Jul 01 19:21:18.082939 ip-10-0-134-212 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 01 19:21:18.082951 ip-10-0-134-212 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 01 19:21:18.082958 ip-10-0-134-212 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 01 19:21:18.083177 ip-10-0-134-212 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 01 19:21:28.222347 ip-10-0-134-212 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 01 19:21:28.222362 ip-10-0-134-212 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 8f211b46b1ed4551a6e5e6e44db0c54e --
Jul 01 19:23:35.526719 ip-10-0-134-212 systemd[1]: Starting Kubernetes Kubelet...
Jul 01 19:23:36.107226 ip-10-0-134-212 systemd[1]: Started Kubernetes Kubelet.
Jul 01 19:23:36.114264 ip-10-0-134-212 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 01 19:23:36.114264 ip-10-0-134-212 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 01 19:23:36.114264 ip-10-0-134-212 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 01 19:23:36.114264 ip-10-0-134-212 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 01 19:23:36.114264 ip-10-0-134-212 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 01 19:23:36.114264 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.001523    2556 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 01 19:23:36.114264 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007070    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 01 19:23:36.114264 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007085    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 01 19:23:36.114264 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007089    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 01 19:23:36.114264 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007092    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 01 19:23:36.114264 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007095    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 01 19:23:36.114264 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007098    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 01 19:23:36.114264 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007101    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 01 19:23:36.114264 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007108    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 01 19:23:36.115756 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007111    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 01 19:23:36.115756 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007113    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 01 19:23:36.115756 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007116    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 01 19:23:36.115756 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007119    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 01 19:23:36.115756 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007122    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 01 19:23:36.115756 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007124    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 01 19:23:36.115756 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007127    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 01 19:23:36.115756 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007130    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 01 19:23:36.115756 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007133    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 01 19:23:36.115756 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007135    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 01 19:23:36.115756 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007138    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 01 19:23:36.115756 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007140    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 01 19:23:36.115756 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007143    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 01 19:23:36.115756 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007146    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 01 19:23:36.115756 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007149    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 01 19:23:36.115756 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007152    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 01 19:23:36.115756 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007156    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 01 19:23:36.115756 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007159    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 01 19:23:36.115756 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007161    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 01 19:23:36.115756 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007163    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 01 19:23:36.123693 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007166    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 01 19:23:36.123693 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007169    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 01 19:23:36.123693 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007172    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 01 19:23:36.123693 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007174    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 01 19:23:36.123693 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007177    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 01 19:23:36.123693 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007180    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 01 19:23:36.123693 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007183    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 01 19:23:36.123693 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007185    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 01 19:23:36.123693 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007188    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 01 19:23:36.123693 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007191    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 01 19:23:36.123693 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007194    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 01 19:23:36.123693 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007196    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 01 19:23:36.123693 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007199    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 01 19:23:36.123693 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007201    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 01 19:23:36.123693 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007204    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 01 19:23:36.123693 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007207    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 01 19:23:36.123693 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007210    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 01 19:23:36.123693 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007213    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 01 19:23:36.123693 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007215    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 01 19:23:36.124572 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007218    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 01 19:23:36.124572 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007220    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 01 19:23:36.124572 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007223    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 01 19:23:36.124572 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007228    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 01 19:23:36.124572 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007231    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 01 19:23:36.124572 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007234    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 01 19:23:36.124572 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007238    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 01 19:23:36.124572 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007241    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 01 19:23:36.124572 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007244    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 01 19:23:36.124572 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007246    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 01 19:23:36.124572 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007249    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 01 19:23:36.124572 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007252    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 01 19:23:36.124572 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007255    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 01 19:23:36.124572 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007257    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 01 19:23:36.124572 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007260    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 01 19:23:36.124572 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007263    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 01 19:23:36.124572 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007265    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 01 19:23:36.124572 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007268    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 01 19:23:36.124572 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007270    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 01 19:23:36.124572 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007273    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 01 19:23:36.126109 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007275    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 01 19:23:36.126109 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007278    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 01 19:23:36.126109 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007280    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 01 19:23:36.126109 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007282    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 01 19:23:36.126109 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007286    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 01 19:23:36.126109 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007288    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 01 19:23:36.126109 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007291    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 01 19:23:36.126109 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007293    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 01 19:23:36.126109 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007296    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 01 19:23:36.126109 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007301    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 01 19:23:36.126109 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007304    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 01 19:23:36.126109 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007307    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 01 19:23:36.126109 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007310    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 01 19:23:36.126109 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007312    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 01 19:23:36.126109 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007314    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 01 19:23:36.126109 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007317    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 01 19:23:36.126109 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007319    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 01 19:23:36.126109 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007322    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 01 19:23:36.126109 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007324    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 01 19:23:36.126921 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007328    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 01 19:23:36.126921 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007332    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 01 19:23:36.126921 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007335    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 01 19:23:36.126921 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007338    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 01 19:23:36.126921 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007341    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 01 19:23:36.126921 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007343    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 01 19:23:36.126921 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007346    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 01 19:23:36.126921 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007348    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 01 19:23:36.126921 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007351    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 01 19:23:36.126921 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007353    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 01 19:23:36.126921 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007356    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 01 19:23:36.126921 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007359    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 01 19:23:36.126921 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.007361    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 01 19:23:36.126921 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008081    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 01 19:23:36.126921 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008087    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 01 19:23:36.126921 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008090    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 01 19:23:36.126921 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008093    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 01 19:23:36.126921 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008096    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 01 19:23:36.126921 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008099    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 01 19:23:36.128624 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008102    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 01 19:23:36.128624 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008104    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 01 19:23:36.128624 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008107    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 01 19:23:36.128624 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008110    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 01 19:23:36.128624 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008113    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 01 19:23:36.128624 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008116    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 01 19:23:36.128624 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008118    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 01 19:23:36.128624 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008121    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 01 19:23:36.128624 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008123    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 01 19:23:36.128624 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008126    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 01 19:23:36.128624 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008128    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 01 19:23:36.128624 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008132    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 01 19:23:36.128624 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008134    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 01 19:23:36.128624 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008137    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 01 19:23:36.128624 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008140    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 01 19:23:36.128624 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008142    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 01 19:23:36.128624 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008145    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 01 19:23:36.128624 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008148    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 01 19:23:36.128624 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008150    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 01 19:23:36.128624 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008153    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 01 19:23:36.129497 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008155    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 01 19:23:36.129497 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008158    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 01 19:23:36.129497 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008161    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 01 19:23:36.129497 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008163    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 01 19:23:36.129497 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008166    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 01 19:23:36.129497 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008168    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 01 19:23:36.129497 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008171    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 01 19:23:36.129497 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008173    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 01 19:23:36.129497 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008176    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 01 19:23:36.129497 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008178    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 01 19:23:36.129497 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008181    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 01 19:23:36.129497 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008183    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 01 19:23:36.129497 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008187    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 01 19:23:36.129497 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008189    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 01 19:23:36.129497 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008192    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 01 19:23:36.129497 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008195    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 01 19:23:36.129497 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008197    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 01 19:23:36.129497 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008200    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 01 19:23:36.129497 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008202    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 01 19:23:36.129497 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008205    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 01 19:23:36.131218 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008207    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 01 19:23:36.131218 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008210    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 01 19:23:36.131218 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008212    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 01 19:23:36.131218 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008215    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 01 19:23:36.131218 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008218    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 01 19:23:36.131218 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008221    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 01 19:23:36.131218 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008223    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 01 19:23:36.131218 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008226    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 01 19:23:36.131218 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008228    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 01 19:23:36.131218 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008231    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 01 19:23:36.131218 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008233    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 01 19:23:36.131218 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008236    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 01 19:23:36.131218 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008238    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 01 19:23:36.131218 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008242    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 01 19:23:36.131218 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008244    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 01 19:23:36.131218 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008246    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 01 19:23:36.131218 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008249    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 01 19:23:36.131218 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008251    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 01 19:23:36.131218 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008254    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 01 19:23:36.131218 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008256    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 01 19:23:36.132096 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008259    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 01 19:23:36.132096 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008261    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 01 19:23:36.132096 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008263    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 01 19:23:36.132096 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008266    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 01 19:23:36.132096 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008268    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 01 19:23:36.132096 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008274    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 01 19:23:36.132096 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008279    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 01 19:23:36.132096 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008283    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 01 19:23:36.132096 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008286    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 01 19:23:36.132096 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008289    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 01 19:23:36.132096 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008291    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 01 19:23:36.132096 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008294    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 01 19:23:36.132096 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008297    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 01 19:23:36.132096 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008300    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 01 19:23:36.132096 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008304    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 01 19:23:36.132096 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008306    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 01 19:23:36.132096 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008309    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 01 19:23:36.132096 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008312    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 01 19:23:36.132096 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008314    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 01 19:23:36.134249 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008317    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 01 19:23:36.134249 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008319    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 01 19:23:36.134249 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008322    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 01 19:23:36.134249 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008324    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 01 19:23:36.134249 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008327    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 01 19:23:36.134249 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008329    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 01 19:23:36.134249 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008333    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 01 19:23:36.134249 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008336    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 01 19:23:36.134249 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008339    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 01 19:23:36.134249 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008342    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 01 19:23:36.134249 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008345    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 01 19:23:36.134249 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008349    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 01 19:23:36.134249 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008352    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 01 19:23:36.134249 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008354    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 01 19:23:36.134249 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008787    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 01 19:23:36.134249 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008795    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 01 19:23:36.134249 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008799    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 01 19:23:36.134249 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008802    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 01 19:23:36.134249 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008807    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 01 19:23:36.135138 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008810    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 01 19:23:36.135138 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008812    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 01 19:23:36.135138 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008815    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 01 19:23:36.135138 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008818    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 01 19:23:36.135138 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008821    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 01 19:23:36.135138 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008823    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 01 19:23:36.135138 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008826    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 01 19:23:36.135138 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008829    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 01 19:23:36.135138 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008831    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 01 19:23:36.135138 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008834    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 01 19:23:36.135138 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008837    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 01 19:23:36.135138 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008839    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 01 19:23:36.135138 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008842    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 01 19:23:36.135138 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008844    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 01 19:23:36.135138 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008847    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 01 19:23:36.135138 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008850    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 01 19:23:36.135138 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008853    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 01 19:23:36.135138 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008855    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 01 19:23:36.135138 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008857    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 01 19:23:36.137290 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008860    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 01 19:23:36.137290 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008863    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 01 19:23:36.137290 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008865    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 01 19:23:36.137290 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008868    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 01 19:23:36.137290 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008870    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 01 19:23:36.137290 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008872    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 01 19:23:36.137290 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008875    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 01 19:23:36.137290 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008877    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 01 19:23:36.137290 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008880    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 01 19:23:36.137290 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008882    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 01 19:23:36.137290 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008885    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 01 19:23:36.137290 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008888    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 01 19:23:36.137290 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008891    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 01 19:23:36.137290 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008894    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 01 19:23:36.137290 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008896    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 01 19:23:36.137290 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008899    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 01 19:23:36.137290 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008901    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 01 19:23:36.137290 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008904    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 01 19:23:36.137290 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008906    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 01 19:23:36.137290 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008909    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 01 19:23:36.138160 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008912    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 01 19:23:36.138160 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008915    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 01 19:23:36.138160 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008918    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 01 19:23:36.138160 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008921    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 01 19:23:36.138160 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008924    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 01 19:23:36.138160 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008926    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 01 19:23:36.138160 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008930    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 01 19:23:36.138160 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008933    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 01 19:23:36.138160 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008936    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 01 19:23:36.138160 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008939    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 01 19:23:36.138160 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008942    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 01 19:23:36.138160 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008944    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 01 19:23:36.138160 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008949    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 01 19:23:36.138160 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008952    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 01 19:23:36.138160 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008954    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 01 19:23:36.138160 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008957    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 01 19:23:36.138160 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008959    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 01 19:23:36.138160 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008962    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 01 19:23:36.138160 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008964    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 01 19:23:36.141169 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008967    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 01 19:23:36.141169 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008969    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 01 19:23:36.141169 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008972    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 01 19:23:36.141169 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008974    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 01 19:23:36.141169 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008977    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 01 19:23:36.141169 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008979    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 01 19:23:36.141169 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008982    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 01 19:23:36.141169 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008986    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 01 19:23:36.141169 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008989    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 01 19:23:36.141169 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008991    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 01 19:23:36.141169 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008994    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 01 19:23:36.141169 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008997    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 01 19:23:36.141169 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.008999    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 01 19:23:36.141169 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009002    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 01 19:23:36.141169 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009005    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 01 19:23:36.141169 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009007    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 01 19:23:36.141169 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009009    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 01 19:23:36.141169 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009012    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 01 19:23:36.141169 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009015    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 01 19:23:36.141169 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009017    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 01 19:23:36.142029 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009022    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 01 19:23:36.142029 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009024    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 01 19:23:36.142029 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009027    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 01 19:23:36.142029 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009029    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 01 19:23:36.142029 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009032    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 01 19:23:36.142029 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009036    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 01 19:23:36.142029 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009038    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 01 19:23:36.142029 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009040    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 01 19:23:36.142029 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009043    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 01 19:23:36.142029 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009045    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 01 19:23:36.142029 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009048    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 01 19:23:36.142029 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009050    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 01 19:23:36.142029 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009054    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 01 19:23:36.142029 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009057    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 01 19:23:36.142029 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009059    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 01 19:23:36.142029 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009062    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 01 19:23:36.142029 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009133    2556 flags.go:64] FLAG: --address="0.0.0.0"
Jul 01 19:23:36.142029 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009144    2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 01 19:23:36.142029 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009151    2556 flags.go:64] FLAG: --anonymous-auth="true"
Jul 01 19:23:36.142029 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009155    2556 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 01 19:23:36.142029 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009161    2556 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 01 19:23:36.302578 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009164    2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 01 19:23:36.302578 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009169    2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 01 19:23:36.302578 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009173    2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 01 19:23:36.302578 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009176    2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 01 19:23:36.302578 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009179    2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 01 19:23:36.302578 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009183    2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 01 19:23:36.302578 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009186    2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 01 19:23:36.302578 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009189    2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 01 19:23:36.302578 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009192    2556 flags.go:64] FLAG: --cgroup-root=""
Jul 01 19:23:36.302578 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009195    2556 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 01 19:23:36.302578 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009198    2556 flags.go:64] FLAG: --client-ca-file=""
Jul 01 19:23:36.302578 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009202    2556 flags.go:64] FLAG: --cloud-provider="external"
Jul 01 19:23:36.302578 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009205    2556 flags.go:64] FLAG: --cluster-dns="[]"
Jul 01 19:23:36.302578 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009210    2556 flags.go:64] FLAG: --cluster-domain=""
Jul 01 19:23:36.302578 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009213    2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 01 19:23:36.302578 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009216    2556 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 01 19:23:36.302578 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009221    2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 01 19:23:36.302578 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009224    2556 flags.go:64] FLAG: --container-log-max-files="5"
Jul 01 19:23:36.302578 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009228    2556 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 01 19:23:36.302578 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009231    2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 01 19:23:36.302578 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009234    2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 01 19:23:36.302578 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009238    2556 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 01 19:23:36.302578 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009241    2556 flags.go:64] FLAG: --contention-profiling="false"
Jul 01 19:23:36.302578 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009244    2556 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 01 19:23:36.318034 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009247    2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 01 19:23:36.318034 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009250    2556 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 01 19:23:36.318034 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009253    2556 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 01 19:23:36.318034 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009257    2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 01 19:23:36.318034 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009260    2556 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 01 19:23:36.318034 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009263    2556 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 01 19:23:36.318034 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009266    2556 flags.go:64] FLAG: --enable-load-reader="false"
Jul 01 19:23:36.318034 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009269    2556 flags.go:64] FLAG: --enable-server="true"
Jul 01 19:23:36.318034 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009273    2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 01 19:23:36.318034 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009277    2556 flags.go:64] FLAG: --event-burst="100"
Jul 01 19:23:36.318034 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009280    2556 flags.go:64] FLAG: --event-qps="50"
Jul 01 19:23:36.318034 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009283    2556 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 01 19:23:36.318034 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009286    2556 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 01 19:23:36.318034 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009289    2556 flags.go:64] FLAG: --eviction-hard=""
Jul 01 19:23:36.318034 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009293    2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 01 19:23:36.318034 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009295    2556 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 01 19:23:36.318034 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009298    2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 01 19:23:36.318034 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009301    2556 flags.go:64] FLAG: --eviction-soft=""
Jul 01 19:23:36.318034 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009304    2556 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 01 19:23:36.318034 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009308    2556 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 01 19:23:36.318034 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009311    2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 01 19:23:36.318034 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009314    2556 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 01 19:23:36.318034 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009317    2556 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 01 19:23:36.318034 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009320    2556 flags.go:64] FLAG: --fail-swap-on="true"
Jul 01 19:23:36.318034 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009324    2556 flags.go:64] FLAG: --feature-gates=""
Jul 01 19:23:36.319151 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009328    2556 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 01 19:23:36.319151 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009331    2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 01 19:23:36.319151 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009334    2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 01 19:23:36.319151 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009337    2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 01 19:23:36.319151 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009340    2556 flags.go:64] FLAG: --healthz-port="10248"
Jul 01 19:23:36.319151 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009343    2556 flags.go:64] FLAG: --help="false"
Jul 01 19:23:36.319151 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009346    2556 flags.go:64] FLAG: --hostname-override="ip-10-0-134-212.ec2.internal"
Jul 01 19:23:36.319151 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009349    2556 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 01 19:23:36.319151 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009352    2556 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 01 19:23:36.319151 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009354    2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 01 19:23:36.319151 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009357    2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 01 19:23:36.319151 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009361    2556 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 01 19:23:36.319151 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009364    2556 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 01 19:23:36.319151 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009380    2556 flags.go:64] FLAG: --image-service-endpoint=""
Jul 01 19:23:36.319151 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009383    2556 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 01 19:23:36.319151 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009392    2556 flags.go:64] FLAG: --kube-api-burst="100"
Jul 01 19:23:36.319151 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009401    2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 01 19:23:36.319151 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009404    2556 flags.go:64] FLAG: --kube-api-qps="50"
Jul 01 19:23:36.319151 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009407    2556 flags.go:64] FLAG: --kube-reserved=""
Jul 01 19:23:36.319151 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009410    2556 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 01 19:23:36.319151 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009413    2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 01 19:23:36.319151 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009416    2556 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 01 19:23:36.319151 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009419    2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 01 19:23:36.319151 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009421    2556 flags.go:64] FLAG: --lock-file=""
Jul 01 19:23:36.320385 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009424    2556 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 01 19:23:36.320385 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009427    2556 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 01 19:23:36.320385 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009431    2556 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 01 19:23:36.320385 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009437    2556 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 01 19:23:36.320385 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009440    2556 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 01 19:23:36.320385 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009442    2556 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 01 19:23:36.320385 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009445    2556 flags.go:64] FLAG: --logging-format="text"
Jul 01 19:23:36.320385 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009450    2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 01 19:23:36.320385 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009453    2556 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 01 19:23:36.320385 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009456    2556 flags.go:64] FLAG: --manifest-url=""
Jul 01 19:23:36.320385 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009461    2556 flags.go:64] FLAG: --manifest-url-header=""
Jul 01 19:23:36.320385 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009473    2556 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 01 19:23:36.320385 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009476    2556 flags.go:64] FLAG: --max-open-files="1000000"
Jul 01 19:23:36.320385 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009480    2556 flags.go:64] FLAG: --max-pods="110"
Jul 01 19:23:36.320385 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009483    2556 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 01 19:23:36.320385 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009486    2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 01 19:23:36.320385 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009489    2556 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 01 19:23:36.320385 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009491    2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 01 19:23:36.320385 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009494    2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 01 19:23:36.320385 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009498    2556 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 01 19:23:36.320385 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009501    2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 01 19:23:36.320385 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009514    2556 flags.go:64] FLAG: --node-status-max-images="50"
Jul 01 19:23:36.320385 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009517    2556 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 01 19:23:36.320385 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009520    2556 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 01 19:23:36.320385 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009523    2556 flags.go:64] FLAG: --pod-cidr=""
Jul 01 19:23:36.322906 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009531    2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04"
Jul 01 19:23:36.322906 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009537    2556 flags.go:64] FLAG: --pod-manifest-path=""
Jul 01 19:23:36.322906 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009540    2556 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 01 19:23:36.322906 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009543    2556 flags.go:64] FLAG: --pods-per-core="0"
Jul 01 19:23:36.322906 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009546    2556 flags.go:64] FLAG: --port="10250"
Jul 01 19:23:36.322906 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009549    2556 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 01 19:23:36.322906 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009552    2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04d57e46352e48e6d"
Jul 01 19:23:36.322906 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009555    2556 flags.go:64] FLAG: --qos-reserved=""
Jul 01 19:23:36.322906 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009558    2556 flags.go:64] FLAG: --read-only-port="10255"
Jul 01 19:23:36.322906 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009561    2556 flags.go:64] FLAG: --register-node="true"
Jul 01 19:23:36.322906 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009566    2556 flags.go:64] FLAG: --register-with-taints=""
Jul 01 19:23:36.322906 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009569    2556 flags.go:64] FLAG: --registry-burst="10"
Jul 01 19:23:36.322906 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009572    2556 flags.go:64] FLAG: --registry-qps="5"
Jul 01 19:23:36.322906 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009575    2556 flags.go:64] FLAG: --reserved-cpus=""
Jul 01 19:23:36.322906 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009579    2556 flags.go:64] FLAG: --reserved-memory=""
Jul 01 19:23:36.322906 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009583    2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 01 19:23:36.322906 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009586    2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 01 19:23:36.322906 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009589    2556 flags.go:64] FLAG: --rotate-certificates="false"
Jul 01 19:23:36.322906 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009592    2556 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 01 19:23:36.322906 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009595    2556 flags.go:64] FLAG: --runonce="false"
Jul 01 19:23:36.322906 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009598    2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 01 19:23:36.322906 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009601    2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 01 19:23:36.322906 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009604    2556 flags.go:64] FLAG: --seccomp-default="false"
Jul 01 19:23:36.322906 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009607    2556 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 01 19:23:36.322906 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009610    2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 01 19:23:36.324222 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009613    2556 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 01 19:23:36.324222 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009616    2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 01 19:23:36.324222 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009619    2556 flags.go:64] FLAG: --storage-driver-password="root"
Jul 01 19:23:36.324222 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009622    2556 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 01 19:23:36.324222 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009625    2556 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 01 19:23:36.324222 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009627    2556 flags.go:64] FLAG: --storage-driver-user="root"
Jul 01 19:23:36.324222 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009630    2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 01 19:23:36.324222 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009633    2556 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 01 19:23:36.324222 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009637    2556 flags.go:64] FLAG: --system-cgroups=""
Jul 01 19:23:36.324222 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009639    2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 01 19:23:36.324222 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009644    2556 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 01 19:23:36.324222 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009647    2556 flags.go:64] FLAG: --tls-cert-file=""
Jul 01 19:23:36.324222 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009650    2556 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 01 19:23:36.324222 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009656    2556 flags.go:64] FLAG: --tls-min-version=""
Jul 01 19:23:36.324222 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009659    2556 flags.go:64] FLAG: --tls-private-key-file=""
Jul 01 19:23:36.324222 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009662    2556 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 01 19:23:36.324222 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009664    2556 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 01 19:23:36.324222 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009669    2556 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 01 19:23:36.324222 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009672    2556 flags.go:64] FLAG: --v="2"
Jul 01 19:23:36.324222 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009676    2556 flags.go:64] FLAG: --version="false"
Jul 01 19:23:36.324222 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009683    2556 flags.go:64] FLAG: --vmodule=""
Jul 01 19:23:36.324222 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009688    2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 01 19:23:36.324222 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.009691    2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 01 19:23:36.324222 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009813    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 01 19:23:36.324222 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009818    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 01 19:23:36.327644 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009821    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 01 19:23:36.327644 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009824    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 01 19:23:36.327644 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009827    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 01 19:23:36.327644 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009830    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 01 19:23:36.327644 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009833    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 01 19:23:36.327644 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009835    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 01 19:23:36.327644 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009838    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 01 19:23:36.327644 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009840    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 01 19:23:36.327644 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009843    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 01 19:23:36.327644 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009845    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 01 19:23:36.327644 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009848    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 01 19:23:36.327644 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009851    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 01 19:23:36.327644 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009853    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 01 19:23:36.327644 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009856    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 01 19:23:36.327644 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009858    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 01 19:23:36.327644 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009861    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 01 19:23:36.327644 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009864    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 01 19:23:36.327644 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009867    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 01 19:23:36.327644 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009869    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 01 19:23:36.327644 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009872    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 01 19:23:36.328741 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009874    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 01 19:23:36.328741 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009877    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 01 19:23:36.328741 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009879    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 01 19:23:36.328741 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009882    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 01 19:23:36.328741 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009888    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 01 19:23:36.328741 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009891    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 01 19:23:36.328741 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009893    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 01 19:23:36.328741 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009896    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 01 19:23:36.328741 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009900    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 01 19:23:36.328741 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009902    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 01 19:23:36.328741 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009904    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 01 19:23:36.328741 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009907    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 01 19:23:36.328741 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009910    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 01 19:23:36.328741 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009913    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 01 19:23:36.328741 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009915    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 01 19:23:36.328741 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009917    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 01 19:23:36.328741 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009920    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 01 19:23:36.328741 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009922    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 01 19:23:36.328741 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009925    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 01 19:23:36.328741 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009928    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 01 19:23:36.331743 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009930    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 01 19:23:36.331743 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009933    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 01 19:23:36.331743 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009935    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 01 19:23:36.331743 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009940    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 01 19:23:36.331743 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009943    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 01 19:23:36.331743 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009946    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 01 19:23:36.331743 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009949    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 01 19:23:36.331743 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009952    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 01 19:23:36.331743 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009954    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 01 19:23:36.331743 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009960    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 01 19:23:36.331743 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009963    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 01 19:23:36.331743 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009966    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 01 19:23:36.331743 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009968    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 01 19:23:36.331743 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009970    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 01 19:23:36.331743 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009973    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 01 19:23:36.331743 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009975    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 01 19:23:36.331743 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009979    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 01 19:23:36.331743 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009982    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 01 19:23:36.331743 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009984    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 01 19:23:36.331743 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009987    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 01 19:23:36.332623 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009991    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 01 19:23:36.332623 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009993    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 01 19:23:36.332623 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009996    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 01 19:23:36.332623 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.009998    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 01 19:23:36.332623 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.010001    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 01 19:23:36.332623 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.010004    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 01 19:23:36.332623 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.010006    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 01 19:23:36.332623 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.010009    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 01 19:23:36.332623 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.010012    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 01 19:23:36.332623 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.010014    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 01 19:23:36.332623 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.010017    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 01 19:23:36.332623 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.010020    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 01 19:23:36.332623 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.010022    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 01 19:23:36.332623 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.010025    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 01 19:23:36.332623 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.010028    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 01 19:23:36.332623 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.010032    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 01 19:23:36.332623 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.010034    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 01 19:23:36.332623 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.010038    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 01 19:23:36.332623 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.010040    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 01 19:23:36.335228 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.010043    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 01 19:23:36.335228 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.010045    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 01 19:23:36.335228 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.010048    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 01 19:23:36.335228 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.010056    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 01 19:23:36.335228 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.010059    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 01 19:23:36.335228 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.010062    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 01 19:23:36.335228 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.010064    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 01 19:23:36.335228 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.010067    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 01 19:23:36.335228 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.010069    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 01 19:23:36.335228 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.010073    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 01 19:23:36.335228 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.010076    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 01 19:23:36.335228 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.010078    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 01 19:23:36.335228 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.010082    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 01 19:23:36.335228 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.010087    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 01 19:23:36.335228 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.010090    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 01 19:23:36.335228 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.010092    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 01 19:23:36.335228 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.010095    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 01 19:23:36.335228 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.010098    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 01 19:23:36.336122 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.013205    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 01 19:23:36.336122 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.020075    2556 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 01 19:23:36.336122 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.020095    2556 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 01 19:23:36.336122 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.020115    2556 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 01 19:23:36.336122 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.020121    2556 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 01 19:23:36.336122 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020183    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 01 19:23:36.336122 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020188    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 01 19:23:36.336122 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020192    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 01 19:23:36.336122 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020195    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 01 19:23:36.336122 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020198    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 01 19:23:36.336122 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020201    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 01 19:23:36.336122 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020204    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 01 19:23:36.336122 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020207    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 01 19:23:36.336122 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020210    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 01 19:23:36.338107 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020213    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 01 19:23:36.338107 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020216    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 01 19:23:36.338107 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020218    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 01 19:23:36.338107 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020221    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 01 19:23:36.338107 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020224    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 01 19:23:36.338107 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020227    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 01 19:23:36.338107 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020229    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 01 19:23:36.338107 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020232    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 01 19:23:36.338107 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020234    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 01 19:23:36.338107 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020237    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 01 19:23:36.338107 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020240    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 01 19:23:36.338107 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020244    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 01 19:23:36.338107 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020247    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 01 19:23:36.338107 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020250    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 01 19:23:36.338107 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020254    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 01 19:23:36.338107 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020257    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 01 19:23:36.338107 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020260    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 01 19:23:36.338107 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020263    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 01 19:23:36.338107 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020266    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 01 19:23:36.338107 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020269    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 01 19:23:36.338982 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020278    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 01 19:23:36.338982 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020281    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 01 19:23:36.338982 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020284    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 01 19:23:36.338982 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020286    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 01 19:23:36.338982 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020289    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 01 19:23:36.338982 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020291    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 01 19:23:36.338982 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020294    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 01 19:23:36.338982 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020298    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 01 19:23:36.338982 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020301    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 01 19:23:36.338982 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020304    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 01 19:23:36.338982 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020307    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 01 19:23:36.338982 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020310    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 01 19:23:36.338982 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020313    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 01 19:23:36.338982 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020315    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 01 19:23:36.338982 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020318    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 01 19:23:36.338982 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020321    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 01 19:23:36.338982 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020323    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 01 19:23:36.338982 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020326    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 01 19:23:36.338982 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020328    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 01 19:23:36.341794 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020331    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 01 19:23:36.341794 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020333    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 01 19:23:36.341794 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020335    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 01 19:23:36.341794 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020338    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 01 19:23:36.341794 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020340    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 01 19:23:36.341794 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020343    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 01 19:23:36.341794 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020345    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 01 19:23:36.341794 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020347    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 01 19:23:36.341794 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020350    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 01 19:23:36.341794 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020353    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 01 19:23:36.341794 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020356    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 01 19:23:36.341794 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020359    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 01 19:23:36.341794 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020361    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 01 19:23:36.341794 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020364    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 01 19:23:36.341794 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020387    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 01 19:23:36.341794 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020390    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 01 19:23:36.341794 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020393    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 01 19:23:36.341794 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020395    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 01 19:23:36.341794 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020398    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 01 19:23:36.341794 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020401    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 01 19:23:36.342675 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020403    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 01 19:23:36.342675 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020406    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 01 19:23:36.342675 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020409    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 01 19:23:36.342675 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020412    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 01 19:23:36.342675 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020414    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 01 19:23:36.342675 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020417    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 01 19:23:36.342675 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020419    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 01 19:23:36.342675 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020422    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 01 19:23:36.342675 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020425    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 01 19:23:36.342675 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020427    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 01 19:23:36.342675 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020430    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 01 19:23:36.342675 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020432    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 01 19:23:36.342675 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020435    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 01 19:23:36.342675 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020438    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 01 19:23:36.342675 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020441    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 01 19:23:36.342675 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020444    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 01 19:23:36.342675 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020447    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 01 19:23:36.342675 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020449    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 01 19:23:36.342675 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020452    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 01 19:23:36.342675 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020454    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 01 19:23:36.346172 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020457    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 01 19:23:36.346172 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020460    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 01 19:23:36.346172 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020462    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 01 19:23:36.346172 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020468    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 01 19:23:36.346172 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020471    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 01 19:23:36.346172 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020473    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 01 19:23:36.346172 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020475    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 01 19:23:36.346172 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020488    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 01 19:23:36.346172 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020490    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 01 19:23:36.346172 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020493    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 01 19:23:36.346172 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020496    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 01 19:23:36.346172 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.020501    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 01 19:23:36.346172 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020664    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 01 19:23:36.346172 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020670    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 01 19:23:36.346172 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020673    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 01 19:23:36.347053 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020676    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 01 19:23:36.347053 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020679    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 01 19:23:36.347053 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020682    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 01 19:23:36.347053 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020685    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 01 19:23:36.347053 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020704    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 01 19:23:36.347053 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020708    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 01 19:23:36.347053 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020711    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 01 19:23:36.347053 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020714    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 01 19:23:36.347053 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020717    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 01 19:23:36.347053 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020720    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 01 19:23:36.347053 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020723    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 01 19:23:36.347053 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020726    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 01 19:23:36.347053 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020728    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 01 19:23:36.347053 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020731    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 01 19:23:36.347053 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020734    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 01 19:23:36.347053 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020736    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 01 19:23:36.347053 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020739    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 01 19:23:36.347053 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020744    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 01 19:23:36.347053 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020746    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 01 19:23:36.347053 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020749    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 01 19:23:36.347957 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020751    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 01 19:23:36.347957 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020756    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 01 19:23:36.347957 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020758    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 01 19:23:36.347957 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020761    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 01 19:23:36.347957 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020763    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 01 19:23:36.347957 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020773    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 01 19:23:36.347957 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020777    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 01 19:23:36.347957 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020780    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 01 19:23:36.347957 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020783    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 01 19:23:36.347957 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020785    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 01 19:23:36.347957 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020788    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 01 19:23:36.347957 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020790    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 01 19:23:36.347957 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020793    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 01 19:23:36.347957 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020795    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 01 19:23:36.347957 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020798    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 01 19:23:36.347957 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020800    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 01 19:23:36.347957 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020803    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 01 19:23:36.347957 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020806    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 01 19:23:36.347957 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020808    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 01 19:23:36.347957 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020810    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 01 19:23:36.453388 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020813    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 01 19:23:36.453388 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020816    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 01 19:23:36.453388 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020818    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 01 19:23:36.453388 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020821    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 01 19:23:36.453388 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020823    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 01 19:23:36.453388 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020826    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 01 19:23:36.453388 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020828    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 01 19:23:36.453388 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020831    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 01 19:23:36.453388 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020833    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 01 19:23:36.453388 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020837    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 01 19:23:36.453388 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020840    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 01 19:23:36.453388 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020843    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 01 19:23:36.453388 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020845    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 01 19:23:36.453388 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020849    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 01 19:23:36.453388 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020852    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 01 19:23:36.453388 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020854    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 01 19:23:36.453388 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020857    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 01 19:23:36.453388 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020860    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 01 19:23:36.453388 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020868    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 01 19:23:36.453388 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020871    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 01 19:23:36.454675 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020873    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 01 19:23:36.454675 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020876    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 01 19:23:36.454675 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020878    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 01 19:23:36.454675 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020881    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 01 19:23:36.454675 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020883    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 01 19:23:36.454675 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020886    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 01 19:23:36.454675 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020889    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 01 19:23:36.454675 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020891    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 01 19:23:36.454675 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020893    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 01 19:23:36.454675 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020896    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 01 19:23:36.454675 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020898    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 01 19:23:36.454675 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020901    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 01 19:23:36.454675 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020903    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 01 19:23:36.454675 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020906    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 01 19:23:36.454675 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020908    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 01 19:23:36.454675 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020911    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 01 19:23:36.454675 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020913    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 01 19:23:36.454675 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020916    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 01 19:23:36.454675 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020918    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 01 19:23:36.455778 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020920    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 01 19:23:36.455778 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020924    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 01 19:23:36.455778 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020929    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 01 19:23:36.455778 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020932    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 01 19:23:36.455778 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020934    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 01 19:23:36.455778 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020937    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 01 19:23:36.455778 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020940    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 01 19:23:36.455778 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020943    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 01 19:23:36.455778 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020946    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 01 19:23:36.455778 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020948    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 01 19:23:36.455778 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020951    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 01 19:23:36.455778 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020953    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 01 19:23:36.455778 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020962    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 01 19:23:36.455778 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020964    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 01 19:23:36.455778 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020967    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 01 19:23:36.455778 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020969    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 01 19:23:36.455778 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:36.020973    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 01 19:23:36.457722 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.020978    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 01 19:23:36.457722 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.021124    2556 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 01 19:23:36.457722 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.023475    2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 01 19:23:36.457722 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.030171    2556 server.go:1019] "Starting client certificate rotation"
Jul 01 19:23:36.457722 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.030273    2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 01 19:23:36.457722 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.030346    2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 01 19:23:36.457722 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.032894    2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 01 19:23:36.457722 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.049984    2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 01 19:23:36.457722 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.063242    2556 log.go:25] "Validated CRI v1 runtime API"
Jul 01 19:23:36.457722 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.063723    2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 01 19:23:36.457722 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.065762    2556 log.go:25] "Validated CRI v1 image API"
Jul 01 19:23:36.457722 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.066588    2556 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 01 19:23:36.458397 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.069389    2556 fs.go:135] Filesystem UUIDs: map[099e29ff-972d-4fbf-bd72-33152f8e0c23:/dev/nvme0n1p3 76f80ea0-61fc-415d-a028-c7ae90a956f5:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 01 19:23:36.458397 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.069411    2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 01 19:23:36.460391 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.079829    2556 manager.go:216] Machine: {Timestamp:2026-07-01 19:23:36.074295266 +0000 UTC m=+0.437306941 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3086671 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2446eaca33e8d56db12b04f643f215 SystemUUID:ec2446ea-ca33-e8d5-6db1-2b04f643f215 BootID:8f211b46-b1ed-4551-a6e5-e6e44db0c54e Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:88:54:cb:df:11 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:88:54:cb:df:11 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e6:25:f9:25:81:ae Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 01 19:23:36.460391 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.079941    2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 01 19:23:36.460391 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.080074    2556 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 01 19:23:36.460391 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.083439    2556 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 01 19:23:36.460391 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.083467    2556 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-212.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 01 19:23:36.460391 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.084764    2556 topology_manager.go:138] "Creating topology manager with none policy"
Jul 01 19:23:36.460391 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.084787    2556 container_manager_linux.go:309] "Creating device plugin manager"
Jul 01 19:23:36.460391 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.084795    2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 01 19:23:36.460391 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.085567    2556 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 01 19:23:36.460391 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.086409    2556 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 01 19:23:36.460391 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.087922    2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xdrlt"
Jul 01 19:23:36.460391 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.089134    2556 state_mem.go:36] "Initialized new in-memory state store"
Jul 01 19:23:36.460391 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.089268    2556 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 01 19:23:36.460391 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.089307    2556 kubelet.go:486] "Attempting to sync node with API server"
Jul 01 19:23:36.460391 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.089320    2556 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 01 19:23:36.460391 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.089330    2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 01 19:23:36.460391 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.089360    2556 kubelet.go:398] "Adding apiserver pod source"
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.089393    2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.089805    2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.089819    2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.092234    2556 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.098290    2556 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.098306    2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xdrlt"
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.098319    2556 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.098999    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.099016    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.099024    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.099030    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.099038    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.099043    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.099079    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.099088    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.099099    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.099109    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.099123    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.099140    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.099169    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.099177    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:36.101928    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.102098    2556 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-212.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:36.102212    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-212.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.102656    2556 server.go:1268] "Started kubelet"
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.102735    2556 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.107303    2556 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.107463    2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.108432    2556 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:36.148811    2556 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.149472    2556 server.go:310] "Adding debug handlers to kubelet server"
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.158017    2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.158035    2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:36.158103    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-212.ec2.internal\" not found"
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.158581    2556 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.158604    2556 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.158625    2556 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.158768    2556 reconstruct.go:97] "Volume reconstruction finished"
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.158778    2556 reconciler.go:29] "Reconciler: start to sync state"
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.158970    2556 factory.go:55] Registering systemd factory
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.158987    2556 factory.go:223] Registration of the systemd container factory successfully
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.159201    2556 factory.go:153] Registering CRI-O factory
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.159216    2556 factory.go:223] Registration of the crio container factory successfully
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.159271    2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.159296    2556 factory.go:103] Registering Raw factory
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.159308    2556 manager.go:1196] Started watching for new ooms in manager
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.159779    2556 manager.go:349] Starting recovery of all containers
Jul 01 19:23:36.463241 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.160336    2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 01 19:23:36.465269 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:36.164053    2556 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-212.ec2.internal\" not found" node="ip-10-0-134-212.ec2.internal"
Jul 01 19:23:36.465269 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.174596    2556 manager.go:354] Recovery completed
Jul 01 19:23:36.465269 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.178988    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 01 19:23:36.465269 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.180709    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-212.ec2.internal" event="NodeHasSufficientMemory"
Jul 01 19:23:36.465269 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.180736    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-212.ec2.internal" event="NodeHasNoDiskPressure"
Jul 01 19:23:36.465269 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.180747    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-212.ec2.internal" event="NodeHasSufficientPID"
Jul 01 19:23:36.465269 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.181268    2556 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 01 19:23:36.465269 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.181277    2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 01 19:23:36.465269 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.181293    2556 state_mem.go:36] "Initialized new in-memory state store"
Jul 01 19:23:36.465269 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.181292    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 01 19:23:36.465269 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.182083    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-212.ec2.internal" event="NodeHasSufficientMemory"
Jul 01 19:23:36.465269 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.182109    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-212.ec2.internal" event="NodeHasNoDiskPressure"
Jul 01 19:23:36.465269 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.182118    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-212.ec2.internal" event="NodeHasSufficientPID"
Jul 01 19:23:36.465269 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.182609    2556 policy_none.go:49] "None policy: Start"
Jul 01 19:23:36.465269 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.182623    2556 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 01 19:23:36.465269 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.182633    2556 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 01 19:23:36.465269 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.183705    2556 policy_none.go:47] "Start"
Jul 01 19:23:36.465269 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.233074    2556 manager.go:337] "Starting Device Plugin manager"
Jul 01 19:23:36.465269 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:36.233269    2556 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 01 19:23:36.465269 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.233280    2556 server.go:87] "Starting device plugin registration server"
Jul 01 19:23:36.465269 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.233535    2556 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 01 19:23:36.465269 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.233547    2556 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 01 19:23:36.465269 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.233649    2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 01 19:23:36.465269 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.233738    2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 01 19:23:36.465269 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.233747    2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 01 19:23:36.465269 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:36.234316    2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 01 19:23:36.465269 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:36.234379    2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-212.ec2.internal\" not found"
Jul 01 19:23:36.465269 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.248119    2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 01 19:23:36.465269 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.249275    2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 01 19:23:36.465269 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.249307    2556 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 01 19:23:36.465269 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.249329    2556 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 01 19:23:36.465269 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:36.249358    2556 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 01 19:23:36.465269 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.252156    2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 01 19:23:36.465269 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.334285    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 01 19:23:36.465269 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.335774    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-212.ec2.internal" event="NodeHasSufficientMemory"
Jul 01 19:23:36.465269 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.335799    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-212.ec2.internal" event="NodeHasNoDiskPressure"
Jul 01 19:23:36.465269 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.335809    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-212.ec2.internal" event="NodeHasSufficientPID"
Jul 01 19:23:36.465269 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.335836    2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-212.ec2.internal"
Jul 01 19:23:36.465269 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.356512    2556 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-212.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-212.ec2.internal"]
Jul 01 19:23:36.465269 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.356584    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 01 19:23:36.465269 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.358761    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-212.ec2.internal" event="NodeHasSufficientMemory"
Jul 01 19:23:36.465269 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.358786    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-212.ec2.internal" event="NodeHasNoDiskPressure"
Jul 01 19:23:36.465269 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.358795    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-212.ec2.internal" event="NodeHasSufficientPID"
Jul 01 19:23:36.465269 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.360205    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 01 19:23:36.465269 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.360335    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-212.ec2.internal"
Jul 01 19:23:36.465269 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.360362    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 01 19:23:36.582778 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.361059    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ba6d1208eed95769604e1c9127dc48d4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-212.ec2.internal\" (UID: \"ba6d1208eed95769604e1c9127dc48d4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-212.ec2.internal"
Jul 01 19:23:36.582778 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.361078    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba6d1208eed95769604e1c9127dc48d4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-212.ec2.internal\" (UID: \"ba6d1208eed95769604e1c9127dc48d4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-212.ec2.internal"
Jul 01 19:23:36.582778 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.361470    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-212.ec2.internal" event="NodeHasSufficientMemory"
Jul 01 19:23:36.582778 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.361495    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-212.ec2.internal" event="NodeHasNoDiskPressure"
Jul 01 19:23:36.582778 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.361504    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-212.ec2.internal" event="NodeHasSufficientPID"
Jul 01 19:23:36.582778 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.361979    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-212.ec2.internal" event="NodeHasSufficientMemory"
Jul 01 19:23:36.582778 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.362000    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-212.ec2.internal" event="NodeHasNoDiskPressure"
Jul 01 19:23:36.582778 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.362018    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-212.ec2.internal" event="NodeHasSufficientPID"
Jul 01 19:23:36.582778 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.362634    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-212.ec2.internal"
Jul 01 19:23:36.582778 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.362660    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 01 19:23:36.582778 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.362909    2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-212.ec2.internal"
Jul 01 19:23:36.582778 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:36.362926    2556 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-212.ec2.internal\": node \"ip-10-0-134-212.ec2.internal\" not found"
Jul 01 19:23:36.582778 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.365490    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-212.ec2.internal" event="NodeHasSufficientMemory"
Jul 01 19:23:36.582778 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.365514    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-212.ec2.internal" event="NodeHasNoDiskPressure"
Jul 01 19:23:36.582778 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.365525    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-212.ec2.internal" event="NodeHasSufficientPID"
Jul 01 19:23:36.582778 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:36.383677    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-212.ec2.internal\" not found"
Jul 01 19:23:36.582778 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:36.402722    2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-212.ec2.internal\" not found" node="ip-10-0-134-212.ec2.internal"
Jul 01 19:23:36.582778 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:36.407157    2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-212.ec2.internal\" not found" node="ip-10-0-134-212.ec2.internal"
Jul 01 19:23:36.582778 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.461595    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ba6d1208eed95769604e1c9127dc48d4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-212.ec2.internal\" (UID: \"ba6d1208eed95769604e1c9127dc48d4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-212.ec2.internal"
Jul 01 19:23:36.582778 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.461629    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba6d1208eed95769604e1c9127dc48d4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-212.ec2.internal\" (UID: \"ba6d1208eed95769604e1c9127dc48d4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-212.ec2.internal"
Jul 01 19:23:36.582778 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.461652    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2a4e7494ec4e45c9b53bd4ccf02e8194-config\") pod \"kube-apiserver-proxy-ip-10-0-134-212.ec2.internal\" (UID: \"2a4e7494ec4e45c9b53bd4ccf02e8194\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-212.ec2.internal"
Jul 01 19:23:36.582778 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.461708    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ba6d1208eed95769604e1c9127dc48d4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-212.ec2.internal\" (UID: \"ba6d1208eed95769604e1c9127dc48d4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-212.ec2.internal"
Jul 01 19:23:36.582778 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.461719    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba6d1208eed95769604e1c9127dc48d4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-212.ec2.internal\" (UID: \"ba6d1208eed95769604e1c9127dc48d4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-212.ec2.internal"
Jul 01 19:23:36.582778 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:36.483999    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-212.ec2.internal\" not found"
Jul 01 19:23:36.582778 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.562097    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2a4e7494ec4e45c9b53bd4ccf02e8194-config\") pod \"kube-apiserver-proxy-ip-10-0-134-212.ec2.internal\" (UID: \"2a4e7494ec4e45c9b53bd4ccf02e8194\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-212.ec2.internal"
Jul 01 19:23:36.583527 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.562162    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2a4e7494ec4e45c9b53bd4ccf02e8194-config\") pod \"kube-apiserver-proxy-ip-10-0-134-212.ec2.internal\" (UID: \"2a4e7494ec4e45c9b53bd4ccf02e8194\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-212.ec2.internal"
Jul 01 19:23:36.584247 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:36.584208    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-212.ec2.internal\" not found"
Jul 01 19:23:36.684968 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:36.684923    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-212.ec2.internal\" not found"
Jul 01 19:23:36.706111 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.706077    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-212.ec2.internal"
Jul 01 19:23:36.711164 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:36.711144    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-212.ec2.internal"
Jul 01 19:23:36.785361 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:36.785317    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-212.ec2.internal\" not found"
Jul 01 19:23:36.885889 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:36.885831    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-212.ec2.internal\" not found"
Jul 01 19:23:36.986324 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:36.986295    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-212.ec2.internal\" not found"
Jul 01 19:23:37.004327 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.004303    2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 01 19:23:37.023802 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.023773    2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 01 19:23:37.023940 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.023920    2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 01 19:23:37.024015 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.023954    2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 01 19:23:37.024015 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.023971    2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 01 19:23:37.059123 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.059087    2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-212.ec2.internal"
Jul 01 19:23:37.077930 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.077903    2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 01 19:23:37.079750 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.079736    2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-212.ec2.internal"
Jul 01 19:23:37.090097 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.090079    2556 apiserver.go:52] "Watching apiserver"
Jul 01 19:23:37.092492 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.092478    2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 01 19:23:37.098868 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.098853    2556 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 01 19:23:37.101030 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.101009    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-jpfpn","openshift-dns/node-resolver-trspk","openshift-image-registry/node-ca-gql7j","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-212.ec2.internal","openshift-network-diagnostics/network-check-target-g7lwk","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qrmf","openshift-multus/multus-2k92k","openshift-multus/multus-additional-cni-plugins-z4m25","openshift-multus/network-metrics-daemon-7mfxn","openshift-network-operator/iptables-alerter-5c4z2","openshift-ovn-kubernetes/ovnkube-node-2tq4l","kube-system/global-pull-secret-syncer-9znvt","kube-system/konnectivity-agent-szp8f","kube-system/kube-apiserver-proxy-ip-10-0-134-212.ec2.internal"]
Jul 01 19:23:37.101980 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.101944    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-30 19:18:36 +0000 UTC" deadline="2027-12-30 21:01:31.941209289 +0000 UTC"
Jul 01 19:23:37.102031 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.101980    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13129h37m54.839231341s"
Jul 01 19:23:37.102379 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.102357    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jpfpn"
Jul 01 19:23:37.103336 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.103322    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-trspk"
Jul 01 19:23:37.104353 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.104329    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gql7j"
Jul 01 19:23:37.104481 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.104465    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-krxcm\""
Jul 01 19:23:37.104838 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.104821    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 01 19:23:37.104838 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.104829    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 01 19:23:37.105340 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.105328    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7lwk"
Jul 01 19:23:37.105466 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:37.105447    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g7lwk" podUID="64190ce2-a2fa-4276-a619-3e43188597ac"
Jul 01 19:23:37.105835 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.105821    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 01 19:23:37.106463 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.106441    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qrmf"
Jul 01 19:23:37.107616 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.107593    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 01 19:23:37.107710 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.107690    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 01 19:23:37.108734 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.107856    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-w2jtg\""
Jul 01 19:23:37.108734 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.107913    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 01 19:23:37.108734 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.108134    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.108734 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.108397    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 01 19:23:37.108734 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.108484    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zkvcp\""
Jul 01 19:23:37.110091 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.110074    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z4m25"
Jul 01 19:23:37.110549 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.110529    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 01 19:23:37.110642 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.110528    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 01 19:23:37.110642 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.110534    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 01 19:23:37.110642 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.110574    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 01 19:23:37.110642 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.110573    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-p7grv\""
Jul 01 19:23:37.111084 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.111069    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 01 19:23:37.111161 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.111143    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 01 19:23:37.111245 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.111228    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-flb8r\""
Jul 01 19:23:37.111340 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.111324    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mfxn"
Jul 01 19:23:37.111450 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.111308    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 01 19:23:37.111450 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:37.111410    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mfxn" podUID="36332f97-ad96-472d-a040-542d79e9e865"
Jul 01 19:23:37.112362 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.112347    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cxvcs\""
Jul 01 19:23:37.112458 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.112444    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 01 19:23:37.112497 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.112470    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 01 19:23:37.112588 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.112575    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5c4z2"
Jul 01 19:23:37.114034 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.114018    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.115042 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.115019    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nnkng\""
Jul 01 19:23:37.115504 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.115216    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znvt"
Jul 01 19:23:37.115504 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.115277    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 01 19:23:37.115504 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:37.115290    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znvt" podUID="091570c8-2f14-46c0-a514-c35f2d3096c4"
Jul 01 19:23:37.115504 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.115458    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 01 19:23:37.115672 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.115594    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 01 19:23:37.116587 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.116569    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-szp8f"
Jul 01 19:23:37.117571 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.117554    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 01 19:23:37.118265 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.117921    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 01 19:23:37.118265 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.117954    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 01 19:23:37.118265 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.118193    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 01 19:23:37.118265 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.118259    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 01 19:23:37.118478 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.118357    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dxmdb\""
Jul 01 19:23:37.118478 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.118405    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 01 19:23:37.118802 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.118786    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 01 19:23:37.118890 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.118874    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 01 19:23:37.119015 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.119002    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-z8tsm\""
Jul 01 19:23:37.158223 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.158197    2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 01 19:23:37.159473 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.159458    2556 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 01 19:23:37.164956 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.164938    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjvcb\" (UniqueName: \"kubernetes.io/projected/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-kube-api-access-qjvcb\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.165075 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.164963    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/92d21eec-cdb9-4f37-848b-a6a29232d828-host-slash\") pod \"iptables-alerter-5c4z2\" (UID: \"92d21eec-cdb9-4f37-848b-a6a29232d828\") " pod="openshift-network-operator/iptables-alerter-5c4z2"
Jul 01 19:23:37.165075 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.164983    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/091570c8-2f14-46c0-a514-c35f2d3096c4-kubelet-config\") pod \"global-pull-secret-syncer-9znvt\" (UID: \"091570c8-2f14-46c0-a514-c35f2d3096c4\") " pod="kube-system/global-pull-secret-syncer-9znvt"
Jul 01 19:23:37.165075 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.165007    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/091570c8-2f14-46c0-a514-c35f2d3096c4-dbus\") pod \"global-pull-secret-syncer-9znvt\" (UID: \"091570c8-2f14-46c0-a514-c35f2d3096c4\") " pod="kube-system/global-pull-secret-syncer-9znvt"
Jul 01 19:23:37.165075 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.165022    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/558a74fc-97f8-4db3-a2de-813540a74fd6-etc-sysctl-d\") pod \"tuned-jpfpn\" (UID: \"558a74fc-97f8-4db3-a2de-813540a74fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-jpfpn"
Jul 01 19:23:37.165229 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.165083    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/558a74fc-97f8-4db3-a2de-813540a74fd6-host\") pod \"tuned-jpfpn\" (UID: \"558a74fc-97f8-4db3-a2de-813540a74fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-jpfpn"
Jul 01 19:23:37.165229 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.165098    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2130321f-c2a8-4308-8f86-04d826bdebbd-tmp-dir\") pod \"node-resolver-trspk\" (UID: \"2130321f-c2a8-4308-8f86-04d826bdebbd\") " pod="openshift-dns/node-resolver-trspk"
Jul 01 19:23:37.165229 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.165115    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/44702a43-1427-4499-a1ce-c22c7c3a7dbe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z4m25\" (UID: \"44702a43-1427-4499-a1ce-c22c7c3a7dbe\") " pod="openshift-multus/multus-additional-cni-plugins-z4m25"
Jul 01 19:23:37.165229 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.165133    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36332f97-ad96-472d-a040-542d79e9e865-metrics-certs\") pod \"network-metrics-daemon-7mfxn\" (UID: \"36332f97-ad96-472d-a040-542d79e9e865\") " pod="openshift-multus/network-metrics-daemon-7mfxn"
Jul 01 19:23:37.165229 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.165192    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d621ab71-8427-42af-bfa4-f83db9c5800d-host-slash\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.165229 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.165208    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d621ab71-8427-42af-bfa4-f83db9c5800d-env-overrides\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.165414 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.165255    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/558a74fc-97f8-4db3-a2de-813540a74fd6-run\") pod \"tuned-jpfpn\" (UID: \"558a74fc-97f8-4db3-a2de-813540a74fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-jpfpn"
Jul 01 19:23:37.165414 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.165270    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/558a74fc-97f8-4db3-a2de-813540a74fd6-etc-tuned\") pod \"tuned-jpfpn\" (UID: \"558a74fc-97f8-4db3-a2de-813540a74fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-jpfpn"
Jul 01 19:23:37.165414 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.165283    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/558a74fc-97f8-4db3-a2de-813540a74fd6-tmp\") pod \"tuned-jpfpn\" (UID: \"558a74fc-97f8-4db3-a2de-813540a74fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-jpfpn"
Jul 01 19:23:37.165414 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.165309    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d621ab71-8427-42af-bfa4-f83db9c5800d-host-run-netns\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.165414 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.165343    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d621ab71-8427-42af-bfa4-f83db9c5800d-var-lib-openvswitch\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.165414 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.165387    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-cni-binary-copy\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.165414 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.165405    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/558a74fc-97f8-4db3-a2de-813540a74fd6-etc-sysconfig\") pod \"tuned-jpfpn\" (UID: \"558a74fc-97f8-4db3-a2de-813540a74fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-jpfpn"
Jul 01 19:23:37.165696 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.165420    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b58w2\" (UniqueName: \"kubernetes.io/projected/558a74fc-97f8-4db3-a2de-813540a74fd6-kube-api-access-b58w2\") pod \"tuned-jpfpn\" (UID: \"558a74fc-97f8-4db3-a2de-813540a74fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-jpfpn"
Jul 01 19:23:37.165696 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.165460    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmmxk\" (UniqueName: \"kubernetes.io/projected/36332f97-ad96-472d-a040-542d79e9e865-kube-api-access-mmmxk\") pod \"network-metrics-daemon-7mfxn\" (UID: \"36332f97-ad96-472d-a040-542d79e9e865\") " pod="openshift-multus/network-metrics-daemon-7mfxn"
Jul 01 19:23:37.165696 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.165482    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d621ab71-8427-42af-bfa4-f83db9c5800d-host-run-ovn-kubernetes\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.165696 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.165498    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-system-cni-dir\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.165696 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.165526    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-multus-conf-dir\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.165696 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.165539    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/558a74fc-97f8-4db3-a2de-813540a74fd6-etc-kubernetes\") pod \"tuned-jpfpn\" (UID: \"558a74fc-97f8-4db3-a2de-813540a74fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-jpfpn"
Jul 01 19:23:37.165696 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.165554    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/44702a43-1427-4499-a1ce-c22c7c3a7dbe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z4m25\" (UID: \"44702a43-1427-4499-a1ce-c22c7c3a7dbe\") " pod="openshift-multus/multus-additional-cni-plugins-z4m25"
Jul 01 19:23:37.165696 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.165576    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d621ab71-8427-42af-bfa4-f83db9c5800d-run-systemd\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.165696 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.165592    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d621ab71-8427-42af-bfa4-f83db9c5800d-etc-openvswitch\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.165696 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.165608    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d621ab71-8427-42af-bfa4-f83db9c5800d-run-ovn\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.165696 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.165667    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9ds4\" (UniqueName: \"kubernetes.io/projected/d621ab71-8427-42af-bfa4-f83db9c5800d-kube-api-access-p9ds4\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.166205 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.165703    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/82ac6af5-5835-474f-a582-e8cca885f010-device-dir\") pod \"aws-ebs-csi-driver-node-5qrmf\" (UID: \"82ac6af5-5835-474f-a582-e8cca885f010\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qrmf"
Jul 01 19:23:37.166205 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.165727    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-host-var-lib-cni-bin\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.166205 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.165768    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-hostroot\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.166205 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.165813    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/091570c8-2f14-46c0-a514-c35f2d3096c4-original-pull-secret\") pod \"global-pull-secret-syncer-9znvt\" (UID: \"091570c8-2f14-46c0-a514-c35f2d3096c4\") " pod="kube-system/global-pull-secret-syncer-9znvt"
Jul 01 19:23:37.166205 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.165848    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/82ac6af5-5835-474f-a582-e8cca885f010-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5qrmf\" (UID: \"82ac6af5-5835-474f-a582-e8cca885f010\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qrmf"
Jul 01 19:23:37.166205 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.165887    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/82ac6af5-5835-474f-a582-e8cca885f010-sys-fs\") pod \"aws-ebs-csi-driver-node-5qrmf\" (UID: \"82ac6af5-5835-474f-a582-e8cca885f010\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qrmf"
Jul 01 19:23:37.166205 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.165924    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-host-run-k8s-cni-cncf-io\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.166205 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.165947    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/558a74fc-97f8-4db3-a2de-813540a74fd6-var-lib-kubelet\") pod \"tuned-jpfpn\" (UID: \"558a74fc-97f8-4db3-a2de-813540a74fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-jpfpn"
Jul 01 19:23:37.166205 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.165972    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg8jr\" (UniqueName: \"kubernetes.io/projected/83cd86be-0e41-4882-be06-4014a93cde38-kube-api-access-lg8jr\") pod \"node-ca-gql7j\" (UID: \"83cd86be-0e41-4882-be06-4014a93cde38\") " pod="openshift-image-registry/node-ca-gql7j"
Jul 01 19:23:37.166205 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.165996    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzkdr\" (UniqueName: \"kubernetes.io/projected/44702a43-1427-4499-a1ce-c22c7c3a7dbe-kube-api-access-mzkdr\") pod \"multus-additional-cni-plugins-z4m25\" (UID: \"44702a43-1427-4499-a1ce-c22c7c3a7dbe\") " pod="openshift-multus/multus-additional-cni-plugins-z4m25"
Jul 01 19:23:37.166205 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.166071    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d621ab71-8427-42af-bfa4-f83db9c5800d-host-kubelet\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.166205 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.166096    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d621ab71-8427-42af-bfa4-f83db9c5800d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.166205 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.166128    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-cnibin\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.166205 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.166159    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a7f64003-a6be-4ff0-8d7b-ebc0489f3d75-agent-certs\") pod \"konnectivity-agent-szp8f\" (UID: \"a7f64003-a6be-4ff0-8d7b-ebc0489f3d75\") " pod="kube-system/konnectivity-agent-szp8f"
Jul 01 19:23:37.166205 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.166181    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/558a74fc-97f8-4db3-a2de-813540a74fd6-etc-systemd\") pod \"tuned-jpfpn\" (UID: \"558a74fc-97f8-4db3-a2de-813540a74fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-jpfpn"
Jul 01 19:23:37.166205 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.166205    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/44702a43-1427-4499-a1ce-c22c7c3a7dbe-cni-binary-copy\") pod \"multus-additional-cni-plugins-z4m25\" (UID: \"44702a43-1427-4499-a1ce-c22c7c3a7dbe\") " pod="openshift-multus/multus-additional-cni-plugins-z4m25"
Jul 01 19:23:37.166903 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.166228    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/44702a43-1427-4499-a1ce-c22c7c3a7dbe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z4m25\" (UID: \"44702a43-1427-4499-a1ce-c22c7c3a7dbe\") " pod="openshift-multus/multus-additional-cni-plugins-z4m25"
Jul 01 19:23:37.166903 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.166251    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d621ab71-8427-42af-bfa4-f83db9c5800d-run-openvswitch\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.166903 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.166265    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-os-release\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.166903 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.166279    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d621ab71-8427-42af-bfa4-f83db9c5800d-ovnkube-script-lib\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.166903 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.166293    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/82ac6af5-5835-474f-a582-e8cca885f010-etc-selinux\") pod \"aws-ebs-csi-driver-node-5qrmf\" (UID: \"82ac6af5-5835-474f-a582-e8cca885f010\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qrmf"
Jul 01 19:23:37.166903 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.166317    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82vcz\" (UniqueName: \"kubernetes.io/projected/92d21eec-cdb9-4f37-848b-a6a29232d828-kube-api-access-82vcz\") pod \"iptables-alerter-5c4z2\" (UID: \"92d21eec-cdb9-4f37-848b-a6a29232d828\") " pod="openshift-network-operator/iptables-alerter-5c4z2"
Jul 01 19:23:37.166903 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.166348    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/83cd86be-0e41-4882-be06-4014a93cde38-host\") pod \"node-ca-gql7j\" (UID: \"83cd86be-0e41-4882-be06-4014a93cde38\") " pod="openshift-image-registry/node-ca-gql7j"
Jul 01 19:23:37.166903 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.166386    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d621ab71-8427-42af-bfa4-f83db9c5800d-host-cni-bin\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.166903 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.166417    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-etc-kubernetes\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.166903 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.166444    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a7f64003-a6be-4ff0-8d7b-ebc0489f3d75-konnectivity-ca\") pod \"konnectivity-agent-szp8f\" (UID: \"a7f64003-a6be-4ff0-8d7b-ebc0489f3d75\") " pod="kube-system/konnectivity-agent-szp8f"
Jul 01 19:23:37.166903 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.166459    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44702a43-1427-4499-a1ce-c22c7c3a7dbe-system-cni-dir\") pod \"multus-additional-cni-plugins-z4m25\" (UID: \"44702a43-1427-4499-a1ce-c22c7c3a7dbe\") " pod="openshift-multus/multus-additional-cni-plugins-z4m25"
Jul 01 19:23:37.166903 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.166491    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/44702a43-1427-4499-a1ce-c22c7c3a7dbe-cnibin\") pod \"multus-additional-cni-plugins-z4m25\" (UID: \"44702a43-1427-4499-a1ce-c22c7c3a7dbe\") " pod="openshift-multus/multus-additional-cni-plugins-z4m25"
Jul 01 19:23:37.166903 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.166523    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d621ab71-8427-42af-bfa4-f83db9c5800d-systemd-units\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.166903 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.166570    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d621ab71-8427-42af-bfa4-f83db9c5800d-ovnkube-config\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.166903 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.166592    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-host-run-netns\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.166903 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.166615    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/92d21eec-cdb9-4f37-848b-a6a29232d828-iptables-alerter-script\") pod \"iptables-alerter-5c4z2\" (UID: \"92d21eec-cdb9-4f37-848b-a6a29232d828\") " pod="openshift-network-operator/iptables-alerter-5c4z2"
Jul 01 19:23:37.167477 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.166651    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/558a74fc-97f8-4db3-a2de-813540a74fd6-etc-modprobe-d\") pod \"tuned-jpfpn\" (UID: \"558a74fc-97f8-4db3-a2de-813540a74fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-jpfpn"
Jul 01 19:23:37.167477 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.166673    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2130321f-c2a8-4308-8f86-04d826bdebbd-hosts-file\") pod \"node-resolver-trspk\" (UID: \"2130321f-c2a8-4308-8f86-04d826bdebbd\") " pod="openshift-dns/node-resolver-trspk"
Jul 01 19:23:37.167477 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.166695    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d621ab71-8427-42af-bfa4-f83db9c5800d-node-log\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.167477 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.166739    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/83cd86be-0e41-4882-be06-4014a93cde38-serviceca\") pod \"node-ca-gql7j\" (UID: \"83cd86be-0e41-4882-be06-4014a93cde38\") " pod="openshift-image-registry/node-ca-gql7j"
Jul 01 19:23:37.167477 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.166767    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/82ac6af5-5835-474f-a582-e8cca885f010-socket-dir\") pod \"aws-ebs-csi-driver-node-5qrmf\" (UID: \"82ac6af5-5835-474f-a582-e8cca885f010\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qrmf"
Jul 01 19:23:37.167477 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.166791    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmwqh\" (UniqueName: \"kubernetes.io/projected/82ac6af5-5835-474f-a582-e8cca885f010-kube-api-access-jmwqh\") pod \"aws-ebs-csi-driver-node-5qrmf\" (UID: \"82ac6af5-5835-474f-a582-e8cca885f010\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qrmf"
Jul 01 19:23:37.167477 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.166821    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-host-run-multus-certs\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.167477 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.166837    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/558a74fc-97f8-4db3-a2de-813540a74fd6-etc-sysctl-conf\") pod \"tuned-jpfpn\" (UID: \"558a74fc-97f8-4db3-a2de-813540a74fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-jpfpn"
Jul 01 19:23:37.167477 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.166867    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/558a74fc-97f8-4db3-a2de-813540a74fd6-sys\") pod \"tuned-jpfpn\" (UID: \"558a74fc-97f8-4db3-a2de-813540a74fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-jpfpn"
Jul 01 19:23:37.167477 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.166894    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4tkv\" (UniqueName: \"kubernetes.io/projected/64190ce2-a2fa-4276-a619-3e43188597ac-kube-api-access-z4tkv\") pod \"network-check-target-g7lwk\" (UID: \"64190ce2-a2fa-4276-a619-3e43188597ac\") " pod="openshift-network-diagnostics/network-check-target-g7lwk"
Jul 01 19:23:37.167477 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.166916    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/82ac6af5-5835-474f-a582-e8cca885f010-registration-dir\") pod \"aws-ebs-csi-driver-node-5qrmf\" (UID: \"82ac6af5-5835-474f-a582-e8cca885f010\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qrmf"
Jul 01 19:23:37.167477 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.166937    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-host-var-lib-cni-multus\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.167477 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.166960    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-host-var-lib-kubelet\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.167477 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.166996    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/44702a43-1427-4499-a1ce-c22c7c3a7dbe-os-release\") pod \"multus-additional-cni-plugins-z4m25\" (UID: \"44702a43-1427-4499-a1ce-c22c7c3a7dbe\") " pod="openshift-multus/multus-additional-cni-plugins-z4m25"
Jul 01 19:23:37.167477 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.167024    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d621ab71-8427-42af-bfa4-f83db9c5800d-log-socket\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.167477 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.167073    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-multus-socket-dir-parent\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.168008 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.167087    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-multus-daemon-config\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.168008 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.167106    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/558a74fc-97f8-4db3-a2de-813540a74fd6-lib-modules\") pod \"tuned-jpfpn\" (UID: \"558a74fc-97f8-4db3-a2de-813540a74fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-jpfpn"
Jul 01 19:23:37.168008 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.167119    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d621ab71-8427-42af-bfa4-f83db9c5800d-host-cni-netd\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.168008 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.167140    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-multus-cni-dir\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.168008 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.167156    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xffhf\" (UniqueName: \"kubernetes.io/projected/2130321f-c2a8-4308-8f86-04d826bdebbd-kube-api-access-xffhf\") pod \"node-resolver-trspk\" (UID: \"2130321f-c2a8-4308-8f86-04d826bdebbd\") " pod="openshift-dns/node-resolver-trspk"
Jul 01 19:23:37.168008 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.167179    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d621ab71-8427-42af-bfa4-f83db9c5800d-ovn-node-metrics-cert\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.179107 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.176017    2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 01 19:23:37.260785 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.260764    2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gfgk2"
Jul 01 19:23:37.265867 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:37.265830    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba6d1208eed95769604e1c9127dc48d4.slice/crio-537d33bb7ad232274a56a8818482a98ed4da39c49d9ee65ae98abd0b790c0fee WatchSource:0}: Error finding container 537d33bb7ad232274a56a8818482a98ed4da39c49d9ee65ae98abd0b790c0fee: Status 404 returned error can't find the container with id 537d33bb7ad232274a56a8818482a98ed4da39c49d9ee65ae98abd0b790c0fee
Jul 01 19:23:37.268053 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268033    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/82ac6af5-5835-474f-a582-e8cca885f010-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5qrmf\" (UID: \"82ac6af5-5835-474f-a582-e8cca885f010\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qrmf"
Jul 01 19:23:37.268118 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268063    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/82ac6af5-5835-474f-a582-e8cca885f010-sys-fs\") pod \"aws-ebs-csi-driver-node-5qrmf\" (UID: \"82ac6af5-5835-474f-a582-e8cca885f010\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qrmf"
Jul 01 19:23:37.268118 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268079    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-host-run-k8s-cni-cncf-io\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.268118 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268098    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/558a74fc-97f8-4db3-a2de-813540a74fd6-var-lib-kubelet\") pod \"tuned-jpfpn\" (UID: \"558a74fc-97f8-4db3-a2de-813540a74fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-jpfpn"
Jul 01 19:23:37.268213 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268140    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/82ac6af5-5835-474f-a582-e8cca885f010-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5qrmf\" (UID: \"82ac6af5-5835-474f-a582-e8cca885f010\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qrmf"
Jul 01 19:23:37.268213 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268154    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/558a74fc-97f8-4db3-a2de-813540a74fd6-var-lib-kubelet\") pod \"tuned-jpfpn\" (UID: \"558a74fc-97f8-4db3-a2de-813540a74fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-jpfpn"
Jul 01 19:23:37.268213 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268154    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-host-run-k8s-cni-cncf-io\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.268213 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268153    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/82ac6af5-5835-474f-a582-e8cca885f010-sys-fs\") pod \"aws-ebs-csi-driver-node-5qrmf\" (UID: \"82ac6af5-5835-474f-a582-e8cca885f010\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qrmf"
Jul 01 19:23:37.268213 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268175    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg8jr\" (UniqueName: \"kubernetes.io/projected/83cd86be-0e41-4882-be06-4014a93cde38-kube-api-access-lg8jr\") pod \"node-ca-gql7j\" (UID: \"83cd86be-0e41-4882-be06-4014a93cde38\") " pod="openshift-image-registry/node-ca-gql7j"
Jul 01 19:23:37.268213 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268201    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzkdr\" (UniqueName: \"kubernetes.io/projected/44702a43-1427-4499-a1ce-c22c7c3a7dbe-kube-api-access-mzkdr\") pod \"multus-additional-cni-plugins-z4m25\" (UID: \"44702a43-1427-4499-a1ce-c22c7c3a7dbe\") " pod="openshift-multus/multus-additional-cni-plugins-z4m25"
Jul 01 19:23:37.268413 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268218    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d621ab71-8427-42af-bfa4-f83db9c5800d-host-kubelet\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.268413 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268235    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d621ab71-8427-42af-bfa4-f83db9c5800d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.268413 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268257    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-cnibin\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.268413 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268273    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a7f64003-a6be-4ff0-8d7b-ebc0489f3d75-agent-certs\") pod \"konnectivity-agent-szp8f\" (UID: \"a7f64003-a6be-4ff0-8d7b-ebc0489f3d75\") " pod="kube-system/konnectivity-agent-szp8f"
Jul 01 19:23:37.268413 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268280    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d621ab71-8427-42af-bfa4-f83db9c5800d-host-kubelet\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.268413 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268287    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/558a74fc-97f8-4db3-a2de-813540a74fd6-etc-systemd\") pod \"tuned-jpfpn\" (UID: \"558a74fc-97f8-4db3-a2de-813540a74fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-jpfpn"
Jul 01 19:23:37.268413 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268317    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/558a74fc-97f8-4db3-a2de-813540a74fd6-etc-systemd\") pod \"tuned-jpfpn\" (UID: \"558a74fc-97f8-4db3-a2de-813540a74fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-jpfpn"
Jul 01 19:23:37.268413 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268336    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/44702a43-1427-4499-a1ce-c22c7c3a7dbe-cni-binary-copy\") pod \"multus-additional-cni-plugins-z4m25\" (UID: \"44702a43-1427-4499-a1ce-c22c7c3a7dbe\") " pod="openshift-multus/multus-additional-cni-plugins-z4m25"
Jul 01 19:23:37.268413 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268354    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-cnibin\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.268413 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268384    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/44702a43-1427-4499-a1ce-c22c7c3a7dbe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z4m25\" (UID: \"44702a43-1427-4499-a1ce-c22c7c3a7dbe\") " pod="openshift-multus/multus-additional-cni-plugins-z4m25"
Jul 01 19:23:37.268413 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268392    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d621ab71-8427-42af-bfa4-f83db9c5800d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.268413 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268410    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d621ab71-8427-42af-bfa4-f83db9c5800d-run-openvswitch\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.268992 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268441    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-os-release\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.268992 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268452    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d621ab71-8427-42af-bfa4-f83db9c5800d-run-openvswitch\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.268992 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268470    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d621ab71-8427-42af-bfa4-f83db9c5800d-ovnkube-script-lib\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.268992 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268490    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/82ac6af5-5835-474f-a582-e8cca885f010-etc-selinux\") pod \"aws-ebs-csi-driver-node-5qrmf\" (UID: \"82ac6af5-5835-474f-a582-e8cca885f010\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qrmf"
Jul 01 19:23:37.268992 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268507    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82vcz\" (UniqueName: \"kubernetes.io/projected/92d21eec-cdb9-4f37-848b-a6a29232d828-kube-api-access-82vcz\") pod \"iptables-alerter-5c4z2\" (UID: \"92d21eec-cdb9-4f37-848b-a6a29232d828\") " pod="openshift-network-operator/iptables-alerter-5c4z2"
Jul 01 19:23:37.268992 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268513    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-os-release\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.268992 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268555    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/83cd86be-0e41-4882-be06-4014a93cde38-host\") pod \"node-ca-gql7j\" (UID: \"83cd86be-0e41-4882-be06-4014a93cde38\") " pod="openshift-image-registry/node-ca-gql7j"
Jul 01 19:23:37.268992 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268612    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/44702a43-1427-4499-a1ce-c22c7c3a7dbe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z4m25\" (UID: \"44702a43-1427-4499-a1ce-c22c7c3a7dbe\") " pod="openshift-multus/multus-additional-cni-plugins-z4m25"
Jul 01 19:23:37.268992 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268625    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d621ab71-8427-42af-bfa4-f83db9c5800d-host-cni-bin\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.268992 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268659    2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 01 19:23:37.268992 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268677    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/83cd86be-0e41-4882-be06-4014a93cde38-host\") pod \"node-ca-gql7j\" (UID: \"83cd86be-0e41-4882-be06-4014a93cde38\") " pod="openshift-image-registry/node-ca-gql7j"
Jul 01 19:23:37.268992 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268688    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d621ab71-8427-42af-bfa4-f83db9c5800d-host-cni-bin\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.268992 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268709    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-etc-kubernetes\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.268992 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268755    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a7f64003-a6be-4ff0-8d7b-ebc0489f3d75-konnectivity-ca\") pod \"konnectivity-agent-szp8f\" (UID: \"a7f64003-a6be-4ff0-8d7b-ebc0489f3d75\") " pod="kube-system/konnectivity-agent-szp8f"
Jul 01 19:23:37.268992 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268775    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-etc-kubernetes\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.268992 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268775    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/82ac6af5-5835-474f-a582-e8cca885f010-etc-selinux\") pod \"aws-ebs-csi-driver-node-5qrmf\" (UID: \"82ac6af5-5835-474f-a582-e8cca885f010\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qrmf"
Jul 01 19:23:37.268992 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268812    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44702a43-1427-4499-a1ce-c22c7c3a7dbe-system-cni-dir\") pod \"multus-additional-cni-plugins-z4m25\" (UID: \"44702a43-1427-4499-a1ce-c22c7c3a7dbe\") " pod="openshift-multus/multus-additional-cni-plugins-z4m25"
Jul 01 19:23:37.268992 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268837    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/44702a43-1427-4499-a1ce-c22c7c3a7dbe-cnibin\") pod \"multus-additional-cni-plugins-z4m25\" (UID: \"44702a43-1427-4499-a1ce-c22c7c3a7dbe\") " pod="openshift-multus/multus-additional-cni-plugins-z4m25"
Jul 01 19:23:37.269884 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268861    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d621ab71-8427-42af-bfa4-f83db9c5800d-systemd-units\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.269884 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268872    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44702a43-1427-4499-a1ce-c22c7c3a7dbe-system-cni-dir\") pod \"multus-additional-cni-plugins-z4m25\" (UID: \"44702a43-1427-4499-a1ce-c22c7c3a7dbe\") " pod="openshift-multus/multus-additional-cni-plugins-z4m25"
Jul 01 19:23:37.269884 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268883    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d621ab71-8427-42af-bfa4-f83db9c5800d-ovnkube-config\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.269884 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268927    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/44702a43-1427-4499-a1ce-c22c7c3a7dbe-cnibin\") pod \"multus-additional-cni-plugins-z4m25\" (UID: \"44702a43-1427-4499-a1ce-c22c7c3a7dbe\") " pod="openshift-multus/multus-additional-cni-plugins-z4m25"
Jul 01 19:23:37.269884 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268907    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-host-run-netns\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.269884 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268962    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/44702a43-1427-4499-a1ce-c22c7c3a7dbe-cni-binary-copy\") pod \"multus-additional-cni-plugins-z4m25\" (UID: \"44702a43-1427-4499-a1ce-c22c7c3a7dbe\") " pod="openshift-multus/multus-additional-cni-plugins-z4m25"
Jul 01 19:23:37.269884 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268965    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-host-run-netns\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.269884 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268965    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/92d21eec-cdb9-4f37-848b-a6a29232d828-iptables-alerter-script\") pod \"iptables-alerter-5c4z2\" (UID: \"92d21eec-cdb9-4f37-848b-a6a29232d828\") " pod="openshift-network-operator/iptables-alerter-5c4z2"
Jul 01 19:23:37.269884 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.268998    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d621ab71-8427-42af-bfa4-f83db9c5800d-systemd-units\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.269884 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269026    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/558a74fc-97f8-4db3-a2de-813540a74fd6-etc-modprobe-d\") pod \"tuned-jpfpn\" (UID: \"558a74fc-97f8-4db3-a2de-813540a74fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-jpfpn"
Jul 01 19:23:37.269884 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269056    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2130321f-c2a8-4308-8f86-04d826bdebbd-hosts-file\") pod \"node-resolver-trspk\" (UID: \"2130321f-c2a8-4308-8f86-04d826bdebbd\") " pod="openshift-dns/node-resolver-trspk"
Jul 01 19:23:37.269884 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269080    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d621ab71-8427-42af-bfa4-f83db9c5800d-node-log\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.269884 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269102    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/83cd86be-0e41-4882-be06-4014a93cde38-serviceca\") pod \"node-ca-gql7j\" (UID: \"83cd86be-0e41-4882-be06-4014a93cde38\") " pod="openshift-image-registry/node-ca-gql7j"
Jul 01 19:23:37.269884 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269123    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/82ac6af5-5835-474f-a582-e8cca885f010-socket-dir\") pod \"aws-ebs-csi-driver-node-5qrmf\" (UID: \"82ac6af5-5835-474f-a582-e8cca885f010\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qrmf"
Jul 01 19:23:37.269884 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269125    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/558a74fc-97f8-4db3-a2de-813540a74fd6-etc-modprobe-d\") pod \"tuned-jpfpn\" (UID: \"558a74fc-97f8-4db3-a2de-813540a74fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-jpfpn"
Jul 01 19:23:37.269884 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269139    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmwqh\" (UniqueName: \"kubernetes.io/projected/82ac6af5-5835-474f-a582-e8cca885f010-kube-api-access-jmwqh\") pod \"aws-ebs-csi-driver-node-5qrmf\" (UID: \"82ac6af5-5835-474f-a582-e8cca885f010\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qrmf"
Jul 01 19:23:37.269884 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269157    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-host-run-multus-certs\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.270809 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269165    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d621ab71-8427-42af-bfa4-f83db9c5800d-node-log\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.270809 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269172    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/558a74fc-97f8-4db3-a2de-813540a74fd6-etc-sysctl-conf\") pod \"tuned-jpfpn\" (UID: \"558a74fc-97f8-4db3-a2de-813540a74fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-jpfpn"
Jul 01 19:23:37.270809 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269205    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/558a74fc-97f8-4db3-a2de-813540a74fd6-sys\") pod \"tuned-jpfpn\" (UID: \"558a74fc-97f8-4db3-a2de-813540a74fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-jpfpn"
Jul 01 19:23:37.270809 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269207    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2130321f-c2a8-4308-8f86-04d826bdebbd-hosts-file\") pod \"node-resolver-trspk\" (UID: \"2130321f-c2a8-4308-8f86-04d826bdebbd\") " pod="openshift-dns/node-resolver-trspk"
Jul 01 19:23:37.270809 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269232    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4tkv\" (UniqueName: \"kubernetes.io/projected/64190ce2-a2fa-4276-a619-3e43188597ac-kube-api-access-z4tkv\") pod \"network-check-target-g7lwk\" (UID: \"64190ce2-a2fa-4276-a619-3e43188597ac\") " pod="openshift-network-diagnostics/network-check-target-g7lwk"
Jul 01 19:23:37.270809 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269284    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/82ac6af5-5835-474f-a582-e8cca885f010-registration-dir\") pod \"aws-ebs-csi-driver-node-5qrmf\" (UID: \"82ac6af5-5835-474f-a582-e8cca885f010\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qrmf"
Jul 01 19:23:37.270809 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269314    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-host-var-lib-cni-multus\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.270809 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269338    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-host-var-lib-kubelet\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.270809 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269359    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/44702a43-1427-4499-a1ce-c22c7c3a7dbe-os-release\") pod \"multus-additional-cni-plugins-z4m25\" (UID: \"44702a43-1427-4499-a1ce-c22c7c3a7dbe\") " pod="openshift-multus/multus-additional-cni-plugins-z4m25"
Jul 01 19:23:37.270809 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269395    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d621ab71-8427-42af-bfa4-f83db9c5800d-log-socket\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.270809 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269418    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-multus-socket-dir-parent\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.270809 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269437    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-multus-daemon-config\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.270809 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269457    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/558a74fc-97f8-4db3-a2de-813540a74fd6-lib-modules\") pod \"tuned-jpfpn\" (UID: \"558a74fc-97f8-4db3-a2de-813540a74fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-jpfpn"
Jul 01 19:23:37.270809 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269482    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d621ab71-8427-42af-bfa4-f83db9c5800d-host-cni-netd\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.270809 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269505    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d621ab71-8427-42af-bfa4-f83db9c5800d-ovnkube-config\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.270809 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269548    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/92d21eec-cdb9-4f37-848b-a6a29232d828-iptables-alerter-script\") pod \"iptables-alerter-5c4z2\" (UID: \"92d21eec-cdb9-4f37-848b-a6a29232d828\") " pod="openshift-network-operator/iptables-alerter-5c4z2"
Jul 01 19:23:37.270809 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269604    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/558a74fc-97f8-4db3-a2de-813540a74fd6-sys\") pod \"tuned-jpfpn\" (UID: \"558a74fc-97f8-4db3-a2de-813540a74fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-jpfpn"
Jul 01 19:23:37.271615 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269500    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-multus-cni-dir\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.271615 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269621    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d621ab71-8427-42af-bfa4-f83db9c5800d-ovnkube-script-lib\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.271615 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269623    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/83cd86be-0e41-4882-be06-4014a93cde38-serviceca\") pod \"node-ca-gql7j\" (UID: \"83cd86be-0e41-4882-be06-4014a93cde38\") " pod="openshift-image-registry/node-ca-gql7j"
Jul 01 19:23:37.271615 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269653    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xffhf\" (UniqueName: \"kubernetes.io/projected/2130321f-c2a8-4308-8f86-04d826bdebbd-kube-api-access-xffhf\") pod \"node-resolver-trspk\" (UID: \"2130321f-c2a8-4308-8f86-04d826bdebbd\") " pod="openshift-dns/node-resolver-trspk"
Jul 01 19:23:37.271615 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269673    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/44702a43-1427-4499-a1ce-c22c7c3a7dbe-os-release\") pod \"multus-additional-cni-plugins-z4m25\" (UID: \"44702a43-1427-4499-a1ce-c22c7c3a7dbe\") " pod="openshift-multus/multus-additional-cni-plugins-z4m25"
Jul 01 19:23:37.271615 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269680    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d621ab71-8427-42af-bfa4-f83db9c5800d-ovn-node-metrics-cert\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.271615 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269713    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-multus-cni-dir\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.271615 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269722    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/82ac6af5-5835-474f-a582-e8cca885f010-registration-dir\") pod \"aws-ebs-csi-driver-node-5qrmf\" (UID: \"82ac6af5-5835-474f-a582-e8cca885f010\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qrmf"
Jul 01 19:23:37.271615 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269751    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjvcb\" (UniqueName: \"kubernetes.io/projected/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-kube-api-access-qjvcb\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.271615 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269779    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/92d21eec-cdb9-4f37-848b-a6a29232d828-host-slash\") pod \"iptables-alerter-5c4z2\" (UID: \"92d21eec-cdb9-4f37-848b-a6a29232d828\") " pod="openshift-network-operator/iptables-alerter-5c4z2"
Jul 01 19:23:37.271615 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269795    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/558a74fc-97f8-4db3-a2de-813540a74fd6-lib-modules\") pod \"tuned-jpfpn\" (UID: \"558a74fc-97f8-4db3-a2de-813540a74fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-jpfpn"
Jul 01 19:23:37.271615 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269786    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/558a74fc-97f8-4db3-a2de-813540a74fd6-etc-sysctl-conf\") pod \"tuned-jpfpn\" (UID: \"558a74fc-97f8-4db3-a2de-813540a74fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-jpfpn"
Jul 01 19:23:37.271615 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269803    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/091570c8-2f14-46c0-a514-c35f2d3096c4-kubelet-config\") pod \"global-pull-secret-syncer-9znvt\" (UID: \"091570c8-2f14-46c0-a514-c35f2d3096c4\") " pod="kube-system/global-pull-secret-syncer-9znvt"
Jul 01 19:23:37.271615 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269843    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/091570c8-2f14-46c0-a514-c35f2d3096c4-kubelet-config\") pod \"global-pull-secret-syncer-9znvt\" (UID: \"091570c8-2f14-46c0-a514-c35f2d3096c4\") " pod="kube-system/global-pull-secret-syncer-9znvt"
Jul 01 19:23:37.271615 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269847    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/091570c8-2f14-46c0-a514-c35f2d3096c4-dbus\") pod \"global-pull-secret-syncer-9znvt\" (UID: \"091570c8-2f14-46c0-a514-c35f2d3096c4\") " pod="kube-system/global-pull-secret-syncer-9znvt"
Jul 01 19:23:37.271615 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269880    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/558a74fc-97f8-4db3-a2de-813540a74fd6-etc-sysctl-d\") pod \"tuned-jpfpn\" (UID: \"558a74fc-97f8-4db3-a2de-813540a74fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-jpfpn"
Jul 01 19:23:37.271615 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269884    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-host-var-lib-cni-multus\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.271615 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269312    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a7f64003-a6be-4ff0-8d7b-ebc0489f3d75-konnectivity-ca\") pod \"konnectivity-agent-szp8f\" (UID: \"a7f64003-a6be-4ff0-8d7b-ebc0489f3d75\") " pod="kube-system/konnectivity-agent-szp8f"
Jul 01 19:23:37.272401 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269915    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d621ab71-8427-42af-bfa4-f83db9c5800d-log-socket\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.272401 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269846    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d621ab71-8427-42af-bfa4-f83db9c5800d-host-cni-netd\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.272401 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269937    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/091570c8-2f14-46c0-a514-c35f2d3096c4-dbus\") pod \"global-pull-secret-syncer-9znvt\" (UID: \"091570c8-2f14-46c0-a514-c35f2d3096c4\") " pod="kube-system/global-pull-secret-syncer-9znvt"
Jul 01 19:23:37.272401 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269938    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-host-var-lib-kubelet\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.272401 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269984    2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gfgk2"
Jul 01 19:23:37.272401 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269620    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/82ac6af5-5835-474f-a582-e8cca885f010-socket-dir\") pod \"aws-ebs-csi-driver-node-5qrmf\" (UID: \"82ac6af5-5835-474f-a582-e8cca885f010\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qrmf"
Jul 01 19:23:37.272401 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.269996    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-multus-socket-dir-parent\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.272401 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.270038    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/558a74fc-97f8-4db3-a2de-813540a74fd6-host\") pod \"tuned-jpfpn\" (UID: \"558a74fc-97f8-4db3-a2de-813540a74fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-jpfpn"
Jul 01 19:23:37.272401 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.270059    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/92d21eec-cdb9-4f37-848b-a6a29232d828-host-slash\") pod \"iptables-alerter-5c4z2\" (UID: \"92d21eec-cdb9-4f37-848b-a6a29232d828\") " pod="openshift-network-operator/iptables-alerter-5c4z2"
Jul 01 19:23:37.272401 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.270016    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/558a74fc-97f8-4db3-a2de-813540a74fd6-etc-sysctl-d\") pod \"tuned-jpfpn\" (UID: \"558a74fc-97f8-4db3-a2de-813540a74fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-jpfpn"
Jul 01 19:23:37.272401 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.270077    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2130321f-c2a8-4308-8f86-04d826bdebbd-tmp-dir\") pod \"node-resolver-trspk\" (UID: \"2130321f-c2a8-4308-8f86-04d826bdebbd\") " pod="openshift-dns/node-resolver-trspk"
Jul 01 19:23:37.272401 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.270109    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-multus-daemon-config\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.272401 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.270114    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/558a74fc-97f8-4db3-a2de-813540a74fd6-host\") pod \"tuned-jpfpn\" (UID: \"558a74fc-97f8-4db3-a2de-813540a74fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-jpfpn"
Jul 01 19:23:37.272401 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.270109    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/44702a43-1427-4499-a1ce-c22c7c3a7dbe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z4m25\" (UID: \"44702a43-1427-4499-a1ce-c22c7c3a7dbe\") " pod="openshift-multus/multus-additional-cni-plugins-z4m25"
Jul 01 19:23:37.272401 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.270079    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-host-run-multus-certs\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.272401 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.270148    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36332f97-ad96-472d-a040-542d79e9e865-metrics-certs\") pod \"network-metrics-daemon-7mfxn\" (UID: \"36332f97-ad96-472d-a040-542d79e9e865\") " pod="openshift-multus/network-metrics-daemon-7mfxn"
Jul 01 19:23:37.272401 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.270176    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d621ab71-8427-42af-bfa4-f83db9c5800d-host-slash\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.272401 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.270200    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d621ab71-8427-42af-bfa4-f83db9c5800d-env-overrides\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.273202 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.270222    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/558a74fc-97f8-4db3-a2de-813540a74fd6-run\") pod \"tuned-jpfpn\" (UID: \"558a74fc-97f8-4db3-a2de-813540a74fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-jpfpn"
Jul 01 19:23:37.273202 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:37.270232    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 19:23:37.273202 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.270243    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/558a74fc-97f8-4db3-a2de-813540a74fd6-etc-tuned\") pod \"tuned-jpfpn\" (UID: \"558a74fc-97f8-4db3-a2de-813540a74fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-jpfpn"
Jul 01 19:23:37.273202 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.270266    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/558a74fc-97f8-4db3-a2de-813540a74fd6-tmp\") pod \"tuned-jpfpn\" (UID: \"558a74fc-97f8-4db3-a2de-813540a74fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-jpfpn"
Jul 01 19:23:37.273202 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:37.270326    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36332f97-ad96-472d-a040-542d79e9e865-metrics-certs podName:36332f97-ad96-472d-a040-542d79e9e865 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:37.770283499 +0000 UTC m=+2.133295172 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36332f97-ad96-472d-a040-542d79e9e865-metrics-certs") pod "network-metrics-daemon-7mfxn" (UID: "36332f97-ad96-472d-a040-542d79e9e865") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 19:23:37.273202 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.270348    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d621ab71-8427-42af-bfa4-f83db9c5800d-host-run-netns\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.273202 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.270390    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d621ab71-8427-42af-bfa4-f83db9c5800d-var-lib-openvswitch\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.273202 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.270415    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-cni-binary-copy\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.273202 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.270441    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/558a74fc-97f8-4db3-a2de-813540a74fd6-etc-sysconfig\") pod \"tuned-jpfpn\" (UID: \"558a74fc-97f8-4db3-a2de-813540a74fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-jpfpn"
Jul 01 19:23:37.273202 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.270454    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d621ab71-8427-42af-bfa4-f83db9c5800d-host-run-netns\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.273202 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.270466    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b58w2\" (UniqueName: \"kubernetes.io/projected/558a74fc-97f8-4db3-a2de-813540a74fd6-kube-api-access-b58w2\") pod \"tuned-jpfpn\" (UID: \"558a74fc-97f8-4db3-a2de-813540a74fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-jpfpn"
Jul 01 19:23:37.273202 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.270496    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmmxk\" (UniqueName: \"kubernetes.io/projected/36332f97-ad96-472d-a040-542d79e9e865-kube-api-access-mmmxk\") pod \"network-metrics-daemon-7mfxn\" (UID: \"36332f97-ad96-472d-a040-542d79e9e865\") " pod="openshift-multus/network-metrics-daemon-7mfxn"
Jul 01 19:23:37.273202 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.270526    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d621ab71-8427-42af-bfa4-f83db9c5800d-host-run-ovn-kubernetes\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.273202 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.270554    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-system-cni-dir\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.273202 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.270583    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-multus-conf-dir\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.273202 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.270612    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/558a74fc-97f8-4db3-a2de-813540a74fd6-etc-kubernetes\") pod \"tuned-jpfpn\" (UID: \"558a74fc-97f8-4db3-a2de-813540a74fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-jpfpn"
Jul 01 19:23:37.273202 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.270645    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/44702a43-1427-4499-a1ce-c22c7c3a7dbe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z4m25\" (UID: \"44702a43-1427-4499-a1ce-c22c7c3a7dbe\") " pod="openshift-multus/multus-additional-cni-plugins-z4m25"
Jul 01 19:23:37.273931 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.270677    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d621ab71-8427-42af-bfa4-f83db9c5800d-run-systemd\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.273931 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.270679    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/44702a43-1427-4499-a1ce-c22c7c3a7dbe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z4m25\" (UID: \"44702a43-1427-4499-a1ce-c22c7c3a7dbe\") " pod="openshift-multus/multus-additional-cni-plugins-z4m25"
Jul 01 19:23:37.273931 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.270707    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d621ab71-8427-42af-bfa4-f83db9c5800d-etc-openvswitch\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.273931 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.270731    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/558a74fc-97f8-4db3-a2de-813540a74fd6-run\") pod \"tuned-jpfpn\" (UID: \"558a74fc-97f8-4db3-a2de-813540a74fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-jpfpn"
Jul 01 19:23:37.273931 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.270753    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d621ab71-8427-42af-bfa4-f83db9c5800d-host-slash\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.273931 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.270755    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d621ab71-8427-42af-bfa4-f83db9c5800d-run-ovn\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.273931 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.270759    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d621ab71-8427-42af-bfa4-f83db9c5800d-env-overrides\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.273931 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.270796    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9ds4\" (UniqueName: \"kubernetes.io/projected/d621ab71-8427-42af-bfa4-f83db9c5800d-kube-api-access-p9ds4\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.273931 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.270831    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/82ac6af5-5835-474f-a582-e8cca885f010-device-dir\") pod \"aws-ebs-csi-driver-node-5qrmf\" (UID: \"82ac6af5-5835-474f-a582-e8cca885f010\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qrmf"
Jul 01 19:23:37.273931 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.270850    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d621ab71-8427-42af-bfa4-f83db9c5800d-host-run-ovn-kubernetes\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.273931 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.270861    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-host-var-lib-cni-bin\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.273931 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.270898    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-hostroot\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.273931 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.270897    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d621ab71-8427-42af-bfa4-f83db9c5800d-var-lib-openvswitch\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.273931 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.270925    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/091570c8-2f14-46c0-a514-c35f2d3096c4-original-pull-secret\") pod \"global-pull-secret-syncer-9znvt\" (UID: \"091570c8-2f14-46c0-a514-c35f2d3096c4\") " pod="kube-system/global-pull-secret-syncer-9znvt"
Jul 01 19:23:37.273931 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.270949    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/558a74fc-97f8-4db3-a2de-813540a74fd6-etc-kubernetes\") pod \"tuned-jpfpn\" (UID: \"558a74fc-97f8-4db3-a2de-813540a74fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-jpfpn"
Jul 01 19:23:37.273931 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.271012    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d621ab71-8427-42af-bfa4-f83db9c5800d-etc-openvswitch\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.273931 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.271063    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/558a74fc-97f8-4db3-a2de-813540a74fd6-etc-sysconfig\") pod \"tuned-jpfpn\" (UID: \"558a74fc-97f8-4db3-a2de-813540a74fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-jpfpn"
Jul 01 19:23:37.274630 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.271096    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d621ab71-8427-42af-bfa4-f83db9c5800d-run-ovn\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.274630 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:37.271205    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 01 19:23:37.274630 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.271229    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-cni-binary-copy\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.274630 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:37.271295    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/091570c8-2f14-46c0-a514-c35f2d3096c4-original-pull-secret podName:091570c8-2f14-46c0-a514-c35f2d3096c4 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:37.771259895 +0000 UTC m=+2.134271560 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/091570c8-2f14-46c0-a514-c35f2d3096c4-original-pull-secret") pod "global-pull-secret-syncer-9znvt" (UID: "091570c8-2f14-46c0-a514-c35f2d3096c4") : object "kube-system"/"original-pull-secret" not registered
Jul 01 19:23:37.274630 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.270862    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-system-cni-dir\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.274630 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.271294    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d621ab71-8427-42af-bfa4-f83db9c5800d-run-systemd\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.274630 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.271358    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/82ac6af5-5835-474f-a582-e8cca885f010-device-dir\") pod \"aws-ebs-csi-driver-node-5qrmf\" (UID: \"82ac6af5-5835-474f-a582-e8cca885f010\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qrmf"
Jul 01 19:23:37.274630 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.271362    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-host-var-lib-cni-bin\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.274630 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.270899    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-multus-conf-dir\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.274630 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.271413    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-hostroot\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.274630 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.271546    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2130321f-c2a8-4308-8f86-04d826bdebbd-tmp-dir\") pod \"node-resolver-trspk\" (UID: \"2130321f-c2a8-4308-8f86-04d826bdebbd\") " pod="openshift-dns/node-resolver-trspk"
Jul 01 19:23:37.274630 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.271802    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/44702a43-1427-4499-a1ce-c22c7c3a7dbe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z4m25\" (UID: \"44702a43-1427-4499-a1ce-c22c7c3a7dbe\") " pod="openshift-multus/multus-additional-cni-plugins-z4m25"
Jul 01 19:23:37.274630 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.272723    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/558a74fc-97f8-4db3-a2de-813540a74fd6-tmp\") pod \"tuned-jpfpn\" (UID: \"558a74fc-97f8-4db3-a2de-813540a74fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-jpfpn"
Jul 01 19:23:37.274630 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.272928    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a7f64003-a6be-4ff0-8d7b-ebc0489f3d75-agent-certs\") pod \"konnectivity-agent-szp8f\" (UID: \"a7f64003-a6be-4ff0-8d7b-ebc0489f3d75\") " pod="kube-system/konnectivity-agent-szp8f"
Jul 01 19:23:37.274630 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.273070    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d621ab71-8427-42af-bfa4-f83db9c5800d-ovn-node-metrics-cert\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.274630 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.273482    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 01 19:23:37.274630 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.273873    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/558a74fc-97f8-4db3-a2de-813540a74fd6-etc-tuned\") pod \"tuned-jpfpn\" (UID: \"558a74fc-97f8-4db3-a2de-813540a74fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-jpfpn"
Jul 01 19:23:37.276095 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.276075    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzkdr\" (UniqueName: \"kubernetes.io/projected/44702a43-1427-4499-a1ce-c22c7c3a7dbe-kube-api-access-mzkdr\") pod \"multus-additional-cni-plugins-z4m25\" (UID: \"44702a43-1427-4499-a1ce-c22c7c3a7dbe\") " pod="openshift-multus/multus-additional-cni-plugins-z4m25"
Jul 01 19:23:37.276657 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.276631    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg8jr\" (UniqueName: \"kubernetes.io/projected/83cd86be-0e41-4882-be06-4014a93cde38-kube-api-access-lg8jr\") pod \"node-ca-gql7j\" (UID: \"83cd86be-0e41-4882-be06-4014a93cde38\") " pod="openshift-image-registry/node-ca-gql7j"
Jul 01 19:23:37.276744 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.276669    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82vcz\" (UniqueName: \"kubernetes.io/projected/92d21eec-cdb9-4f37-848b-a6a29232d828-kube-api-access-82vcz\") pod \"iptables-alerter-5c4z2\" (UID: \"92d21eec-cdb9-4f37-848b-a6a29232d828\") " pod="openshift-network-operator/iptables-alerter-5c4z2"
Jul 01 19:23:37.279567 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.279550    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmwqh\" (UniqueName: \"kubernetes.io/projected/82ac6af5-5835-474f-a582-e8cca885f010-kube-api-access-jmwqh\") pod \"aws-ebs-csi-driver-node-5qrmf\" (UID: \"82ac6af5-5835-474f-a582-e8cca885f010\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qrmf"
Jul 01 19:23:37.280179 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:37.280161    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 01 19:23:37.280179 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:37.280182    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 01 19:23:37.280285 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:37.280191    2556 projected.go:196] Error preparing data for projected volume kube-api-access-z4tkv for pod openshift-network-diagnostics/network-check-target-g7lwk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 19:23:37.280285 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:37.280244    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/64190ce2-a2fa-4276-a619-3e43188597ac-kube-api-access-z4tkv podName:64190ce2-a2fa-4276-a619-3e43188597ac nodeName:}" failed. No retries permitted until 2026-07-01 19:23:37.780229681 +0000 UTC m=+2.143241360 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-z4tkv" (UniqueName: "kubernetes.io/projected/64190ce2-a2fa-4276-a619-3e43188597ac-kube-api-access-z4tkv") pod "network-check-target-g7lwk" (UID: "64190ce2-a2fa-4276-a619-3e43188597ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 19:23:37.280828 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.280810    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjvcb\" (UniqueName: \"kubernetes.io/projected/6b1f80b9-6ebb-4244-a8ab-d93b9e13b002-kube-api-access-qjvcb\") pod \"multus-2k92k\" (UID: \"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002\") " pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.281323 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.281304    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xffhf\" (UniqueName: \"kubernetes.io/projected/2130321f-c2a8-4308-8f86-04d826bdebbd-kube-api-access-xffhf\") pod \"node-resolver-trspk\" (UID: \"2130321f-c2a8-4308-8f86-04d826bdebbd\") " pod="openshift-dns/node-resolver-trspk"
Jul 01 19:23:37.282229 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.282213    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b58w2\" (UniqueName: \"kubernetes.io/projected/558a74fc-97f8-4db3-a2de-813540a74fd6-kube-api-access-b58w2\") pod \"tuned-jpfpn\" (UID: \"558a74fc-97f8-4db3-a2de-813540a74fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-jpfpn"
Jul 01 19:23:37.284823 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.284798    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmmxk\" (UniqueName: \"kubernetes.io/projected/36332f97-ad96-472d-a040-542d79e9e865-kube-api-access-mmmxk\") pod \"network-metrics-daemon-7mfxn\" (UID: \"36332f97-ad96-472d-a040-542d79e9e865\") " pod="openshift-multus/network-metrics-daemon-7mfxn"
Jul 01 19:23:37.285532 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.285509    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9ds4\" (UniqueName: \"kubernetes.io/projected/d621ab71-8427-42af-bfa4-f83db9c5800d-kube-api-access-p9ds4\") pod \"ovnkube-node-2tq4l\" (UID: \"d621ab71-8427-42af-bfa4-f83db9c5800d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.367928 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.367891    2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 01 19:23:37.436098 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.436016    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jpfpn"
Jul 01 19:23:37.444256 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:37.444230    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod558a74fc_97f8_4db3_a2de_813540a74fd6.slice/crio-6248b588a1207586a074a2c31b036bc6ba70d6c7b91fde24db377e5e98dd7d84 WatchSource:0}: Error finding container 6248b588a1207586a074a2c31b036bc6ba70d6c7b91fde24db377e5e98dd7d84: Status 404 returned error can't find the container with id 6248b588a1207586a074a2c31b036bc6ba70d6c7b91fde24db377e5e98dd7d84
Jul 01 19:23:37.457014 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.456991    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-trspk"
Jul 01 19:23:37.459223 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:37.459197    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a4e7494ec4e45c9b53bd4ccf02e8194.slice/crio-57959e294607a2f94fd9f9735880fa219696f4f25187fda3bdab72c28899f78d WatchSource:0}: Error finding container 57959e294607a2f94fd9f9735880fa219696f4f25187fda3bdab72c28899f78d: Status 404 returned error can't find the container with id 57959e294607a2f94fd9f9735880fa219696f4f25187fda3bdab72c28899f78d
Jul 01 19:23:37.465459 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:37.465432    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2130321f_c2a8_4308_8f86_04d826bdebbd.slice/crio-693dfc4394426d074dc4622f914e8eec84da47c52bcbca452edf2d565700461a WatchSource:0}: Error finding container 693dfc4394426d074dc4622f914e8eec84da47c52bcbca452edf2d565700461a: Status 404 returned error can't find the container with id 693dfc4394426d074dc4622f914e8eec84da47c52bcbca452edf2d565700461a
Jul 01 19:23:37.473077 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.473057    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gql7j"
Jul 01 19:23:37.480384 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:37.480351    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83cd86be_0e41_4882_be06_4014a93cde38.slice/crio-95b448abfb86bb227a6172aa406aa8dee3254502464f661daf1c18122af23230 WatchSource:0}: Error finding container 95b448abfb86bb227a6172aa406aa8dee3254502464f661daf1c18122af23230: Status 404 returned error can't find the container with id 95b448abfb86bb227a6172aa406aa8dee3254502464f661daf1c18122af23230
Jul 01 19:23:37.481532 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.481515    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qrmf"
Jul 01 19:23:37.490920 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:37.490900    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82ac6af5_5835_474f_a582_e8cca885f010.slice/crio-f01fe515a74d5459bb990c82f4d08c06f7e2d506a9db5046488fc25b40025b95 WatchSource:0}: Error finding container f01fe515a74d5459bb990c82f4d08c06f7e2d506a9db5046488fc25b40025b95: Status 404 returned error can't find the container with id f01fe515a74d5459bb990c82f4d08c06f7e2d506a9db5046488fc25b40025b95
Jul 01 19:23:37.495537 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.495518    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2k92k"
Jul 01 19:23:37.501879 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:37.501859    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b1f80b9_6ebb_4244_a8ab_d93b9e13b002.slice/crio-20e1e7f45a76ba25e5514b92797d77f1ef62a54e27f12c35696572e841e31d32 WatchSource:0}: Error finding container 20e1e7f45a76ba25e5514b92797d77f1ef62a54e27f12c35696572e841e31d32: Status 404 returned error can't find the container with id 20e1e7f45a76ba25e5514b92797d77f1ef62a54e27f12c35696572e841e31d32
Jul 01 19:23:37.508140 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.508122    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z4m25"
Jul 01 19:23:37.514509 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:37.514490    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44702a43_1427_4499_a1ce_c22c7c3a7dbe.slice/crio-e4c747f728b21a2fa5dc7153c7bb5c8c686575e4b5292df860bd8811d1acfa0b WatchSource:0}: Error finding container e4c747f728b21a2fa5dc7153c7bb5c8c686575e4b5292df860bd8811d1acfa0b: Status 404 returned error can't find the container with id e4c747f728b21a2fa5dc7153c7bb5c8c686575e4b5292df860bd8811d1acfa0b
Jul 01 19:23:37.515078 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.515066    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5c4z2"
Jul 01 19:23:37.519920 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.519900    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:23:37.521893 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:37.521869    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92d21eec_cdb9_4f37_848b_a6a29232d828.slice/crio-112387063bc136f42e8b10344baaf13332be719f665c3ea414a6725dc406fbb0 WatchSource:0}: Error finding container 112387063bc136f42e8b10344baaf13332be719f665c3ea414a6725dc406fbb0: Status 404 returned error can't find the container with id 112387063bc136f42e8b10344baaf13332be719f665c3ea414a6725dc406fbb0
Jul 01 19:23:37.527181 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:37.527164    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd621ab71_8427_42af_bfa4_f83db9c5800d.slice/crio-9793c2bcbbab7a487e0b6587819dbc6078f6bd853621cd8587aaa44cccbd9663 WatchSource:0}: Error finding container 9793c2bcbbab7a487e0b6587819dbc6078f6bd853621cd8587aaa44cccbd9663: Status 404 returned error can't find the container with id 9793c2bcbbab7a487e0b6587819dbc6078f6bd853621cd8587aaa44cccbd9663
Jul 01 19:23:37.540461 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.540444    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-szp8f"
Jul 01 19:23:37.547323 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:23:37.547298    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7f64003_a6be_4ff0_8d7b_ebc0489f3d75.slice/crio-7bc91778c93979eeaaaadf714f767967d58bcec0d2f71f6b0ef1f497d1628f7b WatchSource:0}: Error finding container 7bc91778c93979eeaaaadf714f767967d58bcec0d2f71f6b0ef1f497d1628f7b: Status 404 returned error can't find the container with id 7bc91778c93979eeaaaadf714f767967d58bcec0d2f71f6b0ef1f497d1628f7b
Jul 01 19:23:37.774870 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.774774    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36332f97-ad96-472d-a040-542d79e9e865-metrics-certs\") pod \"network-metrics-daemon-7mfxn\" (UID: \"36332f97-ad96-472d-a040-542d79e9e865\") " pod="openshift-multus/network-metrics-daemon-7mfxn"
Jul 01 19:23:37.774870 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.774845    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/091570c8-2f14-46c0-a514-c35f2d3096c4-original-pull-secret\") pod \"global-pull-secret-syncer-9znvt\" (UID: \"091570c8-2f14-46c0-a514-c35f2d3096c4\") " pod="kube-system/global-pull-secret-syncer-9znvt"
Jul 01 19:23:37.775101 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:37.775020    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 19:23:37.775101 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:37.775052    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 01 19:23:37.775200 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:37.775117    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36332f97-ad96-472d-a040-542d79e9e865-metrics-certs podName:36332f97-ad96-472d-a040-542d79e9e865 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:38.77509139 +0000 UTC m=+3.138103069 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36332f97-ad96-472d-a040-542d79e9e865-metrics-certs") pod "network-metrics-daemon-7mfxn" (UID: "36332f97-ad96-472d-a040-542d79e9e865") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 19:23:37.775200 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:37.775153    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/091570c8-2f14-46c0-a514-c35f2d3096c4-original-pull-secret podName:091570c8-2f14-46c0-a514-c35f2d3096c4 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:38.775130509 +0000 UTC m=+3.138142177 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/091570c8-2f14-46c0-a514-c35f2d3096c4-original-pull-secret") pod "global-pull-secret-syncer-9znvt" (UID: "091570c8-2f14-46c0-a514-c35f2d3096c4") : object "kube-system"/"original-pull-secret" not registered
Jul 01 19:23:37.876276 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.876239    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4tkv\" (UniqueName: \"kubernetes.io/projected/64190ce2-a2fa-4276-a619-3e43188597ac-kube-api-access-z4tkv\") pod \"network-check-target-g7lwk\" (UID: \"64190ce2-a2fa-4276-a619-3e43188597ac\") " pod="openshift-network-diagnostics/network-check-target-g7lwk"
Jul 01 19:23:37.876507 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:37.876484    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 01 19:23:37.876583 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:37.876517    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 01 19:23:37.876583 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:37.876532    2556 projected.go:196] Error preparing data for projected volume kube-api-access-z4tkv for pod openshift-network-diagnostics/network-check-target-g7lwk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 19:23:37.876692 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:37.876609    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/64190ce2-a2fa-4276-a619-3e43188597ac-kube-api-access-z4tkv podName:64190ce2-a2fa-4276-a619-3e43188597ac nodeName:}" failed. No retries permitted until 2026-07-01 19:23:38.876587479 +0000 UTC m=+3.239599158 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-z4tkv" (UniqueName: "kubernetes.io/projected/64190ce2-a2fa-4276-a619-3e43188597ac-kube-api-access-z4tkv") pod "network-check-target-g7lwk" (UID: "64190ce2-a2fa-4276-a619-3e43188597ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 19:23:37.921443 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:37.921409    2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 01 19:23:38.253563 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:38.251685    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7lwk"
Jul 01 19:23:38.253563 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:38.251899    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g7lwk" podUID="64190ce2-a2fa-4276-a619-3e43188597ac"
Jul 01 19:23:38.260398 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:38.260107    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-212.ec2.internal" event={"ID":"ba6d1208eed95769604e1c9127dc48d4","Type":"ContainerStarted","Data":"537d33bb7ad232274a56a8818482a98ed4da39c49d9ee65ae98abd0b790c0fee"}
Jul 01 19:23:38.262314 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:38.262253    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-szp8f" event={"ID":"a7f64003-a6be-4ff0-8d7b-ebc0489f3d75","Type":"ContainerStarted","Data":"7bc91778c93979eeaaaadf714f767967d58bcec0d2f71f6b0ef1f497d1628f7b"}
Jul 01 19:23:38.265080 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:38.264958    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l" event={"ID":"d621ab71-8427-42af-bfa4-f83db9c5800d","Type":"ContainerStarted","Data":"9793c2bcbbab7a487e0b6587819dbc6078f6bd853621cd8587aaa44cccbd9663"}
Jul 01 19:23:38.275084 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:38.275019    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 19:18:37 +0000 UTC" deadline="2028-04-02 00:51:04.289991166 +0000 UTC"
Jul 01 19:23:38.275084 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:38.275058    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15365h27m26.014937636s"
Jul 01 19:23:38.275335 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:38.275310    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4m25" event={"ID":"44702a43-1427-4499-a1ce-c22c7c3a7dbe","Type":"ContainerStarted","Data":"e4c747f728b21a2fa5dc7153c7bb5c8c686575e4b5292df860bd8811d1acfa0b"}
Jul 01 19:23:38.281181 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:38.281139    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2k92k" event={"ID":"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002","Type":"ContainerStarted","Data":"20e1e7f45a76ba25e5514b92797d77f1ef62a54e27f12c35696572e841e31d32"}
Jul 01 19:23:38.284052 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:38.284020    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qrmf" event={"ID":"82ac6af5-5835-474f-a582-e8cca885f010","Type":"ContainerStarted","Data":"f01fe515a74d5459bb990c82f4d08c06f7e2d506a9db5046488fc25b40025b95"}
Jul 01 19:23:38.309099 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:38.309040    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gql7j" event={"ID":"83cd86be-0e41-4882-be06-4014a93cde38","Type":"ContainerStarted","Data":"95b448abfb86bb227a6172aa406aa8dee3254502464f661daf1c18122af23230"}
Jul 01 19:23:38.331196 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:38.331158    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jpfpn" event={"ID":"558a74fc-97f8-4db3-a2de-813540a74fd6","Type":"ContainerStarted","Data":"6248b588a1207586a074a2c31b036bc6ba70d6c7b91fde24db377e5e98dd7d84"}
Jul 01 19:23:38.340439 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:38.340377    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5c4z2" event={"ID":"92d21eec-cdb9-4f37-848b-a6a29232d828","Type":"ContainerStarted","Data":"112387063bc136f42e8b10344baaf13332be719f665c3ea414a6725dc406fbb0"}
Jul 01 19:23:38.351784 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:38.351751    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-trspk" event={"ID":"2130321f-c2a8-4308-8f86-04d826bdebbd","Type":"ContainerStarted","Data":"693dfc4394426d074dc4622f914e8eec84da47c52bcbca452edf2d565700461a"}
Jul 01 19:23:38.363499 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:38.361899    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-212.ec2.internal" event={"ID":"2a4e7494ec4e45c9b53bd4ccf02e8194","Type":"ContainerStarted","Data":"57959e294607a2f94fd9f9735880fa219696f4f25187fda3bdab72c28899f78d"}
Jul 01 19:23:38.372299 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:38.372271    2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 01 19:23:38.784075 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:38.783153    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/091570c8-2f14-46c0-a514-c35f2d3096c4-original-pull-secret\") pod \"global-pull-secret-syncer-9znvt\" (UID: \"091570c8-2f14-46c0-a514-c35f2d3096c4\") " pod="kube-system/global-pull-secret-syncer-9znvt"
Jul 01 19:23:38.784075 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:38.783257    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36332f97-ad96-472d-a040-542d79e9e865-metrics-certs\") pod \"network-metrics-daemon-7mfxn\" (UID: \"36332f97-ad96-472d-a040-542d79e9e865\") " pod="openshift-multus/network-metrics-daemon-7mfxn"
Jul 01 19:23:38.784075 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:38.783393    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 19:23:38.784075 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:38.783477    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36332f97-ad96-472d-a040-542d79e9e865-metrics-certs podName:36332f97-ad96-472d-a040-542d79e9e865 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:40.783456685 +0000 UTC m=+5.146468351 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36332f97-ad96-472d-a040-542d79e9e865-metrics-certs") pod "network-metrics-daemon-7mfxn" (UID: "36332f97-ad96-472d-a040-542d79e9e865") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 19:23:38.784075 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:38.783928    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 01 19:23:38.784075 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:38.783987    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/091570c8-2f14-46c0-a514-c35f2d3096c4-original-pull-secret podName:091570c8-2f14-46c0-a514-c35f2d3096c4 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:40.783970645 +0000 UTC m=+5.146982327 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/091570c8-2f14-46c0-a514-c35f2d3096c4-original-pull-secret") pod "global-pull-secret-syncer-9znvt" (UID: "091570c8-2f14-46c0-a514-c35f2d3096c4") : object "kube-system"/"original-pull-secret" not registered
Jul 01 19:23:38.883744 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:38.883709    2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 01 19:23:38.884288 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:38.884261    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4tkv\" (UniqueName: \"kubernetes.io/projected/64190ce2-a2fa-4276-a619-3e43188597ac-kube-api-access-z4tkv\") pod \"network-check-target-g7lwk\" (UID: \"64190ce2-a2fa-4276-a619-3e43188597ac\") " pod="openshift-network-diagnostics/network-check-target-g7lwk"
Jul 01 19:23:38.884485 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:38.884468    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 01 19:23:38.884559 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:38.884497    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 01 19:23:38.884559 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:38.884511    2556 projected.go:196] Error preparing data for projected volume kube-api-access-z4tkv for pod openshift-network-diagnostics/network-check-target-g7lwk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 19:23:38.884667 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:38.884584    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/64190ce2-a2fa-4276-a619-3e43188597ac-kube-api-access-z4tkv podName:64190ce2-a2fa-4276-a619-3e43188597ac nodeName:}" failed. No retries permitted until 2026-07-01 19:23:40.884565461 +0000 UTC m=+5.247577126 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-z4tkv" (UniqueName: "kubernetes.io/projected/64190ce2-a2fa-4276-a619-3e43188597ac-kube-api-access-z4tkv") pod "network-check-target-g7lwk" (UID: "64190ce2-a2fa-4276-a619-3e43188597ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 19:23:39.250681 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:39.250574    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mfxn"
Jul 01 19:23:39.250851 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:39.250720    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mfxn" podUID="36332f97-ad96-472d-a040-542d79e9e865"
Jul 01 19:23:39.251167 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:39.251144    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znvt"
Jul 01 19:23:39.251280 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:39.251250    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znvt" podUID="091570c8-2f14-46c0-a514-c35f2d3096c4"
Jul 01 19:23:39.276770 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:39.276330    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 19:18:37 +0000 UTC" deadline="2028-01-21 04:38:10.538146953 +0000 UTC"
Jul 01 19:23:39.276770 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:39.276404    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13641h14m31.261747099s"
Jul 01 19:23:40.251025 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:40.250936    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7lwk"
Jul 01 19:23:40.251181 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:40.251090    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g7lwk" podUID="64190ce2-a2fa-4276-a619-3e43188597ac"
Jul 01 19:23:40.802059 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:40.802016    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/091570c8-2f14-46c0-a514-c35f2d3096c4-original-pull-secret\") pod \"global-pull-secret-syncer-9znvt\" (UID: \"091570c8-2f14-46c0-a514-c35f2d3096c4\") " pod="kube-system/global-pull-secret-syncer-9znvt"
Jul 01 19:23:40.802611 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:40.802206    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 01 19:23:40.802611 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:40.802281    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36332f97-ad96-472d-a040-542d79e9e865-metrics-certs\") pod \"network-metrics-daemon-7mfxn\" (UID: \"36332f97-ad96-472d-a040-542d79e9e865\") " pod="openshift-multus/network-metrics-daemon-7mfxn"
Jul 01 19:23:40.802611 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:40.802312    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/091570c8-2f14-46c0-a514-c35f2d3096c4-original-pull-secret podName:091570c8-2f14-46c0-a514-c35f2d3096c4 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:44.802289294 +0000 UTC m=+9.165300959 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/091570c8-2f14-46c0-a514-c35f2d3096c4-original-pull-secret") pod "global-pull-secret-syncer-9znvt" (UID: "091570c8-2f14-46c0-a514-c35f2d3096c4") : object "kube-system"/"original-pull-secret" not registered
Jul 01 19:23:40.802611 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:40.802379    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 19:23:40.802611 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:40.802458    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36332f97-ad96-472d-a040-542d79e9e865-metrics-certs podName:36332f97-ad96-472d-a040-542d79e9e865 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:44.802441504 +0000 UTC m=+9.165453165 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36332f97-ad96-472d-a040-542d79e9e865-metrics-certs") pod "network-metrics-daemon-7mfxn" (UID: "36332f97-ad96-472d-a040-542d79e9e865") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 19:23:40.902945 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:40.902898    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4tkv\" (UniqueName: \"kubernetes.io/projected/64190ce2-a2fa-4276-a619-3e43188597ac-kube-api-access-z4tkv\") pod \"network-check-target-g7lwk\" (UID: \"64190ce2-a2fa-4276-a619-3e43188597ac\") " pod="openshift-network-diagnostics/network-check-target-g7lwk"
Jul 01 19:23:40.903185 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:40.903164    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 01 19:23:40.903256 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:40.903193    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 01 19:23:40.903256 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:40.903208    2556 projected.go:196] Error preparing data for projected volume kube-api-access-z4tkv for pod openshift-network-diagnostics/network-check-target-g7lwk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 19:23:40.903374 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:40.903266    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/64190ce2-a2fa-4276-a619-3e43188597ac-kube-api-access-z4tkv podName:64190ce2-a2fa-4276-a619-3e43188597ac nodeName:}" failed. No retries permitted until 2026-07-01 19:23:44.903249951 +0000 UTC m=+9.266261612 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-z4tkv" (UniqueName: "kubernetes.io/projected/64190ce2-a2fa-4276-a619-3e43188597ac-kube-api-access-z4tkv") pod "network-check-target-g7lwk" (UID: "64190ce2-a2fa-4276-a619-3e43188597ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 19:23:41.250467 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:41.249955    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mfxn"
Jul 01 19:23:41.250467 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:41.250120    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mfxn" podUID="36332f97-ad96-472d-a040-542d79e9e865"
Jul 01 19:23:41.250772 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:41.250744    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znvt"
Jul 01 19:23:41.250911 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:41.250866    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znvt" podUID="091570c8-2f14-46c0-a514-c35f2d3096c4"
Jul 01 19:23:42.250952 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:42.250370    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7lwk"
Jul 01 19:23:42.250952 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:42.250531    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g7lwk" podUID="64190ce2-a2fa-4276-a619-3e43188597ac"
Jul 01 19:23:43.250693 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:43.250652    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znvt"
Jul 01 19:23:43.250897 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:43.250794    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znvt" podUID="091570c8-2f14-46c0-a514-c35f2d3096c4"
Jul 01 19:23:43.251234 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:43.251212    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mfxn"
Jul 01 19:23:43.251685 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:43.251322    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mfxn" podUID="36332f97-ad96-472d-a040-542d79e9e865"
Jul 01 19:23:44.250618 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:44.250539    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7lwk"
Jul 01 19:23:44.250833 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:44.250752    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g7lwk" podUID="64190ce2-a2fa-4276-a619-3e43188597ac"
Jul 01 19:23:44.839793 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:44.839749    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36332f97-ad96-472d-a040-542d79e9e865-metrics-certs\") pod \"network-metrics-daemon-7mfxn\" (UID: \"36332f97-ad96-472d-a040-542d79e9e865\") " pod="openshift-multus/network-metrics-daemon-7mfxn"
Jul 01 19:23:44.840316 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:44.839809    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/091570c8-2f14-46c0-a514-c35f2d3096c4-original-pull-secret\") pod \"global-pull-secret-syncer-9znvt\" (UID: \"091570c8-2f14-46c0-a514-c35f2d3096c4\") " pod="kube-system/global-pull-secret-syncer-9znvt"
Jul 01 19:23:44.840316 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:44.839921    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 01 19:23:44.840316 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:44.839985    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/091570c8-2f14-46c0-a514-c35f2d3096c4-original-pull-secret podName:091570c8-2f14-46c0-a514-c35f2d3096c4 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:52.839963867 +0000 UTC m=+17.202975530 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/091570c8-2f14-46c0-a514-c35f2d3096c4-original-pull-secret") pod "global-pull-secret-syncer-9znvt" (UID: "091570c8-2f14-46c0-a514-c35f2d3096c4") : object "kube-system"/"original-pull-secret" not registered
Jul 01 19:23:44.840316 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:44.839921    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 19:23:44.840316 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:44.840045    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36332f97-ad96-472d-a040-542d79e9e865-metrics-certs podName:36332f97-ad96-472d-a040-542d79e9e865 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:52.840031978 +0000 UTC m=+17.203043654 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36332f97-ad96-472d-a040-542d79e9e865-metrics-certs") pod "network-metrics-daemon-7mfxn" (UID: "36332f97-ad96-472d-a040-542d79e9e865") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 19:23:44.941305 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:44.941184    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4tkv\" (UniqueName: \"kubernetes.io/projected/64190ce2-a2fa-4276-a619-3e43188597ac-kube-api-access-z4tkv\") pod \"network-check-target-g7lwk\" (UID: \"64190ce2-a2fa-4276-a619-3e43188597ac\") " pod="openshift-network-diagnostics/network-check-target-g7lwk"
Jul 01 19:23:44.941493 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:44.941350    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 01 19:23:44.941493 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:44.941375    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 01 19:23:44.941493 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:44.941388    2556 projected.go:196] Error preparing data for projected volume kube-api-access-z4tkv for pod openshift-network-diagnostics/network-check-target-g7lwk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 19:23:44.941493 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:44.941481    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/64190ce2-a2fa-4276-a619-3e43188597ac-kube-api-access-z4tkv podName:64190ce2-a2fa-4276-a619-3e43188597ac nodeName:}" failed. No retries permitted until 2026-07-01 19:23:52.941461147 +0000 UTC m=+17.304472822 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-z4tkv" (UniqueName: "kubernetes.io/projected/64190ce2-a2fa-4276-a619-3e43188597ac-kube-api-access-z4tkv") pod "network-check-target-g7lwk" (UID: "64190ce2-a2fa-4276-a619-3e43188597ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 19:23:45.249604 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:45.249567    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mfxn"
Jul 01 19:23:45.249810 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:45.249577    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znvt"
Jul 01 19:23:45.249810 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:45.249741    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mfxn" podUID="36332f97-ad96-472d-a040-542d79e9e865"
Jul 01 19:23:45.249931 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:45.249827    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znvt" podUID="091570c8-2f14-46c0-a514-c35f2d3096c4"
Jul 01 19:23:46.250858 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:46.250791    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7lwk"
Jul 01 19:23:46.251393 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:46.250905    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g7lwk" podUID="64190ce2-a2fa-4276-a619-3e43188597ac"
Jul 01 19:23:47.249959 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:47.249920    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mfxn"
Jul 01 19:23:47.250222 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:47.249920    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znvt"
Jul 01 19:23:47.250222 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:47.250067    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mfxn" podUID="36332f97-ad96-472d-a040-542d79e9e865"
Jul 01 19:23:47.250222 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:47.250097    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znvt" podUID="091570c8-2f14-46c0-a514-c35f2d3096c4"
Jul 01 19:23:48.250514 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:48.250477    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7lwk"
Jul 01 19:23:48.251058 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:48.250605    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g7lwk" podUID="64190ce2-a2fa-4276-a619-3e43188597ac"
Jul 01 19:23:49.249952 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:49.249914    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mfxn"
Jul 01 19:23:49.250118 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:49.249951    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znvt"
Jul 01 19:23:49.250118 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:49.250069    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mfxn" podUID="36332f97-ad96-472d-a040-542d79e9e865"
Jul 01 19:23:49.250202 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:49.250184    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znvt" podUID="091570c8-2f14-46c0-a514-c35f2d3096c4"
Jul 01 19:23:50.250210 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:50.250179    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7lwk"
Jul 01 19:23:50.250679 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:50.250300    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g7lwk" podUID="64190ce2-a2fa-4276-a619-3e43188597ac"
Jul 01 19:23:51.249987 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:51.249953    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znvt"
Jul 01 19:23:51.250177 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:51.250073    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znvt" podUID="091570c8-2f14-46c0-a514-c35f2d3096c4"
Jul 01 19:23:51.250177 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:51.250134    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mfxn"
Jul 01 19:23:51.250290 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:51.250242    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mfxn" podUID="36332f97-ad96-472d-a040-542d79e9e865"
Jul 01 19:23:52.250516 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:52.250483    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7lwk"
Jul 01 19:23:52.250938 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:52.250608    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g7lwk" podUID="64190ce2-a2fa-4276-a619-3e43188597ac"
Jul 01 19:23:52.900632 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:52.900590    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36332f97-ad96-472d-a040-542d79e9e865-metrics-certs\") pod \"network-metrics-daemon-7mfxn\" (UID: \"36332f97-ad96-472d-a040-542d79e9e865\") " pod="openshift-multus/network-metrics-daemon-7mfxn"
Jul 01 19:23:52.900848 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:52.900647    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/091570c8-2f14-46c0-a514-c35f2d3096c4-original-pull-secret\") pod \"global-pull-secret-syncer-9znvt\" (UID: \"091570c8-2f14-46c0-a514-c35f2d3096c4\") " pod="kube-system/global-pull-secret-syncer-9znvt"
Jul 01 19:23:52.900848 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:52.900783    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 01 19:23:52.900848 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:52.900848    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/091570c8-2f14-46c0-a514-c35f2d3096c4-original-pull-secret podName:091570c8-2f14-46c0-a514-c35f2d3096c4 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:08.900829302 +0000 UTC m=+33.263840964 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/091570c8-2f14-46c0-a514-c35f2d3096c4-original-pull-secret") pod "global-pull-secret-syncer-9znvt" (UID: "091570c8-2f14-46c0-a514-c35f2d3096c4") : object "kube-system"/"original-pull-secret" not registered
Jul 01 19:23:52.901013 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:52.900784    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 19:23:52.901013 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:52.900960    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36332f97-ad96-472d-a040-542d79e9e865-metrics-certs podName:36332f97-ad96-472d-a040-542d79e9e865 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:08.900916774 +0000 UTC m=+33.263928436 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36332f97-ad96-472d-a040-542d79e9e865-metrics-certs") pod "network-metrics-daemon-7mfxn" (UID: "36332f97-ad96-472d-a040-542d79e9e865") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 19:23:53.001918 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:53.001868    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4tkv\" (UniqueName: \"kubernetes.io/projected/64190ce2-a2fa-4276-a619-3e43188597ac-kube-api-access-z4tkv\") pod \"network-check-target-g7lwk\" (UID: \"64190ce2-a2fa-4276-a619-3e43188597ac\") " pod="openshift-network-diagnostics/network-check-target-g7lwk"
Jul 01 19:23:53.002095 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:53.002039    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 01 19:23:53.002095 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:53.002067    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 01 19:23:53.002095 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:53.002080    2556 projected.go:196] Error preparing data for projected volume kube-api-access-z4tkv for pod openshift-network-diagnostics/network-check-target-g7lwk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 19:23:53.002211 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:53.002140    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/64190ce2-a2fa-4276-a619-3e43188597ac-kube-api-access-z4tkv podName:64190ce2-a2fa-4276-a619-3e43188597ac nodeName:}" failed. No retries permitted until 2026-07-01 19:24:09.002128064 +0000 UTC m=+33.365139723 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-z4tkv" (UniqueName: "kubernetes.io/projected/64190ce2-a2fa-4276-a619-3e43188597ac-kube-api-access-z4tkv") pod "network-check-target-g7lwk" (UID: "64190ce2-a2fa-4276-a619-3e43188597ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 19:23:53.250514 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:53.250476    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mfxn"
Jul 01 19:23:53.250945 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:53.250608    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mfxn" podUID="36332f97-ad96-472d-a040-542d79e9e865"
Jul 01 19:23:53.250945 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:53.250671    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znvt"
Jul 01 19:23:53.250945 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:53.250798    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znvt" podUID="091570c8-2f14-46c0-a514-c35f2d3096c4"
Jul 01 19:23:54.249741 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:54.249714    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7lwk"
Jul 01 19:23:54.249928 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:54.249835    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g7lwk" podUID="64190ce2-a2fa-4276-a619-3e43188597ac"
Jul 01 19:23:55.249918 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:55.249876    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mfxn"
Jul 01 19:23:55.250401 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:55.250021    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mfxn" podUID="36332f97-ad96-472d-a040-542d79e9e865"
Jul 01 19:23:55.250401 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:55.250066    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znvt"
Jul 01 19:23:55.250401 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:55.250175    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znvt" podUID="091570c8-2f14-46c0-a514-c35f2d3096c4"
Jul 01 19:23:56.250572 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:56.250540    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7lwk"
Jul 01 19:23:56.251037 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:56.250661    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g7lwk" podUID="64190ce2-a2fa-4276-a619-3e43188597ac"
Jul 01 19:23:57.249823 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:57.249787    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mfxn"
Jul 01 19:23:57.250012 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:57.249803    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znvt"
Jul 01 19:23:57.250012 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:57.249925    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mfxn" podUID="36332f97-ad96-472d-a040-542d79e9e865"
Jul 01 19:23:57.250012 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:57.250001    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znvt" podUID="091570c8-2f14-46c0-a514-c35f2d3096c4"
Jul 01 19:23:58.249624 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:58.249587    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7lwk"
Jul 01 19:23:58.249982 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:58.249696    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g7lwk" podUID="64190ce2-a2fa-4276-a619-3e43188597ac"
Jul 01 19:23:59.249984 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:59.249815    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mfxn"
Jul 01 19:23:59.250550 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:59.249832    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znvt"
Jul 01 19:23:59.250550 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:59.250066    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mfxn" podUID="36332f97-ad96-472d-a040-542d79e9e865"
Jul 01 19:23:59.250550 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:23:59.250131    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znvt" podUID="091570c8-2f14-46c0-a514-c35f2d3096c4"
Jul 01 19:23:59.433813 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:59.433777    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jpfpn" event={"ID":"558a74fc-97f8-4db3-a2de-813540a74fd6","Type":"ContainerStarted","Data":"a74676c5c4102466d78b03e3ddf8bd81a331f40407e1174f178819a6421f6363"}
Jul 01 19:23:59.435227 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:59.435198    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-trspk" event={"ID":"2130321f-c2a8-4308-8f86-04d826bdebbd","Type":"ContainerStarted","Data":"d8f83dfc20c970ee7b0bc20e647710db2ef1606173a76b4dfa0726147131dab4"}
Jul 01 19:23:59.436535 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:59.436511    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-212.ec2.internal" event={"ID":"2a4e7494ec4e45c9b53bd4ccf02e8194","Type":"ContainerStarted","Data":"aecb8bfa67f81b669d00542179b57b511c0c09c23e27cefdffb51c20150bca22"}
Jul 01 19:23:59.437955 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:59.437930    2556 generic.go:356] "Generic (PLEG): container finished" podID="ba6d1208eed95769604e1c9127dc48d4" containerID="856d85aefa83083ccb17a722e99a31428ad6c5612a4d66a683dcbc7885a1ebe9" exitCode=0
Jul 01 19:23:59.438075 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:59.438003    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-212.ec2.internal" event={"ID":"ba6d1208eed95769604e1c9127dc48d4","Type":"ContainerDied","Data":"856d85aefa83083ccb17a722e99a31428ad6c5612a4d66a683dcbc7885a1ebe9"}
Jul 01 19:23:59.439340 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:59.439322    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-szp8f" event={"ID":"a7f64003-a6be-4ff0-8d7b-ebc0489f3d75","Type":"ContainerStarted","Data":"0238bf0b72a6b69acf72dd9fdd80f9f232a1fe0ac1059c3903054081c8959014"}
Jul 01 19:23:59.442018 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:59.441999    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tq4l_d621ab71-8427-42af-bfa4-f83db9c5800d/ovn-acl-logging/0.log"
Jul 01 19:23:59.442339 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:59.442320    2556 generic.go:356] "Generic (PLEG): container finished" podID="d621ab71-8427-42af-bfa4-f83db9c5800d" containerID="a1446ea706b73c39e5b8e6eb4e7ce721b78744b558185b10f252c82e01805009" exitCode=1
Jul 01 19:23:59.442426 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:59.442391    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l" event={"ID":"d621ab71-8427-42af-bfa4-f83db9c5800d","Type":"ContainerStarted","Data":"276d4d974a8d8647b9be0e5a10e2f48100065652d43f8c097c741e5de768e98b"}
Jul 01 19:23:59.442468 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:59.442444    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l" event={"ID":"d621ab71-8427-42af-bfa4-f83db9c5800d","Type":"ContainerStarted","Data":"47e0b5b116ea6e5469cdb47976e4fce257e745b1104d81b6d4ff339c29de3d80"}
Jul 01 19:23:59.442505 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:59.442480    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l" event={"ID":"d621ab71-8427-42af-bfa4-f83db9c5800d","Type":"ContainerStarted","Data":"fb51d3e91bf336070f77e17c6986e3b6c320a203ba4415a4ecd0ee634eaa8fff"}
Jul 01 19:23:59.442538 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:59.442510    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l" event={"ID":"d621ab71-8427-42af-bfa4-f83db9c5800d","Type":"ContainerStarted","Data":"6fdbc0aa473eae655002cc1ffe3c48f83508e774b47eed9fd931ad92aaaf7813"}
Jul 01 19:23:59.442614 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:59.442602    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l" event={"ID":"d621ab71-8427-42af-bfa4-f83db9c5800d","Type":"ContainerDied","Data":"a1446ea706b73c39e5b8e6eb4e7ce721b78744b558185b10f252c82e01805009"}
Jul 01 19:23:59.442661 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:59.442648    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l" event={"ID":"d621ab71-8427-42af-bfa4-f83db9c5800d","Type":"ContainerStarted","Data":"b3bce944324ade070a18338b53071f71b59b8d29887d82850807473b41d98f59"}
Jul 01 19:23:59.443783 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:59.443763    2556 generic.go:356] "Generic (PLEG): container finished" podID="44702a43-1427-4499-a1ce-c22c7c3a7dbe" containerID="f592f73effe94ec786e33c244ebc18ac3c5eb2c09af700ebbacaf4aa459ba606" exitCode=0
Jul 01 19:23:59.443867 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:59.443828    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4m25" event={"ID":"44702a43-1427-4499-a1ce-c22c7c3a7dbe","Type":"ContainerDied","Data":"f592f73effe94ec786e33c244ebc18ac3c5eb2c09af700ebbacaf4aa459ba606"}
Jul 01 19:23:59.447968 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:59.447946    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2k92k" event={"ID":"6b1f80b9-6ebb-4244-a8ab-d93b9e13b002","Type":"ContainerStarted","Data":"21914817563c7e8987ce6b4c9b14a7de7a1eba7c51ceab9b2194e5d16f34474d"}
Jul 01 19:23:59.449384 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:59.449340    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qrmf" event={"ID":"82ac6af5-5835-474f-a582-e8cca885f010","Type":"ContainerStarted","Data":"6be198a47f489154d6658925c037166649d09a0de6fdf48dd16f2ea5b9914d33"}
Jul 01 19:23:59.450577 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:59.450534    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jpfpn" podStartSLOduration=1.524654519 podStartE2EDuration="22.450520855s" totalImagesPullingTime="20.925866336s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:23:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:59.44986569 +0000 UTC m=+23.812877373" watchObservedRunningTime="2026-07-01 19:23:59.450520855 +0000 UTC m=+23.813532557"
Jul 01 19:23:59.450663 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:59.450631    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gql7j" event={"ID":"83cd86be-0e41-4882-be06-4014a93cde38","Type":"ContainerStarted","Data":"c85d66187fcb2a86abd2ab920a1c9e177f3566d5572116c58ca0383dca563b60"}
Jul 01 19:23:59.488081 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:59.487885    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2k92k" podStartSLOduration=1.226285479 podStartE2EDuration="22.487865197s" totalImagesPullingTime="21.261579718s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:23:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:59.487315559 +0000 UTC m=+23.850327243" watchObservedRunningTime="2026-07-01 19:23:59.487865197 +0000 UTC m=+23.850876879"
Jul 01 19:23:59.528050 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:59.527917    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-szp8f" podStartSLOduration=1.7303838599999999 podStartE2EDuration="22.527897331s" totalImagesPullingTime="20.797513471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:23:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:59.527352446 +0000 UTC m=+23.890364126" watchObservedRunningTime="2026-07-01 19:23:59.527897331 +0000 UTC m=+23.890909013"
Jul 01 19:23:59.564312 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:59.564264    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-212.ec2.internal" podStartSLOduration=22.564250207 podStartE2EDuration="22.564250207s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:23:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:59.564245667 +0000 UTC m=+23.927257360" watchObservedRunningTime="2026-07-01 19:23:59.564250207 +0000 UTC m=+23.927261889"
Jul 01 19:23:59.578973 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:59.578932    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-trspk" podStartSLOduration=1.6741391239999999 podStartE2EDuration="22.578917451s" totalImagesPullingTime="20.904778327s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:23:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:59.578439522 +0000 UTC m=+23.941451204" watchObservedRunningTime="2026-07-01 19:23:59.578917451 +0000 UTC m=+23.941929131"
Jul 01 19:23:59.594731 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:59.594689    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gql7j" podStartSLOduration=1.731374323 podStartE2EDuration="22.594675413s" totalImagesPullingTime="20.86330109s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:23:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:59.594282567 +0000 UTC m=+23.957294248" watchObservedRunningTime="2026-07-01 19:23:59.594675413 +0000 UTC m=+23.957687112"
Jul 01 19:23:59.810120 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:59.810085    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-szp8f"
Jul 01 19:23:59.810643 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:23:59.810626    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-szp8f"
Jul 01 19:24:00.249924 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:00.249894    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7lwk"
Jul 01 19:24:00.250154 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:00.250019    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g7lwk" podUID="64190ce2-a2fa-4276-a619-3e43188597ac"
Jul 01 19:24:00.277171 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:00.277141    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-trspk_2130321f-c2a8-4308-8f86-04d826bdebbd/dns-node-resolver/0.log"
Jul 01 19:24:00.454144 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:00.454105    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5c4z2" event={"ID":"92d21eec-cdb9-4f37-848b-a6a29232d828","Type":"ContainerStarted","Data":"3403ef96c178313b11a79847b5a3718f0437e46b21f9b60c01d2b93d0820873d"}
Jul 01 19:24:00.455815 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:00.455783    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-212.ec2.internal" event={"ID":"ba6d1208eed95769604e1c9127dc48d4","Type":"ContainerStarted","Data":"26ed6f3e8314675ee25bd81035cfe80ab0ef906d67c93c7e7e620c6565544d78"}
Jul 01 19:24:00.477785 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:00.477731    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5c4z2" podStartSLOduration=2.655877609 podStartE2EDuration="23.477716153s" totalImagesPullingTime="20.821838544s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:23:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:00.476928458 +0000 UTC m=+24.839940137" watchObservedRunningTime="2026-07-01 19:24:00.477716153 +0000 UTC m=+24.840727834"
Jul 01 19:24:00.498972 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:00.498928    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-212.ec2.internal" podStartSLOduration=23.498913381 podStartE2EDuration="23.498913381s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:23:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:00.498680121 +0000 UTC m=+24.861691794" watchObservedRunningTime="2026-07-01 19:24:00.498913381 +0000 UTC m=+24.861925062"
Jul 01 19:24:00.704933 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:00.704908    2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 01 19:24:01.048463 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:01.048436    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gql7j_83cd86be-0e41-4882-be06-4014a93cde38/node-ca/0.log"
Jul 01 19:24:01.247751 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:01.247669    2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-01T19:24:00.704926799Z","UUID":"5acc4055-740d-4a08-afab-69f9346d3d61","Handler":null,"Name":"","Endpoint":""}
Jul 01 19:24:01.249154 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:01.249131    2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 01 19:24:01.249260 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:01.249176    2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 01 19:24:01.250713 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:01.249535    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mfxn"
Jul 01 19:24:01.250713 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:01.249666    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mfxn" podUID="36332f97-ad96-472d-a040-542d79e9e865"
Jul 01 19:24:01.250713 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:01.249715    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znvt"
Jul 01 19:24:01.250713 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:01.249824    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znvt" podUID="091570c8-2f14-46c0-a514-c35f2d3096c4"
Jul 01 19:24:01.463132 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:01.463104    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tq4l_d621ab71-8427-42af-bfa4-f83db9c5800d/ovn-acl-logging/0.log"
Jul 01 19:24:01.463681 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:01.463579    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l" event={"ID":"d621ab71-8427-42af-bfa4-f83db9c5800d","Type":"ContainerStarted","Data":"b30aa788a3334c4e9826059dcf87985c45a9cb7c10e0ca3d57594c3ca47b106a"}
Jul 01 19:24:01.466003 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:01.465976    2556 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 01 19:24:01.466102 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:01.466007    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qrmf" event={"ID":"82ac6af5-5835-474f-a582-e8cca885f010","Type":"ContainerStarted","Data":"fdf2e35b5bd3bbb21c2f1444a2f1fdf22b5db2665c812a046deb05373e56434e"}
Jul 01 19:24:02.249596 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:02.249562    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7lwk"
Jul 01 19:24:02.249792 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:02.249668    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g7lwk" podUID="64190ce2-a2fa-4276-a619-3e43188597ac"
Jul 01 19:24:02.470440 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:02.470399    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qrmf" event={"ID":"82ac6af5-5835-474f-a582-e8cca885f010","Type":"ContainerStarted","Data":"dd60c8c40206a7b81c76d0cadcf1f69b819afb9f1ed8829fe7fc91d7cf8bd821"}
Jul 01 19:24:02.491553 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:02.491494    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qrmf" podStartSLOduration=2.072335477 podStartE2EDuration="25.491478063s" totalImagesPullingTime="23.419142586s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:23:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:02.490893568 +0000 UTC m=+26.853905268" watchObservedRunningTime="2026-07-01 19:24:02.491478063 +0000 UTC m=+26.854489750"
Jul 01 19:24:03.250212 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:03.250168    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mfxn"
Jul 01 19:24:03.250212 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:03.250211    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znvt"
Jul 01 19:24:03.250456 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:03.250291    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mfxn" podUID="36332f97-ad96-472d-a040-542d79e9e865"
Jul 01 19:24:03.250497 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:03.250437    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znvt" podUID="091570c8-2f14-46c0-a514-c35f2d3096c4"
Jul 01 19:24:03.329003 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:03.328968    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-szp8f"
Jul 01 19:24:03.329203 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:03.329098    2556 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 01 19:24:03.329568 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:03.329547    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-szp8f"
Jul 01 19:24:04.250237 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:04.250199    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7lwk"
Jul 01 19:24:04.250673 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:04.250339    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g7lwk" podUID="64190ce2-a2fa-4276-a619-3e43188597ac"
Jul 01 19:24:05.250388 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:05.250331    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znvt"
Jul 01 19:24:05.251199 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:05.250397    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mfxn"
Jul 01 19:24:05.251199 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:05.250479    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znvt" podUID="091570c8-2f14-46c0-a514-c35f2d3096c4"
Jul 01 19:24:05.251199 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:05.250595    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mfxn" podUID="36332f97-ad96-472d-a040-542d79e9e865"
Jul 01 19:24:05.479756 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:05.479726    2556 generic.go:356] "Generic (PLEG): container finished" podID="44702a43-1427-4499-a1ce-c22c7c3a7dbe" containerID="baefc8225c6da73582c042bbf2852c09b0ff0e183ad25c310e3b668f1deee5c3" exitCode=0
Jul 01 19:24:05.479917 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:05.479813    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4m25" event={"ID":"44702a43-1427-4499-a1ce-c22c7c3a7dbe","Type":"ContainerDied","Data":"baefc8225c6da73582c042bbf2852c09b0ff0e183ad25c310e3b668f1deee5c3"}
Jul 01 19:24:05.483288 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:05.483270    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tq4l_d621ab71-8427-42af-bfa4-f83db9c5800d/ovn-acl-logging/0.log"
Jul 01 19:24:05.483639 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:05.483619    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l" event={"ID":"d621ab71-8427-42af-bfa4-f83db9c5800d","Type":"ContainerStarted","Data":"7c5089be2b37f83bc23463d890fe74d8fa3366d8d924bc3ed9a4e99969cf9d99"}
Jul 01 19:24:05.483890 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:05.483851    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:24:05.483992 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:05.483914    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:24:05.484062 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:05.484036    2556 scope.go:117] "RemoveContainer" containerID="a1446ea706b73c39e5b8e6eb4e7ce721b78744b558185b10f252c82e01805009"
Jul 01 19:24:05.500175 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:05.500155    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:24:06.254682 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:06.254649    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7lwk"
Jul 01 19:24:06.255155 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:06.254736    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g7lwk" podUID="64190ce2-a2fa-4276-a619-3e43188597ac"
Jul 01 19:24:06.489203 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:06.489176    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tq4l_d621ab71-8427-42af-bfa4-f83db9c5800d/ovn-acl-logging/0.log"
Jul 01 19:24:06.489560 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:06.489531    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l" event={"ID":"d621ab71-8427-42af-bfa4-f83db9c5800d","Type":"ContainerStarted","Data":"1d34293ff1e94dff453f87d0315602fb6286b2e76008851714f53870b20c248c"}
Jul 01 19:24:06.489797 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:06.489776    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:24:06.505450 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:06.505360    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:24:06.520172 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:06.520119    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l" podStartSLOduration=8.644173396 podStartE2EDuration="29.520102758s" totalImagesPullingTime="20.875929362s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:23:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:06.519680663 +0000 UTC m=+30.882692345" watchObservedRunningTime="2026-07-01 19:24:06.520102758 +0000 UTC m=+30.883114439"
Jul 01 19:24:07.250033 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:07.249853    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mfxn"
Jul 01 19:24:07.250191 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:07.249897    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znvt"
Jul 01 19:24:07.250191 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:07.250120    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mfxn" podUID="36332f97-ad96-472d-a040-542d79e9e865"
Jul 01 19:24:07.250191 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:07.250181    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znvt" podUID="091570c8-2f14-46c0-a514-c35f2d3096c4"
Jul 01 19:24:07.493726 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:07.493692    2556 generic.go:356] "Generic (PLEG): container finished" podID="44702a43-1427-4499-a1ce-c22c7c3a7dbe" containerID="997e7e98ef9e2eaaab482ec6e720e8c1515cae3fcb970c28e6632d8f67ca45ea" exitCode=0
Jul 01 19:24:07.494175 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:07.493779    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4m25" event={"ID":"44702a43-1427-4499-a1ce-c22c7c3a7dbe","Type":"ContainerDied","Data":"997e7e98ef9e2eaaab482ec6e720e8c1515cae3fcb970c28e6632d8f67ca45ea"}
Jul 01 19:24:08.250214 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:08.250174    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7lwk"
Jul 01 19:24:08.250404 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:08.250283    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g7lwk" podUID="64190ce2-a2fa-4276-a619-3e43188597ac"
Jul 01 19:24:08.908863 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:08.908824    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36332f97-ad96-472d-a040-542d79e9e865-metrics-certs\") pod \"network-metrics-daemon-7mfxn\" (UID: \"36332f97-ad96-472d-a040-542d79e9e865\") " pod="openshift-multus/network-metrics-daemon-7mfxn"
Jul 01 19:24:08.908863 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:08.908871    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/091570c8-2f14-46c0-a514-c35f2d3096c4-original-pull-secret\") pod \"global-pull-secret-syncer-9znvt\" (UID: \"091570c8-2f14-46c0-a514-c35f2d3096c4\") " pod="kube-system/global-pull-secret-syncer-9znvt"
Jul 01 19:24:08.909314 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:08.908984    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 01 19:24:08.909314 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:08.908998    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 19:24:08.909314 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:08.909039    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/091570c8-2f14-46c0-a514-c35f2d3096c4-original-pull-secret podName:091570c8-2f14-46c0-a514-c35f2d3096c4 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:40.909026623 +0000 UTC m=+65.272038281 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/091570c8-2f14-46c0-a514-c35f2d3096c4-original-pull-secret") pod "global-pull-secret-syncer-9znvt" (UID: "091570c8-2f14-46c0-a514-c35f2d3096c4") : object "kube-system"/"original-pull-secret" not registered
Jul 01 19:24:08.909314 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:08.909069    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36332f97-ad96-472d-a040-542d79e9e865-metrics-certs podName:36332f97-ad96-472d-a040-542d79e9e865 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:40.909051793 +0000 UTC m=+65.272063451 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36332f97-ad96-472d-a040-542d79e9e865-metrics-certs") pod "network-metrics-daemon-7mfxn" (UID: "36332f97-ad96-472d-a040-542d79e9e865") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 01 19:24:09.010051 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:09.010022    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4tkv\" (UniqueName: \"kubernetes.io/projected/64190ce2-a2fa-4276-a619-3e43188597ac-kube-api-access-z4tkv\") pod \"network-check-target-g7lwk\" (UID: \"64190ce2-a2fa-4276-a619-3e43188597ac\") " pod="openshift-network-diagnostics/network-check-target-g7lwk"
Jul 01 19:24:09.010198 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:09.010179    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 01 19:24:09.010240 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:09.010203    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 01 19:24:09.010240 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:09.010214    2556 projected.go:196] Error preparing data for projected volume kube-api-access-z4tkv for pod openshift-network-diagnostics/network-check-target-g7lwk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 19:24:09.010302 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:09.010275    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/64190ce2-a2fa-4276-a619-3e43188597ac-kube-api-access-z4tkv podName:64190ce2-a2fa-4276-a619-3e43188597ac nodeName:}" failed. No retries permitted until 2026-07-01 19:24:41.010262551 +0000 UTC m=+65.373274211 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-z4tkv" (UniqueName: "kubernetes.io/projected/64190ce2-a2fa-4276-a619-3e43188597ac-kube-api-access-z4tkv") pod "network-check-target-g7lwk" (UID: "64190ce2-a2fa-4276-a619-3e43188597ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 01 19:24:09.250318 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:09.250224    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mfxn"
Jul 01 19:24:09.250514 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:09.250355    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mfxn" podUID="36332f97-ad96-472d-a040-542d79e9e865"
Jul 01 19:24:09.250514 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:09.250402    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znvt"
Jul 01 19:24:09.250514 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:09.250483    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znvt" podUID="091570c8-2f14-46c0-a514-c35f2d3096c4"
Jul 01 19:24:09.500630 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:09.500540    2556 generic.go:356] "Generic (PLEG): container finished" podID="44702a43-1427-4499-a1ce-c22c7c3a7dbe" containerID="0c068666484b8564d6766482f68a079ea9ffdc7c5e23ce3d64ff6154d091c594" exitCode=0
Jul 01 19:24:09.500630 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:09.500609    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4m25" event={"ID":"44702a43-1427-4499-a1ce-c22c7c3a7dbe","Type":"ContainerDied","Data":"0c068666484b8564d6766482f68a079ea9ffdc7c5e23ce3d64ff6154d091c594"}
Jul 01 19:24:10.250336 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:10.250303    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7lwk"
Jul 01 19:24:10.250824 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:10.250454    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g7lwk" podUID="64190ce2-a2fa-4276-a619-3e43188597ac"
Jul 01 19:24:11.249985 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:11.249951    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mfxn"
Jul 01 19:24:11.250182 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:11.250084    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mfxn" podUID="36332f97-ad96-472d-a040-542d79e9e865"
Jul 01 19:24:11.250182 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:11.250143    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znvt"
Jul 01 19:24:11.250303 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:11.250263    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znvt" podUID="091570c8-2f14-46c0-a514-c35f2d3096c4"
Jul 01 19:24:12.250015 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:12.249972    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7lwk"
Jul 01 19:24:12.250499 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:12.250110    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g7lwk" podUID="64190ce2-a2fa-4276-a619-3e43188597ac"
Jul 01 19:24:13.250420 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:13.250384    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mfxn"
Jul 01 19:24:13.250913 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:13.250435    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znvt"
Jul 01 19:24:13.250913 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:13.250522    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mfxn" podUID="36332f97-ad96-472d-a040-542d79e9e865"
Jul 01 19:24:13.250913 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:13.250592    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znvt" podUID="091570c8-2f14-46c0-a514-c35f2d3096c4"
Jul 01 19:24:14.250243 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:14.250212    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7lwk"
Jul 01 19:24:14.250454 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:14.250341    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g7lwk" podUID="64190ce2-a2fa-4276-a619-3e43188597ac"
Jul 01 19:24:14.514989 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:14.514905    2556 generic.go:356] "Generic (PLEG): container finished" podID="44702a43-1427-4499-a1ce-c22c7c3a7dbe" containerID="3ae54ee0d5825eca8bcd3ce3e2480625c9bbcd2d41ba6eb37751ea12d837e49a" exitCode=0
Jul 01 19:24:14.514989 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:14.514958    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4m25" event={"ID":"44702a43-1427-4499-a1ce-c22c7c3a7dbe","Type":"ContainerDied","Data":"3ae54ee0d5825eca8bcd3ce3e2480625c9bbcd2d41ba6eb37751ea12d837e49a"}
Jul 01 19:24:15.250276 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:15.250235    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znvt"
Jul 01 19:24:15.250504 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:15.250343    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znvt" podUID="091570c8-2f14-46c0-a514-c35f2d3096c4"
Jul 01 19:24:15.250504 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:15.250408    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mfxn"
Jul 01 19:24:15.250860 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:15.250525    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mfxn" podUID="36332f97-ad96-472d-a040-542d79e9e865"
Jul 01 19:24:15.519935 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:15.519847    2556 generic.go:356] "Generic (PLEG): container finished" podID="44702a43-1427-4499-a1ce-c22c7c3a7dbe" containerID="1d890d066245b1e11cf911026ae60f006f2b633b59b8070d84a7a143d1760ae5" exitCode=0
Jul 01 19:24:15.519935 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:15.519893    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4m25" event={"ID":"44702a43-1427-4499-a1ce-c22c7c3a7dbe","Type":"ContainerDied","Data":"1d890d066245b1e11cf911026ae60f006f2b633b59b8070d84a7a143d1760ae5"}
Jul 01 19:24:16.250850 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:16.250817    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7lwk"
Jul 01 19:24:16.251319 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:16.250914    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g7lwk" podUID="64190ce2-a2fa-4276-a619-3e43188597ac"
Jul 01 19:24:16.525901 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:16.525825    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4m25" event={"ID":"44702a43-1427-4499-a1ce-c22c7c3a7dbe","Type":"ContainerStarted","Data":"18ebe7bcc55793b685724e9c04af461888c4037225f19c3c7a223bd523f82c74"}
Jul 01 19:24:16.548381 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:16.548320    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-z4m25" podStartSLOduration=6.334730328 podStartE2EDuration="39.548306266s" totalImagesPullingTime="33.213575938s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:23:37 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:16.548140387 +0000 UTC m=+40.911152066" watchObservedRunningTime="2026-07-01 19:24:16.548306266 +0000 UTC m=+40.911317947"
Jul 01 19:24:17.249786 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:17.249751    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znvt"
Jul 01 19:24:17.249964 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:17.249758    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mfxn"
Jul 01 19:24:17.249964 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:17.249857    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znvt" podUID="091570c8-2f14-46c0-a514-c35f2d3096c4"
Jul 01 19:24:17.249964 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:17.249931    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mfxn" podUID="36332f97-ad96-472d-a040-542d79e9e865"
Jul 01 19:24:18.250214 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:18.250174    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7lwk"
Jul 01 19:24:18.250730 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:18.250275    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g7lwk" podUID="64190ce2-a2fa-4276-a619-3e43188597ac"
Jul 01 19:24:19.249728 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:19.249686    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mfxn"
Jul 01 19:24:19.249728 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:19.249713    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znvt"
Jul 01 19:24:19.249931 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:19.249814    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znvt" podUID="091570c8-2f14-46c0-a514-c35f2d3096c4"
Jul 01 19:24:19.249972 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:19.249939    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mfxn" podUID="36332f97-ad96-472d-a040-542d79e9e865"
Jul 01 19:24:20.250266 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:20.250228    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7lwk"
Jul 01 19:24:20.250710 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:20.250355    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g7lwk" podUID="64190ce2-a2fa-4276-a619-3e43188597ac"
Jul 01 19:24:21.249977 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:21.249944    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mfxn"
Jul 01 19:24:21.250120 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:21.249944    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znvt"
Jul 01 19:24:21.250120 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:21.250063    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mfxn" podUID="36332f97-ad96-472d-a040-542d79e9e865"
Jul 01 19:24:21.250120 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:21.250108    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znvt" podUID="091570c8-2f14-46c0-a514-c35f2d3096c4"
Jul 01 19:24:22.250713 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:22.250675    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7lwk"
Jul 01 19:24:22.251145 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:22.250832    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g7lwk" podUID="64190ce2-a2fa-4276-a619-3e43188597ac"
Jul 01 19:24:22.661462 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:22.661428    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-g7lwk"]
Jul 01 19:24:22.661630 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:22.661531    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7lwk"
Jul 01 19:24:22.661691 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:22.661626    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g7lwk" podUID="64190ce2-a2fa-4276-a619-3e43188597ac"
Jul 01 19:24:22.664461 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:22.664434    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9znvt"]
Jul 01 19:24:22.664602 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:22.664558    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znvt"
Jul 01 19:24:22.664685 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:22.664659    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znvt" podUID="091570c8-2f14-46c0-a514-c35f2d3096c4"
Jul 01 19:24:22.665102 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:22.665079    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7mfxn"]
Jul 01 19:24:22.665223 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:22.665166    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mfxn"
Jul 01 19:24:22.665286 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:22.665253    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mfxn" podUID="36332f97-ad96-472d-a040-542d79e9e865"
Jul 01 19:24:24.250237 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:24.250072    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znvt"
Jul 01 19:24:24.250732 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:24.250073    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7lwk"
Jul 01 19:24:24.250732 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:24.250323    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znvt" podUID="091570c8-2f14-46c0-a514-c35f2d3096c4"
Jul 01 19:24:24.250732 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:24.250418    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g7lwk" podUID="64190ce2-a2fa-4276-a619-3e43188597ac"
Jul 01 19:24:24.250732 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:24.250109    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mfxn"
Jul 01 19:24:24.250732 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:24.250517    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mfxn" podUID="36332f97-ad96-472d-a040-542d79e9e865"
Jul 01 19:24:26.250708 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:26.250677    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znvt"
Jul 01 19:24:26.251199 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:26.250762    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znvt" podUID="091570c8-2f14-46c0-a514-c35f2d3096c4"
Jul 01 19:24:26.251199 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:26.250875    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mfxn"
Jul 01 19:24:26.251199 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:26.251015    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mfxn" podUID="36332f97-ad96-472d-a040-542d79e9e865"
Jul 01 19:24:26.251199 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:26.251060    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7lwk"
Jul 01 19:24:26.251199 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:26.251184    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g7lwk" podUID="64190ce2-a2fa-4276-a619-3e43188597ac"
Jul 01 19:24:27.402996 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.402969    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-212.ec2.internal" event="NodeReady"
Jul 01 19:24:27.403531 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.403105    2556 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 01 19:24:27.454146 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.454058    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pb62t"]
Jul 01 19:24:27.473432 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.473399    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-q4nt4"]
Jul 01 19:24:27.473601 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.473458    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pb62t"
Jul 01 19:24:27.475855 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.475831    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 01 19:24:27.476138 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.476123    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qjjt5\""
Jul 01 19:24:27.476222 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.476128    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 01 19:24:27.476222 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.476188    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 01 19:24:27.503390 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.503292    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pb62t"]
Jul 01 19:24:27.503390 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.503336    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-q4nt4"]
Jul 01 19:24:27.503595 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.503461    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-q4nt4"
Jul 01 19:24:27.505693 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.505670    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 01 19:24:27.505825 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.505723    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 01 19:24:27.505957 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.505942    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5hd6c\""
Jul 01 19:24:27.506041 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.506027    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 01 19:24:27.506227 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.506210    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 01 19:24:27.555248 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.555214    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tszxb"]
Jul 01 19:24:27.581385 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.581335    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tszxb"]
Jul 01 19:24:27.581536 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.581474    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tszxb"
Jul 01 19:24:27.583993 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.583969    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 01 19:24:27.584117 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.583974    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9p2w7\""
Jul 01 19:24:27.584117 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.584060    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 01 19:24:27.652033 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.652003    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/876fca92-a686-42c9-9824-7a2577c9d8c0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q4nt4\" (UID: \"876fca92-a686-42c9-9824-7a2577c9d8c0\") " pod="openshift-insights/insights-runtime-extractor-q4nt4"
Jul 01 19:24:27.652179 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.652040    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4727\" (UniqueName: \"kubernetes.io/projected/f36ac906-7798-4117-8994-bed05d4b1a36-kube-api-access-d4727\") pod \"ingress-canary-pb62t\" (UID: \"f36ac906-7798-4117-8994-bed05d4b1a36\") " pod="openshift-ingress-canary/ingress-canary-pb62t"
Jul 01 19:24:27.652179 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.652059    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/876fca92-a686-42c9-9824-7a2577c9d8c0-crio-socket\") pod \"insights-runtime-extractor-q4nt4\" (UID: \"876fca92-a686-42c9-9824-7a2577c9d8c0\") " pod="openshift-insights/insights-runtime-extractor-q4nt4"
Jul 01 19:24:27.652179 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.652083    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/876fca92-a686-42c9-9824-7a2577c9d8c0-data-volume\") pod \"insights-runtime-extractor-q4nt4\" (UID: \"876fca92-a686-42c9-9824-7a2577c9d8c0\") " pod="openshift-insights/insights-runtime-extractor-q4nt4"
Jul 01 19:24:27.652179 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.652100    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/876fca92-a686-42c9-9824-7a2577c9d8c0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q4nt4\" (UID: \"876fca92-a686-42c9-9824-7a2577c9d8c0\") " pod="openshift-insights/insights-runtime-extractor-q4nt4"
Jul 01 19:24:27.652179 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.652143    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f36ac906-7798-4117-8994-bed05d4b1a36-cert\") pod \"ingress-canary-pb62t\" (UID: \"f36ac906-7798-4117-8994-bed05d4b1a36\") " pod="openshift-ingress-canary/ingress-canary-pb62t"
Jul 01 19:24:27.652353 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.652186    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glxtz\" (UniqueName: \"kubernetes.io/projected/876fca92-a686-42c9-9824-7a2577c9d8c0-kube-api-access-glxtz\") pod \"insights-runtime-extractor-q4nt4\" (UID: \"876fca92-a686-42c9-9824-7a2577c9d8c0\") " pod="openshift-insights/insights-runtime-extractor-q4nt4"
Jul 01 19:24:27.753417 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.753317    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/876fca92-a686-42c9-9824-7a2577c9d8c0-data-volume\") pod \"insights-runtime-extractor-q4nt4\" (UID: \"876fca92-a686-42c9-9824-7a2577c9d8c0\") " pod="openshift-insights/insights-runtime-extractor-q4nt4"
Jul 01 19:24:27.753417 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.753356    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/876fca92-a686-42c9-9824-7a2577c9d8c0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q4nt4\" (UID: \"876fca92-a686-42c9-9824-7a2577c9d8c0\") " pod="openshift-insights/insights-runtime-extractor-q4nt4"
Jul 01 19:24:27.753589 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.753556    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f36ac906-7798-4117-8994-bed05d4b1a36-cert\") pod \"ingress-canary-pb62t\" (UID: \"f36ac906-7798-4117-8994-bed05d4b1a36\") " pod="openshift-ingress-canary/ingress-canary-pb62t"
Jul 01 19:24:27.753632 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.753604    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1a9588d-e88b-40f3-b94f-3258650f6357-metrics-tls\") pod \"dns-default-tszxb\" (UID: \"d1a9588d-e88b-40f3-b94f-3258650f6357\") " pod="openshift-dns/dns-default-tszxb"
Jul 01 19:24:27.753680 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.753630    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d1a9588d-e88b-40f3-b94f-3258650f6357-config-volume\") pod \"dns-default-tszxb\" (UID: \"d1a9588d-e88b-40f3-b94f-3258650f6357\") " pod="openshift-dns/dns-default-tszxb"
Jul 01 19:24:27.753680 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.753649    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1a9588d-e88b-40f3-b94f-3258650f6357-tmp-dir\") pod \"dns-default-tszxb\" (UID: \"d1a9588d-e88b-40f3-b94f-3258650f6357\") " pod="openshift-dns/dns-default-tszxb"
Jul 01 19:24:27.753748 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.753702    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glxtz\" (UniqueName: \"kubernetes.io/projected/876fca92-a686-42c9-9824-7a2577c9d8c0-kube-api-access-glxtz\") pod \"insights-runtime-extractor-q4nt4\" (UID: \"876fca92-a686-42c9-9824-7a2577c9d8c0\") " pod="openshift-insights/insights-runtime-extractor-q4nt4"
Jul 01 19:24:27.753784 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.753749    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/876fca92-a686-42c9-9824-7a2577c9d8c0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q4nt4\" (UID: \"876fca92-a686-42c9-9824-7a2577c9d8c0\") " pod="openshift-insights/insights-runtime-extractor-q4nt4"
Jul 01 19:24:27.753784 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.753775    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4727\" (UniqueName: \"kubernetes.io/projected/f36ac906-7798-4117-8994-bed05d4b1a36-kube-api-access-d4727\") pod \"ingress-canary-pb62t\" (UID: \"f36ac906-7798-4117-8994-bed05d4b1a36\") " pod="openshift-ingress-canary/ingress-canary-pb62t"
Jul 01 19:24:27.753869 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.753779    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/876fca92-a686-42c9-9824-7a2577c9d8c0-data-volume\") pod \"insights-runtime-extractor-q4nt4\" (UID: \"876fca92-a686-42c9-9824-7a2577c9d8c0\") " pod="openshift-insights/insights-runtime-extractor-q4nt4"
Jul 01 19:24:27.753869 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.753796    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m97kx\" (UniqueName: \"kubernetes.io/projected/d1a9588d-e88b-40f3-b94f-3258650f6357-kube-api-access-m97kx\") pod \"dns-default-tszxb\" (UID: \"d1a9588d-e88b-40f3-b94f-3258650f6357\") " pod="openshift-dns/dns-default-tszxb"
Jul 01 19:24:27.753964 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.753876    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/876fca92-a686-42c9-9824-7a2577c9d8c0-crio-socket\") pod \"insights-runtime-extractor-q4nt4\" (UID: \"876fca92-a686-42c9-9824-7a2577c9d8c0\") " pod="openshift-insights/insights-runtime-extractor-q4nt4"
Jul 01 19:24:27.753964 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.753912    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/876fca92-a686-42c9-9824-7a2577c9d8c0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q4nt4\" (UID: \"876fca92-a686-42c9-9824-7a2577c9d8c0\") " pod="openshift-insights/insights-runtime-extractor-q4nt4"
Jul 01 19:24:27.754112 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.754093    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/876fca92-a686-42c9-9824-7a2577c9d8c0-crio-socket\") pod \"insights-runtime-extractor-q4nt4\" (UID: \"876fca92-a686-42c9-9824-7a2577c9d8c0\") " pod="openshift-insights/insights-runtime-extractor-q4nt4"
Jul 01 19:24:27.757493 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.757470    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f36ac906-7798-4117-8994-bed05d4b1a36-cert\") pod \"ingress-canary-pb62t\" (UID: \"f36ac906-7798-4117-8994-bed05d4b1a36\") " pod="openshift-ingress-canary/ingress-canary-pb62t"
Jul 01 19:24:27.757593 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.757464    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/876fca92-a686-42c9-9824-7a2577c9d8c0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q4nt4\" (UID: \"876fca92-a686-42c9-9824-7a2577c9d8c0\") " pod="openshift-insights/insights-runtime-extractor-q4nt4"
Jul 01 19:24:27.761939 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.761907    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glxtz\" (UniqueName: \"kubernetes.io/projected/876fca92-a686-42c9-9824-7a2577c9d8c0-kube-api-access-glxtz\") pod \"insights-runtime-extractor-q4nt4\" (UID: \"876fca92-a686-42c9-9824-7a2577c9d8c0\") " pod="openshift-insights/insights-runtime-extractor-q4nt4"
Jul 01 19:24:27.762046 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.761992    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4727\" (UniqueName: \"kubernetes.io/projected/f36ac906-7798-4117-8994-bed05d4b1a36-kube-api-access-d4727\") pod \"ingress-canary-pb62t\" (UID: \"f36ac906-7798-4117-8994-bed05d4b1a36\") " pod="openshift-ingress-canary/ingress-canary-pb62t"
Jul 01 19:24:27.800823 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.800793    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pb62t"
Jul 01 19:24:27.813503 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.813480    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-q4nt4"
Jul 01 19:24:27.855012 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.854979    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1a9588d-e88b-40f3-b94f-3258650f6357-metrics-tls\") pod \"dns-default-tszxb\" (UID: \"d1a9588d-e88b-40f3-b94f-3258650f6357\") " pod="openshift-dns/dns-default-tszxb"
Jul 01 19:24:27.855098 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.855037    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d1a9588d-e88b-40f3-b94f-3258650f6357-config-volume\") pod \"dns-default-tszxb\" (UID: \"d1a9588d-e88b-40f3-b94f-3258650f6357\") " pod="openshift-dns/dns-default-tszxb"
Jul 01 19:24:27.855266 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.855205    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1a9588d-e88b-40f3-b94f-3258650f6357-tmp-dir\") pod \"dns-default-tszxb\" (UID: \"d1a9588d-e88b-40f3-b94f-3258650f6357\") " pod="openshift-dns/dns-default-tszxb"
Jul 01 19:24:27.855329 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.855308    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m97kx\" (UniqueName: \"kubernetes.io/projected/d1a9588d-e88b-40f3-b94f-3258650f6357-kube-api-access-m97kx\") pod \"dns-default-tszxb\" (UID: \"d1a9588d-e88b-40f3-b94f-3258650f6357\") " pod="openshift-dns/dns-default-tszxb"
Jul 01 19:24:27.855583 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.855531    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1a9588d-e88b-40f3-b94f-3258650f6357-tmp-dir\") pod \"dns-default-tszxb\" (UID: \"d1a9588d-e88b-40f3-b94f-3258650f6357\") " pod="openshift-dns/dns-default-tszxb"
Jul 01 19:24:27.855781 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.855762    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d1a9588d-e88b-40f3-b94f-3258650f6357-config-volume\") pod \"dns-default-tszxb\" (UID: \"d1a9588d-e88b-40f3-b94f-3258650f6357\") " pod="openshift-dns/dns-default-tszxb"
Jul 01 19:24:27.857783 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.857761    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1a9588d-e88b-40f3-b94f-3258650f6357-metrics-tls\") pod \"dns-default-tszxb\" (UID: \"d1a9588d-e88b-40f3-b94f-3258650f6357\") " pod="openshift-dns/dns-default-tszxb"
Jul 01 19:24:27.867638 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.867618    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m97kx\" (UniqueName: \"kubernetes.io/projected/d1a9588d-e88b-40f3-b94f-3258650f6357-kube-api-access-m97kx\") pod \"dns-default-tszxb\" (UID: \"d1a9588d-e88b-40f3-b94f-3258650f6357\") " pod="openshift-dns/dns-default-tszxb"
Jul 01 19:24:27.890548 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:27.890508    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tszxb"
Jul 01 19:24:28.035770 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:28.035532    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pb62t"]
Jul 01 19:24:28.040703 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:28.040679    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-q4nt4"]
Jul 01 19:24:28.043445 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:24:28.043400    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod876fca92_a686_42c9_9824_7a2577c9d8c0.slice/crio-4923ddcace280f98c235fe5259b0198f1ada0201213c8686e4593a2cdeef6669 WatchSource:0}: Error finding container 4923ddcace280f98c235fe5259b0198f1ada0201213c8686e4593a2cdeef6669: Status 404 returned error can't find the container with id 4923ddcace280f98c235fe5259b0198f1ada0201213c8686e4593a2cdeef6669
Jul 01 19:24:28.058448 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:28.058413    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tszxb"]
Jul 01 19:24:28.061026 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:24:28.061000    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1a9588d_e88b_40f3_b94f_3258650f6357.slice/crio-e555728c5eebdde8937c26ec784a52828b54ee780104446a81cbfbb33c1a11f6 WatchSource:0}: Error finding container e555728c5eebdde8937c26ec784a52828b54ee780104446a81cbfbb33c1a11f6: Status 404 returned error can't find the container with id e555728c5eebdde8937c26ec784a52828b54ee780104446a81cbfbb33c1a11f6
Jul 01 19:24:28.250000 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:28.249964    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znvt"
Jul 01 19:24:28.250196 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:28.249964    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mfxn"
Jul 01 19:24:28.250196 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:28.249971    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7lwk"
Jul 01 19:24:28.253069 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:28.252917    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 01 19:24:28.253069 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:28.252932    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 01 19:24:28.253069 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:28.252930    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 01 19:24:28.253069 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:28.253004    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 01 19:24:28.253069 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:28.253030    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4nv7g\""
Jul 01 19:24:28.253364 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:28.253273    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-64bmf\""
Jul 01 19:24:28.551399 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:28.551292    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q4nt4" event={"ID":"876fca92-a686-42c9-9824-7a2577c9d8c0","Type":"ContainerStarted","Data":"4923ddcace280f98c235fe5259b0198f1ada0201213c8686e4593a2cdeef6669"}
Jul 01 19:24:28.552410 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:28.552390    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pb62t" event={"ID":"f36ac906-7798-4117-8994-bed05d4b1a36","Type":"ContainerStarted","Data":"9388140aeed284d38928271d602da5051cabfbb016c1a9ecf820b4571b9df678"}
Jul 01 19:24:28.553400 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:28.553363    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tszxb" event={"ID":"d1a9588d-e88b-40f3-b94f-3258650f6357","Type":"ContainerStarted","Data":"e555728c5eebdde8937c26ec784a52828b54ee780104446a81cbfbb33c1a11f6"}
Jul 01 19:24:30.157341 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:30.157309    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-s426w"]
Jul 01 19:24:30.171891 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:30.171767    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-s426w"]
Jul 01 19:24:30.171891 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:30.171888    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-s426w"
Jul 01 19:24:30.173198 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:30.172972    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e81468a-4ac4-4c46-8964-6c03a180fab5-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-s426w\" (UID: \"1e81468a-4ac4-4c46-8964-6c03a180fab5\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-s426w"
Jul 01 19:24:30.173198 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:30.173006    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hltlc\" (UniqueName: \"kubernetes.io/projected/1e81468a-4ac4-4c46-8964-6c03a180fab5-kube-api-access-hltlc\") pod \"prometheus-operator-7b7d896497-s426w\" (UID: \"1e81468a-4ac4-4c46-8964-6c03a180fab5\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-s426w"
Jul 01 19:24:30.173198 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:30.173112    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1e81468a-4ac4-4c46-8964-6c03a180fab5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-s426w\" (UID: \"1e81468a-4ac4-4c46-8964-6c03a180fab5\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-s426w"
Jul 01 19:24:30.173198 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:30.173149    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e81468a-4ac4-4c46-8964-6c03a180fab5-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-s426w\" (UID: \"1e81468a-4ac4-4c46-8964-6c03a180fab5\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-s426w"
Jul 01 19:24:30.174610 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:30.174467    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 01 19:24:30.174610 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:30.174496    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 01 19:24:30.175466 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:30.175269    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 01 19:24:30.175466 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:30.175296    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 01 19:24:30.175466 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:30.175273    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-xgt96\""
Jul 01 19:24:30.175993 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:30.175821    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 01 19:24:30.273782 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:30.273748    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e81468a-4ac4-4c46-8964-6c03a180fab5-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-s426w\" (UID: \"1e81468a-4ac4-4c46-8964-6c03a180fab5\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-s426w"
Jul 01 19:24:30.273782 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:30.273787    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hltlc\" (UniqueName: \"kubernetes.io/projected/1e81468a-4ac4-4c46-8964-6c03a180fab5-kube-api-access-hltlc\") pod \"prometheus-operator-7b7d896497-s426w\" (UID: \"1e81468a-4ac4-4c46-8964-6c03a180fab5\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-s426w"
Jul 01 19:24:30.274038 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:30.273834    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1e81468a-4ac4-4c46-8964-6c03a180fab5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-s426w\" (UID: \"1e81468a-4ac4-4c46-8964-6c03a180fab5\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-s426w"
Jul 01 19:24:30.274038 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:30.273859    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e81468a-4ac4-4c46-8964-6c03a180fab5-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-s426w\" (UID: \"1e81468a-4ac4-4c46-8964-6c03a180fab5\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-s426w"
Jul 01 19:24:30.274038 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:30.273898    2556 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 01 19:24:30.274473 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:30.274304    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e81468a-4ac4-4c46-8964-6c03a180fab5-prometheus-operator-tls podName:1e81468a-4ac4-4c46-8964-6c03a180fab5 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:30.773947051 +0000 UTC m=+55.136958713 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/1e81468a-4ac4-4c46-8964-6c03a180fab5-prometheus-operator-tls") pod "prometheus-operator-7b7d896497-s426w" (UID: "1e81468a-4ac4-4c46-8964-6c03a180fab5") : secret "prometheus-operator-tls" not found
Jul 01 19:24:30.277684 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:30.275307    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e81468a-4ac4-4c46-8964-6c03a180fab5-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-s426w\" (UID: \"1e81468a-4ac4-4c46-8964-6c03a180fab5\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-s426w"
Jul 01 19:24:30.280190 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:30.280167    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1e81468a-4ac4-4c46-8964-6c03a180fab5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-s426w\" (UID: \"1e81468a-4ac4-4c46-8964-6c03a180fab5\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-s426w"
Jul 01 19:24:30.285028 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:30.285005    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hltlc\" (UniqueName: \"kubernetes.io/projected/1e81468a-4ac4-4c46-8964-6c03a180fab5-kube-api-access-hltlc\") pod \"prometheus-operator-7b7d896497-s426w\" (UID: \"1e81468a-4ac4-4c46-8964-6c03a180fab5\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-s426w"
Jul 01 19:24:30.779976 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:30.779935    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e81468a-4ac4-4c46-8964-6c03a180fab5-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-s426w\" (UID: \"1e81468a-4ac4-4c46-8964-6c03a180fab5\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-s426w"
Jul 01 19:24:30.783641 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:30.783612    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e81468a-4ac4-4c46-8964-6c03a180fab5-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-s426w\" (UID: \"1e81468a-4ac4-4c46-8964-6c03a180fab5\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-s426w"
Jul 01 19:24:31.082625 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:31.082529    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-s426w"
Jul 01 19:24:33.643986 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:33.643639    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-s426w"]
Jul 01 19:24:33.648845 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:24:33.648525    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e81468a_4ac4_4c46_8964_6c03a180fab5.slice/crio-98198cf155e14f9600f02a26e066bfe079187f565426d9f22ba379aaaf496599 WatchSource:0}: Error finding container 98198cf155e14f9600f02a26e066bfe079187f565426d9f22ba379aaaf496599: Status 404 returned error can't find the container with id 98198cf155e14f9600f02a26e066bfe079187f565426d9f22ba379aaaf496599
Jul 01 19:24:34.043116 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:34.043080    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5499b6fb8f-n8cvx"]
Jul 01 19:24:34.044928 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:34.044903    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5499b6fb8f-n8cvx"
Jul 01 19:24:34.047795 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:34.047771    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 01 19:24:34.048029 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:34.048001    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-n7ltf\""
Jul 01 19:24:34.048133 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:34.048069    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 01 19:24:34.058923 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:34.058886    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5499b6fb8f-n8cvx"]
Jul 01 19:24:34.107552 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:34.107514    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2j89\" (UniqueName: \"kubernetes.io/projected/3edd9db8-f2f1-4b65-82f8-208ea3fe3ed7-kube-api-access-g2j89\") pod \"downloads-5499b6fb8f-n8cvx\" (UID: \"3edd9db8-f2f1-4b65-82f8-208ea3fe3ed7\") " pod="openshift-console/downloads-5499b6fb8f-n8cvx"
Jul 01 19:24:34.208409 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:34.208365    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2j89\" (UniqueName: \"kubernetes.io/projected/3edd9db8-f2f1-4b65-82f8-208ea3fe3ed7-kube-api-access-g2j89\") pod \"downloads-5499b6fb8f-n8cvx\" (UID: \"3edd9db8-f2f1-4b65-82f8-208ea3fe3ed7\") " pod="openshift-console/downloads-5499b6fb8f-n8cvx"
Jul 01 19:24:34.217896 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:34.217868    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2j89\" (UniqueName: \"kubernetes.io/projected/3edd9db8-f2f1-4b65-82f8-208ea3fe3ed7-kube-api-access-g2j89\") pod \"downloads-5499b6fb8f-n8cvx\" (UID: \"3edd9db8-f2f1-4b65-82f8-208ea3fe3ed7\") " pod="openshift-console/downloads-5499b6fb8f-n8cvx"
Jul 01 19:24:34.356568 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:34.356487    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5499b6fb8f-n8cvx"
Jul 01 19:24:34.500483 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:34.500446    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5499b6fb8f-n8cvx"]
Jul 01 19:24:34.505653 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:24:34.505624    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3edd9db8_f2f1_4b65_82f8_208ea3fe3ed7.slice/crio-aa97e8348e202770ffc0768903b9d5ae39563657cde281042e160a1abee07710 WatchSource:0}: Error finding container aa97e8348e202770ffc0768903b9d5ae39563657cde281042e160a1abee07710: Status 404 returned error can't find the container with id aa97e8348e202770ffc0768903b9d5ae39563657cde281042e160a1abee07710
Jul 01 19:24:34.578301 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:34.578265    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tszxb" event={"ID":"d1a9588d-e88b-40f3-b94f-3258650f6357","Type":"ContainerStarted","Data":"7fc6c6492ff59fa59563658eaf41b13977882e50362ebe911284b94f3829f621"}
Jul 01 19:24:34.578506 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:34.578351    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tszxb"
Jul 01 19:24:34.578506 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:34.578401    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tszxb" event={"ID":"d1a9588d-e88b-40f3-b94f-3258650f6357","Type":"ContainerStarted","Data":"e93663509777060a08418650e11f74e96e7e7f2af58f2076833de97c8ad52530"}
Jul 01 19:24:34.580479 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:34.580444    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q4nt4" event={"ID":"876fca92-a686-42c9-9824-7a2577c9d8c0","Type":"ContainerStarted","Data":"a21937d8faa84829fc6df0b39a95de5b3bc9e8bd1b3cd820b151add902f1dd69"}
Jul 01 19:24:34.580621 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:34.580507    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q4nt4" event={"ID":"876fca92-a686-42c9-9824-7a2577c9d8c0","Type":"ContainerStarted","Data":"80c8f9ca7179c7f5ca16db9132f5672211d79de0df780420b57338ac7070afb1"}
Jul 01 19:24:34.582183 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:34.582154    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pb62t" event={"ID":"f36ac906-7798-4117-8994-bed05d4b1a36","Type":"ContainerStarted","Data":"782475d49b2e1ea2bca52fc8ef31f9401748ce579026d6364a91950eb3b28b2b"}
Jul 01 19:24:34.583324 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:34.583301    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5499b6fb8f-n8cvx" event={"ID":"3edd9db8-f2f1-4b65-82f8-208ea3fe3ed7","Type":"ContainerStarted","Data":"aa97e8348e202770ffc0768903b9d5ae39563657cde281042e160a1abee07710"}
Jul 01 19:24:34.584459 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:34.584423    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-s426w" event={"ID":"1e81468a-4ac4-4c46-8964-6c03a180fab5","Type":"ContainerStarted","Data":"98198cf155e14f9600f02a26e066bfe079187f565426d9f22ba379aaaf496599"}
Jul 01 19:24:34.598678 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:34.598619    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tszxb" podStartSLOduration=2.162845593 podStartE2EDuration="7.598598848s" totalImagesPullingTime="5.435753255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:34.597392635 +0000 UTC m=+58.960404317" watchObservedRunningTime="2026-07-01 19:24:34.598598848 +0000 UTC m=+58.961610524"
Jul 01 19:24:34.615676 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:34.615570    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pb62t" podStartSLOduration=2.158834864 podStartE2EDuration="7.615552081s" totalImagesPullingTime="5.456717217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:34.614612496 +0000 UTC m=+58.977624179" watchObservedRunningTime="2026-07-01 19:24:34.615552081 +0000 UTC m=+58.978563757"
Jul 01 19:24:35.592642 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:35.592582    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-s426w" event={"ID":"1e81468a-4ac4-4c46-8964-6c03a180fab5","Type":"ContainerStarted","Data":"46d840d1886f9f233c10c837f994869579ce5fb88b1a64f317c189ad49c3d85b"}
Jul 01 19:24:35.593088 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:35.592655    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-s426w" event={"ID":"1e81468a-4ac4-4c46-8964-6c03a180fab5","Type":"ContainerStarted","Data":"bd9383a3c137e54cfb940ae4ee5131cd4c856375d8a8f6f365a449b387884252"}
Jul 01 19:24:35.615713 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:35.615649    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7b7d896497-s426w" podStartSLOduration=4.387246161 podStartE2EDuration="5.615629598s" totalImagesPullingTime="1.228383437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:35.614439034 +0000 UTC m=+59.977450717" watchObservedRunningTime="2026-07-01 19:24:35.615629598 +0000 UTC m=+59.978641279"
Jul 01 19:24:37.578254 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.578213    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-pxx4h"]
Jul 01 19:24:37.589806 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.589778    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-pxx4h"
Jul 01 19:24:37.592497 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.592472    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 01 19:24:37.592930 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.592876    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 01 19:24:37.593078 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.593053    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-k6wks\""
Jul 01 19:24:37.598635 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.598537    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-pxx4h"]
Jul 01 19:24:37.616742 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.616714    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-bfknl"]
Jul 01 19:24:37.634316 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.634285    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vf7hp"]
Jul 01 19:24:37.634475 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.634442    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-bfknl"
Jul 01 19:24:37.636905 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.636880    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bbb4acdc-38bb-4419-8361-32af35d5fc55-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-pxx4h\" (UID: \"bbb4acdc-38bb-4419-8361-32af35d5fc55\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-pxx4h"
Jul 01 19:24:37.637028 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.636920    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnzh9\" (UniqueName: \"kubernetes.io/projected/bbb4acdc-38bb-4419-8361-32af35d5fc55-kube-api-access-vnzh9\") pod \"openshift-state-metrics-57f99c8b49-pxx4h\" (UID: \"bbb4acdc-38bb-4419-8361-32af35d5fc55\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-pxx4h"
Jul 01 19:24:37.637028 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.636960    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bbb4acdc-38bb-4419-8361-32af35d5fc55-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-pxx4h\" (UID: \"bbb4acdc-38bb-4419-8361-32af35d5fc55\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-pxx4h"
Jul 01 19:24:37.637154 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.637050    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbb4acdc-38bb-4419-8361-32af35d5fc55-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-pxx4h\" (UID: \"bbb4acdc-38bb-4419-8361-32af35d5fc55\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-pxx4h"
Jul 01 19:24:37.637659 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.637618    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 01 19:24:37.638016 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.637971    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 01 19:24:37.638115 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.638034    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-f4ccp\""
Jul 01 19:24:37.638200 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.638115    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 01 19:24:37.650486 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.650459    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-bfknl"]
Jul 01 19:24:37.650588 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.650569    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vf7hp"
Jul 01 19:24:37.657820 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.657801    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 01 19:24:37.657959 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.657942    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 01 19:24:37.658882 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.658616    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 01 19:24:37.658882 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.658871    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bfvnn\""
Jul 01 19:24:37.737938 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.737903    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bbb4acdc-38bb-4419-8361-32af35d5fc55-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-pxx4h\" (UID: \"bbb4acdc-38bb-4419-8361-32af35d5fc55\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-pxx4h"
Jul 01 19:24:37.738127 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.737959    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba8e22b6-4dac-4550-a971-a048c29bc65f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-bfknl\" (UID: \"ba8e22b6-4dac-4550-a971-a048c29bc65f\") " pod="openshift-monitoring/kube-state-metrics-845b954455-bfknl"
Jul 01 19:24:37.738127 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.737989    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/698773fc-86f3-48c7-8b12-1e21346536b0-node-exporter-tls\") pod \"node-exporter-vf7hp\" (UID: \"698773fc-86f3-48c7-8b12-1e21346536b0\") " pod="openshift-monitoring/node-exporter-vf7hp"
Jul 01 19:24:37.738127 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.738011    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/698773fc-86f3-48c7-8b12-1e21346536b0-node-exporter-accelerators-collector-config\") pod \"node-exporter-vf7hp\" (UID: \"698773fc-86f3-48c7-8b12-1e21346536b0\") " pod="openshift-monitoring/node-exporter-vf7hp"
Jul 01 19:24:37.738127 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.738034    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bbb4acdc-38bb-4419-8361-32af35d5fc55-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-pxx4h\" (UID: \"bbb4acdc-38bb-4419-8361-32af35d5fc55\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-pxx4h"
Jul 01 19:24:37.738127 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.738058    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmlgf\" (UniqueName: \"kubernetes.io/projected/698773fc-86f3-48c7-8b12-1e21346536b0-kube-api-access-zmlgf\") pod \"node-exporter-vf7hp\" (UID: \"698773fc-86f3-48c7-8b12-1e21346536b0\") " pod="openshift-monitoring/node-exporter-vf7hp"
Jul 01 19:24:37.738397 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.738146    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/698773fc-86f3-48c7-8b12-1e21346536b0-node-exporter-textfile\") pod \"node-exporter-vf7hp\" (UID: \"698773fc-86f3-48c7-8b12-1e21346536b0\") " pod="openshift-monitoring/node-exporter-vf7hp"
Jul 01 19:24:37.738397 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.738175    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/698773fc-86f3-48c7-8b12-1e21346536b0-root\") pod \"node-exporter-vf7hp\" (UID: \"698773fc-86f3-48c7-8b12-1e21346536b0\") " pod="openshift-monitoring/node-exporter-vf7hp"
Jul 01 19:24:37.738397 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.738209    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbb4acdc-38bb-4419-8361-32af35d5fc55-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-pxx4h\" (UID: \"bbb4acdc-38bb-4419-8361-32af35d5fc55\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-pxx4h"
Jul 01 19:24:37.738397 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.738242    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ba8e22b6-4dac-4550-a971-a048c29bc65f-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-bfknl\" (UID: \"ba8e22b6-4dac-4550-a971-a048c29bc65f\") " pod="openshift-monitoring/kube-state-metrics-845b954455-bfknl"
Jul 01 19:24:37.738397 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.738268    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ba8e22b6-4dac-4550-a971-a048c29bc65f-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-bfknl\" (UID: \"ba8e22b6-4dac-4550-a971-a048c29bc65f\") " pod="openshift-monitoring/kube-state-metrics-845b954455-bfknl"
Jul 01 19:24:37.738397 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.738296    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/698773fc-86f3-48c7-8b12-1e21346536b0-sys\") pod \"node-exporter-vf7hp\" (UID: \"698773fc-86f3-48c7-8b12-1e21346536b0\") " pod="openshift-monitoring/node-exporter-vf7hp"
Jul 01 19:24:37.738397 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.738313    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78gfv\" (UniqueName: \"kubernetes.io/projected/ba8e22b6-4dac-4550-a971-a048c29bc65f-kube-api-access-78gfv\") pod \"kube-state-metrics-845b954455-bfknl\" (UID: \"ba8e22b6-4dac-4550-a971-a048c29bc65f\") " pod="openshift-monitoring/kube-state-metrics-845b954455-bfknl"
Jul 01 19:24:37.738731 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.738508    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnzh9\" (UniqueName: \"kubernetes.io/projected/bbb4acdc-38bb-4419-8361-32af35d5fc55-kube-api-access-vnzh9\") pod \"openshift-state-metrics-57f99c8b49-pxx4h\" (UID: \"bbb4acdc-38bb-4419-8361-32af35d5fc55\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-pxx4h"
Jul 01 19:24:37.738731 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.738589    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/698773fc-86f3-48c7-8b12-1e21346536b0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vf7hp\" (UID: \"698773fc-86f3-48c7-8b12-1e21346536b0\") " pod="openshift-monitoring/node-exporter-vf7hp"
Jul 01 19:24:37.738841 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.738755    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bbb4acdc-38bb-4419-8361-32af35d5fc55-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-pxx4h\" (UID: \"bbb4acdc-38bb-4419-8361-32af35d5fc55\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-pxx4h"
Jul 01 19:24:37.738841 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.738764    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/698773fc-86f3-48c7-8b12-1e21346536b0-metrics-client-ca\") pod \"node-exporter-vf7hp\" (UID: \"698773fc-86f3-48c7-8b12-1e21346536b0\") " pod="openshift-monitoring/node-exporter-vf7hp"
Jul 01 19:24:37.738841 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.738795    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ba8e22b6-4dac-4550-a971-a048c29bc65f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-bfknl\" (UID: \"ba8e22b6-4dac-4550-a971-a048c29bc65f\") " pod="openshift-monitoring/kube-state-metrics-845b954455-bfknl"
Jul 01 19:24:37.738841 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.738825    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba8e22b6-4dac-4550-a971-a048c29bc65f-metrics-client-ca\") pod \"kube-state-metrics-845b954455-bfknl\" (UID: \"ba8e22b6-4dac-4550-a971-a048c29bc65f\") " pod="openshift-monitoring/kube-state-metrics-845b954455-bfknl"
Jul 01 19:24:37.739038 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.738884    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/698773fc-86f3-48c7-8b12-1e21346536b0-node-exporter-wtmp\") pod \"node-exporter-vf7hp\" (UID: \"698773fc-86f3-48c7-8b12-1e21346536b0\") " pod="openshift-monitoring/node-exporter-vf7hp"
Jul 01 19:24:37.740796 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.740766    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bbb4acdc-38bb-4419-8361-32af35d5fc55-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-pxx4h\" (UID: \"bbb4acdc-38bb-4419-8361-32af35d5fc55\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-pxx4h"
Jul 01 19:24:37.740922 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.740886    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbb4acdc-38bb-4419-8361-32af35d5fc55-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-pxx4h\" (UID: \"bbb4acdc-38bb-4419-8361-32af35d5fc55\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-pxx4h"
Jul 01 19:24:37.750726 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.750705    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnzh9\" (UniqueName: \"kubernetes.io/projected/bbb4acdc-38bb-4419-8361-32af35d5fc55-kube-api-access-vnzh9\") pod \"openshift-state-metrics-57f99c8b49-pxx4h\" (UID: \"bbb4acdc-38bb-4419-8361-32af35d5fc55\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-pxx4h"
Jul 01 19:24:37.839884 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.839859    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/698773fc-86f3-48c7-8b12-1e21346536b0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vf7hp\" (UID: \"698773fc-86f3-48c7-8b12-1e21346536b0\") " pod="openshift-monitoring/node-exporter-vf7hp"
Jul 01 19:24:37.840041 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.839920    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/698773fc-86f3-48c7-8b12-1e21346536b0-metrics-client-ca\") pod \"node-exporter-vf7hp\" (UID: \"698773fc-86f3-48c7-8b12-1e21346536b0\") " pod="openshift-monitoring/node-exporter-vf7hp"
Jul 01 19:24:37.840041 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.839950    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ba8e22b6-4dac-4550-a971-a048c29bc65f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-bfknl\" (UID: \"ba8e22b6-4dac-4550-a971-a048c29bc65f\") " pod="openshift-monitoring/kube-state-metrics-845b954455-bfknl"
Jul 01 19:24:37.840041 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.839978    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba8e22b6-4dac-4550-a971-a048c29bc65f-metrics-client-ca\") pod \"kube-state-metrics-845b954455-bfknl\" (UID: \"ba8e22b6-4dac-4550-a971-a048c29bc65f\") " pod="openshift-monitoring/kube-state-metrics-845b954455-bfknl"
Jul 01 19:24:37.840041 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.840018    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/698773fc-86f3-48c7-8b12-1e21346536b0-node-exporter-wtmp\") pod \"node-exporter-vf7hp\" (UID: \"698773fc-86f3-48c7-8b12-1e21346536b0\") " pod="openshift-monitoring/node-exporter-vf7hp"
Jul 01 19:24:37.840249 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.840047    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba8e22b6-4dac-4550-a971-a048c29bc65f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-bfknl\" (UID: \"ba8e22b6-4dac-4550-a971-a048c29bc65f\") " pod="openshift-monitoring/kube-state-metrics-845b954455-bfknl"
Jul 01 19:24:37.840249 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.840077    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/698773fc-86f3-48c7-8b12-1e21346536b0-node-exporter-tls\") pod \"node-exporter-vf7hp\" (UID: \"698773fc-86f3-48c7-8b12-1e21346536b0\") " pod="openshift-monitoring/node-exporter-vf7hp"
Jul 01 19:24:37.840352 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.840289    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/698773fc-86f3-48c7-8b12-1e21346536b0-node-exporter-wtmp\") pod \"node-exporter-vf7hp\" (UID: \"698773fc-86f3-48c7-8b12-1e21346536b0\") " pod="openshift-monitoring/node-exporter-vf7hp"
Jul 01 19:24:37.840352 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.840339    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/698773fc-86f3-48c7-8b12-1e21346536b0-node-exporter-accelerators-collector-config\") pod \"node-exporter-vf7hp\" (UID: \"698773fc-86f3-48c7-8b12-1e21346536b0\") " pod="openshift-monitoring/node-exporter-vf7hp"
Jul 01 19:24:37.840478 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.840400    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmlgf\" (UniqueName: \"kubernetes.io/projected/698773fc-86f3-48c7-8b12-1e21346536b0-kube-api-access-zmlgf\") pod \"node-exporter-vf7hp\" (UID: \"698773fc-86f3-48c7-8b12-1e21346536b0\") " pod="openshift-monitoring/node-exporter-vf7hp"
Jul 01 19:24:37.840478 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.840430    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/698773fc-86f3-48c7-8b12-1e21346536b0-node-exporter-textfile\") pod \"node-exporter-vf7hp\" (UID: \"698773fc-86f3-48c7-8b12-1e21346536b0\") " pod="openshift-monitoring/node-exporter-vf7hp"
Jul 01 19:24:37.840478 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.840450    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/698773fc-86f3-48c7-8b12-1e21346536b0-root\") pod \"node-exporter-vf7hp\" (UID: \"698773fc-86f3-48c7-8b12-1e21346536b0\") " pod="openshift-monitoring/node-exporter-vf7hp"
Jul 01 19:24:37.840615 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:37.840450    2556 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 01 19:24:37.840945 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.840703    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/698773fc-86f3-48c7-8b12-1e21346536b0-metrics-client-ca\") pod \"node-exporter-vf7hp\" (UID: \"698773fc-86f3-48c7-8b12-1e21346536b0\") " pod="openshift-monitoring/node-exporter-vf7hp"
Jul 01 19:24:37.840945 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.840793    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/698773fc-86f3-48c7-8b12-1e21346536b0-node-exporter-textfile\") pod \"node-exporter-vf7hp\" (UID: \"698773fc-86f3-48c7-8b12-1e21346536b0\") " pod="openshift-monitoring/node-exporter-vf7hp"
Jul 01 19:24:37.840945 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.840817    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ba8e22b6-4dac-4550-a971-a048c29bc65f-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-bfknl\" (UID: \"ba8e22b6-4dac-4550-a971-a048c29bc65f\") " pod="openshift-monitoring/kube-state-metrics-845b954455-bfknl"
Jul 01 19:24:37.840945 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.840481    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ba8e22b6-4dac-4550-a971-a048c29bc65f-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-bfknl\" (UID: \"ba8e22b6-4dac-4550-a971-a048c29bc65f\") " pod="openshift-monitoring/kube-state-metrics-845b954455-bfknl"
Jul 01 19:24:37.841180 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:24:37.841038    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/698773fc-86f3-48c7-8b12-1e21346536b0-node-exporter-tls podName:698773fc-86f3-48c7-8b12-1e21346536b0 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:38.340526283 +0000 UTC m=+62.703537954 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/698773fc-86f3-48c7-8b12-1e21346536b0-node-exporter-tls") pod "node-exporter-vf7hp" (UID: "698773fc-86f3-48c7-8b12-1e21346536b0") : secret "node-exporter-tls" not found
Jul 01 19:24:37.841180 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.841073    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/698773fc-86f3-48c7-8b12-1e21346536b0-root\") pod \"node-exporter-vf7hp\" (UID: \"698773fc-86f3-48c7-8b12-1e21346536b0\") " pod="openshift-monitoring/node-exporter-vf7hp"
Jul 01 19:24:37.841180 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.841072    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/698773fc-86f3-48c7-8b12-1e21346536b0-node-exporter-accelerators-collector-config\") pod \"node-exporter-vf7hp\" (UID: \"698773fc-86f3-48c7-8b12-1e21346536b0\") " pod="openshift-monitoring/node-exporter-vf7hp"
Jul 01 19:24:37.841180 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.841092    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ba8e22b6-4dac-4550-a971-a048c29bc65f-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-bfknl\" (UID: \"ba8e22b6-4dac-4550-a971-a048c29bc65f\") " pod="openshift-monitoring/kube-state-metrics-845b954455-bfknl"
Jul 01 19:24:37.841180 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.841140    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/698773fc-86f3-48c7-8b12-1e21346536b0-sys\") pod \"node-exporter-vf7hp\" (UID: \"698773fc-86f3-48c7-8b12-1e21346536b0\") " pod="openshift-monitoring/node-exporter-vf7hp"
Jul 01 19:24:37.841180 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.841168    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78gfv\" (UniqueName: \"kubernetes.io/projected/ba8e22b6-4dac-4550-a971-a048c29bc65f-kube-api-access-78gfv\") pod \"kube-state-metrics-845b954455-bfknl\" (UID: \"ba8e22b6-4dac-4550-a971-a048c29bc65f\") " pod="openshift-monitoring/kube-state-metrics-845b954455-bfknl"
Jul 01 19:24:37.841516 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.841180    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/698773fc-86f3-48c7-8b12-1e21346536b0-sys\") pod \"node-exporter-vf7hp\" (UID: \"698773fc-86f3-48c7-8b12-1e21346536b0\") " pod="openshift-monitoring/node-exporter-vf7hp"
Jul 01 19:24:37.841516 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.841278    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba8e22b6-4dac-4550-a971-a048c29bc65f-metrics-client-ca\") pod \"kube-state-metrics-845b954455-bfknl\" (UID: \"ba8e22b6-4dac-4550-a971-a048c29bc65f\") " pod="openshift-monitoring/kube-state-metrics-845b954455-bfknl"
Jul 01 19:24:37.841516 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.840813    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ba8e22b6-4dac-4550-a971-a048c29bc65f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-bfknl\" (UID: \"ba8e22b6-4dac-4550-a971-a048c29bc65f\") " pod="openshift-monitoring/kube-state-metrics-845b954455-bfknl"
Jul 01 19:24:37.842965 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.842937    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/698773fc-86f3-48c7-8b12-1e21346536b0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vf7hp\" (UID: \"698773fc-86f3-48c7-8b12-1e21346536b0\") " pod="openshift-monitoring/node-exporter-vf7hp"
Jul 01 19:24:37.843462 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.843442    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ba8e22b6-4dac-4550-a971-a048c29bc65f-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-bfknl\" (UID: \"ba8e22b6-4dac-4550-a971-a048c29bc65f\") " pod="openshift-monitoring/kube-state-metrics-845b954455-bfknl"
Jul 01 19:24:37.843574 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.843551    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba8e22b6-4dac-4550-a971-a048c29bc65f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-bfknl\" (UID: \"ba8e22b6-4dac-4550-a971-a048c29bc65f\") " pod="openshift-monitoring/kube-state-metrics-845b954455-bfknl"
Jul 01 19:24:37.858587 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.858567    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmlgf\" (UniqueName: \"kubernetes.io/projected/698773fc-86f3-48c7-8b12-1e21346536b0-kube-api-access-zmlgf\") pod \"node-exporter-vf7hp\" (UID: \"698773fc-86f3-48c7-8b12-1e21346536b0\") " pod="openshift-monitoring/node-exporter-vf7hp"
Jul 01 19:24:37.869357 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.869334    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78gfv\" (UniqueName: \"kubernetes.io/projected/ba8e22b6-4dac-4550-a971-a048c29bc65f-kube-api-access-78gfv\") pod \"kube-state-metrics-845b954455-bfknl\" (UID: \"ba8e22b6-4dac-4550-a971-a048c29bc65f\") " pod="openshift-monitoring/kube-state-metrics-845b954455-bfknl"
Jul 01 19:24:37.901861 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.901826    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-pxx4h"
Jul 01 19:24:37.945487 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:37.945454    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-bfknl"
Jul 01 19:24:38.111089 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:38.111013    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-pxx4h"]
Jul 01 19:24:38.114263 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:24:38.114233    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbb4acdc_38bb_4419_8361_32af35d5fc55.slice/crio-24f68b2d55d0fa5c6929be62b0b94c7bf9a7ad5a09720746500f2f0e69fbeffa WatchSource:0}: Error finding container 24f68b2d55d0fa5c6929be62b0b94c7bf9a7ad5a09720746500f2f0e69fbeffa: Status 404 returned error can't find the container with id 24f68b2d55d0fa5c6929be62b0b94c7bf9a7ad5a09720746500f2f0e69fbeffa
Jul 01 19:24:38.146075 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:38.146042    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-bfknl"]
Jul 01 19:24:38.149844 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:24:38.149819    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba8e22b6_4dac_4550_a971_a048c29bc65f.slice/crio-1b4b76ff33c999f8aef28c6fa3c2971f953fc1bb13d98c54f5bdab911b9bc330 WatchSource:0}: Error finding container 1b4b76ff33c999f8aef28c6fa3c2971f953fc1bb13d98c54f5bdab911b9bc330: Status 404 returned error can't find the container with id 1b4b76ff33c999f8aef28c6fa3c2971f953fc1bb13d98c54f5bdab911b9bc330
Jul 01 19:24:38.347600 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:38.347555    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/698773fc-86f3-48c7-8b12-1e21346536b0-node-exporter-tls\") pod \"node-exporter-vf7hp\" (UID: \"698773fc-86f3-48c7-8b12-1e21346536b0\") " pod="openshift-monitoring/node-exporter-vf7hp"
Jul 01 19:24:38.350267 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:38.350241    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/698773fc-86f3-48c7-8b12-1e21346536b0-node-exporter-tls\") pod \"node-exporter-vf7hp\" (UID: \"698773fc-86f3-48c7-8b12-1e21346536b0\") " pod="openshift-monitoring/node-exporter-vf7hp"
Jul 01 19:24:38.513293 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:38.513261    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2tq4l"
Jul 01 19:24:38.562318 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:38.562283    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vf7hp"
Jul 01 19:24:38.590420 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:24:38.590391    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod698773fc_86f3_48c7_8b12_1e21346536b0.slice/crio-6f92168c934c0f9d04e807371e7550134b9ee10a1e994e0e092bd32a92d9fcc3 WatchSource:0}: Error finding container 6f92168c934c0f9d04e807371e7550134b9ee10a1e994e0e092bd32a92d9fcc3: Status 404 returned error can't find the container with id 6f92168c934c0f9d04e807371e7550134b9ee10a1e994e0e092bd32a92d9fcc3
Jul 01 19:24:38.604701 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:38.604665    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-pxx4h" event={"ID":"bbb4acdc-38bb-4419-8361-32af35d5fc55","Type":"ContainerStarted","Data":"4898424a74f3bda4ba7817a39991b2316d9d5d793d2c3cb42a7750d6b6d40d43"}
Jul 01 19:24:38.604837 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:38.604740    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-pxx4h" event={"ID":"bbb4acdc-38bb-4419-8361-32af35d5fc55","Type":"ContainerStarted","Data":"fb59f2c1e4b7693bc9324acf83edac781fe933300814b613de74c07f4997d16d"}
Jul 01 19:24:38.604837 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:38.604768    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-pxx4h" event={"ID":"bbb4acdc-38bb-4419-8361-32af35d5fc55","Type":"ContainerStarted","Data":"24f68b2d55d0fa5c6929be62b0b94c7bf9a7ad5a09720746500f2f0e69fbeffa"}
Jul 01 19:24:38.607075 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:38.607016    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q4nt4" event={"ID":"876fca92-a686-42c9-9824-7a2577c9d8c0","Type":"ContainerStarted","Data":"7be67fa5e15642354662a26d9cb2619e026bb8caa8928a1ce30751212f653d1d"}
Jul 01 19:24:38.608400 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:38.608358    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vf7hp" event={"ID":"698773fc-86f3-48c7-8b12-1e21346536b0","Type":"ContainerStarted","Data":"6f92168c934c0f9d04e807371e7550134b9ee10a1e994e0e092bd32a92d9fcc3"}
Jul 01 19:24:38.609788 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:38.609763    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-bfknl" event={"ID":"ba8e22b6-4dac-4550-a971-a048c29bc65f","Type":"ContainerStarted","Data":"1b4b76ff33c999f8aef28c6fa3c2971f953fc1bb13d98c54f5bdab911b9bc330"}
Jul 01 19:24:38.637657 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:38.637560    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-q4nt4" podStartSLOduration=2.081276549 podStartE2EDuration="11.637536977s" totalImagesPullingTime="9.556260428s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:24:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:38.637135708 +0000 UTC m=+63.000147388" watchObservedRunningTime="2026-07-01 19:24:38.637536977 +0000 UTC m=+63.000548635"
Jul 01 19:24:38.847122 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:38.847081    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 01 19:24:38.850342 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:38.850310    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:24:38.857864 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:38.857723    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 01 19:24:38.858017 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:38.857883    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 01 19:24:38.858075 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:38.858058    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 01 19:24:38.860964 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:38.860944    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 01 19:24:38.861048 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:38.860986    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 01 19:24:38.861185 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:38.861170    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 01 19:24:38.861422 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:38.861352    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 01 19:24:38.861857 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:38.861560    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 01 19:24:38.861857 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:38.861728    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 01 19:24:38.862517 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:38.862327    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-675vj\""
Jul 01 19:24:38.952937 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:38.952710    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:24:38.952937 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:38.952762    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-config-out\") pod \"alertmanager-main-0\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:24:38.952937 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:38.952788    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:24:38.952937 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:38.952816    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz28d\" (UniqueName: \"kubernetes.io/projected/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-kube-api-access-sz28d\") pod \"alertmanager-main-0\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:24:38.952937 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:38.952849    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:24:38.952937 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:38.952876    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:24:38.952937 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:38.952920    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-config-volume\") pod \"alertmanager-main-0\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:24:38.953518 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:38.952991    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:24:38.953518 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:38.953023    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:24:38.953518 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:38.953059    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:24:38.953518 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:38.953108    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:24:38.953518 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:38.953154    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:24:38.953518 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:38.953176    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-web-config\") pod \"alertmanager-main-0\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:24:38.961750 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:38.961645    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 01 19:24:39.054739 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:39.053926    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:24:39.054739 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:39.053975    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-config-out\") pod \"alertmanager-main-0\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:24:39.054739 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:39.054000    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:24:39.054739 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:39.054030    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz28d\" (UniqueName: \"kubernetes.io/projected/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-kube-api-access-sz28d\") pod \"alertmanager-main-0\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:24:39.054739 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:39.054059    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:24:39.054739 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:39.054083    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:24:39.054739 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:39.054110    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-config-volume\") pod \"alertmanager-main-0\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:24:39.054739 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:39.054151    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:24:39.054739 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:39.054177    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:24:39.054739 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:39.054223    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:24:39.054739 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:39.054278    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:24:39.054739 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:39.054333    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:24:39.054739 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:39.054357    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-web-config\") pod \"alertmanager-main-0\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:24:39.055518 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:39.055481    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:24:39.055771 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:39.055744    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:24:39.056412 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:39.056360    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:24:39.059640 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:39.059596    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:24:39.060256 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:39.060213    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:24:39.061004 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:39.060606    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-config-out\") pod \"alertmanager-main-0\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:24:39.061004 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:39.060884    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:24:39.061004 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:39.060922    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:24:39.061460 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:39.061418    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:24:39.061706 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:39.061629    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-web-config\") pod \"alertmanager-main-0\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:24:39.063508 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:39.063466    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-config-volume\") pod \"alertmanager-main-0\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:24:39.063651 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:39.063628    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:24:39.065875 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:39.065854    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz28d\" (UniqueName: \"kubernetes.io/projected/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-kube-api-access-sz28d\") pod \"alertmanager-main-0\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:24:39.163434 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:39.163397    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:24:39.357205 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:39.356657    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 01 19:24:39.709625 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:24:39.709583    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd63797ef_d1c6_4a3b_94a5_c363b75b45ad.slice/crio-842c0b6d5d8a9e1fef31c354d50a3a72fd01ebfb77c9092078b7e2f258b79f67 WatchSource:0}: Error finding container 842c0b6d5d8a9e1fef31c354d50a3a72fd01ebfb77c9092078b7e2f258b79f67: Status 404 returned error can't find the container with id 842c0b6d5d8a9e1fef31c354d50a3a72fd01ebfb77c9092078b7e2f258b79f67
Jul 01 19:24:40.622286 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.622240    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-bfknl" event={"ID":"ba8e22b6-4dac-4550-a971-a048c29bc65f","Type":"ContainerStarted","Data":"cd07247bf7d333e51ffa9ccc0ce3ca3b48e1202ec111a3b85bf652e00f89f5ce"}
Jul 01 19:24:40.622493 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.622325    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-bfknl" event={"ID":"ba8e22b6-4dac-4550-a971-a048c29bc65f","Type":"ContainerStarted","Data":"8a557cf45b265e068c4e1279863acfe1e6ec8e6ee8185d17cf79a40dd95b2b49"}
Jul 01 19:24:40.622493 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.622357    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-bfknl" event={"ID":"ba8e22b6-4dac-4550-a971-a048c29bc65f","Type":"ContainerStarted","Data":"59a0ed458b1a0cbf556b08d0059865f8ace8a1e47f76de78a4834b66d131b3da"}
Jul 01 19:24:40.626032 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.625540    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-pxx4h" event={"ID":"bbb4acdc-38bb-4419-8361-32af35d5fc55","Type":"ContainerStarted","Data":"3b2b3841c79652c38f99ac1415471e72180d74fa05d6a7cf3eaff8b8d4a58b15"}
Jul 01 19:24:40.628313 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.628271    2556 generic.go:356] "Generic (PLEG): container finished" podID="698773fc-86f3-48c7-8b12-1e21346536b0" containerID="2fd29e973a2b823f43d7d25bca36a676f2f2c5aa67b2ec728b843eb71ee68fb2" exitCode=0
Jul 01 19:24:40.628458 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.628356    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vf7hp" event={"ID":"698773fc-86f3-48c7-8b12-1e21346536b0","Type":"ContainerDied","Data":"2fd29e973a2b823f43d7d25bca36a676f2f2c5aa67b2ec728b843eb71ee68fb2"}
Jul 01 19:24:40.631218 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.631142    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d63797ef-d1c6-4a3b-94a5-c363b75b45ad","Type":"ContainerStarted","Data":"842c0b6d5d8a9e1fef31c354d50a3a72fd01ebfb77c9092078b7e2f258b79f67"}
Jul 01 19:24:40.647040 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.644601    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-845b954455-bfknl" podStartSLOduration=1.560127877 podStartE2EDuration="3.644583188s" totalImagesPullingTime="2.084455311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:40.643120092 +0000 UTC m=+65.006131772" watchObservedRunningTime="2026-07-01 19:24:40.644583188 +0000 UTC m=+65.007594850"
Jul 01 19:24:40.657043 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.657014    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-66bc5d4987-8svj4"]
Jul 01 19:24:40.661104 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.661083    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-66bc5d4987-8svj4"
Jul 01 19:24:40.665209 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.664921    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 01 19:24:40.665209 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.665003    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 01 19:24:40.665209 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.665040    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-1qtr4ol29fept\""
Jul 01 19:24:40.665209 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.665149    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-wf7q4\""
Jul 01 19:24:40.665209 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.665168    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 01 19:24:40.665564 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.665295    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 01 19:24:40.665564 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.665438    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 01 19:24:40.672557 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.672535    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-66bc5d4987-8svj4"]
Jul 01 19:24:40.687234 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.687187    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-pxx4h" podStartSLOduration=1.823617807 podStartE2EDuration="3.687167842s" totalImagesPullingTime="1.863550035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:40.685595339 +0000 UTC m=+65.048607018" watchObservedRunningTime="2026-07-01 19:24:40.687167842 +0000 UTC m=+65.050179515"
Jul 01 19:24:40.770982 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.770936    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0b999439-23ae-44ac-8307-9f9fa6959707-secret-thanos-querier-tls\") pod \"thanos-querier-66bc5d4987-8svj4\" (UID: \"0b999439-23ae-44ac-8307-9f9fa6959707\") " pod="openshift-monitoring/thanos-querier-66bc5d4987-8svj4"
Jul 01 19:24:40.771385 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.770994    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b999439-23ae-44ac-8307-9f9fa6959707-metrics-client-ca\") pod \"thanos-querier-66bc5d4987-8svj4\" (UID: \"0b999439-23ae-44ac-8307-9f9fa6959707\") " pod="openshift-monitoring/thanos-querier-66bc5d4987-8svj4"
Jul 01 19:24:40.771385 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.771038    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glbgr\" (UniqueName: \"kubernetes.io/projected/0b999439-23ae-44ac-8307-9f9fa6959707-kube-api-access-glbgr\") pod \"thanos-querier-66bc5d4987-8svj4\" (UID: \"0b999439-23ae-44ac-8307-9f9fa6959707\") " pod="openshift-monitoring/thanos-querier-66bc5d4987-8svj4"
Jul 01 19:24:40.771385 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.771075    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0b999439-23ae-44ac-8307-9f9fa6959707-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66bc5d4987-8svj4\" (UID: \"0b999439-23ae-44ac-8307-9f9fa6959707\") " pod="openshift-monitoring/thanos-querier-66bc5d4987-8svj4"
Jul 01 19:24:40.771385 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.771114    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0b999439-23ae-44ac-8307-9f9fa6959707-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66bc5d4987-8svj4\" (UID: \"0b999439-23ae-44ac-8307-9f9fa6959707\") " pod="openshift-monitoring/thanos-querier-66bc5d4987-8svj4"
Jul 01 19:24:40.771385 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.771195    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0b999439-23ae-44ac-8307-9f9fa6959707-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66bc5d4987-8svj4\" (UID: \"0b999439-23ae-44ac-8307-9f9fa6959707\") " pod="openshift-monitoring/thanos-querier-66bc5d4987-8svj4"
Jul 01 19:24:40.771385 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.771255    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0b999439-23ae-44ac-8307-9f9fa6959707-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66bc5d4987-8svj4\" (UID: \"0b999439-23ae-44ac-8307-9f9fa6959707\") " pod="openshift-monitoring/thanos-querier-66bc5d4987-8svj4"
Jul 01 19:24:40.771385 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.771282    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0b999439-23ae-44ac-8307-9f9fa6959707-secret-grpc-tls\") pod \"thanos-querier-66bc5d4987-8svj4\" (UID: \"0b999439-23ae-44ac-8307-9f9fa6959707\") " pod="openshift-monitoring/thanos-querier-66bc5d4987-8svj4"
Jul 01 19:24:40.872397 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.872317    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0b999439-23ae-44ac-8307-9f9fa6959707-secret-thanos-querier-tls\") pod \"thanos-querier-66bc5d4987-8svj4\" (UID: \"0b999439-23ae-44ac-8307-9f9fa6959707\") " pod="openshift-monitoring/thanos-querier-66bc5d4987-8svj4"
Jul 01 19:24:40.872397 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.872380    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b999439-23ae-44ac-8307-9f9fa6959707-metrics-client-ca\") pod \"thanos-querier-66bc5d4987-8svj4\" (UID: \"0b999439-23ae-44ac-8307-9f9fa6959707\") " pod="openshift-monitoring/thanos-querier-66bc5d4987-8svj4"
Jul 01 19:24:40.872594 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.872428    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glbgr\" (UniqueName: \"kubernetes.io/projected/0b999439-23ae-44ac-8307-9f9fa6959707-kube-api-access-glbgr\") pod \"thanos-querier-66bc5d4987-8svj4\" (UID: \"0b999439-23ae-44ac-8307-9f9fa6959707\") " pod="openshift-monitoring/thanos-querier-66bc5d4987-8svj4"
Jul 01 19:24:40.872594 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.872466    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0b999439-23ae-44ac-8307-9f9fa6959707-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66bc5d4987-8svj4\" (UID: \"0b999439-23ae-44ac-8307-9f9fa6959707\") " pod="openshift-monitoring/thanos-querier-66bc5d4987-8svj4"
Jul 01 19:24:40.872594 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.872502    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0b999439-23ae-44ac-8307-9f9fa6959707-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66bc5d4987-8svj4\" (UID: \"0b999439-23ae-44ac-8307-9f9fa6959707\") " pod="openshift-monitoring/thanos-querier-66bc5d4987-8svj4"
Jul 01 19:24:40.872594 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.872539    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0b999439-23ae-44ac-8307-9f9fa6959707-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66bc5d4987-8svj4\" (UID: \"0b999439-23ae-44ac-8307-9f9fa6959707\") " pod="openshift-monitoring/thanos-querier-66bc5d4987-8svj4"
Jul 01 19:24:40.872594 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.872581    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0b999439-23ae-44ac-8307-9f9fa6959707-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66bc5d4987-8svj4\" (UID: \"0b999439-23ae-44ac-8307-9f9fa6959707\") " pod="openshift-monitoring/thanos-querier-66bc5d4987-8svj4"
Jul 01 19:24:40.872753 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.872605    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0b999439-23ae-44ac-8307-9f9fa6959707-secret-grpc-tls\") pod \"thanos-querier-66bc5d4987-8svj4\" (UID: \"0b999439-23ae-44ac-8307-9f9fa6959707\") " pod="openshift-monitoring/thanos-querier-66bc5d4987-8svj4"
Jul 01 19:24:40.874262 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.873920    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b999439-23ae-44ac-8307-9f9fa6959707-metrics-client-ca\") pod \"thanos-querier-66bc5d4987-8svj4\" (UID: \"0b999439-23ae-44ac-8307-9f9fa6959707\") " pod="openshift-monitoring/thanos-querier-66bc5d4987-8svj4"
Jul 01 19:24:40.875758 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.875723    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0b999439-23ae-44ac-8307-9f9fa6959707-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66bc5d4987-8svj4\" (UID: \"0b999439-23ae-44ac-8307-9f9fa6959707\") " pod="openshift-monitoring/thanos-querier-66bc5d4987-8svj4"
Jul 01 19:24:40.876151 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.876109    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0b999439-23ae-44ac-8307-9f9fa6959707-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66bc5d4987-8svj4\" (UID: \"0b999439-23ae-44ac-8307-9f9fa6959707\") " pod="openshift-monitoring/thanos-querier-66bc5d4987-8svj4"
Jul 01 19:24:40.876516 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.876493    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0b999439-23ae-44ac-8307-9f9fa6959707-secret-grpc-tls\") pod \"thanos-querier-66bc5d4987-8svj4\" (UID: \"0b999439-23ae-44ac-8307-9f9fa6959707\") " pod="openshift-monitoring/thanos-querier-66bc5d4987-8svj4"
Jul 01 19:24:40.877775 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.877730    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0b999439-23ae-44ac-8307-9f9fa6959707-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66bc5d4987-8svj4\" (UID: \"0b999439-23ae-44ac-8307-9f9fa6959707\") " pod="openshift-monitoring/thanos-querier-66bc5d4987-8svj4"
Jul 01 19:24:40.877880 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.877831    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0b999439-23ae-44ac-8307-9f9fa6959707-secret-thanos-querier-tls\") pod \"thanos-querier-66bc5d4987-8svj4\" (UID: \"0b999439-23ae-44ac-8307-9f9fa6959707\") " pod="openshift-monitoring/thanos-querier-66bc5d4987-8svj4"
Jul 01 19:24:40.879124 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.879098    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0b999439-23ae-44ac-8307-9f9fa6959707-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66bc5d4987-8svj4\" (UID: \"0b999439-23ae-44ac-8307-9f9fa6959707\") " pod="openshift-monitoring/thanos-querier-66bc5d4987-8svj4"
Jul 01 19:24:40.884783 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.884735    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glbgr\" (UniqueName: \"kubernetes.io/projected/0b999439-23ae-44ac-8307-9f9fa6959707-kube-api-access-glbgr\") pod \"thanos-querier-66bc5d4987-8svj4\" (UID: \"0b999439-23ae-44ac-8307-9f9fa6959707\") " pod="openshift-monitoring/thanos-querier-66bc5d4987-8svj4"
Jul 01 19:24:40.973733 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.973689    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36332f97-ad96-472d-a040-542d79e9e865-metrics-certs\") pod \"network-metrics-daemon-7mfxn\" (UID: \"36332f97-ad96-472d-a040-542d79e9e865\") " pod="openshift-multus/network-metrics-daemon-7mfxn"
Jul 01 19:24:40.973927 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.973752    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/091570c8-2f14-46c0-a514-c35f2d3096c4-original-pull-secret\") pod \"global-pull-secret-syncer-9znvt\" (UID: \"091570c8-2f14-46c0-a514-c35f2d3096c4\") " pod="kube-system/global-pull-secret-syncer-9znvt"
Jul 01 19:24:40.976288 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.976086    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 01 19:24:40.976288 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.976126    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 01 19:24:40.985410 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.985257    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-66bc5d4987-8svj4"
Jul 01 19:24:40.987645 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.987589    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/091570c8-2f14-46c0-a514-c35f2d3096c4-original-pull-secret\") pod \"global-pull-secret-syncer-9znvt\" (UID: \"091570c8-2f14-46c0-a514-c35f2d3096c4\") " pod="kube-system/global-pull-secret-syncer-9znvt"
Jul 01 19:24:40.988258 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:40.988208    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36332f97-ad96-472d-a040-542d79e9e865-metrics-certs\") pod \"network-metrics-daemon-7mfxn\" (UID: \"36332f97-ad96-472d-a040-542d79e9e865\") " pod="openshift-multus/network-metrics-daemon-7mfxn"
Jul 01 19:24:41.075086 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:41.075045    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4tkv\" (UniqueName: \"kubernetes.io/projected/64190ce2-a2fa-4276-a619-3e43188597ac-kube-api-access-z4tkv\") pod \"network-check-target-g7lwk\" (UID: \"64190ce2-a2fa-4276-a619-3e43188597ac\") " pod="openshift-network-diagnostics/network-check-target-g7lwk"
Jul 01 19:24:41.077874 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:41.077834    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 01 19:24:41.087961 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:41.087937    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 01 19:24:41.098748 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:41.098725    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4tkv\" (UniqueName: \"kubernetes.io/projected/64190ce2-a2fa-4276-a619-3e43188597ac-kube-api-access-z4tkv\") pod \"network-check-target-g7lwk\" (UID: \"64190ce2-a2fa-4276-a619-3e43188597ac\") " pod="openshift-network-diagnostics/network-check-target-g7lwk"
Jul 01 19:24:41.160459 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:41.160287    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znvt"
Jul 01 19:24:41.168992 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:41.168940    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4nv7g\""
Jul 01 19:24:41.172323 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:41.172301    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-64bmf\""
Jul 01 19:24:41.177216 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:41.177185    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mfxn"
Jul 01 19:24:41.183013 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:41.181241    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g7lwk"
Jul 01 19:24:41.304392 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:41.304174    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-66bc5d4987-8svj4"]
Jul 01 19:24:41.306635 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:24:41.305623    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b999439_23ae_44ac_8307_9f9fa6959707.slice/crio-a27c4ea49f32d8a90fb03c846d8ac2af7f20f4c9fe4c88ac6fd1d0dd21b001bf WatchSource:0}: Error finding container a27c4ea49f32d8a90fb03c846d8ac2af7f20f4c9fe4c88ac6fd1d0dd21b001bf: Status 404 returned error can't find the container with id a27c4ea49f32d8a90fb03c846d8ac2af7f20f4c9fe4c88ac6fd1d0dd21b001bf
Jul 01 19:24:41.379159 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:41.379130    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9znvt"]
Jul 01 19:24:41.390740 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:24:41.390706    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod091570c8_2f14_46c0_a514_c35f2d3096c4.slice/crio-0941f005de183f091abae4c879dba57a15fe34dca5a92daae2095d1da62df574 WatchSource:0}: Error finding container 0941f005de183f091abae4c879dba57a15fe34dca5a92daae2095d1da62df574: Status 404 returned error can't find the container with id 0941f005de183f091abae4c879dba57a15fe34dca5a92daae2095d1da62df574
Jul 01 19:24:41.398417 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:41.398389    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7mfxn"]
Jul 01 19:24:41.401941 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:24:41.401914    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36332f97_ad96_472d_a040_542d79e9e865.slice/crio-224496c6d5b8e87d1820d3a7ffab814ddf0d2466d25220a60c2ecf45a3955111 WatchSource:0}: Error finding container 224496c6d5b8e87d1820d3a7ffab814ddf0d2466d25220a60c2ecf45a3955111: Status 404 returned error can't find the container with id 224496c6d5b8e87d1820d3a7ffab814ddf0d2466d25220a60c2ecf45a3955111
Jul 01 19:24:41.427508 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:41.427477    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-g7lwk"]
Jul 01 19:24:41.431632 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:24:41.430090    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64190ce2_a2fa_4276_a619_3e43188597ac.slice/crio-23222823d68a58de30a8a9924c790fa65e8bc8ebbefbf08921bae4842d62c0ee WatchSource:0}: Error finding container 23222823d68a58de30a8a9924c790fa65e8bc8ebbefbf08921bae4842d62c0ee: Status 404 returned error can't find the container with id 23222823d68a58de30a8a9924c790fa65e8bc8ebbefbf08921bae4842d62c0ee
Jul 01 19:24:41.637866 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:41.637775    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vf7hp" event={"ID":"698773fc-86f3-48c7-8b12-1e21346536b0","Type":"ContainerStarted","Data":"6dd0e4f5d70a1f77bcd5c2976e56ee251f7ba929a564eb6c73865280cc538792"}
Jul 01 19:24:41.637866 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:41.637845    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vf7hp" event={"ID":"698773fc-86f3-48c7-8b12-1e21346536b0","Type":"ContainerStarted","Data":"2233b28b49091548233e50394798b8280c49c32500d33f94c79c678cba28dff3"}
Jul 01 19:24:41.639720 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:41.639688    2556 generic.go:356] "Generic (PLEG): container finished" podID="d63797ef-d1c6-4a3b-94a5-c363b75b45ad" containerID="85fe595eca6f2bd45f729a40b72f7395d0f291493cb0b58a5cafa6270823abbd" exitCode=0
Jul 01 19:24:41.639829 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:41.639719    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d63797ef-d1c6-4a3b-94a5-c363b75b45ad","Type":"ContainerDied","Data":"85fe595eca6f2bd45f729a40b72f7395d0f291493cb0b58a5cafa6270823abbd"}
Jul 01 19:24:41.641070 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:41.641038    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9znvt" event={"ID":"091570c8-2f14-46c0-a514-c35f2d3096c4","Type":"ContainerStarted","Data":"0941f005de183f091abae4c879dba57a15fe34dca5a92daae2095d1da62df574"}
Jul 01 19:24:41.642676 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:41.642651    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66bc5d4987-8svj4" event={"ID":"0b999439-23ae-44ac-8307-9f9fa6959707","Type":"ContainerStarted","Data":"a27c4ea49f32d8a90fb03c846d8ac2af7f20f4c9fe4c88ac6fd1d0dd21b001bf"}
Jul 01 19:24:41.644032 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:41.644006    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-g7lwk" event={"ID":"64190ce2-a2fa-4276-a619-3e43188597ac","Type":"ContainerStarted","Data":"23222823d68a58de30a8a9924c790fa65e8bc8ebbefbf08921bae4842d62c0ee"}
Jul 01 19:24:41.645582 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:41.645553    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7mfxn" event={"ID":"36332f97-ad96-472d-a040-542d79e9e865","Type":"ContainerStarted","Data":"224496c6d5b8e87d1820d3a7ffab814ddf0d2466d25220a60c2ecf45a3955111"}
Jul 01 19:24:41.660408 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:41.660335    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vf7hp" podStartSLOduration=2.91089257 podStartE2EDuration="4.660316947s" totalImagesPullingTime="1.649691514s" totalInitContainerRuntime="99.732863ms" isStatefulPod=true podCreationTimestamp="2026-07-01 19:24:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:41.659010149 +0000 UTC m=+66.022021830" watchObservedRunningTime="2026-07-01 19:24:41.660316947 +0000 UTC m=+66.023328656"
Jul 01 19:24:42.309397 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.308345    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7d9bb75989-6q6jc"]
Jul 01 19:24:42.312564 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.311990    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7d9bb75989-6q6jc"
Jul 01 19:24:42.317101 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.316685    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 01 19:24:42.317101 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.316945    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-jk6fm\""
Jul 01 19:24:42.318494 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.317661    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 01 19:24:42.318494 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.317875    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-1sfo138esap10\""
Jul 01 19:24:42.318494 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.318110    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 01 19:24:42.318494 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.318311    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 01 19:24:42.337715 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.337629    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7d9bb75989-6q6jc"]
Jul 01 19:24:42.338845 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.338822    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-f4zbs"]
Jul 01 19:24:42.341653 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.341632    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-f4zbs"
Jul 01 19:24:42.344462 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.344430    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-7phfp\""
Jul 01 19:24:42.344462 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.344430    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 01 19:24:42.358224 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.358202    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-f4zbs"]
Jul 01 19:24:42.388079 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.387635    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b42489e4-d315-40e7-96bf-1fdbe6c31246-secret-metrics-server-client-certs\") pod \"metrics-server-7d9bb75989-6q6jc\" (UID: \"b42489e4-d315-40e7-96bf-1fdbe6c31246\") " pod="openshift-monitoring/metrics-server-7d9bb75989-6q6jc"
Jul 01 19:24:42.388079 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.387701    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b42489e4-d315-40e7-96bf-1fdbe6c31246-secret-metrics-server-tls\") pod \"metrics-server-7d9bb75989-6q6jc\" (UID: \"b42489e4-d315-40e7-96bf-1fdbe6c31246\") " pod="openshift-monitoring/metrics-server-7d9bb75989-6q6jc"
Jul 01 19:24:42.388079 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.387752    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b42489e4-d315-40e7-96bf-1fdbe6c31246-client-ca-bundle\") pod \"metrics-server-7d9bb75989-6q6jc\" (UID: \"b42489e4-d315-40e7-96bf-1fdbe6c31246\") " pod="openshift-monitoring/metrics-server-7d9bb75989-6q6jc"
Jul 01 19:24:42.388079 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.387780    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bzf8\" (UniqueName: \"kubernetes.io/projected/9dfc3924-9507-4a81-9a1c-74f73f7fc347-kube-api-access-4bzf8\") pod \"monitoring-plugin-cd8656b8-f4zbs\" (UID: \"9dfc3924-9507-4a81-9a1c-74f73f7fc347\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-f4zbs"
Jul 01 19:24:42.388079 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.387808    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b42489e4-d315-40e7-96bf-1fdbe6c31246-metrics-server-audit-profiles\") pod \"metrics-server-7d9bb75989-6q6jc\" (UID: \"b42489e4-d315-40e7-96bf-1fdbe6c31246\") " pod="openshift-monitoring/metrics-server-7d9bb75989-6q6jc"
Jul 01 19:24:42.388079 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.387834    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9dfc3924-9507-4a81-9a1c-74f73f7fc347-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-f4zbs\" (UID: \"9dfc3924-9507-4a81-9a1c-74f73f7fc347\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-f4zbs"
Jul 01 19:24:42.388079 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.387868    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b42489e4-d315-40e7-96bf-1fdbe6c31246-audit-log\") pod \"metrics-server-7d9bb75989-6q6jc\" (UID: \"b42489e4-d315-40e7-96bf-1fdbe6c31246\") " pod="openshift-monitoring/metrics-server-7d9bb75989-6q6jc"
Jul 01 19:24:42.388079 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.387906    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpnqx\" (UniqueName: \"kubernetes.io/projected/b42489e4-d315-40e7-96bf-1fdbe6c31246-kube-api-access-fpnqx\") pod \"metrics-server-7d9bb75989-6q6jc\" (UID: \"b42489e4-d315-40e7-96bf-1fdbe6c31246\") " pod="openshift-monitoring/metrics-server-7d9bb75989-6q6jc"
Jul 01 19:24:42.388079 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.387941    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b42489e4-d315-40e7-96bf-1fdbe6c31246-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d9bb75989-6q6jc\" (UID: \"b42489e4-d315-40e7-96bf-1fdbe6c31246\") " pod="openshift-monitoring/metrics-server-7d9bb75989-6q6jc"
Jul 01 19:24:42.490059 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.488604    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b42489e4-d315-40e7-96bf-1fdbe6c31246-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d9bb75989-6q6jc\" (UID: \"b42489e4-d315-40e7-96bf-1fdbe6c31246\") " pod="openshift-monitoring/metrics-server-7d9bb75989-6q6jc"
Jul 01 19:24:42.490059 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.488659    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b42489e4-d315-40e7-96bf-1fdbe6c31246-secret-metrics-server-client-certs\") pod \"metrics-server-7d9bb75989-6q6jc\" (UID: \"b42489e4-d315-40e7-96bf-1fdbe6c31246\") " pod="openshift-monitoring/metrics-server-7d9bb75989-6q6jc"
Jul 01 19:24:42.490059 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.488714    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b42489e4-d315-40e7-96bf-1fdbe6c31246-secret-metrics-server-tls\") pod \"metrics-server-7d9bb75989-6q6jc\" (UID: \"b42489e4-d315-40e7-96bf-1fdbe6c31246\") " pod="openshift-monitoring/metrics-server-7d9bb75989-6q6jc"
Jul 01 19:24:42.490059 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.488767    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b42489e4-d315-40e7-96bf-1fdbe6c31246-client-ca-bundle\") pod \"metrics-server-7d9bb75989-6q6jc\" (UID: \"b42489e4-d315-40e7-96bf-1fdbe6c31246\") " pod="openshift-monitoring/metrics-server-7d9bb75989-6q6jc"
Jul 01 19:24:42.490059 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.488793    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bzf8\" (UniqueName: \"kubernetes.io/projected/9dfc3924-9507-4a81-9a1c-74f73f7fc347-kube-api-access-4bzf8\") pod \"monitoring-plugin-cd8656b8-f4zbs\" (UID: \"9dfc3924-9507-4a81-9a1c-74f73f7fc347\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-f4zbs"
Jul 01 19:24:42.490059 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.488822    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b42489e4-d315-40e7-96bf-1fdbe6c31246-metrics-server-audit-profiles\") pod \"metrics-server-7d9bb75989-6q6jc\" (UID: \"b42489e4-d315-40e7-96bf-1fdbe6c31246\") " pod="openshift-monitoring/metrics-server-7d9bb75989-6q6jc"
Jul 01 19:24:42.490059 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.488848    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9dfc3924-9507-4a81-9a1c-74f73f7fc347-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-f4zbs\" (UID: \"9dfc3924-9507-4a81-9a1c-74f73f7fc347\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-f4zbs"
Jul 01 19:24:42.490059 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.488883    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b42489e4-d315-40e7-96bf-1fdbe6c31246-audit-log\") pod \"metrics-server-7d9bb75989-6q6jc\" (UID: \"b42489e4-d315-40e7-96bf-1fdbe6c31246\") " pod="openshift-monitoring/metrics-server-7d9bb75989-6q6jc"
Jul 01 19:24:42.490059 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.488916    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpnqx\" (UniqueName: \"kubernetes.io/projected/b42489e4-d315-40e7-96bf-1fdbe6c31246-kube-api-access-fpnqx\") pod \"metrics-server-7d9bb75989-6q6jc\" (UID: \"b42489e4-d315-40e7-96bf-1fdbe6c31246\") " pod="openshift-monitoring/metrics-server-7d9bb75989-6q6jc"
Jul 01 19:24:42.490674 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.490083    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b42489e4-d315-40e7-96bf-1fdbe6c31246-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d9bb75989-6q6jc\" (UID: \"b42489e4-d315-40e7-96bf-1fdbe6c31246\") " pod="openshift-monitoring/metrics-server-7d9bb75989-6q6jc"
Jul 01 19:24:42.490674 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.490402    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b42489e4-d315-40e7-96bf-1fdbe6c31246-audit-log\") pod \"metrics-server-7d9bb75989-6q6jc\" (UID: \"b42489e4-d315-40e7-96bf-1fdbe6c31246\") " pod="openshift-monitoring/metrics-server-7d9bb75989-6q6jc"
Jul 01 19:24:42.491147 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.491083    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b42489e4-d315-40e7-96bf-1fdbe6c31246-metrics-server-audit-profiles\") pod \"metrics-server-7d9bb75989-6q6jc\" (UID: \"b42489e4-d315-40e7-96bf-1fdbe6c31246\") " pod="openshift-monitoring/metrics-server-7d9bb75989-6q6jc"
Jul 01 19:24:42.493982 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.493923    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b42489e4-d315-40e7-96bf-1fdbe6c31246-secret-metrics-server-tls\") pod \"metrics-server-7d9bb75989-6q6jc\" (UID: \"b42489e4-d315-40e7-96bf-1fdbe6c31246\") " pod="openshift-monitoring/metrics-server-7d9bb75989-6q6jc"
Jul 01 19:24:42.494953 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.494912    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9dfc3924-9507-4a81-9a1c-74f73f7fc347-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-f4zbs\" (UID: \"9dfc3924-9507-4a81-9a1c-74f73f7fc347\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-f4zbs"
Jul 01 19:24:42.495690 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.495642    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b42489e4-d315-40e7-96bf-1fdbe6c31246-client-ca-bundle\") pod \"metrics-server-7d9bb75989-6q6jc\" (UID: \"b42489e4-d315-40e7-96bf-1fdbe6c31246\") " pod="openshift-monitoring/metrics-server-7d9bb75989-6q6jc"
Jul 01 19:24:42.496249 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.496202    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b42489e4-d315-40e7-96bf-1fdbe6c31246-secret-metrics-server-client-certs\") pod \"metrics-server-7d9bb75989-6q6jc\" (UID: \"b42489e4-d315-40e7-96bf-1fdbe6c31246\") " pod="openshift-monitoring/metrics-server-7d9bb75989-6q6jc"
Jul 01 19:24:42.512827 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.512752    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bzf8\" (UniqueName: \"kubernetes.io/projected/9dfc3924-9507-4a81-9a1c-74f73f7fc347-kube-api-access-4bzf8\") pod \"monitoring-plugin-cd8656b8-f4zbs\" (UID: \"9dfc3924-9507-4a81-9a1c-74f73f7fc347\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-f4zbs"
Jul 01 19:24:42.513558 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.513511    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpnqx\" (UniqueName: \"kubernetes.io/projected/b42489e4-d315-40e7-96bf-1fdbe6c31246-kube-api-access-fpnqx\") pod \"metrics-server-7d9bb75989-6q6jc\" (UID: \"b42489e4-d315-40e7-96bf-1fdbe6c31246\") " pod="openshift-monitoring/metrics-server-7d9bb75989-6q6jc"
Jul 01 19:24:42.636992 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.636583    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7d9bb75989-6q6jc"
Jul 01 19:24:42.660265 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.660005    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-f4zbs"
Jul 01 19:24:42.836047 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.835645    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-74cf8bff8-p4czh"]
Jul 01 19:24:42.845902 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.845013    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-74cf8bff8-p4czh"
Jul 01 19:24:42.848363 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.847852    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 01 19:24:42.848363 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.848115    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 01 19:24:42.848363 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.848133    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-wl99n\""
Jul 01 19:24:42.849134 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.848851    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 01 19:24:42.849134 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.849004    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 01 19:24:42.851621 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.851359    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 01 19:24:42.877758 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.877581    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-74cf8bff8-p4czh"]
Jul 01 19:24:42.889758 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.889679    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 01 19:24:42.895479 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.895015    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec-metrics-client-ca\") pod \"telemeter-client-74cf8bff8-p4czh\" (UID: \"0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec\") " pod="openshift-monitoring/telemeter-client-74cf8bff8-p4czh"
Jul 01 19:24:42.895479 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.895065    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec-federate-client-tls\") pod \"telemeter-client-74cf8bff8-p4czh\" (UID: \"0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec\") " pod="openshift-monitoring/telemeter-client-74cf8bff8-p4czh"
Jul 01 19:24:42.895479 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.895093    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec-telemeter-trusted-ca-bundle\") pod \"telemeter-client-74cf8bff8-p4czh\" (UID: \"0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec\") " pod="openshift-monitoring/telemeter-client-74cf8bff8-p4czh"
Jul 01 19:24:42.895479 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.895131    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-74cf8bff8-p4czh\" (UID: \"0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec\") " pod="openshift-monitoring/telemeter-client-74cf8bff8-p4czh"
Jul 01 19:24:42.895479 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.895203    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrlln\" (UniqueName: \"kubernetes.io/projected/0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec-kube-api-access-wrlln\") pod \"telemeter-client-74cf8bff8-p4czh\" (UID: \"0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec\") " pod="openshift-monitoring/telemeter-client-74cf8bff8-p4czh"
Jul 01 19:24:42.895479 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.895232    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec-telemeter-client-tls\") pod \"telemeter-client-74cf8bff8-p4czh\" (UID: \"0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec\") " pod="openshift-monitoring/telemeter-client-74cf8bff8-p4czh"
Jul 01 19:24:42.895479 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.895259    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec-secret-telemeter-client\") pod \"telemeter-client-74cf8bff8-p4czh\" (UID: \"0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec\") " pod="openshift-monitoring/telemeter-client-74cf8bff8-p4czh"
Jul 01 19:24:42.895479 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.895302    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec-serving-certs-ca-bundle\") pod \"telemeter-client-74cf8bff8-p4czh\" (UID: \"0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec\") " pod="openshift-monitoring/telemeter-client-74cf8bff8-p4czh"
Jul 01 19:24:42.937525 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.937177    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-f4zbs"]
Jul 01 19:24:42.952830 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:24:42.951758    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dfc3924_9507_4a81_9a1c_74f73f7fc347.slice/crio-1bf121c5dbb0656f570688a872d7eb1e915e237ac4dfb0953c24a9d70430e23e WatchSource:0}: Error finding container 1bf121c5dbb0656f570688a872d7eb1e915e237ac4dfb0953c24a9d70430e23e: Status 404 returned error can't find the container with id 1bf121c5dbb0656f570688a872d7eb1e915e237ac4dfb0953c24a9d70430e23e
Jul 01 19:24:42.986184 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.986115    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7d9bb75989-6q6jc"]
Jul 01 19:24:42.989640 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:24:42.989602    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb42489e4_d315_40e7_96bf_1fdbe6c31246.slice/crio-7332217880ca8fb140adddd5a68be9590094f5de54627d4184e39893aa82bf0f WatchSource:0}: Error finding container 7332217880ca8fb140adddd5a68be9590094f5de54627d4184e39893aa82bf0f: Status 404 returned error can't find the container with id 7332217880ca8fb140adddd5a68be9590094f5de54627d4184e39893aa82bf0f
Jul 01 19:24:42.999061 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.996559    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrlln\" (UniqueName: \"kubernetes.io/projected/0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec-kube-api-access-wrlln\") pod \"telemeter-client-74cf8bff8-p4czh\" (UID: \"0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec\") " pod="openshift-monitoring/telemeter-client-74cf8bff8-p4czh"
Jul 01 19:24:42.999061 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.996604    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec-telemeter-client-tls\") pod \"telemeter-client-74cf8bff8-p4czh\" (UID: \"0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec\") " pod="openshift-monitoring/telemeter-client-74cf8bff8-p4czh"
Jul 01 19:24:42.999061 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.996638    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec-secret-telemeter-client\") pod \"telemeter-client-74cf8bff8-p4czh\" (UID: \"0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec\") " pod="openshift-monitoring/telemeter-client-74cf8bff8-p4czh"
Jul 01 19:24:42.999061 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.996681    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec-serving-certs-ca-bundle\") pod \"telemeter-client-74cf8bff8-p4czh\" (UID: \"0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec\") " pod="openshift-monitoring/telemeter-client-74cf8bff8-p4czh"
Jul 01 19:24:42.999061 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.996732    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec-metrics-client-ca\") pod \"telemeter-client-74cf8bff8-p4czh\" (UID: \"0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec\") " pod="openshift-monitoring/telemeter-client-74cf8bff8-p4czh"
Jul 01 19:24:42.999061 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.996759    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec-federate-client-tls\") pod \"telemeter-client-74cf8bff8-p4czh\" (UID: \"0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec\") " pod="openshift-monitoring/telemeter-client-74cf8bff8-p4czh"
Jul 01 19:24:42.999061 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.996789    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec-telemeter-trusted-ca-bundle\") pod \"telemeter-client-74cf8bff8-p4czh\" (UID: \"0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec\") " pod="openshift-monitoring/telemeter-client-74cf8bff8-p4czh"
Jul 01 19:24:42.999061 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.996826    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-74cf8bff8-p4czh\" (UID: \"0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec\") " pod="openshift-monitoring/telemeter-client-74cf8bff8-p4czh"
Jul 01 19:24:42.999061 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:42.998196    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec-serving-certs-ca-bundle\") pod \"telemeter-client-74cf8bff8-p4czh\" (UID: \"0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec\") " pod="openshift-monitoring/telemeter-client-74cf8bff8-p4czh"
Jul 01 19:24:43.001844 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:43.001139    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec-telemeter-trusted-ca-bundle\") pod \"telemeter-client-74cf8bff8-p4czh\" (UID: \"0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec\") " pod="openshift-monitoring/telemeter-client-74cf8bff8-p4czh"
Jul 01 19:24:43.001844 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:43.001719    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec-metrics-client-ca\") pod \"telemeter-client-74cf8bff8-p4czh\" (UID: \"0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec\") " pod="openshift-monitoring/telemeter-client-74cf8bff8-p4czh"
Jul 01 19:24:43.004210 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:43.004172    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec-telemeter-client-tls\") pod \"telemeter-client-74cf8bff8-p4czh\" (UID: \"0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec\") " pod="openshift-monitoring/telemeter-client-74cf8bff8-p4czh"
Jul 01 19:24:43.004932 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:43.004890    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec-secret-telemeter-client\") pod \"telemeter-client-74cf8bff8-p4czh\" (UID: \"0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec\") " pod="openshift-monitoring/telemeter-client-74cf8bff8-p4czh"
Jul 01 19:24:43.005726 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:43.005690    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec-federate-client-tls\") pod \"telemeter-client-74cf8bff8-p4czh\" (UID: \"0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec\") " pod="openshift-monitoring/telemeter-client-74cf8bff8-p4czh"
Jul 01 19:24:43.007071 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:43.006292    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-74cf8bff8-p4czh\" (UID: \"0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec\") " pod="openshift-monitoring/telemeter-client-74cf8bff8-p4czh"
Jul 01 19:24:43.012310 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:43.012236    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrlln\" (UniqueName: \"kubernetes.io/projected/0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec-kube-api-access-wrlln\") pod \"telemeter-client-74cf8bff8-p4czh\" (UID: \"0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec\") " pod="openshift-monitoring/telemeter-client-74cf8bff8-p4czh"
Jul 01 19:24:43.177078 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:43.176891    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54767dbcbf-qb7sv"]
Jul 01 19:24:43.179317 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:43.179149    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-74cf8bff8-p4czh"
Jul 01 19:24:43.181082 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:43.180321    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54767dbcbf-qb7sv"
Jul 01 19:24:43.185273 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:43.184575    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 01 19:24:43.185273 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:43.185112    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 01 19:24:43.185273 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:43.185128    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 01 19:24:43.185533 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:43.185419    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 01 19:24:43.185822 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:43.185619    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2twc4\""
Jul 01 19:24:43.185822 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:43.185681    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 01 19:24:43.197893 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:43.197867    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54767dbcbf-qb7sv"]
Jul 01 19:24:43.299739 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:43.299668    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ec5ad34-8736-47aa-86cb-3f7c32975f6f-console-config\") pod \"console-54767dbcbf-qb7sv\" (UID: \"8ec5ad34-8736-47aa-86cb-3f7c32975f6f\") " pod="openshift-console/console-54767dbcbf-qb7sv"
Jul 01 19:24:43.299915 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:43.299884    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ec5ad34-8736-47aa-86cb-3f7c32975f6f-service-ca\") pod \"console-54767dbcbf-qb7sv\" (UID: \"8ec5ad34-8736-47aa-86cb-3f7c32975f6f\") " pod="openshift-console/console-54767dbcbf-qb7sv"
Jul 01 19:24:43.300008 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:43.299934    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzh2d\" (UniqueName: \"kubernetes.io/projected/8ec5ad34-8736-47aa-86cb-3f7c32975f6f-kube-api-access-fzh2d\") pod \"console-54767dbcbf-qb7sv\" (UID: \"8ec5ad34-8736-47aa-86cb-3f7c32975f6f\") " pod="openshift-console/console-54767dbcbf-qb7sv"
Jul 01 19:24:43.300008 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:43.299985    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ec5ad34-8736-47aa-86cb-3f7c32975f6f-console-oauth-config\") pod \"console-54767dbcbf-qb7sv\" (UID: \"8ec5ad34-8736-47aa-86cb-3f7c32975f6f\") " pod="openshift-console/console-54767dbcbf-qb7sv"
Jul 01 19:24:43.300175 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:43.300030    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ec5ad34-8736-47aa-86cb-3f7c32975f6f-console-serving-cert\") pod \"console-54767dbcbf-qb7sv\" (UID: \"8ec5ad34-8736-47aa-86cb-3f7c32975f6f\") " pod="openshift-console/console-54767dbcbf-qb7sv"
Jul 01 19:24:43.300175 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:43.300056    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ec5ad34-8736-47aa-86cb-3f7c32975f6f-oauth-serving-cert\") pod \"console-54767dbcbf-qb7sv\" (UID: \"8ec5ad34-8736-47aa-86cb-3f7c32975f6f\") " pod="openshift-console/console-54767dbcbf-qb7sv"
Jul 01 19:24:43.402465 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:43.401112    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ec5ad34-8736-47aa-86cb-3f7c32975f6f-console-config\") pod \"console-54767dbcbf-qb7sv\" (UID: \"8ec5ad34-8736-47aa-86cb-3f7c32975f6f\") " pod="openshift-console/console-54767dbcbf-qb7sv"
Jul 01 19:24:43.402465 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:43.401185    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ec5ad34-8736-47aa-86cb-3f7c32975f6f-service-ca\") pod \"console-54767dbcbf-qb7sv\" (UID: \"8ec5ad34-8736-47aa-86cb-3f7c32975f6f\") " pod="openshift-console/console-54767dbcbf-qb7sv"
Jul 01 19:24:43.402465 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:43.401221    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzh2d\" (UniqueName: \"kubernetes.io/projected/8ec5ad34-8736-47aa-86cb-3f7c32975f6f-kube-api-access-fzh2d\") pod \"console-54767dbcbf-qb7sv\" (UID: \"8ec5ad34-8736-47aa-86cb-3f7c32975f6f\") " pod="openshift-console/console-54767dbcbf-qb7sv"
Jul 01 19:24:43.402465 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:43.401264    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ec5ad34-8736-47aa-86cb-3f7c32975f6f-console-oauth-config\") pod \"console-54767dbcbf-qb7sv\" (UID: \"8ec5ad34-8736-47aa-86cb-3f7c32975f6f\") " pod="openshift-console/console-54767dbcbf-qb7sv"
Jul 01 19:24:43.402465 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:43.401303    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ec5ad34-8736-47aa-86cb-3f7c32975f6f-console-serving-cert\") pod \"console-54767dbcbf-qb7sv\" (UID: \"8ec5ad34-8736-47aa-86cb-3f7c32975f6f\") " pod="openshift-console/console-54767dbcbf-qb7sv"
Jul 01 19:24:43.402465 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:43.401329    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ec5ad34-8736-47aa-86cb-3f7c32975f6f-oauth-serving-cert\") pod \"console-54767dbcbf-qb7sv\" (UID: \"8ec5ad34-8736-47aa-86cb-3f7c32975f6f\") " pod="openshift-console/console-54767dbcbf-qb7sv"
Jul 01 19:24:43.402465 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:43.402135    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ec5ad34-8736-47aa-86cb-3f7c32975f6f-oauth-serving-cert\") pod \"console-54767dbcbf-qb7sv\" (UID: \"8ec5ad34-8736-47aa-86cb-3f7c32975f6f\") " pod="openshift-console/console-54767dbcbf-qb7sv"
Jul 01 19:24:43.403185 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:43.402522    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ec5ad34-8736-47aa-86cb-3f7c32975f6f-console-config\") pod \"console-54767dbcbf-qb7sv\" (UID: \"8ec5ad34-8736-47aa-86cb-3f7c32975f6f\") " pod="openshift-console/console-54767dbcbf-qb7sv"
Jul 01 19:24:43.403185 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:43.403018    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ec5ad34-8736-47aa-86cb-3f7c32975f6f-service-ca\") pod \"console-54767dbcbf-qb7sv\" (UID: \"8ec5ad34-8736-47aa-86cb-3f7c32975f6f\") " pod="openshift-console/console-54767dbcbf-qb7sv"
Jul 01 19:24:43.406206 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:43.406143    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ec5ad34-8736-47aa-86cb-3f7c32975f6f-console-oauth-config\") pod \"console-54767dbcbf-qb7sv\" (UID: \"8ec5ad34-8736-47aa-86cb-3f7c32975f6f\") " pod="openshift-console/console-54767dbcbf-qb7sv"
Jul 01 19:24:43.406798 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:43.406751    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ec5ad34-8736-47aa-86cb-3f7c32975f6f-console-serving-cert\") pod \"console-54767dbcbf-qb7sv\" (UID: \"8ec5ad34-8736-47aa-86cb-3f7c32975f6f\") " pod="openshift-console/console-54767dbcbf-qb7sv"
Jul 01 19:24:43.415409 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:43.415380    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzh2d\" (UniqueName: \"kubernetes.io/projected/8ec5ad34-8736-47aa-86cb-3f7c32975f6f-kube-api-access-fzh2d\") pod \"console-54767dbcbf-qb7sv\" (UID: \"8ec5ad34-8736-47aa-86cb-3f7c32975f6f\") " pod="openshift-console/console-54767dbcbf-qb7sv"
Jul 01 19:24:43.499041 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:43.498839    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54767dbcbf-qb7sv"
Jul 01 19:24:43.660229 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:43.660127    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7mfxn" event={"ID":"36332f97-ad96-472d-a040-542d79e9e865","Type":"ContainerStarted","Data":"d1a61236254eb1a0b184d2826fb0369b03aac1d62992ed13a4e452bc260a5335"}
Jul 01 19:24:43.660229 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:43.660193    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7mfxn" event={"ID":"36332f97-ad96-472d-a040-542d79e9e865","Type":"ContainerStarted","Data":"c3919af17a9f0c219f4fd53ae4beeeb35071972ca7475a5dd821310cfea50ad8"}
Jul 01 19:24:43.663564 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:43.663511    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7d9bb75989-6q6jc" event={"ID":"b42489e4-d315-40e7-96bf-1fdbe6c31246","Type":"ContainerStarted","Data":"7332217880ca8fb140adddd5a68be9590094f5de54627d4184e39893aa82bf0f"}
Jul 01 19:24:43.666116 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:43.666075    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-f4zbs" event={"ID":"9dfc3924-9507-4a81-9a1c-74f73f7fc347","Type":"ContainerStarted","Data":"1bf121c5dbb0656f570688a872d7eb1e915e237ac4dfb0953c24a9d70430e23e"}
Jul 01 19:24:43.683189 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:43.682323    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7mfxn" podStartSLOduration=65.312153523 podStartE2EDuration="1m6.682301736s" totalImagesPullingTime="1.370148213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:23:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:43.677652273 +0000 UTC m=+68.040663970" watchObservedRunningTime="2026-07-01 19:24:43.682301736 +0000 UTC m=+68.045313418"
Jul 01 19:24:44.004071 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.002189    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 01 19:24:44.011009 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.010984    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.018525 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.015992    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 01 19:24:44.018525 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.016279    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 01 19:24:44.018525 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.016590    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 01 19:24:44.018525 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.016731    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 01 19:24:44.018525 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.016857    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qlx4s\""
Jul 01 19:24:44.018525 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.017036    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a9u32dkencu39\""
Jul 01 19:24:44.018525 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.017161    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 01 19:24:44.018525 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.017315    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 01 19:24:44.033158 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.033047    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 01 19:24:44.036534 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.036307    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 01 19:24:44.038115 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.037925    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 01 19:24:44.041421 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.040977    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 01 19:24:44.044437 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.043571    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 01 19:24:44.044437 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.043905    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 01 19:24:44.044437 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.043981    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 01 19:24:44.044437 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.044244    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 01 19:24:44.047178 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.047159    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 01 19:24:44.086100 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.086049    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-74cf8bff8-p4czh"]
Jul 01 19:24:44.108809 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.108038    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-config\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.108809 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.108088    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/304aab4c-2394-418b-bc9d-d8169f55974c-config-out\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.108809 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.108128    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.108809 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.108154    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/304aab4c-2394-418b-bc9d-d8169f55974c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.108809 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.108182    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.108809 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.108206    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdkjx\" (UniqueName: \"kubernetes.io/projected/304aab4c-2394-418b-bc9d-d8169f55974c-kube-api-access-xdkjx\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.108809 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.108240    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.108809 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.108277    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.108809 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.108302    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.108809 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.108329    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/304aab4c-2394-418b-bc9d-d8169f55974c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.108809 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.108363    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/304aab4c-2394-418b-bc9d-d8169f55974c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.108809 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.108449    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.108809 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.108474    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/304aab4c-2394-418b-bc9d-d8169f55974c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.108809 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.108501    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/304aab4c-2394-418b-bc9d-d8169f55974c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.108809 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.108530    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-web-config\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.108809 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.108552    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.109745 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.108581    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/304aab4c-2394-418b-bc9d-d8169f55974c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.109745 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.108603    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/304aab4c-2394-418b-bc9d-d8169f55974c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.109745 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.108635    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/304aab4c-2394-418b-bc9d-d8169f55974c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.109745 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.108687    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/304aab4c-2394-418b-bc9d-d8169f55974c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.209458 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.209417    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.209638 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.209474    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/304aab4c-2394-418b-bc9d-d8169f55974c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.209638 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.209502    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/304aab4c-2394-418b-bc9d-d8169f55974c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.209638 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.209529    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-web-config\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.209638 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.209557    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.209638 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.209584    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/304aab4c-2394-418b-bc9d-d8169f55974c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.209638 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.209605    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/304aab4c-2394-418b-bc9d-d8169f55974c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.209638 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.209631    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/304aab4c-2394-418b-bc9d-d8169f55974c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.209968 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.209677    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/304aab4c-2394-418b-bc9d-d8169f55974c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.212320 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.210595    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/304aab4c-2394-418b-bc9d-d8169f55974c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.212320 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.211911    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/304aab4c-2394-418b-bc9d-d8169f55974c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.212320 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.212012    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-config\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.212320 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.212067    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/304aab4c-2394-418b-bc9d-d8169f55974c-config-out\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.212320 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.212106    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.212320 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.212131    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/304aab4c-2394-418b-bc9d-d8169f55974c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.212320 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.212159    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.212320 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.212181    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdkjx\" (UniqueName: \"kubernetes.io/projected/304aab4c-2394-418b-bc9d-d8169f55974c-kube-api-access-xdkjx\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.212320 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.212219    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.212320 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.212263    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.212320 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.212263    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/304aab4c-2394-418b-bc9d-d8169f55974c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.212320 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.212292    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.212320 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.212321    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/304aab4c-2394-418b-bc9d-d8169f55974c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.213691 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.212357    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/304aab4c-2394-418b-bc9d-d8169f55974c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.213691 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.213151    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/304aab4c-2394-418b-bc9d-d8169f55974c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.214968 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.214177    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/304aab4c-2394-418b-bc9d-d8169f55974c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.217246 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.217021    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/304aab4c-2394-418b-bc9d-d8169f55974c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.219123 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.217792    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/304aab4c-2394-418b-bc9d-d8169f55974c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.219123 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.218661    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/304aab4c-2394-418b-bc9d-d8169f55974c-config-out\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.219123 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.219033    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.219804 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.219530    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-config\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.220261 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.220054    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.220610 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.220537    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.221407 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.221258    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.222067 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.221970    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.223197 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.223141    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.225350 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.225259    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/304aab4c-2394-418b-bc9d-d8169f55974c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.226517 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.226486    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.228613 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.228587    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-web-config\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.228897 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.228836    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/304aab4c-2394-418b-bc9d-d8169f55974c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.240647 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.240570    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdkjx\" (UniqueName: \"kubernetes.io/projected/304aab4c-2394-418b-bc9d-d8169f55974c-kube-api-access-xdkjx\") pod \"prometheus-k8s-0\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.332671 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.332611    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:24:44.596273 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:44.595483    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tszxb"
Jul 01 19:24:45.471734 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:24:45.471687    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b9fa0e5_2932_451d_8c3e_2f6d9694a1ec.slice/crio-df1e624d8b82ea2c0aef4fd67ae604567aee119757adff9764998e4fc90cf48a WatchSource:0}: Error finding container df1e624d8b82ea2c0aef4fd67ae604567aee119757adff9764998e4fc90cf48a: Status 404 returned error can't find the container with id df1e624d8b82ea2c0aef4fd67ae604567aee119757adff9764998e4fc90cf48a
Jul 01 19:24:45.678998 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:45.678954    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74cf8bff8-p4czh" event={"ID":"0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec","Type":"ContainerStarted","Data":"df1e624d8b82ea2c0aef4fd67ae604567aee119757adff9764998e4fc90cf48a"}
Jul 01 19:24:46.830118 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:46.830078    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54767dbcbf-qb7sv"]
Jul 01 19:24:55.328187 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:24:55.328152    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ec5ad34_8736_47aa_86cb_3f7c32975f6f.slice/crio-80759d79af92c5033f66b1bd03e9746cb558119e71a31640e376459ef3c57fda WatchSource:0}: Error finding container 80759d79af92c5033f66b1bd03e9746cb558119e71a31640e376459ef3c57fda: Status 404 returned error can't find the container with id 80759d79af92c5033f66b1bd03e9746cb558119e71a31640e376459ef3c57fda
Jul 01 19:24:55.719988 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:55.719952    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54767dbcbf-qb7sv" event={"ID":"8ec5ad34-8736-47aa-86cb-3f7c32975f6f","Type":"ContainerStarted","Data":"80759d79af92c5033f66b1bd03e9746cb558119e71a31640e376459ef3c57fda"}
Jul 01 19:24:57.659645 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:57.659584    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 01 19:24:57.666603 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:24:57.666536    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod304aab4c_2394_418b_bc9d_d8169f55974c.slice/crio-226b4dcb5605df1e56b1f253fd64e8fa62b762ce0d06039cf215e7dd18b6f3e4 WatchSource:0}: Error finding container 226b4dcb5605df1e56b1f253fd64e8fa62b762ce0d06039cf215e7dd18b6f3e4: Status 404 returned error can't find the container with id 226b4dcb5605df1e56b1f253fd64e8fa62b762ce0d06039cf215e7dd18b6f3e4
Jul 01 19:24:57.735288 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:57.734511    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7d9bb75989-6q6jc" event={"ID":"b42489e4-d315-40e7-96bf-1fdbe6c31246","Type":"ContainerStarted","Data":"4d571ac214f1ee8ede8959dd26ad54cced72eeb7058bf1c443c9041e4575da78"}
Jul 01 19:24:57.739388 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:57.738665    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9znvt" event={"ID":"091570c8-2f14-46c0-a514-c35f2d3096c4","Type":"ContainerStarted","Data":"d2de8dbaa0cf92de8cb375112aec14667691c5290cdfe1a22f5efdd719d99077"}
Jul 01 19:24:57.743523 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:57.742504    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5499b6fb8f-n8cvx" event={"ID":"3edd9db8-f2f1-4b65-82f8-208ea3fe3ed7","Type":"ContainerStarted","Data":"51c9dd7fe94b00f50be1ea57181ebfa7e0361dc03c3ea2eb114136d5656803b9"}
Jul 01 19:24:57.743851 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:57.743813    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5499b6fb8f-n8cvx"
Jul 01 19:24:57.752913 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:57.751771    2556 patch_prober.go:28] interesting pod/downloads-5499b6fb8f-n8cvx container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.10:8080/\": dial tcp 10.134.0.10:8080: connect: connection refused" start-of-body=
Jul 01 19:24:57.752913 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:57.751827    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-5499b6fb8f-n8cvx" podUID="3edd9db8-f2f1-4b65-82f8-208ea3fe3ed7" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.10:8080/\": dial tcp 10.134.0.10:8080: connect: connection refused"
Jul 01 19:24:57.756299 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:57.756245    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7d9bb75989-6q6jc" podStartSLOduration=1.269695706 podStartE2EDuration="15.756226716s" totalImagesPullingTime="14.48653101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:57.754496125 +0000 UTC m=+82.117507820" watchObservedRunningTime="2026-07-01 19:24:57.756226716 +0000 UTC m=+82.119238398"
Jul 01 19:24:57.761692 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:57.761427    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-g7lwk" event={"ID":"64190ce2-a2fa-4276-a619-3e43188597ac","Type":"ContainerStarted","Data":"908063d075620a0e6fc45224df0ec846159950e2199dcce847de620312432f9e"}
Jul 01 19:24:57.761692 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:57.761678    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-g7lwk"
Jul 01 19:24:57.769484 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:57.769448    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-f4zbs" event={"ID":"9dfc3924-9507-4a81-9a1c-74f73f7fc347","Type":"ContainerStarted","Data":"39f966c552a97537a1977bcbf2e38ee78dd50a07495350972172ab2b1c79f473"}
Jul 01 19:24:57.769914 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:57.769870    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-f4zbs"
Jul 01 19:24:57.775714 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:57.775493    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5499b6fb8f-n8cvx" podStartSLOduration=0.803559236 podStartE2EDuration="23.775453615s" totalImagesPullingTime="22.971894379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:57.773513133 +0000 UTC m=+82.136524829" watchObservedRunningTime="2026-07-01 19:24:57.775453615 +0000 UTC m=+82.138465298"
Jul 01 19:24:57.780419 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:57.779497    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d63797ef-d1c6-4a3b-94a5-c363b75b45ad","Type":"ContainerStarted","Data":"ba7ddcd6097f881b8eac2c424ce3752d6bd91e14008848ed8bd7ac73e5dda1c0"}
Jul 01 19:24:57.783552 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:57.783465    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66bc5d4987-8svj4" event={"ID":"0b999439-23ae-44ac-8307-9f9fa6959707","Type":"ContainerStarted","Data":"27d912afe849f1dfe3f6255d7b53c8b7a16fd985a07c529a0514ea969843bba6"}
Jul 01 19:24:57.785335 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:57.785314    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74cf8bff8-p4czh" event={"ID":"0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec","Type":"ContainerStarted","Data":"3564c21a1057974e00ca83b3d972660758d06b4822f667072c198d43ac0b0e4f"}
Jul 01 19:24:57.788872 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:57.788418    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-f4zbs"
Jul 01 19:24:57.792290 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:57.792144    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"304aab4c-2394-418b-bc9d-d8169f55974c","Type":"ContainerStarted","Data":"226b4dcb5605df1e56b1f253fd64e8fa62b762ce0d06039cf215e7dd18b6f3e4"}
Jul 01 19:24:57.813439 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:57.812994    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-g7lwk" podStartSLOduration=64.775413942 podStartE2EDuration="1m20.812972695s" totalImagesPullingTime="16.037558753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:23:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:57.812325476 +0000 UTC m=+82.175337160" watchObservedRunningTime="2026-07-01 19:24:57.812972695 +0000 UTC m=+82.175984377"
Jul 01 19:24:57.813954 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:57.813898    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9znvt" podStartSLOduration=64.728593843 podStartE2EDuration="1m20.813875522s" totalImagesPullingTime="16.085281679s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:23:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:57.795434016 +0000 UTC m=+82.158445698" watchObservedRunningTime="2026-07-01 19:24:57.813875522 +0000 UTC m=+82.176887205"
Jul 01 19:24:57.833597 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:57.832657    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-cd8656b8-f4zbs" podStartSLOduration=1.283883793 podStartE2EDuration="15.832633599s" totalImagesPullingTime="14.548749806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:57.831239592 +0000 UTC m=+82.194251274" watchObservedRunningTime="2026-07-01 19:24:57.832633599 +0000 UTC m=+82.195645282"
Jul 01 19:24:58.804666 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:58.804616    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d63797ef-d1c6-4a3b-94a5-c363b75b45ad","Type":"ContainerStarted","Data":"9c9af7b02af1c19ed953eb2f89ac461e91f4c1756d143c55a33a0ede0b3fcfd5"}
Jul 01 19:24:58.805149 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:58.804715    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d63797ef-d1c6-4a3b-94a5-c363b75b45ad","Type":"ContainerStarted","Data":"27482d2d5011f8e099ac4e0dbba5cd2552e7d527bca74ead577e13fc74905384"}
Jul 01 19:24:58.805149 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:58.804758    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d63797ef-d1c6-4a3b-94a5-c363b75b45ad","Type":"ContainerStarted","Data":"29dffcaee26c36e23c5f0548a7852c17301ef5087d86a32daa876cc2fdca636c"}
Jul 01 19:24:58.805149 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:58.804799    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d63797ef-d1c6-4a3b-94a5-c363b75b45ad","Type":"ContainerStarted","Data":"f268218fa2ca7343576be5819271852d18c5153f016a065735a309b075eb29c0"}
Jul 01 19:24:58.807405 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:58.807233    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66bc5d4987-8svj4" event={"ID":"0b999439-23ae-44ac-8307-9f9fa6959707","Type":"ContainerStarted","Data":"afd4cda0e730caf0b4f6640fab9e59fc8c4bfc2ee0bf989fbee1fc1954f84438"}
Jul 01 19:24:58.807405 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:58.807307    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66bc5d4987-8svj4" event={"ID":"0b999439-23ae-44ac-8307-9f9fa6959707","Type":"ContainerStarted","Data":"a1bc020c2a655181dfcfe1a0472d0868036dd8add073e58453586311b6c58e25"}
Jul 01 19:24:58.810034 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:58.810004    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74cf8bff8-p4czh" event={"ID":"0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec","Type":"ContainerStarted","Data":"4f368bf85adf42fd85dd31995781e6a30829a1de560be4cec8e4d89278f63e05"}
Jul 01 19:24:58.810154 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:58.810063    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74cf8bff8-p4czh" event={"ID":"0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec","Type":"ContainerStarted","Data":"65751546f162e3925e26bdcecb54360a1275a367820fe19fad01f0b17d87a6cf"}
Jul 01 19:24:58.813245 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:58.812452    2556 generic.go:356] "Generic (PLEG): container finished" podID="304aab4c-2394-418b-bc9d-d8169f55974c" containerID="dfd83901b577f550c78a4cec388545ec1478152ece446b1422c412957fc525ed" exitCode=0
Jul 01 19:24:58.813245 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:58.813108    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"304aab4c-2394-418b-bc9d-d8169f55974c","Type":"ContainerDied","Data":"dfd83901b577f550c78a4cec388545ec1478152ece446b1422c412957fc525ed"}
Jul 01 19:24:58.827346 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:58.825510    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5499b6fb8f-n8cvx"
Jul 01 19:24:58.837403 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:58.835866    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-74cf8bff8-p4czh" podStartSLOduration=4.788799225 podStartE2EDuration="16.835838555s" totalImagesPullingTime="12.04703933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:58.834309338 +0000 UTC m=+83.197321046" watchObservedRunningTime="2026-07-01 19:24:58.835838555 +0000 UTC m=+83.198850237"
Jul 01 19:24:59.910070 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:24:59.909950    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54767dbcbf-qb7sv"]
Jul 01 19:25:01.832079 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:01.831981    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54767dbcbf-qb7sv" event={"ID":"8ec5ad34-8736-47aa-86cb-3f7c32975f6f","Type":"ContainerStarted","Data":"021eafb35e2ab4086bac0a79f11113ab6bcd2eff8f5a487c3dd8408ab049300d"}
Jul 01 19:25:01.839546 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:01.838559    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d63797ef-d1c6-4a3b-94a5-c363b75b45ad","Type":"ContainerStarted","Data":"645b94c9fbc26c1fc808383759f46ef9d178806f52e8cb4c39f085a5b886540c"}
Jul 01 19:25:01.847570 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:01.846794    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66bc5d4987-8svj4" event={"ID":"0b999439-23ae-44ac-8307-9f9fa6959707","Type":"ContainerStarted","Data":"8fd822501fe4fcff8f4a36f25005e4f50232eac4094da040821241f8bf461bb9"}
Jul 01 19:25:01.847570 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:01.846879    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66bc5d4987-8svj4" event={"ID":"0b999439-23ae-44ac-8307-9f9fa6959707","Type":"ContainerStarted","Data":"b17c4e2476d153b9df37f1923a0a57c3dba3e82a529d269fb01386aa70617960"}
Jul 01 19:25:01.847570 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:01.846921    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66bc5d4987-8svj4" event={"ID":"0b999439-23ae-44ac-8307-9f9fa6959707","Type":"ContainerStarted","Data":"a3ffc11a085b1ccf0cfb807e2cab5f5143e779ca4bb00a7d8cc58494a0a55b00"}
Jul 01 19:25:01.847854 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:01.847765    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-66bc5d4987-8svj4"
Jul 01 19:25:01.851941 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:01.851415    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54767dbcbf-qb7sv" podStartSLOduration=13.341669971 podStartE2EDuration="18.851393647s" totalImagesPullingTime="5.509723676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:25:01.850381231 +0000 UTC m=+86.213392908" watchObservedRunningTime="2026-07-01 19:25:01.851393647 +0000 UTC m=+86.214405327"
Jul 01 19:25:01.896499 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:01.896363    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=5.514888567 podStartE2EDuration="23.896345896s" totalImagesPullingTime="18.337551251s" totalInitContainerRuntime="43.906078ms" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:25:01.895642297 +0000 UTC m=+86.258653980" watchObservedRunningTime="2026-07-01 19:25:01.896345896 +0000 UTC m=+86.259357788"
Jul 01 19:25:01.942049 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:01.941965    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-66bc5d4987-8svj4" podStartSLOduration=2.511384926 podStartE2EDuration="21.9419401s" totalImagesPullingTime="19.430555174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:25:01.941391008 +0000 UTC m=+86.304402693" watchObservedRunningTime="2026-07-01 19:25:01.9419401 +0000 UTC m=+86.304951782"
Jul 01 19:25:02.637080 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:02.637040    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7d9bb75989-6q6jc"
Jul 01 19:25:02.637302 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:02.637157    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7d9bb75989-6q6jc"
Jul 01 19:25:02.863395 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:02.863343    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-66bc5d4987-8svj4"
Jul 01 19:25:03.188329 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:03.188297    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pb62t_f36ac906-7798-4117-8994-bed05d4b1a36/serve-healthcheck-canary/0.log"
Jul 01 19:25:03.499610 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:03.499474    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54767dbcbf-qb7sv"
Jul 01 19:25:05.875079 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:05.874989    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"304aab4c-2394-418b-bc9d-d8169f55974c","Type":"ContainerStarted","Data":"9f61f9411337b4162c325477f0d95211d2396174e0864f7e808732411646a9eb"}
Jul 01 19:25:05.875079 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:05.875067    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"304aab4c-2394-418b-bc9d-d8169f55974c","Type":"ContainerStarted","Data":"b7a22502c35486746ee665eea6a77e39fa93a45fb3b0277e4d95c7a7ae3877ed"}
Jul 01 19:25:05.875630 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:05.875108    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"304aab4c-2394-418b-bc9d-d8169f55974c","Type":"ContainerStarted","Data":"df7e0dd4daeaf811caa5e2700520c8b94b57fc3df5e1689c16e19321de79747e"}
Jul 01 19:25:05.875630 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:05.875530    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"304aab4c-2394-418b-bc9d-d8169f55974c","Type":"ContainerStarted","Data":"21298a119f542c3c88c925946240f2781889eb9606e880921a68dfb3b1139004"}
Jul 01 19:25:05.875736 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:05.875668    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"304aab4c-2394-418b-bc9d-d8169f55974c","Type":"ContainerStarted","Data":"4c346b0a8d9323f5fe3504097cb5db02c1908284f9b422be9dd1d6ce5ddc1b39"}
Jul 01 19:25:05.875808 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:05.875789    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"304aab4c-2394-418b-bc9d-d8169f55974c","Type":"ContainerStarted","Data":"4ef2f029f3e8de66ec3615a04d8eb69f0496eea09031858e2abf5c8653d77c36"}
Jul 01 19:25:05.912565 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:05.912503    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=16.784418037000002 podStartE2EDuration="22.912483257s" totalImagesPullingTime="6.091554177s" totalInitContainerRuntime="36.511043ms" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:25:05.909634481 +0000 UTC m=+90.272646163" watchObservedRunningTime="2026-07-01 19:25:05.912483257 +0000 UTC m=+90.275494939"
Jul 01 19:25:09.333525 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:09.333480    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:25:22.642614 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:22.642580    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7d9bb75989-6q6jc"
Jul 01 19:25:22.646477 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:22.646453    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7d9bb75989-6q6jc"
Jul 01 19:25:26.865695 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:26.865629    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-54767dbcbf-qb7sv" podUID="8ec5ad34-8736-47aa-86cb-3f7c32975f6f" containerName="console" containerID="cri-o://021eafb35e2ab4086bac0a79f11113ab6bcd2eff8f5a487c3dd8408ab049300d" gracePeriod=15
Jul 01 19:25:27.136738 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:27.136703    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54767dbcbf-qb7sv"
Jul 01 19:25:27.246977 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:27.246940    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ec5ad34-8736-47aa-86cb-3f7c32975f6f-console-serving-cert\") pod \"8ec5ad34-8736-47aa-86cb-3f7c32975f6f\" (UID: \"8ec5ad34-8736-47aa-86cb-3f7c32975f6f\") "
Jul 01 19:25:27.246977 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:27.246989    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fzh2d\" (UniqueName: \"kubernetes.io/projected/8ec5ad34-8736-47aa-86cb-3f7c32975f6f-kube-api-access-fzh2d\") pod \"8ec5ad34-8736-47aa-86cb-3f7c32975f6f\" (UID: \"8ec5ad34-8736-47aa-86cb-3f7c32975f6f\") "
Jul 01 19:25:27.247195 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:27.247021    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ec5ad34-8736-47aa-86cb-3f7c32975f6f-oauth-serving-cert\") pod \"8ec5ad34-8736-47aa-86cb-3f7c32975f6f\" (UID: \"8ec5ad34-8736-47aa-86cb-3f7c32975f6f\") "
Jul 01 19:25:27.247195 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:27.247042    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ec5ad34-8736-47aa-86cb-3f7c32975f6f-console-oauth-config\") pod \"8ec5ad34-8736-47aa-86cb-3f7c32975f6f\" (UID: \"8ec5ad34-8736-47aa-86cb-3f7c32975f6f\") "
Jul 01 19:25:27.247195 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:27.247122    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ec5ad34-8736-47aa-86cb-3f7c32975f6f-service-ca\") pod \"8ec5ad34-8736-47aa-86cb-3f7c32975f6f\" (UID: \"8ec5ad34-8736-47aa-86cb-3f7c32975f6f\") "
Jul 01 19:25:27.247195 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:27.247140    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ec5ad34-8736-47aa-86cb-3f7c32975f6f-console-config\") pod \"8ec5ad34-8736-47aa-86cb-3f7c32975f6f\" (UID: \"8ec5ad34-8736-47aa-86cb-3f7c32975f6f\") "
Jul 01 19:25:27.247548 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:27.247510    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ec5ad34-8736-47aa-86cb-3f7c32975f6f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8ec5ad34-8736-47aa-86cb-3f7c32975f6f" (UID: "8ec5ad34-8736-47aa-86cb-3f7c32975f6f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 19:25:27.247681 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:27.247555    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ec5ad34-8736-47aa-86cb-3f7c32975f6f-console-config" (OuterVolumeSpecName: "console-config") pod "8ec5ad34-8736-47aa-86cb-3f7c32975f6f" (UID: "8ec5ad34-8736-47aa-86cb-3f7c32975f6f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 19:25:27.247681 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:27.247560    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ec5ad34-8736-47aa-86cb-3f7c32975f6f-service-ca" (OuterVolumeSpecName: "service-ca") pod "8ec5ad34-8736-47aa-86cb-3f7c32975f6f" (UID: "8ec5ad34-8736-47aa-86cb-3f7c32975f6f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 19:25:27.249452 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:27.249422    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ec5ad34-8736-47aa-86cb-3f7c32975f6f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8ec5ad34-8736-47aa-86cb-3f7c32975f6f" (UID: "8ec5ad34-8736-47aa-86cb-3f7c32975f6f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 19:25:27.249549 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:27.249477    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ec5ad34-8736-47aa-86cb-3f7c32975f6f-kube-api-access-fzh2d" (OuterVolumeSpecName: "kube-api-access-fzh2d") pod "8ec5ad34-8736-47aa-86cb-3f7c32975f6f" (UID: "8ec5ad34-8736-47aa-86cb-3f7c32975f6f"). InnerVolumeSpecName "kube-api-access-fzh2d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 19:25:27.249549 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:27.249509    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ec5ad34-8736-47aa-86cb-3f7c32975f6f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8ec5ad34-8736-47aa-86cb-3f7c32975f6f" (UID: "8ec5ad34-8736-47aa-86cb-3f7c32975f6f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 19:25:27.347900 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:27.347864    2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ec5ad34-8736-47aa-86cb-3f7c32975f6f-service-ca\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:25:27.347900 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:27.347894    2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ec5ad34-8736-47aa-86cb-3f7c32975f6f-console-config\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:25:27.347900 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:27.347904    2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ec5ad34-8736-47aa-86cb-3f7c32975f6f-console-serving-cert\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:25:27.347900 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:27.347914    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fzh2d\" (UniqueName: \"kubernetes.io/projected/8ec5ad34-8736-47aa-86cb-3f7c32975f6f-kube-api-access-fzh2d\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:25:27.348168 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:27.347922    2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ec5ad34-8736-47aa-86cb-3f7c32975f6f-oauth-serving-cert\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:25:27.348168 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:27.347932    2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ec5ad34-8736-47aa-86cb-3f7c32975f6f-console-oauth-config\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:25:27.978775 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:27.978741    2556 generic.go:356] "Generic (PLEG): container finished" podID="8ec5ad34-8736-47aa-86cb-3f7c32975f6f" containerID="021eafb35e2ab4086bac0a79f11113ab6bcd2eff8f5a487c3dd8408ab049300d" exitCode=0
Jul 01 19:25:27.979261 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:27.978785    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54767dbcbf-qb7sv"
Jul 01 19:25:27.979261 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:27.978828    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54767dbcbf-qb7sv" event={"ID":"8ec5ad34-8736-47aa-86cb-3f7c32975f6f","Type":"ContainerDied","Data":"021eafb35e2ab4086bac0a79f11113ab6bcd2eff8f5a487c3dd8408ab049300d"}
Jul 01 19:25:27.979261 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:27.978886    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54767dbcbf-qb7sv" event={"ID":"8ec5ad34-8736-47aa-86cb-3f7c32975f6f","Type":"ContainerDied","Data":"80759d79af92c5033f66b1bd03e9746cb558119e71a31640e376459ef3c57fda"}
Jul 01 19:25:27.979261 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:27.978934    2556 scope.go:117] "RemoveContainer" containerID="021eafb35e2ab4086bac0a79f11113ab6bcd2eff8f5a487c3dd8408ab049300d"
Jul 01 19:25:27.987588 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:27.987571    2556 scope.go:117] "RemoveContainer" containerID="021eafb35e2ab4086bac0a79f11113ab6bcd2eff8f5a487c3dd8408ab049300d"
Jul 01 19:25:27.987831 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:25:27.987812    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"021eafb35e2ab4086bac0a79f11113ab6bcd2eff8f5a487c3dd8408ab049300d\": container with ID starting with 021eafb35e2ab4086bac0a79f11113ab6bcd2eff8f5a487c3dd8408ab049300d not found: ID does not exist" containerID="021eafb35e2ab4086bac0a79f11113ab6bcd2eff8f5a487c3dd8408ab049300d"
Jul 01 19:25:27.987909 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:27.987839    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"021eafb35e2ab4086bac0a79f11113ab6bcd2eff8f5a487c3dd8408ab049300d"} err="failed to get container status \"021eafb35e2ab4086bac0a79f11113ab6bcd2eff8f5a487c3dd8408ab049300d\": rpc error: code = NotFound desc = could not find container \"021eafb35e2ab4086bac0a79f11113ab6bcd2eff8f5a487c3dd8408ab049300d\": container with ID starting with 021eafb35e2ab4086bac0a79f11113ab6bcd2eff8f5a487c3dd8408ab049300d not found: ID does not exist"
Jul 01 19:25:27.999148 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:27.999127    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54767dbcbf-qb7sv"]
Jul 01 19:25:28.001636 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:28.001614    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54767dbcbf-qb7sv"]
Jul 01 19:25:28.255052 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:28.254972    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ec5ad34-8736-47aa-86cb-3f7c32975f6f" path="/var/lib/kubelet/pods/8ec5ad34-8736-47aa-86cb-3f7c32975f6f/volumes"
Jul 01 19:25:28.815598 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:28.815565    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-g7lwk"
Jul 01 19:25:44.333206 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:44.333164    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:25:44.392144 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:44.392113    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:25:45.067301 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:45.067275    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:25:58.074630 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:58.074597    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 01 19:25:58.075051 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:58.074888    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d63797ef-d1c6-4a3b-94a5-c363b75b45ad" containerName="alertmanager" containerID="cri-o://ba7ddcd6097f881b8eac2c424ce3752d6bd91e14008848ed8bd7ac73e5dda1c0" gracePeriod=120
Jul 01 19:25:58.075051 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:58.074917    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d63797ef-d1c6-4a3b-94a5-c363b75b45ad" containerName="kube-rbac-proxy-metric" containerID="cri-o://9c9af7b02af1c19ed953eb2f89ac461e91f4c1756d143c55a33a0ede0b3fcfd5" gracePeriod=120
Jul 01 19:25:58.075051 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:58.074916    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d63797ef-d1c6-4a3b-94a5-c363b75b45ad" containerName="kube-rbac-proxy-web" containerID="cri-o://29dffcaee26c36e23c5f0548a7852c17301ef5087d86a32daa876cc2fdca636c" gracePeriod=120
Jul 01 19:25:58.075051 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:58.074965    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d63797ef-d1c6-4a3b-94a5-c363b75b45ad" containerName="kube-rbac-proxy" containerID="cri-o://27482d2d5011f8e099ac4e0dbba5cd2552e7d527bca74ead577e13fc74905384" gracePeriod=120
Jul 01 19:25:58.075051 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:58.074980    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d63797ef-d1c6-4a3b-94a5-c363b75b45ad" containerName="config-reloader" containerID="cri-o://f268218fa2ca7343576be5819271852d18c5153f016a065735a309b075eb29c0" gracePeriod=120
Jul 01 19:25:58.075051 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:58.074999    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d63797ef-d1c6-4a3b-94a5-c363b75b45ad" containerName="prom-label-proxy" containerID="cri-o://645b94c9fbc26c1fc808383759f46ef9d178806f52e8cb4c39f085a5b886540c" gracePeriod=120
Jul 01 19:25:59.107811 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.107776    2556 generic.go:356] "Generic (PLEG): container finished" podID="d63797ef-d1c6-4a3b-94a5-c363b75b45ad" containerID="645b94c9fbc26c1fc808383759f46ef9d178806f52e8cb4c39f085a5b886540c" exitCode=0
Jul 01 19:25:59.107811 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.107804    2556 generic.go:356] "Generic (PLEG): container finished" podID="d63797ef-d1c6-4a3b-94a5-c363b75b45ad" containerID="27482d2d5011f8e099ac4e0dbba5cd2552e7d527bca74ead577e13fc74905384" exitCode=0
Jul 01 19:25:59.107811 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.107810    2556 generic.go:356] "Generic (PLEG): container finished" podID="d63797ef-d1c6-4a3b-94a5-c363b75b45ad" containerID="f268218fa2ca7343576be5819271852d18c5153f016a065735a309b075eb29c0" exitCode=0
Jul 01 19:25:59.107811 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.107815    2556 generic.go:356] "Generic (PLEG): container finished" podID="d63797ef-d1c6-4a3b-94a5-c363b75b45ad" containerID="ba7ddcd6097f881b8eac2c424ce3752d6bd91e14008848ed8bd7ac73e5dda1c0" exitCode=0
Jul 01 19:25:59.108288 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.107847    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d63797ef-d1c6-4a3b-94a5-c363b75b45ad","Type":"ContainerDied","Data":"645b94c9fbc26c1fc808383759f46ef9d178806f52e8cb4c39f085a5b886540c"}
Jul 01 19:25:59.108288 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.107912    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d63797ef-d1c6-4a3b-94a5-c363b75b45ad","Type":"ContainerDied","Data":"27482d2d5011f8e099ac4e0dbba5cd2552e7d527bca74ead577e13fc74905384"}
Jul 01 19:25:59.108288 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.107941    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d63797ef-d1c6-4a3b-94a5-c363b75b45ad","Type":"ContainerDied","Data":"f268218fa2ca7343576be5819271852d18c5153f016a065735a309b075eb29c0"}
Jul 01 19:25:59.108288 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.107966    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d63797ef-d1c6-4a3b-94a5-c363b75b45ad","Type":"ContainerDied","Data":"ba7ddcd6097f881b8eac2c424ce3752d6bd91e14008848ed8bd7ac73e5dda1c0"}
Jul 01 19:25:59.416088 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.416065    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:25:59.434405 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.434380    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-config-volume\") pod \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") "
Jul 01 19:25:59.434552 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.434422    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-cluster-tls-config\") pod \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") "
Jul 01 19:25:59.434552 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.434447    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-secret-alertmanager-kube-rbac-proxy\") pod \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") "
Jul 01 19:25:59.434552 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.434467    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-config-out\") pod \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") "
Jul 01 19:25:59.434552 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.434495    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-web-config\") pod \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") "
Jul 01 19:25:59.434552 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.434526    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-alertmanager-trusted-ca-bundle\") pod \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") "
Jul 01 19:25:59.434806 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.434555    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-secret-alertmanager-main-tls\") pod \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") "
Jul 01 19:25:59.434806 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.434613    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-tls-assets\") pod \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") "
Jul 01 19:25:59.434806 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.434650    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sz28d\" (UniqueName: \"kubernetes.io/projected/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-kube-api-access-sz28d\") pod \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") "
Jul 01 19:25:59.434806 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.434677    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-alertmanager-main-db\") pod \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") "
Jul 01 19:25:59.434806 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.434708    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-secret-alertmanager-kube-rbac-proxy-metric\") pod \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") "
Jul 01 19:25:59.434806 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.434742    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-metrics-client-ca\") pod \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") "
Jul 01 19:25:59.434806 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.434774    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-secret-alertmanager-kube-rbac-proxy-web\") pod \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\" (UID: \"d63797ef-d1c6-4a3b-94a5-c363b75b45ad\") "
Jul 01 19:25:59.435812 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.435333    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "d63797ef-d1c6-4a3b-94a5-c363b75b45ad" (UID: "d63797ef-d1c6-4a3b-94a5-c363b75b45ad"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 19:25:59.435812 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.435778    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "d63797ef-d1c6-4a3b-94a5-c363b75b45ad" (UID: "d63797ef-d1c6-4a3b-94a5-c363b75b45ad"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 19:25:59.436091 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.436051    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "d63797ef-d1c6-4a3b-94a5-c363b75b45ad" (UID: "d63797ef-d1c6-4a3b-94a5-c363b75b45ad"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 19:25:59.437738 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.437698    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-config-volume" (OuterVolumeSpecName: "config-volume") pod "d63797ef-d1c6-4a3b-94a5-c363b75b45ad" (UID: "d63797ef-d1c6-4a3b-94a5-c363b75b45ad"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 19:25:59.438294 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.438256    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "d63797ef-d1c6-4a3b-94a5-c363b75b45ad" (UID: "d63797ef-d1c6-4a3b-94a5-c363b75b45ad"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 19:25:59.438294 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.438266    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-config-out" (OuterVolumeSpecName: "config-out") pod "d63797ef-d1c6-4a3b-94a5-c363b75b45ad" (UID: "d63797ef-d1c6-4a3b-94a5-c363b75b45ad"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 19:25:59.438479 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.438335    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-kube-api-access-sz28d" (OuterVolumeSpecName: "kube-api-access-sz28d") pod "d63797ef-d1c6-4a3b-94a5-c363b75b45ad" (UID: "d63797ef-d1c6-4a3b-94a5-c363b75b45ad"). InnerVolumeSpecName "kube-api-access-sz28d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 19:25:59.438539 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.438519    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "d63797ef-d1c6-4a3b-94a5-c363b75b45ad" (UID: "d63797ef-d1c6-4a3b-94a5-c363b75b45ad"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 19:25:59.438707 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.438672    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "d63797ef-d1c6-4a3b-94a5-c363b75b45ad" (UID: "d63797ef-d1c6-4a3b-94a5-c363b75b45ad"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 19:25:59.438821 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.438760    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "d63797ef-d1c6-4a3b-94a5-c363b75b45ad" (UID: "d63797ef-d1c6-4a3b-94a5-c363b75b45ad"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 19:25:59.439007 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.438988    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d63797ef-d1c6-4a3b-94a5-c363b75b45ad" (UID: "d63797ef-d1c6-4a3b-94a5-c363b75b45ad"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 19:25:59.442430 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.442272    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "d63797ef-d1c6-4a3b-94a5-c363b75b45ad" (UID: "d63797ef-d1c6-4a3b-94a5-c363b75b45ad"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 19:25:59.450557 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.450529    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-web-config" (OuterVolumeSpecName: "web-config") pod "d63797ef-d1c6-4a3b-94a5-c363b75b45ad" (UID: "d63797ef-d1c6-4a3b-94a5-c363b75b45ad"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 19:25:59.536216 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.536178    2556 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-config-out\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:25:59.536216 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.536209    2556 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-web-config\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:25:59.536216 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.536219    2556 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:25:59.536471 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.536229    2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-secret-alertmanager-main-tls\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:25:59.536471 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.536239    2556 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-tls-assets\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:25:59.536471 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.536247    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sz28d\" (UniqueName: \"kubernetes.io/projected/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-kube-api-access-sz28d\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:25:59.536471 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.536256    2556 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-alertmanager-main-db\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:25:59.536471 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.536266    2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:25:59.536471 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.536276    2556 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-metrics-client-ca\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:25:59.536471 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.536286    2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:25:59.536471 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.536295    2556 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-config-volume\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:25:59.536471 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.536302    2556 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-cluster-tls-config\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:25:59.536471 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:25:59.536310    2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d63797ef-d1c6-4a3b-94a5-c363b75b45ad-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:26:00.114309 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.114278    2556 generic.go:356] "Generic (PLEG): container finished" podID="d63797ef-d1c6-4a3b-94a5-c363b75b45ad" containerID="9c9af7b02af1c19ed953eb2f89ac461e91f4c1756d143c55a33a0ede0b3fcfd5" exitCode=0
Jul 01 19:26:00.114309 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.114304    2556 generic.go:356] "Generic (PLEG): container finished" podID="d63797ef-d1c6-4a3b-94a5-c363b75b45ad" containerID="29dffcaee26c36e23c5f0548a7852c17301ef5087d86a32daa876cc2fdca636c" exitCode=0
Jul 01 19:26:00.114777 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.114335    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d63797ef-d1c6-4a3b-94a5-c363b75b45ad","Type":"ContainerDied","Data":"9c9af7b02af1c19ed953eb2f89ac461e91f4c1756d143c55a33a0ede0b3fcfd5"}
Jul 01 19:26:00.114777 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.114359    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:26:00.114777 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.114440    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d63797ef-d1c6-4a3b-94a5-c363b75b45ad","Type":"ContainerDied","Data":"29dffcaee26c36e23c5f0548a7852c17301ef5087d86a32daa876cc2fdca636c"}
Jul 01 19:26:00.114777 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.114481    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d63797ef-d1c6-4a3b-94a5-c363b75b45ad","Type":"ContainerDied","Data":"842c0b6d5d8a9e1fef31c354d50a3a72fd01ebfb77c9092078b7e2f258b79f67"}
Jul 01 19:26:00.114777 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.114506    2556 scope.go:117] "RemoveContainer" containerID="645b94c9fbc26c1fc808383759f46ef9d178806f52e8cb4c39f085a5b886540c"
Jul 01 19:26:00.125251 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.125224    2556 scope.go:117] "RemoveContainer" containerID="9c9af7b02af1c19ed953eb2f89ac461e91f4c1756d143c55a33a0ede0b3fcfd5"
Jul 01 19:26:00.132843 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.132826    2556 scope.go:117] "RemoveContainer" containerID="27482d2d5011f8e099ac4e0dbba5cd2552e7d527bca74ead577e13fc74905384"
Jul 01 19:26:00.139421 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.139402    2556 scope.go:117] "RemoveContainer" containerID="29dffcaee26c36e23c5f0548a7852c17301ef5087d86a32daa876cc2fdca636c"
Jul 01 19:26:00.143918 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.143480    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 01 19:26:00.150646 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.150624    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 01 19:26:00.151872 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.151850    2556 scope.go:117] "RemoveContainer" containerID="f268218fa2ca7343576be5819271852d18c5153f016a065735a309b075eb29c0"
Jul 01 19:26:00.158995 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.158977    2556 scope.go:117] "RemoveContainer" containerID="ba7ddcd6097f881b8eac2c424ce3752d6bd91e14008848ed8bd7ac73e5dda1c0"
Jul 01 19:26:00.168968 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.168944    2556 scope.go:117] "RemoveContainer" containerID="85fe595eca6f2bd45f729a40b72f7395d0f291493cb0b58a5cafa6270823abbd"
Jul 01 19:26:00.173137 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.173111    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 01 19:26:00.173743 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.173483    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d63797ef-d1c6-4a3b-94a5-c363b75b45ad" containerName="init-config-reloader"
Jul 01 19:26:00.173743 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.173500    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d63797ef-d1c6-4a3b-94a5-c363b75b45ad" containerName="init-config-reloader"
Jul 01 19:26:00.173743 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.173528    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d63797ef-d1c6-4a3b-94a5-c363b75b45ad" containerName="config-reloader"
Jul 01 19:26:00.173743 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.173537    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d63797ef-d1c6-4a3b-94a5-c363b75b45ad" containerName="config-reloader"
Jul 01 19:26:00.173743 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.173553    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d63797ef-d1c6-4a3b-94a5-c363b75b45ad" containerName="kube-rbac-proxy-web"
Jul 01 19:26:00.173743 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.173561    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d63797ef-d1c6-4a3b-94a5-c363b75b45ad" containerName="kube-rbac-proxy-web"
Jul 01 19:26:00.173743 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.173582    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ec5ad34-8736-47aa-86cb-3f7c32975f6f" containerName="console"
Jul 01 19:26:00.173743 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.173590    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ec5ad34-8736-47aa-86cb-3f7c32975f6f" containerName="console"
Jul 01 19:26:00.173743 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.173603    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d63797ef-d1c6-4a3b-94a5-c363b75b45ad" containerName="alertmanager"
Jul 01 19:26:00.173743 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.173611    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d63797ef-d1c6-4a3b-94a5-c363b75b45ad" containerName="alertmanager"
Jul 01 19:26:00.173743 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.173636    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d63797ef-d1c6-4a3b-94a5-c363b75b45ad" containerName="kube-rbac-proxy"
Jul 01 19:26:00.173743 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.173644    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d63797ef-d1c6-4a3b-94a5-c363b75b45ad" containerName="kube-rbac-proxy"
Jul 01 19:26:00.173743 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.173655    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d63797ef-d1c6-4a3b-94a5-c363b75b45ad" containerName="kube-rbac-proxy-metric"
Jul 01 19:26:00.173743 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.173663    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d63797ef-d1c6-4a3b-94a5-c363b75b45ad" containerName="kube-rbac-proxy-metric"
Jul 01 19:26:00.173743 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.173677    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d63797ef-d1c6-4a3b-94a5-c363b75b45ad" containerName="prom-label-proxy"
Jul 01 19:26:00.173743 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.173683    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d63797ef-d1c6-4a3b-94a5-c363b75b45ad" containerName="prom-label-proxy"
Jul 01 19:26:00.174315 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.173757    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ec5ad34-8736-47aa-86cb-3f7c32975f6f" containerName="console"
Jul 01 19:26:00.174315 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.173767    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d63797ef-d1c6-4a3b-94a5-c363b75b45ad" containerName="kube-rbac-proxy-web"
Jul 01 19:26:00.174315 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.173774    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d63797ef-d1c6-4a3b-94a5-c363b75b45ad" containerName="alertmanager"
Jul 01 19:26:00.174315 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.173782    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d63797ef-d1c6-4a3b-94a5-c363b75b45ad" containerName="kube-rbac-proxy-metric"
Jul 01 19:26:00.174315 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.173790    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d63797ef-d1c6-4a3b-94a5-c363b75b45ad" containerName="config-reloader"
Jul 01 19:26:00.174315 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.173800    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d63797ef-d1c6-4a3b-94a5-c363b75b45ad" containerName="kube-rbac-proxy"
Jul 01 19:26:00.174315 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.173807    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d63797ef-d1c6-4a3b-94a5-c363b75b45ad" containerName="prom-label-proxy"
Jul 01 19:26:00.179190 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.179171    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:26:00.181769 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.181739    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-675vj\""
Jul 01 19:26:00.181859 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.181771    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 01 19:26:00.182109 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.182074    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 01 19:26:00.182109 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.182095    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 01 19:26:00.182284 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.182158    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 01 19:26:00.182284 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.182095    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 01 19:26:00.182284 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.182208    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 01 19:26:00.182973 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.182790    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 01 19:26:00.182973 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.182883    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 01 19:26:00.183439 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.183421    2556 scope.go:117] "RemoveContainer" containerID="645b94c9fbc26c1fc808383759f46ef9d178806f52e8cb4c39f085a5b886540c"
Jul 01 19:26:00.183826 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:26:00.183797    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"645b94c9fbc26c1fc808383759f46ef9d178806f52e8cb4c39f085a5b886540c\": container with ID starting with 645b94c9fbc26c1fc808383759f46ef9d178806f52e8cb4c39f085a5b886540c not found: ID does not exist" containerID="645b94c9fbc26c1fc808383759f46ef9d178806f52e8cb4c39f085a5b886540c"
Jul 01 19:26:00.183916 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.183836    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"645b94c9fbc26c1fc808383759f46ef9d178806f52e8cb4c39f085a5b886540c"} err="failed to get container status \"645b94c9fbc26c1fc808383759f46ef9d178806f52e8cb4c39f085a5b886540c\": rpc error: code = NotFound desc = could not find container \"645b94c9fbc26c1fc808383759f46ef9d178806f52e8cb4c39f085a5b886540c\": container with ID starting with 645b94c9fbc26c1fc808383759f46ef9d178806f52e8cb4c39f085a5b886540c not found: ID does not exist"
Jul 01 19:26:00.183916 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.183860    2556 scope.go:117] "RemoveContainer" containerID="9c9af7b02af1c19ed953eb2f89ac461e91f4c1756d143c55a33a0ede0b3fcfd5"
Jul 01 19:26:00.184160 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:26:00.184138    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c9af7b02af1c19ed953eb2f89ac461e91f4c1756d143c55a33a0ede0b3fcfd5\": container with ID starting with 9c9af7b02af1c19ed953eb2f89ac461e91f4c1756d143c55a33a0ede0b3fcfd5 not found: ID does not exist" containerID="9c9af7b02af1c19ed953eb2f89ac461e91f4c1756d143c55a33a0ede0b3fcfd5"
Jul 01 19:26:00.184268 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.184169    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c9af7b02af1c19ed953eb2f89ac461e91f4c1756d143c55a33a0ede0b3fcfd5"} err="failed to get container status \"9c9af7b02af1c19ed953eb2f89ac461e91f4c1756d143c55a33a0ede0b3fcfd5\": rpc error: code = NotFound desc = could not find container \"9c9af7b02af1c19ed953eb2f89ac461e91f4c1756d143c55a33a0ede0b3fcfd5\": container with ID starting with 9c9af7b02af1c19ed953eb2f89ac461e91f4c1756d143c55a33a0ede0b3fcfd5 not found: ID does not exist"
Jul 01 19:26:00.184268 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.184195    2556 scope.go:117] "RemoveContainer" containerID="27482d2d5011f8e099ac4e0dbba5cd2552e7d527bca74ead577e13fc74905384"
Jul 01 19:26:00.184585 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:26:00.184549    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27482d2d5011f8e099ac4e0dbba5cd2552e7d527bca74ead577e13fc74905384\": container with ID starting with 27482d2d5011f8e099ac4e0dbba5cd2552e7d527bca74ead577e13fc74905384 not found: ID does not exist" containerID="27482d2d5011f8e099ac4e0dbba5cd2552e7d527bca74ead577e13fc74905384"
Jul 01 19:26:00.184680 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.184579    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27482d2d5011f8e099ac4e0dbba5cd2552e7d527bca74ead577e13fc74905384"} err="failed to get container status \"27482d2d5011f8e099ac4e0dbba5cd2552e7d527bca74ead577e13fc74905384\": rpc error: code = NotFound desc = could not find container \"27482d2d5011f8e099ac4e0dbba5cd2552e7d527bca74ead577e13fc74905384\": container with ID starting with 27482d2d5011f8e099ac4e0dbba5cd2552e7d527bca74ead577e13fc74905384 not found: ID does not exist"
Jul 01 19:26:00.184680 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.184601    2556 scope.go:117] "RemoveContainer" containerID="29dffcaee26c36e23c5f0548a7852c17301ef5087d86a32daa876cc2fdca636c"
Jul 01 19:26:00.184939 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:26:00.184918    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29dffcaee26c36e23c5f0548a7852c17301ef5087d86a32daa876cc2fdca636c\": container with ID starting with 29dffcaee26c36e23c5f0548a7852c17301ef5087d86a32daa876cc2fdca636c not found: ID does not exist" containerID="29dffcaee26c36e23c5f0548a7852c17301ef5087d86a32daa876cc2fdca636c"
Jul 01 19:26:00.185024 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.184945    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29dffcaee26c36e23c5f0548a7852c17301ef5087d86a32daa876cc2fdca636c"} err="failed to get container status \"29dffcaee26c36e23c5f0548a7852c17301ef5087d86a32daa876cc2fdca636c\": rpc error: code = NotFound desc = could not find container \"29dffcaee26c36e23c5f0548a7852c17301ef5087d86a32daa876cc2fdca636c\": container with ID starting with 29dffcaee26c36e23c5f0548a7852c17301ef5087d86a32daa876cc2fdca636c not found: ID does not exist"
Jul 01 19:26:00.185024 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.184966    2556 scope.go:117] "RemoveContainer" containerID="f268218fa2ca7343576be5819271852d18c5153f016a065735a309b075eb29c0"
Jul 01 19:26:00.185236 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:26:00.185216    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f268218fa2ca7343576be5819271852d18c5153f016a065735a309b075eb29c0\": container with ID starting with f268218fa2ca7343576be5819271852d18c5153f016a065735a309b075eb29c0 not found: ID does not exist" containerID="f268218fa2ca7343576be5819271852d18c5153f016a065735a309b075eb29c0"
Jul 01 19:26:00.185292 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.185244    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f268218fa2ca7343576be5819271852d18c5153f016a065735a309b075eb29c0"} err="failed to get container status \"f268218fa2ca7343576be5819271852d18c5153f016a065735a309b075eb29c0\": rpc error: code = NotFound desc = could not find container \"f268218fa2ca7343576be5819271852d18c5153f016a065735a309b075eb29c0\": container with ID starting with f268218fa2ca7343576be5819271852d18c5153f016a065735a309b075eb29c0 not found: ID does not exist"
Jul 01 19:26:00.185292 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.185267    2556 scope.go:117] "RemoveContainer" containerID="ba7ddcd6097f881b8eac2c424ce3752d6bd91e14008848ed8bd7ac73e5dda1c0"
Jul 01 19:26:00.185576 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:26:00.185555    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba7ddcd6097f881b8eac2c424ce3752d6bd91e14008848ed8bd7ac73e5dda1c0\": container with ID starting with ba7ddcd6097f881b8eac2c424ce3752d6bd91e14008848ed8bd7ac73e5dda1c0 not found: ID does not exist" containerID="ba7ddcd6097f881b8eac2c424ce3752d6bd91e14008848ed8bd7ac73e5dda1c0"
Jul 01 19:26:00.185676 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.185579    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba7ddcd6097f881b8eac2c424ce3752d6bd91e14008848ed8bd7ac73e5dda1c0"} err="failed to get container status \"ba7ddcd6097f881b8eac2c424ce3752d6bd91e14008848ed8bd7ac73e5dda1c0\": rpc error: code = NotFound desc = could not find container \"ba7ddcd6097f881b8eac2c424ce3752d6bd91e14008848ed8bd7ac73e5dda1c0\": container with ID starting with ba7ddcd6097f881b8eac2c424ce3752d6bd91e14008848ed8bd7ac73e5dda1c0 not found: ID does not exist"
Jul 01 19:26:00.185676 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.185595    2556 scope.go:117] "RemoveContainer" containerID="85fe595eca6f2bd45f729a40b72f7395d0f291493cb0b58a5cafa6270823abbd"
Jul 01 19:26:00.185916 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:26:00.185853    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85fe595eca6f2bd45f729a40b72f7395d0f291493cb0b58a5cafa6270823abbd\": container with ID starting with 85fe595eca6f2bd45f729a40b72f7395d0f291493cb0b58a5cafa6270823abbd not found: ID does not exist" containerID="85fe595eca6f2bd45f729a40b72f7395d0f291493cb0b58a5cafa6270823abbd"
Jul 01 19:26:00.185916 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.185883    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85fe595eca6f2bd45f729a40b72f7395d0f291493cb0b58a5cafa6270823abbd"} err="failed to get container status \"85fe595eca6f2bd45f729a40b72f7395d0f291493cb0b58a5cafa6270823abbd\": rpc error: code = NotFound desc = could not find container \"85fe595eca6f2bd45f729a40b72f7395d0f291493cb0b58a5cafa6270823abbd\": container with ID starting with 85fe595eca6f2bd45f729a40b72f7395d0f291493cb0b58a5cafa6270823abbd not found: ID does not exist"
Jul 01 19:26:00.185916 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.185903    2556 scope.go:117] "RemoveContainer" containerID="645b94c9fbc26c1fc808383759f46ef9d178806f52e8cb4c39f085a5b886540c"
Jul 01 19:26:00.186236 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.186209    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"645b94c9fbc26c1fc808383759f46ef9d178806f52e8cb4c39f085a5b886540c"} err="failed to get container status \"645b94c9fbc26c1fc808383759f46ef9d178806f52e8cb4c39f085a5b886540c\": rpc error: code = NotFound desc = could not find container \"645b94c9fbc26c1fc808383759f46ef9d178806f52e8cb4c39f085a5b886540c\": container with ID starting with 645b94c9fbc26c1fc808383759f46ef9d178806f52e8cb4c39f085a5b886540c not found: ID does not exist"
Jul 01 19:26:00.186327 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.186235    2556 scope.go:117] "RemoveContainer" containerID="9c9af7b02af1c19ed953eb2f89ac461e91f4c1756d143c55a33a0ede0b3fcfd5"
Jul 01 19:26:00.186724 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.186696    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c9af7b02af1c19ed953eb2f89ac461e91f4c1756d143c55a33a0ede0b3fcfd5"} err="failed to get container status \"9c9af7b02af1c19ed953eb2f89ac461e91f4c1756d143c55a33a0ede0b3fcfd5\": rpc error: code = NotFound desc = could not find container \"9c9af7b02af1c19ed953eb2f89ac461e91f4c1756d143c55a33a0ede0b3fcfd5\": container with ID starting with 9c9af7b02af1c19ed953eb2f89ac461e91f4c1756d143c55a33a0ede0b3fcfd5 not found: ID does not exist"
Jul 01 19:26:00.186724 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.186723    2556 scope.go:117] "RemoveContainer" containerID="27482d2d5011f8e099ac4e0dbba5cd2552e7d527bca74ead577e13fc74905384"
Jul 01 19:26:00.186978 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.186950    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27482d2d5011f8e099ac4e0dbba5cd2552e7d527bca74ead577e13fc74905384"} err="failed to get container status \"27482d2d5011f8e099ac4e0dbba5cd2552e7d527bca74ead577e13fc74905384\": rpc error: code = NotFound desc = could not find container \"27482d2d5011f8e099ac4e0dbba5cd2552e7d527bca74ead577e13fc74905384\": container with ID starting with 27482d2d5011f8e099ac4e0dbba5cd2552e7d527bca74ead577e13fc74905384 not found: ID does not exist"
Jul 01 19:26:00.186978 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.186971    2556 scope.go:117] "RemoveContainer" containerID="29dffcaee26c36e23c5f0548a7852c17301ef5087d86a32daa876cc2fdca636c"
Jul 01 19:26:00.187159 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.187129    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 01 19:26:00.187413 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.187281    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29dffcaee26c36e23c5f0548a7852c17301ef5087d86a32daa876cc2fdca636c"} err="failed to get container status \"29dffcaee26c36e23c5f0548a7852c17301ef5087d86a32daa876cc2fdca636c\": rpc error: code = NotFound desc = could not find container \"29dffcaee26c36e23c5f0548a7852c17301ef5087d86a32daa876cc2fdca636c\": container with ID starting with 29dffcaee26c36e23c5f0548a7852c17301ef5087d86a32daa876cc2fdca636c not found: ID does not exist"
Jul 01 19:26:00.187413 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.187304    2556 scope.go:117] "RemoveContainer" containerID="f268218fa2ca7343576be5819271852d18c5153f016a065735a309b075eb29c0"
Jul 01 19:26:00.187761 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.187732    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f268218fa2ca7343576be5819271852d18c5153f016a065735a309b075eb29c0"} err="failed to get container status \"f268218fa2ca7343576be5819271852d18c5153f016a065735a309b075eb29c0\": rpc error: code = NotFound desc = could not find container \"f268218fa2ca7343576be5819271852d18c5153f016a065735a309b075eb29c0\": container with ID starting with f268218fa2ca7343576be5819271852d18c5153f016a065735a309b075eb29c0 not found: ID does not exist"
Jul 01 19:26:00.187873 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.187765    2556 scope.go:117] "RemoveContainer" containerID="ba7ddcd6097f881b8eac2c424ce3752d6bd91e14008848ed8bd7ac73e5dda1c0"
Jul 01 19:26:00.188063 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.188043    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba7ddcd6097f881b8eac2c424ce3752d6bd91e14008848ed8bd7ac73e5dda1c0"} err="failed to get container status \"ba7ddcd6097f881b8eac2c424ce3752d6bd91e14008848ed8bd7ac73e5dda1c0\": rpc error: code = NotFound desc = could not find container \"ba7ddcd6097f881b8eac2c424ce3752d6bd91e14008848ed8bd7ac73e5dda1c0\": container with ID starting with ba7ddcd6097f881b8eac2c424ce3752d6bd91e14008848ed8bd7ac73e5dda1c0 not found: ID does not exist"
Jul 01 19:26:00.188063 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.188064    2556 scope.go:117] "RemoveContainer" containerID="85fe595eca6f2bd45f729a40b72f7395d0f291493cb0b58a5cafa6270823abbd"
Jul 01 19:26:00.188345 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.188324    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85fe595eca6f2bd45f729a40b72f7395d0f291493cb0b58a5cafa6270823abbd"} err="failed to get container status \"85fe595eca6f2bd45f729a40b72f7395d0f291493cb0b58a5cafa6270823abbd\": rpc error: code = NotFound desc = could not find container \"85fe595eca6f2bd45f729a40b72f7395d0f291493cb0b58a5cafa6270823abbd\": container with ID starting with 85fe595eca6f2bd45f729a40b72f7395d0f291493cb0b58a5cafa6270823abbd not found: ID does not exist"
Jul 01 19:26:00.193617 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.193597    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 01 19:26:00.241237 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.241207    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/76a8486d-8330-4cf5-b339-783c75286216-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"76a8486d-8330-4cf5-b339-783c75286216\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:26:00.241439 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.241242    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/76a8486d-8330-4cf5-b339-783c75286216-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"76a8486d-8330-4cf5-b339-783c75286216\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:26:00.241439 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.241269    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/76a8486d-8330-4cf5-b339-783c75286216-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"76a8486d-8330-4cf5-b339-783c75286216\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:26:00.241439 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.241287    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/76a8486d-8330-4cf5-b339-783c75286216-config-volume\") pod \"alertmanager-main-0\" (UID: \"76a8486d-8330-4cf5-b339-783c75286216\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:26:00.241439 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.241354    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2m99\" (UniqueName: \"kubernetes.io/projected/76a8486d-8330-4cf5-b339-783c75286216-kube-api-access-w2m99\") pod \"alertmanager-main-0\" (UID: \"76a8486d-8330-4cf5-b339-783c75286216\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:26:00.241439 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.241420    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/76a8486d-8330-4cf5-b339-783c75286216-config-out\") pod \"alertmanager-main-0\" (UID: \"76a8486d-8330-4cf5-b339-783c75286216\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:26:00.241663 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.241454    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/76a8486d-8330-4cf5-b339-783c75286216-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"76a8486d-8330-4cf5-b339-783c75286216\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:26:00.241663 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.241478    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/76a8486d-8330-4cf5-b339-783c75286216-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"76a8486d-8330-4cf5-b339-783c75286216\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:26:00.241663 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.241499    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/76a8486d-8330-4cf5-b339-783c75286216-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"76a8486d-8330-4cf5-b339-783c75286216\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:26:00.241663 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.241526    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76a8486d-8330-4cf5-b339-783c75286216-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"76a8486d-8330-4cf5-b339-783c75286216\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:26:00.241663 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.241572    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/76a8486d-8330-4cf5-b339-783c75286216-tls-assets\") pod \"alertmanager-main-0\" (UID: \"76a8486d-8330-4cf5-b339-783c75286216\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:26:00.241663 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.241593    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/76a8486d-8330-4cf5-b339-783c75286216-web-config\") pod \"alertmanager-main-0\" (UID: \"76a8486d-8330-4cf5-b339-783c75286216\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:26:00.241663 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.241608    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76a8486d-8330-4cf5-b339-783c75286216-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"76a8486d-8330-4cf5-b339-783c75286216\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:26:00.255027 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.255004    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d63797ef-d1c6-4a3b-94a5-c363b75b45ad" path="/var/lib/kubelet/pods/d63797ef-d1c6-4a3b-94a5-c363b75b45ad/volumes"
Jul 01 19:26:00.342693 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.342640    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/76a8486d-8330-4cf5-b339-783c75286216-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"76a8486d-8330-4cf5-b339-783c75286216\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:26:00.342887 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.342711    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/76a8486d-8330-4cf5-b339-783c75286216-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"76a8486d-8330-4cf5-b339-783c75286216\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:26:00.342887 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.342831    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/76a8486d-8330-4cf5-b339-783c75286216-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"76a8486d-8330-4cf5-b339-783c75286216\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:26:00.342887 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.342869    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76a8486d-8330-4cf5-b339-783c75286216-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"76a8486d-8330-4cf5-b339-783c75286216\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:26:00.343052 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.342926    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/76a8486d-8330-4cf5-b339-783c75286216-tls-assets\") pod \"alertmanager-main-0\" (UID: \"76a8486d-8330-4cf5-b339-783c75286216\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:26:00.343052 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.342960    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/76a8486d-8330-4cf5-b339-783c75286216-web-config\") pod \"alertmanager-main-0\" (UID: \"76a8486d-8330-4cf5-b339-783c75286216\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:26:00.343052 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.342984    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76a8486d-8330-4cf5-b339-783c75286216-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"76a8486d-8330-4cf5-b339-783c75286216\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:26:00.343207 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.343152    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/76a8486d-8330-4cf5-b339-783c75286216-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"76a8486d-8330-4cf5-b339-783c75286216\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:26:00.343207 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.343188    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/76a8486d-8330-4cf5-b339-783c75286216-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"76a8486d-8330-4cf5-b339-783c75286216\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:26:00.343314 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.343269    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/76a8486d-8330-4cf5-b339-783c75286216-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"76a8486d-8330-4cf5-b339-783c75286216\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:26:00.343314 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.343293    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/76a8486d-8330-4cf5-b339-783c75286216-config-volume\") pod \"alertmanager-main-0\" (UID: \"76a8486d-8330-4cf5-b339-783c75286216\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:26:00.343314 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.343311    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2m99\" (UniqueName: \"kubernetes.io/projected/76a8486d-8330-4cf5-b339-783c75286216-kube-api-access-w2m99\") pod \"alertmanager-main-0\" (UID: \"76a8486d-8330-4cf5-b339-783c75286216\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:26:00.343457 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.343334    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/76a8486d-8330-4cf5-b339-783c75286216-config-out\") pod \"alertmanager-main-0\" (UID: \"76a8486d-8330-4cf5-b339-783c75286216\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:26:00.343895 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.343849    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76a8486d-8330-4cf5-b339-783c75286216-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"76a8486d-8330-4cf5-b339-783c75286216\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:26:00.344126 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.344101    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76a8486d-8330-4cf5-b339-783c75286216-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"76a8486d-8330-4cf5-b339-783c75286216\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:26:00.346165 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.345823    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/76a8486d-8330-4cf5-b339-783c75286216-tls-assets\") pod \"alertmanager-main-0\" (UID: \"76a8486d-8330-4cf5-b339-783c75286216\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:26:00.346165 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.345871    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/76a8486d-8330-4cf5-b339-783c75286216-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"76a8486d-8330-4cf5-b339-783c75286216\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:26:00.346165 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.343157    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/76a8486d-8330-4cf5-b339-783c75286216-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"76a8486d-8330-4cf5-b339-783c75286216\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:26:00.346165 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.345977    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/76a8486d-8330-4cf5-b339-783c75286216-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"76a8486d-8330-4cf5-b339-783c75286216\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:26:00.346165 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.346145    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/76a8486d-8330-4cf5-b339-783c75286216-config-out\") pod \"alertmanager-main-0\" (UID: \"76a8486d-8330-4cf5-b339-783c75286216\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:26:00.346435 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.346184    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/76a8486d-8330-4cf5-b339-783c75286216-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"76a8486d-8330-4cf5-b339-783c75286216\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:26:00.346753 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.346735    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/76a8486d-8330-4cf5-b339-783c75286216-web-config\") pod \"alertmanager-main-0\" (UID: \"76a8486d-8330-4cf5-b339-783c75286216\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:26:00.346898 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.346876    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/76a8486d-8330-4cf5-b339-783c75286216-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"76a8486d-8330-4cf5-b339-783c75286216\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:26:00.346937 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.346898    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/76a8486d-8330-4cf5-b339-783c75286216-config-volume\") pod \"alertmanager-main-0\" (UID: \"76a8486d-8330-4cf5-b339-783c75286216\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:26:00.347790 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.347762    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/76a8486d-8330-4cf5-b339-783c75286216-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"76a8486d-8330-4cf5-b339-783c75286216\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:26:00.354010 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.353990    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2m99\" (UniqueName: \"kubernetes.io/projected/76a8486d-8330-4cf5-b339-783c75286216-kube-api-access-w2m99\") pod \"alertmanager-main-0\" (UID: \"76a8486d-8330-4cf5-b339-783c75286216\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:26:00.490355 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.490319    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 01 19:26:00.628044 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:00.628019    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 01 19:26:00.630120 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:26:00.630094    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76a8486d_8330_4cf5_b339_783c75286216.slice/crio-e135650193dfef234c3ca8e5494ddee0ecf16ea5a3ba25d31330664bfc496848 WatchSource:0}: Error finding container e135650193dfef234c3ca8e5494ddee0ecf16ea5a3ba25d31330664bfc496848: Status 404 returned error can't find the container with id e135650193dfef234c3ca8e5494ddee0ecf16ea5a3ba25d31330664bfc496848
Jul 01 19:26:01.121139 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:01.121101    2556 generic.go:356] "Generic (PLEG): container finished" podID="76a8486d-8330-4cf5-b339-783c75286216" containerID="e5786405a739289db4a58498ac1bb60ee124f276cf99bdffb04f6355f598039b" exitCode=0
Jul 01 19:26:01.121509 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:01.121163    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"76a8486d-8330-4cf5-b339-783c75286216","Type":"ContainerDied","Data":"e5786405a739289db4a58498ac1bb60ee124f276cf99bdffb04f6355f598039b"}
Jul 01 19:26:01.121509 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:01.121228    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"76a8486d-8330-4cf5-b339-783c75286216","Type":"ContainerStarted","Data":"e135650193dfef234c3ca8e5494ddee0ecf16ea5a3ba25d31330664bfc496848"}
Jul 01 19:26:02.132868 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.132830    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"76a8486d-8330-4cf5-b339-783c75286216","Type":"ContainerStarted","Data":"884118913f24e91be44158fdf21ff5e055994bae972673ecbea2ab2e1fbc9577"}
Jul 01 19:26:02.133308 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.132951    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"76a8486d-8330-4cf5-b339-783c75286216","Type":"ContainerStarted","Data":"718cdaf8e40f4c8fcb72932d1ba3663597532af16d553b0037bd3e043b511cdc"}
Jul 01 19:26:02.133308 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.133001    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"76a8486d-8330-4cf5-b339-783c75286216","Type":"ContainerStarted","Data":"423522a15f902c48c92f55389bffe241fc2668a5344115264412a9a4d1598d47"}
Jul 01 19:26:02.133308 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.133045    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"76a8486d-8330-4cf5-b339-783c75286216","Type":"ContainerStarted","Data":"a0f9d87776afc0a6f9f8d44c9bd39a09f5269702fce21575ec21874a3de1b85b"}
Jul 01 19:26:02.133308 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.133081    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"76a8486d-8330-4cf5-b339-783c75286216","Type":"ContainerStarted","Data":"017ceac9c3f4c71cac600d7e229dbcc781481370d14a365145a17ec3dae605fd"}
Jul 01 19:26:02.133308 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.133116    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"76a8486d-8330-4cf5-b339-783c75286216","Type":"ContainerStarted","Data":"8ade881d7fb24cfd0981ce8ecc46b7842ab314cde9523bd72474a8d2b7cf9d42"}
Jul 01 19:26:02.163698 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.163635    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.148422006 podStartE2EDuration="2.163612386s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.19038ms" isStatefulPod=false podCreationTimestamp="2026-07-01 19:26:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:26:02.162488722 +0000 UTC m=+146.525500404" watchObservedRunningTime="2026-07-01 19:26:02.163612386 +0000 UTC m=+146.526624069"
Jul 01 19:26:02.318476 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.318434    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 01 19:26:02.318753 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.318714    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="304aab4c-2394-418b-bc9d-d8169f55974c" containerName="prometheus" containerID="cri-o://4ef2f029f3e8de66ec3615a04d8eb69f0496eea09031858e2abf5c8653d77c36" gracePeriod=600
Jul 01 19:26:02.318882 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.318747    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="304aab4c-2394-418b-bc9d-d8169f55974c" containerName="kube-rbac-proxy" containerID="cri-o://b7a22502c35486746ee665eea6a77e39fa93a45fb3b0277e4d95c7a7ae3877ed" gracePeriod=600
Jul 01 19:26:02.318882 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.318771    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="304aab4c-2394-418b-bc9d-d8169f55974c" containerName="kube-rbac-proxy-thanos" containerID="cri-o://9f61f9411337b4162c325477f0d95211d2396174e0864f7e808732411646a9eb" gracePeriod=600
Jul 01 19:26:02.318882 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.318795    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="304aab4c-2394-418b-bc9d-d8169f55974c" containerName="thanos-sidecar" containerID="cri-o://21298a119f542c3c88c925946240f2781889eb9606e880921a68dfb3b1139004" gracePeriod=600
Jul 01 19:26:02.318882 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.318806    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="304aab4c-2394-418b-bc9d-d8169f55974c" containerName="config-reloader" containerID="cri-o://4c346b0a8d9323f5fe3504097cb5db02c1908284f9b422be9dd1d6ce5ddc1b39" gracePeriod=600
Jul 01 19:26:02.318882 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.318858    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="304aab4c-2394-418b-bc9d-d8169f55974c" containerName="kube-rbac-proxy-web" containerID="cri-o://df7e0dd4daeaf811caa5e2700520c8b94b57fc3df5e1689c16e19321de79747e" gracePeriod=600
Jul 01 19:26:02.562537 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.562505    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:02.662748 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.662719    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/304aab4c-2394-418b-bc9d-d8169f55974c-prometheus-trusted-ca-bundle\") pod \"304aab4c-2394-418b-bc9d-d8169f55974c\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") "
Jul 01 19:26:02.662748 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.662752    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/304aab4c-2394-418b-bc9d-d8169f55974c-configmap-metrics-client-ca\") pod \"304aab4c-2394-418b-bc9d-d8169f55974c\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") "
Jul 01 19:26:02.662990 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.662780    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/304aab4c-2394-418b-bc9d-d8169f55974c-prometheus-k8s-rulefiles-0\") pod \"304aab4c-2394-418b-bc9d-d8169f55974c\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") "
Jul 01 19:26:02.662990 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.662811    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-web-config\") pod \"304aab4c-2394-418b-bc9d-d8169f55974c\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") "
Jul 01 19:26:02.662990 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.662853    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/304aab4c-2394-418b-bc9d-d8169f55974c-prometheus-k8s-db\") pod \"304aab4c-2394-418b-bc9d-d8169f55974c\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") "
Jul 01 19:26:02.662990 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.662874    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-secret-grpc-tls\") pod \"304aab4c-2394-418b-bc9d-d8169f55974c\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") "
Jul 01 19:26:02.662990 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.662903    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdkjx\" (UniqueName: \"kubernetes.io/projected/304aab4c-2394-418b-bc9d-d8169f55974c-kube-api-access-xdkjx\") pod \"304aab4c-2394-418b-bc9d-d8169f55974c\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") "
Jul 01 19:26:02.662990 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.662925    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/304aab4c-2394-418b-bc9d-d8169f55974c-prometheus-k8s-rulefiles-1\") pod \"304aab4c-2394-418b-bc9d-d8169f55974c\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") "
Jul 01 19:26:02.662990 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.662965    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-thanos-prometheus-http-client-file\") pod \"304aab4c-2394-418b-bc9d-d8169f55974c\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") "
Jul 01 19:26:02.663342 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.662994    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/304aab4c-2394-418b-bc9d-d8169f55974c-tls-assets\") pod \"304aab4c-2394-418b-bc9d-d8169f55974c\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") "
Jul 01 19:26:02.663342 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.663031    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-config\") pod \"304aab4c-2394-418b-bc9d-d8169f55974c\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") "
Jul 01 19:26:02.663342 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.663061    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/304aab4c-2394-418b-bc9d-d8169f55974c-prometheus-k8s-rulefiles-2\") pod \"304aab4c-2394-418b-bc9d-d8169f55974c\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") "
Jul 01 19:26:02.663342 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.663096    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"304aab4c-2394-418b-bc9d-d8169f55974c\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") "
Jul 01 19:26:02.663342 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.663121    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-secret-prometheus-k8s-tls\") pod \"304aab4c-2394-418b-bc9d-d8169f55974c\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") "
Jul 01 19:26:02.663342 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.663135    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/304aab4c-2394-418b-bc9d-d8169f55974c-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "304aab4c-2394-418b-bc9d-d8169f55974c" (UID: "304aab4c-2394-418b-bc9d-d8169f55974c"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 19:26:02.663342 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.663156    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/304aab4c-2394-418b-bc9d-d8169f55974c-configmap-kubelet-serving-ca-bundle\") pod \"304aab4c-2394-418b-bc9d-d8169f55974c\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") "
Jul 01 19:26:02.663342 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.663179    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-secret-kube-rbac-proxy\") pod \"304aab4c-2394-418b-bc9d-d8169f55974c\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") "
Jul 01 19:26:02.663342 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.663179    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/304aab4c-2394-418b-bc9d-d8169f55974c-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "304aab4c-2394-418b-bc9d-d8169f55974c" (UID: "304aab4c-2394-418b-bc9d-d8169f55974c"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 19:26:02.663342 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.663221    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/304aab4c-2394-418b-bc9d-d8169f55974c-config-out\") pod \"304aab4c-2394-418b-bc9d-d8169f55974c\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") "
Jul 01 19:26:02.663342 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.663282    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-secret-metrics-client-certs\") pod \"304aab4c-2394-418b-bc9d-d8169f55974c\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") "
Jul 01 19:26:02.663342 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.663309    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"304aab4c-2394-418b-bc9d-d8169f55974c\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") "
Jul 01 19:26:02.663342 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.663333    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/304aab4c-2394-418b-bc9d-d8169f55974c-configmap-serving-certs-ca-bundle\") pod \"304aab4c-2394-418b-bc9d-d8169f55974c\" (UID: \"304aab4c-2394-418b-bc9d-d8169f55974c\") "
Jul 01 19:26:02.663342 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.663331    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/304aab4c-2394-418b-bc9d-d8169f55974c-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "304aab4c-2394-418b-bc9d-d8169f55974c" (UID: "304aab4c-2394-418b-bc9d-d8169f55974c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 19:26:02.664086 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.663646    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/304aab4c-2394-418b-bc9d-d8169f55974c-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "304aab4c-2394-418b-bc9d-d8169f55974c" (UID: "304aab4c-2394-418b-bc9d-d8169f55974c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 19:26:02.664086 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.663674    2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/304aab4c-2394-418b-bc9d-d8169f55974c-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:26:02.664086 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.663993    2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/304aab4c-2394-418b-bc9d-d8169f55974c-prometheus-trusted-ca-bundle\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:26:02.664086 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.664009    2556 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/304aab4c-2394-418b-bc9d-d8169f55974c-configmap-metrics-client-ca\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:26:02.664086 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.664073    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/304aab4c-2394-418b-bc9d-d8169f55974c-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "304aab4c-2394-418b-bc9d-d8169f55974c" (UID: "304aab4c-2394-418b-bc9d-d8169f55974c"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 19:26:02.664323 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.664178    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/304aab4c-2394-418b-bc9d-d8169f55974c-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "304aab4c-2394-418b-bc9d-d8169f55974c" (UID: "304aab4c-2394-418b-bc9d-d8169f55974c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 19:26:02.665452 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.664797    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/304aab4c-2394-418b-bc9d-d8169f55974c-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "304aab4c-2394-418b-bc9d-d8169f55974c" (UID: "304aab4c-2394-418b-bc9d-d8169f55974c"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 19:26:02.665452 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.665180    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/304aab4c-2394-418b-bc9d-d8169f55974c-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "304aab4c-2394-418b-bc9d-d8169f55974c" (UID: "304aab4c-2394-418b-bc9d-d8169f55974c"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 19:26:02.666048 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.666009    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "304aab4c-2394-418b-bc9d-d8169f55974c" (UID: "304aab4c-2394-418b-bc9d-d8169f55974c"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 19:26:02.666388 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.666335    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-config" (OuterVolumeSpecName: "config") pod "304aab4c-2394-418b-bc9d-d8169f55974c" (UID: "304aab4c-2394-418b-bc9d-d8169f55974c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 19:26:02.667397 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.667339    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "304aab4c-2394-418b-bc9d-d8169f55974c" (UID: "304aab4c-2394-418b-bc9d-d8169f55974c"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 19:26:02.667779 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.667745    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "304aab4c-2394-418b-bc9d-d8169f55974c" (UID: "304aab4c-2394-418b-bc9d-d8169f55974c"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 19:26:02.667881 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.667790    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/304aab4c-2394-418b-bc9d-d8169f55974c-kube-api-access-xdkjx" (OuterVolumeSpecName: "kube-api-access-xdkjx") pod "304aab4c-2394-418b-bc9d-d8169f55974c" (UID: "304aab4c-2394-418b-bc9d-d8169f55974c"). InnerVolumeSpecName "kube-api-access-xdkjx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 19:26:02.668040 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.668015    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/304aab4c-2394-418b-bc9d-d8169f55974c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "304aab4c-2394-418b-bc9d-d8169f55974c" (UID: "304aab4c-2394-418b-bc9d-d8169f55974c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 19:26:02.668186 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.668171    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "304aab4c-2394-418b-bc9d-d8169f55974c" (UID: "304aab4c-2394-418b-bc9d-d8169f55974c"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 19:26:02.668347 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.668333    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "304aab4c-2394-418b-bc9d-d8169f55974c" (UID: "304aab4c-2394-418b-bc9d-d8169f55974c"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 19:26:02.668418 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.668342    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/304aab4c-2394-418b-bc9d-d8169f55974c-config-out" (OuterVolumeSpecName: "config-out") pod "304aab4c-2394-418b-bc9d-d8169f55974c" (UID: "304aab4c-2394-418b-bc9d-d8169f55974c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 19:26:02.668585 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.668558    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "304aab4c-2394-418b-bc9d-d8169f55974c" (UID: "304aab4c-2394-418b-bc9d-d8169f55974c"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 19:26:02.668943 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.668921    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "304aab4c-2394-418b-bc9d-d8169f55974c" (UID: "304aab4c-2394-418b-bc9d-d8169f55974c"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 19:26:02.677488 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.677446    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-web-config" (OuterVolumeSpecName: "web-config") pod "304aab4c-2394-418b-bc9d-d8169f55974c" (UID: "304aab4c-2394-418b-bc9d-d8169f55974c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 19:26:02.764699 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.764603    2556 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:26:02.764699 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.764639    2556 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/304aab4c-2394-418b-bc9d-d8169f55974c-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:26:02.764699 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.764656    2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/304aab4c-2394-418b-bc9d-d8169f55974c-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:26:02.764699 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.764666    2556 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-web-config\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:26:02.764699 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.764675    2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/304aab4c-2394-418b-bc9d-d8169f55974c-prometheus-k8s-db\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:26:02.764699 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.764685    2556 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-secret-grpc-tls\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:26:02.764699 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.764693    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdkjx\" (UniqueName: \"kubernetes.io/projected/304aab4c-2394-418b-bc9d-d8169f55974c-kube-api-access-xdkjx\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:26:02.764699 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.764703    2556 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-thanos-prometheus-http-client-file\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:26:02.765044 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.764712    2556 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/304aab4c-2394-418b-bc9d-d8169f55974c-tls-assets\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:26:02.765044 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.764720    2556 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-config\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:26:02.765044 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.764727    2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/304aab4c-2394-418b-bc9d-d8169f55974c-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:26:02.765044 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.764735    2556 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:26:02.765044 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.764744    2556 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-secret-prometheus-k8s-tls\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:26:02.765044 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.764752    2556 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/304aab4c-2394-418b-bc9d-d8169f55974c-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:26:02.765044 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.764761    2556 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-secret-kube-rbac-proxy\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:26:02.765044 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.764768    2556 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/304aab4c-2394-418b-bc9d-d8169f55974c-config-out\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:26:02.765044 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:02.764776    2556 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/304aab4c-2394-418b-bc9d-d8169f55974c-secret-metrics-client-certs\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:26:03.140490 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.140393    2556 generic.go:356] "Generic (PLEG): container finished" podID="304aab4c-2394-418b-bc9d-d8169f55974c" containerID="9f61f9411337b4162c325477f0d95211d2396174e0864f7e808732411646a9eb" exitCode=0
Jul 01 19:26:03.140490 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.140431    2556 generic.go:356] "Generic (PLEG): container finished" podID="304aab4c-2394-418b-bc9d-d8169f55974c" containerID="b7a22502c35486746ee665eea6a77e39fa93a45fb3b0277e4d95c7a7ae3877ed" exitCode=0
Jul 01 19:26:03.140490 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.140437    2556 generic.go:356] "Generic (PLEG): container finished" podID="304aab4c-2394-418b-bc9d-d8169f55974c" containerID="df7e0dd4daeaf811caa5e2700520c8b94b57fc3df5e1689c16e19321de79747e" exitCode=0
Jul 01 19:26:03.140490 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.140444    2556 generic.go:356] "Generic (PLEG): container finished" podID="304aab4c-2394-418b-bc9d-d8169f55974c" containerID="21298a119f542c3c88c925946240f2781889eb9606e880921a68dfb3b1139004" exitCode=0
Jul 01 19:26:03.140490 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.140450    2556 generic.go:356] "Generic (PLEG): container finished" podID="304aab4c-2394-418b-bc9d-d8169f55974c" containerID="4c346b0a8d9323f5fe3504097cb5db02c1908284f9b422be9dd1d6ce5ddc1b39" exitCode=0
Jul 01 19:26:03.140490 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.140455    2556 generic.go:356] "Generic (PLEG): container finished" podID="304aab4c-2394-418b-bc9d-d8169f55974c" containerID="4ef2f029f3e8de66ec3615a04d8eb69f0496eea09031858e2abf5c8653d77c36" exitCode=0
Jul 01 19:26:03.140490 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.140474    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"304aab4c-2394-418b-bc9d-d8169f55974c","Type":"ContainerDied","Data":"9f61f9411337b4162c325477f0d95211d2396174e0864f7e808732411646a9eb"}
Jul 01 19:26:03.141270 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.140511    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.141270 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.140560    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"304aab4c-2394-418b-bc9d-d8169f55974c","Type":"ContainerDied","Data":"b7a22502c35486746ee665eea6a77e39fa93a45fb3b0277e4d95c7a7ae3877ed"}
Jul 01 19:26:03.141270 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.140602    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"304aab4c-2394-418b-bc9d-d8169f55974c","Type":"ContainerDied","Data":"df7e0dd4daeaf811caa5e2700520c8b94b57fc3df5e1689c16e19321de79747e"}
Jul 01 19:26:03.141270 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.140629    2556 scope.go:117] "RemoveContainer" containerID="9f61f9411337b4162c325477f0d95211d2396174e0864f7e808732411646a9eb"
Jul 01 19:26:03.141270 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.140644    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"304aab4c-2394-418b-bc9d-d8169f55974c","Type":"ContainerDied","Data":"21298a119f542c3c88c925946240f2781889eb9606e880921a68dfb3b1139004"}
Jul 01 19:26:03.141270 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.140686    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"304aab4c-2394-418b-bc9d-d8169f55974c","Type":"ContainerDied","Data":"4c346b0a8d9323f5fe3504097cb5db02c1908284f9b422be9dd1d6ce5ddc1b39"}
Jul 01 19:26:03.141270 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.140728    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"304aab4c-2394-418b-bc9d-d8169f55974c","Type":"ContainerDied","Data":"4ef2f029f3e8de66ec3615a04d8eb69f0496eea09031858e2abf5c8653d77c36"}
Jul 01 19:26:03.141270 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.140770    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"304aab4c-2394-418b-bc9d-d8169f55974c","Type":"ContainerDied","Data":"226b4dcb5605df1e56b1f253fd64e8fa62b762ce0d06039cf215e7dd18b6f3e4"}
Jul 01 19:26:03.149659 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.149555    2556 scope.go:117] "RemoveContainer" containerID="b7a22502c35486746ee665eea6a77e39fa93a45fb3b0277e4d95c7a7ae3877ed"
Jul 01 19:26:03.156646 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.156618    2556 scope.go:117] "RemoveContainer" containerID="df7e0dd4daeaf811caa5e2700520c8b94b57fc3df5e1689c16e19321de79747e"
Jul 01 19:26:03.163344 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.163325    2556 scope.go:117] "RemoveContainer" containerID="21298a119f542c3c88c925946240f2781889eb9606e880921a68dfb3b1139004"
Jul 01 19:26:03.167468 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.167422    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 01 19:26:03.171053 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.171022    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 01 19:26:03.172765 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.172662    2556 scope.go:117] "RemoveContainer" containerID="4c346b0a8d9323f5fe3504097cb5db02c1908284f9b422be9dd1d6ce5ddc1b39"
Jul 01 19:26:03.187328 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.187257    2556 scope.go:117] "RemoveContainer" containerID="4ef2f029f3e8de66ec3615a04d8eb69f0496eea09031858e2abf5c8653d77c36"
Jul 01 19:26:03.195516 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.195490    2556 scope.go:117] "RemoveContainer" containerID="dfd83901b577f550c78a4cec388545ec1478152ece446b1422c412957fc525ed"
Jul 01 19:26:03.195654 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.195636    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 01 19:26:03.195979 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.195963    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="304aab4c-2394-418b-bc9d-d8169f55974c" containerName="thanos-sidecar"
Jul 01 19:26:03.195979 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.195978    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="304aab4c-2394-418b-bc9d-d8169f55974c" containerName="thanos-sidecar"
Jul 01 19:26:03.196085 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.195992    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="304aab4c-2394-418b-bc9d-d8169f55974c" containerName="prometheus"
Jul 01 19:26:03.196085 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.195998    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="304aab4c-2394-418b-bc9d-d8169f55974c" containerName="prometheus"
Jul 01 19:26:03.196085 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.196006    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="304aab4c-2394-418b-bc9d-d8169f55974c" containerName="config-reloader"
Jul 01 19:26:03.196085 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.196011    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="304aab4c-2394-418b-bc9d-d8169f55974c" containerName="config-reloader"
Jul 01 19:26:03.196085 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.196021    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="304aab4c-2394-418b-bc9d-d8169f55974c" containerName="kube-rbac-proxy"
Jul 01 19:26:03.196085 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.196028    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="304aab4c-2394-418b-bc9d-d8169f55974c" containerName="kube-rbac-proxy"
Jul 01 19:26:03.196085 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.196040    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="304aab4c-2394-418b-bc9d-d8169f55974c" containerName="init-config-reloader"
Jul 01 19:26:03.196085 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.196048    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="304aab4c-2394-418b-bc9d-d8169f55974c" containerName="init-config-reloader"
Jul 01 19:26:03.196085 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.196059    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="304aab4c-2394-418b-bc9d-d8169f55974c" containerName="kube-rbac-proxy-thanos"
Jul 01 19:26:03.196085 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.196067    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="304aab4c-2394-418b-bc9d-d8169f55974c" containerName="kube-rbac-proxy-thanos"
Jul 01 19:26:03.196085 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.196081    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="304aab4c-2394-418b-bc9d-d8169f55974c" containerName="kube-rbac-proxy-web"
Jul 01 19:26:03.196085 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.196086    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="304aab4c-2394-418b-bc9d-d8169f55974c" containerName="kube-rbac-proxy-web"
Jul 01 19:26:03.196523 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.196142    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="304aab4c-2394-418b-bc9d-d8169f55974c" containerName="prometheus"
Jul 01 19:26:03.196523 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.196149    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="304aab4c-2394-418b-bc9d-d8169f55974c" containerName="kube-rbac-proxy-web"
Jul 01 19:26:03.196523 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.196155    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="304aab4c-2394-418b-bc9d-d8169f55974c" containerName="kube-rbac-proxy"
Jul 01 19:26:03.196523 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.196162    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="304aab4c-2394-418b-bc9d-d8169f55974c" containerName="thanos-sidecar"
Jul 01 19:26:03.196523 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.196167    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="304aab4c-2394-418b-bc9d-d8169f55974c" containerName="kube-rbac-proxy-thanos"
Jul 01 19:26:03.196523 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.196173    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="304aab4c-2394-418b-bc9d-d8169f55974c" containerName="config-reloader"
Jul 01 19:26:03.200542 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.200521    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.203061 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.203030    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 01 19:26:03.203061 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.203046    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 01 19:26:03.203205 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.203159    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a9u32dkencu39\""
Jul 01 19:26:03.203205 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.203169    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 01 19:26:03.203489 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.203470    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 01 19:26:03.203570 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.203474    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 01 19:26:03.203630 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.203572    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 01 19:26:03.203785 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.203764    2556 scope.go:117] "RemoveContainer" containerID="9f61f9411337b4162c325477f0d95211d2396174e0864f7e808732411646a9eb"
Jul 01 19:26:03.203930 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.203915    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 01 19:26:03.204000 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.203934    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 01 19:26:03.204000 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.203938    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 01 19:26:03.204000 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.203977    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qlx4s\""
Jul 01 19:26:03.204000 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.203956    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 01 19:26:03.204256 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.204046    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 01 19:26:03.204308 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.204263    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 01 19:26:03.204551 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:26:03.204526    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f61f9411337b4162c325477f0d95211d2396174e0864f7e808732411646a9eb\": container with ID starting with 9f61f9411337b4162c325477f0d95211d2396174e0864f7e808732411646a9eb not found: ID does not exist" containerID="9f61f9411337b4162c325477f0d95211d2396174e0864f7e808732411646a9eb"
Jul 01 19:26:03.204653 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.204556    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f61f9411337b4162c325477f0d95211d2396174e0864f7e808732411646a9eb"} err="failed to get container status \"9f61f9411337b4162c325477f0d95211d2396174e0864f7e808732411646a9eb\": rpc error: code = NotFound desc = could not find container \"9f61f9411337b4162c325477f0d95211d2396174e0864f7e808732411646a9eb\": container with ID starting with 9f61f9411337b4162c325477f0d95211d2396174e0864f7e808732411646a9eb not found: ID does not exist"
Jul 01 19:26:03.204653 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.204587    2556 scope.go:117] "RemoveContainer" containerID="b7a22502c35486746ee665eea6a77e39fa93a45fb3b0277e4d95c7a7ae3877ed"
Jul 01 19:26:03.204887 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:26:03.204869    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7a22502c35486746ee665eea6a77e39fa93a45fb3b0277e4d95c7a7ae3877ed\": container with ID starting with b7a22502c35486746ee665eea6a77e39fa93a45fb3b0277e4d95c7a7ae3877ed not found: ID does not exist" containerID="b7a22502c35486746ee665eea6a77e39fa93a45fb3b0277e4d95c7a7ae3877ed"
Jul 01 19:26:03.204945 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.204892    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7a22502c35486746ee665eea6a77e39fa93a45fb3b0277e4d95c7a7ae3877ed"} err="failed to get container status \"b7a22502c35486746ee665eea6a77e39fa93a45fb3b0277e4d95c7a7ae3877ed\": rpc error: code = NotFound desc = could not find container \"b7a22502c35486746ee665eea6a77e39fa93a45fb3b0277e4d95c7a7ae3877ed\": container with ID starting with b7a22502c35486746ee665eea6a77e39fa93a45fb3b0277e4d95c7a7ae3877ed not found: ID does not exist"
Jul 01 19:26:03.204945 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.204909    2556 scope.go:117] "RemoveContainer" containerID="df7e0dd4daeaf811caa5e2700520c8b94b57fc3df5e1689c16e19321de79747e"
Jul 01 19:26:03.205279 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:26:03.205247    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df7e0dd4daeaf811caa5e2700520c8b94b57fc3df5e1689c16e19321de79747e\": container with ID starting with df7e0dd4daeaf811caa5e2700520c8b94b57fc3df5e1689c16e19321de79747e not found: ID does not exist" containerID="df7e0dd4daeaf811caa5e2700520c8b94b57fc3df5e1689c16e19321de79747e"
Jul 01 19:26:03.205385 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.205281    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df7e0dd4daeaf811caa5e2700520c8b94b57fc3df5e1689c16e19321de79747e"} err="failed to get container status \"df7e0dd4daeaf811caa5e2700520c8b94b57fc3df5e1689c16e19321de79747e\": rpc error: code = NotFound desc = could not find container \"df7e0dd4daeaf811caa5e2700520c8b94b57fc3df5e1689c16e19321de79747e\": container with ID starting with df7e0dd4daeaf811caa5e2700520c8b94b57fc3df5e1689c16e19321de79747e not found: ID does not exist"
Jul 01 19:26:03.205385 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.205295    2556 scope.go:117] "RemoveContainer" containerID="21298a119f542c3c88c925946240f2781889eb9606e880921a68dfb3b1139004"
Jul 01 19:26:03.205579 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:26:03.205555    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21298a119f542c3c88c925946240f2781889eb9606e880921a68dfb3b1139004\": container with ID starting with 21298a119f542c3c88c925946240f2781889eb9606e880921a68dfb3b1139004 not found: ID does not exist" containerID="21298a119f542c3c88c925946240f2781889eb9606e880921a68dfb3b1139004"
Jul 01 19:26:03.205619 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.205587    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21298a119f542c3c88c925946240f2781889eb9606e880921a68dfb3b1139004"} err="failed to get container status \"21298a119f542c3c88c925946240f2781889eb9606e880921a68dfb3b1139004\": rpc error: code = NotFound desc = could not find container \"21298a119f542c3c88c925946240f2781889eb9606e880921a68dfb3b1139004\": container with ID starting with 21298a119f542c3c88c925946240f2781889eb9606e880921a68dfb3b1139004 not found: ID does not exist"
Jul 01 19:26:03.205619 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.205605    2556 scope.go:117] "RemoveContainer" containerID="4c346b0a8d9323f5fe3504097cb5db02c1908284f9b422be9dd1d6ce5ddc1b39"
Jul 01 19:26:03.205878 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:26:03.205857    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c346b0a8d9323f5fe3504097cb5db02c1908284f9b422be9dd1d6ce5ddc1b39\": container with ID starting with 4c346b0a8d9323f5fe3504097cb5db02c1908284f9b422be9dd1d6ce5ddc1b39 not found: ID does not exist" containerID="4c346b0a8d9323f5fe3504097cb5db02c1908284f9b422be9dd1d6ce5ddc1b39"
Jul 01 19:26:03.205935 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.205884    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c346b0a8d9323f5fe3504097cb5db02c1908284f9b422be9dd1d6ce5ddc1b39"} err="failed to get container status \"4c346b0a8d9323f5fe3504097cb5db02c1908284f9b422be9dd1d6ce5ddc1b39\": rpc error: code = NotFound desc = could not find container \"4c346b0a8d9323f5fe3504097cb5db02c1908284f9b422be9dd1d6ce5ddc1b39\": container with ID starting with 4c346b0a8d9323f5fe3504097cb5db02c1908284f9b422be9dd1d6ce5ddc1b39 not found: ID does not exist"
Jul 01 19:26:03.205935 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.205906    2556 scope.go:117] "RemoveContainer" containerID="4ef2f029f3e8de66ec3615a04d8eb69f0496eea09031858e2abf5c8653d77c36"
Jul 01 19:26:03.206183 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:26:03.206163    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ef2f029f3e8de66ec3615a04d8eb69f0496eea09031858e2abf5c8653d77c36\": container with ID starting with 4ef2f029f3e8de66ec3615a04d8eb69f0496eea09031858e2abf5c8653d77c36 not found: ID does not exist" containerID="4ef2f029f3e8de66ec3615a04d8eb69f0496eea09031858e2abf5c8653d77c36"
Jul 01 19:26:03.206262 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.206189    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ef2f029f3e8de66ec3615a04d8eb69f0496eea09031858e2abf5c8653d77c36"} err="failed to get container status \"4ef2f029f3e8de66ec3615a04d8eb69f0496eea09031858e2abf5c8653d77c36\": rpc error: code = NotFound desc = could not find container \"4ef2f029f3e8de66ec3615a04d8eb69f0496eea09031858e2abf5c8653d77c36\": container with ID starting with 4ef2f029f3e8de66ec3615a04d8eb69f0496eea09031858e2abf5c8653d77c36 not found: ID does not exist"
Jul 01 19:26:03.206262 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.206208    2556 scope.go:117] "RemoveContainer" containerID="dfd83901b577f550c78a4cec388545ec1478152ece446b1422c412957fc525ed"
Jul 01 19:26:03.206632 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:26:03.206609    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfd83901b577f550c78a4cec388545ec1478152ece446b1422c412957fc525ed\": container with ID starting with dfd83901b577f550c78a4cec388545ec1478152ece446b1422c412957fc525ed not found: ID does not exist" containerID="dfd83901b577f550c78a4cec388545ec1478152ece446b1422c412957fc525ed"
Jul 01 19:26:03.206753 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.206635    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 01 19:26:03.206753 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.206638    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfd83901b577f550c78a4cec388545ec1478152ece446b1422c412957fc525ed"} err="failed to get container status \"dfd83901b577f550c78a4cec388545ec1478152ece446b1422c412957fc525ed\": rpc error: code = NotFound desc = could not find container \"dfd83901b577f550c78a4cec388545ec1478152ece446b1422c412957fc525ed\": container with ID starting with dfd83901b577f550c78a4cec388545ec1478152ece446b1422c412957fc525ed not found: ID does not exist"
Jul 01 19:26:03.206753 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.206659    2556 scope.go:117] "RemoveContainer" containerID="9f61f9411337b4162c325477f0d95211d2396174e0864f7e808732411646a9eb"
Jul 01 19:26:03.207008 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.206940    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f61f9411337b4162c325477f0d95211d2396174e0864f7e808732411646a9eb"} err="failed to get container status \"9f61f9411337b4162c325477f0d95211d2396174e0864f7e808732411646a9eb\": rpc error: code = NotFound desc = could not find container \"9f61f9411337b4162c325477f0d95211d2396174e0864f7e808732411646a9eb\": container with ID starting with 9f61f9411337b4162c325477f0d95211d2396174e0864f7e808732411646a9eb not found: ID does not exist"
Jul 01 19:26:03.207008 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.206958    2556 scope.go:117] "RemoveContainer" containerID="b7a22502c35486746ee665eea6a77e39fa93a45fb3b0277e4d95c7a7ae3877ed"
Jul 01 19:26:03.207329 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.207295    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7a22502c35486746ee665eea6a77e39fa93a45fb3b0277e4d95c7a7ae3877ed"} err="failed to get container status \"b7a22502c35486746ee665eea6a77e39fa93a45fb3b0277e4d95c7a7ae3877ed\": rpc error: code = NotFound desc = could not find container \"b7a22502c35486746ee665eea6a77e39fa93a45fb3b0277e4d95c7a7ae3877ed\": container with ID starting with b7a22502c35486746ee665eea6a77e39fa93a45fb3b0277e4d95c7a7ae3877ed not found: ID does not exist"
Jul 01 19:26:03.207329 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.207321    2556 scope.go:117] "RemoveContainer" containerID="df7e0dd4daeaf811caa5e2700520c8b94b57fc3df5e1689c16e19321de79747e"
Jul 01 19:26:03.207607 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.207588    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df7e0dd4daeaf811caa5e2700520c8b94b57fc3df5e1689c16e19321de79747e"} err="failed to get container status \"df7e0dd4daeaf811caa5e2700520c8b94b57fc3df5e1689c16e19321de79747e\": rpc error: code = NotFound desc = could not find container \"df7e0dd4daeaf811caa5e2700520c8b94b57fc3df5e1689c16e19321de79747e\": container with ID starting with df7e0dd4daeaf811caa5e2700520c8b94b57fc3df5e1689c16e19321de79747e not found: ID does not exist"
Jul 01 19:26:03.207668 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.207607    2556 scope.go:117] "RemoveContainer" containerID="21298a119f542c3c88c925946240f2781889eb9606e880921a68dfb3b1139004"
Jul 01 19:26:03.207847 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.207828    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21298a119f542c3c88c925946240f2781889eb9606e880921a68dfb3b1139004"} err="failed to get container status \"21298a119f542c3c88c925946240f2781889eb9606e880921a68dfb3b1139004\": rpc error: code = NotFound desc = could not find container \"21298a119f542c3c88c925946240f2781889eb9606e880921a68dfb3b1139004\": container with ID starting with 21298a119f542c3c88c925946240f2781889eb9606e880921a68dfb3b1139004 not found: ID does not exist"
Jul 01 19:26:03.207847 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.207847    2556 scope.go:117] "RemoveContainer" containerID="4c346b0a8d9323f5fe3504097cb5db02c1908284f9b422be9dd1d6ce5ddc1b39"
Jul 01 19:26:03.208113 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.208075    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c346b0a8d9323f5fe3504097cb5db02c1908284f9b422be9dd1d6ce5ddc1b39"} err="failed to get container status \"4c346b0a8d9323f5fe3504097cb5db02c1908284f9b422be9dd1d6ce5ddc1b39\": rpc error: code = NotFound desc = could not find container \"4c346b0a8d9323f5fe3504097cb5db02c1908284f9b422be9dd1d6ce5ddc1b39\": container with ID starting with 4c346b0a8d9323f5fe3504097cb5db02c1908284f9b422be9dd1d6ce5ddc1b39 not found: ID does not exist"
Jul 01 19:26:03.208113 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.208112    2556 scope.go:117] "RemoveContainer" containerID="4ef2f029f3e8de66ec3615a04d8eb69f0496eea09031858e2abf5c8653d77c36"
Jul 01 19:26:03.208935 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.208907    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ef2f029f3e8de66ec3615a04d8eb69f0496eea09031858e2abf5c8653d77c36"} err="failed to get container status \"4ef2f029f3e8de66ec3615a04d8eb69f0496eea09031858e2abf5c8653d77c36\": rpc error: code = NotFound desc = could not find container \"4ef2f029f3e8de66ec3615a04d8eb69f0496eea09031858e2abf5c8653d77c36\": container with ID starting with 4ef2f029f3e8de66ec3615a04d8eb69f0496eea09031858e2abf5c8653d77c36 not found: ID does not exist"
Jul 01 19:26:03.209020 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.208937    2556 scope.go:117] "RemoveContainer" containerID="dfd83901b577f550c78a4cec388545ec1478152ece446b1422c412957fc525ed"
Jul 01 19:26:03.209209 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.209188    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfd83901b577f550c78a4cec388545ec1478152ece446b1422c412957fc525ed"} err="failed to get container status \"dfd83901b577f550c78a4cec388545ec1478152ece446b1422c412957fc525ed\": rpc error: code = NotFound desc = could not find container \"dfd83901b577f550c78a4cec388545ec1478152ece446b1422c412957fc525ed\": container with ID starting with dfd83901b577f550c78a4cec388545ec1478152ece446b1422c412957fc525ed not found: ID does not exist"
Jul 01 19:26:03.209288 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.209210    2556 scope.go:117] "RemoveContainer" containerID="9f61f9411337b4162c325477f0d95211d2396174e0864f7e808732411646a9eb"
Jul 01 19:26:03.209547 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.209485    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f61f9411337b4162c325477f0d95211d2396174e0864f7e808732411646a9eb"} err="failed to get container status \"9f61f9411337b4162c325477f0d95211d2396174e0864f7e808732411646a9eb\": rpc error: code = NotFound desc = could not find container \"9f61f9411337b4162c325477f0d95211d2396174e0864f7e808732411646a9eb\": container with ID starting with 9f61f9411337b4162c325477f0d95211d2396174e0864f7e808732411646a9eb not found: ID does not exist"
Jul 01 19:26:03.209547 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.209542    2556 scope.go:117] "RemoveContainer" containerID="b7a22502c35486746ee665eea6a77e39fa93a45fb3b0277e4d95c7a7ae3877ed"
Jul 01 19:26:03.209815 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.209797    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7a22502c35486746ee665eea6a77e39fa93a45fb3b0277e4d95c7a7ae3877ed"} err="failed to get container status \"b7a22502c35486746ee665eea6a77e39fa93a45fb3b0277e4d95c7a7ae3877ed\": rpc error: code = NotFound desc = could not find container \"b7a22502c35486746ee665eea6a77e39fa93a45fb3b0277e4d95c7a7ae3877ed\": container with ID starting with b7a22502c35486746ee665eea6a77e39fa93a45fb3b0277e4d95c7a7ae3877ed not found: ID does not exist"
Jul 01 19:26:03.209815 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.209814    2556 scope.go:117] "RemoveContainer" containerID="df7e0dd4daeaf811caa5e2700520c8b94b57fc3df5e1689c16e19321de79747e"
Jul 01 19:26:03.210041 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.210022    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df7e0dd4daeaf811caa5e2700520c8b94b57fc3df5e1689c16e19321de79747e"} err="failed to get container status \"df7e0dd4daeaf811caa5e2700520c8b94b57fc3df5e1689c16e19321de79747e\": rpc error: code = NotFound desc = could not find container \"df7e0dd4daeaf811caa5e2700520c8b94b57fc3df5e1689c16e19321de79747e\": container with ID starting with df7e0dd4daeaf811caa5e2700520c8b94b57fc3df5e1689c16e19321de79747e not found: ID does not exist"
Jul 01 19:26:03.210110 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.210044    2556 scope.go:117] "RemoveContainer" containerID="21298a119f542c3c88c925946240f2781889eb9606e880921a68dfb3b1139004"
Jul 01 19:26:03.210320 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.210295    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21298a119f542c3c88c925946240f2781889eb9606e880921a68dfb3b1139004"} err="failed to get container status \"21298a119f542c3c88c925946240f2781889eb9606e880921a68dfb3b1139004\": rpc error: code = NotFound desc = could not find container \"21298a119f542c3c88c925946240f2781889eb9606e880921a68dfb3b1139004\": container with ID starting with 21298a119f542c3c88c925946240f2781889eb9606e880921a68dfb3b1139004 not found: ID does not exist"
Jul 01 19:26:03.210391 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.210323    2556 scope.go:117] "RemoveContainer" containerID="4c346b0a8d9323f5fe3504097cb5db02c1908284f9b422be9dd1d6ce5ddc1b39"
Jul 01 19:26:03.210595 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.210574    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c346b0a8d9323f5fe3504097cb5db02c1908284f9b422be9dd1d6ce5ddc1b39"} err="failed to get container status \"4c346b0a8d9323f5fe3504097cb5db02c1908284f9b422be9dd1d6ce5ddc1b39\": rpc error: code = NotFound desc = could not find container \"4c346b0a8d9323f5fe3504097cb5db02c1908284f9b422be9dd1d6ce5ddc1b39\": container with ID starting with 4c346b0a8d9323f5fe3504097cb5db02c1908284f9b422be9dd1d6ce5ddc1b39 not found: ID does not exist"
Jul 01 19:26:03.210686 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.210597    2556 scope.go:117] "RemoveContainer" containerID="4ef2f029f3e8de66ec3615a04d8eb69f0496eea09031858e2abf5c8653d77c36"
Jul 01 19:26:03.210839 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.210807    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ef2f029f3e8de66ec3615a04d8eb69f0496eea09031858e2abf5c8653d77c36"} err="failed to get container status \"4ef2f029f3e8de66ec3615a04d8eb69f0496eea09031858e2abf5c8653d77c36\": rpc error: code = NotFound desc = could not find container \"4ef2f029f3e8de66ec3615a04d8eb69f0496eea09031858e2abf5c8653d77c36\": container with ID starting with 4ef2f029f3e8de66ec3615a04d8eb69f0496eea09031858e2abf5c8653d77c36 not found: ID does not exist"
Jul 01 19:26:03.210839 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.210831    2556 scope.go:117] "RemoveContainer" containerID="dfd83901b577f550c78a4cec388545ec1478152ece446b1422c412957fc525ed"
Jul 01 19:26:03.211111 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.211086    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfd83901b577f550c78a4cec388545ec1478152ece446b1422c412957fc525ed"} err="failed to get container status \"dfd83901b577f550c78a4cec388545ec1478152ece446b1422c412957fc525ed\": rpc error: code = NotFound desc = could not find container \"dfd83901b577f550c78a4cec388545ec1478152ece446b1422c412957fc525ed\": container with ID starting with dfd83901b577f550c78a4cec388545ec1478152ece446b1422c412957fc525ed not found: ID does not exist"
Jul 01 19:26:03.211221 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.211113    2556 scope.go:117] "RemoveContainer" containerID="9f61f9411337b4162c325477f0d95211d2396174e0864f7e808732411646a9eb"
Jul 01 19:26:03.211221 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.211173    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 01 19:26:03.211573 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.211546    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f61f9411337b4162c325477f0d95211d2396174e0864f7e808732411646a9eb"} err="failed to get container status \"9f61f9411337b4162c325477f0d95211d2396174e0864f7e808732411646a9eb\": rpc error: code = NotFound desc = could not find container \"9f61f9411337b4162c325477f0d95211d2396174e0864f7e808732411646a9eb\": container with ID starting with 9f61f9411337b4162c325477f0d95211d2396174e0864f7e808732411646a9eb not found: ID does not exist"
Jul 01 19:26:03.213880 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.211574    2556 scope.go:117] "RemoveContainer" containerID="b7a22502c35486746ee665eea6a77e39fa93a45fb3b0277e4d95c7a7ae3877ed"
Jul 01 19:26:03.213880 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.211823    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7a22502c35486746ee665eea6a77e39fa93a45fb3b0277e4d95c7a7ae3877ed"} err="failed to get container status \"b7a22502c35486746ee665eea6a77e39fa93a45fb3b0277e4d95c7a7ae3877ed\": rpc error: code = NotFound desc = could not find container \"b7a22502c35486746ee665eea6a77e39fa93a45fb3b0277e4d95c7a7ae3877ed\": container with ID starting with b7a22502c35486746ee665eea6a77e39fa93a45fb3b0277e4d95c7a7ae3877ed not found: ID does not exist"
Jul 01 19:26:03.213880 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.211845    2556 scope.go:117] "RemoveContainer" containerID="df7e0dd4daeaf811caa5e2700520c8b94b57fc3df5e1689c16e19321de79747e"
Jul 01 19:26:03.213880 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.212061    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df7e0dd4daeaf811caa5e2700520c8b94b57fc3df5e1689c16e19321de79747e"} err="failed to get container status \"df7e0dd4daeaf811caa5e2700520c8b94b57fc3df5e1689c16e19321de79747e\": rpc error: code = NotFound desc = could not find container \"df7e0dd4daeaf811caa5e2700520c8b94b57fc3df5e1689c16e19321de79747e\": container with ID starting with df7e0dd4daeaf811caa5e2700520c8b94b57fc3df5e1689c16e19321de79747e not found: ID does not exist"
Jul 01 19:26:03.213880 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.212079    2556 scope.go:117] "RemoveContainer" containerID="21298a119f542c3c88c925946240f2781889eb9606e880921a68dfb3b1139004"
Jul 01 19:26:03.213880 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.212297    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21298a119f542c3c88c925946240f2781889eb9606e880921a68dfb3b1139004"} err="failed to get container status \"21298a119f542c3c88c925946240f2781889eb9606e880921a68dfb3b1139004\": rpc error: code = NotFound desc = could not find container \"21298a119f542c3c88c925946240f2781889eb9606e880921a68dfb3b1139004\": container with ID starting with 21298a119f542c3c88c925946240f2781889eb9606e880921a68dfb3b1139004 not found: ID does not exist"
Jul 01 19:26:03.213880 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.212318    2556 scope.go:117] "RemoveContainer" containerID="4c346b0a8d9323f5fe3504097cb5db02c1908284f9b422be9dd1d6ce5ddc1b39"
Jul 01 19:26:03.213880 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.212585    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c346b0a8d9323f5fe3504097cb5db02c1908284f9b422be9dd1d6ce5ddc1b39"} err="failed to get container status \"4c346b0a8d9323f5fe3504097cb5db02c1908284f9b422be9dd1d6ce5ddc1b39\": rpc error: code = NotFound desc = could not find container \"4c346b0a8d9323f5fe3504097cb5db02c1908284f9b422be9dd1d6ce5ddc1b39\": container with ID starting with 4c346b0a8d9323f5fe3504097cb5db02c1908284f9b422be9dd1d6ce5ddc1b39 not found: ID does not exist"
Jul 01 19:26:03.213880 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.212604    2556 scope.go:117] "RemoveContainer" containerID="4ef2f029f3e8de66ec3615a04d8eb69f0496eea09031858e2abf5c8653d77c36"
Jul 01 19:26:03.213880 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.212836    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ef2f029f3e8de66ec3615a04d8eb69f0496eea09031858e2abf5c8653d77c36"} err="failed to get container status \"4ef2f029f3e8de66ec3615a04d8eb69f0496eea09031858e2abf5c8653d77c36\": rpc error: code = NotFound desc = could not find container \"4ef2f029f3e8de66ec3615a04d8eb69f0496eea09031858e2abf5c8653d77c36\": container with ID starting with 4ef2f029f3e8de66ec3615a04d8eb69f0496eea09031858e2abf5c8653d77c36 not found: ID does not exist"
Jul 01 19:26:03.213880 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.212856    2556 scope.go:117] "RemoveContainer" containerID="dfd83901b577f550c78a4cec388545ec1478152ece446b1422c412957fc525ed"
Jul 01 19:26:03.213880 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.213104    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfd83901b577f550c78a4cec388545ec1478152ece446b1422c412957fc525ed"} err="failed to get container status \"dfd83901b577f550c78a4cec388545ec1478152ece446b1422c412957fc525ed\": rpc error: code = NotFound desc = could not find container \"dfd83901b577f550c78a4cec388545ec1478152ece446b1422c412957fc525ed\": container with ID starting with dfd83901b577f550c78a4cec388545ec1478152ece446b1422c412957fc525ed not found: ID does not exist"
Jul 01 19:26:03.213880 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.213124    2556 scope.go:117] "RemoveContainer" containerID="9f61f9411337b4162c325477f0d95211d2396174e0864f7e808732411646a9eb"
Jul 01 19:26:03.213880 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.213574    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f61f9411337b4162c325477f0d95211d2396174e0864f7e808732411646a9eb"} err="failed to get container status \"9f61f9411337b4162c325477f0d95211d2396174e0864f7e808732411646a9eb\": rpc error: code = NotFound desc = could not find container \"9f61f9411337b4162c325477f0d95211d2396174e0864f7e808732411646a9eb\": container with ID starting with 9f61f9411337b4162c325477f0d95211d2396174e0864f7e808732411646a9eb not found: ID does not exist"
Jul 01 19:26:03.213880 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.213596    2556 scope.go:117] "RemoveContainer" containerID="b7a22502c35486746ee665eea6a77e39fa93a45fb3b0277e4d95c7a7ae3877ed"
Jul 01 19:26:03.214771 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.214508    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7a22502c35486746ee665eea6a77e39fa93a45fb3b0277e4d95c7a7ae3877ed"} err="failed to get container status \"b7a22502c35486746ee665eea6a77e39fa93a45fb3b0277e4d95c7a7ae3877ed\": rpc error: code = NotFound desc = could not find container \"b7a22502c35486746ee665eea6a77e39fa93a45fb3b0277e4d95c7a7ae3877ed\": container with ID starting with b7a22502c35486746ee665eea6a77e39fa93a45fb3b0277e4d95c7a7ae3877ed not found: ID does not exist"
Jul 01 19:26:03.214771 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.214545    2556 scope.go:117] "RemoveContainer" containerID="df7e0dd4daeaf811caa5e2700520c8b94b57fc3df5e1689c16e19321de79747e"
Jul 01 19:26:03.214882 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.214846    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df7e0dd4daeaf811caa5e2700520c8b94b57fc3df5e1689c16e19321de79747e"} err="failed to get container status \"df7e0dd4daeaf811caa5e2700520c8b94b57fc3df5e1689c16e19321de79747e\": rpc error: code = NotFound desc = could not find container \"df7e0dd4daeaf811caa5e2700520c8b94b57fc3df5e1689c16e19321de79747e\": container with ID starting with df7e0dd4daeaf811caa5e2700520c8b94b57fc3df5e1689c16e19321de79747e not found: ID does not exist"
Jul 01 19:26:03.214922 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.214883    2556 scope.go:117] "RemoveContainer" containerID="21298a119f542c3c88c925946240f2781889eb9606e880921a68dfb3b1139004"
Jul 01 19:26:03.215187 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.215160    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21298a119f542c3c88c925946240f2781889eb9606e880921a68dfb3b1139004"} err="failed to get container status \"21298a119f542c3c88c925946240f2781889eb9606e880921a68dfb3b1139004\": rpc error: code = NotFound desc = could not find container \"21298a119f542c3c88c925946240f2781889eb9606e880921a68dfb3b1139004\": container with ID starting with 21298a119f542c3c88c925946240f2781889eb9606e880921a68dfb3b1139004 not found: ID does not exist"
Jul 01 19:26:03.215187 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.215188    2556 scope.go:117] "RemoveContainer" containerID="4c346b0a8d9323f5fe3504097cb5db02c1908284f9b422be9dd1d6ce5ddc1b39"
Jul 01 19:26:03.215486 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.215465    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c346b0a8d9323f5fe3504097cb5db02c1908284f9b422be9dd1d6ce5ddc1b39"} err="failed to get container status \"4c346b0a8d9323f5fe3504097cb5db02c1908284f9b422be9dd1d6ce5ddc1b39\": rpc error: code = NotFound desc = could not find container \"4c346b0a8d9323f5fe3504097cb5db02c1908284f9b422be9dd1d6ce5ddc1b39\": container with ID starting with 4c346b0a8d9323f5fe3504097cb5db02c1908284f9b422be9dd1d6ce5ddc1b39 not found: ID does not exist"
Jul 01 19:26:03.215486 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.215484    2556 scope.go:117] "RemoveContainer" containerID="4ef2f029f3e8de66ec3615a04d8eb69f0496eea09031858e2abf5c8653d77c36"
Jul 01 19:26:03.215747 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.215724    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ef2f029f3e8de66ec3615a04d8eb69f0496eea09031858e2abf5c8653d77c36"} err="failed to get container status \"4ef2f029f3e8de66ec3615a04d8eb69f0496eea09031858e2abf5c8653d77c36\": rpc error: code = NotFound desc = could not find container \"4ef2f029f3e8de66ec3615a04d8eb69f0496eea09031858e2abf5c8653d77c36\": container with ID starting with 4ef2f029f3e8de66ec3615a04d8eb69f0496eea09031858e2abf5c8653d77c36 not found: ID does not exist"
Jul 01 19:26:03.215747 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.215746    2556 scope.go:117] "RemoveContainer" containerID="dfd83901b577f550c78a4cec388545ec1478152ece446b1422c412957fc525ed"
Jul 01 19:26:03.216013 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.215993    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfd83901b577f550c78a4cec388545ec1478152ece446b1422c412957fc525ed"} err="failed to get container status \"dfd83901b577f550c78a4cec388545ec1478152ece446b1422c412957fc525ed\": rpc error: code = NotFound desc = could not find container \"dfd83901b577f550c78a4cec388545ec1478152ece446b1422c412957fc525ed\": container with ID starting with dfd83901b577f550c78a4cec388545ec1478152ece446b1422c412957fc525ed not found: ID does not exist"
Jul 01 19:26:03.216013 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.216012    2556 scope.go:117] "RemoveContainer" containerID="9f61f9411337b4162c325477f0d95211d2396174e0864f7e808732411646a9eb"
Jul 01 19:26:03.216183 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.216159    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 01 19:26:03.216253 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.216207    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f61f9411337b4162c325477f0d95211d2396174e0864f7e808732411646a9eb"} err="failed to get container status \"9f61f9411337b4162c325477f0d95211d2396174e0864f7e808732411646a9eb\": rpc error: code = NotFound desc = could not find container \"9f61f9411337b4162c325477f0d95211d2396174e0864f7e808732411646a9eb\": container with ID starting with 9f61f9411337b4162c325477f0d95211d2396174e0864f7e808732411646a9eb not found: ID does not exist"
Jul 01 19:26:03.216253 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.216231    2556 scope.go:117] "RemoveContainer" containerID="b7a22502c35486746ee665eea6a77e39fa93a45fb3b0277e4d95c7a7ae3877ed"
Jul 01 19:26:03.216492 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.216475    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7a22502c35486746ee665eea6a77e39fa93a45fb3b0277e4d95c7a7ae3877ed"} err="failed to get container status \"b7a22502c35486746ee665eea6a77e39fa93a45fb3b0277e4d95c7a7ae3877ed\": rpc error: code = NotFound desc = could not find container \"b7a22502c35486746ee665eea6a77e39fa93a45fb3b0277e4d95c7a7ae3877ed\": container with ID starting with b7a22502c35486746ee665eea6a77e39fa93a45fb3b0277e4d95c7a7ae3877ed not found: ID does not exist"
Jul 01 19:26:03.216540 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.216493    2556 scope.go:117] "RemoveContainer" containerID="df7e0dd4daeaf811caa5e2700520c8b94b57fc3df5e1689c16e19321de79747e"
Jul 01 19:26:03.216729 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.216705    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df7e0dd4daeaf811caa5e2700520c8b94b57fc3df5e1689c16e19321de79747e"} err="failed to get container status \"df7e0dd4daeaf811caa5e2700520c8b94b57fc3df5e1689c16e19321de79747e\": rpc error: code = NotFound desc = could not find container \"df7e0dd4daeaf811caa5e2700520c8b94b57fc3df5e1689c16e19321de79747e\": container with ID starting with df7e0dd4daeaf811caa5e2700520c8b94b57fc3df5e1689c16e19321de79747e not found: ID does not exist"
Jul 01 19:26:03.216729 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.216728    2556 scope.go:117] "RemoveContainer" containerID="21298a119f542c3c88c925946240f2781889eb9606e880921a68dfb3b1139004"
Jul 01 19:26:03.217070 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.217014    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21298a119f542c3c88c925946240f2781889eb9606e880921a68dfb3b1139004"} err="failed to get container status \"21298a119f542c3c88c925946240f2781889eb9606e880921a68dfb3b1139004\": rpc error: code = NotFound desc = could not find container \"21298a119f542c3c88c925946240f2781889eb9606e880921a68dfb3b1139004\": container with ID starting with 21298a119f542c3c88c925946240f2781889eb9606e880921a68dfb3b1139004 not found: ID does not exist"
Jul 01 19:26:03.217070 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.217041    2556 scope.go:117] "RemoveContainer" containerID="4c346b0a8d9323f5fe3504097cb5db02c1908284f9b422be9dd1d6ce5ddc1b39"
Jul 01 19:26:03.217348 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.217327    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c346b0a8d9323f5fe3504097cb5db02c1908284f9b422be9dd1d6ce5ddc1b39"} err="failed to get container status \"4c346b0a8d9323f5fe3504097cb5db02c1908284f9b422be9dd1d6ce5ddc1b39\": rpc error: code = NotFound desc = could not find container \"4c346b0a8d9323f5fe3504097cb5db02c1908284f9b422be9dd1d6ce5ddc1b39\": container with ID starting with 4c346b0a8d9323f5fe3504097cb5db02c1908284f9b422be9dd1d6ce5ddc1b39 not found: ID does not exist"
Jul 01 19:26:03.217457 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.217350    2556 scope.go:117] "RemoveContainer" containerID="4ef2f029f3e8de66ec3615a04d8eb69f0496eea09031858e2abf5c8653d77c36"
Jul 01 19:26:03.217589 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.217571    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ef2f029f3e8de66ec3615a04d8eb69f0496eea09031858e2abf5c8653d77c36"} err="failed to get container status \"4ef2f029f3e8de66ec3615a04d8eb69f0496eea09031858e2abf5c8653d77c36\": rpc error: code = NotFound desc = could not find container \"4ef2f029f3e8de66ec3615a04d8eb69f0496eea09031858e2abf5c8653d77c36\": container with ID starting with 4ef2f029f3e8de66ec3615a04d8eb69f0496eea09031858e2abf5c8653d77c36 not found: ID does not exist"
Jul 01 19:26:03.217649 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.217590    2556 scope.go:117] "RemoveContainer" containerID="dfd83901b577f550c78a4cec388545ec1478152ece446b1422c412957fc525ed"
Jul 01 19:26:03.217838 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.217822    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfd83901b577f550c78a4cec388545ec1478152ece446b1422c412957fc525ed"} err="failed to get container status \"dfd83901b577f550c78a4cec388545ec1478152ece446b1422c412957fc525ed\": rpc error: code = NotFound desc = could not find container \"dfd83901b577f550c78a4cec388545ec1478152ece446b1422c412957fc525ed\": container with ID starting with dfd83901b577f550c78a4cec388545ec1478152ece446b1422c412957fc525ed not found: ID does not exist"
Jul 01 19:26:03.269992 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.269948    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/010d6a47-a972-4421-8041-6060b67c427c-web-config\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.269992 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.269992    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/010d6a47-a972-4421-8041-6060b67c427c-config-out\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.270202 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.270035    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/010d6a47-a972-4421-8041-6060b67c427c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.270202 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.270061    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/010d6a47-a972-4421-8041-6060b67c427c-config\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.270202 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.270084    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/010d6a47-a972-4421-8041-6060b67c427c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.270202 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.270107    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/010d6a47-a972-4421-8041-6060b67c427c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.270202 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.270136    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/010d6a47-a972-4421-8041-6060b67c427c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.270202 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.270153    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/010d6a47-a972-4421-8041-6060b67c427c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.270202 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.270172    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/010d6a47-a972-4421-8041-6060b67c427c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.270437 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.270205    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/010d6a47-a972-4421-8041-6060b67c427c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.270437 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.270223    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/010d6a47-a972-4421-8041-6060b67c427c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.270437 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.270240    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/010d6a47-a972-4421-8041-6060b67c427c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.270437 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.270283    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/010d6a47-a972-4421-8041-6060b67c427c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.270437 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.270323    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/010d6a47-a972-4421-8041-6060b67c427c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.270437 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.270346    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/010d6a47-a972-4421-8041-6060b67c427c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.270437 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.270363    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/010d6a47-a972-4421-8041-6060b67c427c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.270437 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.270407    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/010d6a47-a972-4421-8041-6060b67c427c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.270437 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.270431    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvpbv\" (UniqueName: \"kubernetes.io/projected/010d6a47-a972-4421-8041-6060b67c427c-kube-api-access-vvpbv\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.270688 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.270448    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/010d6a47-a972-4421-8041-6060b67c427c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.270688 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.270489    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/010d6a47-a972-4421-8041-6060b67c427c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.371748 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.371702    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/010d6a47-a972-4421-8041-6060b67c427c-web-config\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.371748 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.371748    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/010d6a47-a972-4421-8041-6060b67c427c-config-out\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.371995 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.371769    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/010d6a47-a972-4421-8041-6060b67c427c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.371995 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.371893    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/010d6a47-a972-4421-8041-6060b67c427c-config\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.371995 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.371949    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/010d6a47-a972-4421-8041-6060b67c427c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.371995 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.371973    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/010d6a47-a972-4421-8041-6060b67c427c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.372196 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.372004    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/010d6a47-a972-4421-8041-6060b67c427c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.372196 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.372024    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/010d6a47-a972-4421-8041-6060b67c427c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.372196 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.372048    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/010d6a47-a972-4421-8041-6060b67c427c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.372196 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.372107    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/010d6a47-a972-4421-8041-6060b67c427c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.372196 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.372139    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/010d6a47-a972-4421-8041-6060b67c427c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.372196 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.372177    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/010d6a47-a972-4421-8041-6060b67c427c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.372705 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.372199    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/010d6a47-a972-4421-8041-6060b67c427c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.372705 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.372227    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/010d6a47-a972-4421-8041-6060b67c427c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.372705 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.372265    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/010d6a47-a972-4421-8041-6060b67c427c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.372705 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.372291    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/010d6a47-a972-4421-8041-6060b67c427c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.372705 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.372330    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/010d6a47-a972-4421-8041-6060b67c427c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.372705 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.372358    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvpbv\" (UniqueName: \"kubernetes.io/projected/010d6a47-a972-4421-8041-6060b67c427c-kube-api-access-vvpbv\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.372705 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.372447    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/010d6a47-a972-4421-8041-6060b67c427c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.372705 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.372491    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/010d6a47-a972-4421-8041-6060b67c427c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.372705 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.372551    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/010d6a47-a972-4421-8041-6060b67c427c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.372705 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.372700    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/010d6a47-a972-4421-8041-6060b67c427c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.373304 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.372804    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/010d6a47-a972-4421-8041-6060b67c427c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.375397 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.374827    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/010d6a47-a972-4421-8041-6060b67c427c-config-out\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.375397 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.374962    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/010d6a47-a972-4421-8041-6060b67c427c-web-config\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.375397 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.375060    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/010d6a47-a972-4421-8041-6060b67c427c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.375397 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.375209    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/010d6a47-a972-4421-8041-6060b67c427c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.375696 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.375475    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/010d6a47-a972-4421-8041-6060b67c427c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.375696 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.375528    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/010d6a47-a972-4421-8041-6060b67c427c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.375696 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.375671    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/010d6a47-a972-4421-8041-6060b67c427c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.376397 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.376137    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/010d6a47-a972-4421-8041-6060b67c427c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.376397 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.376137    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/010d6a47-a972-4421-8041-6060b67c427c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.376567 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.376452    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/010d6a47-a972-4421-8041-6060b67c427c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.376567 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.376463    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/010d6a47-a972-4421-8041-6060b67c427c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.377339 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.377311    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/010d6a47-a972-4421-8041-6060b67c427c-config\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.377571 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.377548    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/010d6a47-a972-4421-8041-6060b67c427c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.377702 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.377686    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/010d6a47-a972-4421-8041-6060b67c427c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.378199 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.378176    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/010d6a47-a972-4421-8041-6060b67c427c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.378475 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.378458    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/010d6a47-a972-4421-8041-6060b67c427c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.383036 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.383016    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvpbv\" (UniqueName: \"kubernetes.io/projected/010d6a47-a972-4421-8041-6060b67c427c-kube-api-access-vvpbv\") pod \"prometheus-k8s-0\" (UID: \"010d6a47-a972-4421-8041-6060b67c427c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.512342 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.512306    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:26:03.649889 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:03.649855    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 01 19:26:03.652889 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:26:03.652863    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod010d6a47_a972_4421_8041_6060b67c427c.slice/crio-970bd2531aadf9984fba08d6d9e86f18e2af1b7d841ff6c86542dbc0ef2de880 WatchSource:0}: Error finding container 970bd2531aadf9984fba08d6d9e86f18e2af1b7d841ff6c86542dbc0ef2de880: Status 404 returned error can't find the container with id 970bd2531aadf9984fba08d6d9e86f18e2af1b7d841ff6c86542dbc0ef2de880
Jul 01 19:26:04.146957 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:04.146915    2556 generic.go:356] "Generic (PLEG): container finished" podID="010d6a47-a972-4421-8041-6060b67c427c" containerID="d521d6b81c3c2df711e42ca49baf9d9b063a43949843a2516734c2fabbd44375" exitCode=0
Jul 01 19:26:04.147364 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:04.146999    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"010d6a47-a972-4421-8041-6060b67c427c","Type":"ContainerDied","Data":"d521d6b81c3c2df711e42ca49baf9d9b063a43949843a2516734c2fabbd44375"}
Jul 01 19:26:04.147364 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:04.147072    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"010d6a47-a972-4421-8041-6060b67c427c","Type":"ContainerStarted","Data":"970bd2531aadf9984fba08d6d9e86f18e2af1b7d841ff6c86542dbc0ef2de880"}
Jul 01 19:26:04.255612 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:04.255572    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="304aab4c-2394-418b-bc9d-d8169f55974c" path="/var/lib/kubelet/pods/304aab4c-2394-418b-bc9d-d8169f55974c/volumes"
Jul 01 19:26:05.155935 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:05.155903    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"010d6a47-a972-4421-8041-6060b67c427c","Type":"ContainerStarted","Data":"96b9387d8ba41a3d6726af7aac57813879bb20da50229aba859b1394063327ad"}
Jul 01 19:26:05.156301 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:05.155974    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"010d6a47-a972-4421-8041-6060b67c427c","Type":"ContainerStarted","Data":"502990216e06a29ce26129c1df193135295b005e541c5688a6d40e711301f20b"}
Jul 01 19:26:05.156301 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:05.156002    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"010d6a47-a972-4421-8041-6060b67c427c","Type":"ContainerStarted","Data":"66c9cbc763be3fc226c407ae4f1be79a53bbcd7a806fc41df5c2026f4772ac61"}
Jul 01 19:26:05.156301 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:05.156040    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"010d6a47-a972-4421-8041-6060b67c427c","Type":"ContainerStarted","Data":"42e4a5da49edb0d19f38b63c13b0769b8b755ddb144480d4a46b815176669595"}
Jul 01 19:26:05.156301 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:05.156067    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"010d6a47-a972-4421-8041-6060b67c427c","Type":"ContainerStarted","Data":"e989a5eb2e6d36718a9d411b8ee3d30f02beda2e3fc6217ec3152d837ba04e15"}
Jul 01 19:26:05.156301 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:05.156093    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"010d6a47-a972-4421-8041-6060b67c427c","Type":"ContainerStarted","Data":"4f28556aa43e301a333091e6d7e6b311585055f94d05d69936d4cd251068bb34"}
Jul 01 19:26:05.183269 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:05.183217    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.1658989 podStartE2EDuration="2.183197641s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.298741ms" isStatefulPod=false podCreationTimestamp="2026-07-01 19:26:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:26:05.18095317 +0000 UTC m=+149.543964851" watchObservedRunningTime="2026-07-01 19:26:05.183197641 +0000 UTC m=+149.546209324"
Jul 01 19:26:08.513105 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:26:08.513074    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:27:03.512870 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:27:03.512818    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:27:03.528665 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:27:03.528638    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:27:04.408784 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:27:04.408758    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 01 19:28:31.824666 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:28:31.824584    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-fxp2k"]
Jul 01 19:28:31.826891 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:28:31.826874    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-fxp2k"
Jul 01 19:28:31.828932 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:28:31.828909    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
Jul 01 19:28:31.829033 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:28:31.828909    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-s849z\""
Jul 01 19:28:31.829834 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:28:31.829812    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Jul 01 19:28:31.829944 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:28:31.829861    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Jul 01 19:28:31.839678 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:28:31.839654    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-fxp2k"]
Jul 01 19:28:31.939432 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:28:31.939400    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/50f73e8c-efca-4c6a-91b8-742f25830cad-data\") pod \"seaweedfs-64568bcd49-fxp2k\" (UID: \"50f73e8c-efca-4c6a-91b8-742f25830cad\") " pod="kserve/seaweedfs-64568bcd49-fxp2k"
Jul 01 19:28:31.939432 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:28:31.939434    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7n5z\" (UniqueName: \"kubernetes.io/projected/50f73e8c-efca-4c6a-91b8-742f25830cad-kube-api-access-k7n5z\") pod \"seaweedfs-64568bcd49-fxp2k\" (UID: \"50f73e8c-efca-4c6a-91b8-742f25830cad\") " pod="kserve/seaweedfs-64568bcd49-fxp2k"
Jul 01 19:28:32.040666 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:28:32.040625    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/50f73e8c-efca-4c6a-91b8-742f25830cad-data\") pod \"seaweedfs-64568bcd49-fxp2k\" (UID: \"50f73e8c-efca-4c6a-91b8-742f25830cad\") " pod="kserve/seaweedfs-64568bcd49-fxp2k"
Jul 01 19:28:32.040666 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:28:32.040663    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7n5z\" (UniqueName: \"kubernetes.io/projected/50f73e8c-efca-4c6a-91b8-742f25830cad-kube-api-access-k7n5z\") pod \"seaweedfs-64568bcd49-fxp2k\" (UID: \"50f73e8c-efca-4c6a-91b8-742f25830cad\") " pod="kserve/seaweedfs-64568bcd49-fxp2k"
Jul 01 19:28:32.041009 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:28:32.040990    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/50f73e8c-efca-4c6a-91b8-742f25830cad-data\") pod \"seaweedfs-64568bcd49-fxp2k\" (UID: \"50f73e8c-efca-4c6a-91b8-742f25830cad\") " pod="kserve/seaweedfs-64568bcd49-fxp2k"
Jul 01 19:28:32.071038 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:28:32.071013    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7n5z\" (UniqueName: \"kubernetes.io/projected/50f73e8c-efca-4c6a-91b8-742f25830cad-kube-api-access-k7n5z\") pod \"seaweedfs-64568bcd49-fxp2k\" (UID: \"50f73e8c-efca-4c6a-91b8-742f25830cad\") " pod="kserve/seaweedfs-64568bcd49-fxp2k"
Jul 01 19:28:32.137265 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:28:32.137179    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-fxp2k"
Jul 01 19:28:32.264283 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:28:32.264260    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-fxp2k"]
Jul 01 19:28:32.266715 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:28:32.266685    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50f73e8c_efca_4c6a_91b8_742f25830cad.slice/crio-8a4784c4d6d4de0bab919122269d678b757088b3703e2aab5dfad1821d639313 WatchSource:0}: Error finding container 8a4784c4d6d4de0bab919122269d678b757088b3703e2aab5dfad1821d639313: Status 404 returned error can't find the container with id 8a4784c4d6d4de0bab919122269d678b757088b3703e2aab5dfad1821d639313
Jul 01 19:28:32.745149 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:28:32.745106    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-fxp2k" event={"ID":"50f73e8c-efca-4c6a-91b8-742f25830cad","Type":"ContainerStarted","Data":"8a4784c4d6d4de0bab919122269d678b757088b3703e2aab5dfad1821d639313"}
Jul 01 19:28:34.758106 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:28:34.758052    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-fxp2k" event={"ID":"50f73e8c-efca-4c6a-91b8-742f25830cad","Type":"ContainerStarted","Data":"33e1ac90e3c4cc5d1d28806c5b23cd54fe27def423d0ad1f28ff4c3626580928"}
Jul 01 19:28:34.758600 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:28:34.758183    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-fxp2k"
Jul 01 19:28:34.784935 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:28:34.784887    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-fxp2k" podStartSLOduration=1.3960295870000001 podStartE2EDuration="3.784872563s" totalImagesPullingTime="2.388842976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:28:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:28:34.784093569 +0000 UTC m=+299.147105250" watchObservedRunningTime="2026-07-01 19:28:34.784872563 +0000 UTC m=+299.147884243"
Jul 01 19:28:36.171556 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:28:36.171526    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tq4l_d621ab71-8427-42af-bfa4-f83db9c5800d/ovn-acl-logging/0.log"
Jul 01 19:28:36.178298 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:28:36.178273    2556 kubelet.go:1648] "Image garbage collection succeeded"
Jul 01 19:28:36.180887 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:28:36.180867    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tq4l_d621ab71-8427-42af-bfa4-f83db9c5800d/ovn-acl-logging/0.log"
Jul 01 19:28:40.764027 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:28:40.763997    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-fxp2k"
Jul 01 19:29:42.774275 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:29:42.774240    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-84b54b7f97-z6mvd"]
Jul 01 19:29:42.777848 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:29:42.777828    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-z6mvd"
Jul 01 19:29:42.780569 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:29:42.780549    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-hml9r\""
Jul 01 19:29:42.781346 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:29:42.781333    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\""
Jul 01 19:29:42.791953 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:29:42.791922    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-z6mvd"]
Jul 01 19:29:42.853248 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:29:42.853211    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-628nv\" (UniqueName: \"kubernetes.io/projected/42493882-d207-4c4a-a39e-3487781ee626-kube-api-access-628nv\") pod \"odh-model-controller-84b54b7f97-z6mvd\" (UID: \"42493882-d207-4c4a-a39e-3487781ee626\") " pod="kserve/odh-model-controller-84b54b7f97-z6mvd"
Jul 01 19:29:42.853248 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:29:42.853253    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42493882-d207-4c4a-a39e-3487781ee626-cert\") pod \"odh-model-controller-84b54b7f97-z6mvd\" (UID: \"42493882-d207-4c4a-a39e-3487781ee626\") " pod="kserve/odh-model-controller-84b54b7f97-z6mvd"
Jul 01 19:29:42.953780 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:29:42.953734    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-628nv\" (UniqueName: \"kubernetes.io/projected/42493882-d207-4c4a-a39e-3487781ee626-kube-api-access-628nv\") pod \"odh-model-controller-84b54b7f97-z6mvd\" (UID: \"42493882-d207-4c4a-a39e-3487781ee626\") " pod="kserve/odh-model-controller-84b54b7f97-z6mvd"
Jul 01 19:29:42.953780 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:29:42.953784    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42493882-d207-4c4a-a39e-3487781ee626-cert\") pod \"odh-model-controller-84b54b7f97-z6mvd\" (UID: \"42493882-d207-4c4a-a39e-3487781ee626\") " pod="kserve/odh-model-controller-84b54b7f97-z6mvd"
Jul 01 19:29:42.956306 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:29:42.956277    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42493882-d207-4c4a-a39e-3487781ee626-cert\") pod \"odh-model-controller-84b54b7f97-z6mvd\" (UID: \"42493882-d207-4c4a-a39e-3487781ee626\") " pod="kserve/odh-model-controller-84b54b7f97-z6mvd"
Jul 01 19:29:42.966217 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:29:42.966189    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-628nv\" (UniqueName: \"kubernetes.io/projected/42493882-d207-4c4a-a39e-3487781ee626-kube-api-access-628nv\") pod \"odh-model-controller-84b54b7f97-z6mvd\" (UID: \"42493882-d207-4c4a-a39e-3487781ee626\") " pod="kserve/odh-model-controller-84b54b7f97-z6mvd"
Jul 01 19:29:43.088284 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:29:43.088197    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-z6mvd"
Jul 01 19:29:43.231795 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:29:43.231771    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-z6mvd"]
Jul 01 19:29:43.233764 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:29:43.233729    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42493882_d207_4c4a_a39e_3487781ee626.slice/crio-5592e4fea29f5e812bddd3ba7a9e6449e7441009076d4d07dad09067abcd6772 WatchSource:0}: Error finding container 5592e4fea29f5e812bddd3ba7a9e6449e7441009076d4d07dad09067abcd6772: Status 404 returned error can't find the container with id 5592e4fea29f5e812bddd3ba7a9e6449e7441009076d4d07dad09067abcd6772
Jul 01 19:29:43.235073 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:29:43.235056    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 01 19:29:44.038507 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:29:44.038454    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-z6mvd" event={"ID":"42493882-d207-4c4a-a39e-3487781ee626","Type":"ContainerStarted","Data":"5592e4fea29f5e812bddd3ba7a9e6449e7441009076d4d07dad09067abcd6772"}
Jul 01 19:29:47.056501 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:29:47.056467    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-z6mvd" event={"ID":"42493882-d207-4c4a-a39e-3487781ee626","Type":"ContainerStarted","Data":"0ab5fcf0bfdc69b9010c2787197870ff5d5f349eee56cffef1cef46936ce99d0"}
Jul 01 19:29:47.056893 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:29:47.056590    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-84b54b7f97-z6mvd"
Jul 01 19:29:47.080259 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:29:47.080200    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/odh-model-controller-84b54b7f97-z6mvd" podStartSLOduration=2.179806339 podStartE2EDuration="5.080184828s" totalImagesPullingTime="2.900378489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:29:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:29:47.079408236 +0000 UTC m=+371.442419917" watchObservedRunningTime="2026-07-01 19:29:47.080184828 +0000 UTC m=+371.443196508"
Jul 01 19:29:58.065213 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:29:58.065177    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-84b54b7f97-z6mvd"
Jul 01 19:29:58.862876 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:29:58.862843    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-cs7pm"]
Jul 01 19:29:58.866098 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:29:58.866082    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-cs7pm"
Jul 01 19:29:58.874716 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:29:58.874692    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-cs7pm"]
Jul 01 19:29:58.995920 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:29:58.995881    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgjqj\" (UniqueName: \"kubernetes.io/projected/d0b6865b-dde3-49a0-9082-d539ad3f049b-kube-api-access-dgjqj\") pod \"s3-init-cs7pm\" (UID: \"d0b6865b-dde3-49a0-9082-d539ad3f049b\") " pod="kserve/s3-init-cs7pm"
Jul 01 19:29:58.995920 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:29:58.995919    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0b6865b-dde3-49a0-9082-d539ad3f049b-model-cache\") pod \"s3-init-cs7pm\" (UID: \"d0b6865b-dde3-49a0-9082-d539ad3f049b\") " pod="kserve/s3-init-cs7pm"
Jul 01 19:29:59.096769 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:29:59.096733    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgjqj\" (UniqueName: \"kubernetes.io/projected/d0b6865b-dde3-49a0-9082-d539ad3f049b-kube-api-access-dgjqj\") pod \"s3-init-cs7pm\" (UID: \"d0b6865b-dde3-49a0-9082-d539ad3f049b\") " pod="kserve/s3-init-cs7pm"
Jul 01 19:29:59.096769 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:29:59.096773    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0b6865b-dde3-49a0-9082-d539ad3f049b-model-cache\") pod \"s3-init-cs7pm\" (UID: \"d0b6865b-dde3-49a0-9082-d539ad3f049b\") " pod="kserve/s3-init-cs7pm"
Jul 01 19:29:59.097192 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:29:59.097086    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0b6865b-dde3-49a0-9082-d539ad3f049b-model-cache\") pod \"s3-init-cs7pm\" (UID: \"d0b6865b-dde3-49a0-9082-d539ad3f049b\") " pod="kserve/s3-init-cs7pm"
Jul 01 19:29:59.106857 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:29:59.106831    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgjqj\" (UniqueName: \"kubernetes.io/projected/d0b6865b-dde3-49a0-9082-d539ad3f049b-kube-api-access-dgjqj\") pod \"s3-init-cs7pm\" (UID: \"d0b6865b-dde3-49a0-9082-d539ad3f049b\") " pod="kserve/s3-init-cs7pm"
Jul 01 19:29:59.182781 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:29:59.182753    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-cs7pm"
Jul 01 19:29:59.333645 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:29:59.333612    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-cs7pm"]
Jul 01 19:29:59.339028 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:29:59.338996    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0b6865b_dde3_49a0_9082_d539ad3f049b.slice/crio-8ae6e17c06a357c2009c638bb27b568f2e32deb7e312f858e4146ee459234768 WatchSource:0}: Error finding container 8ae6e17c06a357c2009c638bb27b568f2e32deb7e312f858e4146ee459234768: Status 404 returned error can't find the container with id 8ae6e17c06a357c2009c638bb27b568f2e32deb7e312f858e4146ee459234768
Jul 01 19:30:00.112419 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:30:00.112388    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-cs7pm" event={"ID":"d0b6865b-dde3-49a0-9082-d539ad3f049b","Type":"ContainerStarted","Data":"8ae6e17c06a357c2009c638bb27b568f2e32deb7e312f858e4146ee459234768"}
Jul 01 19:30:03.128381 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:30:03.128278    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-cs7pm" event={"ID":"d0b6865b-dde3-49a0-9082-d539ad3f049b","Type":"ContainerStarted","Data":"b6d6b9b70a5312939a4ef5096e9a8f65844919beb73926b0d82a5f350e8b7fcb"}
Jul 01 19:30:05.138959 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:30:05.138927    2556 generic.go:356] "Generic (PLEG): container finished" podID="d0b6865b-dde3-49a0-9082-d539ad3f049b" containerID="b6d6b9b70a5312939a4ef5096e9a8f65844919beb73926b0d82a5f350e8b7fcb" exitCode=0
Jul 01 19:30:05.139337 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:30:05.138985    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-cs7pm" event={"ID":"d0b6865b-dde3-49a0-9082-d539ad3f049b","Type":"ContainerDied","Data":"b6d6b9b70a5312939a4ef5096e9a8f65844919beb73926b0d82a5f350e8b7fcb"}
Jul 01 19:30:11.170830 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:30:11.170786    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-cs7pm" event={"ID":"d0b6865b-dde3-49a0-9082-d539ad3f049b","Type":"ContainerStarted","Data":"7086a7ae5b38dcee3a54a9ca20f90e7c829e02674039ca5a2a095b4836454cd0"}
Jul 01 19:30:11.195239 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:30:11.195185    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-cs7pm" podStartSLOduration=2.59866156 podStartE2EDuration="13.195169755s" totalImagesPullingTime="8.785359936s" totalInitContainerRuntime="1.811148259s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:29:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:30:11.193789235 +0000 UTC m=+395.556800918" watchObservedRunningTime="2026-07-01 19:30:11.195169755 +0000 UTC m=+395.558181436"
Jul 01 19:31:16.436064 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:16.436029    2556 generic.go:356] "Generic (PLEG): container finished" podID="d0b6865b-dde3-49a0-9082-d539ad3f049b" containerID="7086a7ae5b38dcee3a54a9ca20f90e7c829e02674039ca5a2a095b4836454cd0" exitCode=0
Jul 01 19:31:16.436485 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:16.436075    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-cs7pm" event={"ID":"d0b6865b-dde3-49a0-9082-d539ad3f049b","Type":"ContainerDied","Data":"7086a7ae5b38dcee3a54a9ca20f90e7c829e02674039ca5a2a095b4836454cd0"}
Jul 01 19:31:17.576103 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:17.576075    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-cs7pm"
Jul 01 19:31:17.762939 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:17.762854    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dgjqj\" (UniqueName: \"kubernetes.io/projected/d0b6865b-dde3-49a0-9082-d539ad3f049b-kube-api-access-dgjqj\") pod \"d0b6865b-dde3-49a0-9082-d539ad3f049b\" (UID: \"d0b6865b-dde3-49a0-9082-d539ad3f049b\") "
Jul 01 19:31:17.763083 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:17.762986    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0b6865b-dde3-49a0-9082-d539ad3f049b-model-cache\") pod \"d0b6865b-dde3-49a0-9082-d539ad3f049b\" (UID: \"d0b6865b-dde3-49a0-9082-d539ad3f049b\") "
Jul 01 19:31:17.765053 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:17.765026    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0b6865b-dde3-49a0-9082-d539ad3f049b-kube-api-access-dgjqj" (OuterVolumeSpecName: "kube-api-access-dgjqj") pod "d0b6865b-dde3-49a0-9082-d539ad3f049b" (UID: "d0b6865b-dde3-49a0-9082-d539ad3f049b"). InnerVolumeSpecName "kube-api-access-dgjqj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 19:31:17.782234 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:17.782201    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0b6865b-dde3-49a0-9082-d539ad3f049b-model-cache" (OuterVolumeSpecName: "model-cache") pod "d0b6865b-dde3-49a0-9082-d539ad3f049b" (UID: "d0b6865b-dde3-49a0-9082-d539ad3f049b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 19:31:17.864015 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:17.863985    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0b6865b-dde3-49a0-9082-d539ad3f049b-model-cache\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:31:17.864015 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:17.864012    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dgjqj\" (UniqueName: \"kubernetes.io/projected/d0b6865b-dde3-49a0-9082-d539ad3f049b-kube-api-access-dgjqj\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:31:18.450633 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:18.450598    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-cs7pm" event={"ID":"d0b6865b-dde3-49a0-9082-d539ad3f049b","Type":"ContainerDied","Data":"8ae6e17c06a357c2009c638bb27b568f2e32deb7e312f858e4146ee459234768"}
Jul 01 19:31:18.450633 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:18.450631    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-cs7pm"
Jul 01 19:31:18.450633 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:18.450638    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8ae6e17c06a357c2009c638bb27b568f2e32deb7e312f858e4146ee459234768"
Jul 01 19:31:31.270671 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.270637    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72"]
Jul 01 19:31:31.271033 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.270977    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0b6865b-dde3-49a0-9082-d539ad3f049b" containerName="s3-init"
Jul 01 19:31:31.271033 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.270988    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0b6865b-dde3-49a0-9082-d539ad3f049b" containerName="s3-init"
Jul 01 19:31:31.271033 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.271011    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0b6865b-dde3-49a0-9082-d539ad3f049b" containerName="download-hf-model"
Jul 01 19:31:31.271033 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.271017    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0b6865b-dde3-49a0-9082-d539ad3f049b" containerName="download-hf-model"
Jul 01 19:31:31.271161 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.271073    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0b6865b-dde3-49a0-9082-d539ad3f049b" containerName="s3-init"
Jul 01 19:31:31.273616 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.273598    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72"
Jul 01 19:31:31.288292 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.288265    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 01 19:31:31.288423 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.288344    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\""
Jul 01 19:31:31.288473 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.288349    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 01 19:31:31.289250 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.289230    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 01 19:31:31.289250 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.289239    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 01 19:31:31.289435 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.289244    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-predictor-serving-cert\""
Jul 01 19:31:31.289551 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.289537    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-tw4nc\""
Jul 01 19:31:31.312662 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.312631    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72"]
Jul 01 19:31:31.382759 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.382719    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4843b39d-a468-4c30-863a-72175b1ab0fb-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-875bcd459-8dd72\" (UID: \"4843b39d-a468-4c30-863a-72175b1ab0fb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72"
Jul 01 19:31:31.382759 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.382763    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57rnm\" (UniqueName: \"kubernetes.io/projected/4843b39d-a468-4c30-863a-72175b1ab0fb-kube-api-access-57rnm\") pod \"isvc-sklearn-graph-1-predictor-875bcd459-8dd72\" (UID: \"4843b39d-a468-4c30-863a-72175b1ab0fb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72"
Jul 01 19:31:31.383015 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.382880    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4843b39d-a468-4c30-863a-72175b1ab0fb-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-875bcd459-8dd72\" (UID: \"4843b39d-a468-4c30-863a-72175b1ab0fb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72"
Jul 01 19:31:31.383015 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.382911    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/4843b39d-a468-4c30-863a-72175b1ab0fb-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-875bcd459-8dd72\" (UID: \"4843b39d-a468-4c30-863a-72175b1ab0fb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72"
Jul 01 19:31:31.383015 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.382958    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4843b39d-a468-4c30-863a-72175b1ab0fb-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-875bcd459-8dd72\" (UID: \"4843b39d-a468-4c30-863a-72175b1ab0fb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72"
Jul 01 19:31:31.459210 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.459168    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-8fd9c-predictor-7658f9f556-xszkl"]
Jul 01 19:31:31.461955 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.461933    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-8fd9c-predictor-7658f9f556-xszkl"
Jul 01 19:31:31.466512 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.466492    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-8fd9c-kube-rbac-proxy-sar-config\""
Jul 01 19:31:31.467050 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.467031    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-8fd9c-predictor-serving-cert\""
Jul 01 19:31:31.475804 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.475781    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-8fd9c-predictor-7658f9f556-xszkl"]
Jul 01 19:31:31.483908 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.483885    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4843b39d-a468-4c30-863a-72175b1ab0fb-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-875bcd459-8dd72\" (UID: \"4843b39d-a468-4c30-863a-72175b1ab0fb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72"
Jul 01 19:31:31.484012 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.483920    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57rnm\" (UniqueName: \"kubernetes.io/projected/4843b39d-a468-4c30-863a-72175b1ab0fb-kube-api-access-57rnm\") pod \"isvc-sklearn-graph-1-predictor-875bcd459-8dd72\" (UID: \"4843b39d-a468-4c30-863a-72175b1ab0fb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72"
Jul 01 19:31:31.484012 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.483951    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b8ccbe83-6639-4eb3-9d3f-5dad47420d2a-proxy-tls\") pod \"error-404-isvc-8fd9c-predictor-7658f9f556-xszkl\" (UID: \"b8ccbe83-6639-4eb3-9d3f-5dad47420d2a\") " pod="kserve-ci-e2e-test/error-404-isvc-8fd9c-predictor-7658f9f556-xszkl"
Jul 01 19:31:31.484012 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.484007    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4843b39d-a468-4c30-863a-72175b1ab0fb-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-875bcd459-8dd72\" (UID: \"4843b39d-a468-4c30-863a-72175b1ab0fb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72"
Jul 01 19:31:31.484191 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.484037    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/4843b39d-a468-4c30-863a-72175b1ab0fb-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-875bcd459-8dd72\" (UID: \"4843b39d-a468-4c30-863a-72175b1ab0fb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72"
Jul 01 19:31:31.484191 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.484077    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4843b39d-a468-4c30-863a-72175b1ab0fb-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-875bcd459-8dd72\" (UID: \"4843b39d-a468-4c30-863a-72175b1ab0fb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72"
Jul 01 19:31:31.484191 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.484104    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b8ccbe83-6639-4eb3-9d3f-5dad47420d2a-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-8fd9c-predictor-7658f9f556-xszkl\" (UID: \"b8ccbe83-6639-4eb3-9d3f-5dad47420d2a\") " pod="kserve-ci-e2e-test/error-404-isvc-8fd9c-predictor-7658f9f556-xszkl"
Jul 01 19:31:31.484191 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.484179    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdc4x\" (UniqueName: \"kubernetes.io/projected/b8ccbe83-6639-4eb3-9d3f-5dad47420d2a-kube-api-access-pdc4x\") pod \"error-404-isvc-8fd9c-predictor-7658f9f556-xszkl\" (UID: \"b8ccbe83-6639-4eb3-9d3f-5dad47420d2a\") " pod="kserve-ci-e2e-test/error-404-isvc-8fd9c-predictor-7658f9f556-xszkl"
Jul 01 19:31:31.484500 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.484476    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4843b39d-a468-4c30-863a-72175b1ab0fb-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-875bcd459-8dd72\" (UID: \"4843b39d-a468-4c30-863a-72175b1ab0fb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72"
Jul 01 19:31:31.484668 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.484645    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4843b39d-a468-4c30-863a-72175b1ab0fb-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-875bcd459-8dd72\" (UID: \"4843b39d-a468-4c30-863a-72175b1ab0fb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72"
Jul 01 19:31:31.484794 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.484699    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/4843b39d-a468-4c30-863a-72175b1ab0fb-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-875bcd459-8dd72\" (UID: \"4843b39d-a468-4c30-863a-72175b1ab0fb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72"
Jul 01 19:31:31.486596 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.486575    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4843b39d-a468-4c30-863a-72175b1ab0fb-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-875bcd459-8dd72\" (UID: \"4843b39d-a468-4c30-863a-72175b1ab0fb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72"
Jul 01 19:31:31.494496 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.494475    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57rnm\" (UniqueName: \"kubernetes.io/projected/4843b39d-a468-4c30-863a-72175b1ab0fb-kube-api-access-57rnm\") pod \"isvc-sklearn-graph-1-predictor-875bcd459-8dd72\" (UID: \"4843b39d-a468-4c30-863a-72175b1ab0fb\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72"
Jul 01 19:31:31.585734 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.585649    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b8ccbe83-6639-4eb3-9d3f-5dad47420d2a-proxy-tls\") pod \"error-404-isvc-8fd9c-predictor-7658f9f556-xszkl\" (UID: \"b8ccbe83-6639-4eb3-9d3f-5dad47420d2a\") " pod="kserve-ci-e2e-test/error-404-isvc-8fd9c-predictor-7658f9f556-xszkl"
Jul 01 19:31:31.585868 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.585734    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b8ccbe83-6639-4eb3-9d3f-5dad47420d2a-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-8fd9c-predictor-7658f9f556-xszkl\" (UID: \"b8ccbe83-6639-4eb3-9d3f-5dad47420d2a\") " pod="kserve-ci-e2e-test/error-404-isvc-8fd9c-predictor-7658f9f556-xszkl"
Jul 01 19:31:31.585868 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.585790    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdc4x\" (UniqueName: \"kubernetes.io/projected/b8ccbe83-6639-4eb3-9d3f-5dad47420d2a-kube-api-access-pdc4x\") pod \"error-404-isvc-8fd9c-predictor-7658f9f556-xszkl\" (UID: \"b8ccbe83-6639-4eb3-9d3f-5dad47420d2a\") " pod="kserve-ci-e2e-test/error-404-isvc-8fd9c-predictor-7658f9f556-xszkl"
Jul 01 19:31:31.586468 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.586445    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b8ccbe83-6639-4eb3-9d3f-5dad47420d2a-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-8fd9c-predictor-7658f9f556-xszkl\" (UID: \"b8ccbe83-6639-4eb3-9d3f-5dad47420d2a\") " pod="kserve-ci-e2e-test/error-404-isvc-8fd9c-predictor-7658f9f556-xszkl"
Jul 01 19:31:31.588105 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.588078    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b8ccbe83-6639-4eb3-9d3f-5dad47420d2a-proxy-tls\") pod \"error-404-isvc-8fd9c-predictor-7658f9f556-xszkl\" (UID: \"b8ccbe83-6639-4eb3-9d3f-5dad47420d2a\") " pod="kserve-ci-e2e-test/error-404-isvc-8fd9c-predictor-7658f9f556-xszkl"
Jul 01 19:31:31.588840 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.588826    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72"
Jul 01 19:31:31.595159 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.595136    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdc4x\" (UniqueName: \"kubernetes.io/projected/b8ccbe83-6639-4eb3-9d3f-5dad47420d2a-kube-api-access-pdc4x\") pod \"error-404-isvc-8fd9c-predictor-7658f9f556-xszkl\" (UID: \"b8ccbe83-6639-4eb3-9d3f-5dad47420d2a\") " pod="kserve-ci-e2e-test/error-404-isvc-8fd9c-predictor-7658f9f556-xszkl"
Jul 01 19:31:31.750591 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:31:31.750556    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4843b39d_a468_4c30_863a_72175b1ab0fb.slice/crio-ba87238c0e35a4cbbe5a6e0cb1fc3dd804160e226b396cbe49f339ca40dd2164 WatchSource:0}: Error finding container ba87238c0e35a4cbbe5a6e0cb1fc3dd804160e226b396cbe49f339ca40dd2164: Status 404 returned error can't find the container with id ba87238c0e35a4cbbe5a6e0cb1fc3dd804160e226b396cbe49f339ca40dd2164
Jul 01 19:31:31.754014 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.753993    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72"]
Jul 01 19:31:31.771475 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.771448    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v"]
Jul 01 19:31:31.771568 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.771520    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-8fd9c-predictor-7658f9f556-xszkl"
Jul 01 19:31:31.774161 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.774133    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v"
Jul 01 19:31:31.779918 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.779900    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-kube-rbac-proxy-sar-config\""
Jul 01 19:31:31.780024 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.779958    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-predictor-serving-cert\""
Jul 01 19:31:31.812542 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.812514    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v"]
Jul 01 19:31:31.889291 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.889252    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/317d360c-a0c9-47fb-8fc3-c5b4622bda0b-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-7ll6v\" (UID: \"317d360c-a0c9-47fb-8fc3-c5b4622bda0b\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v"
Jul 01 19:31:31.889516 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.889313    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlh5p\" (UniqueName: \"kubernetes.io/projected/317d360c-a0c9-47fb-8fc3-c5b4622bda0b-kube-api-access-zlh5p\") pod \"isvc-xgboost-graph-predictor-555fc69d56-7ll6v\" (UID: \"317d360c-a0c9-47fb-8fc3-c5b4622bda0b\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v"
Jul 01 19:31:31.889516 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.889392    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/317d360c-a0c9-47fb-8fc3-c5b4622bda0b-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-7ll6v\" (UID: \"317d360c-a0c9-47fb-8fc3-c5b4622bda0b\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v"
Jul 01 19:31:31.889516 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.889433    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/317d360c-a0c9-47fb-8fc3-c5b4622bda0b-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-7ll6v\" (UID: \"317d360c-a0c9-47fb-8fc3-c5b4622bda0b\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v"
Jul 01 19:31:31.889699 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.889525    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/317d360c-a0c9-47fb-8fc3-c5b4622bda0b-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-7ll6v\" (UID: \"317d360c-a0c9-47fb-8fc3-c5b4622bda0b\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v"
Jul 01 19:31:31.950158 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.950119    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-8fd9c-predictor-7658f9f556-xszkl"]
Jul 01 19:31:31.953291 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:31:31.953263    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8ccbe83_6639_4eb3_9d3f_5dad47420d2a.slice/crio-43f5ed629fe63d1f72fa8889f9d514fa6bf57a900001f10a874bb1ca29d0593c WatchSource:0}: Error finding container 43f5ed629fe63d1f72fa8889f9d514fa6bf57a900001f10a874bb1ca29d0593c: Status 404 returned error can't find the container with id 43f5ed629fe63d1f72fa8889f9d514fa6bf57a900001f10a874bb1ca29d0593c
Jul 01 19:31:31.990293 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.990259    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/317d360c-a0c9-47fb-8fc3-c5b4622bda0b-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-7ll6v\" (UID: \"317d360c-a0c9-47fb-8fc3-c5b4622bda0b\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v"
Jul 01 19:31:31.990513 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.990331    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/317d360c-a0c9-47fb-8fc3-c5b4622bda0b-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-7ll6v\" (UID: \"317d360c-a0c9-47fb-8fc3-c5b4622bda0b\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v"
Jul 01 19:31:31.990513 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.990437    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlh5p\" (UniqueName: \"kubernetes.io/projected/317d360c-a0c9-47fb-8fc3-c5b4622bda0b-kube-api-access-zlh5p\") pod \"isvc-xgboost-graph-predictor-555fc69d56-7ll6v\" (UID: \"317d360c-a0c9-47fb-8fc3-c5b4622bda0b\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v"
Jul 01 19:31:31.990513 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.990466    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/317d360c-a0c9-47fb-8fc3-c5b4622bda0b-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-7ll6v\" (UID: \"317d360c-a0c9-47fb-8fc3-c5b4622bda0b\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v"
Jul 01 19:31:31.990513 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.990492    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/317d360c-a0c9-47fb-8fc3-c5b4622bda0b-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-7ll6v\" (UID: \"317d360c-a0c9-47fb-8fc3-c5b4622bda0b\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v"
Jul 01 19:31:31.991159 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.991129    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/317d360c-a0c9-47fb-8fc3-c5b4622bda0b-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-7ll6v\" (UID: \"317d360c-a0c9-47fb-8fc3-c5b4622bda0b\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v"
Jul 01 19:31:31.991281 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.991157    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/317d360c-a0c9-47fb-8fc3-c5b4622bda0b-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-7ll6v\" (UID: \"317d360c-a0c9-47fb-8fc3-c5b4622bda0b\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v"
Jul 01 19:31:31.991281 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.991129    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/317d360c-a0c9-47fb-8fc3-c5b4622bda0b-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-7ll6v\" (UID: \"317d360c-a0c9-47fb-8fc3-c5b4622bda0b\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v"
Jul 01 19:31:31.993302 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:31.993274    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/317d360c-a0c9-47fb-8fc3-c5b4622bda0b-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-7ll6v\" (UID: \"317d360c-a0c9-47fb-8fc3-c5b4622bda0b\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v"
Jul 01 19:31:32.002990 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:32.002967    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlh5p\" (UniqueName: \"kubernetes.io/projected/317d360c-a0c9-47fb-8fc3-c5b4622bda0b-kube-api-access-zlh5p\") pod \"isvc-xgboost-graph-predictor-555fc69d56-7ll6v\" (UID: \"317d360c-a0c9-47fb-8fc3-c5b4622bda0b\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v"
Jul 01 19:31:32.084823 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:32.084771    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c"]
Jul 01 19:31:32.089803 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:32.089779    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c"
Jul 01 19:31:32.094147 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:31:32.094113    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\" is forbidden: User \"system:node:ip-10-0-134-212.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kserve-ci-e2e-test\": no relationship found between node 'ip-10-0-134-212.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\"" type="*v1.ConfigMap"
Jul 01 19:31:32.094147 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:31:32.094129    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c\" is forbidden: User \"system:node:ip-10-0-134-212.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kserve-ci-e2e-test\": no relationship found between node 'ip-10-0-134-212.ec2.internal' and this object" podUID="1f6bb43c-c710-47e2-9f14-5f14ef6eac68" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c"
Jul 01 19:31:32.094513 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:31:32.094488    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"isvc-sklearn-graph-2-predictor-serving-cert\" is forbidden: User \"system:node:ip-10-0-134-212.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"kserve-ci-e2e-test\": no relationship found between node 'ip-10-0-134-212.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-predictor-serving-cert\"" type="*v1.Secret"
Jul 01 19:31:32.114138 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:32.114103    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v"
Jul 01 19:31:32.115063 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:32.115037    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c"]
Jul 01 19:31:32.192231 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:32.192191    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1f6bb43c-c710-47e2-9f14-5f14ef6eac68-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c\" (UID: \"1f6bb43c-c710-47e2-9f14-5f14ef6eac68\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c"
Jul 01 19:31:32.192456 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:32.192360    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1f6bb43c-c710-47e2-9f14-5f14ef6eac68-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c\" (UID: \"1f6bb43c-c710-47e2-9f14-5f14ef6eac68\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c"
Jul 01 19:31:32.192456 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:32.192430    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1f6bb43c-c710-47e2-9f14-5f14ef6eac68-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c\" (UID: \"1f6bb43c-c710-47e2-9f14-5f14ef6eac68\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c"
Jul 01 19:31:32.192567 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:32.192457    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1f6bb43c-c710-47e2-9f14-5f14ef6eac68-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c\" (UID: \"1f6bb43c-c710-47e2-9f14-5f14ef6eac68\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c"
Jul 01 19:31:32.192567 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:32.192490    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c69xn\" (UniqueName: \"kubernetes.io/projected/1f6bb43c-c710-47e2-9f14-5f14ef6eac68-kube-api-access-c69xn\") pod \"isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c\" (UID: \"1f6bb43c-c710-47e2-9f14-5f14ef6eac68\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c"
Jul 01 19:31:32.269123 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:32.269082    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v"]
Jul 01 19:31:32.272338 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:31:32.272312    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod317d360c_a0c9_47fb_8fc3_c5b4622bda0b.slice/crio-4ddaf24a5a635bbc77cb00d3191eb7f3798497f7149fd26e260d01bc330dd31a WatchSource:0}: Error finding container 4ddaf24a5a635bbc77cb00d3191eb7f3798497f7149fd26e260d01bc330dd31a: Status 404 returned error can't find the container with id 4ddaf24a5a635bbc77cb00d3191eb7f3798497f7149fd26e260d01bc330dd31a
Jul 01 19:31:32.293055 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:32.293031    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1f6bb43c-c710-47e2-9f14-5f14ef6eac68-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c\" (UID: \"1f6bb43c-c710-47e2-9f14-5f14ef6eac68\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c"
Jul 01 19:31:32.293169 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:32.293069    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1f6bb43c-c710-47e2-9f14-5f14ef6eac68-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c\" (UID: \"1f6bb43c-c710-47e2-9f14-5f14ef6eac68\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c"
Jul 01 19:31:32.293237 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:32.293204    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1f6bb43c-c710-47e2-9f14-5f14ef6eac68-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c\" (UID: \"1f6bb43c-c710-47e2-9f14-5f14ef6eac68\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c"
Jul 01 19:31:32.293289 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:32.293243    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c69xn\" (UniqueName: \"kubernetes.io/projected/1f6bb43c-c710-47e2-9f14-5f14ef6eac68-kube-api-access-c69xn\") pod \"isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c\" (UID: \"1f6bb43c-c710-47e2-9f14-5f14ef6eac68\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c"
Jul 01 19:31:32.293337 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:32.293325    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1f6bb43c-c710-47e2-9f14-5f14ef6eac68-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c\" (UID: \"1f6bb43c-c710-47e2-9f14-5f14ef6eac68\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c"
Jul 01 19:31:32.293691 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:32.293671    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1f6bb43c-c710-47e2-9f14-5f14ef6eac68-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c\" (UID: \"1f6bb43c-c710-47e2-9f14-5f14ef6eac68\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c"
Jul 01 19:31:32.293845 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:32.293822    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1f6bb43c-c710-47e2-9f14-5f14ef6eac68-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c\" (UID: \"1f6bb43c-c710-47e2-9f14-5f14ef6eac68\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c"
Jul 01 19:31:32.304801 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:32.304779    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c69xn\" (UniqueName: \"kubernetes.io/projected/1f6bb43c-c710-47e2-9f14-5f14ef6eac68-kube-api-access-c69xn\") pod \"isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c\" (UID: \"1f6bb43c-c710-47e2-9f14-5f14ef6eac68\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c"
Jul 01 19:31:32.512875 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:32.512840    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72" event={"ID":"4843b39d-a468-4c30-863a-72175b1ab0fb","Type":"ContainerStarted","Data":"b9fc6b30f03b028228176a9b2f8b19759aefe45ff134befc505b72de64ebdc87"}
Jul 01 19:31:32.513157 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:32.513110    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72" event={"ID":"4843b39d-a468-4c30-863a-72175b1ab0fb","Type":"ContainerStarted","Data":"ba87238c0e35a4cbbe5a6e0cb1fc3dd804160e226b396cbe49f339ca40dd2164"}
Jul 01 19:31:32.514684 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:32.514654    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-8fd9c-predictor-7658f9f556-xszkl" event={"ID":"b8ccbe83-6639-4eb3-9d3f-5dad47420d2a","Type":"ContainerStarted","Data":"43f5ed629fe63d1f72fa8889f9d514fa6bf57a900001f10a874bb1ca29d0593c"}
Jul 01 19:31:32.517105 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:32.516647    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v" event={"ID":"317d360c-a0c9-47fb-8fc3-c5b4622bda0b","Type":"ContainerStarted","Data":"07dfdede658b4a73741d105290f2efb014d1d74d75ba558f4905ed36e34a8291"}
Jul 01 19:31:32.517105 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:32.516701    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v" event={"ID":"317d360c-a0c9-47fb-8fc3-c5b4622bda0b","Type":"ContainerStarted","Data":"4ddaf24a5a635bbc77cb00d3191eb7f3798497f7149fd26e260d01bc330dd31a"}
Jul 01 19:31:32.902940 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:32.902908    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\""
Jul 01 19:31:32.904866 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:32.904836    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1f6bb43c-c710-47e2-9f14-5f14ef6eac68-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c\" (UID: \"1f6bb43c-c710-47e2-9f14-5f14ef6eac68\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c"
Jul 01 19:31:32.955211 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:32.955180    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-predictor-serving-cert\""
Jul 01 19:31:32.970779 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:32.970749    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1f6bb43c-c710-47e2-9f14-5f14ef6eac68-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c\" (UID: \"1f6bb43c-c710-47e2-9f14-5f14ef6eac68\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c"
Jul 01 19:31:32.999897 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:32.999856    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c"
Jul 01 19:31:33.228817 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:33.228730    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c"]
Jul 01 19:31:33.235610 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:31:33.235582    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f6bb43c_c710_47e2_9f14_5f14ef6eac68.slice/crio-28a4162778cf89d5b81dc69290762b9e4ab24984c5ea2137e340af832f72a345 WatchSource:0}: Error finding container 28a4162778cf89d5b81dc69290762b9e4ab24984c5ea2137e340af832f72a345: Status 404 returned error can't find the container with id 28a4162778cf89d5b81dc69290762b9e4ab24984c5ea2137e340af832f72a345
Jul 01 19:31:33.546804 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:33.546711    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c" event={"ID":"1f6bb43c-c710-47e2-9f14-5f14ef6eac68","Type":"ContainerStarted","Data":"4a98fa062830d98bc83664fbb9ac184c76181721b032ca78b27524b7df3a824c"}
Jul 01 19:31:33.547233 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:33.546844    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c" event={"ID":"1f6bb43c-c710-47e2-9f14-5f14ef6eac68","Type":"ContainerStarted","Data":"28a4162778cf89d5b81dc69290762b9e4ab24984c5ea2137e340af832f72a345"}
Jul 01 19:31:37.571907 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:37.571874    2556 generic.go:356] "Generic (PLEG): container finished" podID="1f6bb43c-c710-47e2-9f14-5f14ef6eac68" containerID="4a98fa062830d98bc83664fbb9ac184c76181721b032ca78b27524b7df3a824c" exitCode=0
Jul 01 19:31:37.572347 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:37.571946    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c" event={"ID":"1f6bb43c-c710-47e2-9f14-5f14ef6eac68","Type":"ContainerDied","Data":"4a98fa062830d98bc83664fbb9ac184c76181721b032ca78b27524b7df3a824c"}
Jul 01 19:31:37.573599 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:37.573574    2556 generic.go:356] "Generic (PLEG): container finished" podID="317d360c-a0c9-47fb-8fc3-c5b4622bda0b" containerID="07dfdede658b4a73741d105290f2efb014d1d74d75ba558f4905ed36e34a8291" exitCode=0
Jul 01 19:31:37.573681 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:37.573663    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v" event={"ID":"317d360c-a0c9-47fb-8fc3-c5b4622bda0b","Type":"ContainerDied","Data":"07dfdede658b4a73741d105290f2efb014d1d74d75ba558f4905ed36e34a8291"}
Jul 01 19:31:37.575157 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:37.575136    2556 generic.go:356] "Generic (PLEG): container finished" podID="4843b39d-a468-4c30-863a-72175b1ab0fb" containerID="b9fc6b30f03b028228176a9b2f8b19759aefe45ff134befc505b72de64ebdc87" exitCode=0
Jul 01 19:31:37.575222 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:37.575202    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72" event={"ID":"4843b39d-a468-4c30-863a-72175b1ab0fb","Type":"ContainerDied","Data":"b9fc6b30f03b028228176a9b2f8b19759aefe45ff134befc505b72de64ebdc87"}
Jul 01 19:31:45.633201 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:45.633114    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-8fd9c-predictor-7658f9f556-xszkl" event={"ID":"b8ccbe83-6639-4eb3-9d3f-5dad47420d2a","Type":"ContainerStarted","Data":"181bdade0f368ff02cb1f1ed7278e7f656e49cf847b2cab126e06cf229538786"}
Jul 01 19:31:53.685164 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:53.685120    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-8fd9c-predictor-7658f9f556-xszkl" event={"ID":"b8ccbe83-6639-4eb3-9d3f-5dad47420d2a","Type":"ContainerStarted","Data":"88fe1618f7e459fa085a48cb13045dd6f74a0d489d5eb1ca8a9ddf2b899f7a4f"}
Jul 01 19:31:53.685703 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:53.685204    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-8fd9c-predictor-7658f9f556-xszkl"
Jul 01 19:31:53.685703 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:53.685240    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-8fd9c-predictor-7658f9f556-xszkl"
Jul 01 19:31:53.686687 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:53.686654    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-8fd9c-predictor-7658f9f556-xszkl" podUID="b8ccbe83-6639-4eb3-9d3f-5dad47420d2a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
Jul 01 19:31:53.687880 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:53.687855    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c" event={"ID":"1f6bb43c-c710-47e2-9f14-5f14ef6eac68","Type":"ContainerStarted","Data":"a01057d964411d750d4d8b8eff6337cb09e37d8187ac026ec909b568d37e2dc2"}
Jul 01 19:31:53.687994 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:53.687923    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c" event={"ID":"1f6bb43c-c710-47e2-9f14-5f14ef6eac68","Type":"ContainerStarted","Data":"a6a7b6f549162c8c9d10736742e07bf1e1e2545f85928f7d72f4f07d9951be6e"}
Jul 01 19:31:53.688573 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:53.688276    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c"
Jul 01 19:31:53.688573 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:53.688327    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c"
Jul 01 19:31:53.689275 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:53.689246    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c" podUID="1f6bb43c-c710-47e2-9f14-5f14ef6eac68" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 01 19:31:53.690252 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:53.690232    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72" event={"ID":"4843b39d-a468-4c30-863a-72175b1ab0fb","Type":"ContainerStarted","Data":"25030e53256860147006ee34f741a8321904a7b6f758dcd360671f65c9b98fe3"}
Jul 01 19:31:53.690334 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:53.690278    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72" event={"ID":"4843b39d-a468-4c30-863a-72175b1ab0fb","Type":"ContainerStarted","Data":"c0ceac7a4038724181c52ddd5ca5e67ef520d0e55443db4b38337a1aa2d47cab"}
Jul 01 19:31:53.690565 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:53.690542    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72"
Jul 01 19:31:53.731144 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:53.731082    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-8fd9c-predictor-7658f9f556-xszkl" podStartSLOduration=1.9650066160000002 podStartE2EDuration="22.731061908s" totalImagesPullingTime="20.766055292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:31:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:31:53.729733833 +0000 UTC m=+498.092745516" watchObservedRunningTime="2026-07-01 19:31:53.731061908 +0000 UTC m=+498.094073590"
Jul 01 19:31:53.802562 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:53.802487    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72" podStartSLOduration=3.721609292 podStartE2EDuration="22.802465846s" totalImagesPullingTime="15.348328003s" totalInitContainerRuntime="3.732528551s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:31:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:31:53.764095296 +0000 UTC m=+498.127106977" watchObservedRunningTime="2026-07-01 19:31:53.802465846 +0000 UTC m=+498.165477534"
Jul 01 19:31:53.802891 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:53.802841    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c" podStartSLOduration=2.748636825 podStartE2EDuration="21.802834679s" totalImagesPullingTime="15.302186197s" totalInitContainerRuntime="3.752011657s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:31:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:31:53.799057399 +0000 UTC m=+498.162069081" watchObservedRunningTime="2026-07-01 19:31:53.802834679 +0000 UTC m=+498.165846361"
Jul 01 19:31:54.699643 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:54.699363    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72"
Jul 01 19:31:54.699643 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:54.699456    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-8fd9c-predictor-7658f9f556-xszkl" podUID="b8ccbe83-6639-4eb3-9d3f-5dad47420d2a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
Jul 01 19:31:54.699643 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:54.699592    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c" podUID="1f6bb43c-c710-47e2-9f14-5f14ef6eac68" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 01 19:31:54.700266 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:54.699863    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72" podUID="4843b39d-a468-4c30-863a-72175b1ab0fb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.25:8080: connect: connection refused"
Jul 01 19:31:55.703311 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:55.703269    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72" podUID="4843b39d-a468-4c30-863a-72175b1ab0fb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.25:8080: connect: connection refused"
Jul 01 19:31:59.704759 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:59.704723    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-8fd9c-predictor-7658f9f556-xszkl"
Jul 01 19:31:59.705327 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:59.705293    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-8fd9c-predictor-7658f9f556-xszkl" podUID="b8ccbe83-6639-4eb3-9d3f-5dad47420d2a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
Jul 01 19:31:59.705573 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:59.705551    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c"
Jul 01 19:31:59.706108 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:31:59.706081    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c" podUID="1f6bb43c-c710-47e2-9f14-5f14ef6eac68" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 01 19:32:00.708620 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:32:00.708587    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72"
Jul 01 19:32:00.709143 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:32:00.709105    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72" podUID="4843b39d-a468-4c30-863a-72175b1ab0fb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.25:8080: connect: connection refused"
Jul 01 19:32:06.763949 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:32:06.763870    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v" event={"ID":"317d360c-a0c9-47fb-8fc3-c5b4622bda0b","Type":"ContainerStarted","Data":"a7bc669464c9ec0e4e6a9a24392589369850e46209173c0be34ab65d175a264b"}
Jul 01 19:32:06.764346 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:32:06.763985    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v" event={"ID":"317d360c-a0c9-47fb-8fc3-c5b4622bda0b","Type":"ContainerStarted","Data":"c3dbbe0b0822a237bc9e085a02025178c5d0c15e1f34fe14cbc5dda9bf1880e4"}
Jul 01 19:32:06.764346 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:32:06.764187    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v"
Jul 01 19:32:07.768895 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:32:07.768863    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v"
Jul 01 19:32:07.770088 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:32:07.770061    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v" podUID="317d360c-a0c9-47fb-8fc3-c5b4622bda0b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 01 19:32:08.774218 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:32:08.774180    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v" podUID="317d360c-a0c9-47fb-8fc3-c5b4622bda0b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 01 19:32:09.706160 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:32:09.706122    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-8fd9c-predictor-7658f9f556-xszkl" podUID="b8ccbe83-6639-4eb3-9d3f-5dad47420d2a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
Jul 01 19:32:09.706332 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:32:09.706122    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c" podUID="1f6bb43c-c710-47e2-9f14-5f14ef6eac68" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 01 19:32:10.709299 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:32:10.709260    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72" podUID="4843b39d-a468-4c30-863a-72175b1ab0fb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.25:8080: connect: connection refused"
Jul 01 19:32:13.778322 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:32:13.778290    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v"
Jul 01 19:32:13.778869 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:32:13.778843    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v" podUID="317d360c-a0c9-47fb-8fc3-c5b4622bda0b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 01 19:32:13.813903 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:32:13.813847    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v" podStartSLOduration=9.863084 podStartE2EDuration="42.813831027s" totalImagesPullingTime="28.903922459s" totalInitContainerRuntime="4.046824568s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:31:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:32:06.802404599 +0000 UTC m=+511.165416281" watchObservedRunningTime="2026-07-01 19:32:13.813831027 +0000 UTC m=+518.176842701"
Jul 01 19:32:19.705384 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:32:19.705328    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-8fd9c-predictor-7658f9f556-xszkl" podUID="b8ccbe83-6639-4eb3-9d3f-5dad47420d2a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
Jul 01 19:32:19.706578 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:32:19.706549    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c" podUID="1f6bb43c-c710-47e2-9f14-5f14ef6eac68" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 01 19:32:20.709684 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:32:20.709646    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72" podUID="4843b39d-a468-4c30-863a-72175b1ab0fb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.25:8080: connect: connection refused"
Jul 01 19:32:23.779576 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:32:23.779531    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v" podUID="317d360c-a0c9-47fb-8fc3-c5b4622bda0b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 01 19:32:29.706005 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:32:29.705913    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-8fd9c-predictor-7658f9f556-xszkl" podUID="b8ccbe83-6639-4eb3-9d3f-5dad47420d2a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.26:8080: connect: connection refused"
Jul 01 19:32:29.706359 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:32:29.705925    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c" podUID="1f6bb43c-c710-47e2-9f14-5f14ef6eac68" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 01 19:32:30.709879 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:32:30.709838    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72" podUID="4843b39d-a468-4c30-863a-72175b1ab0fb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.25:8080: connect: connection refused"
Jul 01 19:32:33.779245 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:32:33.779205    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v" podUID="317d360c-a0c9-47fb-8fc3-c5b4622bda0b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 01 19:32:39.705527 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:32:39.705497    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-8fd9c-predictor-7658f9f556-xszkl"
Jul 01 19:32:39.706045 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:32:39.706018    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c" podUID="1f6bb43c-c710-47e2-9f14-5f14ef6eac68" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 01 19:32:40.709295 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:32:40.709256    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72" podUID="4843b39d-a468-4c30-863a-72175b1ab0fb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.25:8080: connect: connection refused"
Jul 01 19:32:43.779566 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:32:43.779523    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v" podUID="317d360c-a0c9-47fb-8fc3-c5b4622bda0b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 01 19:32:49.706118 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:32:49.706077    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c" podUID="1f6bb43c-c710-47e2-9f14-5f14ef6eac68" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 01 19:32:50.709654 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:32:50.709607    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72" podUID="4843b39d-a468-4c30-863a-72175b1ab0fb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.25:8080: connect: connection refused"
Jul 01 19:32:53.778895 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:32:53.778858    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v" podUID="317d360c-a0c9-47fb-8fc3-c5b4622bda0b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 01 19:32:59.705915 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:32:59.705876    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c" podUID="1f6bb43c-c710-47e2-9f14-5f14ef6eac68" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 01 19:33:00.709438 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:00.709398    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72" podUID="4843b39d-a468-4c30-863a-72175b1ab0fb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.25:8080: connect: connection refused"
Jul 01 19:33:01.438762 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:01.438724    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-8fd9c-predictor-7658f9f556-xszkl"]
Jul 01 19:33:01.438966 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:01.438943    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-8fd9c-predictor-7658f9f556-xszkl" podUID="b8ccbe83-6639-4eb3-9d3f-5dad47420d2a" containerName="kserve-container" containerID="cri-o://181bdade0f368ff02cb1f1ed7278e7f656e49cf847b2cab126e06cf229538786" gracePeriod=30
Jul 01 19:33:01.439025 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:01.438978    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-8fd9c-predictor-7658f9f556-xszkl" podUID="b8ccbe83-6639-4eb3-9d3f-5dad47420d2a" containerName="kube-rbac-proxy" containerID="cri-o://88fe1618f7e459fa085a48cb13045dd6f74a0d489d5eb1ca8a9ddf2b899f7a4f" gracePeriod=30
Jul 01 19:33:01.477617 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:01.477562    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s"]
Jul 01 19:33:01.484534 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:01.482258    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s"
Jul 01 19:33:01.486583 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:01.486558    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-834d0-predictor-serving-cert\""
Jul 01 19:33:01.486715 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:01.486563    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-834d0-kube-rbac-proxy-sar-config\""
Jul 01 19:33:01.499233 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:01.499203    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s"]
Jul 01 19:33:01.534792 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:01.534752    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv6ml\" (UniqueName: \"kubernetes.io/projected/69c2e01b-7582-4d6c-b35a-be506f1715cf-kube-api-access-wv6ml\") pod \"error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s\" (UID: \"69c2e01b-7582-4d6c-b35a-be506f1715cf\") " pod="kserve-ci-e2e-test/error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s"
Jul 01 19:33:01.534995 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:01.534826    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/69c2e01b-7582-4d6c-b35a-be506f1715cf-proxy-tls\") pod \"error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s\" (UID: \"69c2e01b-7582-4d6c-b35a-be506f1715cf\") " pod="kserve-ci-e2e-test/error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s"
Jul 01 19:33:01.534995 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:01.534910    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/69c2e01b-7582-4d6c-b35a-be506f1715cf-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s\" (UID: \"69c2e01b-7582-4d6c-b35a-be506f1715cf\") " pod="kserve-ci-e2e-test/error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s"
Jul 01 19:33:01.636206 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:01.636171    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/69c2e01b-7582-4d6c-b35a-be506f1715cf-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s\" (UID: \"69c2e01b-7582-4d6c-b35a-be506f1715cf\") " pod="kserve-ci-e2e-test/error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s"
Jul 01 19:33:01.636206 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:01.636215    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv6ml\" (UniqueName: \"kubernetes.io/projected/69c2e01b-7582-4d6c-b35a-be506f1715cf-kube-api-access-wv6ml\") pod \"error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s\" (UID: \"69c2e01b-7582-4d6c-b35a-be506f1715cf\") " pod="kserve-ci-e2e-test/error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s"
Jul 01 19:33:01.636497 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:01.636401    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/69c2e01b-7582-4d6c-b35a-be506f1715cf-proxy-tls\") pod \"error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s\" (UID: \"69c2e01b-7582-4d6c-b35a-be506f1715cf\") " pod="kserve-ci-e2e-test/error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s"
Jul 01 19:33:01.636897 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:01.636870    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/69c2e01b-7582-4d6c-b35a-be506f1715cf-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s\" (UID: \"69c2e01b-7582-4d6c-b35a-be506f1715cf\") " pod="kserve-ci-e2e-test/error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s"
Jul 01 19:33:01.638872 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:01.638851    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/69c2e01b-7582-4d6c-b35a-be506f1715cf-proxy-tls\") pod \"error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s\" (UID: \"69c2e01b-7582-4d6c-b35a-be506f1715cf\") " pod="kserve-ci-e2e-test/error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s"
Jul 01 19:33:01.649495 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:01.649467    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv6ml\" (UniqueName: \"kubernetes.io/projected/69c2e01b-7582-4d6c-b35a-be506f1715cf-kube-api-access-wv6ml\") pod \"error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s\" (UID: \"69c2e01b-7582-4d6c-b35a-be506f1715cf\") " pod="kserve-ci-e2e-test/error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s"
Jul 01 19:33:01.795236 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:01.795129    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s"
Jul 01 19:33:01.933658 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:01.933581    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s"]
Jul 01 19:33:01.935934 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:33:01.935895    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69c2e01b_7582_4d6c_b35a_be506f1715cf.slice/crio-8e6b06cda7370c62e744531fe3a7655f8b97a316d424fba67f0f9c12ae87f66c WatchSource:0}: Error finding container 8e6b06cda7370c62e744531fe3a7655f8b97a316d424fba67f0f9c12ae87f66c: Status 404 returned error can't find the container with id 8e6b06cda7370c62e744531fe3a7655f8b97a316d424fba67f0f9c12ae87f66c
Jul 01 19:33:02.043642 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:02.043512    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s" event={"ID":"69c2e01b-7582-4d6c-b35a-be506f1715cf","Type":"ContainerStarted","Data":"7f94a1182f73d810d34aaa8b0b5f3de7c438ab64a14baa99776cb5c4a5c8d208"}
Jul 01 19:33:02.043642 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:02.043588    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s" event={"ID":"69c2e01b-7582-4d6c-b35a-be506f1715cf","Type":"ContainerStarted","Data":"8e6b06cda7370c62e744531fe3a7655f8b97a316d424fba67f0f9c12ae87f66c"}
Jul 01 19:33:02.046633 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:02.046333    2556 generic.go:356] "Generic (PLEG): container finished" podID="b8ccbe83-6639-4eb3-9d3f-5dad47420d2a" containerID="88fe1618f7e459fa085a48cb13045dd6f74a0d489d5eb1ca8a9ddf2b899f7a4f" exitCode=2
Jul 01 19:33:02.046633 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:02.046468    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-8fd9c-predictor-7658f9f556-xszkl" event={"ID":"b8ccbe83-6639-4eb3-9d3f-5dad47420d2a","Type":"ContainerDied","Data":"88fe1618f7e459fa085a48cb13045dd6f74a0d489d5eb1ca8a9ddf2b899f7a4f"}
Jul 01 19:33:03.052579 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:03.052546    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s" event={"ID":"69c2e01b-7582-4d6c-b35a-be506f1715cf","Type":"ContainerStarted","Data":"3fe10db1fe4ea2757cf111a2d093d42f72effe5346938fc246deecd88d3b48d7"}
Jul 01 19:33:03.052966 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:03.052669    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s"
Jul 01 19:33:03.073071 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:03.073021    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s" podStartSLOduration=2.073004902 podStartE2EDuration="2.073004902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:33:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:33:03.071522788 +0000 UTC m=+567.434534480" watchObservedRunningTime="2026-07-01 19:33:03.073004902 +0000 UTC m=+567.436016583"
Jul 01 19:33:03.779096 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:03.779056    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v" podUID="317d360c-a0c9-47fb-8fc3-c5b4622bda0b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 01 19:33:04.057430 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:04.057349    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s"
Jul 01 19:33:04.058841 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:04.058815    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s" podUID="69c2e01b-7582-4d6c-b35a-be506f1715cf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Jul 01 19:33:04.698586 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:04.698537    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-8fd9c-predictor-7658f9f556-xszkl" podUID="b8ccbe83-6639-4eb3-9d3f-5dad47420d2a" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.26:8643/healthz\": dial tcp 10.134.0.26:8643: connect: connection refused"
Jul 01 19:33:04.802213 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:04.802181    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-8fd9c-predictor-7658f9f556-xszkl"
Jul 01 19:33:04.867768 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:04.867679    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdc4x\" (UniqueName: \"kubernetes.io/projected/b8ccbe83-6639-4eb3-9d3f-5dad47420d2a-kube-api-access-pdc4x\") pod \"b8ccbe83-6639-4eb3-9d3f-5dad47420d2a\" (UID: \"b8ccbe83-6639-4eb3-9d3f-5dad47420d2a\") "
Jul 01 19:33:04.867768 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:04.867747    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b8ccbe83-6639-4eb3-9d3f-5dad47420d2a-kube-rbac-proxy-sar-config\") pod \"b8ccbe83-6639-4eb3-9d3f-5dad47420d2a\" (UID: \"b8ccbe83-6639-4eb3-9d3f-5dad47420d2a\") "
Jul 01 19:33:04.867943 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:04.867778    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b8ccbe83-6639-4eb3-9d3f-5dad47420d2a-proxy-tls\") pod \"b8ccbe83-6639-4eb3-9d3f-5dad47420d2a\" (UID: \"b8ccbe83-6639-4eb3-9d3f-5dad47420d2a\") "
Jul 01 19:33:04.868118 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:04.868087    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8ccbe83-6639-4eb3-9d3f-5dad47420d2a-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "b8ccbe83-6639-4eb3-9d3f-5dad47420d2a" (UID: "b8ccbe83-6639-4eb3-9d3f-5dad47420d2a"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 19:33:04.870007 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:04.869977    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8ccbe83-6639-4eb3-9d3f-5dad47420d2a-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "b8ccbe83-6639-4eb3-9d3f-5dad47420d2a" (UID: "b8ccbe83-6639-4eb3-9d3f-5dad47420d2a"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 19:33:04.870089 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:04.870028    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8ccbe83-6639-4eb3-9d3f-5dad47420d2a-kube-api-access-pdc4x" (OuterVolumeSpecName: "kube-api-access-pdc4x") pod "b8ccbe83-6639-4eb3-9d3f-5dad47420d2a" (UID: "b8ccbe83-6639-4eb3-9d3f-5dad47420d2a"). InnerVolumeSpecName "kube-api-access-pdc4x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 19:33:04.968817 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:04.968762    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdc4x\" (UniqueName: \"kubernetes.io/projected/b8ccbe83-6639-4eb3-9d3f-5dad47420d2a-kube-api-access-pdc4x\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:33:04.968817 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:04.968811    2556 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b8ccbe83-6639-4eb3-9d3f-5dad47420d2a-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:33:04.968817 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:04.968825    2556 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b8ccbe83-6639-4eb3-9d3f-5dad47420d2a-proxy-tls\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:33:05.063123 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:05.063087    2556 generic.go:356] "Generic (PLEG): container finished" podID="b8ccbe83-6639-4eb3-9d3f-5dad47420d2a" containerID="181bdade0f368ff02cb1f1ed7278e7f656e49cf847b2cab126e06cf229538786" exitCode=0
Jul 01 19:33:05.063530 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:05.063133    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-8fd9c-predictor-7658f9f556-xszkl"
Jul 01 19:33:05.063530 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:05.063171    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-8fd9c-predictor-7658f9f556-xszkl" event={"ID":"b8ccbe83-6639-4eb3-9d3f-5dad47420d2a","Type":"ContainerDied","Data":"181bdade0f368ff02cb1f1ed7278e7f656e49cf847b2cab126e06cf229538786"}
Jul 01 19:33:05.063530 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:05.063237    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-8fd9c-predictor-7658f9f556-xszkl" event={"ID":"b8ccbe83-6639-4eb3-9d3f-5dad47420d2a","Type":"ContainerDied","Data":"43f5ed629fe63d1f72fa8889f9d514fa6bf57a900001f10a874bb1ca29d0593c"}
Jul 01 19:33:05.063530 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:05.063266    2556 scope.go:117] "RemoveContainer" containerID="88fe1618f7e459fa085a48cb13045dd6f74a0d489d5eb1ca8a9ddf2b899f7a4f"
Jul 01 19:33:05.063879 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:05.063845    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s" podUID="69c2e01b-7582-4d6c-b35a-be506f1715cf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Jul 01 19:33:05.072416 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:05.072355    2556 scope.go:117] "RemoveContainer" containerID="181bdade0f368ff02cb1f1ed7278e7f656e49cf847b2cab126e06cf229538786"
Jul 01 19:33:05.080654 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:05.080638    2556 scope.go:117] "RemoveContainer" containerID="88fe1618f7e459fa085a48cb13045dd6f74a0d489d5eb1ca8a9ddf2b899f7a4f"
Jul 01 19:33:05.080916 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:33:05.080894    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88fe1618f7e459fa085a48cb13045dd6f74a0d489d5eb1ca8a9ddf2b899f7a4f\": container with ID starting with 88fe1618f7e459fa085a48cb13045dd6f74a0d489d5eb1ca8a9ddf2b899f7a4f not found: ID does not exist" containerID="88fe1618f7e459fa085a48cb13045dd6f74a0d489d5eb1ca8a9ddf2b899f7a4f"
Jul 01 19:33:05.081004 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:05.080921    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88fe1618f7e459fa085a48cb13045dd6f74a0d489d5eb1ca8a9ddf2b899f7a4f"} err="failed to get container status \"88fe1618f7e459fa085a48cb13045dd6f74a0d489d5eb1ca8a9ddf2b899f7a4f\": rpc error: code = NotFound desc = could not find container \"88fe1618f7e459fa085a48cb13045dd6f74a0d489d5eb1ca8a9ddf2b899f7a4f\": container with ID starting with 88fe1618f7e459fa085a48cb13045dd6f74a0d489d5eb1ca8a9ddf2b899f7a4f not found: ID does not exist"
Jul 01 19:33:05.081004 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:05.080936    2556 scope.go:117] "RemoveContainer" containerID="181bdade0f368ff02cb1f1ed7278e7f656e49cf847b2cab126e06cf229538786"
Jul 01 19:33:05.081133 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:33:05.081117    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"181bdade0f368ff02cb1f1ed7278e7f656e49cf847b2cab126e06cf229538786\": container with ID starting with 181bdade0f368ff02cb1f1ed7278e7f656e49cf847b2cab126e06cf229538786 not found: ID does not exist" containerID="181bdade0f368ff02cb1f1ed7278e7f656e49cf847b2cab126e06cf229538786"
Jul 01 19:33:05.081171 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:05.081138    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"181bdade0f368ff02cb1f1ed7278e7f656e49cf847b2cab126e06cf229538786"} err="failed to get container status \"181bdade0f368ff02cb1f1ed7278e7f656e49cf847b2cab126e06cf229538786\": rpc error: code = NotFound desc = could not find container \"181bdade0f368ff02cb1f1ed7278e7f656e49cf847b2cab126e06cf229538786\": container with ID starting with 181bdade0f368ff02cb1f1ed7278e7f656e49cf847b2cab126e06cf229538786 not found: ID does not exist"
Jul 01 19:33:05.093063 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:05.093038    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-8fd9c-predictor-7658f9f556-xszkl"]
Jul 01 19:33:05.096861 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:05.096833    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-8fd9c-predictor-7658f9f556-xszkl"]
Jul 01 19:33:06.262742 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:06.262706    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8ccbe83-6639-4eb3-9d3f-5dad47420d2a" path="/var/lib/kubelet/pods/b8ccbe83-6639-4eb3-9d3f-5dad47420d2a/volumes"
Jul 01 19:33:08.250154 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:08.250111    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72" podUID="4843b39d-a468-4c30-863a-72175b1ab0fb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.25:8080: connect: connection refused"
Jul 01 19:33:09.706090 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:09.706054    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c" podUID="1f6bb43c-c710-47e2-9f14-5f14ef6eac68" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 01 19:33:10.067581 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:10.067500    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s"
Jul 01 19:33:10.068033 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:10.068007    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s" podUID="69c2e01b-7582-4d6c-b35a-be506f1715cf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Jul 01 19:33:13.780293 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:13.780263    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v"
Jul 01 19:33:14.251187 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:14.251148    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c" podUID="1f6bb43c-c710-47e2-9f14-5f14ef6eac68" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 01 19:33:18.250882 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:18.250826    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72" podUID="4843b39d-a468-4c30-863a-72175b1ab0fb" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.25:8080: connect: connection refused"
Jul 01 19:33:20.067948 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:20.067906    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s" podUID="69c2e01b-7582-4d6c-b35a-be506f1715cf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Jul 01 19:33:24.255417 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:24.255386    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c"
Jul 01 19:33:28.255789 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:28.255750    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72"
Jul 01 19:33:30.068328 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:30.068287    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s" podUID="69c2e01b-7582-4d6c-b35a-be506f1715cf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Jul 01 19:33:36.213274 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:36.213249    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tq4l_d621ab71-8427-42af-bfa4-f83db9c5800d/ovn-acl-logging/0.log"
Jul 01 19:33:36.217305 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:36.217283    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tq4l_d621ab71-8427-42af-bfa4-f83db9c5800d/ovn-acl-logging/0.log"
Jul 01 19:33:40.068137 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:40.068092    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s" podUID="69c2e01b-7582-4d6c-b35a-be506f1715cf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Jul 01 19:33:50.068937 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:33:50.068903    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s"
Jul 01 19:34:01.002422 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:01.002327    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v"]
Jul 01 19:34:01.002914 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:01.002581    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v" podUID="317d360c-a0c9-47fb-8fc3-c5b4622bda0b" containerName="kserve-container" containerID="cri-o://c3dbbe0b0822a237bc9e085a02025178c5d0c15e1f34fe14cbc5dda9bf1880e4" gracePeriod=30
Jul 01 19:34:01.002914 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:01.002638    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v" podUID="317d360c-a0c9-47fb-8fc3-c5b4622bda0b" containerName="kube-rbac-proxy" containerID="cri-o://a7bc669464c9ec0e4e6a9a24392589369850e46209173c0be34ab65d175a264b" gracePeriod=30
Jul 01 19:34:01.080567 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:01.080533    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c"]
Jul 01 19:34:01.080782 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:01.080756    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c" podUID="1f6bb43c-c710-47e2-9f14-5f14ef6eac68" containerName="kserve-container" containerID="cri-o://a6a7b6f549162c8c9d10736742e07bf1e1e2545f85928f7d72f4f07d9951be6e" gracePeriod=30
Jul 01 19:34:01.080887 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:01.080858    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c" podUID="1f6bb43c-c710-47e2-9f14-5f14ef6eac68" containerName="kube-rbac-proxy" containerID="cri-o://a01057d964411d750d4d8b8eff6337cb09e37d8187ac026ec909b568d37e2dc2" gracePeriod=30
Jul 01 19:34:01.174926 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:01.174889    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72"]
Jul 01 19:34:01.175221 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:01.175189    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72" podUID="4843b39d-a468-4c30-863a-72175b1ab0fb" containerName="kserve-container" containerID="cri-o://c0ceac7a4038724181c52ddd5ca5e67ef520d0e55443db4b38337a1aa2d47cab" gracePeriod=30
Jul 01 19:34:01.175309 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:01.175269    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72" podUID="4843b39d-a468-4c30-863a-72175b1ab0fb" containerName="kube-rbac-proxy" containerID="cri-o://25030e53256860147006ee34f741a8321904a7b6f758dcd360671f65c9b98fe3" gracePeriod=30
Jul 01 19:34:01.270606 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:01.270522    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-01ba2-predictor-66f759c884-26btm"]
Jul 01 19:34:01.270922 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:01.270910    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8ccbe83-6639-4eb3-9d3f-5dad47420d2a" containerName="kube-rbac-proxy"
Jul 01 19:34:01.270972 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:01.270923    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8ccbe83-6639-4eb3-9d3f-5dad47420d2a" containerName="kube-rbac-proxy"
Jul 01 19:34:01.270972 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:01.270945    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8ccbe83-6639-4eb3-9d3f-5dad47420d2a" containerName="kserve-container"
Jul 01 19:34:01.270972 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:01.270951    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8ccbe83-6639-4eb3-9d3f-5dad47420d2a" containerName="kserve-container"
Jul 01 19:34:01.271067 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:01.271008    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8ccbe83-6639-4eb3-9d3f-5dad47420d2a" containerName="kserve-container"
Jul 01 19:34:01.271067 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:01.271019    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8ccbe83-6639-4eb3-9d3f-5dad47420d2a" containerName="kube-rbac-proxy"
Jul 01 19:34:01.273214 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:01.273192    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-01ba2-predictor-66f759c884-26btm"
Jul 01 19:34:01.277399 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:01.277360    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-01ba2-predictor-serving-cert\""
Jul 01 19:34:01.277621 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:01.277607    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-01ba2-kube-rbac-proxy-sar-config\""
Jul 01 19:34:01.291081 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:01.291055    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-01ba2-predictor-66f759c884-26btm"]
Jul 01 19:34:01.342229 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:01.342196    2556 generic.go:356] "Generic (PLEG): container finished" podID="1f6bb43c-c710-47e2-9f14-5f14ef6eac68" containerID="a01057d964411d750d4d8b8eff6337cb09e37d8187ac026ec909b568d37e2dc2" exitCode=2
Jul 01 19:34:01.342429 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:01.342278    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c" event={"ID":"1f6bb43c-c710-47e2-9f14-5f14ef6eac68","Type":"ContainerDied","Data":"a01057d964411d750d4d8b8eff6337cb09e37d8187ac026ec909b568d37e2dc2"}
Jul 01 19:34:01.344241 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:01.344217    2556 generic.go:356] "Generic (PLEG): container finished" podID="317d360c-a0c9-47fb-8fc3-c5b4622bda0b" containerID="a7bc669464c9ec0e4e6a9a24392589369850e46209173c0be34ab65d175a264b" exitCode=2
Jul 01 19:34:01.344353 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:01.344285    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v" event={"ID":"317d360c-a0c9-47fb-8fc3-c5b4622bda0b","Type":"ContainerDied","Data":"a7bc669464c9ec0e4e6a9a24392589369850e46209173c0be34ab65d175a264b"}
Jul 01 19:34:01.346283 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:01.346261    2556 generic.go:356] "Generic (PLEG): container finished" podID="4843b39d-a468-4c30-863a-72175b1ab0fb" containerID="25030e53256860147006ee34f741a8321904a7b6f758dcd360671f65c9b98fe3" exitCode=2
Jul 01 19:34:01.346406 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:01.346305    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72" event={"ID":"4843b39d-a468-4c30-863a-72175b1ab0fb","Type":"ContainerDied","Data":"25030e53256860147006ee34f741a8321904a7b6f758dcd360671f65c9b98fe3"}
Jul 01 19:34:01.374377 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:01.374335    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4h9n\" (UniqueName: \"kubernetes.io/projected/1f8faff5-2165-49ec-9c6b-953905b8abc7-kube-api-access-x4h9n\") pod \"error-404-isvc-01ba2-predictor-66f759c884-26btm\" (UID: \"1f8faff5-2165-49ec-9c6b-953905b8abc7\") " pod="kserve-ci-e2e-test/error-404-isvc-01ba2-predictor-66f759c884-26btm"
Jul 01 19:34:01.374525 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:01.374440    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1f8faff5-2165-49ec-9c6b-953905b8abc7-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-01ba2-predictor-66f759c884-26btm\" (UID: \"1f8faff5-2165-49ec-9c6b-953905b8abc7\") " pod="kserve-ci-e2e-test/error-404-isvc-01ba2-predictor-66f759c884-26btm"
Jul 01 19:34:01.374525 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:01.374514    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1f8faff5-2165-49ec-9c6b-953905b8abc7-proxy-tls\") pod \"error-404-isvc-01ba2-predictor-66f759c884-26btm\" (UID: \"1f8faff5-2165-49ec-9c6b-953905b8abc7\") " pod="kserve-ci-e2e-test/error-404-isvc-01ba2-predictor-66f759c884-26btm"
Jul 01 19:34:01.475885 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:01.475846    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4h9n\" (UniqueName: \"kubernetes.io/projected/1f8faff5-2165-49ec-9c6b-953905b8abc7-kube-api-access-x4h9n\") pod \"error-404-isvc-01ba2-predictor-66f759c884-26btm\" (UID: \"1f8faff5-2165-49ec-9c6b-953905b8abc7\") " pod="kserve-ci-e2e-test/error-404-isvc-01ba2-predictor-66f759c884-26btm"
Jul 01 19:34:01.476052 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:01.475926    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1f8faff5-2165-49ec-9c6b-953905b8abc7-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-01ba2-predictor-66f759c884-26btm\" (UID: \"1f8faff5-2165-49ec-9c6b-953905b8abc7\") " pod="kserve-ci-e2e-test/error-404-isvc-01ba2-predictor-66f759c884-26btm"
Jul 01 19:34:01.476052 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:01.476000    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1f8faff5-2165-49ec-9c6b-953905b8abc7-proxy-tls\") pod \"error-404-isvc-01ba2-predictor-66f759c884-26btm\" (UID: \"1f8faff5-2165-49ec-9c6b-953905b8abc7\") " pod="kserve-ci-e2e-test/error-404-isvc-01ba2-predictor-66f759c884-26btm"
Jul 01 19:34:01.476720 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:01.476702    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1f8faff5-2165-49ec-9c6b-953905b8abc7-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-01ba2-predictor-66f759c884-26btm\" (UID: \"1f8faff5-2165-49ec-9c6b-953905b8abc7\") " pod="kserve-ci-e2e-test/error-404-isvc-01ba2-predictor-66f759c884-26btm"
Jul 01 19:34:01.478491 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:01.478469    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1f8faff5-2165-49ec-9c6b-953905b8abc7-proxy-tls\") pod \"error-404-isvc-01ba2-predictor-66f759c884-26btm\" (UID: \"1f8faff5-2165-49ec-9c6b-953905b8abc7\") " pod="kserve-ci-e2e-test/error-404-isvc-01ba2-predictor-66f759c884-26btm"
Jul 01 19:34:01.485914 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:01.485890    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4h9n\" (UniqueName: \"kubernetes.io/projected/1f8faff5-2165-49ec-9c6b-953905b8abc7-kube-api-access-x4h9n\") pod \"error-404-isvc-01ba2-predictor-66f759c884-26btm\" (UID: \"1f8faff5-2165-49ec-9c6b-953905b8abc7\") " pod="kserve-ci-e2e-test/error-404-isvc-01ba2-predictor-66f759c884-26btm"
Jul 01 19:34:01.583902 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:01.583805    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-01ba2-predictor-66f759c884-26btm"
Jul 01 19:34:01.727534 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:01.727455    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-01ba2-predictor-66f759c884-26btm"]
Jul 01 19:34:01.730195 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:34:01.730163    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f8faff5_2165_49ec_9c6b_953905b8abc7.slice/crio-a0fa6c5747c8a9eb079a4955e9ec88bf766afff2b232fc17e6cf5d7849ebc58f WatchSource:0}: Error finding container a0fa6c5747c8a9eb079a4955e9ec88bf766afff2b232fc17e6cf5d7849ebc58f: Status 404 returned error can't find the container with id a0fa6c5747c8a9eb079a4955e9ec88bf766afff2b232fc17e6cf5d7849ebc58f
Jul 01 19:34:02.360069 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:02.360030    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-01ba2-predictor-66f759c884-26btm" event={"ID":"1f8faff5-2165-49ec-9c6b-953905b8abc7","Type":"ContainerStarted","Data":"8d442f6566df9f22ee414696c4e8764c35a7c35a6ea552234a0324198579d64e"}
Jul 01 19:34:02.360579 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:02.360123    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-01ba2-predictor-66f759c884-26btm" event={"ID":"1f8faff5-2165-49ec-9c6b-953905b8abc7","Type":"ContainerStarted","Data":"33c96e77f15c4055b47519f8c5a144c67cc2c3bbfa57d35fe8eb900ca5cc86a3"}
Jul 01 19:34:02.360579 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:02.360156    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-01ba2-predictor-66f759c884-26btm" event={"ID":"1f8faff5-2165-49ec-9c6b-953905b8abc7","Type":"ContainerStarted","Data":"a0fa6c5747c8a9eb079a4955e9ec88bf766afff2b232fc17e6cf5d7849ebc58f"}
Jul 01 19:34:02.360579 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:02.360191    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-01ba2-predictor-66f759c884-26btm"
Jul 01 19:34:02.360579 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:02.360227    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-01ba2-predictor-66f759c884-26btm"
Jul 01 19:34:02.361698 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:02.361662    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-01ba2-predictor-66f759c884-26btm" podUID="1f8faff5-2165-49ec-9c6b-953905b8abc7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Jul 01 19:34:03.365491 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:03.365443    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-01ba2-predictor-66f759c884-26btm" podUID="1f8faff5-2165-49ec-9c6b-953905b8abc7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Jul 01 19:34:03.775241 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:03.775198    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v" podUID="317d360c-a0c9-47fb-8fc3-c5b4622bda0b" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.27:8643/healthz\": dial tcp 10.134.0.27:8643: connect: connection refused"
Jul 01 19:34:03.779480 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:03.779446    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v" podUID="317d360c-a0c9-47fb-8fc3-c5b4622bda0b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Jul 01 19:34:04.251656 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:04.251614    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c" podUID="1f6bb43c-c710-47e2-9f14-5f14ef6eac68" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Jul 01 19:34:04.700046 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:04.699994    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c" podUID="1f6bb43c-c710-47e2-9f14-5f14ef6eac68" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.28:8643/healthz\": dial tcp 10.134.0.28:8643: connect: connection refused"
Jul 01 19:34:04.955783 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:04.955721    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v"
Jul 01 19:34:04.977021 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:04.976970    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-01ba2-predictor-66f759c884-26btm" podStartSLOduration=3.976954483 podStartE2EDuration="3.976954483s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:34:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:34:02.399118791 +0000 UTC m=+626.762130468" watchObservedRunningTime="2026-07-01 19:34:04.976954483 +0000 UTC m=+629.339966169"
Jul 01 19:34:05.115610 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:05.115576    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/317d360c-a0c9-47fb-8fc3-c5b4622bda0b-cabundle-cert\") pod \"317d360c-a0c9-47fb-8fc3-c5b4622bda0b\" (UID: \"317d360c-a0c9-47fb-8fc3-c5b4622bda0b\") "
Jul 01 19:34:05.115789 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:05.115634    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/317d360c-a0c9-47fb-8fc3-c5b4622bda0b-proxy-tls\") pod \"317d360c-a0c9-47fb-8fc3-c5b4622bda0b\" (UID: \"317d360c-a0c9-47fb-8fc3-c5b4622bda0b\") "
Jul 01 19:34:05.115789 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:05.115670    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zlh5p\" (UniqueName: \"kubernetes.io/projected/317d360c-a0c9-47fb-8fc3-c5b4622bda0b-kube-api-access-zlh5p\") pod \"317d360c-a0c9-47fb-8fc3-c5b4622bda0b\" (UID: \"317d360c-a0c9-47fb-8fc3-c5b4622bda0b\") "
Jul 01 19:34:05.115789 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:05.115712    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/317d360c-a0c9-47fb-8fc3-c5b4622bda0b-kube-rbac-proxy-sar-config\") pod \"317d360c-a0c9-47fb-8fc3-c5b4622bda0b\" (UID: \"317d360c-a0c9-47fb-8fc3-c5b4622bda0b\") "
Jul 01 19:34:05.115789 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:05.115730    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/317d360c-a0c9-47fb-8fc3-c5b4622bda0b-kserve-provision-location\") pod \"317d360c-a0c9-47fb-8fc3-c5b4622bda0b\" (UID: \"317d360c-a0c9-47fb-8fc3-c5b4622bda0b\") "
Jul 01 19:34:05.116096 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:05.116061    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/317d360c-a0c9-47fb-8fc3-c5b4622bda0b-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "317d360c-a0c9-47fb-8fc3-c5b4622bda0b" (UID: "317d360c-a0c9-47fb-8fc3-c5b4622bda0b"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 19:34:05.116096 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:05.116086    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/317d360c-a0c9-47fb-8fc3-c5b4622bda0b-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "317d360c-a0c9-47fb-8fc3-c5b4622bda0b" (UID: "317d360c-a0c9-47fb-8fc3-c5b4622bda0b"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 19:34:05.116259 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:05.116137    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/317d360c-a0c9-47fb-8fc3-c5b4622bda0b-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "317d360c-a0c9-47fb-8fc3-c5b4622bda0b" (UID: "317d360c-a0c9-47fb-8fc3-c5b4622bda0b"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 19:34:05.118311 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:05.118290    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/317d360c-a0c9-47fb-8fc3-c5b4622bda0b-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "317d360c-a0c9-47fb-8fc3-c5b4622bda0b" (UID: "317d360c-a0c9-47fb-8fc3-c5b4622bda0b"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 19:34:05.118418 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:05.118307    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/317d360c-a0c9-47fb-8fc3-c5b4622bda0b-kube-api-access-zlh5p" (OuterVolumeSpecName: "kube-api-access-zlh5p") pod "317d360c-a0c9-47fb-8fc3-c5b4622bda0b" (UID: "317d360c-a0c9-47fb-8fc3-c5b4622bda0b"). InnerVolumeSpecName "kube-api-access-zlh5p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 19:34:05.216551 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:05.216463    2556 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/317d360c-a0c9-47fb-8fc3-c5b4622bda0b-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:34:05.216551 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:05.216496    2556 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/317d360c-a0c9-47fb-8fc3-c5b4622bda0b-kserve-provision-location\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:34:05.216551 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:05.216506    2556 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/317d360c-a0c9-47fb-8fc3-c5b4622bda0b-cabundle-cert\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:34:05.216551 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:05.216515    2556 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/317d360c-a0c9-47fb-8fc3-c5b4622bda0b-proxy-tls\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:34:05.216551 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:05.216525    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zlh5p\" (UniqueName: \"kubernetes.io/projected/317d360c-a0c9-47fb-8fc3-c5b4622bda0b-kube-api-access-zlh5p\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:34:05.375360 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:05.375324    2556 generic.go:356] "Generic (PLEG): container finished" podID="317d360c-a0c9-47fb-8fc3-c5b4622bda0b" containerID="c3dbbe0b0822a237bc9e085a02025178c5d0c15e1f34fe14cbc5dda9bf1880e4" exitCode=0
Jul 01 19:34:05.375578 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:05.375405    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v"
Jul 01 19:34:05.375578 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:05.375411    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v" event={"ID":"317d360c-a0c9-47fb-8fc3-c5b4622bda0b","Type":"ContainerDied","Data":"c3dbbe0b0822a237bc9e085a02025178c5d0c15e1f34fe14cbc5dda9bf1880e4"}
Jul 01 19:34:05.375578 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:05.375470    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v" event={"ID":"317d360c-a0c9-47fb-8fc3-c5b4622bda0b","Type":"ContainerDied","Data":"4ddaf24a5a635bbc77cb00d3191eb7f3798497f7149fd26e260d01bc330dd31a"}
Jul 01 19:34:05.375578 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:05.375495    2556 scope.go:117] "RemoveContainer" containerID="a7bc669464c9ec0e4e6a9a24392589369850e46209173c0be34ab65d175a264b"
Jul 01 19:34:05.387086 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:05.386867    2556 scope.go:117] "RemoveContainer" containerID="c3dbbe0b0822a237bc9e085a02025178c5d0c15e1f34fe14cbc5dda9bf1880e4"
Jul 01 19:34:05.397823 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:05.397798    2556 scope.go:117] "RemoveContainer" containerID="07dfdede658b4a73741d105290f2efb014d1d74d75ba558f4905ed36e34a8291"
Jul 01 19:34:05.405961 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:05.405930    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v"]
Jul 01 19:34:05.406407 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:05.406392    2556 scope.go:117] "RemoveContainer" containerID="a7bc669464c9ec0e4e6a9a24392589369850e46209173c0be34ab65d175a264b"
Jul 01 19:34:05.406727 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:34:05.406706    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7bc669464c9ec0e4e6a9a24392589369850e46209173c0be34ab65d175a264b\": container with ID starting with a7bc669464c9ec0e4e6a9a24392589369850e46209173c0be34ab65d175a264b not found: ID does not exist" containerID="a7bc669464c9ec0e4e6a9a24392589369850e46209173c0be34ab65d175a264b"
Jul 01 19:34:05.406777 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:05.406736    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7bc669464c9ec0e4e6a9a24392589369850e46209173c0be34ab65d175a264b"} err="failed to get container status \"a7bc669464c9ec0e4e6a9a24392589369850e46209173c0be34ab65d175a264b\": rpc error: code = NotFound desc = could not find container \"a7bc669464c9ec0e4e6a9a24392589369850e46209173c0be34ab65d175a264b\": container with ID starting with a7bc669464c9ec0e4e6a9a24392589369850e46209173c0be34ab65d175a264b not found: ID does not exist"
Jul 01 19:34:05.406777 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:05.406754    2556 scope.go:117] "RemoveContainer" containerID="c3dbbe0b0822a237bc9e085a02025178c5d0c15e1f34fe14cbc5dda9bf1880e4"
Jul 01 19:34:05.407012 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:34:05.406994    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3dbbe0b0822a237bc9e085a02025178c5d0c15e1f34fe14cbc5dda9bf1880e4\": container with ID starting with c3dbbe0b0822a237bc9e085a02025178c5d0c15e1f34fe14cbc5dda9bf1880e4 not found: ID does not exist" containerID="c3dbbe0b0822a237bc9e085a02025178c5d0c15e1f34fe14cbc5dda9bf1880e4"
Jul 01 19:34:05.407062 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:05.407016    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3dbbe0b0822a237bc9e085a02025178c5d0c15e1f34fe14cbc5dda9bf1880e4"} err="failed to get container status \"c3dbbe0b0822a237bc9e085a02025178c5d0c15e1f34fe14cbc5dda9bf1880e4\": rpc error: code = NotFound desc = could not find container \"c3dbbe0b0822a237bc9e085a02025178c5d0c15e1f34fe14cbc5dda9bf1880e4\": container with ID starting with c3dbbe0b0822a237bc9e085a02025178c5d0c15e1f34fe14cbc5dda9bf1880e4 not found: ID does not exist"
Jul 01 19:34:05.407062 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:05.407034    2556 scope.go:117] "RemoveContainer" containerID="07dfdede658b4a73741d105290f2efb014d1d74d75ba558f4905ed36e34a8291"
Jul 01 19:34:05.407222 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:34:05.407208    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07dfdede658b4a73741d105290f2efb014d1d74d75ba558f4905ed36e34a8291\": container with ID starting with 07dfdede658b4a73741d105290f2efb014d1d74d75ba558f4905ed36e34a8291 not found: ID does not exist" containerID="07dfdede658b4a73741d105290f2efb014d1d74d75ba558f4905ed36e34a8291"
Jul 01 19:34:05.407260 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:05.407225    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07dfdede658b4a73741d105290f2efb014d1d74d75ba558f4905ed36e34a8291"} err="failed to get container status \"07dfdede658b4a73741d105290f2efb014d1d74d75ba558f4905ed36e34a8291\": rpc error: code = NotFound desc = could not find container \"07dfdede658b4a73741d105290f2efb014d1d74d75ba558f4905ed36e34a8291\": container with ID starting with 07dfdede658b4a73741d105290f2efb014d1d74d75ba558f4905ed36e34a8291 not found: ID does not exist"
Jul 01 19:34:05.410138 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:05.410118    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-7ll6v"]
Jul 01 19:34:05.703997 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:05.703960    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72" podUID="4843b39d-a468-4c30-863a-72175b1ab0fb" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.25:8643/healthz\": dial tcp 10.134.0.25:8643: connect: connection refused"
Jul 01 19:34:06.133992 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.133966    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c"
Jul 01 19:34:06.226730 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.226693    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1f6bb43c-c710-47e2-9f14-5f14ef6eac68-kserve-provision-location\") pod \"1f6bb43c-c710-47e2-9f14-5f14ef6eac68\" (UID: \"1f6bb43c-c710-47e2-9f14-5f14ef6eac68\") "
Jul 01 19:34:06.227012 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.226744    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1f6bb43c-c710-47e2-9f14-5f14ef6eac68-kube-rbac-proxy-sar-config\") pod \"1f6bb43c-c710-47e2-9f14-5f14ef6eac68\" (UID: \"1f6bb43c-c710-47e2-9f14-5f14ef6eac68\") "
Jul 01 19:34:06.227012 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.226765    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c69xn\" (UniqueName: \"kubernetes.io/projected/1f6bb43c-c710-47e2-9f14-5f14ef6eac68-kube-api-access-c69xn\") pod \"1f6bb43c-c710-47e2-9f14-5f14ef6eac68\" (UID: \"1f6bb43c-c710-47e2-9f14-5f14ef6eac68\") "
Jul 01 19:34:06.227012 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.226794    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1f6bb43c-c710-47e2-9f14-5f14ef6eac68-proxy-tls\") pod \"1f6bb43c-c710-47e2-9f14-5f14ef6eac68\" (UID: \"1f6bb43c-c710-47e2-9f14-5f14ef6eac68\") "
Jul 01 19:34:06.227012 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.226859    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1f6bb43c-c710-47e2-9f14-5f14ef6eac68-cabundle-cert\") pod \"1f6bb43c-c710-47e2-9f14-5f14ef6eac68\" (UID: \"1f6bb43c-c710-47e2-9f14-5f14ef6eac68\") "
Jul 01 19:34:06.227240 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.227037    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f6bb43c-c710-47e2-9f14-5f14ef6eac68-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "1f6bb43c-c710-47e2-9f14-5f14ef6eac68" (UID: "1f6bb43c-c710-47e2-9f14-5f14ef6eac68"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 19:34:06.227240 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.227192    2556 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1f6bb43c-c710-47e2-9f14-5f14ef6eac68-kserve-provision-location\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:34:06.227240 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.227192    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f6bb43c-c710-47e2-9f14-5f14ef6eac68-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "1f6bb43c-c710-47e2-9f14-5f14ef6eac68" (UID: "1f6bb43c-c710-47e2-9f14-5f14ef6eac68"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 19:34:06.227339 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.227228    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f6bb43c-c710-47e2-9f14-5f14ef6eac68-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "1f6bb43c-c710-47e2-9f14-5f14ef6eac68" (UID: "1f6bb43c-c710-47e2-9f14-5f14ef6eac68"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 19:34:06.228882 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.228858    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f6bb43c-c710-47e2-9f14-5f14ef6eac68-kube-api-access-c69xn" (OuterVolumeSpecName: "kube-api-access-c69xn") pod "1f6bb43c-c710-47e2-9f14-5f14ef6eac68" (UID: "1f6bb43c-c710-47e2-9f14-5f14ef6eac68"). InnerVolumeSpecName "kube-api-access-c69xn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 19:34:06.228959 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.228874    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f6bb43c-c710-47e2-9f14-5f14ef6eac68-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "1f6bb43c-c710-47e2-9f14-5f14ef6eac68" (UID: "1f6bb43c-c710-47e2-9f14-5f14ef6eac68"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 19:34:06.255549 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.255476    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="317d360c-a0c9-47fb-8fc3-c5b4622bda0b" path="/var/lib/kubelet/pods/317d360c-a0c9-47fb-8fc3-c5b4622bda0b/volumes"
Jul 01 19:34:06.328184 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.328141    2556 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1f6bb43c-c710-47e2-9f14-5f14ef6eac68-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:34:06.328184 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.328176    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c69xn\" (UniqueName: \"kubernetes.io/projected/1f6bb43c-c710-47e2-9f14-5f14ef6eac68-kube-api-access-c69xn\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:34:06.328184 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.328189    2556 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1f6bb43c-c710-47e2-9f14-5f14ef6eac68-proxy-tls\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:34:06.328459 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.328204    2556 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1f6bb43c-c710-47e2-9f14-5f14ef6eac68-cabundle-cert\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:34:06.381350 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.381319    2556 generic.go:356] "Generic (PLEG): container finished" podID="1f6bb43c-c710-47e2-9f14-5f14ef6eac68" containerID="a6a7b6f549162c8c9d10736742e07bf1e1e2545f85928f7d72f4f07d9951be6e" exitCode=0
Jul 01 19:34:06.381574 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.381391    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c"
Jul 01 19:34:06.381574 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.381401    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c" event={"ID":"1f6bb43c-c710-47e2-9f14-5f14ef6eac68","Type":"ContainerDied","Data":"a6a7b6f549162c8c9d10736742e07bf1e1e2545f85928f7d72f4f07d9951be6e"}
Jul 01 19:34:06.381574 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.381477    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c" event={"ID":"1f6bb43c-c710-47e2-9f14-5f14ef6eac68","Type":"ContainerDied","Data":"28a4162778cf89d5b81dc69290762b9e4ab24984c5ea2137e340af832f72a345"}
Jul 01 19:34:06.381574 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.381524    2556 scope.go:117] "RemoveContainer" containerID="a01057d964411d750d4d8b8eff6337cb09e37d8187ac026ec909b568d37e2dc2"
Jul 01 19:34:06.389828 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.389813    2556 scope.go:117] "RemoveContainer" containerID="a6a7b6f549162c8c9d10736742e07bf1e1e2545f85928f7d72f4f07d9951be6e"
Jul 01 19:34:06.399805 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.399778    2556 scope.go:117] "RemoveContainer" containerID="4a98fa062830d98bc83664fbb9ac184c76181721b032ca78b27524b7df3a824c"
Jul 01 19:34:06.413742 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.413713    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c"]
Jul 01 19:34:06.418044 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.418023    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rzr4c"]
Jul 01 19:34:06.454853 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.454829    2556 scope.go:117] "RemoveContainer" containerID="a01057d964411d750d4d8b8eff6337cb09e37d8187ac026ec909b568d37e2dc2"
Jul 01 19:34:06.455153 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:34:06.455136    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a01057d964411d750d4d8b8eff6337cb09e37d8187ac026ec909b568d37e2dc2\": container with ID starting with a01057d964411d750d4d8b8eff6337cb09e37d8187ac026ec909b568d37e2dc2 not found: ID does not exist" containerID="a01057d964411d750d4d8b8eff6337cb09e37d8187ac026ec909b568d37e2dc2"
Jul 01 19:34:06.455206 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.455161    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a01057d964411d750d4d8b8eff6337cb09e37d8187ac026ec909b568d37e2dc2"} err="failed to get container status \"a01057d964411d750d4d8b8eff6337cb09e37d8187ac026ec909b568d37e2dc2\": rpc error: code = NotFound desc = could not find container \"a01057d964411d750d4d8b8eff6337cb09e37d8187ac026ec909b568d37e2dc2\": container with ID starting with a01057d964411d750d4d8b8eff6337cb09e37d8187ac026ec909b568d37e2dc2 not found: ID does not exist"
Jul 01 19:34:06.455206 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.455178    2556 scope.go:117] "RemoveContainer" containerID="a6a7b6f549162c8c9d10736742e07bf1e1e2545f85928f7d72f4f07d9951be6e"
Jul 01 19:34:06.455455 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:34:06.455435    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6a7b6f549162c8c9d10736742e07bf1e1e2545f85928f7d72f4f07d9951be6e\": container with ID starting with a6a7b6f549162c8c9d10736742e07bf1e1e2545f85928f7d72f4f07d9951be6e not found: ID does not exist" containerID="a6a7b6f549162c8c9d10736742e07bf1e1e2545f85928f7d72f4f07d9951be6e"
Jul 01 19:34:06.455512 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.455461    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6a7b6f549162c8c9d10736742e07bf1e1e2545f85928f7d72f4f07d9951be6e"} err="failed to get container status \"a6a7b6f549162c8c9d10736742e07bf1e1e2545f85928f7d72f4f07d9951be6e\": rpc error: code = NotFound desc = could not find container \"a6a7b6f549162c8c9d10736742e07bf1e1e2545f85928f7d72f4f07d9951be6e\": container with ID starting with a6a7b6f549162c8c9d10736742e07bf1e1e2545f85928f7d72f4f07d9951be6e not found: ID does not exist"
Jul 01 19:34:06.455512 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.455477    2556 scope.go:117] "RemoveContainer" containerID="4a98fa062830d98bc83664fbb9ac184c76181721b032ca78b27524b7df3a824c"
Jul 01 19:34:06.455714 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:34:06.455691    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a98fa062830d98bc83664fbb9ac184c76181721b032ca78b27524b7df3a824c\": container with ID starting with 4a98fa062830d98bc83664fbb9ac184c76181721b032ca78b27524b7df3a824c not found: ID does not exist" containerID="4a98fa062830d98bc83664fbb9ac184c76181721b032ca78b27524b7df3a824c"
Jul 01 19:34:06.455764 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.455716    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a98fa062830d98bc83664fbb9ac184c76181721b032ca78b27524b7df3a824c"} err="failed to get container status \"4a98fa062830d98bc83664fbb9ac184c76181721b032ca78b27524b7df3a824c\": rpc error: code = NotFound desc = could not find container \"4a98fa062830d98bc83664fbb9ac184c76181721b032ca78b27524b7df3a824c\": container with ID starting with 4a98fa062830d98bc83664fbb9ac184c76181721b032ca78b27524b7df3a824c not found: ID does not exist"
Jul 01 19:34:06.611228 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.611202    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72"
Jul 01 19:34:06.731466 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.731424    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57rnm\" (UniqueName: \"kubernetes.io/projected/4843b39d-a468-4c30-863a-72175b1ab0fb-kube-api-access-57rnm\") pod \"4843b39d-a468-4c30-863a-72175b1ab0fb\" (UID: \"4843b39d-a468-4c30-863a-72175b1ab0fb\") "
Jul 01 19:34:06.731954 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.731478    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/4843b39d-a468-4c30-863a-72175b1ab0fb-cabundle-cert\") pod \"4843b39d-a468-4c30-863a-72175b1ab0fb\" (UID: \"4843b39d-a468-4c30-863a-72175b1ab0fb\") "
Jul 01 19:34:06.731954 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.731499    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4843b39d-a468-4c30-863a-72175b1ab0fb-kserve-provision-location\") pod \"4843b39d-a468-4c30-863a-72175b1ab0fb\" (UID: \"4843b39d-a468-4c30-863a-72175b1ab0fb\") "
Jul 01 19:34:06.731954 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.731627    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4843b39d-a468-4c30-863a-72175b1ab0fb-kube-rbac-proxy-sar-config\") pod \"4843b39d-a468-4c30-863a-72175b1ab0fb\" (UID: \"4843b39d-a468-4c30-863a-72175b1ab0fb\") "
Jul 01 19:34:06.731954 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.731677    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4843b39d-a468-4c30-863a-72175b1ab0fb-proxy-tls\") pod \"4843b39d-a468-4c30-863a-72175b1ab0fb\" (UID: \"4843b39d-a468-4c30-863a-72175b1ab0fb\") "
Jul 01 19:34:06.731954 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.731810    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4843b39d-a468-4c30-863a-72175b1ab0fb-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "4843b39d-a468-4c30-863a-72175b1ab0fb" (UID: "4843b39d-a468-4c30-863a-72175b1ab0fb"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 19:34:06.731954 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.731935    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4843b39d-a468-4c30-863a-72175b1ab0fb-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "4843b39d-a468-4c30-863a-72175b1ab0fb" (UID: "4843b39d-a468-4c30-863a-72175b1ab0fb"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 19:34:06.732203 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.731966    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4843b39d-a468-4c30-863a-72175b1ab0fb-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "4843b39d-a468-4c30-863a-72175b1ab0fb" (UID: "4843b39d-a468-4c30-863a-72175b1ab0fb"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 19:34:06.732203 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.732022    2556 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/4843b39d-a468-4c30-863a-72175b1ab0fb-cabundle-cert\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:34:06.732203 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.732042    2556 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4843b39d-a468-4c30-863a-72175b1ab0fb-kserve-provision-location\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:34:06.733569 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.733551    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4843b39d-a468-4c30-863a-72175b1ab0fb-kube-api-access-57rnm" (OuterVolumeSpecName: "kube-api-access-57rnm") pod "4843b39d-a468-4c30-863a-72175b1ab0fb" (UID: "4843b39d-a468-4c30-863a-72175b1ab0fb"). InnerVolumeSpecName "kube-api-access-57rnm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 19:34:06.733632 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.733620    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4843b39d-a468-4c30-863a-72175b1ab0fb-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "4843b39d-a468-4c30-863a-72175b1ab0fb" (UID: "4843b39d-a468-4c30-863a-72175b1ab0fb"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 19:34:06.832841 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.832749    2556 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4843b39d-a468-4c30-863a-72175b1ab0fb-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:34:06.832841 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.832781    2556 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4843b39d-a468-4c30-863a-72175b1ab0fb-proxy-tls\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:34:06.832841 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:06.832792    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57rnm\" (UniqueName: \"kubernetes.io/projected/4843b39d-a468-4c30-863a-72175b1ab0fb-kube-api-access-57rnm\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:34:07.390004 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:07.389968    2556 generic.go:356] "Generic (PLEG): container finished" podID="4843b39d-a468-4c30-863a-72175b1ab0fb" containerID="c0ceac7a4038724181c52ddd5ca5e67ef520d0e55443db4b38337a1aa2d47cab" exitCode=0
Jul 01 19:34:07.390176 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:07.390027    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72"
Jul 01 19:34:07.390176 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:07.390054    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72" event={"ID":"4843b39d-a468-4c30-863a-72175b1ab0fb","Type":"ContainerDied","Data":"c0ceac7a4038724181c52ddd5ca5e67ef520d0e55443db4b38337a1aa2d47cab"}
Jul 01 19:34:07.390176 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:07.390114    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72" event={"ID":"4843b39d-a468-4c30-863a-72175b1ab0fb","Type":"ContainerDied","Data":"ba87238c0e35a4cbbe5a6e0cb1fc3dd804160e226b396cbe49f339ca40dd2164"}
Jul 01 19:34:07.390176 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:07.390141    2556 scope.go:117] "RemoveContainer" containerID="25030e53256860147006ee34f741a8321904a7b6f758dcd360671f65c9b98fe3"
Jul 01 19:34:07.398624 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:07.398601    2556 scope.go:117] "RemoveContainer" containerID="c0ceac7a4038724181c52ddd5ca5e67ef520d0e55443db4b38337a1aa2d47cab"
Jul 01 19:34:07.412964 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:07.412931    2556 scope.go:117] "RemoveContainer" containerID="b9fc6b30f03b028228176a9b2f8b19759aefe45ff134befc505b72de64ebdc87"
Jul 01 19:34:07.421029 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:07.421008    2556 scope.go:117] "RemoveContainer" containerID="25030e53256860147006ee34f741a8321904a7b6f758dcd360671f65c9b98fe3"
Jul 01 19:34:07.421304 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:34:07.421285    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25030e53256860147006ee34f741a8321904a7b6f758dcd360671f65c9b98fe3\": container with ID starting with 25030e53256860147006ee34f741a8321904a7b6f758dcd360671f65c9b98fe3 not found: ID does not exist" containerID="25030e53256860147006ee34f741a8321904a7b6f758dcd360671f65c9b98fe3"
Jul 01 19:34:07.421394 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:07.421316    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25030e53256860147006ee34f741a8321904a7b6f758dcd360671f65c9b98fe3"} err="failed to get container status \"25030e53256860147006ee34f741a8321904a7b6f758dcd360671f65c9b98fe3\": rpc error: code = NotFound desc = could not find container \"25030e53256860147006ee34f741a8321904a7b6f758dcd360671f65c9b98fe3\": container with ID starting with 25030e53256860147006ee34f741a8321904a7b6f758dcd360671f65c9b98fe3 not found: ID does not exist"
Jul 01 19:34:07.421394 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:07.421338    2556 scope.go:117] "RemoveContainer" containerID="c0ceac7a4038724181c52ddd5ca5e67ef520d0e55443db4b38337a1aa2d47cab"
Jul 01 19:34:07.421613 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:34:07.421589    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0ceac7a4038724181c52ddd5ca5e67ef520d0e55443db4b38337a1aa2d47cab\": container with ID starting with c0ceac7a4038724181c52ddd5ca5e67ef520d0e55443db4b38337a1aa2d47cab not found: ID does not exist" containerID="c0ceac7a4038724181c52ddd5ca5e67ef520d0e55443db4b38337a1aa2d47cab"
Jul 01 19:34:07.421655 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:07.421623    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0ceac7a4038724181c52ddd5ca5e67ef520d0e55443db4b38337a1aa2d47cab"} err="failed to get container status \"c0ceac7a4038724181c52ddd5ca5e67ef520d0e55443db4b38337a1aa2d47cab\": rpc error: code = NotFound desc = could not find container \"c0ceac7a4038724181c52ddd5ca5e67ef520d0e55443db4b38337a1aa2d47cab\": container with ID starting with c0ceac7a4038724181c52ddd5ca5e67ef520d0e55443db4b38337a1aa2d47cab not found: ID does not exist"
Jul 01 19:34:07.421655 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:07.421644    2556 scope.go:117] "RemoveContainer" containerID="b9fc6b30f03b028228176a9b2f8b19759aefe45ff134befc505b72de64ebdc87"
Jul 01 19:34:07.421863 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:34:07.421846    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9fc6b30f03b028228176a9b2f8b19759aefe45ff134befc505b72de64ebdc87\": container with ID starting with b9fc6b30f03b028228176a9b2f8b19759aefe45ff134befc505b72de64ebdc87 not found: ID does not exist" containerID="b9fc6b30f03b028228176a9b2f8b19759aefe45ff134befc505b72de64ebdc87"
Jul 01 19:34:07.421919 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:07.421867    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9fc6b30f03b028228176a9b2f8b19759aefe45ff134befc505b72de64ebdc87"} err="failed to get container status \"b9fc6b30f03b028228176a9b2f8b19759aefe45ff134befc505b72de64ebdc87\": rpc error: code = NotFound desc = could not find container \"b9fc6b30f03b028228176a9b2f8b19759aefe45ff134befc505b72de64ebdc87\": container with ID starting with b9fc6b30f03b028228176a9b2f8b19759aefe45ff134befc505b72de64ebdc87 not found: ID does not exist"
Jul 01 19:34:07.422191 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:07.422174    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72"]
Jul 01 19:34:07.427946 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:07.427925    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-8dd72"]
Jul 01 19:34:08.254759 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:08.254725    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f6bb43c-c710-47e2-9f14-5f14ef6eac68" path="/var/lib/kubelet/pods/1f6bb43c-c710-47e2-9f14-5f14ef6eac68/volumes"
Jul 01 19:34:08.255205 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:08.255191    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4843b39d-a468-4c30-863a-72175b1ab0fb" path="/var/lib/kubelet/pods/4843b39d-a468-4c30-863a-72175b1ab0fb/volumes"
Jul 01 19:34:08.370221 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:08.370189    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-01ba2-predictor-66f759c884-26btm"
Jul 01 19:34:08.370802 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:08.370776    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-01ba2-predictor-66f759c884-26btm" podUID="1f8faff5-2165-49ec-9c6b-953905b8abc7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Jul 01 19:34:18.371623 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:18.371584    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-01ba2-predictor-66f759c884-26btm" podUID="1f8faff5-2165-49ec-9c6b-953905b8abc7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Jul 01 19:34:28.371473 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:28.371430    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-01ba2-predictor-66f759c884-26btm" podUID="1f8faff5-2165-49ec-9c6b-953905b8abc7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Jul 01 19:34:38.370787 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:38.370748    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-01ba2-predictor-66f759c884-26btm" podUID="1f8faff5-2165-49ec-9c6b-953905b8abc7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Jul 01 19:34:48.371388 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:34:48.371336    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-01ba2-predictor-66f759c884-26btm"
Jul 01 19:38:36.243162 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:38:36.243082    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tq4l_d621ab71-8427-42af-bfa4-f83db9c5800d/ovn-acl-logging/0.log"
Jul 01 19:38:36.243695 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:38:36.243680    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tq4l_d621ab71-8427-42af-bfa4-f83db9c5800d/ovn-acl-logging/0.log"
Jul 01 19:42:16.317634 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:16.317597    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-ac147-predictor-84bcbc5868-rqjk8"]
Jul 01 19:42:16.320051 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:16.318119    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="317d360c-a0c9-47fb-8fc3-c5b4622bda0b" containerName="kube-rbac-proxy"
Jul 01 19:42:16.320051 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:16.318134    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="317d360c-a0c9-47fb-8fc3-c5b4622bda0b" containerName="kube-rbac-proxy"
Jul 01 19:42:16.320051 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:16.318147    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="317d360c-a0c9-47fb-8fc3-c5b4622bda0b" containerName="kserve-container"
Jul 01 19:42:16.320051 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:16.318154    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="317d360c-a0c9-47fb-8fc3-c5b4622bda0b" containerName="kserve-container"
Jul 01 19:42:16.320051 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:16.318163    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f6bb43c-c710-47e2-9f14-5f14ef6eac68" containerName="kserve-container"
Jul 01 19:42:16.320051 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:16.318169    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f6bb43c-c710-47e2-9f14-5f14ef6eac68" containerName="kserve-container"
Jul 01 19:42:16.320051 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:16.318176    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4843b39d-a468-4c30-863a-72175b1ab0fb" containerName="kube-rbac-proxy"
Jul 01 19:42:16.320051 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:16.318181    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4843b39d-a468-4c30-863a-72175b1ab0fb" containerName="kube-rbac-proxy"
Jul 01 19:42:16.320051 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:16.318189    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4843b39d-a468-4c30-863a-72175b1ab0fb" containerName="storage-initializer"
Jul 01 19:42:16.320051 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:16.318194    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4843b39d-a468-4c30-863a-72175b1ab0fb" containerName="storage-initializer"
Jul 01 19:42:16.320051 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:16.318200    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="317d360c-a0c9-47fb-8fc3-c5b4622bda0b" containerName="storage-initializer"
Jul 01 19:42:16.320051 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:16.318205    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="317d360c-a0c9-47fb-8fc3-c5b4622bda0b" containerName="storage-initializer"
Jul 01 19:42:16.320051 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:16.318212    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4843b39d-a468-4c30-863a-72175b1ab0fb" containerName="kserve-container"
Jul 01 19:42:16.320051 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:16.318217    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4843b39d-a468-4c30-863a-72175b1ab0fb" containerName="kserve-container"
Jul 01 19:42:16.320051 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:16.318224    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f6bb43c-c710-47e2-9f14-5f14ef6eac68" containerName="storage-initializer"
Jul 01 19:42:16.320051 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:16.318229    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f6bb43c-c710-47e2-9f14-5f14ef6eac68" containerName="storage-initializer"
Jul 01 19:42:16.320051 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:16.318239    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f6bb43c-c710-47e2-9f14-5f14ef6eac68" containerName="kube-rbac-proxy"
Jul 01 19:42:16.320051 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:16.318244    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f6bb43c-c710-47e2-9f14-5f14ef6eac68" containerName="kube-rbac-proxy"
Jul 01 19:42:16.320051 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:16.318314    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f6bb43c-c710-47e2-9f14-5f14ef6eac68" containerName="kserve-container"
Jul 01 19:42:16.320051 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:16.318322    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4843b39d-a468-4c30-863a-72175b1ab0fb" containerName="kserve-container"
Jul 01 19:42:16.320051 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:16.318328    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="317d360c-a0c9-47fb-8fc3-c5b4622bda0b" containerName="kube-rbac-proxy"
Jul 01 19:42:16.320051 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:16.318334    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4843b39d-a468-4c30-863a-72175b1ab0fb" containerName="kube-rbac-proxy"
Jul 01 19:42:16.320051 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:16.318338    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f6bb43c-c710-47e2-9f14-5f14ef6eac68" containerName="kube-rbac-proxy"
Jul 01 19:42:16.320051 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:16.318344    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="317d360c-a0c9-47fb-8fc3-c5b4622bda0b" containerName="kserve-container"
Jul 01 19:42:16.321964 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:16.321945    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-ac147-predictor-84bcbc5868-rqjk8"
Jul 01 19:42:16.324196 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:16.324160    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-ac147-predictor-serving-cert\""
Jul 01 19:42:16.324434 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:16.324420    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-ac147-kube-rbac-proxy-sar-config\""
Jul 01 19:42:16.334998 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:16.334967    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-ac147-predictor-84bcbc5868-rqjk8"]
Jul 01 19:42:16.369340 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:16.369304    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s"]
Jul 01 19:42:16.369598 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:16.369566    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s" podUID="69c2e01b-7582-4d6c-b35a-be506f1715cf" containerName="kserve-container" containerID="cri-o://7f94a1182f73d810d34aaa8b0b5f3de7c438ab64a14baa99776cb5c4a5c8d208" gracePeriod=30
Jul 01 19:42:16.369726 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:16.369594    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s" podUID="69c2e01b-7582-4d6c-b35a-be506f1715cf" containerName="kube-rbac-proxy" containerID="cri-o://3fe10db1fe4ea2757cf111a2d093d42f72effe5346938fc246deecd88d3b48d7" gracePeriod=30
Jul 01 19:42:16.424587 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:16.424556    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/644393c3-9e8b-495f-8023-953890b7ef50-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-ac147-predictor-84bcbc5868-rqjk8\" (UID: \"644393c3-9e8b-495f-8023-953890b7ef50\") " pod="kserve-ci-e2e-test/error-404-isvc-ac147-predictor-84bcbc5868-rqjk8"
Jul 01 19:42:16.424587 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:16.424589    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwqzl\" (UniqueName: \"kubernetes.io/projected/644393c3-9e8b-495f-8023-953890b7ef50-kube-api-access-vwqzl\") pod \"error-404-isvc-ac147-predictor-84bcbc5868-rqjk8\" (UID: \"644393c3-9e8b-495f-8023-953890b7ef50\") " pod="kserve-ci-e2e-test/error-404-isvc-ac147-predictor-84bcbc5868-rqjk8"
Jul 01 19:42:16.424736 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:16.424615    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/644393c3-9e8b-495f-8023-953890b7ef50-proxy-tls\") pod \"error-404-isvc-ac147-predictor-84bcbc5868-rqjk8\" (UID: \"644393c3-9e8b-495f-8023-953890b7ef50\") " pod="kserve-ci-e2e-test/error-404-isvc-ac147-predictor-84bcbc5868-rqjk8"
Jul 01 19:42:16.525112 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:16.525080    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/644393c3-9e8b-495f-8023-953890b7ef50-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-ac147-predictor-84bcbc5868-rqjk8\" (UID: \"644393c3-9e8b-495f-8023-953890b7ef50\") " pod="kserve-ci-e2e-test/error-404-isvc-ac147-predictor-84bcbc5868-rqjk8"
Jul 01 19:42:16.525278 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:16.525122    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwqzl\" (UniqueName: \"kubernetes.io/projected/644393c3-9e8b-495f-8023-953890b7ef50-kube-api-access-vwqzl\") pod \"error-404-isvc-ac147-predictor-84bcbc5868-rqjk8\" (UID: \"644393c3-9e8b-495f-8023-953890b7ef50\") " pod="kserve-ci-e2e-test/error-404-isvc-ac147-predictor-84bcbc5868-rqjk8"
Jul 01 19:42:16.525278 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:16.525156    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/644393c3-9e8b-495f-8023-953890b7ef50-proxy-tls\") pod \"error-404-isvc-ac147-predictor-84bcbc5868-rqjk8\" (UID: \"644393c3-9e8b-495f-8023-953890b7ef50\") " pod="kserve-ci-e2e-test/error-404-isvc-ac147-predictor-84bcbc5868-rqjk8"
Jul 01 19:42:16.525427 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:42:16.525289    2556 secret.go:189] Couldn't get secret kserve-ci-e2e-test/error-404-isvc-ac147-predictor-serving-cert: secret "error-404-isvc-ac147-predictor-serving-cert" not found
Jul 01 19:42:16.525427 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:42:16.525360    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/644393c3-9e8b-495f-8023-953890b7ef50-proxy-tls podName:644393c3-9e8b-495f-8023-953890b7ef50 nodeName:}" failed. No retries permitted until 2026-07-01 19:42:17.025339565 +0000 UTC m=+1121.388351242 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/644393c3-9e8b-495f-8023-953890b7ef50-proxy-tls") pod "error-404-isvc-ac147-predictor-84bcbc5868-rqjk8" (UID: "644393c3-9e8b-495f-8023-953890b7ef50") : secret "error-404-isvc-ac147-predictor-serving-cert" not found
Jul 01 19:42:16.525899 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:16.525873    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/644393c3-9e8b-495f-8023-953890b7ef50-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-ac147-predictor-84bcbc5868-rqjk8\" (UID: \"644393c3-9e8b-495f-8023-953890b7ef50\") " pod="kserve-ci-e2e-test/error-404-isvc-ac147-predictor-84bcbc5868-rqjk8"
Jul 01 19:42:16.536104 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:16.536066    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwqzl\" (UniqueName: \"kubernetes.io/projected/644393c3-9e8b-495f-8023-953890b7ef50-kube-api-access-vwqzl\") pod \"error-404-isvc-ac147-predictor-84bcbc5868-rqjk8\" (UID: \"644393c3-9e8b-495f-8023-953890b7ef50\") " pod="kserve-ci-e2e-test/error-404-isvc-ac147-predictor-84bcbc5868-rqjk8"
Jul 01 19:42:17.030057 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:17.030016    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/644393c3-9e8b-495f-8023-953890b7ef50-proxy-tls\") pod \"error-404-isvc-ac147-predictor-84bcbc5868-rqjk8\" (UID: \"644393c3-9e8b-495f-8023-953890b7ef50\") " pod="kserve-ci-e2e-test/error-404-isvc-ac147-predictor-84bcbc5868-rqjk8"
Jul 01 19:42:17.032399 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:17.032381    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/644393c3-9e8b-495f-8023-953890b7ef50-proxy-tls\") pod \"error-404-isvc-ac147-predictor-84bcbc5868-rqjk8\" (UID: \"644393c3-9e8b-495f-8023-953890b7ef50\") " pod="kserve-ci-e2e-test/error-404-isvc-ac147-predictor-84bcbc5868-rqjk8"
Jul 01 19:42:17.232696 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:17.232661    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-ac147-predictor-84bcbc5868-rqjk8"
Jul 01 19:42:17.374317 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:17.374289    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-ac147-predictor-84bcbc5868-rqjk8"]
Jul 01 19:42:17.376893 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:42:17.376866    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod644393c3_9e8b_495f_8023_953890b7ef50.slice/crio-cb04f9a6dbbb698071fc9c780b77e476c40272d786ca8286c2c69a2b47f40f42 WatchSource:0}: Error finding container cb04f9a6dbbb698071fc9c780b77e476c40272d786ca8286c2c69a2b47f40f42: Status 404 returned error can't find the container with id cb04f9a6dbbb698071fc9c780b77e476c40272d786ca8286c2c69a2b47f40f42
Jul 01 19:42:17.487581 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:17.487547    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-ac147-predictor-84bcbc5868-rqjk8" event={"ID":"644393c3-9e8b-495f-8023-953890b7ef50","Type":"ContainerStarted","Data":"afeab18b70a9d8bf406bbc740c5d2c3757175fc7f5fe53ddd29d26382922a38c"}
Jul 01 19:42:17.487711 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:17.487610    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-ac147-predictor-84bcbc5868-rqjk8" event={"ID":"644393c3-9e8b-495f-8023-953890b7ef50","Type":"ContainerStarted","Data":"cb04f9a6dbbb698071fc9c780b77e476c40272d786ca8286c2c69a2b47f40f42"}
Jul 01 19:42:17.489243 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:17.489222    2556 generic.go:356] "Generic (PLEG): container finished" podID="69c2e01b-7582-4d6c-b35a-be506f1715cf" containerID="3fe10db1fe4ea2757cf111a2d093d42f72effe5346938fc246deecd88d3b48d7" exitCode=2
Jul 01 19:42:17.489336 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:17.489291    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s" event={"ID":"69c2e01b-7582-4d6c-b35a-be506f1715cf","Type":"ContainerDied","Data":"3fe10db1fe4ea2757cf111a2d093d42f72effe5346938fc246deecd88d3b48d7"}
Jul 01 19:42:18.495085 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:18.495052    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-ac147-predictor-84bcbc5868-rqjk8" event={"ID":"644393c3-9e8b-495f-8023-953890b7ef50","Type":"ContainerStarted","Data":"882293d66f6e6bf3d4bba78108b8a423cb113944472aa02a8d790a0d02268ff3"}
Jul 01 19:42:18.495527 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:18.495188    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-ac147-predictor-84bcbc5868-rqjk8"
Jul 01 19:42:18.512764 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:18.512714    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-ac147-predictor-84bcbc5868-rqjk8" podStartSLOduration=2.512699031 podStartE2EDuration="2.512699031s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:42:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:42:18.511654766 +0000 UTC m=+1122.874666448" watchObservedRunningTime="2026-07-01 19:42:18.512699031 +0000 UTC m=+1122.875710711"
Jul 01 19:42:19.421203 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:42:19.421168    2556 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69c2e01b_7582_4d6c_b35a_be506f1715cf.slice/crio-conmon-7f94a1182f73d810d34aaa8b0b5f3de7c438ab64a14baa99776cb5c4a5c8d208.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69c2e01b_7582_4d6c_b35a_be506f1715cf.slice/crio-7f94a1182f73d810d34aaa8b0b5f3de7c438ab64a14baa99776cb5c4a5c8d208.scope\": RecentStats: unable to find data in memory cache]"
Jul 01 19:42:19.502096 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:19.502064    2556 generic.go:356] "Generic (PLEG): container finished" podID="69c2e01b-7582-4d6c-b35a-be506f1715cf" containerID="7f94a1182f73d810d34aaa8b0b5f3de7c438ab64a14baa99776cb5c4a5c8d208" exitCode=0
Jul 01 19:42:19.502462 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:19.502140    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s" event={"ID":"69c2e01b-7582-4d6c-b35a-be506f1715cf","Type":"ContainerDied","Data":"7f94a1182f73d810d34aaa8b0b5f3de7c438ab64a14baa99776cb5c4a5c8d208"}
Jul 01 19:42:19.502517 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:19.502462    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-ac147-predictor-84bcbc5868-rqjk8"
Jul 01 19:42:19.504007 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:19.503977    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-ac147-predictor-84bcbc5868-rqjk8" podUID="644393c3-9e8b-495f-8023-953890b7ef50" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Jul 01 19:42:19.619125 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:19.619101    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s"
Jul 01 19:42:19.654339 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:19.654313    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wv6ml\" (UniqueName: \"kubernetes.io/projected/69c2e01b-7582-4d6c-b35a-be506f1715cf-kube-api-access-wv6ml\") pod \"69c2e01b-7582-4d6c-b35a-be506f1715cf\" (UID: \"69c2e01b-7582-4d6c-b35a-be506f1715cf\") "
Jul 01 19:42:19.654504 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:19.654392    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/69c2e01b-7582-4d6c-b35a-be506f1715cf-kube-rbac-proxy-sar-config\") pod \"69c2e01b-7582-4d6c-b35a-be506f1715cf\" (UID: \"69c2e01b-7582-4d6c-b35a-be506f1715cf\") "
Jul 01 19:42:19.654572 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:19.654512    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/69c2e01b-7582-4d6c-b35a-be506f1715cf-proxy-tls\") pod \"69c2e01b-7582-4d6c-b35a-be506f1715cf\" (UID: \"69c2e01b-7582-4d6c-b35a-be506f1715cf\") "
Jul 01 19:42:19.654786 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:19.654765    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69c2e01b-7582-4d6c-b35a-be506f1715cf-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "69c2e01b-7582-4d6c-b35a-be506f1715cf" (UID: "69c2e01b-7582-4d6c-b35a-be506f1715cf"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 19:42:19.656501 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:19.656468    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69c2e01b-7582-4d6c-b35a-be506f1715cf-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "69c2e01b-7582-4d6c-b35a-be506f1715cf" (UID: "69c2e01b-7582-4d6c-b35a-be506f1715cf"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 19:42:19.656603 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:19.656503    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69c2e01b-7582-4d6c-b35a-be506f1715cf-kube-api-access-wv6ml" (OuterVolumeSpecName: "kube-api-access-wv6ml") pod "69c2e01b-7582-4d6c-b35a-be506f1715cf" (UID: "69c2e01b-7582-4d6c-b35a-be506f1715cf"). InnerVolumeSpecName "kube-api-access-wv6ml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 19:42:19.755810 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:19.755777    2556 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/69c2e01b-7582-4d6c-b35a-be506f1715cf-proxy-tls\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:42:19.755810 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:19.755806    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wv6ml\" (UniqueName: \"kubernetes.io/projected/69c2e01b-7582-4d6c-b35a-be506f1715cf-kube-api-access-wv6ml\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:42:19.755810 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:19.755816    2556 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/69c2e01b-7582-4d6c-b35a-be506f1715cf-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:42:20.508201 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:20.508173    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s"
Jul 01 19:42:20.508654 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:20.508201    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s" event={"ID":"69c2e01b-7582-4d6c-b35a-be506f1715cf","Type":"ContainerDied","Data":"8e6b06cda7370c62e744531fe3a7655f8b97a316d424fba67f0f9c12ae87f66c"}
Jul 01 19:42:20.508654 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:20.508262    2556 scope.go:117] "RemoveContainer" containerID="3fe10db1fe4ea2757cf111a2d093d42f72effe5346938fc246deecd88d3b48d7"
Jul 01 19:42:20.508894 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:20.508859    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-ac147-predictor-84bcbc5868-rqjk8" podUID="644393c3-9e8b-495f-8023-953890b7ef50" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Jul 01 19:42:20.516809 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:20.516783    2556 scope.go:117] "RemoveContainer" containerID="7f94a1182f73d810d34aaa8b0b5f3de7c438ab64a14baa99776cb5c4a5c8d208"
Jul 01 19:42:20.528282 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:20.528259    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s"]
Jul 01 19:42:20.531479 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:20.531459    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-834d0-predictor-5d6bdfcff8-t9t2s"]
Jul 01 19:42:22.255343 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:22.255307    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69c2e01b-7582-4d6c-b35a-be506f1715cf" path="/var/lib/kubelet/pods/69c2e01b-7582-4d6c-b35a-be506f1715cf/volumes"
Jul 01 19:42:25.512727 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:25.512700    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-ac147-predictor-84bcbc5868-rqjk8"
Jul 01 19:42:25.513179 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:25.513154    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-ac147-predictor-84bcbc5868-rqjk8" podUID="644393c3-9e8b-495f-8023-953890b7ef50" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Jul 01 19:42:35.513457 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:35.513411    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-ac147-predictor-84bcbc5868-rqjk8" podUID="644393c3-9e8b-495f-8023-953890b7ef50" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Jul 01 19:42:45.514025 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:45.513986    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-ac147-predictor-84bcbc5868-rqjk8" podUID="644393c3-9e8b-495f-8023-953890b7ef50" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Jul 01 19:42:55.513169 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:42:55.513126    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-ac147-predictor-84bcbc5868-rqjk8" podUID="644393c3-9e8b-495f-8023-953890b7ef50" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Jul 01 19:43:05.514178 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:05.514086    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-ac147-predictor-84bcbc5868-rqjk8"
Jul 01 19:43:16.091881 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:16.091839    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc"]
Jul 01 19:43:16.092531 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:16.092436    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69c2e01b-7582-4d6c-b35a-be506f1715cf" containerName="kserve-container"
Jul 01 19:43:16.092531 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:16.092460    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="69c2e01b-7582-4d6c-b35a-be506f1715cf" containerName="kserve-container"
Jul 01 19:43:16.092531 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:16.092474    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69c2e01b-7582-4d6c-b35a-be506f1715cf" containerName="kube-rbac-proxy"
Jul 01 19:43:16.092531 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:16.092483    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="69c2e01b-7582-4d6c-b35a-be506f1715cf" containerName="kube-rbac-proxy"
Jul 01 19:43:16.092771 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:16.092584    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="69c2e01b-7582-4d6c-b35a-be506f1715cf" containerName="kserve-container"
Jul 01 19:43:16.092771 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:16.092600    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="69c2e01b-7582-4d6c-b35a-be506f1715cf" containerName="kube-rbac-proxy"
Jul 01 19:43:16.094656 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:16.094635    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc"
Jul 01 19:43:16.097033 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:16.097008    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-46ddd-predictor-serving-cert\""
Jul 01 19:43:16.097141 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:16.097068    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-46ddd-kube-rbac-proxy-sar-config\""
Jul 01 19:43:16.106132 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:16.106105    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc"]
Jul 01 19:43:16.150577 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:16.150541    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/617a6c91-9eb5-4902-bd06-aa2916ded127-proxy-tls\") pod \"error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc\" (UID: \"617a6c91-9eb5-4902-bd06-aa2916ded127\") " pod="kserve-ci-e2e-test/error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc"
Jul 01 19:43:16.150729 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:16.150581    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q644c\" (UniqueName: \"kubernetes.io/projected/617a6c91-9eb5-4902-bd06-aa2916ded127-kube-api-access-q644c\") pod \"error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc\" (UID: \"617a6c91-9eb5-4902-bd06-aa2916ded127\") " pod="kserve-ci-e2e-test/error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc"
Jul 01 19:43:16.150729 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:16.150612    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/617a6c91-9eb5-4902-bd06-aa2916ded127-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc\" (UID: \"617a6c91-9eb5-4902-bd06-aa2916ded127\") " pod="kserve-ci-e2e-test/error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc"
Jul 01 19:43:16.158386 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:16.158337    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-01ba2-predictor-66f759c884-26btm"]
Jul 01 19:43:16.158671 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:16.158628    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-01ba2-predictor-66f759c884-26btm" podUID="1f8faff5-2165-49ec-9c6b-953905b8abc7" containerName="kserve-container" containerID="cri-o://33c96e77f15c4055b47519f8c5a144c67cc2c3bbfa57d35fe8eb900ca5cc86a3" gracePeriod=30
Jul 01 19:43:16.158780 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:16.158660    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-01ba2-predictor-66f759c884-26btm" podUID="1f8faff5-2165-49ec-9c6b-953905b8abc7" containerName="kube-rbac-proxy" containerID="cri-o://8d442f6566df9f22ee414696c4e8764c35a7c35a6ea552234a0324198579d64e" gracePeriod=30
Jul 01 19:43:16.251691 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:16.251656    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/617a6c91-9eb5-4902-bd06-aa2916ded127-proxy-tls\") pod \"error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc\" (UID: \"617a6c91-9eb5-4902-bd06-aa2916ded127\") " pod="kserve-ci-e2e-test/error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc"
Jul 01 19:43:16.251691 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:16.251692    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q644c\" (UniqueName: \"kubernetes.io/projected/617a6c91-9eb5-4902-bd06-aa2916ded127-kube-api-access-q644c\") pod \"error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc\" (UID: \"617a6c91-9eb5-4902-bd06-aa2916ded127\") " pod="kserve-ci-e2e-test/error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc"
Jul 01 19:43:16.251942 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:16.251724    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/617a6c91-9eb5-4902-bd06-aa2916ded127-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc\" (UID: \"617a6c91-9eb5-4902-bd06-aa2916ded127\") " pod="kserve-ci-e2e-test/error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc"
Jul 01 19:43:16.252471 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:16.252447    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/617a6c91-9eb5-4902-bd06-aa2916ded127-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc\" (UID: \"617a6c91-9eb5-4902-bd06-aa2916ded127\") " pod="kserve-ci-e2e-test/error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc"
Jul 01 19:43:16.254161 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:16.254133    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/617a6c91-9eb5-4902-bd06-aa2916ded127-proxy-tls\") pod \"error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc\" (UID: \"617a6c91-9eb5-4902-bd06-aa2916ded127\") " pod="kserve-ci-e2e-test/error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc"
Jul 01 19:43:16.270778 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:16.270755    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q644c\" (UniqueName: \"kubernetes.io/projected/617a6c91-9eb5-4902-bd06-aa2916ded127-kube-api-access-q644c\") pod \"error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc\" (UID: \"617a6c91-9eb5-4902-bd06-aa2916ded127\") " pod="kserve-ci-e2e-test/error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc"
Jul 01 19:43:16.405523 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:16.405493    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc"
Jul 01 19:43:16.540723 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:16.540694    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc"]
Jul 01 19:43:16.543197 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:43:16.543170    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod617a6c91_9eb5_4902_bd06_aa2916ded127.slice/crio-271f8ecb6b84063a5c724b7e662ff784a7e7b44ef2195c91e7e4c759291f19ec WatchSource:0}: Error finding container 271f8ecb6b84063a5c724b7e662ff784a7e7b44ef2195c91e7e4c759291f19ec: Status 404 returned error can't find the container with id 271f8ecb6b84063a5c724b7e662ff784a7e7b44ef2195c91e7e4c759291f19ec
Jul 01 19:43:16.747632 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:16.747533    2556 generic.go:356] "Generic (PLEG): container finished" podID="1f8faff5-2165-49ec-9c6b-953905b8abc7" containerID="8d442f6566df9f22ee414696c4e8764c35a7c35a6ea552234a0324198579d64e" exitCode=2
Jul 01 19:43:16.747632 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:16.747611    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-01ba2-predictor-66f759c884-26btm" event={"ID":"1f8faff5-2165-49ec-9c6b-953905b8abc7","Type":"ContainerDied","Data":"8d442f6566df9f22ee414696c4e8764c35a7c35a6ea552234a0324198579d64e"}
Jul 01 19:43:16.749293 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:16.749270    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc" event={"ID":"617a6c91-9eb5-4902-bd06-aa2916ded127","Type":"ContainerStarted","Data":"15845923a5b9c7b6d32bcd05f18ae13254916bffb2c17b02ef4a2dd5cb87555b"}
Jul 01 19:43:16.749461 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:16.749315    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc" event={"ID":"617a6c91-9eb5-4902-bd06-aa2916ded127","Type":"ContainerStarted","Data":"2b592db5ce8252a333539e54f331b892d232b6a65b5099c3e20e9d8f6eb6bddb"}
Jul 01 19:43:16.749461 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:16.749340    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc" event={"ID":"617a6c91-9eb5-4902-bd06-aa2916ded127","Type":"ContainerStarted","Data":"271f8ecb6b84063a5c724b7e662ff784a7e7b44ef2195c91e7e4c759291f19ec"}
Jul 01 19:43:16.749461 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:16.749362    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc"
Jul 01 19:43:16.749461 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:16.749415    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc"
Jul 01 19:43:16.750580 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:16.750557    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc" podUID="617a6c91-9eb5-4902-bd06-aa2916ded127" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Jul 01 19:43:16.771917 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:16.771864    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc" podStartSLOduration=0.771849247 podStartE2EDuration="771.849247ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:43:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:43:16.769914616 +0000 UTC m=+1181.132926298" watchObservedRunningTime="2026-07-01 19:43:16.771849247 +0000 UTC m=+1181.134860928"
Jul 01 19:43:17.754169 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:17.754132    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc" podUID="617a6c91-9eb5-4902-bd06-aa2916ded127" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Jul 01 19:43:18.366458 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:18.366408    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-01ba2-predictor-66f759c884-26btm" podUID="1f8faff5-2165-49ec-9c6b-953905b8abc7" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.30:8643/healthz\": dial tcp 10.134.0.30:8643: connect: connection refused"
Jul 01 19:43:18.370741 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:18.370716    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-01ba2-predictor-66f759c884-26btm" podUID="1f8faff5-2165-49ec-9c6b-953905b8abc7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Jul 01 19:43:19.510412 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:19.510384    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-01ba2-predictor-66f759c884-26btm"
Jul 01 19:43:19.578602 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:19.578519    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1f8faff5-2165-49ec-9c6b-953905b8abc7-proxy-tls\") pod \"1f8faff5-2165-49ec-9c6b-953905b8abc7\" (UID: \"1f8faff5-2165-49ec-9c6b-953905b8abc7\") "
Jul 01 19:43:19.578602 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:19.578591    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4h9n\" (UniqueName: \"kubernetes.io/projected/1f8faff5-2165-49ec-9c6b-953905b8abc7-kube-api-access-x4h9n\") pod \"1f8faff5-2165-49ec-9c6b-953905b8abc7\" (UID: \"1f8faff5-2165-49ec-9c6b-953905b8abc7\") "
Jul 01 19:43:19.578814 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:19.578640    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1f8faff5-2165-49ec-9c6b-953905b8abc7-kube-rbac-proxy-sar-config\") pod \"1f8faff5-2165-49ec-9c6b-953905b8abc7\" (UID: \"1f8faff5-2165-49ec-9c6b-953905b8abc7\") "
Jul 01 19:43:19.579040 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:19.579009    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f8faff5-2165-49ec-9c6b-953905b8abc7-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "1f8faff5-2165-49ec-9c6b-953905b8abc7" (UID: "1f8faff5-2165-49ec-9c6b-953905b8abc7"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 19:43:19.580660 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:19.580632    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f8faff5-2165-49ec-9c6b-953905b8abc7-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "1f8faff5-2165-49ec-9c6b-953905b8abc7" (UID: "1f8faff5-2165-49ec-9c6b-953905b8abc7"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 19:43:19.580757 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:19.580662    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f8faff5-2165-49ec-9c6b-953905b8abc7-kube-api-access-x4h9n" (OuterVolumeSpecName: "kube-api-access-x4h9n") pod "1f8faff5-2165-49ec-9c6b-953905b8abc7" (UID: "1f8faff5-2165-49ec-9c6b-953905b8abc7"). InnerVolumeSpecName "kube-api-access-x4h9n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 19:43:19.680173 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:19.680136    2556 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1f8faff5-2165-49ec-9c6b-953905b8abc7-proxy-tls\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:43:19.680173 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:19.680166    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4h9n\" (UniqueName: \"kubernetes.io/projected/1f8faff5-2165-49ec-9c6b-953905b8abc7-kube-api-access-x4h9n\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:43:19.680173 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:19.680176    2556 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1f8faff5-2165-49ec-9c6b-953905b8abc7-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:43:19.763962 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:19.763924    2556 generic.go:356] "Generic (PLEG): container finished" podID="1f8faff5-2165-49ec-9c6b-953905b8abc7" containerID="33c96e77f15c4055b47519f8c5a144c67cc2c3bbfa57d35fe8eb900ca5cc86a3" exitCode=0
Jul 01 19:43:19.764124 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:19.763973    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-01ba2-predictor-66f759c884-26btm"
Jul 01 19:43:19.764124 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:19.764001    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-01ba2-predictor-66f759c884-26btm" event={"ID":"1f8faff5-2165-49ec-9c6b-953905b8abc7","Type":"ContainerDied","Data":"33c96e77f15c4055b47519f8c5a144c67cc2c3bbfa57d35fe8eb900ca5cc86a3"}
Jul 01 19:43:19.764124 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:19.764052    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-01ba2-predictor-66f759c884-26btm" event={"ID":"1f8faff5-2165-49ec-9c6b-953905b8abc7","Type":"ContainerDied","Data":"a0fa6c5747c8a9eb079a4955e9ec88bf766afff2b232fc17e6cf5d7849ebc58f"}
Jul 01 19:43:19.764124 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:19.764084    2556 scope.go:117] "RemoveContainer" containerID="8d442f6566df9f22ee414696c4e8764c35a7c35a6ea552234a0324198579d64e"
Jul 01 19:43:19.772510 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:19.772486    2556 scope.go:117] "RemoveContainer" containerID="33c96e77f15c4055b47519f8c5a144c67cc2c3bbfa57d35fe8eb900ca5cc86a3"
Jul 01 19:43:19.779533 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:19.779513    2556 scope.go:117] "RemoveContainer" containerID="8d442f6566df9f22ee414696c4e8764c35a7c35a6ea552234a0324198579d64e"
Jul 01 19:43:19.779769 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:43:19.779750    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d442f6566df9f22ee414696c4e8764c35a7c35a6ea552234a0324198579d64e\": container with ID starting with 8d442f6566df9f22ee414696c4e8764c35a7c35a6ea552234a0324198579d64e not found: ID does not exist" containerID="8d442f6566df9f22ee414696c4e8764c35a7c35a6ea552234a0324198579d64e"
Jul 01 19:43:19.779810 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:19.779778    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d442f6566df9f22ee414696c4e8764c35a7c35a6ea552234a0324198579d64e"} err="failed to get container status \"8d442f6566df9f22ee414696c4e8764c35a7c35a6ea552234a0324198579d64e\": rpc error: code = NotFound desc = could not find container \"8d442f6566df9f22ee414696c4e8764c35a7c35a6ea552234a0324198579d64e\": container with ID starting with 8d442f6566df9f22ee414696c4e8764c35a7c35a6ea552234a0324198579d64e not found: ID does not exist"
Jul 01 19:43:19.779810 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:19.779795    2556 scope.go:117] "RemoveContainer" containerID="33c96e77f15c4055b47519f8c5a144c67cc2c3bbfa57d35fe8eb900ca5cc86a3"
Jul 01 19:43:19.780000 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:43:19.779985    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33c96e77f15c4055b47519f8c5a144c67cc2c3bbfa57d35fe8eb900ca5cc86a3\": container with ID starting with 33c96e77f15c4055b47519f8c5a144c67cc2c3bbfa57d35fe8eb900ca5cc86a3 not found: ID does not exist" containerID="33c96e77f15c4055b47519f8c5a144c67cc2c3bbfa57d35fe8eb900ca5cc86a3"
Jul 01 19:43:19.780041 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:19.780003    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33c96e77f15c4055b47519f8c5a144c67cc2c3bbfa57d35fe8eb900ca5cc86a3"} err="failed to get container status \"33c96e77f15c4055b47519f8c5a144c67cc2c3bbfa57d35fe8eb900ca5cc86a3\": rpc error: code = NotFound desc = could not find container \"33c96e77f15c4055b47519f8c5a144c67cc2c3bbfa57d35fe8eb900ca5cc86a3\": container with ID starting with 33c96e77f15c4055b47519f8c5a144c67cc2c3bbfa57d35fe8eb900ca5cc86a3 not found: ID does not exist"
Jul 01 19:43:19.792946 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:19.792920    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-01ba2-predictor-66f759c884-26btm"]
Jul 01 19:43:19.798651 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:19.798630    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-01ba2-predictor-66f759c884-26btm"]
Jul 01 19:43:20.254833 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:20.254801    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f8faff5-2165-49ec-9c6b-953905b8abc7" path="/var/lib/kubelet/pods/1f8faff5-2165-49ec-9c6b-953905b8abc7/volumes"
Jul 01 19:43:22.758751 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:22.758722    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc"
Jul 01 19:43:22.759163 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:22.759136    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc" podUID="617a6c91-9eb5-4902-bd06-aa2916ded127" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Jul 01 19:43:26.590160 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:26.590126    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr"]
Jul 01 19:43:26.590576 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:26.590521    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f8faff5-2165-49ec-9c6b-953905b8abc7" containerName="kserve-container"
Jul 01 19:43:26.590576 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:26.590534    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f8faff5-2165-49ec-9c6b-953905b8abc7" containerName="kserve-container"
Jul 01 19:43:26.590576 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:26.590548    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f8faff5-2165-49ec-9c6b-953905b8abc7" containerName="kube-rbac-proxy"
Jul 01 19:43:26.590576 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:26.590554    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f8faff5-2165-49ec-9c6b-953905b8abc7" containerName="kube-rbac-proxy"
Jul 01 19:43:26.590706 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:26.590619    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f8faff5-2165-49ec-9c6b-953905b8abc7" containerName="kserve-container"
Jul 01 19:43:26.590706 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:26.590630    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f8faff5-2165-49ec-9c6b-953905b8abc7" containerName="kube-rbac-proxy"
Jul 01 19:43:26.593893 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:26.593871    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr"
Jul 01 19:43:26.597040 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:26.597016    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-c6a40-predictor-serving-cert\""
Jul 01 19:43:26.597176 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:26.597021    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-c6a40-kube-rbac-proxy-sar-config\""
Jul 01 19:43:26.609156 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:26.609131    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr"]
Jul 01 19:43:26.645898 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:26.645853    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c19349f6-8485-4781-b55e-3d6992cd8c96-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr\" (UID: \"c19349f6-8485-4781-b55e-3d6992cd8c96\") " pod="kserve-ci-e2e-test/error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr"
Jul 01 19:43:26.646065 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:26.645916    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c19349f6-8485-4781-b55e-3d6992cd8c96-proxy-tls\") pod \"error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr\" (UID: \"c19349f6-8485-4781-b55e-3d6992cd8c96\") " pod="kserve-ci-e2e-test/error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr"
Jul 01 19:43:26.646065 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:26.645995    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh4j4\" (UniqueName: \"kubernetes.io/projected/c19349f6-8485-4781-b55e-3d6992cd8c96-kube-api-access-sh4j4\") pod \"error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr\" (UID: \"c19349f6-8485-4781-b55e-3d6992cd8c96\") " pod="kserve-ci-e2e-test/error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr"
Jul 01 19:43:26.654350 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:26.654320    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-ac147-predictor-84bcbc5868-rqjk8"]
Jul 01 19:43:26.654597 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:26.654575    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-ac147-predictor-84bcbc5868-rqjk8" podUID="644393c3-9e8b-495f-8023-953890b7ef50" containerName="kserve-container" containerID="cri-o://afeab18b70a9d8bf406bbc740c5d2c3757175fc7f5fe53ddd29d26382922a38c" gracePeriod=30
Jul 01 19:43:26.654665 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:26.654603    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-ac147-predictor-84bcbc5868-rqjk8" podUID="644393c3-9e8b-495f-8023-953890b7ef50" containerName="kube-rbac-proxy" containerID="cri-o://882293d66f6e6bf3d4bba78108b8a423cb113944472aa02a8d790a0d02268ff3" gracePeriod=30
Jul 01 19:43:26.747272 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:26.747234    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c19349f6-8485-4781-b55e-3d6992cd8c96-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr\" (UID: \"c19349f6-8485-4781-b55e-3d6992cd8c96\") " pod="kserve-ci-e2e-test/error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr"
Jul 01 19:43:26.747460 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:26.747286    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c19349f6-8485-4781-b55e-3d6992cd8c96-proxy-tls\") pod \"error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr\" (UID: \"c19349f6-8485-4781-b55e-3d6992cd8c96\") " pod="kserve-ci-e2e-test/error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr"
Jul 01 19:43:26.747460 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:26.747313    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh4j4\" (UniqueName: \"kubernetes.io/projected/c19349f6-8485-4781-b55e-3d6992cd8c96-kube-api-access-sh4j4\") pod \"error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr\" (UID: \"c19349f6-8485-4781-b55e-3d6992cd8c96\") " pod="kserve-ci-e2e-test/error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr"
Jul 01 19:43:26.747568 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:43:26.747472    2556 secret.go:189] Couldn't get secret kserve-ci-e2e-test/error-404-isvc-c6a40-predictor-serving-cert: secret "error-404-isvc-c6a40-predictor-serving-cert" not found
Jul 01 19:43:26.747568 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:43:26.747549    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c19349f6-8485-4781-b55e-3d6992cd8c96-proxy-tls podName:c19349f6-8485-4781-b55e-3d6992cd8c96 nodeName:}" failed. No retries permitted until 2026-07-01 19:43:27.247525362 +0000 UTC m=+1191.610537026 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/c19349f6-8485-4781-b55e-3d6992cd8c96-proxy-tls") pod "error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr" (UID: "c19349f6-8485-4781-b55e-3d6992cd8c96") : secret "error-404-isvc-c6a40-predictor-serving-cert" not found
Jul 01 19:43:26.748017 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:26.747998    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c19349f6-8485-4781-b55e-3d6992cd8c96-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr\" (UID: \"c19349f6-8485-4781-b55e-3d6992cd8c96\") " pod="kserve-ci-e2e-test/error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr"
Jul 01 19:43:26.760092 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:26.760064    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh4j4\" (UniqueName: \"kubernetes.io/projected/c19349f6-8485-4781-b55e-3d6992cd8c96-kube-api-access-sh4j4\") pod \"error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr\" (UID: \"c19349f6-8485-4781-b55e-3d6992cd8c96\") " pod="kserve-ci-e2e-test/error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr"
Jul 01 19:43:26.799790 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:26.799748    2556 generic.go:356] "Generic (PLEG): container finished" podID="644393c3-9e8b-495f-8023-953890b7ef50" containerID="882293d66f6e6bf3d4bba78108b8a423cb113944472aa02a8d790a0d02268ff3" exitCode=2
Jul 01 19:43:26.799960 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:26.799828    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-ac147-predictor-84bcbc5868-rqjk8" event={"ID":"644393c3-9e8b-495f-8023-953890b7ef50","Type":"ContainerDied","Data":"882293d66f6e6bf3d4bba78108b8a423cb113944472aa02a8d790a0d02268ff3"}
Jul 01 19:43:27.250099 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:27.250056    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c19349f6-8485-4781-b55e-3d6992cd8c96-proxy-tls\") pod \"error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr\" (UID: \"c19349f6-8485-4781-b55e-3d6992cd8c96\") " pod="kserve-ci-e2e-test/error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr"
Jul 01 19:43:27.252454 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:27.252425    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c19349f6-8485-4781-b55e-3d6992cd8c96-proxy-tls\") pod \"error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr\" (UID: \"c19349f6-8485-4781-b55e-3d6992cd8c96\") " pod="kserve-ci-e2e-test/error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr"
Jul 01 19:43:27.505917 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:27.505828    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr"
Jul 01 19:43:27.637866 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:27.637838    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr"]
Jul 01 19:43:27.639947 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:43:27.639923    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc19349f6_8485_4781_b55e_3d6992cd8c96.slice/crio-9daf789d21dfc837675a939ecf0692cbfc00cd3f37969fa0c3a75d4798895491 WatchSource:0}: Error finding container 9daf789d21dfc837675a939ecf0692cbfc00cd3f37969fa0c3a75d4798895491: Status 404 returned error can't find the container with id 9daf789d21dfc837675a939ecf0692cbfc00cd3f37969fa0c3a75d4798895491
Jul 01 19:43:27.807114 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:27.807069    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr" event={"ID":"c19349f6-8485-4781-b55e-3d6992cd8c96","Type":"ContainerStarted","Data":"659b9a3d6d7ef45dc56a10ed0bbeb8ce2e8cac227bbcacaea9feee703da15fc6"}
Jul 01 19:43:27.807299 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:27.807137    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr" event={"ID":"c19349f6-8485-4781-b55e-3d6992cd8c96","Type":"ContainerStarted","Data":"1c115c630b949e7bbc10d15b9ba18f50149f0bc78e021f1a919d87df350e9e0b"}
Jul 01 19:43:27.807299 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:27.807167    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr" event={"ID":"c19349f6-8485-4781-b55e-3d6992cd8c96","Type":"ContainerStarted","Data":"9daf789d21dfc837675a939ecf0692cbfc00cd3f37969fa0c3a75d4798895491"}
Jul 01 19:43:27.807299 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:27.807232    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr"
Jul 01 19:43:27.829681 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:27.829623    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr" podStartSLOduration=1.829603174 podStartE2EDuration="1.829603174s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:43:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:43:27.82797753 +0000 UTC m=+1192.190989207" watchObservedRunningTime="2026-07-01 19:43:27.829603174 +0000 UTC m=+1192.192614855"
Jul 01 19:43:28.812353 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:28.812323    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr"
Jul 01 19:43:28.813652 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:28.813619    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr" podUID="c19349f6-8485-4781-b55e-3d6992cd8c96" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused"
Jul 01 19:43:29.819195 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:29.819153    2556 generic.go:356] "Generic (PLEG): container finished" podID="644393c3-9e8b-495f-8023-953890b7ef50" containerID="afeab18b70a9d8bf406bbc740c5d2c3757175fc7f5fe53ddd29d26382922a38c" exitCode=0
Jul 01 19:43:29.819647 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:29.819220    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-ac147-predictor-84bcbc5868-rqjk8" event={"ID":"644393c3-9e8b-495f-8023-953890b7ef50","Type":"ContainerDied","Data":"afeab18b70a9d8bf406bbc740c5d2c3757175fc7f5fe53ddd29d26382922a38c"}
Jul 01 19:43:29.819647 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:29.819586    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr" podUID="c19349f6-8485-4781-b55e-3d6992cd8c96" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused"
Jul 01 19:43:29.909119 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:29.909094    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-ac147-predictor-84bcbc5868-rqjk8"
Jul 01 19:43:29.970912 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:29.970816    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/644393c3-9e8b-495f-8023-953890b7ef50-proxy-tls\") pod \"644393c3-9e8b-495f-8023-953890b7ef50\" (UID: \"644393c3-9e8b-495f-8023-953890b7ef50\") "
Jul 01 19:43:29.970912 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:29.970888    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwqzl\" (UniqueName: \"kubernetes.io/projected/644393c3-9e8b-495f-8023-953890b7ef50-kube-api-access-vwqzl\") pod \"644393c3-9e8b-495f-8023-953890b7ef50\" (UID: \"644393c3-9e8b-495f-8023-953890b7ef50\") "
Jul 01 19:43:29.971152 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:29.970929    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/644393c3-9e8b-495f-8023-953890b7ef50-kube-rbac-proxy-sar-config\") pod \"644393c3-9e8b-495f-8023-953890b7ef50\" (UID: \"644393c3-9e8b-495f-8023-953890b7ef50\") "
Jul 01 19:43:29.971319 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:29.971290    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/644393c3-9e8b-495f-8023-953890b7ef50-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "644393c3-9e8b-495f-8023-953890b7ef50" (UID: "644393c3-9e8b-495f-8023-953890b7ef50"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 19:43:29.972953 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:29.972926    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/644393c3-9e8b-495f-8023-953890b7ef50-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "644393c3-9e8b-495f-8023-953890b7ef50" (UID: "644393c3-9e8b-495f-8023-953890b7ef50"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 19:43:29.973055 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:29.973034    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/644393c3-9e8b-495f-8023-953890b7ef50-kube-api-access-vwqzl" (OuterVolumeSpecName: "kube-api-access-vwqzl") pod "644393c3-9e8b-495f-8023-953890b7ef50" (UID: "644393c3-9e8b-495f-8023-953890b7ef50"). InnerVolumeSpecName "kube-api-access-vwqzl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 19:43:30.071918 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:30.071865    2556 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/644393c3-9e8b-495f-8023-953890b7ef50-proxy-tls\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:43:30.071918 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:30.071913    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwqzl\" (UniqueName: \"kubernetes.io/projected/644393c3-9e8b-495f-8023-953890b7ef50-kube-api-access-vwqzl\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:43:30.071918 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:30.071924    2556 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/644393c3-9e8b-495f-8023-953890b7ef50-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:43:30.824800 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:30.824769    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-ac147-predictor-84bcbc5868-rqjk8"
Jul 01 19:43:30.824800 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:30.824774    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-ac147-predictor-84bcbc5868-rqjk8" event={"ID":"644393c3-9e8b-495f-8023-953890b7ef50","Type":"ContainerDied","Data":"cb04f9a6dbbb698071fc9c780b77e476c40272d786ca8286c2c69a2b47f40f42"}
Jul 01 19:43:30.825306 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:30.824851    2556 scope.go:117] "RemoveContainer" containerID="882293d66f6e6bf3d4bba78108b8a423cb113944472aa02a8d790a0d02268ff3"
Jul 01 19:43:30.833022 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:30.833010    2556 scope.go:117] "RemoveContainer" containerID="afeab18b70a9d8bf406bbc740c5d2c3757175fc7f5fe53ddd29d26382922a38c"
Jul 01 19:43:30.843474 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:30.843448    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-ac147-predictor-84bcbc5868-rqjk8"]
Jul 01 19:43:30.847205 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:30.847182    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-ac147-predictor-84bcbc5868-rqjk8"]
Jul 01 19:43:32.255697 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:32.255661    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="644393c3-9e8b-495f-8023-953890b7ef50" path="/var/lib/kubelet/pods/644393c3-9e8b-495f-8023-953890b7ef50/volumes"
Jul 01 19:43:32.759640 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:32.759597    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc" podUID="617a6c91-9eb5-4902-bd06-aa2916ded127" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Jul 01 19:43:34.824506 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:34.824478    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr"
Jul 01 19:43:34.825099 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:34.825072    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr" podUID="c19349f6-8485-4781-b55e-3d6992cd8c96" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused"
Jul 01 19:43:36.274068 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:36.274033    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tq4l_d621ab71-8427-42af-bfa4-f83db9c5800d/ovn-acl-logging/0.log"
Jul 01 19:43:36.274535 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:36.274310    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tq4l_d621ab71-8427-42af-bfa4-f83db9c5800d/ovn-acl-logging/0.log"
Jul 01 19:43:42.759751 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:42.759712    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc" podUID="617a6c91-9eb5-4902-bd06-aa2916ded127" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Jul 01 19:43:44.825348 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:44.825305    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr" podUID="c19349f6-8485-4781-b55e-3d6992cd8c96" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused"
Jul 01 19:43:52.760064 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:52.760022    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc" podUID="617a6c91-9eb5-4902-bd06-aa2916ded127" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Jul 01 19:43:54.825052 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:43:54.825010    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr" podUID="c19349f6-8485-4781-b55e-3d6992cd8c96" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused"
Jul 01 19:44:02.759576 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:02.759536    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc"
Jul 01 19:44:04.825553 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:04.825515    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr" podUID="c19349f6-8485-4781-b55e-3d6992cd8c96" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused"
Jul 01 19:44:14.826491 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:14.826458    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr"
Jul 01 19:44:26.177567 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:26.177527    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc"]
Jul 01 19:44:26.178285 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:26.178247    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc" podUID="617a6c91-9eb5-4902-bd06-aa2916ded127" containerName="kube-rbac-proxy" containerID="cri-o://15845923a5b9c7b6d32bcd05f18ae13254916bffb2c17b02ef4a2dd5cb87555b" gracePeriod=30
Jul 01 19:44:26.178501 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:26.178264    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc" podUID="617a6c91-9eb5-4902-bd06-aa2916ded127" containerName="kserve-container" containerID="cri-o://2b592db5ce8252a333539e54f331b892d232b6a65b5099c3e20e9d8f6eb6bddb" gracePeriod=30
Jul 01 19:44:26.339942 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:26.339906    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-88843-predictor-5985fbc74-lkb8x"]
Jul 01 19:44:26.340341 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:26.340327    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="644393c3-9e8b-495f-8023-953890b7ef50" containerName="kserve-container"
Jul 01 19:44:26.340416 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:26.340344    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="644393c3-9e8b-495f-8023-953890b7ef50" containerName="kserve-container"
Jul 01 19:44:26.340416 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:26.340354    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="644393c3-9e8b-495f-8023-953890b7ef50" containerName="kube-rbac-proxy"
Jul 01 19:44:26.340416 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:26.340360    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="644393c3-9e8b-495f-8023-953890b7ef50" containerName="kube-rbac-proxy"
Jul 01 19:44:26.340532 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:26.340447    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="644393c3-9e8b-495f-8023-953890b7ef50" containerName="kserve-container"
Jul 01 19:44:26.340532 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:26.340456    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="644393c3-9e8b-495f-8023-953890b7ef50" containerName="kube-rbac-proxy"
Jul 01 19:44:26.342684 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:26.342667    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-88843-predictor-5985fbc74-lkb8x"
Jul 01 19:44:26.345770 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:26.345747    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-88843-kube-rbac-proxy-sar-config\""
Jul 01 19:44:26.346274 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:26.346257    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-88843-predictor-serving-cert\""
Jul 01 19:44:26.357110 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:26.357086    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-88843-predictor-5985fbc74-lkb8x"]
Jul 01 19:44:26.480435 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:26.480355    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ef75e643-8bd8-4a66-b644-77f9ce967712-proxy-tls\") pod \"error-404-isvc-88843-predictor-5985fbc74-lkb8x\" (UID: \"ef75e643-8bd8-4a66-b644-77f9ce967712\") " pod="kserve-ci-e2e-test/error-404-isvc-88843-predictor-5985fbc74-lkb8x"
Jul 01 19:44:26.480621 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:26.480498    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ef75e643-8bd8-4a66-b644-77f9ce967712-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-88843-predictor-5985fbc74-lkb8x\" (UID: \"ef75e643-8bd8-4a66-b644-77f9ce967712\") " pod="kserve-ci-e2e-test/error-404-isvc-88843-predictor-5985fbc74-lkb8x"
Jul 01 19:44:26.480621 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:26.480553    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2wl2\" (UniqueName: \"kubernetes.io/projected/ef75e643-8bd8-4a66-b644-77f9ce967712-kube-api-access-l2wl2\") pod \"error-404-isvc-88843-predictor-5985fbc74-lkb8x\" (UID: \"ef75e643-8bd8-4a66-b644-77f9ce967712\") " pod="kserve-ci-e2e-test/error-404-isvc-88843-predictor-5985fbc74-lkb8x"
Jul 01 19:44:26.581108 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:26.581023    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2wl2\" (UniqueName: \"kubernetes.io/projected/ef75e643-8bd8-4a66-b644-77f9ce967712-kube-api-access-l2wl2\") pod \"error-404-isvc-88843-predictor-5985fbc74-lkb8x\" (UID: \"ef75e643-8bd8-4a66-b644-77f9ce967712\") " pod="kserve-ci-e2e-test/error-404-isvc-88843-predictor-5985fbc74-lkb8x"
Jul 01 19:44:26.581285 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:26.581120    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ef75e643-8bd8-4a66-b644-77f9ce967712-proxy-tls\") pod \"error-404-isvc-88843-predictor-5985fbc74-lkb8x\" (UID: \"ef75e643-8bd8-4a66-b644-77f9ce967712\") " pod="kserve-ci-e2e-test/error-404-isvc-88843-predictor-5985fbc74-lkb8x"
Jul 01 19:44:26.581285 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:26.581179    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ef75e643-8bd8-4a66-b644-77f9ce967712-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-88843-predictor-5985fbc74-lkb8x\" (UID: \"ef75e643-8bd8-4a66-b644-77f9ce967712\") " pod="kserve-ci-e2e-test/error-404-isvc-88843-predictor-5985fbc74-lkb8x"
Jul 01 19:44:26.581285 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:44:26.581277    2556 secret.go:189] Couldn't get secret kserve-ci-e2e-test/error-404-isvc-88843-predictor-serving-cert: secret "error-404-isvc-88843-predictor-serving-cert" not found
Jul 01 19:44:26.581513 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:44:26.581392    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef75e643-8bd8-4a66-b644-77f9ce967712-proxy-tls podName:ef75e643-8bd8-4a66-b644-77f9ce967712 nodeName:}" failed. No retries permitted until 2026-07-01 19:44:27.081354656 +0000 UTC m=+1251.444366332 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/ef75e643-8bd8-4a66-b644-77f9ce967712-proxy-tls") pod "error-404-isvc-88843-predictor-5985fbc74-lkb8x" (UID: "ef75e643-8bd8-4a66-b644-77f9ce967712") : secret "error-404-isvc-88843-predictor-serving-cert" not found
Jul 01 19:44:26.581907 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:26.581877    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ef75e643-8bd8-4a66-b644-77f9ce967712-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-88843-predictor-5985fbc74-lkb8x\" (UID: \"ef75e643-8bd8-4a66-b644-77f9ce967712\") " pod="kserve-ci-e2e-test/error-404-isvc-88843-predictor-5985fbc74-lkb8x"
Jul 01 19:44:26.589869 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:26.589846    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2wl2\" (UniqueName: \"kubernetes.io/projected/ef75e643-8bd8-4a66-b644-77f9ce967712-kube-api-access-l2wl2\") pod \"error-404-isvc-88843-predictor-5985fbc74-lkb8x\" (UID: \"ef75e643-8bd8-4a66-b644-77f9ce967712\") " pod="kserve-ci-e2e-test/error-404-isvc-88843-predictor-5985fbc74-lkb8x"
Jul 01 19:44:27.069719 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:27.069682    2556 generic.go:356] "Generic (PLEG): container finished" podID="617a6c91-9eb5-4902-bd06-aa2916ded127" containerID="15845923a5b9c7b6d32bcd05f18ae13254916bffb2c17b02ef4a2dd5cb87555b" exitCode=2
Jul 01 19:44:27.069894 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:27.069731    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc" event={"ID":"617a6c91-9eb5-4902-bd06-aa2916ded127","Type":"ContainerDied","Data":"15845923a5b9c7b6d32bcd05f18ae13254916bffb2c17b02ef4a2dd5cb87555b"}
Jul 01 19:44:27.086179 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:27.086149    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ef75e643-8bd8-4a66-b644-77f9ce967712-proxy-tls\") pod \"error-404-isvc-88843-predictor-5985fbc74-lkb8x\" (UID: \"ef75e643-8bd8-4a66-b644-77f9ce967712\") " pod="kserve-ci-e2e-test/error-404-isvc-88843-predictor-5985fbc74-lkb8x"
Jul 01 19:44:27.088490 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:27.088472    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ef75e643-8bd8-4a66-b644-77f9ce967712-proxy-tls\") pod \"error-404-isvc-88843-predictor-5985fbc74-lkb8x\" (UID: \"ef75e643-8bd8-4a66-b644-77f9ce967712\") " pod="kserve-ci-e2e-test/error-404-isvc-88843-predictor-5985fbc74-lkb8x"
Jul 01 19:44:27.253045 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:27.252952    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-88843-predictor-5985fbc74-lkb8x"
Jul 01 19:44:27.388960 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:27.388931    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-88843-predictor-5985fbc74-lkb8x"]
Jul 01 19:44:27.392071 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:44:27.392040    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef75e643_8bd8_4a66_b644_77f9ce967712.slice/crio-cffc56d90517efe3ce23991bb044723e038f136a5f85d7783c38171ed1442b93 WatchSource:0}: Error finding container cffc56d90517efe3ce23991bb044723e038f136a5f85d7783c38171ed1442b93: Status 404 returned error can't find the container with id cffc56d90517efe3ce23991bb044723e038f136a5f85d7783c38171ed1442b93
Jul 01 19:44:27.755151 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:27.755108    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc" podUID="617a6c91-9eb5-4902-bd06-aa2916ded127" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.32:8643/healthz\": dial tcp 10.134.0.32:8643: connect: connection refused"
Jul 01 19:44:28.075830 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:28.075735    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-88843-predictor-5985fbc74-lkb8x" event={"ID":"ef75e643-8bd8-4a66-b644-77f9ce967712","Type":"ContainerStarted","Data":"ac7e477e0a0b8df538c2564b1f05c2081cc8c55472e3b33346d1120ffe11af7a"}
Jul 01 19:44:28.075830 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:28.075809    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-88843-predictor-5985fbc74-lkb8x"
Jul 01 19:44:28.076056 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:28.075866    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-88843-predictor-5985fbc74-lkb8x"
Jul 01 19:44:28.076056 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:28.075897    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-88843-predictor-5985fbc74-lkb8x" event={"ID":"ef75e643-8bd8-4a66-b644-77f9ce967712","Type":"ContainerStarted","Data":"b2b7c8665813db79cfb0bc45db09a1f296d07e9bbf031c5f9e1aece14b5b4e7c"}
Jul 01 19:44:28.076056 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:28.075928    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-88843-predictor-5985fbc74-lkb8x" event={"ID":"ef75e643-8bd8-4a66-b644-77f9ce967712","Type":"ContainerStarted","Data":"cffc56d90517efe3ce23991bb044723e038f136a5f85d7783c38171ed1442b93"}
Jul 01 19:44:28.077252 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:28.077226    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-88843-predictor-5985fbc74-lkb8x" podUID="ef75e643-8bd8-4a66-b644-77f9ce967712" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.34:8080: connect: connection refused"
Jul 01 19:44:29.080453 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:29.080415    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-88843-predictor-5985fbc74-lkb8x" podUID="ef75e643-8bd8-4a66-b644-77f9ce967712" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.34:8080: connect: connection refused"
Jul 01 19:44:29.533353 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:29.533331    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc"
Jul 01 19:44:29.551113 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:29.550752    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-88843-predictor-5985fbc74-lkb8x" podStartSLOduration=3.5507325119999997 podStartE2EDuration="3.550732512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:44:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:44:28.107160319 +0000 UTC m=+1252.470171999" watchObservedRunningTime="2026-07-01 19:44:29.550732512 +0000 UTC m=+1253.913744195"
Jul 01 19:44:29.708991 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:29.708950    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/617a6c91-9eb5-4902-bd06-aa2916ded127-proxy-tls\") pod \"617a6c91-9eb5-4902-bd06-aa2916ded127\" (UID: \"617a6c91-9eb5-4902-bd06-aa2916ded127\") "
Jul 01 19:44:29.709190 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:29.709019    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q644c\" (UniqueName: \"kubernetes.io/projected/617a6c91-9eb5-4902-bd06-aa2916ded127-kube-api-access-q644c\") pod \"617a6c91-9eb5-4902-bd06-aa2916ded127\" (UID: \"617a6c91-9eb5-4902-bd06-aa2916ded127\") "
Jul 01 19:44:29.709190 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:29.709076    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/617a6c91-9eb5-4902-bd06-aa2916ded127-kube-rbac-proxy-sar-config\") pod \"617a6c91-9eb5-4902-bd06-aa2916ded127\" (UID: \"617a6c91-9eb5-4902-bd06-aa2916ded127\") "
Jul 01 19:44:29.709498 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:29.709463    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/617a6c91-9eb5-4902-bd06-aa2916ded127-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "617a6c91-9eb5-4902-bd06-aa2916ded127" (UID: "617a6c91-9eb5-4902-bd06-aa2916ded127"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 19:44:29.711083 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:29.711048    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/617a6c91-9eb5-4902-bd06-aa2916ded127-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "617a6c91-9eb5-4902-bd06-aa2916ded127" (UID: "617a6c91-9eb5-4902-bd06-aa2916ded127"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 19:44:29.711186 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:29.711100    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/617a6c91-9eb5-4902-bd06-aa2916ded127-kube-api-access-q644c" (OuterVolumeSpecName: "kube-api-access-q644c") pod "617a6c91-9eb5-4902-bd06-aa2916ded127" (UID: "617a6c91-9eb5-4902-bd06-aa2916ded127"). InnerVolumeSpecName "kube-api-access-q644c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 19:44:29.810684 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:29.810643    2556 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/617a6c91-9eb5-4902-bd06-aa2916ded127-proxy-tls\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:44:29.810684 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:29.810672    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q644c\" (UniqueName: \"kubernetes.io/projected/617a6c91-9eb5-4902-bd06-aa2916ded127-kube-api-access-q644c\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:44:29.810684 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:29.810683    2556 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/617a6c91-9eb5-4902-bd06-aa2916ded127-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:44:30.086356 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:30.086261    2556 generic.go:356] "Generic (PLEG): container finished" podID="617a6c91-9eb5-4902-bd06-aa2916ded127" containerID="2b592db5ce8252a333539e54f331b892d232b6a65b5099c3e20e9d8f6eb6bddb" exitCode=0
Jul 01 19:44:30.086356 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:30.086337    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc"
Jul 01 19:44:30.086843 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:30.086347    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc" event={"ID":"617a6c91-9eb5-4902-bd06-aa2916ded127","Type":"ContainerDied","Data":"2b592db5ce8252a333539e54f331b892d232b6a65b5099c3e20e9d8f6eb6bddb"}
Jul 01 19:44:30.086843 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:30.086472    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc" event={"ID":"617a6c91-9eb5-4902-bd06-aa2916ded127","Type":"ContainerDied","Data":"271f8ecb6b84063a5c724b7e662ff784a7e7b44ef2195c91e7e4c759291f19ec"}
Jul 01 19:44:30.086843 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:30.086513    2556 scope.go:117] "RemoveContainer" containerID="15845923a5b9c7b6d32bcd05f18ae13254916bffb2c17b02ef4a2dd5cb87555b"
Jul 01 19:44:30.095448 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:30.095426    2556 scope.go:117] "RemoveContainer" containerID="2b592db5ce8252a333539e54f331b892d232b6a65b5099c3e20e9d8f6eb6bddb"
Jul 01 19:44:30.105223 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:30.105202    2556 scope.go:117] "RemoveContainer" containerID="15845923a5b9c7b6d32bcd05f18ae13254916bffb2c17b02ef4a2dd5cb87555b"
Jul 01 19:44:30.105648 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:44:30.105620    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15845923a5b9c7b6d32bcd05f18ae13254916bffb2c17b02ef4a2dd5cb87555b\": container with ID starting with 15845923a5b9c7b6d32bcd05f18ae13254916bffb2c17b02ef4a2dd5cb87555b not found: ID does not exist" containerID="15845923a5b9c7b6d32bcd05f18ae13254916bffb2c17b02ef4a2dd5cb87555b"
Jul 01 19:44:30.105739 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:30.105659    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15845923a5b9c7b6d32bcd05f18ae13254916bffb2c17b02ef4a2dd5cb87555b"} err="failed to get container status \"15845923a5b9c7b6d32bcd05f18ae13254916bffb2c17b02ef4a2dd5cb87555b\": rpc error: code = NotFound desc = could not find container \"15845923a5b9c7b6d32bcd05f18ae13254916bffb2c17b02ef4a2dd5cb87555b\": container with ID starting with 15845923a5b9c7b6d32bcd05f18ae13254916bffb2c17b02ef4a2dd5cb87555b not found: ID does not exist"
Jul 01 19:44:30.105739 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:30.105681    2556 scope.go:117] "RemoveContainer" containerID="2b592db5ce8252a333539e54f331b892d232b6a65b5099c3e20e9d8f6eb6bddb"
Jul 01 19:44:30.105987 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:44:30.105959    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b592db5ce8252a333539e54f331b892d232b6a65b5099c3e20e9d8f6eb6bddb\": container with ID starting with 2b592db5ce8252a333539e54f331b892d232b6a65b5099c3e20e9d8f6eb6bddb not found: ID does not exist" containerID="2b592db5ce8252a333539e54f331b892d232b6a65b5099c3e20e9d8f6eb6bddb"
Jul 01 19:44:30.105987 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:30.105993    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b592db5ce8252a333539e54f331b892d232b6a65b5099c3e20e9d8f6eb6bddb"} err="failed to get container status \"2b592db5ce8252a333539e54f331b892d232b6a65b5099c3e20e9d8f6eb6bddb\": rpc error: code = NotFound desc = could not find container \"2b592db5ce8252a333539e54f331b892d232b6a65b5099c3e20e9d8f6eb6bddb\": container with ID starting with 2b592db5ce8252a333539e54f331b892d232b6a65b5099c3e20e9d8f6eb6bddb not found: ID does not exist"
Jul 01 19:44:30.110122 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:30.110098    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc"]
Jul 01 19:44:30.116289 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:30.116268    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-46ddd-predictor-5cc8f4b6d4-zd9kc"]
Jul 01 19:44:30.255576 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:30.255540    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="617a6c91-9eb5-4902-bd06-aa2916ded127" path="/var/lib/kubelet/pods/617a6c91-9eb5-4902-bd06-aa2916ded127/volumes"
Jul 01 19:44:34.085059 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:34.085026    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-88843-predictor-5985fbc74-lkb8x"
Jul 01 19:44:34.085579 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:34.085493    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-88843-predictor-5985fbc74-lkb8x" podUID="ef75e643-8bd8-4a66-b644-77f9ce967712" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.34:8080: connect: connection refused"
Jul 01 19:44:44.085823 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:44.085776    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-88843-predictor-5985fbc74-lkb8x" podUID="ef75e643-8bd8-4a66-b644-77f9ce967712" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.34:8080: connect: connection refused"
Jul 01 19:44:54.085779 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:44:54.085733    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-88843-predictor-5985fbc74-lkb8x" podUID="ef75e643-8bd8-4a66-b644-77f9ce967712" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.34:8080: connect: connection refused"
Jul 01 19:45:04.086131 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:45:04.086087    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-88843-predictor-5985fbc74-lkb8x" podUID="ef75e643-8bd8-4a66-b644-77f9ce967712" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.34:8080: connect: connection refused"
Jul 01 19:45:14.086551 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:45:14.086520    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-88843-predictor-5985fbc74-lkb8x"
Jul 01 19:48:36.309878 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:48:36.309845    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tq4l_d621ab71-8427-42af-bfa4-f83db9c5800d/ovn-acl-logging/0.log"
Jul 01 19:48:36.310446 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:48:36.310279    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tq4l_d621ab71-8427-42af-bfa4-f83db9c5800d/ovn-acl-logging/0.log"
Jul 01 19:52:41.374838 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:41.374806    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-74731-predictor-545cd488f6-w9m6r"]
Jul 01 19:52:41.377336 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:41.375156    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="617a6c91-9eb5-4902-bd06-aa2916ded127" containerName="kube-rbac-proxy"
Jul 01 19:52:41.377336 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:41.375166    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="617a6c91-9eb5-4902-bd06-aa2916ded127" containerName="kube-rbac-proxy"
Jul 01 19:52:41.377336 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:41.375183    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="617a6c91-9eb5-4902-bd06-aa2916ded127" containerName="kserve-container"
Jul 01 19:52:41.377336 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:41.375189    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="617a6c91-9eb5-4902-bd06-aa2916ded127" containerName="kserve-container"
Jul 01 19:52:41.377336 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:41.375249    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="617a6c91-9eb5-4902-bd06-aa2916ded127" containerName="kserve-container"
Jul 01 19:52:41.377336 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:41.375257    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="617a6c91-9eb5-4902-bd06-aa2916ded127" containerName="kube-rbac-proxy"
Jul 01 19:52:41.378299 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:41.378283    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-74731-predictor-545cd488f6-w9m6r"
Jul 01 19:52:41.380886 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:41.380862    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-74731-predictor-serving-cert\""
Jul 01 19:52:41.381011 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:41.380879    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-74731-kube-rbac-proxy-sar-config\""
Jul 01 19:52:41.394981 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:41.394953    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-74731-predictor-545cd488f6-w9m6r"]
Jul 01 19:52:41.433581 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:41.433548    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr"]
Jul 01 19:52:41.433797 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:41.433759    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr" podUID="c19349f6-8485-4781-b55e-3d6992cd8c96" containerName="kserve-container" containerID="cri-o://1c115c630b949e7bbc10d15b9ba18f50149f0bc78e021f1a919d87df350e9e0b" gracePeriod=30
Jul 01 19:52:41.433872 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:41.433826    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr" podUID="c19349f6-8485-4781-b55e-3d6992cd8c96" containerName="kube-rbac-proxy" containerID="cri-o://659b9a3d6d7ef45dc56a10ed0bbeb8ce2e8cac227bbcacaea9feee703da15fc6" gracePeriod=30
Jul 01 19:52:41.460028 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:41.459993    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9c5b3090-df12-47ec-a39d-67714ce7e797-proxy-tls\") pod \"error-404-isvc-74731-predictor-545cd488f6-w9m6r\" (UID: \"9c5b3090-df12-47ec-a39d-67714ce7e797\") " pod="kserve-ci-e2e-test/error-404-isvc-74731-predictor-545cd488f6-w9m6r"
Jul 01 19:52:41.460148 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:41.460099    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9c5b3090-df12-47ec-a39d-67714ce7e797-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-74731-predictor-545cd488f6-w9m6r\" (UID: \"9c5b3090-df12-47ec-a39d-67714ce7e797\") " pod="kserve-ci-e2e-test/error-404-isvc-74731-predictor-545cd488f6-w9m6r"
Jul 01 19:52:41.460148 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:41.460133    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p58l\" (UniqueName: \"kubernetes.io/projected/9c5b3090-df12-47ec-a39d-67714ce7e797-kube-api-access-8p58l\") pod \"error-404-isvc-74731-predictor-545cd488f6-w9m6r\" (UID: \"9c5b3090-df12-47ec-a39d-67714ce7e797\") " pod="kserve-ci-e2e-test/error-404-isvc-74731-predictor-545cd488f6-w9m6r"
Jul 01 19:52:41.560946 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:41.560910    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9c5b3090-df12-47ec-a39d-67714ce7e797-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-74731-predictor-545cd488f6-w9m6r\" (UID: \"9c5b3090-df12-47ec-a39d-67714ce7e797\") " pod="kserve-ci-e2e-test/error-404-isvc-74731-predictor-545cd488f6-w9m6r"
Jul 01 19:52:41.561099 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:41.560952    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p58l\" (UniqueName: \"kubernetes.io/projected/9c5b3090-df12-47ec-a39d-67714ce7e797-kube-api-access-8p58l\") pod \"error-404-isvc-74731-predictor-545cd488f6-w9m6r\" (UID: \"9c5b3090-df12-47ec-a39d-67714ce7e797\") " pod="kserve-ci-e2e-test/error-404-isvc-74731-predictor-545cd488f6-w9m6r"
Jul 01 19:52:41.561099 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:41.561014    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9c5b3090-df12-47ec-a39d-67714ce7e797-proxy-tls\") pod \"error-404-isvc-74731-predictor-545cd488f6-w9m6r\" (UID: \"9c5b3090-df12-47ec-a39d-67714ce7e797\") " pod="kserve-ci-e2e-test/error-404-isvc-74731-predictor-545cd488f6-w9m6r"
Jul 01 19:52:41.561614 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:41.561591    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9c5b3090-df12-47ec-a39d-67714ce7e797-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-74731-predictor-545cd488f6-w9m6r\" (UID: \"9c5b3090-df12-47ec-a39d-67714ce7e797\") " pod="kserve-ci-e2e-test/error-404-isvc-74731-predictor-545cd488f6-w9m6r"
Jul 01 19:52:41.563264 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:41.563243    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9c5b3090-df12-47ec-a39d-67714ce7e797-proxy-tls\") pod \"error-404-isvc-74731-predictor-545cd488f6-w9m6r\" (UID: \"9c5b3090-df12-47ec-a39d-67714ce7e797\") " pod="kserve-ci-e2e-test/error-404-isvc-74731-predictor-545cd488f6-w9m6r"
Jul 01 19:52:41.568446 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:41.568424    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p58l\" (UniqueName: \"kubernetes.io/projected/9c5b3090-df12-47ec-a39d-67714ce7e797-kube-api-access-8p58l\") pod \"error-404-isvc-74731-predictor-545cd488f6-w9m6r\" (UID: \"9c5b3090-df12-47ec-a39d-67714ce7e797\") " pod="kserve-ci-e2e-test/error-404-isvc-74731-predictor-545cd488f6-w9m6r"
Jul 01 19:52:41.690667 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:41.690623    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-74731-predictor-545cd488f6-w9m6r"
Jul 01 19:52:41.823782 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:41.823748    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-74731-predictor-545cd488f6-w9m6r"]
Jul 01 19:52:41.827045 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:52:41.827021    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c5b3090_df12_47ec_a39d_67714ce7e797.slice/crio-1ff6d6e57e2188b3b2627dcc73aa651d48a06f7c538d0c21969d02e688a40df1 WatchSource:0}: Error finding container 1ff6d6e57e2188b3b2627dcc73aa651d48a06f7c538d0c21969d02e688a40df1: Status 404 returned error can't find the container with id 1ff6d6e57e2188b3b2627dcc73aa651d48a06f7c538d0c21969d02e688a40df1
Jul 01 19:52:42.198356 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:42.198255    2556 generic.go:356] "Generic (PLEG): container finished" podID="c19349f6-8485-4781-b55e-3d6992cd8c96" containerID="659b9a3d6d7ef45dc56a10ed0bbeb8ce2e8cac227bbcacaea9feee703da15fc6" exitCode=2
Jul 01 19:52:42.198356 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:42.198324    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr" event={"ID":"c19349f6-8485-4781-b55e-3d6992cd8c96","Type":"ContainerDied","Data":"659b9a3d6d7ef45dc56a10ed0bbeb8ce2e8cac227bbcacaea9feee703da15fc6"}
Jul 01 19:52:42.200441 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:42.200417    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-74731-predictor-545cd488f6-w9m6r" event={"ID":"9c5b3090-df12-47ec-a39d-67714ce7e797","Type":"ContainerStarted","Data":"995c9b020b479a2145554a810a4ba66ecc407290d2f73f134650f46e2b9c4cc5"}
Jul 01 19:52:42.200540 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:42.200462    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-74731-predictor-545cd488f6-w9m6r" event={"ID":"9c5b3090-df12-47ec-a39d-67714ce7e797","Type":"ContainerStarted","Data":"3a4603961af18452d125cd20d03f17122436ae4ecbe0ee3ea8abc022be5da4a3"}
Jul 01 19:52:42.200540 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:42.200483    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-74731-predictor-545cd488f6-w9m6r" event={"ID":"9c5b3090-df12-47ec-a39d-67714ce7e797","Type":"ContainerStarted","Data":"1ff6d6e57e2188b3b2627dcc73aa651d48a06f7c538d0c21969d02e688a40df1"}
Jul 01 19:52:42.200630 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:42.200578    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-74731-predictor-545cd488f6-w9m6r"
Jul 01 19:52:42.220794 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:42.220745    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-74731-predictor-545cd488f6-w9m6r" podStartSLOduration=1.2207269 podStartE2EDuration="1.2207269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:52:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:52:42.218426886 +0000 UTC m=+1746.581438564" watchObservedRunningTime="2026-07-01 19:52:42.2207269 +0000 UTC m=+1746.583738580"
Jul 01 19:52:43.205004 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:43.204969    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-74731-predictor-545cd488f6-w9m6r"
Jul 01 19:52:43.206295 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:43.206268    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-74731-predictor-545cd488f6-w9m6r" podUID="9c5b3090-df12-47ec-a39d-67714ce7e797" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused"
Jul 01 19:52:44.208704 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:44.208663    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-74731-predictor-545cd488f6-w9m6r" podUID="9c5b3090-df12-47ec-a39d-67714ce7e797" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused"
Jul 01 19:52:44.686152 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:44.686129    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr"
Jul 01 19:52:44.789980 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:44.789902    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c19349f6-8485-4781-b55e-3d6992cd8c96-kube-rbac-proxy-sar-config\") pod \"c19349f6-8485-4781-b55e-3d6992cd8c96\" (UID: \"c19349f6-8485-4781-b55e-3d6992cd8c96\") "
Jul 01 19:52:44.790145 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:44.790005    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c19349f6-8485-4781-b55e-3d6992cd8c96-proxy-tls\") pod \"c19349f6-8485-4781-b55e-3d6992cd8c96\" (UID: \"c19349f6-8485-4781-b55e-3d6992cd8c96\") "
Jul 01 19:52:44.790145 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:44.790040    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sh4j4\" (UniqueName: \"kubernetes.io/projected/c19349f6-8485-4781-b55e-3d6992cd8c96-kube-api-access-sh4j4\") pod \"c19349f6-8485-4781-b55e-3d6992cd8c96\" (UID: \"c19349f6-8485-4781-b55e-3d6992cd8c96\") "
Jul 01 19:52:44.790253 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:44.790231    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c19349f6-8485-4781-b55e-3d6992cd8c96-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "c19349f6-8485-4781-b55e-3d6992cd8c96" (UID: "c19349f6-8485-4781-b55e-3d6992cd8c96"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 19:52:44.792026 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:44.791999    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c19349f6-8485-4781-b55e-3d6992cd8c96-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "c19349f6-8485-4781-b55e-3d6992cd8c96" (UID: "c19349f6-8485-4781-b55e-3d6992cd8c96"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 19:52:44.792184 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:44.792155    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c19349f6-8485-4781-b55e-3d6992cd8c96-kube-api-access-sh4j4" (OuterVolumeSpecName: "kube-api-access-sh4j4") pod "c19349f6-8485-4781-b55e-3d6992cd8c96" (UID: "c19349f6-8485-4781-b55e-3d6992cd8c96"). InnerVolumeSpecName "kube-api-access-sh4j4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 19:52:44.890688 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:44.890648    2556 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c19349f6-8485-4781-b55e-3d6992cd8c96-proxy-tls\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:52:44.890688 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:44.890679    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sh4j4\" (UniqueName: \"kubernetes.io/projected/c19349f6-8485-4781-b55e-3d6992cd8c96-kube-api-access-sh4j4\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:52:44.890688 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:44.890690    2556 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c19349f6-8485-4781-b55e-3d6992cd8c96-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:52:45.214237 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:45.214206    2556 generic.go:356] "Generic (PLEG): container finished" podID="c19349f6-8485-4781-b55e-3d6992cd8c96" containerID="1c115c630b949e7bbc10d15b9ba18f50149f0bc78e021f1a919d87df350e9e0b" exitCode=0
Jul 01 19:52:45.214694 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:45.214257    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr"
Jul 01 19:52:45.214694 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:45.214294    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr" event={"ID":"c19349f6-8485-4781-b55e-3d6992cd8c96","Type":"ContainerDied","Data":"1c115c630b949e7bbc10d15b9ba18f50149f0bc78e021f1a919d87df350e9e0b"}
Jul 01 19:52:45.214694 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:45.214353    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr" event={"ID":"c19349f6-8485-4781-b55e-3d6992cd8c96","Type":"ContainerDied","Data":"9daf789d21dfc837675a939ecf0692cbfc00cd3f37969fa0c3a75d4798895491"}
Jul 01 19:52:45.214694 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:45.214399    2556 scope.go:117] "RemoveContainer" containerID="659b9a3d6d7ef45dc56a10ed0bbeb8ce2e8cac227bbcacaea9feee703da15fc6"
Jul 01 19:52:45.223626 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:45.223609    2556 scope.go:117] "RemoveContainer" containerID="1c115c630b949e7bbc10d15b9ba18f50149f0bc78e021f1a919d87df350e9e0b"
Jul 01 19:52:45.230795 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:45.230779    2556 scope.go:117] "RemoveContainer" containerID="659b9a3d6d7ef45dc56a10ed0bbeb8ce2e8cac227bbcacaea9feee703da15fc6"
Jul 01 19:52:45.231046 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:52:45.231024    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"659b9a3d6d7ef45dc56a10ed0bbeb8ce2e8cac227bbcacaea9feee703da15fc6\": container with ID starting with 659b9a3d6d7ef45dc56a10ed0bbeb8ce2e8cac227bbcacaea9feee703da15fc6 not found: ID does not exist" containerID="659b9a3d6d7ef45dc56a10ed0bbeb8ce2e8cac227bbcacaea9feee703da15fc6"
Jul 01 19:52:45.231099 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:45.231059    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"659b9a3d6d7ef45dc56a10ed0bbeb8ce2e8cac227bbcacaea9feee703da15fc6"} err="failed to get container status \"659b9a3d6d7ef45dc56a10ed0bbeb8ce2e8cac227bbcacaea9feee703da15fc6\": rpc error: code = NotFound desc = could not find container \"659b9a3d6d7ef45dc56a10ed0bbeb8ce2e8cac227bbcacaea9feee703da15fc6\": container with ID starting with 659b9a3d6d7ef45dc56a10ed0bbeb8ce2e8cac227bbcacaea9feee703da15fc6 not found: ID does not exist"
Jul 01 19:52:45.231099 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:45.231077    2556 scope.go:117] "RemoveContainer" containerID="1c115c630b949e7bbc10d15b9ba18f50149f0bc78e021f1a919d87df350e9e0b"
Jul 01 19:52:45.231277 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:52:45.231259    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c115c630b949e7bbc10d15b9ba18f50149f0bc78e021f1a919d87df350e9e0b\": container with ID starting with 1c115c630b949e7bbc10d15b9ba18f50149f0bc78e021f1a919d87df350e9e0b not found: ID does not exist" containerID="1c115c630b949e7bbc10d15b9ba18f50149f0bc78e021f1a919d87df350e9e0b"
Jul 01 19:52:45.231334 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:45.231287    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c115c630b949e7bbc10d15b9ba18f50149f0bc78e021f1a919d87df350e9e0b"} err="failed to get container status \"1c115c630b949e7bbc10d15b9ba18f50149f0bc78e021f1a919d87df350e9e0b\": rpc error: code = NotFound desc = could not find container \"1c115c630b949e7bbc10d15b9ba18f50149f0bc78e021f1a919d87df350e9e0b\": container with ID starting with 1c115c630b949e7bbc10d15b9ba18f50149f0bc78e021f1a919d87df350e9e0b not found: ID does not exist"
Jul 01 19:52:45.236319 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:45.236301    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr"]
Jul 01 19:52:45.240980 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:45.240961    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-c6a40-predictor-74cb7f48b4-4tpdr"]
Jul 01 19:52:46.254876 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:46.254841    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c19349f6-8485-4781-b55e-3d6992cd8c96" path="/var/lib/kubelet/pods/c19349f6-8485-4781-b55e-3d6992cd8c96/volumes"
Jul 01 19:52:49.213559 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:49.213529    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-74731-predictor-545cd488f6-w9m6r"
Jul 01 19:52:49.214038 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:49.214009    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-74731-predictor-545cd488f6-w9m6r" podUID="9c5b3090-df12-47ec-a39d-67714ce7e797" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused"
Jul 01 19:52:59.214381 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:52:59.214325    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-74731-predictor-545cd488f6-w9m6r" podUID="9c5b3090-df12-47ec-a39d-67714ce7e797" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused"
Jul 01 19:53:09.214965 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:09.214925    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-74731-predictor-545cd488f6-w9m6r" podUID="9c5b3090-df12-47ec-a39d-67714ce7e797" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused"
Jul 01 19:53:19.215020 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:19.214974    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-74731-predictor-545cd488f6-w9m6r" podUID="9c5b3090-df12-47ec-a39d-67714ce7e797" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused"
Jul 01 19:53:29.215158 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:29.215074    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-74731-predictor-545cd488f6-w9m6r"
Jul 01 19:53:36.337475 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:36.337445    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tq4l_d621ab71-8427-42af-bfa4-f83db9c5800d/ovn-acl-logging/0.log"
Jul 01 19:53:36.339484 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:36.339462    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tq4l_d621ab71-8427-42af-bfa4-f83db9c5800d/ovn-acl-logging/0.log"
Jul 01 19:53:41.151713 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:41.151678    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-88843-predictor-5985fbc74-lkb8x"]
Jul 01 19:53:41.152187 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:41.151928    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-88843-predictor-5985fbc74-lkb8x" podUID="ef75e643-8bd8-4a66-b644-77f9ce967712" containerName="kserve-container" containerID="cri-o://b2b7c8665813db79cfb0bc45db09a1f296d07e9bbf031c5f9e1aece14b5b4e7c" gracePeriod=30
Jul 01 19:53:41.152187 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:41.152028    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-88843-predictor-5985fbc74-lkb8x" podUID="ef75e643-8bd8-4a66-b644-77f9ce967712" containerName="kube-rbac-proxy" containerID="cri-o://ac7e477e0a0b8df538c2564b1f05c2081cc8c55472e3b33346d1120ffe11af7a" gracePeriod=30
Jul 01 19:53:41.329293 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:41.329258    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888"]
Jul 01 19:53:41.329700 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:41.329684    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c19349f6-8485-4781-b55e-3d6992cd8c96" containerName="kserve-container"
Jul 01 19:53:41.329700 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:41.329701    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c19349f6-8485-4781-b55e-3d6992cd8c96" containerName="kserve-container"
Jul 01 19:53:41.329793 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:41.329709    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c19349f6-8485-4781-b55e-3d6992cd8c96" containerName="kube-rbac-proxy"
Jul 01 19:53:41.329793 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:41.329714    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c19349f6-8485-4781-b55e-3d6992cd8c96" containerName="kube-rbac-proxy"
Jul 01 19:53:41.329793 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:41.329780    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c19349f6-8485-4781-b55e-3d6992cd8c96" containerName="kserve-container"
Jul 01 19:53:41.329793 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:41.329790    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c19349f6-8485-4781-b55e-3d6992cd8c96" containerName="kube-rbac-proxy"
Jul 01 19:53:41.332684 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:41.332668    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888"
Jul 01 19:53:41.335174 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:41.335148    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-ee34f-predictor-serving-cert\""
Jul 01 19:53:41.335174 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:41.335166    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-ee34f-kube-rbac-proxy-sar-config\""
Jul 01 19:53:41.349002 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:41.348975    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888"]
Jul 01 19:53:41.462807 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:41.462769    2556 generic.go:356] "Generic (PLEG): container finished" podID="ef75e643-8bd8-4a66-b644-77f9ce967712" containerID="ac7e477e0a0b8df538c2564b1f05c2081cc8c55472e3b33346d1120ffe11af7a" exitCode=2
Jul 01 19:53:41.462970 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:41.462844    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-88843-predictor-5985fbc74-lkb8x" event={"ID":"ef75e643-8bd8-4a66-b644-77f9ce967712","Type":"ContainerDied","Data":"ac7e477e0a0b8df538c2564b1f05c2081cc8c55472e3b33346d1120ffe11af7a"}
Jul 01 19:53:41.483705 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:41.483675    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c65dc835-3da6-49c1-b1da-623bc534f522-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888\" (UID: \"c65dc835-3da6-49c1-b1da-623bc534f522\") " pod="kserve-ci-e2e-test/error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888"
Jul 01 19:53:41.483843 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:41.483736    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgczq\" (UniqueName: \"kubernetes.io/projected/c65dc835-3da6-49c1-b1da-623bc534f522-kube-api-access-mgczq\") pod \"error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888\" (UID: \"c65dc835-3da6-49c1-b1da-623bc534f522\") " pod="kserve-ci-e2e-test/error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888"
Jul 01 19:53:41.483843 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:41.483759    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c65dc835-3da6-49c1-b1da-623bc534f522-proxy-tls\") pod \"error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888\" (UID: \"c65dc835-3da6-49c1-b1da-623bc534f522\") " pod="kserve-ci-e2e-test/error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888"
Jul 01 19:53:41.584152 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:41.584115    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c65dc835-3da6-49c1-b1da-623bc534f522-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888\" (UID: \"c65dc835-3da6-49c1-b1da-623bc534f522\") " pod="kserve-ci-e2e-test/error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888"
Jul 01 19:53:41.584330 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:41.584196    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgczq\" (UniqueName: \"kubernetes.io/projected/c65dc835-3da6-49c1-b1da-623bc534f522-kube-api-access-mgczq\") pod \"error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888\" (UID: \"c65dc835-3da6-49c1-b1da-623bc534f522\") " pod="kserve-ci-e2e-test/error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888"
Jul 01 19:53:41.584330 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:41.584219    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c65dc835-3da6-49c1-b1da-623bc534f522-proxy-tls\") pod \"error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888\" (UID: \"c65dc835-3da6-49c1-b1da-623bc534f522\") " pod="kserve-ci-e2e-test/error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888"
Jul 01 19:53:41.584872 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:41.584837    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c65dc835-3da6-49c1-b1da-623bc534f522-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888\" (UID: \"c65dc835-3da6-49c1-b1da-623bc534f522\") " pod="kserve-ci-e2e-test/error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888"
Jul 01 19:53:41.586825 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:41.586800    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c65dc835-3da6-49c1-b1da-623bc534f522-proxy-tls\") pod \"error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888\" (UID: \"c65dc835-3da6-49c1-b1da-623bc534f522\") " pod="kserve-ci-e2e-test/error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888"
Jul 01 19:53:41.594033 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:41.593928    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgczq\" (UniqueName: \"kubernetes.io/projected/c65dc835-3da6-49c1-b1da-623bc534f522-kube-api-access-mgczq\") pod \"error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888\" (UID: \"c65dc835-3da6-49c1-b1da-623bc534f522\") " pod="kserve-ci-e2e-test/error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888"
Jul 01 19:53:41.643700 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:41.643671    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888"
Jul 01 19:53:41.777886 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:41.777853    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888"]
Jul 01 19:53:41.781541 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:53:41.781513    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc65dc835_3da6_49c1_b1da_623bc534f522.slice/crio-e3f6df126fbca58d2dcb7c6b6b3ce7fee27a262a650519f0908b1d5b214209da WatchSource:0}: Error finding container e3f6df126fbca58d2dcb7c6b6b3ce7fee27a262a650519f0908b1d5b214209da: Status 404 returned error can't find the container with id e3f6df126fbca58d2dcb7c6b6b3ce7fee27a262a650519f0908b1d5b214209da
Jul 01 19:53:42.468491 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:42.468443    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888" event={"ID":"c65dc835-3da6-49c1-b1da-623bc534f522","Type":"ContainerStarted","Data":"5421bcd2b17cd293e2a0c0e4382f8105ca1032161b68b9d6207366df88334ab4"}
Jul 01 19:53:42.468877 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:42.468526    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888"
Jul 01 19:53:42.468877 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:42.468550    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888" event={"ID":"c65dc835-3da6-49c1-b1da-623bc534f522","Type":"ContainerStarted","Data":"e504e6b42787d0deb3cdc2f2061a316414b7175299f8de3d21c0ef0e16a6a2fd"}
Jul 01 19:53:42.468877 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:42.468569    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888" event={"ID":"c65dc835-3da6-49c1-b1da-623bc534f522","Type":"ContainerStarted","Data":"e3f6df126fbca58d2dcb7c6b6b3ce7fee27a262a650519f0908b1d5b214209da"}
Jul 01 19:53:42.487489 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:42.487432    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888" podStartSLOduration=1.487418121 podStartE2EDuration="1.487418121s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:53:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:53:42.485491298 +0000 UTC m=+1806.848502981" watchObservedRunningTime="2026-07-01 19:53:42.487418121 +0000 UTC m=+1806.850429801"
Jul 01 19:53:43.473069 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:43.473029    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888"
Jul 01 19:53:43.474007 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:43.473981    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888" podUID="c65dc835-3da6-49c1-b1da-623bc534f522" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Jul 01 19:53:44.081639 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:44.081547    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-88843-predictor-5985fbc74-lkb8x" podUID="ef75e643-8bd8-4a66-b644-77f9ce967712" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.34:8643/healthz\": dial tcp 10.134.0.34:8643: connect: connection refused"
Jul 01 19:53:44.085748 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:44.085724    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-88843-predictor-5985fbc74-lkb8x" podUID="ef75e643-8bd8-4a66-b644-77f9ce967712" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.34:8080: connect: connection refused"
Jul 01 19:53:44.478844 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:44.478809    2556 generic.go:356] "Generic (PLEG): container finished" podID="ef75e643-8bd8-4a66-b644-77f9ce967712" containerID="b2b7c8665813db79cfb0bc45db09a1f296d07e9bbf031c5f9e1aece14b5b4e7c" exitCode=0
Jul 01 19:53:44.479252 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:44.478885    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-88843-predictor-5985fbc74-lkb8x" event={"ID":"ef75e643-8bd8-4a66-b644-77f9ce967712","Type":"ContainerDied","Data":"b2b7c8665813db79cfb0bc45db09a1f296d07e9bbf031c5f9e1aece14b5b4e7c"}
Jul 01 19:53:44.479252 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:44.479151    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888" podUID="c65dc835-3da6-49c1-b1da-623bc534f522" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Jul 01 19:53:44.504800 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:44.504773    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-88843-predictor-5985fbc74-lkb8x"
Jul 01 19:53:44.611869 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:44.611830    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ef75e643-8bd8-4a66-b644-77f9ce967712-kube-rbac-proxy-sar-config\") pod \"ef75e643-8bd8-4a66-b644-77f9ce967712\" (UID: \"ef75e643-8bd8-4a66-b644-77f9ce967712\") "
Jul 01 19:53:44.612051 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:44.611948    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ef75e643-8bd8-4a66-b644-77f9ce967712-proxy-tls\") pod \"ef75e643-8bd8-4a66-b644-77f9ce967712\" (UID: \"ef75e643-8bd8-4a66-b644-77f9ce967712\") "
Jul 01 19:53:44.612051 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:44.612009    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l2wl2\" (UniqueName: \"kubernetes.io/projected/ef75e643-8bd8-4a66-b644-77f9ce967712-kube-api-access-l2wl2\") pod \"ef75e643-8bd8-4a66-b644-77f9ce967712\" (UID: \"ef75e643-8bd8-4a66-b644-77f9ce967712\") "
Jul 01 19:53:44.612292 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:44.612255    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef75e643-8bd8-4a66-b644-77f9ce967712-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "ef75e643-8bd8-4a66-b644-77f9ce967712" (UID: "ef75e643-8bd8-4a66-b644-77f9ce967712"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 19:53:44.612481 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:44.612344    2556 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ef75e643-8bd8-4a66-b644-77f9ce967712-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:53:44.614559 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:44.614528    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef75e643-8bd8-4a66-b644-77f9ce967712-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "ef75e643-8bd8-4a66-b644-77f9ce967712" (UID: "ef75e643-8bd8-4a66-b644-77f9ce967712"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 19:53:44.614559 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:44.614529    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef75e643-8bd8-4a66-b644-77f9ce967712-kube-api-access-l2wl2" (OuterVolumeSpecName: "kube-api-access-l2wl2") pod "ef75e643-8bd8-4a66-b644-77f9ce967712" (UID: "ef75e643-8bd8-4a66-b644-77f9ce967712"). InnerVolumeSpecName "kube-api-access-l2wl2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 19:53:44.713678 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:44.713635    2556 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ef75e643-8bd8-4a66-b644-77f9ce967712-proxy-tls\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:53:44.713678 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:44.713668    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l2wl2\" (UniqueName: \"kubernetes.io/projected/ef75e643-8bd8-4a66-b644-77f9ce967712-kube-api-access-l2wl2\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:53:45.484635 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:45.484599    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-88843-predictor-5985fbc74-lkb8x" event={"ID":"ef75e643-8bd8-4a66-b644-77f9ce967712","Type":"ContainerDied","Data":"cffc56d90517efe3ce23991bb044723e038f136a5f85d7783c38171ed1442b93"}
Jul 01 19:53:45.484635 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:45.484637    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-88843-predictor-5985fbc74-lkb8x"
Jul 01 19:53:45.485186 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:45.484676    2556 scope.go:117] "RemoveContainer" containerID="ac7e477e0a0b8df538c2564b1f05c2081cc8c55472e3b33346d1120ffe11af7a"
Jul 01 19:53:45.493746 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:45.493720    2556 scope.go:117] "RemoveContainer" containerID="b2b7c8665813db79cfb0bc45db09a1f296d07e9bbf031c5f9e1aece14b5b4e7c"
Jul 01 19:53:45.507430 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:45.507406    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-88843-predictor-5985fbc74-lkb8x"]
Jul 01 19:53:45.511240 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:45.511217    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-88843-predictor-5985fbc74-lkb8x"]
Jul 01 19:53:46.256894 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:46.255775    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef75e643-8bd8-4a66-b644-77f9ce967712" path="/var/lib/kubelet/pods/ef75e643-8bd8-4a66-b644-77f9ce967712/volumes"
Jul 01 19:53:49.483982 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:49.483951    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888"
Jul 01 19:53:49.484450 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:49.484424    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888" podUID="c65dc835-3da6-49c1-b1da-623bc534f522" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Jul 01 19:53:51.737222 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:51.737184    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj"]
Jul 01 19:53:51.737616 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:51.737602    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef75e643-8bd8-4a66-b644-77f9ce967712" containerName="kserve-container"
Jul 01 19:53:51.737678 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:51.737620    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef75e643-8bd8-4a66-b644-77f9ce967712" containerName="kserve-container"
Jul 01 19:53:51.737678 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:51.737634    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef75e643-8bd8-4a66-b644-77f9ce967712" containerName="kube-rbac-proxy"
Jul 01 19:53:51.737678 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:51.737639    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef75e643-8bd8-4a66-b644-77f9ce967712" containerName="kube-rbac-proxy"
Jul 01 19:53:51.737771 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:51.737717    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef75e643-8bd8-4a66-b644-77f9ce967712" containerName="kserve-container"
Jul 01 19:53:51.737771 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:51.737727    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef75e643-8bd8-4a66-b644-77f9ce967712" containerName="kube-rbac-proxy"
Jul 01 19:53:51.742469 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:51.742448    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj"
Jul 01 19:53:51.744853 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:51.744834    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-b4182-predictor-serving-cert\""
Jul 01 19:53:51.744968 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:51.744852    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-b4182-kube-rbac-proxy-sar-config\""
Jul 01 19:53:51.752466 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:51.752444    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj"]
Jul 01 19:53:51.882037 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:51.882001    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g2kp\" (UniqueName: \"kubernetes.io/projected/966a627b-3953-47a6-838b-afdc6b45ae43-kube-api-access-8g2kp\") pod \"error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj\" (UID: \"966a627b-3953-47a6-838b-afdc6b45ae43\") " pod="kserve-ci-e2e-test/error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj"
Jul 01 19:53:51.882238 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:51.882042    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/966a627b-3953-47a6-838b-afdc6b45ae43-proxy-tls\") pod \"error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj\" (UID: \"966a627b-3953-47a6-838b-afdc6b45ae43\") " pod="kserve-ci-e2e-test/error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj"
Jul 01 19:53:51.882238 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:51.882115    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/966a627b-3953-47a6-838b-afdc6b45ae43-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj\" (UID: \"966a627b-3953-47a6-838b-afdc6b45ae43\") " pod="kserve-ci-e2e-test/error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj"
Jul 01 19:53:51.958840 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:51.958806    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-74731-predictor-545cd488f6-w9m6r"]
Jul 01 19:53:51.959070 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:51.959040    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-74731-predictor-545cd488f6-w9m6r" podUID="9c5b3090-df12-47ec-a39d-67714ce7e797" containerName="kserve-container" containerID="cri-o://3a4603961af18452d125cd20d03f17122436ae4ecbe0ee3ea8abc022be5da4a3" gracePeriod=30
Jul 01 19:53:51.959168 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:51.959090    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-74731-predictor-545cd488f6-w9m6r" podUID="9c5b3090-df12-47ec-a39d-67714ce7e797" containerName="kube-rbac-proxy" containerID="cri-o://995c9b020b479a2145554a810a4ba66ecc407290d2f73f134650f46e2b9c4cc5" gracePeriod=30
Jul 01 19:53:51.982607 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:51.982574    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/966a627b-3953-47a6-838b-afdc6b45ae43-proxy-tls\") pod \"error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj\" (UID: \"966a627b-3953-47a6-838b-afdc6b45ae43\") " pod="kserve-ci-e2e-test/error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj"
Jul 01 19:53:51.982738 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:51.982617    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/966a627b-3953-47a6-838b-afdc6b45ae43-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj\" (UID: \"966a627b-3953-47a6-838b-afdc6b45ae43\") " pod="kserve-ci-e2e-test/error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj"
Jul 01 19:53:51.982738 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:51.982702    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g2kp\" (UniqueName: \"kubernetes.io/projected/966a627b-3953-47a6-838b-afdc6b45ae43-kube-api-access-8g2kp\") pod \"error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj\" (UID: \"966a627b-3953-47a6-838b-afdc6b45ae43\") " pod="kserve-ci-e2e-test/error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj"
Jul 01 19:53:51.983329 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:51.983308    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/966a627b-3953-47a6-838b-afdc6b45ae43-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj\" (UID: \"966a627b-3953-47a6-838b-afdc6b45ae43\") " pod="kserve-ci-e2e-test/error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj"
Jul 01 19:53:51.985010 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:51.984989    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/966a627b-3953-47a6-838b-afdc6b45ae43-proxy-tls\") pod \"error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj\" (UID: \"966a627b-3953-47a6-838b-afdc6b45ae43\") " pod="kserve-ci-e2e-test/error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj"
Jul 01 19:53:51.991356 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:51.991279    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g2kp\" (UniqueName: \"kubernetes.io/projected/966a627b-3953-47a6-838b-afdc6b45ae43-kube-api-access-8g2kp\") pod \"error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj\" (UID: \"966a627b-3953-47a6-838b-afdc6b45ae43\") " pod="kserve-ci-e2e-test/error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj"
Jul 01 19:53:52.052962 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:52.052924    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj"
Jul 01 19:53:52.189152 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:52.189125    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj"]
Jul 01 19:53:52.190731 ip-10-0-134-212 kubenswrapper[2556]: W0701 19:53:52.190701    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod966a627b_3953_47a6_838b_afdc6b45ae43.slice/crio-682805d1a7102d4134e47d7ebe7db59abe53bf191a1a97c29337e65fb928837b WatchSource:0}: Error finding container 682805d1a7102d4134e47d7ebe7db59abe53bf191a1a97c29337e65fb928837b: Status 404 returned error can't find the container with id 682805d1a7102d4134e47d7ebe7db59abe53bf191a1a97c29337e65fb928837b
Jul 01 19:53:52.516113 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:52.516012    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj" event={"ID":"966a627b-3953-47a6-838b-afdc6b45ae43","Type":"ContainerStarted","Data":"87a90bf22704a3dad1996a131d4a152da79542da49a544e9a869c1a4d241c420"}
Jul 01 19:53:52.516113 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:52.516082    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj" event={"ID":"966a627b-3953-47a6-838b-afdc6b45ae43","Type":"ContainerStarted","Data":"c2f2b4176b712cb27f58ea279b0e197d89ec5dfead77fb61f4cbf9aaf01c16c5"}
Jul 01 19:53:52.516113 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:52.516111    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj" event={"ID":"966a627b-3953-47a6-838b-afdc6b45ae43","Type":"ContainerStarted","Data":"682805d1a7102d4134e47d7ebe7db59abe53bf191a1a97c29337e65fb928837b"}
Jul 01 19:53:52.516393 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:52.516142    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj"
Jul 01 19:53:52.518024 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:52.517999    2556 generic.go:356] "Generic (PLEG): container finished" podID="9c5b3090-df12-47ec-a39d-67714ce7e797" containerID="995c9b020b479a2145554a810a4ba66ecc407290d2f73f134650f46e2b9c4cc5" exitCode=2
Jul 01 19:53:52.518140 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:52.518033    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-74731-predictor-545cd488f6-w9m6r" event={"ID":"9c5b3090-df12-47ec-a39d-67714ce7e797","Type":"ContainerDied","Data":"995c9b020b479a2145554a810a4ba66ecc407290d2f73f134650f46e2b9c4cc5"}
Jul 01 19:53:52.534896 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:52.534830    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj" podStartSLOduration=1.534812492 podStartE2EDuration="1.534812492s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:53:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:53:52.534008976 +0000 UTC m=+1816.897020658" watchObservedRunningTime="2026-07-01 19:53:52.534812492 +0000 UTC m=+1816.897824174"
Jul 01 19:53:53.523439 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:53.523401    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj"
Jul 01 19:53:53.524769 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:53.524741    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj" podUID="966a627b-3953-47a6-838b-afdc6b45ae43" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused"
Jul 01 19:53:54.209383 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:54.209328    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-74731-predictor-545cd488f6-w9m6r" podUID="9c5b3090-df12-47ec-a39d-67714ce7e797" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.35:8643/healthz\": dial tcp 10.134.0.35:8643: connect: connection refused"
Jul 01 19:53:54.529123 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:54.529026    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj" podUID="966a627b-3953-47a6-838b-afdc6b45ae43" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused"
Jul 01 19:53:56.202326 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:56.202301    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-74731-predictor-545cd488f6-w9m6r"
Jul 01 19:53:56.213573 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:56.213548    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9c5b3090-df12-47ec-a39d-67714ce7e797-proxy-tls\") pod \"9c5b3090-df12-47ec-a39d-67714ce7e797\" (UID: \"9c5b3090-df12-47ec-a39d-67714ce7e797\") "
Jul 01 19:53:56.213687 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:56.213592    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9c5b3090-df12-47ec-a39d-67714ce7e797-kube-rbac-proxy-sar-config\") pod \"9c5b3090-df12-47ec-a39d-67714ce7e797\" (UID: \"9c5b3090-df12-47ec-a39d-67714ce7e797\") "
Jul 01 19:53:56.213687 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:56.213637    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8p58l\" (UniqueName: \"kubernetes.io/projected/9c5b3090-df12-47ec-a39d-67714ce7e797-kube-api-access-8p58l\") pod \"9c5b3090-df12-47ec-a39d-67714ce7e797\" (UID: \"9c5b3090-df12-47ec-a39d-67714ce7e797\") "
Jul 01 19:53:56.213928 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:56.213905    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c5b3090-df12-47ec-a39d-67714ce7e797-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "9c5b3090-df12-47ec-a39d-67714ce7e797" (UID: "9c5b3090-df12-47ec-a39d-67714ce7e797"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 19:53:56.215623 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:56.215592    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c5b3090-df12-47ec-a39d-67714ce7e797-kube-api-access-8p58l" (OuterVolumeSpecName: "kube-api-access-8p58l") pod "9c5b3090-df12-47ec-a39d-67714ce7e797" (UID: "9c5b3090-df12-47ec-a39d-67714ce7e797"). InnerVolumeSpecName "kube-api-access-8p58l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 19:53:56.215623 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:56.215600    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c5b3090-df12-47ec-a39d-67714ce7e797-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "9c5b3090-df12-47ec-a39d-67714ce7e797" (UID: "9c5b3090-df12-47ec-a39d-67714ce7e797"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 19:53:56.314817 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:56.314777    2556 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9c5b3090-df12-47ec-a39d-67714ce7e797-proxy-tls\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:53:56.314817 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:56.314810    2556 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9c5b3090-df12-47ec-a39d-67714ce7e797-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:53:56.314817 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:56.314824    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8p58l\" (UniqueName: \"kubernetes.io/projected/9c5b3090-df12-47ec-a39d-67714ce7e797-kube-api-access-8p58l\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 19:53:56.541315 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:56.541284    2556 generic.go:356] "Generic (PLEG): container finished" podID="9c5b3090-df12-47ec-a39d-67714ce7e797" containerID="3a4603961af18452d125cd20d03f17122436ae4ecbe0ee3ea8abc022be5da4a3" exitCode=0
Jul 01 19:53:56.541511 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:56.541330    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-74731-predictor-545cd488f6-w9m6r"
Jul 01 19:53:56.541511 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:56.541350    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-74731-predictor-545cd488f6-w9m6r" event={"ID":"9c5b3090-df12-47ec-a39d-67714ce7e797","Type":"ContainerDied","Data":"3a4603961af18452d125cd20d03f17122436ae4ecbe0ee3ea8abc022be5da4a3"}
Jul 01 19:53:56.541511 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:56.541422    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-74731-predictor-545cd488f6-w9m6r" event={"ID":"9c5b3090-df12-47ec-a39d-67714ce7e797","Type":"ContainerDied","Data":"1ff6d6e57e2188b3b2627dcc73aa651d48a06f7c538d0c21969d02e688a40df1"}
Jul 01 19:53:56.541511 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:56.541449    2556 scope.go:117] "RemoveContainer" containerID="995c9b020b479a2145554a810a4ba66ecc407290d2f73f134650f46e2b9c4cc5"
Jul 01 19:53:56.549429 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:56.549401    2556 scope.go:117] "RemoveContainer" containerID="3a4603961af18452d125cd20d03f17122436ae4ecbe0ee3ea8abc022be5da4a3"
Jul 01 19:53:56.556884 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:56.556862    2556 scope.go:117] "RemoveContainer" containerID="995c9b020b479a2145554a810a4ba66ecc407290d2f73f134650f46e2b9c4cc5"
Jul 01 19:53:56.557186 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:53:56.557156    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"995c9b020b479a2145554a810a4ba66ecc407290d2f73f134650f46e2b9c4cc5\": container with ID starting with 995c9b020b479a2145554a810a4ba66ecc407290d2f73f134650f46e2b9c4cc5 not found: ID does not exist" containerID="995c9b020b479a2145554a810a4ba66ecc407290d2f73f134650f46e2b9c4cc5"
Jul 01 19:53:56.557252 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:56.557187    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"995c9b020b479a2145554a810a4ba66ecc407290d2f73f134650f46e2b9c4cc5"} err="failed to get container status \"995c9b020b479a2145554a810a4ba66ecc407290d2f73f134650f46e2b9c4cc5\": rpc error: code = NotFound desc = could not find container \"995c9b020b479a2145554a810a4ba66ecc407290d2f73f134650f46e2b9c4cc5\": container with ID starting with 995c9b020b479a2145554a810a4ba66ecc407290d2f73f134650f46e2b9c4cc5 not found: ID does not exist"
Jul 01 19:53:56.557252 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:56.557204    2556 scope.go:117] "RemoveContainer" containerID="3a4603961af18452d125cd20d03f17122436ae4ecbe0ee3ea8abc022be5da4a3"
Jul 01 19:53:56.557504 ip-10-0-134-212 kubenswrapper[2556]: E0701 19:53:56.557483    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a4603961af18452d125cd20d03f17122436ae4ecbe0ee3ea8abc022be5da4a3\": container with ID starting with 3a4603961af18452d125cd20d03f17122436ae4ecbe0ee3ea8abc022be5da4a3 not found: ID does not exist" containerID="3a4603961af18452d125cd20d03f17122436ae4ecbe0ee3ea8abc022be5da4a3"
Jul 01 19:53:56.557556 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:56.557510    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a4603961af18452d125cd20d03f17122436ae4ecbe0ee3ea8abc022be5da4a3"} err="failed to get container status \"3a4603961af18452d125cd20d03f17122436ae4ecbe0ee3ea8abc022be5da4a3\": rpc error: code = NotFound desc = could not find container \"3a4603961af18452d125cd20d03f17122436ae4ecbe0ee3ea8abc022be5da4a3\": container with ID starting with 3a4603961af18452d125cd20d03f17122436ae4ecbe0ee3ea8abc022be5da4a3 not found: ID does not exist"
Jul 01 19:53:56.557720 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:56.557705    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-74731-predictor-545cd488f6-w9m6r"]
Jul 01 19:53:56.561594 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:56.561572    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-74731-predictor-545cd488f6-w9m6r"]
Jul 01 19:53:58.255359 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:58.255325    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c5b3090-df12-47ec-a39d-67714ce7e797" path="/var/lib/kubelet/pods/9c5b3090-df12-47ec-a39d-67714ce7e797/volumes"
Jul 01 19:53:59.485283 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:59.485239    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888" podUID="c65dc835-3da6-49c1-b1da-623bc534f522" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Jul 01 19:53:59.534325 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:59.534295    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj"
Jul 01 19:53:59.534811 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:53:59.534781    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj" podUID="966a627b-3953-47a6-838b-afdc6b45ae43" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused"
Jul 01 19:54:09.484682 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:54:09.484633    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888" podUID="c65dc835-3da6-49c1-b1da-623bc534f522" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Jul 01 19:54:09.535116 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:54:09.535076    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj" podUID="966a627b-3953-47a6-838b-afdc6b45ae43" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused"
Jul 01 19:54:19.484748 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:54:19.484701    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888" podUID="c65dc835-3da6-49c1-b1da-623bc534f522" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Jul 01 19:54:19.534980 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:54:19.534941    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj" podUID="966a627b-3953-47a6-838b-afdc6b45ae43" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused"
Jul 01 19:54:29.485433 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:54:29.485395    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888"
Jul 01 19:54:29.534750 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:54:29.534710    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj" podUID="966a627b-3953-47a6-838b-afdc6b45ae43" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused"
Jul 01 19:54:39.535559 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:54:39.535527    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj"
Jul 01 19:58:36.366960 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:58:36.366920    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tq4l_d621ab71-8427-42af-bfa4-f83db9c5800d/ovn-acl-logging/0.log"
Jul 01 19:58:36.369610 ip-10-0-134-212 kubenswrapper[2556]: I0701 19:58:36.369084    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tq4l_d621ab71-8427-42af-bfa4-f83db9c5800d/ovn-acl-logging/0.log"
Jul 01 20:03:06.474919 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:03:06.474881    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj"]
Jul 01 20:03:06.475486 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:03:06.475163    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj" podUID="966a627b-3953-47a6-838b-afdc6b45ae43" containerName="kserve-container" containerID="cri-o://c2f2b4176b712cb27f58ea279b0e197d89ec5dfead77fb61f4cbf9aaf01c16c5" gracePeriod=30
Jul 01 20:03:06.475486 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:03:06.475265    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj" podUID="966a627b-3953-47a6-838b-afdc6b45ae43" containerName="kube-rbac-proxy" containerID="cri-o://87a90bf22704a3dad1996a131d4a152da79542da49a544e9a869c1a4d241c420" gracePeriod=30
Jul 01 20:03:06.891976 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:03:06.891877    2556 generic.go:356] "Generic (PLEG): container finished" podID="966a627b-3953-47a6-838b-afdc6b45ae43" containerID="87a90bf22704a3dad1996a131d4a152da79542da49a544e9a869c1a4d241c420" exitCode=2
Jul 01 20:03:06.892150 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:03:06.891967    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj" event={"ID":"966a627b-3953-47a6-838b-afdc6b45ae43","Type":"ContainerDied","Data":"87a90bf22704a3dad1996a131d4a152da79542da49a544e9a869c1a4d241c420"}
Jul 01 20:03:09.529995 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:03:09.529942    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj" podUID="966a627b-3953-47a6-838b-afdc6b45ae43" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.37:8643/healthz\": dial tcp 10.134.0.37:8643: connect: connection refused"
Jul 01 20:03:09.535267 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:03:09.535235    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj" podUID="966a627b-3953-47a6-838b-afdc6b45ae43" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused"
Jul 01 20:03:09.722050 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:03:09.722025    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj"
Jul 01 20:03:09.806788 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:03:09.806692    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8g2kp\" (UniqueName: \"kubernetes.io/projected/966a627b-3953-47a6-838b-afdc6b45ae43-kube-api-access-8g2kp\") pod \"966a627b-3953-47a6-838b-afdc6b45ae43\" (UID: \"966a627b-3953-47a6-838b-afdc6b45ae43\") "
Jul 01 20:03:09.806788 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:03:09.806757    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/966a627b-3953-47a6-838b-afdc6b45ae43-kube-rbac-proxy-sar-config\") pod \"966a627b-3953-47a6-838b-afdc6b45ae43\" (UID: \"966a627b-3953-47a6-838b-afdc6b45ae43\") "
Jul 01 20:03:09.806788 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:03:09.806788    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/966a627b-3953-47a6-838b-afdc6b45ae43-proxy-tls\") pod \"966a627b-3953-47a6-838b-afdc6b45ae43\" (UID: \"966a627b-3953-47a6-838b-afdc6b45ae43\") "
Jul 01 20:03:09.807120 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:03:09.807092    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/966a627b-3953-47a6-838b-afdc6b45ae43-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "966a627b-3953-47a6-838b-afdc6b45ae43" (UID: "966a627b-3953-47a6-838b-afdc6b45ae43"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 20:03:09.808900 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:03:09.808869    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/966a627b-3953-47a6-838b-afdc6b45ae43-kube-api-access-8g2kp" (OuterVolumeSpecName: "kube-api-access-8g2kp") pod "966a627b-3953-47a6-838b-afdc6b45ae43" (UID: "966a627b-3953-47a6-838b-afdc6b45ae43"). InnerVolumeSpecName "kube-api-access-8g2kp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 20:03:09.809021 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:03:09.809003    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/966a627b-3953-47a6-838b-afdc6b45ae43-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "966a627b-3953-47a6-838b-afdc6b45ae43" (UID: "966a627b-3953-47a6-838b-afdc6b45ae43"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 20:03:09.906915 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:03:09.906876    2556 generic.go:356] "Generic (PLEG): container finished" podID="966a627b-3953-47a6-838b-afdc6b45ae43" containerID="c2f2b4176b712cb27f58ea279b0e197d89ec5dfead77fb61f4cbf9aaf01c16c5" exitCode=0
Jul 01 20:03:09.907113 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:03:09.906921    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj"
Jul 01 20:03:09.907113 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:03:09.906962    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj" event={"ID":"966a627b-3953-47a6-838b-afdc6b45ae43","Type":"ContainerDied","Data":"c2f2b4176b712cb27f58ea279b0e197d89ec5dfead77fb61f4cbf9aaf01c16c5"}
Jul 01 20:03:09.907113 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:03:09.907039    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj" event={"ID":"966a627b-3953-47a6-838b-afdc6b45ae43","Type":"ContainerDied","Data":"682805d1a7102d4134e47d7ebe7db59abe53bf191a1a97c29337e65fb928837b"}
Jul 01 20:03:09.907113 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:03:09.907076    2556 scope.go:117] "RemoveContainer" containerID="87a90bf22704a3dad1996a131d4a152da79542da49a544e9a869c1a4d241c420"
Jul 01 20:03:09.907349 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:03:09.907299    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8g2kp\" (UniqueName: \"kubernetes.io/projected/966a627b-3953-47a6-838b-afdc6b45ae43-kube-api-access-8g2kp\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 20:03:09.907349 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:03:09.907323    2556 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/966a627b-3953-47a6-838b-afdc6b45ae43-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 20:03:09.907349 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:03:09.907339    2556 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/966a627b-3953-47a6-838b-afdc6b45ae43-proxy-tls\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 20:03:09.916292 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:03:09.916277    2556 scope.go:117] "RemoveContainer" containerID="c2f2b4176b712cb27f58ea279b0e197d89ec5dfead77fb61f4cbf9aaf01c16c5"
Jul 01 20:03:09.923671 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:03:09.923651    2556 scope.go:117] "RemoveContainer" containerID="87a90bf22704a3dad1996a131d4a152da79542da49a544e9a869c1a4d241c420"
Jul 01 20:03:09.923937 ip-10-0-134-212 kubenswrapper[2556]: E0701 20:03:09.923919    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87a90bf22704a3dad1996a131d4a152da79542da49a544e9a869c1a4d241c420\": container with ID starting with 87a90bf22704a3dad1996a131d4a152da79542da49a544e9a869c1a4d241c420 not found: ID does not exist" containerID="87a90bf22704a3dad1996a131d4a152da79542da49a544e9a869c1a4d241c420"
Jul 01 20:03:09.923989 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:03:09.923946    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87a90bf22704a3dad1996a131d4a152da79542da49a544e9a869c1a4d241c420"} err="failed to get container status \"87a90bf22704a3dad1996a131d4a152da79542da49a544e9a869c1a4d241c420\": rpc error: code = NotFound desc = could not find container \"87a90bf22704a3dad1996a131d4a152da79542da49a544e9a869c1a4d241c420\": container with ID starting with 87a90bf22704a3dad1996a131d4a152da79542da49a544e9a869c1a4d241c420 not found: ID does not exist"
Jul 01 20:03:09.923989 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:03:09.923965    2556 scope.go:117] "RemoveContainer" containerID="c2f2b4176b712cb27f58ea279b0e197d89ec5dfead77fb61f4cbf9aaf01c16c5"
Jul 01 20:03:09.924188 ip-10-0-134-212 kubenswrapper[2556]: E0701 20:03:09.924168    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2f2b4176b712cb27f58ea279b0e197d89ec5dfead77fb61f4cbf9aaf01c16c5\": container with ID starting with c2f2b4176b712cb27f58ea279b0e197d89ec5dfead77fb61f4cbf9aaf01c16c5 not found: ID does not exist" containerID="c2f2b4176b712cb27f58ea279b0e197d89ec5dfead77fb61f4cbf9aaf01c16c5"
Jul 01 20:03:09.924247 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:03:09.924199    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2f2b4176b712cb27f58ea279b0e197d89ec5dfead77fb61f4cbf9aaf01c16c5"} err="failed to get container status \"c2f2b4176b712cb27f58ea279b0e197d89ec5dfead77fb61f4cbf9aaf01c16c5\": rpc error: code = NotFound desc = could not find container \"c2f2b4176b712cb27f58ea279b0e197d89ec5dfead77fb61f4cbf9aaf01c16c5\": container with ID starting with c2f2b4176b712cb27f58ea279b0e197d89ec5dfead77fb61f4cbf9aaf01c16c5 not found: ID does not exist"
Jul 01 20:03:09.929478 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:03:09.929447    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj"]
Jul 01 20:03:09.933277 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:03:09.933252    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-b4182-predictor-6877fd5bfd-bfpzj"]
Jul 01 20:03:10.256235 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:03:10.256203    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="966a627b-3953-47a6-838b-afdc6b45ae43" path="/var/lib/kubelet/pods/966a627b-3953-47a6-838b-afdc6b45ae43/volumes"
Jul 01 20:03:36.402236 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:03:36.402216    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tq4l_d621ab71-8427-42af-bfa4-f83db9c5800d/ovn-acl-logging/0.log"
Jul 01 20:03:36.405401 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:03:36.405382    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tq4l_d621ab71-8427-42af-bfa4-f83db9c5800d/ovn-acl-logging/0.log"
Jul 01 20:08:36.430223 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:08:36.430103    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tq4l_d621ab71-8427-42af-bfa4-f83db9c5800d/ovn-acl-logging/0.log"
Jul 01 20:08:36.435162 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:08:36.435138    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tq4l_d621ab71-8427-42af-bfa4-f83db9c5800d/ovn-acl-logging/0.log"
Jul 01 20:11:00.852085 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:00.852044    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888"]
Jul 01 20:11:00.853125 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:00.853086    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888" podUID="c65dc835-3da6-49c1-b1da-623bc534f522" containerName="kserve-container" containerID="cri-o://e504e6b42787d0deb3cdc2f2061a316414b7175299f8de3d21c0ef0e16a6a2fd" gracePeriod=30
Jul 01 20:11:00.854127 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:00.853702    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888" podUID="c65dc835-3da6-49c1-b1da-623bc534f522" containerName="kube-rbac-proxy" containerID="cri-o://5421bcd2b17cd293e2a0c0e4382f8105ca1032161b68b9d6207366df88334ab4" gracePeriod=30
Jul 01 20:11:01.742035 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:01.741996    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4c4hj/must-gather-j8lbn"]
Jul 01 20:11:01.742392 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:01.742378    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c5b3090-df12-47ec-a39d-67714ce7e797" containerName="kube-rbac-proxy"
Jul 01 20:11:01.742445 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:01.742393    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c5b3090-df12-47ec-a39d-67714ce7e797" containerName="kube-rbac-proxy"
Jul 01 20:11:01.742445 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:01.742405    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="966a627b-3953-47a6-838b-afdc6b45ae43" containerName="kube-rbac-proxy"
Jul 01 20:11:01.742445 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:01.742410    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="966a627b-3953-47a6-838b-afdc6b45ae43" containerName="kube-rbac-proxy"
Jul 01 20:11:01.742445 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:01.742427    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="966a627b-3953-47a6-838b-afdc6b45ae43" containerName="kserve-container"
Jul 01 20:11:01.742445 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:01.742434    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="966a627b-3953-47a6-838b-afdc6b45ae43" containerName="kserve-container"
Jul 01 20:11:01.742445 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:01.742445    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c5b3090-df12-47ec-a39d-67714ce7e797" containerName="kserve-container"
Jul 01 20:11:01.742631 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:01.742450    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c5b3090-df12-47ec-a39d-67714ce7e797" containerName="kserve-container"
Jul 01 20:11:01.742631 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:01.742500    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="966a627b-3953-47a6-838b-afdc6b45ae43" containerName="kube-rbac-proxy"
Jul 01 20:11:01.742631 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:01.742509    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c5b3090-df12-47ec-a39d-67714ce7e797" containerName="kserve-container"
Jul 01 20:11:01.742631 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:01.742519    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="966a627b-3953-47a6-838b-afdc6b45ae43" containerName="kserve-container"
Jul 01 20:11:01.742631 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:01.742525    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c5b3090-df12-47ec-a39d-67714ce7e797" containerName="kube-rbac-proxy"
Jul 01 20:11:01.745627 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:01.745604    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4c4hj/must-gather-j8lbn"
Jul 01 20:11:01.750620 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:01.750597    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4c4hj\"/\"openshift-service-ca.crt\""
Jul 01 20:11:01.750775 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:01.750659    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4c4hj\"/\"kube-root-ca.crt\""
Jul 01 20:11:01.750775 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:01.750679    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4c4hj\"/\"default-dockercfg-vq58n\""
Jul 01 20:11:01.757833 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:01.757809    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4c4hj/must-gather-j8lbn"]
Jul 01 20:11:01.820264 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:01.820222    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a219259e-381a-4432-ae1e-10df0b05c15b-must-gather-output\") pod \"must-gather-j8lbn\" (UID: \"a219259e-381a-4432-ae1e-10df0b05c15b\") " pod="openshift-must-gather-4c4hj/must-gather-j8lbn"
Jul 01 20:11:01.820467 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:01.820293    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rqss\" (UniqueName: \"kubernetes.io/projected/a219259e-381a-4432-ae1e-10df0b05c15b-kube-api-access-4rqss\") pod \"must-gather-j8lbn\" (UID: \"a219259e-381a-4432-ae1e-10df0b05c15b\") " pod="openshift-must-gather-4c4hj/must-gather-j8lbn"
Jul 01 20:11:01.877464 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:01.877427    2556 generic.go:356] "Generic (PLEG): container finished" podID="c65dc835-3da6-49c1-b1da-623bc534f522" containerID="5421bcd2b17cd293e2a0c0e4382f8105ca1032161b68b9d6207366df88334ab4" exitCode=2
Jul 01 20:11:01.877838 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:01.877486    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888" event={"ID":"c65dc835-3da6-49c1-b1da-623bc534f522","Type":"ContainerDied","Data":"5421bcd2b17cd293e2a0c0e4382f8105ca1032161b68b9d6207366df88334ab4"}
Jul 01 20:11:01.921039 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:01.920996    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a219259e-381a-4432-ae1e-10df0b05c15b-must-gather-output\") pod \"must-gather-j8lbn\" (UID: \"a219259e-381a-4432-ae1e-10df0b05c15b\") " pod="openshift-must-gather-4c4hj/must-gather-j8lbn"
Jul 01 20:11:01.921208 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:01.921078    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rqss\" (UniqueName: \"kubernetes.io/projected/a219259e-381a-4432-ae1e-10df0b05c15b-kube-api-access-4rqss\") pod \"must-gather-j8lbn\" (UID: \"a219259e-381a-4432-ae1e-10df0b05c15b\") " pod="openshift-must-gather-4c4hj/must-gather-j8lbn"
Jul 01 20:11:01.921349 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:01.921329    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a219259e-381a-4432-ae1e-10df0b05c15b-must-gather-output\") pod \"must-gather-j8lbn\" (UID: \"a219259e-381a-4432-ae1e-10df0b05c15b\") " pod="openshift-must-gather-4c4hj/must-gather-j8lbn"
Jul 01 20:11:01.930698 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:01.930665    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rqss\" (UniqueName: \"kubernetes.io/projected/a219259e-381a-4432-ae1e-10df0b05c15b-kube-api-access-4rqss\") pod \"must-gather-j8lbn\" (UID: \"a219259e-381a-4432-ae1e-10df0b05c15b\") " pod="openshift-must-gather-4c4hj/must-gather-j8lbn"
Jul 01 20:11:02.067425 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:02.067308    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4c4hj/must-gather-j8lbn"
Jul 01 20:11:02.198717 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:02.198688    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4c4hj/must-gather-j8lbn"]
Jul 01 20:11:02.201805 ip-10-0-134-212 kubenswrapper[2556]: W0701 20:11:02.201780    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda219259e_381a_4432_ae1e_10df0b05c15b.slice/crio-83e35cdc0fdf554b85531998807462dd3b68f0884e6524127984f95447f7f4d8 WatchSource:0}: Error finding container 83e35cdc0fdf554b85531998807462dd3b68f0884e6524127984f95447f7f4d8: Status 404 returned error can't find the container with id 83e35cdc0fdf554b85531998807462dd3b68f0884e6524127984f95447f7f4d8
Jul 01 20:11:02.203708 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:02.203688    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 01 20:11:02.882628 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:02.882598    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4c4hj/must-gather-j8lbn" event={"ID":"a219259e-381a-4432-ae1e-10df0b05c15b","Type":"ContainerStarted","Data":"83e35cdc0fdf554b85531998807462dd3b68f0884e6524127984f95447f7f4d8"}
Jul 01 20:11:04.358664 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:04.358589    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888"
Jul 01 20:11:04.445695 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:04.445588    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c65dc835-3da6-49c1-b1da-623bc534f522-proxy-tls\") pod \"c65dc835-3da6-49c1-b1da-623bc534f522\" (UID: \"c65dc835-3da6-49c1-b1da-623bc534f522\") "
Jul 01 20:11:04.445695 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:04.445656    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c65dc835-3da6-49c1-b1da-623bc534f522-kube-rbac-proxy-sar-config\") pod \"c65dc835-3da6-49c1-b1da-623bc534f522\" (UID: \"c65dc835-3da6-49c1-b1da-623bc534f522\") "
Jul 01 20:11:04.445695 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:04.445697    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mgczq\" (UniqueName: \"kubernetes.io/projected/c65dc835-3da6-49c1-b1da-623bc534f522-kube-api-access-mgczq\") pod \"c65dc835-3da6-49c1-b1da-623bc534f522\" (UID: \"c65dc835-3da6-49c1-b1da-623bc534f522\") "
Jul 01 20:11:04.446515 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:04.446484    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c65dc835-3da6-49c1-b1da-623bc534f522-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "c65dc835-3da6-49c1-b1da-623bc534f522" (UID: "c65dc835-3da6-49c1-b1da-623bc534f522"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 01 20:11:04.448927 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:04.448894    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c65dc835-3da6-49c1-b1da-623bc534f522-kube-api-access-mgczq" (OuterVolumeSpecName: "kube-api-access-mgczq") pod "c65dc835-3da6-49c1-b1da-623bc534f522" (UID: "c65dc835-3da6-49c1-b1da-623bc534f522"). InnerVolumeSpecName "kube-api-access-mgczq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 20:11:04.450787 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:04.450704    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c65dc835-3da6-49c1-b1da-623bc534f522-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "c65dc835-3da6-49c1-b1da-623bc534f522" (UID: "c65dc835-3da6-49c1-b1da-623bc534f522"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 01 20:11:04.546947 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:04.546904    2556 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c65dc835-3da6-49c1-b1da-623bc534f522-proxy-tls\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 20:11:04.546947 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:04.546945    2556 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c65dc835-3da6-49c1-b1da-623bc534f522-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 20:11:04.547159 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:04.546962    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgczq\" (UniqueName: \"kubernetes.io/projected/c65dc835-3da6-49c1-b1da-623bc534f522-kube-api-access-mgczq\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 20:11:04.894958 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:04.894917    2556 generic.go:356] "Generic (PLEG): container finished" podID="c65dc835-3da6-49c1-b1da-623bc534f522" containerID="e504e6b42787d0deb3cdc2f2061a316414b7175299f8de3d21c0ef0e16a6a2fd" exitCode=0
Jul 01 20:11:04.895145 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:04.894973    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888" event={"ID":"c65dc835-3da6-49c1-b1da-623bc534f522","Type":"ContainerDied","Data":"e504e6b42787d0deb3cdc2f2061a316414b7175299f8de3d21c0ef0e16a6a2fd"}
Jul 01 20:11:04.895145 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:04.895040    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888" event={"ID":"c65dc835-3da6-49c1-b1da-623bc534f522","Type":"ContainerDied","Data":"e3f6df126fbca58d2dcb7c6b6b3ce7fee27a262a650519f0908b1d5b214209da"}
Jul 01 20:11:04.895145 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:04.894977    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888"
Jul 01 20:11:04.895145 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:04.895087    2556 scope.go:117] "RemoveContainer" containerID="5421bcd2b17cd293e2a0c0e4382f8105ca1032161b68b9d6207366df88334ab4"
Jul 01 20:11:04.918975 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:04.918939    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888"]
Jul 01 20:11:04.923301 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:04.923272    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-ee34f-predictor-6c5b4cbc46-zh888"]
Jul 01 20:11:06.256566 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:06.256536    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c65dc835-3da6-49c1-b1da-623bc534f522" path="/var/lib/kubelet/pods/c65dc835-3da6-49c1-b1da-623bc534f522/volumes"
Jul 01 20:11:07.651164 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:07.650935    2556 scope.go:117] "RemoveContainer" containerID="e504e6b42787d0deb3cdc2f2061a316414b7175299f8de3d21c0ef0e16a6a2fd"
Jul 01 20:11:08.551429 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:08.551401    2556 scope.go:117] "RemoveContainer" containerID="5421bcd2b17cd293e2a0c0e4382f8105ca1032161b68b9d6207366df88334ab4"
Jul 01 20:11:08.551757 ip-10-0-134-212 kubenswrapper[2556]: E0701 20:11:08.551736    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5421bcd2b17cd293e2a0c0e4382f8105ca1032161b68b9d6207366df88334ab4\": container with ID starting with 5421bcd2b17cd293e2a0c0e4382f8105ca1032161b68b9d6207366df88334ab4 not found: ID does not exist" containerID="5421bcd2b17cd293e2a0c0e4382f8105ca1032161b68b9d6207366df88334ab4"
Jul 01 20:11:08.551831 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:08.551767    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5421bcd2b17cd293e2a0c0e4382f8105ca1032161b68b9d6207366df88334ab4"} err="failed to get container status \"5421bcd2b17cd293e2a0c0e4382f8105ca1032161b68b9d6207366df88334ab4\": rpc error: code = NotFound desc = could not find container \"5421bcd2b17cd293e2a0c0e4382f8105ca1032161b68b9d6207366df88334ab4\": container with ID starting with 5421bcd2b17cd293e2a0c0e4382f8105ca1032161b68b9d6207366df88334ab4 not found: ID does not exist"
Jul 01 20:11:08.551831 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:08.551790    2556 scope.go:117] "RemoveContainer" containerID="e504e6b42787d0deb3cdc2f2061a316414b7175299f8de3d21c0ef0e16a6a2fd"
Jul 01 20:11:08.552041 ip-10-0-134-212 kubenswrapper[2556]: E0701 20:11:08.552023    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e504e6b42787d0deb3cdc2f2061a316414b7175299f8de3d21c0ef0e16a6a2fd\": container with ID starting with e504e6b42787d0deb3cdc2f2061a316414b7175299f8de3d21c0ef0e16a6a2fd not found: ID does not exist" containerID="e504e6b42787d0deb3cdc2f2061a316414b7175299f8de3d21c0ef0e16a6a2fd"
Jul 01 20:11:08.552086 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:08.552043    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e504e6b42787d0deb3cdc2f2061a316414b7175299f8de3d21c0ef0e16a6a2fd"} err="failed to get container status \"e504e6b42787d0deb3cdc2f2061a316414b7175299f8de3d21c0ef0e16a6a2fd\": rpc error: code = NotFound desc = could not find container \"e504e6b42787d0deb3cdc2f2061a316414b7175299f8de3d21c0ef0e16a6a2fd\": container with ID starting with e504e6b42787d0deb3cdc2f2061a316414b7175299f8de3d21c0ef0e16a6a2fd not found: ID does not exist"
Jul 01 20:11:08.918255 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:08.918220    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4c4hj/must-gather-j8lbn" event={"ID":"a219259e-381a-4432-ae1e-10df0b05c15b","Type":"ContainerStarted","Data":"06527e4787fa67c0068e70647e8ad2e280eee78372540c6e36c3f8fa58f0abd9"}
Jul 01 20:11:09.926696 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:09.926656    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4c4hj/must-gather-j8lbn" event={"ID":"a219259e-381a-4432-ae1e-10df0b05c15b","Type":"ContainerStarted","Data":"570fc3526309412ac42ebcec15cc5906d4413f6ba825f965fb2a6662ea19023f"}
Jul 01 20:11:09.944067 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:09.944012    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4c4hj/must-gather-j8lbn" podStartSLOduration=2.481647862 podStartE2EDuration="8.943994198s" totalImagesPullingTime="6.462346336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:11:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:11:09.942594507 +0000 UTC m=+2854.305606189" watchObservedRunningTime="2026-07-01 20:11:09.943994198 +0000 UTC m=+2854.307005879"
Jul 01 20:11:31.033183 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:31.033140    2556 generic.go:356] "Generic (PLEG): container finished" podID="a219259e-381a-4432-ae1e-10df0b05c15b" containerID="06527e4787fa67c0068e70647e8ad2e280eee78372540c6e36c3f8fa58f0abd9" exitCode=0
Jul 01 20:11:31.033183 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:31.033187    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4c4hj/must-gather-j8lbn" event={"ID":"a219259e-381a-4432-ae1e-10df0b05c15b","Type":"ContainerDied","Data":"06527e4787fa67c0068e70647e8ad2e280eee78372540c6e36c3f8fa58f0abd9"}
Jul 01 20:11:31.033700 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:31.033554    2556 scope.go:117] "RemoveContainer" containerID="06527e4787fa67c0068e70647e8ad2e280eee78372540c6e36c3f8fa58f0abd9"
Jul 01 20:11:31.454282 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:31.454252    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-4c4hj_must-gather-j8lbn_a219259e-381a-4432-ae1e-10df0b05c15b/gather/0.log"
Jul 01 20:11:34.669381 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:34.669335    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9znvt_091570c8-2f14-46c0-a514-c35f2d3096c4/global-pull-secret-syncer/0.log"
Jul 01 20:11:34.786380 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:34.786349    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-szp8f_a7f64003-a6be-4ff0-8d7b-ebc0489f3d75/konnectivity-agent/0.log"
Jul 01 20:11:34.869590 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:34.869562    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-212.ec2.internal_2a4e7494ec4e45c9b53bd4ccf02e8194/haproxy/0.log"
Jul 01 20:11:36.878570 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:36.878485    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-4c4hj/must-gather-j8lbn"]
Jul 01 20:11:36.878953 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:36.878681    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-4c4hj/must-gather-j8lbn" podUID="a219259e-381a-4432-ae1e-10df0b05c15b" containerName="copy" containerID="cri-o://570fc3526309412ac42ebcec15cc5906d4413f6ba825f965fb2a6662ea19023f" gracePeriod=2
Jul 01 20:11:36.885213 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:36.885185    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-4c4hj/must-gather-j8lbn"]
Jul 01 20:11:36.885798 ip-10-0-134-212 kubenswrapper[2556]: E0701 20:11:36.885762    2556 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"a219259e-381a-4432-ae1e-10df0b05c15b\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"openshift-must-gather-4c4hj\"/\"must-gather-j8lbn\": pods \"must-gather-j8lbn\" not found" pod="openshift-must-gather-4c4hj/must-gather-j8lbn"
Jul 01 20:11:37.060801 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:37.060779    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-4c4hj_must-gather-j8lbn_a219259e-381a-4432-ae1e-10df0b05c15b/copy/0.log"
Jul 01 20:11:37.061100 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:37.061078    2556 generic.go:356] "Generic (PLEG): container finished" podID="a219259e-381a-4432-ae1e-10df0b05c15b" containerID="570fc3526309412ac42ebcec15cc5906d4413f6ba825f965fb2a6662ea19023f" exitCode=143
Jul 01 20:11:37.115476 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:37.115452    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-4c4hj_must-gather-j8lbn_a219259e-381a-4432-ae1e-10df0b05c15b/copy/0.log"
Jul 01 20:11:37.117075 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:37.117059    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4c4hj/must-gather-j8lbn"
Jul 01 20:11:37.119093 ip-10-0-134-212 kubenswrapper[2556]: E0701 20:11:37.119068    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-j8lbn\" is forbidden: User \"system:node:ip-10-0-134-212.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-4c4hj\": no relationship found between node 'ip-10-0-134-212.ec2.internal' and this object" podUID="a219259e-381a-4432-ae1e-10df0b05c15b" pod="openshift-must-gather-4c4hj/must-gather-j8lbn"
Jul 01 20:11:37.157565 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:37.157535    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4rqss\" (UniqueName: \"kubernetes.io/projected/a219259e-381a-4432-ae1e-10df0b05c15b-kube-api-access-4rqss\") pod \"a219259e-381a-4432-ae1e-10df0b05c15b\" (UID: \"a219259e-381a-4432-ae1e-10df0b05c15b\") "
Jul 01 20:11:37.157717 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:37.157576    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a219259e-381a-4432-ae1e-10df0b05c15b-must-gather-output\") pod \"a219259e-381a-4432-ae1e-10df0b05c15b\" (UID: \"a219259e-381a-4432-ae1e-10df0b05c15b\") "
Jul 01 20:11:37.159128 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:37.159105    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a219259e-381a-4432-ae1e-10df0b05c15b-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "a219259e-381a-4432-ae1e-10df0b05c15b" (UID: "a219259e-381a-4432-ae1e-10df0b05c15b"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 01 20:11:37.159758 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:37.159733    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a219259e-381a-4432-ae1e-10df0b05c15b-kube-api-access-4rqss" (OuterVolumeSpecName: "kube-api-access-4rqss") pod "a219259e-381a-4432-ae1e-10df0b05c15b" (UID: "a219259e-381a-4432-ae1e-10df0b05c15b"). InnerVolumeSpecName "kube-api-access-4rqss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 01 20:11:37.258360 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:37.258319    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rqss\" (UniqueName: \"kubernetes.io/projected/a219259e-381a-4432-ae1e-10df0b05c15b-kube-api-access-4rqss\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 20:11:37.258360 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:37.258351    2556 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a219259e-381a-4432-ae1e-10df0b05c15b-must-gather-output\") on node \"ip-10-0-134-212.ec2.internal\" DevicePath \"\""
Jul 01 20:11:38.066702 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:38.066675    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-4c4hj_must-gather-j8lbn_a219259e-381a-4432-ae1e-10df0b05c15b/copy/0.log"
Jul 01 20:11:38.067114 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:38.067072    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4c4hj/must-gather-j8lbn"
Jul 01 20:11:38.067114 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:38.067104    2556 scope.go:117] "RemoveContainer" containerID="570fc3526309412ac42ebcec15cc5906d4413f6ba825f965fb2a6662ea19023f"
Jul 01 20:11:38.069331 ip-10-0-134-212 kubenswrapper[2556]: E0701 20:11:38.069303    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-j8lbn\" is forbidden: User \"system:node:ip-10-0-134-212.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-4c4hj\": no relationship found between node 'ip-10-0-134-212.ec2.internal' and this object" podUID="a219259e-381a-4432-ae1e-10df0b05c15b" pod="openshift-must-gather-4c4hj/must-gather-j8lbn"
Jul 01 20:11:38.075042 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:38.075028    2556 scope.go:117] "RemoveContainer" containerID="06527e4787fa67c0068e70647e8ad2e280eee78372540c6e36c3f8fa58f0abd9"
Jul 01 20:11:38.076929 ip-10-0-134-212 kubenswrapper[2556]: E0701 20:11:38.076904    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-j8lbn\" is forbidden: User \"system:node:ip-10-0-134-212.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-4c4hj\": no relationship found between node 'ip-10-0-134-212.ec2.internal' and this object" podUID="a219259e-381a-4432-ae1e-10df0b05c15b" pod="openshift-must-gather-4c4hj/must-gather-j8lbn"
Jul 01 20:11:38.255502 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:38.255464    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a219259e-381a-4432-ae1e-10df0b05c15b" path="/var/lib/kubelet/pods/a219259e-381a-4432-ae1e-10df0b05c15b/volumes"
Jul 01 20:11:38.784033 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:38.784006    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_76a8486d-8330-4cf5-b339-783c75286216/alertmanager/0.log"
Jul 01 20:11:38.827736 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:38.827707    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_76a8486d-8330-4cf5-b339-783c75286216/config-reloader/0.log"
Jul 01 20:11:38.864682 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:38.864657    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_76a8486d-8330-4cf5-b339-783c75286216/kube-rbac-proxy-web/0.log"
Jul 01 20:11:38.897177 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:38.897153    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_76a8486d-8330-4cf5-b339-783c75286216/kube-rbac-proxy/0.log"
Jul 01 20:11:38.933657 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:38.933624    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_76a8486d-8330-4cf5-b339-783c75286216/kube-rbac-proxy-metric/0.log"
Jul 01 20:11:38.971415 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:38.971380    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_76a8486d-8330-4cf5-b339-783c75286216/prom-label-proxy/0.log"
Jul 01 20:11:39.008699 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:39.008627    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_76a8486d-8330-4cf5-b339-783c75286216/init-config-reloader/0.log"
Jul 01 20:11:39.082728 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:39.082696    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-bfknl_ba8e22b6-4dac-4550-a971-a048c29bc65f/kube-state-metrics/0.log"
Jul 01 20:11:39.113787 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:39.113753    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-bfknl_ba8e22b6-4dac-4550-a971-a048c29bc65f/kube-rbac-proxy-main/0.log"
Jul 01 20:11:39.150723 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:39.150697    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-bfknl_ba8e22b6-4dac-4550-a971-a048c29bc65f/kube-rbac-proxy-self/0.log"
Jul 01 20:11:39.188224 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:39.188190    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7d9bb75989-6q6jc_b42489e4-d315-40e7-96bf-1fdbe6c31246/metrics-server/0.log"
Jul 01 20:11:39.219324 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:39.219295    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-cd8656b8-f4zbs_9dfc3924-9507-4a81-9a1c-74f73f7fc347/monitoring-plugin/0.log"
Jul 01 20:11:39.436170 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:39.436130    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vf7hp_698773fc-86f3-48c7-8b12-1e21346536b0/node-exporter/0.log"
Jul 01 20:11:39.461644 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:39.461621    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vf7hp_698773fc-86f3-48c7-8b12-1e21346536b0/kube-rbac-proxy/0.log"
Jul 01 20:11:39.494311 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:39.494288    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vf7hp_698773fc-86f3-48c7-8b12-1e21346536b0/init-textfile/0.log"
Jul 01 20:11:39.526783 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:39.526756    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-pxx4h_bbb4acdc-38bb-4419-8361-32af35d5fc55/kube-rbac-proxy-main/0.log"
Jul 01 20:11:39.551863 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:39.551828    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-pxx4h_bbb4acdc-38bb-4419-8361-32af35d5fc55/kube-rbac-proxy-self/0.log"
Jul 01 20:11:39.582740 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:39.582710    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-pxx4h_bbb4acdc-38bb-4419-8361-32af35d5fc55/openshift-state-metrics/0.log"
Jul 01 20:11:39.637588 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:39.637560    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_010d6a47-a972-4421-8041-6060b67c427c/prometheus/0.log"
Jul 01 20:11:39.670572 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:39.670543    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_010d6a47-a972-4421-8041-6060b67c427c/config-reloader/0.log"
Jul 01 20:11:39.695794 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:39.695770    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_010d6a47-a972-4421-8041-6060b67c427c/thanos-sidecar/0.log"
Jul 01 20:11:39.719582 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:39.719553    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_010d6a47-a972-4421-8041-6060b67c427c/kube-rbac-proxy-web/0.log"
Jul 01 20:11:39.745668 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:39.745642    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_010d6a47-a972-4421-8041-6060b67c427c/kube-rbac-proxy/0.log"
Jul 01 20:11:39.769636 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:39.769612    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_010d6a47-a972-4421-8041-6060b67c427c/kube-rbac-proxy-thanos/0.log"
Jul 01 20:11:39.797341 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:39.797318    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_010d6a47-a972-4421-8041-6060b67c427c/init-config-reloader/0.log"
Jul 01 20:11:39.836487 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:39.836455    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-s426w_1e81468a-4ac4-4c46-8964-6c03a180fab5/prometheus-operator/0.log"
Jul 01 20:11:39.861781 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:39.861754    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-s426w_1e81468a-4ac4-4c46-8964-6c03a180fab5/kube-rbac-proxy/0.log"
Jul 01 20:11:39.927683 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:39.927600    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-74cf8bff8-p4czh_0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec/telemeter-client/0.log"
Jul 01 20:11:39.953434 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:39.953401    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-74cf8bff8-p4czh_0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec/reload/0.log"
Jul 01 20:11:39.977976 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:39.977945    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-74cf8bff8-p4czh_0b9fa0e5-2932-451d-8c3e-2f6d9694a1ec/kube-rbac-proxy/0.log"
Jul 01 20:11:40.012039 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:40.012009    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66bc5d4987-8svj4_0b999439-23ae-44ac-8307-9f9fa6959707/thanos-query/0.log"
Jul 01 20:11:40.041478 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:40.041453    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66bc5d4987-8svj4_0b999439-23ae-44ac-8307-9f9fa6959707/kube-rbac-proxy-web/0.log"
Jul 01 20:11:40.066702 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:40.066673    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66bc5d4987-8svj4_0b999439-23ae-44ac-8307-9f9fa6959707/kube-rbac-proxy/0.log"
Jul 01 20:11:40.094321 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:40.094292    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66bc5d4987-8svj4_0b999439-23ae-44ac-8307-9f9fa6959707/prom-label-proxy/0.log"
Jul 01 20:11:40.118820 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:40.118791    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66bc5d4987-8svj4_0b999439-23ae-44ac-8307-9f9fa6959707/kube-rbac-proxy-rules/0.log"
Jul 01 20:11:40.144090 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:40.144066    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66bc5d4987-8svj4_0b999439-23ae-44ac-8307-9f9fa6959707/kube-rbac-proxy-metrics/0.log"
Jul 01 20:11:42.536280 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:42.536246    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5499b6fb8f-n8cvx_3edd9db8-f2f1-4b65-82f8-208ea3fe3ed7/download-server/0.log"
Jul 01 20:11:43.305284 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:43.305251    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-cn2r8/perf-node-gather-daemonset-pm9m4"]
Jul 01 20:11:43.305616 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:43.305603    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a219259e-381a-4432-ae1e-10df0b05c15b" containerName="copy"
Jul 01 20:11:43.305670 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:43.305617    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a219259e-381a-4432-ae1e-10df0b05c15b" containerName="copy"
Jul 01 20:11:43.305670 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:43.305638    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a219259e-381a-4432-ae1e-10df0b05c15b" containerName="gather"
Jul 01 20:11:43.305670 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:43.305643    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a219259e-381a-4432-ae1e-10df0b05c15b" containerName="gather"
Jul 01 20:11:43.305670 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:43.305651    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c65dc835-3da6-49c1-b1da-623bc534f522" containerName="kserve-container"
Jul 01 20:11:43.305670 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:43.305657    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c65dc835-3da6-49c1-b1da-623bc534f522" containerName="kserve-container"
Jul 01 20:11:43.305670 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:43.305666    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c65dc835-3da6-49c1-b1da-623bc534f522" containerName="kube-rbac-proxy"
Jul 01 20:11:43.305670 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:43.305671    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c65dc835-3da6-49c1-b1da-623bc534f522" containerName="kube-rbac-proxy"
Jul 01 20:11:43.305879 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:43.305722    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c65dc835-3da6-49c1-b1da-623bc534f522" containerName="kube-rbac-proxy"
Jul 01 20:11:43.305879 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:43.305729    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a219259e-381a-4432-ae1e-10df0b05c15b" containerName="gather"
Jul 01 20:11:43.305879 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:43.305737    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a219259e-381a-4432-ae1e-10df0b05c15b" containerName="copy"
Jul 01 20:11:43.305879 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:43.305745    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c65dc835-3da6-49c1-b1da-623bc534f522" containerName="kserve-container"
Jul 01 20:11:43.309395 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:43.309360    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cn2r8/perf-node-gather-daemonset-pm9m4"
Jul 01 20:11:43.312315 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:43.312287    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cn2r8\"/\"kube-root-ca.crt\""
Jul 01 20:11:43.313161 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:43.313138    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-cn2r8\"/\"default-dockercfg-f6k5p\""
Jul 01 20:11:43.313263 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:43.313164    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cn2r8\"/\"openshift-service-ca.crt\""
Jul 01 20:11:43.317568 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:43.317545    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cn2r8/perf-node-gather-daemonset-pm9m4"]
Jul 01 20:11:43.410617 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:43.410575    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e4d47fb-9646-40ae-99a9-deccf80636fa-sys\") pod \"perf-node-gather-daemonset-pm9m4\" (UID: \"7e4d47fb-9646-40ae-99a9-deccf80636fa\") " pod="openshift-must-gather-cn2r8/perf-node-gather-daemonset-pm9m4"
Jul 01 20:11:43.410617 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:43.410616    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7e4d47fb-9646-40ae-99a9-deccf80636fa-proc\") pod \"perf-node-gather-daemonset-pm9m4\" (UID: \"7e4d47fb-9646-40ae-99a9-deccf80636fa\") " pod="openshift-must-gather-cn2r8/perf-node-gather-daemonset-pm9m4"
Jul 01 20:11:43.410898 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:43.410660    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wdbx\" (UniqueName: \"kubernetes.io/projected/7e4d47fb-9646-40ae-99a9-deccf80636fa-kube-api-access-5wdbx\") pod \"perf-node-gather-daemonset-pm9m4\" (UID: \"7e4d47fb-9646-40ae-99a9-deccf80636fa\") " pod="openshift-must-gather-cn2r8/perf-node-gather-daemonset-pm9m4"
Jul 01 20:11:43.410898 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:43.410720    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7e4d47fb-9646-40ae-99a9-deccf80636fa-lib-modules\") pod \"perf-node-gather-daemonset-pm9m4\" (UID: \"7e4d47fb-9646-40ae-99a9-deccf80636fa\") " pod="openshift-must-gather-cn2r8/perf-node-gather-daemonset-pm9m4"
Jul 01 20:11:43.410898 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:43.410815    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7e4d47fb-9646-40ae-99a9-deccf80636fa-podres\") pod \"perf-node-gather-daemonset-pm9m4\" (UID: \"7e4d47fb-9646-40ae-99a9-deccf80636fa\") " pod="openshift-must-gather-cn2r8/perf-node-gather-daemonset-pm9m4"
Jul 01 20:11:43.512084 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:43.512044    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e4d47fb-9646-40ae-99a9-deccf80636fa-sys\") pod \"perf-node-gather-daemonset-pm9m4\" (UID: \"7e4d47fb-9646-40ae-99a9-deccf80636fa\") " pod="openshift-must-gather-cn2r8/perf-node-gather-daemonset-pm9m4"
Jul 01 20:11:43.512084 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:43.512080    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7e4d47fb-9646-40ae-99a9-deccf80636fa-proc\") pod \"perf-node-gather-daemonset-pm9m4\" (UID: \"7e4d47fb-9646-40ae-99a9-deccf80636fa\") " pod="openshift-must-gather-cn2r8/perf-node-gather-daemonset-pm9m4"
Jul 01 20:11:43.512343 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:43.512127    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wdbx\" (UniqueName: \"kubernetes.io/projected/7e4d47fb-9646-40ae-99a9-deccf80636fa-kube-api-access-5wdbx\") pod \"perf-node-gather-daemonset-pm9m4\" (UID: \"7e4d47fb-9646-40ae-99a9-deccf80636fa\") " pod="openshift-must-gather-cn2r8/perf-node-gather-daemonset-pm9m4"
Jul 01 20:11:43.512343 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:43.512146    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7e4d47fb-9646-40ae-99a9-deccf80636fa-lib-modules\") pod \"perf-node-gather-daemonset-pm9m4\" (UID: \"7e4d47fb-9646-40ae-99a9-deccf80636fa\") " pod="openshift-must-gather-cn2r8/perf-node-gather-daemonset-pm9m4"
Jul 01 20:11:43.512343 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:43.512181    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e4d47fb-9646-40ae-99a9-deccf80636fa-sys\") pod \"perf-node-gather-daemonset-pm9m4\" (UID: \"7e4d47fb-9646-40ae-99a9-deccf80636fa\") " pod="openshift-must-gather-cn2r8/perf-node-gather-daemonset-pm9m4"
Jul 01 20:11:43.512343 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:43.512243    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7e4d47fb-9646-40ae-99a9-deccf80636fa-proc\") pod \"perf-node-gather-daemonset-pm9m4\" (UID: \"7e4d47fb-9646-40ae-99a9-deccf80636fa\") " pod="openshift-must-gather-cn2r8/perf-node-gather-daemonset-pm9m4"
Jul 01 20:11:43.512343 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:43.512280    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7e4d47fb-9646-40ae-99a9-deccf80636fa-podres\") pod \"perf-node-gather-daemonset-pm9m4\" (UID: \"7e4d47fb-9646-40ae-99a9-deccf80636fa\") " pod="openshift-must-gather-cn2r8/perf-node-gather-daemonset-pm9m4"
Jul 01 20:11:43.512343 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:43.512295    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7e4d47fb-9646-40ae-99a9-deccf80636fa-lib-modules\") pod \"perf-node-gather-daemonset-pm9m4\" (UID: \"7e4d47fb-9646-40ae-99a9-deccf80636fa\") " pod="openshift-must-gather-cn2r8/perf-node-gather-daemonset-pm9m4"
Jul 01 20:11:43.512627 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:43.512354    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7e4d47fb-9646-40ae-99a9-deccf80636fa-podres\") pod \"perf-node-gather-daemonset-pm9m4\" (UID: \"7e4d47fb-9646-40ae-99a9-deccf80636fa\") " pod="openshift-must-gather-cn2r8/perf-node-gather-daemonset-pm9m4"
Jul 01 20:11:43.520707 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:43.520677    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wdbx\" (UniqueName: \"kubernetes.io/projected/7e4d47fb-9646-40ae-99a9-deccf80636fa-kube-api-access-5wdbx\") pod \"perf-node-gather-daemonset-pm9m4\" (UID: \"7e4d47fb-9646-40ae-99a9-deccf80636fa\") " pod="openshift-must-gather-cn2r8/perf-node-gather-daemonset-pm9m4"
Jul 01 20:11:43.621149 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:43.621040    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cn2r8/perf-node-gather-daemonset-pm9m4"
Jul 01 20:11:43.749827 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:43.749781    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cn2r8/perf-node-gather-daemonset-pm9m4"]
Jul 01 20:11:43.752241 ip-10-0-134-212 kubenswrapper[2556]: W0701 20:11:43.752212    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7e4d47fb_9646_40ae_99a9_deccf80636fa.slice/crio-c59205807fbb37917eee8ec198a5f2a8a6bc2999915d35484ba98a68936e3bea WatchSource:0}: Error finding container c59205807fbb37917eee8ec198a5f2a8a6bc2999915d35484ba98a68936e3bea: Status 404 returned error can't find the container with id c59205807fbb37917eee8ec198a5f2a8a6bc2999915d35484ba98a68936e3bea
Jul 01 20:11:44.095248 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:44.095208    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cn2r8/perf-node-gather-daemonset-pm9m4" event={"ID":"7e4d47fb-9646-40ae-99a9-deccf80636fa","Type":"ContainerStarted","Data":"631132df0050da191b33ccf8b076d8eea6946d19570cca0a0ee6d22db7b0d86d"}
Jul 01 20:11:44.095471 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:44.095276    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cn2r8/perf-node-gather-daemonset-pm9m4" event={"ID":"7e4d47fb-9646-40ae-99a9-deccf80636fa","Type":"ContainerStarted","Data":"c59205807fbb37917eee8ec198a5f2a8a6bc2999915d35484ba98a68936e3bea"}
Jul 01 20:11:44.095471 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:44.095412    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-cn2r8/perf-node-gather-daemonset-pm9m4"
Jul 01 20:11:44.113203 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:44.113150    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-cn2r8/perf-node-gather-daemonset-pm9m4" podStartSLOduration=1.113137529 podStartE2EDuration="1.113137529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:11:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:11:44.111509766 +0000 UTC m=+2888.474521448" watchObservedRunningTime="2026-07-01 20:11:44.113137529 +0000 UTC m=+2888.476149210"
Jul 01 20:11:44.118878 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:44.118855    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tszxb_d1a9588d-e88b-40f3-b94f-3258650f6357/dns/0.log"
Jul 01 20:11:44.141884 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:44.141855    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tszxb_d1a9588d-e88b-40f3-b94f-3258650f6357/kube-rbac-proxy/0.log"
Jul 01 20:11:44.220950 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:44.220916    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-trspk_2130321f-c2a8-4308-8f86-04d826bdebbd/dns-node-resolver/0.log"
Jul 01 20:11:44.758518 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:44.758488    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gql7j_83cd86be-0e41-4882-be06-4014a93cde38/node-ca/0.log"
Jul 01 20:11:46.024046 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:46.024016    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pb62t_f36ac906-7798-4117-8994-bed05d4b1a36/serve-healthcheck-canary/0.log"
Jul 01 20:11:46.508028 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:46.507997    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q4nt4_876fca92-a686-42c9-9824-7a2577c9d8c0/kube-rbac-proxy/0.log"
Jul 01 20:11:46.530389 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:46.530334    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q4nt4_876fca92-a686-42c9-9824-7a2577c9d8c0/exporter/0.log"
Jul 01 20:11:46.554254 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:46.554228    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q4nt4_876fca92-a686-42c9-9824-7a2577c9d8c0/extractor/0.log"
Jul 01 20:11:48.893479 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:48.893439    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-84b54b7f97-z6mvd_42493882-d207-4c4a-a39e-3487781ee626/manager/0.log"
Jul 01 20:11:48.924848 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:48.924815    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-cs7pm_d0b6865b-dde3-49a0-9082-d539ad3f049b/s3-init/0.log"
Jul 01 20:11:48.941306 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:48.941281    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-cs7pm_d0b6865b-dde3-49a0-9082-d539ad3f049b/download-hf-model/0.log"
Jul 01 20:11:48.968993 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:48.968962    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-fxp2k_50f73e8c-efca-4c6a-91b8-742f25830cad/seaweedfs/0.log"
Jul 01 20:11:50.109713 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:50.109686    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-cn2r8/perf-node-gather-daemonset-pm9m4"
Jul 01 20:11:54.440413 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:54.440385    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2k92k_6b1f80b9-6ebb-4244-a8ab-d93b9e13b002/kube-multus/0.log"
Jul 01 20:11:54.686204 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:54.686179    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z4m25_44702a43-1427-4499-a1ce-c22c7c3a7dbe/kube-multus-additional-cni-plugins/0.log"
Jul 01 20:11:54.735358 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:54.735330    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z4m25_44702a43-1427-4499-a1ce-c22c7c3a7dbe/egress-router-binary-copy/0.log"
Jul 01 20:11:54.798221 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:54.798195    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z4m25_44702a43-1427-4499-a1ce-c22c7c3a7dbe/cni-plugins/0.log"
Jul 01 20:11:54.821086 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:54.821061    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z4m25_44702a43-1427-4499-a1ce-c22c7c3a7dbe/bond-cni-plugin/0.log"
Jul 01 20:11:54.844452 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:54.844426    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z4m25_44702a43-1427-4499-a1ce-c22c7c3a7dbe/routeoverride-cni/0.log"
Jul 01 20:11:54.871010 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:54.870987    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z4m25_44702a43-1427-4499-a1ce-c22c7c3a7dbe/whereabouts-cni-bincopy/0.log"
Jul 01 20:11:54.893532 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:54.893508    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z4m25_44702a43-1427-4499-a1ce-c22c7c3a7dbe/whereabouts-cni/0.log"
Jul 01 20:11:55.136924 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:55.136897    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7mfxn_36332f97-ad96-472d-a040-542d79e9e865/network-metrics-daemon/0.log"
Jul 01 20:11:55.158807 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:55.158782    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7mfxn_36332f97-ad96-472d-a040-542d79e9e865/kube-rbac-proxy/0.log"
Jul 01 20:11:56.004690 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:56.004656    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tq4l_d621ab71-8427-42af-bfa4-f83db9c5800d/ovn-controller/0.log"
Jul 01 20:11:56.026636 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:56.026599    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tq4l_d621ab71-8427-42af-bfa4-f83db9c5800d/ovn-acl-logging/1.log"
Jul 01 20:11:56.026777 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:56.026605    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tq4l_d621ab71-8427-42af-bfa4-f83db9c5800d/ovn-acl-logging/0.log"
Jul 01 20:11:56.049020 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:56.048988    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tq4l_d621ab71-8427-42af-bfa4-f83db9c5800d/kube-rbac-proxy-node/0.log"
Jul 01 20:11:56.077873 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:56.077847    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tq4l_d621ab71-8427-42af-bfa4-f83db9c5800d/kube-rbac-proxy-ovn-metrics/0.log"
Jul 01 20:11:56.102073 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:56.102047    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tq4l_d621ab71-8427-42af-bfa4-f83db9c5800d/northd/0.log"
Jul 01 20:11:56.128593 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:56.128563    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tq4l_d621ab71-8427-42af-bfa4-f83db9c5800d/nbdb/0.log"
Jul 01 20:11:56.154808 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:56.154772    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tq4l_d621ab71-8427-42af-bfa4-f83db9c5800d/sbdb/0.log"
Jul 01 20:11:56.208464 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:56.208435    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2tq4l_d621ab71-8427-42af-bfa4-f83db9c5800d/ovnkube-controller/0.log"
Jul 01 20:11:57.753787 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:57.753744    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-g7lwk_64190ce2-a2fa-4276-a619-3e43188597ac/network-check-target-container/0.log"
Jul 01 20:11:58.644585 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:58.644556    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-5c4z2_92d21eec-cdb9-4f37-848b-a6a29232d828/iptables-alerter/0.log"
Jul 01 20:11:59.368173 ip-10-0-134-212 kubenswrapper[2556]: I0701 20:11:59.368143    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-jpfpn_558a74fc-97f8-4db3-a2de-813540a74fd6/tuned/0.log"