Aug 05 17:12:45.315959 ip-10-0-131-128 systemd[1]: Starting Kubernetes Kubelet...
Aug 05 17:12:45.674514 ip-10-0-131-128 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 05 17:12:45.674514 ip-10-0-131-128 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Aug 05 17:12:45.674514 ip-10-0-131-128 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 05 17:12:45.674514 ip-10-0-131-128 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Aug 05 17:12:45.674514 ip-10-0-131-128 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 05 17:12:45.675297 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.674586    2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Aug 05 17:12:45.680399 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680370    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 17:12:45.680399 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680397    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 17:12:45.680399 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680402    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 17:12:45.680505 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680405    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 17:12:45.680505 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680408    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 17:12:45.680505 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680411    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 17:12:45.680505 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680414    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 17:12:45.680505 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680417    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 17:12:45.680505 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680419    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 17:12:45.680505 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680422    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 17:12:45.680505 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680424    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 17:12:45.680505 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680427    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 17:12:45.680505 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680429    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 17:12:45.680505 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680432    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 17:12:45.680505 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680435    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 17:12:45.680505 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680437    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 17:12:45.680505 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680440    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 17:12:45.680505 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680445    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 17:12:45.680505 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680456    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 17:12:45.680505 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680460    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 17:12:45.680505 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680462    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 17:12:45.680505 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680465    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 17:12:45.680505 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680468    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 17:12:45.680995 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680471    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 17:12:45.680995 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680475    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 17:12:45.680995 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680478    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 17:12:45.680995 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680483    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 17:12:45.680995 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680486    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 17:12:45.680995 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680489    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 17:12:45.680995 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680492    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 17:12:45.680995 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680495    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 17:12:45.680995 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680498    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 17:12:45.680995 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680500    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 17:12:45.680995 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680503    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 17:12:45.680995 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680506    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 17:12:45.680995 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680508    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 17:12:45.680995 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680514    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 17:12:45.680995 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680517    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 17:12:45.680995 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680526    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 17:12:45.680995 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680530    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 17:12:45.680995 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680532    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 17:12:45.680995 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680535    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 17:12:45.681448 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680537    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 17:12:45.681448 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680540    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 17:12:45.681448 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680543    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 17:12:45.681448 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680545    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 17:12:45.681448 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680548    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 17:12:45.681448 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680566    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 17:12:45.681448 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680570    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 17:12:45.681448 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680574    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 17:12:45.681448 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680578    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 17:12:45.681448 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680582    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 17:12:45.681448 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680585    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 17:12:45.681448 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680587    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 17:12:45.681448 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680589    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 17:12:45.681448 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680592    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 17:12:45.681448 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680595    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 17:12:45.681448 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680599    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 17:12:45.681448 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680602    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 17:12:45.681448 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680604    2580 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 17:12:45.681448 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680607    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 17:12:45.681923 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680610    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 17:12:45.681923 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680613    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 17:12:45.681923 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680615    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 17:12:45.681923 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680618    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 17:12:45.681923 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680621    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 17:12:45.681923 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680630    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 17:12:45.681923 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680633    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 17:12:45.681923 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680636    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 17:12:45.681923 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680638    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 17:12:45.681923 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680641    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 17:12:45.681923 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680644    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 17:12:45.681923 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680647    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 17:12:45.681923 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680649    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 17:12:45.681923 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680652    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 17:12:45.681923 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680654    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 17:12:45.681923 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680656    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 17:12:45.681923 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680659    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 17:12:45.681923 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680661    2580 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 17:12:45.681923 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680664    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 17:12:45.681923 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680668    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 17:12:45.682391 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680670    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 17:12:45.682391 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680673    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 17:12:45.682391 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680675    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 17:12:45.682391 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680678    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 17:12:45.682391 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680680    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 17:12:45.682391 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680683    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 17:12:45.682391 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680686    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 17:12:45.682391 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680689    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 17:12:45.682391 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680691    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 17:12:45.682391 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680694    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 17:12:45.682391 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680697    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 17:12:45.682391 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680699    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 17:12:45.682391 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680702    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 17:12:45.682391 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680704    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 17:12:45.682391 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680708    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 17:12:45.682391 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680712    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 17:12:45.682391 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680715    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 17:12:45.682391 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.680718    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 17:12:45.682391 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681530    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 17:12:45.682391 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681537    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 17:12:45.682921 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681541    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 17:12:45.682921 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681544    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 17:12:45.682921 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681547    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 17:12:45.682921 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681550    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 17:12:45.682921 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681570    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 17:12:45.682921 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681572    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 17:12:45.682921 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681575    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 17:12:45.682921 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681578    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 17:12:45.682921 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681581    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 17:12:45.682921 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681583    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 17:12:45.682921 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681586    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 17:12:45.682921 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681589    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 17:12:45.682921 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681592    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 17:12:45.682921 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681594    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 17:12:45.682921 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681598    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 17:12:45.682921 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681602    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 17:12:45.682921 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681605    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 17:12:45.682921 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681608    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 17:12:45.682921 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681610    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 17:12:45.683424 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681614    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 17:12:45.683424 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681617    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 17:12:45.683424 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681620    2580 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 17:12:45.683424 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681623    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 17:12:45.683424 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681626    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 17:12:45.683424 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681629    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 17:12:45.683424 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681632    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 17:12:45.683424 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681635    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 17:12:45.683424 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681637    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 17:12:45.683424 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681640    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 17:12:45.683424 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681645    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 17:12:45.683424 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681648    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 17:12:45.683424 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681651    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 17:12:45.683424 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681654    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 17:12:45.683424 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681656    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 17:12:45.683424 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681659    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 17:12:45.683424 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681662    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 17:12:45.683424 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681665    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 17:12:45.683424 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681667    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 17:12:45.683919 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681670    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 17:12:45.683919 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681673    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 17:12:45.683919 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681676    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 17:12:45.683919 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681679    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 17:12:45.683919 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681683    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 17:12:45.683919 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681685    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 17:12:45.683919 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681688    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 17:12:45.683919 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681690    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 17:12:45.683919 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681694    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 17:12:45.683919 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681696    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 17:12:45.683919 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681699    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 17:12:45.683919 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681702    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 17:12:45.683919 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681704    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 17:12:45.683919 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681707    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 17:12:45.683919 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681710    2580 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 17:12:45.683919 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681713    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 17:12:45.683919 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681715    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 17:12:45.683919 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681718    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 17:12:45.683919 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681721    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 17:12:45.683919 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681723    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 17:12:45.684420 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681726    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 17:12:45.684420 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681728    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 17:12:45.684420 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681731    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 17:12:45.684420 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681734    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 17:12:45.684420 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681736    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 17:12:45.684420 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681739    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 17:12:45.684420 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681741    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 17:12:45.684420 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681744    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 17:12:45.684420 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681746    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 17:12:45.684420 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681749    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 17:12:45.684420 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681751    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 17:12:45.684420 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681760    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 17:12:45.684420 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681763    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 17:12:45.684420 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681765    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 17:12:45.684420 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681768    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 17:12:45.684420 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681770    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 17:12:45.684420 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681775    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 17:12:45.684420 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681778    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 17:12:45.684420 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681780    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 17:12:45.684420 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681783    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 17:12:45.684910 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681785    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 17:12:45.684910 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681787    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 17:12:45.684910 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681790    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 17:12:45.684910 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681793    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 17:12:45.684910 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681798    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 17:12:45.684910 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681801    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 17:12:45.684910 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681804    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 17:12:45.684910 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681807    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 17:12:45.684910 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681809    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 17:12:45.684910 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681812    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 17:12:45.684910 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681815    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 17:12:45.684910 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681817    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 17:12:45.684910 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681820    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 17:12:45.684910 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681822    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 17:12:45.684910 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681825    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 17:12:45.684910 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681827    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 17:12:45.684910 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681830    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 17:12:45.684910 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681832    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 17:12:45.684910 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.681835    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 17:12:45.684910 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682246    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 17:12:45.685397 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682251    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 17:12:45.685397 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682254    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 17:12:45.685397 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682256    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 17:12:45.685397 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682259    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 17:12:45.685397 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682262    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 17:12:45.685397 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682265    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 17:12:45.685397 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682268    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 17:12:45.685397 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682271    2580 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 17:12:45.685397 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682274    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 17:12:45.685397 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682276    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 17:12:45.685397 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682279    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 17:12:45.685397 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682281    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 17:12:45.685397 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682284    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 17:12:45.685397 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682286    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 17:12:45.685397 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682290    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 17:12:45.685397 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682294    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 17:12:45.685397 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682297    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 17:12:45.685397 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682300    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 17:12:45.685397 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682304    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 17:12:45.685874 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682307    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 17:12:45.685874 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682310    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 17:12:45.685874 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682313    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 17:12:45.685874 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682316    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 17:12:45.685874 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682319    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 17:12:45.685874 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682322    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 17:12:45.685874 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682325    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 17:12:45.685874 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682328    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 17:12:45.685874 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682331    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 17:12:45.685874 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682334    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 17:12:45.685874 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682336    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 17:12:45.685874 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682339    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 17:12:45.685874 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682342    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 17:12:45.685874 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682345    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 17:12:45.685874 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682347    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 17:12:45.685874 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682350    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 17:12:45.685874 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682352    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 17:12:45.685874 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682356    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 17:12:45.685874 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682358    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 17:12:45.685874 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682361    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 17:12:45.686361 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682363    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 17:12:45.686361 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682366    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 17:12:45.686361 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682368    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 17:12:45.686361 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682370    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 17:12:45.686361 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682373    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 17:12:45.686361 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682377    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 17:12:45.686361 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682380    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 17:12:45.686361 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682383    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 17:12:45.686361 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682385    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 17:12:45.686361 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682388    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 17:12:45.686361 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682391    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 17:12:45.686361 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682394    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 17:12:45.686361 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682398    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 17:12:45.686361 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682401    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 17:12:45.686361 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682404    2580 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 17:12:45.686361 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682406    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 17:12:45.686361 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682409    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 17:12:45.686361 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682411    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 17:12:45.686361 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682413    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 17:12:45.686361 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682416    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 17:12:45.686853 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682418    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 17:12:45.686853 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682421    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 17:12:45.686853 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682423    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 17:12:45.686853 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682426    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 17:12:45.686853 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682428    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 17:12:45.686853 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682431    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 17:12:45.686853 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682434    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 17:12:45.686853 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682437    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 17:12:45.686853 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682439    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 17:12:45.686853 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682442    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 17:12:45.686853 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682444    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 17:12:45.686853 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682447    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 17:12:45.686853 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682449    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 17:12:45.686853 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682452    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 17:12:45.686853 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682454    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 17:12:45.686853 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682456    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 17:12:45.686853 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682459    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 17:12:45.686853 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682461    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 17:12:45.686853 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682464    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 17:12:45.687322 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682466    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 17:12:45.687322 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682469    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 17:12:45.687322 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682471    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 17:12:45.687322 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682476    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 17:12:45.687322 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682478    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 17:12:45.687322 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682481    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 17:12:45.687322 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682483    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 17:12:45.687322 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682486    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 17:12:45.687322 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682488    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 17:12:45.687322 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682491    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 17:12:45.687322 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682494    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 17:12:45.687322 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682496    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 17:12:45.687322 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682498    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 17:12:45.687322 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682501    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 17:12:45.687322 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682504    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 17:12:45.687322 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682506    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 17:12:45.687322 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682508    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 17:12:45.687322 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682511    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 17:12:45.687322 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682514    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 17:12:45.687322 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.682516    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 17:12:45.687833 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682619    2580 flags.go:64] FLAG: --address="0.0.0.0"
Aug 05 17:12:45.687833 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682627    2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Aug 05 17:12:45.687833 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682635    2580 flags.go:64] FLAG: --anonymous-auth="true"
Aug 05 17:12:45.687833 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682643    2580 flags.go:64] FLAG: --application-metrics-count-limit="100"
Aug 05 17:12:45.687833 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682650    2580 flags.go:64] FLAG: --authentication-token-webhook="false"
Aug 05 17:12:45.687833 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682654    2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Aug 05 17:12:45.687833 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682661    2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Aug 05 17:12:45.687833 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682666    2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Aug 05 17:12:45.687833 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682669    2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Aug 05 17:12:45.687833 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682672    2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Aug 05 17:12:45.687833 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682676    2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Aug 05 17:12:45.687833 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682679    2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Aug 05 17:12:45.687833 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682682    2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Aug 05 17:12:45.687833 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682685    2580 flags.go:64] FLAG: --cgroup-root=""
Aug 05 17:12:45.687833 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682688    2580 flags.go:64] FLAG: --cgroups-per-qos="true"
Aug 05 17:12:45.687833 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682692    2580 flags.go:64] FLAG: --client-ca-file=""
Aug 05 17:12:45.687833 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682695    2580 flags.go:64] FLAG: --cloud-provider="external"
Aug 05 17:12:45.687833 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682699    2580 flags.go:64] FLAG: --cluster-dns="[]"
Aug 05 17:12:45.687833 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682704    2580 flags.go:64] FLAG: --cluster-domain=""
Aug 05 17:12:45.687833 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682707    2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Aug 05 17:12:45.687833 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682710    2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Aug 05 17:12:45.687833 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682713    2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Aug 05 17:12:45.687833 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682716    2580 flags.go:64] FLAG: --container-log-max-files="5"
Aug 05 17:12:45.687833 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682720    2580 flags.go:64] FLAG: --container-log-max-size="10Mi"
Aug 05 17:12:45.688446 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682723    2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Aug 05 17:12:45.688446 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682726    2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Aug 05 17:12:45.688446 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682729    2580 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Aug 05 17:12:45.688446 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682733    2580 flags.go:64] FLAG: --contention-profiling="false"
Aug 05 17:12:45.688446 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682736    2580 flags.go:64] FLAG: --cpu-cfs-quota="true"
Aug 05 17:12:45.688446 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682739    2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Aug 05 17:12:45.688446 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682742    2580 flags.go:64] FLAG: --cpu-manager-policy="none"
Aug 05 17:12:45.688446 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682745    2580 flags.go:64] FLAG: --cpu-manager-policy-options=""
Aug 05 17:12:45.688446 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682749    2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Aug 05 17:12:45.688446 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682752    2580 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Aug 05 17:12:45.688446 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682755    2580 flags.go:64] FLAG: --enable-debugging-handlers="true"
Aug 05 17:12:45.688446 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682757    2580 flags.go:64] FLAG: --enable-load-reader="false"
Aug 05 17:12:45.688446 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682760    2580 flags.go:64] FLAG: --enable-server="true"
Aug 05 17:12:45.688446 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682764    2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Aug 05 17:12:45.688446 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682769    2580 flags.go:64] FLAG: --event-burst="100"
Aug 05 17:12:45.688446 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682772    2580 flags.go:64] FLAG: --event-qps="50"
Aug 05 17:12:45.688446 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682775    2580 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Aug 05 17:12:45.688446 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682778    2580 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Aug 05 17:12:45.688446 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682781    2580 flags.go:64] FLAG: --eviction-hard=""
Aug 05 17:12:45.688446 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682784    2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Aug 05 17:12:45.688446 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682787    2580 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Aug 05 17:12:45.688446 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682790    2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Aug 05 17:12:45.688446 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682793    2580 flags.go:64] FLAG: --eviction-soft=""
Aug 05 17:12:45.688446 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682798    2580 flags.go:64] FLAG: --eviction-soft-grace-period=""
Aug 05 17:12:45.688446 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682801    2580 flags.go:64] FLAG: --exit-on-lock-contention="false"
Aug 05 17:12:45.689085 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682805    2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Aug 05 17:12:45.689085 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682808    2580 flags.go:64] FLAG: --experimental-mounter-path=""
Aug 05 17:12:45.689085 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682812    2580 flags.go:64] FLAG: --fail-cgroupv1="false"
Aug 05 17:12:45.689085 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682815    2580 flags.go:64] FLAG: --fail-swap-on="true"
Aug 05 17:12:45.689085 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682818    2580 flags.go:64] FLAG: --feature-gates=""
Aug 05 17:12:45.689085 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682822    2580 flags.go:64] FLAG: --file-check-frequency="20s"
Aug 05 17:12:45.689085 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682825    2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Aug 05 17:12:45.689085 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682828    2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Aug 05 17:12:45.689085 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682831    2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Aug 05 17:12:45.689085 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682834    2580 flags.go:64] FLAG: --healthz-port="10248"
Aug 05 17:12:45.689085 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682837    2580 flags.go:64] FLAG: --help="false"
Aug 05 17:12:45.689085 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682840    2580 flags.go:64] FLAG: --hostname-override="ip-10-0-131-128.ec2.internal"
Aug 05 17:12:45.689085 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682843    2580 flags.go:64] FLAG: --housekeeping-interval="10s"
Aug 05 17:12:45.689085 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682846    2580 flags.go:64] FLAG: --http-check-frequency="20s"
Aug 05 17:12:45.689085 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682849    2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Aug 05 17:12:45.689085 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682852    2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Aug 05 17:12:45.689085 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682856    2580 flags.go:64] FLAG: --image-gc-high-threshold="85"
Aug 05 17:12:45.689085 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682858    2580 flags.go:64] FLAG: --image-gc-low-threshold="80"
Aug 05 17:12:45.689085 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682861    2580 flags.go:64] FLAG: --image-service-endpoint=""
Aug 05 17:12:45.689085 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682864    2580 flags.go:64] FLAG: --kernel-memcg-notification="false"
Aug 05 17:12:45.689085 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682867    2580 flags.go:64] FLAG: --kube-api-burst="100"
Aug 05 17:12:45.689085 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682870    2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Aug 05 17:12:45.689085 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682873    2580 flags.go:64] FLAG: --kube-api-qps="50"
Aug 05 17:12:45.689085 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682876    2580 flags.go:64] FLAG: --kube-reserved=""
Aug 05 17:12:45.689742 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682879    2580 flags.go:64] FLAG: --kube-reserved-cgroup=""
Aug 05 17:12:45.689742 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682882    2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Aug 05 17:12:45.689742 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682885    2580 flags.go:64] FLAG: --kubelet-cgroups=""
Aug 05 17:12:45.689742 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682887    2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Aug 05 17:12:45.689742 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682890    2580 flags.go:64] FLAG: --lock-file=""
Aug 05 17:12:45.689742 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682893    2580 flags.go:64] FLAG: --log-cadvisor-usage="false"
Aug 05 17:12:45.689742 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682897    2580 flags.go:64] FLAG: --log-flush-frequency="5s"
Aug 05 17:12:45.689742 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682900    2580 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Aug 05 17:12:45.689742 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682907    2580 flags.go:64] FLAG: --log-json-split-stream="false"
Aug 05 17:12:45.689742 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682910    2580 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Aug 05 17:12:45.689742 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682912    2580 flags.go:64] FLAG: --log-text-split-stream="false"
Aug 05 17:12:45.689742 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682915    2580 flags.go:64] FLAG: --logging-format="text"
Aug 05 17:12:45.689742 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682918    2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Aug 05 17:12:45.689742 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682921    2580 flags.go:64] FLAG: --make-iptables-util-chains="true"
Aug 05 17:12:45.689742 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682924    2580 flags.go:64] FLAG: --manifest-url=""
Aug 05 17:12:45.689742 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682927    2580 flags.go:64] FLAG: --manifest-url-header=""
Aug 05 17:12:45.689742 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682932    2580 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Aug 05 17:12:45.689742 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682935    2580 flags.go:64] FLAG: --max-open-files="1000000"
Aug 05 17:12:45.689742 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682939    2580 flags.go:64] FLAG: --max-pods="110"
Aug 05 17:12:45.689742 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682942    2580 flags.go:64] FLAG: --maximum-dead-containers="-1"
Aug 05 17:12:45.689742 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682945    2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Aug 05 17:12:45.689742 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682948    2580 flags.go:64] FLAG: --memory-manager-policy="None"
Aug 05 17:12:45.689742 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682951    2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Aug 05 17:12:45.689742 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682954    2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Aug 05 17:12:45.689742 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682957    2580 flags.go:64] FLAG: --node-ip="0.0.0.0"
Aug 05 17:12:45.690394 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682960    2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Aug 05 17:12:45.690394 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682967    2580 flags.go:64] FLAG: --node-status-max-images="50"
Aug 05 17:12:45.690394 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682970    2580 flags.go:64] FLAG: --node-status-update-frequency="10s"
Aug 05 17:12:45.690394 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682973    2580 flags.go:64] FLAG: --oom-score-adj="-999"
Aug 05 17:12:45.690394 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682976    2580 flags.go:64] FLAG: --pod-cidr=""
Aug 05 17:12:45.690394 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682979    2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Aug 05 17:12:45.690394 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682986    2580 flags.go:64] FLAG: --pod-manifest-path=""
Aug 05 17:12:45.690394 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682988    2580 flags.go:64] FLAG: --pod-max-pids="-1"
Aug 05 17:12:45.690394 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682992    2580 flags.go:64] FLAG: --pods-per-core="0"
Aug 05 17:12:45.690394 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682994    2580 flags.go:64] FLAG: --port="10250"
Aug 05 17:12:45.690394 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.682998    2580 flags.go:64] FLAG: --protect-kernel-defaults="false"
Aug 05 17:12:45.690394 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.683001    2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0709b92d126dd17af"
Aug 05 17:12:45.690394 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.683004    2580 flags.go:64] FLAG: --qos-reserved=""
Aug 05 17:12:45.690394 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.683007    2580 flags.go:64] FLAG: --read-only-port="10255"
Aug 05 17:12:45.690394 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.683011    2580 flags.go:64] FLAG: --register-node="true"
Aug 05 17:12:45.690394 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.683015    2580 flags.go:64] FLAG: --register-with-taints=""
Aug 05 17:12:45.690394 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.683019    2580 flags.go:64] FLAG: --registry-burst="10"
Aug 05 17:12:45.690394 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.683021    2580 flags.go:64] FLAG: --registry-qps="5"
Aug 05 17:12:45.690394 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.683024    2580 flags.go:64] FLAG: --reserved-cpus=""
Aug 05 17:12:45.690394 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.683027    2580 flags.go:64] FLAG: --reserved-memory=""
Aug 05 17:12:45.690394 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.683031    2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Aug 05 17:12:45.690394 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.683034    2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Aug 05 17:12:45.690394 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.683037    2580 flags.go:64] FLAG: --rotate-certificates="false"
Aug 05 17:12:45.690394 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.683040    2580 flags.go:64] FLAG: --rotate-server-certificates="false"
Aug 05 17:12:45.690394 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.683043    2580 flags.go:64] FLAG: --runonce="false"
Aug 05 17:12:45.691025 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.683046    2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Aug 05 17:12:45.691025 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.683049    2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Aug 05 17:12:45.691025 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.683052    2580 flags.go:64] FLAG: --seccomp-default="false"
Aug 05 17:12:45.691025 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.683055    2580 flags.go:64] FLAG: --serialize-image-pulls="true"
Aug 05 17:12:45.691025 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.683057    2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Aug 05 17:12:45.691025 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.683061    2580 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Aug 05 17:12:45.691025 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.683064    2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Aug 05 17:12:45.691025 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.683067    2580 flags.go:64] FLAG: --storage-driver-password="root"
Aug 05 17:12:45.691025 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.683070    2580 flags.go:64] FLAG: --storage-driver-secure="false"
Aug 05 17:12:45.691025 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.683072    2580 flags.go:64] FLAG: --storage-driver-table="stats"
Aug 05 17:12:45.691025 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.683075    2580 flags.go:64] FLAG: --storage-driver-user="root"
Aug 05 17:12:45.691025 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.683078    2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Aug 05 17:12:45.691025 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.683081    2580 flags.go:64] FLAG: --sync-frequency="1m0s"
Aug 05 17:12:45.691025 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.683084    2580 flags.go:64] FLAG: --system-cgroups=""
Aug 05 17:12:45.691025 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.683087    2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Aug 05 17:12:45.691025 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.683093    2580 flags.go:64] FLAG: --system-reserved-cgroup=""
Aug 05 17:12:45.691025 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.683096    2580 flags.go:64] FLAG: --tls-cert-file=""
Aug 05 17:12:45.691025 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.683098    2580 flags.go:64] FLAG: --tls-cipher-suites="[]"
Aug 05 17:12:45.691025 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.683102    2580 flags.go:64] FLAG: --tls-min-version=""
Aug 05 17:12:45.691025 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.683105    2580 flags.go:64] FLAG: --tls-private-key-file=""
Aug 05 17:12:45.691025 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.683108    2580 flags.go:64] FLAG: --topology-manager-policy="none"
Aug 05 17:12:45.691025 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.683111    2580 flags.go:64] FLAG: --topology-manager-policy-options=""
Aug 05 17:12:45.691025 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.683116    2580 flags.go:64] FLAG: --topology-manager-scope="container"
Aug 05 17:12:45.691025 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.683119    2580 flags.go:64] FLAG: --v="2"
Aug 05 17:12:45.691025 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.683123    2580 flags.go:64] FLAG: --version="false"
Aug 05 17:12:45.691690 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.683127    2580 flags.go:64] FLAG: --vmodule=""
Aug 05 17:12:45.691690 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.683130    2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Aug 05 17:12:45.691690 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.683134    2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Aug 05 17:12:45.691690 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683257    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 17:12:45.691690 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683261    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 17:12:45.691690 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683264    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 17:12:45.691690 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683266    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 17:12:45.691690 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683269    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 17:12:45.691690 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683272    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 17:12:45.691690 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683274    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 17:12:45.691690 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683277    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 17:12:45.691690 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683280    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 17:12:45.691690 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683282    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 17:12:45.691690 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683285    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 17:12:45.691690 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683287    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 17:12:45.691690 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683290    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 17:12:45.691690 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683292    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 17:12:45.691690 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683295    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 17:12:45.691690 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683297    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 17:12:45.691690 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683300    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 17:12:45.692362 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683302    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 17:12:45.692362 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683305    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 17:12:45.692362 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683308    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 17:12:45.692362 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683310    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 17:12:45.692362 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683313    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 17:12:45.692362 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683315    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 17:12:45.692362 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683318    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 17:12:45.692362 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683320    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 17:12:45.692362 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683324    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 17:12:45.692362 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683327    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 17:12:45.692362 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683330    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 17:12:45.692362 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683333    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 17:12:45.692362 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683336    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 17:12:45.692362 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683338    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 17:12:45.692362 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683341    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 17:12:45.692362 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683343    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 17:12:45.692362 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683346    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 17:12:45.692362 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683348    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 17:12:45.692362 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683351    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 17:12:45.692362 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683353    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 17:12:45.693176 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683356    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 17:12:45.693176 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683358    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 17:12:45.693176 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683361    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 17:12:45.693176 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683364    2580 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 17:12:45.693176 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683366    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 17:12:45.693176 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683368    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 17:12:45.693176 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683373    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 17:12:45.693176 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683376    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 17:12:45.693176 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683379    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 17:12:45.693176 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683382    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 17:12:45.693176 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683385    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 17:12:45.693176 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683387    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 17:12:45.693176 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683390    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 17:12:45.693176 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683392    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 17:12:45.693176 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683395    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 17:12:45.693176 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683398    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 17:12:45.693176 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683400    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 17:12:45.693176 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683403    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 17:12:45.693176 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683405    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 17:12:45.693880 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683408    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 17:12:45.693880 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683412    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 17:12:45.693880 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683416    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 17:12:45.693880 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683418    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 17:12:45.693880 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683421    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 17:12:45.693880 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683424    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 17:12:45.693880 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683427    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 17:12:45.693880 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683431    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 17:12:45.693880 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683434    2580 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 17:12:45.693880 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683436    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 17:12:45.693880 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683439    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 17:12:45.693880 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683442    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 17:12:45.693880 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683444    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 17:12:45.693880 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683448    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 17:12:45.693880 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683450    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 17:12:45.693880 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683453    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 17:12:45.693880 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683455    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 17:12:45.693880 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683458    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 17:12:45.693880 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683460    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 17:12:45.693880 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683463    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 17:12:45.694455 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683465    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 17:12:45.694455 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683468    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 17:12:45.694455 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683470    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 17:12:45.694455 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683472    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 17:12:45.694455 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683475    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 17:12:45.694455 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683478    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 17:12:45.694455 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683480    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 17:12:45.694455 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683483    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 17:12:45.694455 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683485    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 17:12:45.694455 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683488    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 17:12:45.694455 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683491    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 17:12:45.694455 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683493    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 17:12:45.694455 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683495    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 17:12:45.694455 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683502    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 17:12:45.694455 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683507    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 17:12:45.694455 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683510    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 17:12:45.694455 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683513    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 17:12:45.694455 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683516    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 17:12:45.694455 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683518    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 17:12:45.694455 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683521    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 17:12:45.695064 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683523    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 17:12:45.695064 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683526    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 17:12:45.695064 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.683528    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 17:12:45.695064 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.684185    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 05 17:12:45.695064 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.691391    2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Aug 05 17:12:45.695064 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.691408    2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Aug 05 17:12:45.695064 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.691430    2580 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Aug 05 17:12:45.695064 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.691435    2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Aug 05 17:12:45.695064 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691493    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 17:12:45.695064 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691498    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 17:12:45.695064 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691501    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 17:12:45.695064 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691504    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 17:12:45.695064 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691506    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 17:12:45.695064 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691509    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 17:12:45.695404 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691512    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 17:12:45.695404 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691514    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 17:12:45.695404 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691518    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 17:12:45.695404 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691521    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 17:12:45.695404 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691523    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 17:12:45.695404 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691526    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 17:12:45.695404 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691528    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 17:12:45.695404 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691531    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 17:12:45.695404 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691533    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 17:12:45.695404 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691536    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 17:12:45.695404 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691538    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 17:12:45.695404 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691541    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 17:12:45.695404 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691543    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 17:12:45.695404 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691546    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 17:12:45.695404 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691550    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 17:12:45.695404 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691574    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 17:12:45.695404 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691577    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 17:12:45.695404 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691581    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 17:12:45.695404 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691584    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 17:12:45.695404 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691587    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 17:12:45.695914 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691589    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 17:12:45.695914 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691592    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 17:12:45.695914 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691594    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 17:12:45.695914 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691599    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 17:12:45.695914 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691602    2580 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 17:12:45.695914 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691604    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 17:12:45.695914 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691607    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 17:12:45.695914 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691610    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 17:12:45.695914 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691613    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 17:12:45.695914 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691615    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 17:12:45.695914 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691618    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 17:12:45.695914 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691620    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 17:12:45.695914 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691623    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 17:12:45.695914 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691625    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 17:12:45.695914 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691628    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 17:12:45.695914 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691630    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 17:12:45.695914 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691633    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 17:12:45.695914 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691635    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 17:12:45.695914 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691637    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 17:12:45.695914 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691640    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 17:12:45.696435 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691642    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 17:12:45.696435 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691645    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 17:12:45.696435 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691647    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 17:12:45.696435 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691650    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 17:12:45.696435 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691652    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 17:12:45.696435 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691655    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 17:12:45.696435 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691657    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 17:12:45.696435 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691659    2580 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 17:12:45.696435 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691662    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 17:12:45.696435 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691664    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 17:12:45.696435 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691667    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 17:12:45.696435 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691669    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 17:12:45.696435 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691672    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 17:12:45.696435 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691674    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 17:12:45.696435 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691677    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 17:12:45.696435 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691680    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 17:12:45.696435 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691684    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 17:12:45.696435 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691686    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 17:12:45.696435 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691688    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 17:12:45.696975 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691691    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 17:12:45.696975 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691694    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 17:12:45.696975 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691697    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 17:12:45.696975 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691699    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 17:12:45.696975 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691703    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 17:12:45.696975 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691707    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 17:12:45.696975 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691709    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 17:12:45.696975 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691712    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 17:12:45.696975 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691714    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 17:12:45.696975 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691717    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 17:12:45.696975 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691721    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 17:12:45.696975 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691725    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 17:12:45.696975 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691728    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 17:12:45.696975 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691730    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 17:12:45.696975 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691733    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 17:12:45.696975 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691735    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 17:12:45.696975 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691738    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 17:12:45.696975 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691741    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 17:12:45.696975 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691744    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 17:12:45.697445 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691746    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 17:12:45.697445 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691749    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 17:12:45.697445 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691752    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 17:12:45.697445 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691754    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 17:12:45.697445 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691757    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 17:12:45.697445 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691759    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 17:12:45.697445 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691762    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 17:12:45.697445 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691764    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 17:12:45.697445 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691767    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 17:12:45.697445 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691770    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 17:12:45.697445 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691772    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 17:12:45.697445 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691776    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 17:12:45.697445 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691779    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 17:12:45.697445 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691782    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 17:12:45.697445 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691784    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 17:12:45.697840 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.691790    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 05 17:12:45.697840 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691906    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 17:12:45.697840 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691912    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 17:12:45.697840 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691915    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 17:12:45.697840 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691918    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 17:12:45.697840 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691920    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 17:12:45.697840 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691923    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 17:12:45.697840 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691926    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 17:12:45.697840 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691929    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 17:12:45.697840 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691931    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 17:12:45.697840 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691934    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 17:12:45.697840 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691937    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 17:12:45.697840 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691940    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 17:12:45.697840 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691942    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 17:12:45.697840 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691945    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 17:12:45.697840 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691947    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 17:12:45.698254 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691950    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 17:12:45.698254 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691952    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 17:12:45.698254 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691955    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 17:12:45.698254 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691957    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 17:12:45.698254 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691959    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 17:12:45.698254 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691962    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 17:12:45.698254 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691964    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 17:12:45.698254 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691967    2580 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 17:12:45.698254 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691970    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 17:12:45.698254 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691972    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 17:12:45.698254 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691974    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 17:12:45.698254 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691977    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 17:12:45.698254 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691980    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 17:12:45.698254 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691984    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 17:12:45.698254 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691986    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 17:12:45.698254 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691989    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 17:12:45.698254 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691991    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 17:12:45.698254 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691994    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 17:12:45.698254 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.691997    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 17:12:45.698793 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.692102    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 17:12:45.698793 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.692107    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 17:12:45.698793 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.692111    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 17:12:45.698793 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.692116    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 17:12:45.698793 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.692119    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 17:12:45.698793 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.692123    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 17:12:45.698793 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.692126    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 17:12:45.698793 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.692129    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 17:12:45.698793 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.692132    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 17:12:45.698793 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.692135    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 17:12:45.698793 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.692138    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 17:12:45.698793 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.692142    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 17:12:45.698793 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.692147    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 17:12:45.698793 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.692157    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 17:12:45.698793 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.692161    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 17:12:45.698793 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.692165    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 17:12:45.698793 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.692169    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 17:12:45.698793 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.692173    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 17:12:45.698793 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.692177    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 17:12:45.699254 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.693536    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 17:12:45.699254 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.693550    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 17:12:45.699254 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.693573    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 17:12:45.699254 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.693578    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 17:12:45.699254 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.693584    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 17:12:45.699254 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.693601    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 17:12:45.699254 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.693640    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 17:12:45.699254 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.693659    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 17:12:45.699254 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.693663    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 17:12:45.699254 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.693818    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 17:12:45.699254 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.693824    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 17:12:45.699254 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.693827    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 17:12:45.699254 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.693830    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 17:12:45.699254 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.693834    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 17:12:45.699254 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.693837    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 17:12:45.699254 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.693840    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 17:12:45.699254 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.693843    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 17:12:45.699254 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.693846    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 17:12:45.699254 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.693849    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 17:12:45.699254 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.693851    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 17:12:45.699770 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.693854    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 17:12:45.699770 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.693857    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 17:12:45.699770 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.693859    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 17:12:45.699770 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.693873    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 17:12:45.699770 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.693879    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 17:12:45.699770 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.693882    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 17:12:45.699770 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.693885    2580 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 17:12:45.699770 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.693888    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 17:12:45.699770 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.693891    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 17:12:45.699770 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.693894    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 17:12:45.699770 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.693897    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 17:12:45.699770 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.693900    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 17:12:45.699770 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.693902    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 17:12:45.699770 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.693905    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 17:12:45.699770 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.693908    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 17:12:45.699770 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.693911    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 17:12:45.699770 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.693913    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 17:12:45.699770 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.693916    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 17:12:45.699770 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.693919    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 17:12:45.700230 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.693921    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 17:12:45.700230 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.693923    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 17:12:45.700230 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.693926    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 17:12:45.700230 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.693929    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 17:12:45.700230 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.693932    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 17:12:45.700230 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.693935    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 17:12:45.700230 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:45.693937    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 17:12:45.700230 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.693943    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 05 17:12:45.700230 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.694107    2580 server.go:962] "Client rotation is on, will bootstrap in background"
Aug 05 17:12:45.700230 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.696389    2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Aug 05 17:12:45.700230 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.697831    2580 server.go:1019] "Starting client certificate rotation"
Aug 05 17:12:45.700230 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.697935    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 05 17:12:45.700230 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.697972    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 05 17:12:45.700604 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.700349    2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 05 17:12:45.705415 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.705395    2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 05 17:12:45.715568 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.715540    2580 log.go:25] "Validated CRI v1 runtime API"
Aug 05 17:12:45.717818 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.717799    2580 log.go:25] "Validated CRI v1 image API"
Aug 05 17:12:45.719284 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.719260    2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Aug 05 17:12:45.722903 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.722864    2580 fs.go:135] Filesystem UUIDs: map[43816a6f-d93a-4b56-ac41-89a7b6b60e7a:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 de4417a7-ce61-4043-b247-b91b3d727487:/dev/nvme0n1p3]
Aug 05 17:12:45.722992 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.722904    2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Aug 05 17:12:45.725767 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.725745    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 05 17:12:45.728914 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.728787    2580 manager.go:216] Machine: {Timestamp:2026-08-05 17:12:45.727535714 +0000 UTC m=+0.296038128 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101531 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2948786fa6ab72da0e8037d7e7a33b SystemUUID:ec294878-6fa6-ab72-da0e-8037d7e7a33b BootID:1038aa83-b764-4649-acfe-f124c2542f53 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b8:32:ed:0c:b1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b8:32:ed:0c:b1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a2:e3:37:11:8f:c7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Aug 05 17:12:45.728914 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.728902    2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Aug 05 17:12:45.729083 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.729019    2580 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Aug 05 17:12:45.730525 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.730500    2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Aug 05 17:12:45.730688 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.730529    2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-128.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Aug 05 17:12:45.731879 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.731866    2580 topology_manager.go:138] "Creating topology manager with none policy"
Aug 05 17:12:45.731912 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.731881    2580 container_manager_linux.go:309] "Creating device plugin manager"
Aug 05 17:12:45.731912 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.731889    2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 05 17:12:45.732664 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.732652    2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 05 17:12:45.733730 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.733719    2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Aug 05 17:12:45.737567 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.737544    2580 state_mem.go:36] "Initialized new in-memory state store"
Aug 05 17:12:45.737694 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.737684    2580 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Aug 05 17:12:45.737728 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.737717    2580 kubelet.go:486] "Attempting to sync node with API server"
Aug 05 17:12:45.737764 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.737732    2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Aug 05 17:12:45.737764 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.737752    2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Aug 05 17:12:45.737764 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.737764    2580 kubelet.go:398] "Adding apiserver pod source"
Aug 05 17:12:45.737870 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.737777    2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Aug 05 17:12:45.738140 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.738126    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 05 17:12:45.738191 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.738144    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 05 17:12:45.741639 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.741614    2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Aug 05 17:12:45.743501 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.743487    2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Aug 05 17:12:45.743564 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.743518    2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Aug 05 17:12:45.744841 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.744830    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Aug 05 17:12:45.744886 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.744847    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Aug 05 17:12:45.744886 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.744854    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Aug 05 17:12:45.744886 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.744859    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Aug 05 17:12:45.744886 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.744868    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Aug 05 17:12:45.744886 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.744874    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Aug 05 17:12:45.744886 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.744882    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Aug 05 17:12:45.745072 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.744891    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Aug 05 17:12:45.745072 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.744898    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Aug 05 17:12:45.745072 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.744904    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Aug 05 17:12:45.745072 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.744912    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Aug 05 17:12:45.745072 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.744917    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Aug 05 17:12:45.745651 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.745641    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Aug 05 17:12:45.745651 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.745651    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Aug 05 17:12:45.748834 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.748818    2580 server.go:1268] "Started kubelet"
Aug 05 17:12:45.748964 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.748911    2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Aug 05 17:12:45.749021 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.748989    2580 server_v1.go:49] "podresources" method="list" useActivePods=true
Aug 05 17:12:45.749107 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.749073    2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Aug 05 17:12:45.749764 ip-10-0-131-128 systemd[1]: Started Kubernetes Kubelet.
Aug 05 17:12:45.750397 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.750380    2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Aug 05 17:12:45.751485 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.751470    2580 server.go:310] "Adding debug handlers to kubelet server"
Aug 05 17:12:45.754313 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:45.754290    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-128.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Aug 05 17:12:45.754390 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.754320    2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-128.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Aug 05 17:12:45.754637 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:45.754615    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Aug 05 17:12:45.755116 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:45.754384    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-128.ec2.internal.18c8f8080f13f988  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-128.ec2.internal,UID:ip-10-0-131-128.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-128.ec2.internal,},FirstTimestamp:2026-08-05 17:12:45.748795784 +0000 UTC m=+0.317298198,LastTimestamp:2026-08-05 17:12:45.748795784 +0000 UTC m=+0.317298198,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-128.ec2.internal,}"
Aug 05 17:12:45.755204 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:45.755187    2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Aug 05 17:12:45.756566 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.756539    2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Aug 05 17:12:45.756634 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.756604    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Aug 05 17:12:45.756687 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:45.756675    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-128.ec2.internal\" not found"
Aug 05 17:12:45.757605 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.757492    2580 volume_manager.go:311] "The desired_state_of_world populator starts"
Aug 05 17:12:45.757605 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.757521    2580 factory.go:55] Registering systemd factory
Aug 05 17:12:45.757605 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.757538    2580 factory.go:223] Registration of the systemd container factory successfully
Aug 05 17:12:45.757605 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.757527    2580 volume_manager.go:313] "Starting Kubelet Volume Manager"
Aug 05 17:12:45.757824 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.757634    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p97nk"
Aug 05 17:12:45.757824 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.757676    2580 reconstruct.go:97] "Volume reconstruction finished"
Aug 05 17:12:45.757824 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.757683    2580 reconciler.go:29] "Reconciler: start to sync state"
Aug 05 17:12:45.757824 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.757701    2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Aug 05 17:12:45.757824 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.757753    2580 factory.go:153] Registering CRI-O factory
Aug 05 17:12:45.757824 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.757766    2580 factory.go:223] Registration of the crio container factory successfully
Aug 05 17:12:45.757824 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.757819    2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Aug 05 17:12:45.758059 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.757844    2580 factory.go:103] Registering Raw factory
Aug 05 17:12:45.758059 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.757857    2580 manager.go:1196] Started watching for new ooms in manager
Aug 05 17:12:45.758410 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.758399    2580 manager.go:349] Starting recovery of all containers
Aug 05 17:12:45.761872 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:45.761800    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Aug 05 17:12:45.762126 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:45.762106    2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-128.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Aug 05 17:12:45.766542 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.766520    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p97nk"
Aug 05 17:12:45.771917 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.771878    2580 manager.go:354] Recovery completed
Aug 05 17:12:45.778020 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.777899    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 17:12:45.780221 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.780205    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-128.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 17:12:45.780295 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.780240    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-128.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 17:12:45.780295 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.780256    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-128.ec2.internal" event="NodeHasSufficientPID"
Aug 05 17:12:45.780849 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.780834    2580 cpu_manager.go:222] "Starting CPU manager" policy="none"
Aug 05 17:12:45.780849 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.780846    2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Aug 05 17:12:45.780963 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.780853    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 17:12:45.780963 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.780863    2580 state_mem.go:36] "Initialized new in-memory state store"
Aug 05 17:12:45.781534 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.781520    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-128.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 17:12:45.781650 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.781584    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-128.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 17:12:45.781650 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.781604    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-128.ec2.internal" event="NodeHasSufficientPID"
Aug 05 17:12:45.782401 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.782389    2580 policy_none.go:49] "None policy: Start"
Aug 05 17:12:45.782451 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.782406    2580 memory_manager.go:187] "Starting memorymanager" policy="None"
Aug 05 17:12:45.782451 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.782416    2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Aug 05 17:12:45.782529 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:45.782426    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-128.ec2.internal.18c8f80810f383e3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-128.ec2.internal,UID:ip-10-0-131-128.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-128.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-128.ec2.internal,},FirstTimestamp:2026-08-05 17:12:45.780222947 +0000 UTC m=+0.348725365,LastTimestamp:2026-08-05 17:12:45.780222947 +0000 UTC m=+0.348725365,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-128.ec2.internal,}"
Aug 05 17:12:45.783547 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.783536    2580 policy_none.go:47] "Start"
Aug 05 17:12:45.820250 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.820229    2580 manager.go:337] "Starting Device Plugin manager"
Aug 05 17:12:45.820396 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:45.820288    2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Aug 05 17:12:45.820396 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.820302    2580 server.go:87] "Starting device plugin registration server"
Aug 05 17:12:45.820674 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.820659    2580 eviction_manager.go:189] "Eviction manager: starting control loop"
Aug 05 17:12:45.820738 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.820679    2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Aug 05 17:12:45.820806 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.820749    2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Aug 05 17:12:45.820861 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.820837    2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Aug 05 17:12:45.820861 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.820847    2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Aug 05 17:12:45.821434 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:45.821412    2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Aug 05 17:12:45.821518 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:45.821465    2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-128.ec2.internal\" not found"
Aug 05 17:12:45.921837 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.921794    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 17:12:45.923406 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.922870    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-128.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 17:12:45.923406 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.922905    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-128.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 17:12:45.923406 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.922918    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-128.ec2.internal" event="NodeHasSufficientPID"
Aug 05 17:12:45.923406 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.922946    2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-128.ec2.internal"
Aug 05 17:12:45.929393 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.929338    2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-128.ec2.internal"
Aug 05 17:12:45.929393 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:45.929371    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-128.ec2.internal\": node \"ip-10-0-131-128.ec2.internal\" not found"
Aug 05 17:12:45.939111 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:45.939082    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-128.ec2.internal\" not found"
Aug 05 17:12:45.994437 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.994389    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Aug 05 17:12:45.995799 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.995767    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Aug 05 17:12:45.995914 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.995821    2580 status_manager.go:244] "Starting to sync pod status with apiserver"
Aug 05 17:12:45.995914 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.995849    2580 kubelet.go:2448] "Starting kubelet main sync loop"
Aug 05 17:12:45.995914 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:45.995896    2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Aug 05 17:12:45.997765 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:45.997741    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 17:12:46.039340 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:46.039294    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-128.ec2.internal\" not found"
Aug 05 17:12:46.096780 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:46.096750    2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-128.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-128.ec2.internal"]
Aug 05 17:12:46.096908 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:46.096830    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 17:12:46.097838 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:46.097821    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-128.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 17:12:46.097914 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:46.097853    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-128.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 17:12:46.097914 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:46.097864    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-128.ec2.internal" event="NodeHasSufficientPID"
Aug 05 17:12:46.099225 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:46.099211    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 17:12:46.099363 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:46.099347    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-128.ec2.internal"
Aug 05 17:12:46.099422 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:46.099387    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 17:12:46.100001 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:46.099984    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-128.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 17:12:46.100071 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:46.100016    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-128.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 17:12:46.100071 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:46.100030    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-128.ec2.internal" event="NodeHasSufficientPID"
Aug 05 17:12:46.100071 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:46.100035    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-128.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 17:12:46.100071 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:46.100062    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-128.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 17:12:46.100244 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:46.100075    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-128.ec2.internal" event="NodeHasSufficientPID"
Aug 05 17:12:46.101333 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:46.101313    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-128.ec2.internal"
Aug 05 17:12:46.101416 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:46.101339    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 17:12:46.102029 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:46.102012    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-128.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 17:12:46.102111 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:46.102046    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-128.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 17:12:46.102111 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:46.102060    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-128.ec2.internal" event="NodeHasSufficientPID"
Aug 05 17:12:46.130619 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:46.130588    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-128.ec2.internal\" not found" node="ip-10-0-131-128.ec2.internal"
Aug 05 17:12:46.135240 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:46.135220    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-128.ec2.internal\" not found" node="ip-10-0-131-128.ec2.internal"
Aug 05 17:12:46.140272 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:46.140248    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-128.ec2.internal\" not found"
Aug 05 17:12:46.159341 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:46.159305    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e1b83dd9bca61494c59a13c639d8ff7b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-128.ec2.internal\" (UID: \"e1b83dd9bca61494c59a13c639d8ff7b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-128.ec2.internal"
Aug 05 17:12:46.159341 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:46.159342    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1b83dd9bca61494c59a13c639d8ff7b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-128.ec2.internal\" (UID: \"e1b83dd9bca61494c59a13c639d8ff7b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-128.ec2.internal"
Aug 05 17:12:46.159537 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:46.159363    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2906d83a7da9fad32f85769014ae2ba9-config\") pod \"kube-apiserver-proxy-ip-10-0-131-128.ec2.internal\" (UID: \"2906d83a7da9fad32f85769014ae2ba9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-128.ec2.internal"
Aug 05 17:12:46.241385 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:46.241292    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-128.ec2.internal\" not found"
Aug 05 17:12:46.259732 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:46.259701    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e1b83dd9bca61494c59a13c639d8ff7b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-128.ec2.internal\" (UID: \"e1b83dd9bca61494c59a13c639d8ff7b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-128.ec2.internal"
Aug 05 17:12:46.259839 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:46.259735    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1b83dd9bca61494c59a13c639d8ff7b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-128.ec2.internal\" (UID: \"e1b83dd9bca61494c59a13c639d8ff7b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-128.ec2.internal"
Aug 05 17:12:46.259839 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:46.259758    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2906d83a7da9fad32f85769014ae2ba9-config\") pod \"kube-apiserver-proxy-ip-10-0-131-128.ec2.internal\" (UID: \"2906d83a7da9fad32f85769014ae2ba9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-128.ec2.internal"
Aug 05 17:12:46.259839 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:46.259790    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e1b83dd9bca61494c59a13c639d8ff7b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-128.ec2.internal\" (UID: \"e1b83dd9bca61494c59a13c639d8ff7b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-128.ec2.internal"
Aug 05 17:12:46.259839 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:46.259815    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1b83dd9bca61494c59a13c639d8ff7b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-128.ec2.internal\" (UID: \"e1b83dd9bca61494c59a13c639d8ff7b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-128.ec2.internal"
Aug 05 17:12:46.260007 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:46.259790    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2906d83a7da9fad32f85769014ae2ba9-config\") pod \"kube-apiserver-proxy-ip-10-0-131-128.ec2.internal\" (UID: \"2906d83a7da9fad32f85769014ae2ba9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-128.ec2.internal"
Aug 05 17:12:46.341919 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:46.341866    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-128.ec2.internal\" not found"
Aug 05 17:12:46.434570 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:46.434504    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-128.ec2.internal"
Aug 05 17:12:46.439760 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:46.439353    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-128.ec2.internal"
Aug 05 17:12:46.442393 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:46.442370    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-128.ec2.internal\" not found"
Aug 05 17:12:46.543511 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:46.543469    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-128.ec2.internal\" not found"
Aug 05 17:12:46.624025 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:46.623991    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 17:12:46.644369 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:46.644317    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-128.ec2.internal\" not found"
Aug 05 17:12:46.697381 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:46.697345    2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Aug 05 17:12:46.697866 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:46.697509    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 05 17:12:46.697866 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:46.697577    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 05 17:12:46.744694 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:46.744647    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-128.ec2.internal\" not found"
Aug 05 17:12:46.772065 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:46.771973    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-08-04 17:07:46 +0000 UTC" deadline="2028-03-17 22:05:07.231085686 +0000 UTC"
Aug 05 17:12:46.772065 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:46.772007    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14164h52m20.459083623s"
Aug 05 17:12:46.846177 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:46.846133    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-128.ec2.internal\" not found"
Aug 05 17:12:46.946730 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:46.946695    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-128.ec2.internal\" not found"
Aug 05 17:12:46.960551 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:46.960518    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 17:12:47.018538 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:47.018500    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1b83dd9bca61494c59a13c639d8ff7b.slice/crio-2c99e618f333ddb4ffa7e381edc956fba4cf16f79df308b98c34a071b27a311a WatchSource:0}: Error finding container 2c99e618f333ddb4ffa7e381edc956fba4cf16f79df308b98c34a071b27a311a: Status 404 returned error can't find the container with id 2c99e618f333ddb4ffa7e381edc956fba4cf16f79df308b98c34a071b27a311a
Aug 05 17:12:47.023884 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.023866    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 17:12:47.047220 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:47.047165    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-128.ec2.internal\" not found"
Aug 05 17:12:47.149284 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:47.149228    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-128.ec2.internal\" not found"
Aug 05 17:12:47.225789 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.225761    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 17:12:47.232384 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:47.232348    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2906d83a7da9fad32f85769014ae2ba9.slice/crio-02cb624f01f566b72a773806301db0f6767607a94c1fd510b07dca965e449b9c WatchSource:0}: Error finding container 02cb624f01f566b72a773806301db0f6767607a94c1fd510b07dca965e449b9c: Status 404 returned error can't find the container with id 02cb624f01f566b72a773806301db0f6767607a94c1fd510b07dca965e449b9c
Aug 05 17:12:47.257054 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.257008    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-128.ec2.internal"
Aug 05 17:12:47.270142 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.270115    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 05 17:12:47.271194 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.271177    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-128.ec2.internal"
Aug 05 17:12:47.280014 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.279935    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 05 17:12:47.738546 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.738450    2580 apiserver.go:52] "Watching apiserver"
Aug 05 17:12:47.751159 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.751122    2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Aug 05 17:12:47.752116 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.751738    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv2br","openshift-cluster-node-tuning-operator/tuned-kzft4","openshift-dns/node-resolver-7wgm8","openshift-image-registry/node-ca-8gxfg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-128.ec2.internal","openshift-multus/multus-nws8z","openshift-multus/network-metrics-daemon-j48xm","kube-system/konnectivity-agent-8zp9w","kube-system/kube-apiserver-proxy-ip-10-0-131-128.ec2.internal","openshift-multus/multus-additional-cni-plugins-fg62p","openshift-network-diagnostics/network-check-target-fjb99","openshift-network-operator/iptables-alerter-pfqnr","openshift-ovn-kubernetes/ovnkube-node-q69wj","kube-system/global-pull-secret-syncer-8g5w9"]
Aug 05 17:12:47.754178 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.753749    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j48xm"
Aug 05 17:12:47.754178 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:47.753836    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j48xm" podUID="0746144f-9064-48d7-ad22-f33bbbc3c16e"
Aug 05 17:12:47.755512 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.755362    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjb99"
Aug 05 17:12:47.755512 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:47.755455    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjb99" podUID="eb450465-98ef-415c-b5a3-83c3ed6efb16"
Aug 05 17:12:47.760044 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.756640    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7wgm8"
Aug 05 17:12:47.760044 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.757187    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Aug 05 17:12:47.760044 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.758478    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8gxfg"
Aug 05 17:12:47.760044 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.759592    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Aug 05 17:12:47.760044 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.759690    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Aug 05 17:12:47.760044 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.759946    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g5w9"
Aug 05 17:12:47.760044 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.759967    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-kpwd7\""
Aug 05 17:12:47.760044 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:47.759990    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g5w9" podUID="8e53ac33-f7e0-491b-a0fa-3a08b3eb6175"
Aug 05 17:12:47.762658 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.760856    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Aug 05 17:12:47.762658 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.761162    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-flk8w\""
Aug 05 17:12:47.762658 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.761382    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Aug 05 17:12:47.762658 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.761709    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Aug 05 17:12:47.762658 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.761987    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.763521 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.763093    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8zp9w"
Aug 05 17:12:47.765924 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.765379    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.765924 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.765471    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Aug 05 17:12:47.765924 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.765489    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Aug 05 17:12:47.766130 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.765939    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mwcfr\""
Aug 05 17:12:47.766943 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.766334    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Aug 05 17:12:47.766943 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.766475    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Aug 05 17:12:47.766943 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.766701    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-56jxq\""
Aug 05 17:12:47.766943 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.766825    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Aug 05 17:12:47.767207 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.767109    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kzft4"
Aug 05 17:12:47.767731 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.767549    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Aug 05 17:12:47.768733 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.768710    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Aug 05 17:12:47.768948 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.768929    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Aug 05 17:12:47.769302 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.769281    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Aug 05 17:12:47.769496 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.769479    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fg62p"
Aug 05 17:12:47.769567 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.769497    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-r6cl4\""
Aug 05 17:12:47.769727 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.769706    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Aug 05 17:12:47.769950 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.769933    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Aug 05 17:12:47.770009 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.769960    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Aug 05 17:12:47.770128 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.770093    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx8zq\" (UniqueName: \"kubernetes.io/projected/0746144f-9064-48d7-ad22-f33bbbc3c16e-kube-api-access-tx8zq\") pod \"network-metrics-daemon-j48xm\" (UID: \"0746144f-9064-48d7-ad22-f33bbbc3c16e\") " pod="openshift-multus/network-metrics-daemon-j48xm"
Aug 05 17:12:47.770192 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.770128    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbtr8\" (UniqueName: \"kubernetes.io/projected/f4349f2f-ccd4-43c7-bee0-2bb29268387c-kube-api-access-nbtr8\") pod \"node-resolver-7wgm8\" (UID: \"f4349f2f-ccd4-43c7-bee0-2bb29268387c\") " pod="openshift-dns/node-resolver-7wgm8"
Aug 05 17:12:47.770192 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.770157    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4bf26f2b-19d6-42f0-81db-423f51c7982e-host\") pod \"node-ca-8gxfg\" (UID: \"4bf26f2b-19d6-42f0-81db-423f51c7982e\") " pod="openshift-image-registry/node-ca-8gxfg"
Aug 05 17:12:47.770192 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.770183    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4bf26f2b-19d6-42f0-81db-423f51c7982e-serviceca\") pod \"node-ca-8gxfg\" (UID: \"4bf26f2b-19d6-42f0-81db-423f51c7982e\") " pod="openshift-image-registry/node-ca-8gxfg"
Aug 05 17:12:47.770349 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.770211    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e53ac33-f7e0-491b-a0fa-3a08b3eb6175-original-pull-secret\") pod \"global-pull-secret-syncer-8g5w9\" (UID: \"8e53ac33-f7e0-491b-a0fa-3a08b3eb6175\") " pod="kube-system/global-pull-secret-syncer-8g5w9"
Aug 05 17:12:47.770349 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.770240    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv2br"
Aug 05 17:12:47.770349 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.770271    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p87cb\" (UniqueName: \"kubernetes.io/projected/4bf26f2b-19d6-42f0-81db-423f51c7982e-kube-api-access-p87cb\") pod \"node-ca-8gxfg\" (UID: \"4bf26f2b-19d6-42f0-81db-423f51c7982e\") " pod="openshift-image-registry/node-ca-8gxfg"
Aug 05 17:12:47.770349 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.770306    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr4fg\" (UniqueName: \"kubernetes.io/projected/eb450465-98ef-415c-b5a3-83c3ed6efb16-kube-api-access-vr4fg\") pod \"network-check-target-fjb99\" (UID: \"eb450465-98ef-415c-b5a3-83c3ed6efb16\") " pod="openshift-network-diagnostics/network-check-target-fjb99"
Aug 05 17:12:47.770349 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.770334    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f4349f2f-ccd4-43c7-bee0-2bb29268387c-hosts-file\") pod \"node-resolver-7wgm8\" (UID: \"f4349f2f-ccd4-43c7-bee0-2bb29268387c\") " pod="openshift-dns/node-resolver-7wgm8"
Aug 05 17:12:47.770608 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.770374    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8e53ac33-f7e0-491b-a0fa-3a08b3eb6175-dbus\") pod \"global-pull-secret-syncer-8g5w9\" (UID: \"8e53ac33-f7e0-491b-a0fa-3a08b3eb6175\") " pod="kube-system/global-pull-secret-syncer-8g5w9"
Aug 05 17:12:47.770608 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.770400    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0746144f-9064-48d7-ad22-f33bbbc3c16e-metrics-certs\") pod \"network-metrics-daemon-j48xm\" (UID: \"0746144f-9064-48d7-ad22-f33bbbc3c16e\") " pod="openshift-multus/network-metrics-daemon-j48xm"
Aug 05 17:12:47.770608 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.770437    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4349f2f-ccd4-43c7-bee0-2bb29268387c-tmp-dir\") pod \"node-resolver-7wgm8\" (UID: \"f4349f2f-ccd4-43c7-bee0-2bb29268387c\") " pod="openshift-dns/node-resolver-7wgm8"
Aug 05 17:12:47.770608 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.770464    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8e53ac33-f7e0-491b-a0fa-3a08b3eb6175-kubelet-config\") pod \"global-pull-secret-syncer-8g5w9\" (UID: \"8e53ac33-f7e0-491b-a0fa-3a08b3eb6175\") " pod="kube-system/global-pull-secret-syncer-8g5w9"
Aug 05 17:12:47.771391 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.771375    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pfqnr"
Aug 05 17:12:47.775122 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.775098    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Aug 05 17:12:47.775339 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.775316    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Aug 05 17:12:47.775482 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.775445    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-f4f2n\""
Aug 05 17:12:47.776068 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.776048    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cq9tv\""
Aug 05 17:12:47.776295 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.776276    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Aug 05 17:12:47.776771 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.776735    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Aug 05 17:12:47.777287 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.777125    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Aug 05 17:12:47.777287 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.777136    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hphct\""
Aug 05 17:12:47.777287 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.777144    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Aug 05 17:12:47.777563 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.777449    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-84msk\""
Aug 05 17:12:47.777894 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.777877    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Aug 05 17:12:47.778220 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.778201    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Aug 05 17:12:47.779833 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.779813    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Aug 05 17:12:47.781452 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.781192    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 05 17:12:47.783031 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.782545    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Aug 05 17:12:47.830489 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.830463    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rnzpp"
Aug 05 17:12:47.840077 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.840053    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rnzpp"
Aug 05 17:12:47.858542 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.858503    2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Aug 05 17:12:47.871589 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.871511    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4bf26f2b-19d6-42f0-81db-423f51c7982e-serviceca\") pod \"node-ca-8gxfg\" (UID: \"4bf26f2b-19d6-42f0-81db-423f51c7982e\") " pod="openshift-image-registry/node-ca-8gxfg"
Aug 05 17:12:47.871744 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.871610    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e53ac33-f7e0-491b-a0fa-3a08b3eb6175-original-pull-secret\") pod \"global-pull-secret-syncer-8g5w9\" (UID: \"8e53ac33-f7e0-491b-a0fa-3a08b3eb6175\") " pod="kube-system/global-pull-secret-syncer-8g5w9"
Aug 05 17:12:47.871744 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.871651    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d8e22937-0209-4cf9-b262-dacb99128703-host-slash\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.871744 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.871677    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d8e22937-0209-4cf9-b262-dacb99128703-run-ovn\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.871744 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.871702    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hffct\" (UniqueName: \"kubernetes.io/projected/d8e22937-0209-4cf9-b262-dacb99128703-kube-api-access-hffct\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.871744 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.871726    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/feca036a-6aec-43c5-a206-81bd86431621-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vv2br\" (UID: \"feca036a-6aec-43c5-a206-81bd86431621\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv2br"
Aug 05 17:12:47.871973 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.871760    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr4fg\" (UniqueName: \"kubernetes.io/projected/eb450465-98ef-415c-b5a3-83c3ed6efb16-kube-api-access-vr4fg\") pod \"network-check-target-fjb99\" (UID: \"eb450465-98ef-415c-b5a3-83c3ed6efb16\") " pod="openshift-network-diagnostics/network-check-target-fjb99"
Aug 05 17:12:47.871973 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.871784    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d8e22937-0209-4cf9-b262-dacb99128703-node-log\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.871973 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.871809    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/feca036a-6aec-43c5-a206-81bd86431621-socket-dir\") pod \"aws-ebs-csi-driver-node-vv2br\" (UID: \"feca036a-6aec-43c5-a206-81bd86431621\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv2br"
Aug 05 17:12:47.871973 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.871835    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-host-run-k8s-cni-cncf-io\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.871973 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.871859    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-multus-daemon-config\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.871973 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.871904    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f0132161-af65-49eb-8335-197fe57259b2-konnectivity-ca\") pod \"konnectivity-agent-8zp9w\" (UID: \"f0132161-af65-49eb-8335-197fe57259b2\") " pod="kube-system/konnectivity-agent-8zp9w"
Aug 05 17:12:47.871973 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.871932    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f4349f2f-ccd4-43c7-bee0-2bb29268387c-hosts-file\") pod \"node-resolver-7wgm8\" (UID: \"f4349f2f-ccd4-43c7-bee0-2bb29268387c\") " pod="openshift-dns/node-resolver-7wgm8"
Aug 05 17:12:47.871973 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.871962    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-742lr\" (UniqueName: \"kubernetes.io/projected/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-kube-api-access-742lr\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.872244 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.871990    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8e53ac33-f7e0-491b-a0fa-3a08b3eb6175-kubelet-config\") pod \"global-pull-secret-syncer-8g5w9\" (UID: \"8e53ac33-f7e0-491b-a0fa-3a08b3eb6175\") " pod="kube-system/global-pull-secret-syncer-8g5w9"
Aug 05 17:12:47.872244 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.872042    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8e22937-0209-4cf9-b262-dacb99128703-run-openvswitch\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.872244 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.872070    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d8e22937-0209-4cf9-b262-dacb99128703-ovnkube-script-lib\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.872244 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.872100    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/feca036a-6aec-43c5-a206-81bd86431621-device-dir\") pod \"aws-ebs-csi-driver-node-vv2br\" (UID: \"feca036a-6aec-43c5-a206-81bd86431621\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv2br"
Aug 05 17:12:47.872244 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.872125    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-host-run-netns\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.872244 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.872147    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3ae8f50f-82eb-4c86-9ea5-6fe09014fa90-cnibin\") pod \"multus-additional-cni-plugins-fg62p\" (UID: \"3ae8f50f-82eb-4c86-9ea5-6fe09014fa90\") " pod="openshift-multus/multus-additional-cni-plugins-fg62p"
Aug 05 17:12:47.872244 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.872166    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc9nc\" (UniqueName: \"kubernetes.io/projected/14800fd4-965e-422e-b8dd-8faf2116ac06-kube-api-access-xc9nc\") pod \"iptables-alerter-pfqnr\" (UID: \"14800fd4-965e-422e-b8dd-8faf2116ac06\") " pod="openshift-network-operator/iptables-alerter-pfqnr"
Aug 05 17:12:47.872244 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.872181    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8e22937-0209-4cf9-b262-dacb99128703-host-kubelet\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.872244 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.872198    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8e22937-0209-4cf9-b262-dacb99128703-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.872244 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.872219    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/89d1e5e7-5f6f-45c2-af1f-cccac035bb74-host\") pod \"tuned-kzft4\" (UID: \"89d1e5e7-5f6f-45c2-af1f-cccac035bb74\") " pod="openshift-cluster-node-tuning-operator/tuned-kzft4"
Aug 05 17:12:47.872244 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.872247    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89d1e5e7-5f6f-45c2-af1f-cccac035bb74-tmp\") pod \"tuned-kzft4\" (UID: \"89d1e5e7-5f6f-45c2-af1f-cccac035bb74\") " pod="openshift-cluster-node-tuning-operator/tuned-kzft4"
Aug 05 17:12:47.872734 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.872272    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-multus-cni-dir\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.872734 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.872296    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3ae8f50f-82eb-4c86-9ea5-6fe09014fa90-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fg62p\" (UID: \"3ae8f50f-82eb-4c86-9ea5-6fe09014fa90\") " pod="openshift-multus/multus-additional-cni-plugins-fg62p"
Aug 05 17:12:47.872734 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.872323    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p87cb\" (UniqueName: \"kubernetes.io/projected/4bf26f2b-19d6-42f0-81db-423f51c7982e-kube-api-access-p87cb\") pod \"node-ca-8gxfg\" (UID: \"4bf26f2b-19d6-42f0-81db-423f51c7982e\") " pod="openshift-image-registry/node-ca-8gxfg"
Aug 05 17:12:47.872734 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.872346    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8e22937-0209-4cf9-b262-dacb99128703-etc-openvswitch\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.872734 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.872376    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/feca036a-6aec-43c5-a206-81bd86431621-registration-dir\") pod \"aws-ebs-csi-driver-node-vv2br\" (UID: \"feca036a-6aec-43c5-a206-81bd86431621\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv2br"
Aug 05 17:12:47.872734 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.872398    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3ae8f50f-82eb-4c86-9ea5-6fe09014fa90-cni-binary-copy\") pod \"multus-additional-cni-plugins-fg62p\" (UID: \"3ae8f50f-82eb-4c86-9ea5-6fe09014fa90\") " pod="openshift-multus/multus-additional-cni-plugins-fg62p"
Aug 05 17:12:47.872734 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.872413    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8e53ac33-f7e0-491b-a0fa-3a08b3eb6175-dbus\") pod \"global-pull-secret-syncer-8g5w9\" (UID: \"8e53ac33-f7e0-491b-a0fa-3a08b3eb6175\") " pod="kube-system/global-pull-secret-syncer-8g5w9"
Aug 05 17:12:47.872734 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.872439    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/89d1e5e7-5f6f-45c2-af1f-cccac035bb74-etc-kubernetes\") pod \"tuned-kzft4\" (UID: \"89d1e5e7-5f6f-45c2-af1f-cccac035bb74\") " pod="openshift-cluster-node-tuning-operator/tuned-kzft4"
Aug 05 17:12:47.872734 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.872462    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/89d1e5e7-5f6f-45c2-af1f-cccac035bb74-etc-systemd\") pod \"tuned-kzft4\" (UID: \"89d1e5e7-5f6f-45c2-af1f-cccac035bb74\") " pod="openshift-cluster-node-tuning-operator/tuned-kzft4"
Aug 05 17:12:47.872734 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.872488    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f0132161-af65-49eb-8335-197fe57259b2-agent-certs\") pod \"konnectivity-agent-8zp9w\" (UID: \"f0132161-af65-49eb-8335-197fe57259b2\") " pod="kube-system/konnectivity-agent-8zp9w"
Aug 05 17:12:47.872734 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.872504    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8e22937-0209-4cf9-b262-dacb99128703-var-lib-openvswitch\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.872734 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.872520    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8e22937-0209-4cf9-b262-dacb99128703-host-cni-bin\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.872734 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.872535    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d8e22937-0209-4cf9-b262-dacb99128703-ovnkube-config\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.872734 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.872557    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/89d1e5e7-5f6f-45c2-af1f-cccac035bb74-etc-sysconfig\") pod \"tuned-kzft4\" (UID: \"89d1e5e7-5f6f-45c2-af1f-cccac035bb74\") " pod="openshift-cluster-node-tuning-operator/tuned-kzft4"
Aug 05 17:12:47.872734 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.872583    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/89d1e5e7-5f6f-45c2-af1f-cccac035bb74-etc-sysctl-d\") pod \"tuned-kzft4\" (UID: \"89d1e5e7-5f6f-45c2-af1f-cccac035bb74\") " pod="openshift-cluster-node-tuning-operator/tuned-kzft4"
Aug 05 17:12:47.872734 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.872609    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-host-var-lib-cni-multus\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.873497 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.872653    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3ae8f50f-82eb-4c86-9ea5-6fe09014fa90-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fg62p\" (UID: \"3ae8f50f-82eb-4c86-9ea5-6fe09014fa90\") " pod="openshift-multus/multus-additional-cni-plugins-fg62p"
Aug 05 17:12:47.873497 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.872674    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d8e22937-0209-4cf9-b262-dacb99128703-systemd-units\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.873497 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.872689    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d8e22937-0209-4cf9-b262-dacb99128703-run-systemd\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.873497 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.872706    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d8e22937-0209-4cf9-b262-dacb99128703-env-overrides\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.873497 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.872734    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-multus-conf-dir\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.873497 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.872754    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-host-run-multus-certs\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.873497 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.872777    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkm66\" (UniqueName: \"kubernetes.io/projected/89d1e5e7-5f6f-45c2-af1f-cccac035bb74-kube-api-access-lkm66\") pod \"tuned-kzft4\" (UID: \"89d1e5e7-5f6f-45c2-af1f-cccac035bb74\") " pod="openshift-cluster-node-tuning-operator/tuned-kzft4"
Aug 05 17:12:47.873497 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.872803    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d8e22937-0209-4cf9-b262-dacb99128703-ovn-node-metrics-cert\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.873497 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.872828    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/89d1e5e7-5f6f-45c2-af1f-cccac035bb74-etc-modprobe-d\") pod \"tuned-kzft4\" (UID: \"89d1e5e7-5f6f-45c2-af1f-cccac035bb74\") " pod="openshift-cluster-node-tuning-operator/tuned-kzft4"
Aug 05 17:12:47.873497 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.872848    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/89d1e5e7-5f6f-45c2-af1f-cccac035bb74-run\") pod \"tuned-kzft4\" (UID: \"89d1e5e7-5f6f-45c2-af1f-cccac035bb74\") " pod="openshift-cluster-node-tuning-operator/tuned-kzft4"
Aug 05 17:12:47.873497 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.872865    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phf4m\" (UniqueName: \"kubernetes.io/projected/feca036a-6aec-43c5-a206-81bd86431621-kube-api-access-phf4m\") pod \"aws-ebs-csi-driver-node-vv2br\" (UID: \"feca036a-6aec-43c5-a206-81bd86431621\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv2br"
Aug 05 17:12:47.873497 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.872892    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-os-release\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.873497 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.872917    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-multus-socket-dir-parent\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.873497 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.872943    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-host-var-lib-kubelet\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.873497 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.872961    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-hostroot\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.873497 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.872987    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d8e22937-0209-4cf9-b262-dacb99128703-host-cni-netd\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.874135 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.873021    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/89d1e5e7-5f6f-45c2-af1f-cccac035bb74-lib-modules\") pod \"tuned-kzft4\" (UID: \"89d1e5e7-5f6f-45c2-af1f-cccac035bb74\") " pod="openshift-cluster-node-tuning-operator/tuned-kzft4"
Aug 05 17:12:47.874135 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.873046    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/feca036a-6aec-43c5-a206-81bd86431621-sys-fs\") pod \"aws-ebs-csi-driver-node-vv2br\" (UID: \"feca036a-6aec-43c5-a206-81bd86431621\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv2br"
Aug 05 17:12:47.874135 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.873073    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3ae8f50f-82eb-4c86-9ea5-6fe09014fa90-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fg62p\" (UID: \"3ae8f50f-82eb-4c86-9ea5-6fe09014fa90\") " pod="openshift-multus/multus-additional-cni-plugins-fg62p"
Aug 05 17:12:47.874135 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.873091    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/14800fd4-965e-422e-b8dd-8faf2116ac06-host-slash\") pod \"iptables-alerter-pfqnr\" (UID: \"14800fd4-965e-422e-b8dd-8faf2116ac06\") " pod="openshift-network-operator/iptables-alerter-pfqnr"
Aug 05 17:12:47.874135 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.873107    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d8e22937-0209-4cf9-b262-dacb99128703-log-socket\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.874135 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.873123    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/89d1e5e7-5f6f-45c2-af1f-cccac035bb74-etc-tuned\") pod \"tuned-kzft4\" (UID: \"89d1e5e7-5f6f-45c2-af1f-cccac035bb74\") " pod="openshift-cluster-node-tuning-operator/tuned-kzft4"
Aug 05 17:12:47.874135 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.873150    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-cnibin\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.874135 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.873179    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-host-var-lib-cni-bin\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.874135 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.873206    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ae8f50f-82eb-4c86-9ea5-6fe09014fa90-system-cni-dir\") pod \"multus-additional-cni-plugins-fg62p\" (UID: \"3ae8f50f-82eb-4c86-9ea5-6fe09014fa90\") " pod="openshift-multus/multus-additional-cni-plugins-fg62p"
Aug 05 17:12:47.874135 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.873232    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/89d1e5e7-5f6f-45c2-af1f-cccac035bb74-etc-sysctl-conf\") pod \"tuned-kzft4\" (UID: \"89d1e5e7-5f6f-45c2-af1f-cccac035bb74\") " pod="openshift-cluster-node-tuning-operator/tuned-kzft4"
Aug 05 17:12:47.874135 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.873254    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/89d1e5e7-5f6f-45c2-af1f-cccac035bb74-var-lib-kubelet\") pod \"tuned-kzft4\" (UID: \"89d1e5e7-5f6f-45c2-af1f-cccac035bb74\") " pod="openshift-cluster-node-tuning-operator/tuned-kzft4"
Aug 05 17:12:47.874135 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.873276    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3ae8f50f-82eb-4c86-9ea5-6fe09014fa90-os-release\") pod \"multus-additional-cni-plugins-fg62p\" (UID: \"3ae8f50f-82eb-4c86-9ea5-6fe09014fa90\") " pod="openshift-multus/multus-additional-cni-plugins-fg62p"
Aug 05 17:12:47.874135 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.873297    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/14800fd4-965e-422e-b8dd-8faf2116ac06-iptables-alerter-script\") pod \"iptables-alerter-pfqnr\" (UID: \"14800fd4-965e-422e-b8dd-8faf2116ac06\") " pod="openshift-network-operator/iptables-alerter-pfqnr"
Aug 05 17:12:47.874135 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.873333    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0746144f-9064-48d7-ad22-f33bbbc3c16e-metrics-certs\") pod \"network-metrics-daemon-j48xm\" (UID: \"0746144f-9064-48d7-ad22-f33bbbc3c16e\") " pod="openshift-multus/network-metrics-daemon-j48xm"
Aug 05 17:12:47.874135 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.873360    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-cni-binary-copy\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.874135 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.873389    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-etc-kubernetes\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.874808 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.873427    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fpw9\" (UniqueName: \"kubernetes.io/projected/3ae8f50f-82eb-4c86-9ea5-6fe09014fa90-kube-api-access-7fpw9\") pod \"multus-additional-cni-plugins-fg62p\" (UID: \"3ae8f50f-82eb-4c86-9ea5-6fe09014fa90\") " pod="openshift-multus/multus-additional-cni-plugins-fg62p"
Aug 05 17:12:47.874808 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.873459    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4349f2f-ccd4-43c7-bee0-2bb29268387c-tmp-dir\") pod \"node-resolver-7wgm8\" (UID: \"f4349f2f-ccd4-43c7-bee0-2bb29268387c\") " pod="openshift-dns/node-resolver-7wgm8"
Aug 05 17:12:47.874808 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.873487    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx8zq\" (UniqueName: \"kubernetes.io/projected/0746144f-9064-48d7-ad22-f33bbbc3c16e-kube-api-access-tx8zq\") pod \"network-metrics-daemon-j48xm\" (UID: \"0746144f-9064-48d7-ad22-f33bbbc3c16e\") " pod="openshift-multus/network-metrics-daemon-j48xm"
Aug 05 17:12:47.874808 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.873514    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8e22937-0209-4cf9-b262-dacb99128703-host-run-netns\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.874808 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.873544    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8e22937-0209-4cf9-b262-dacb99128703-host-run-ovn-kubernetes\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.874808 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.873577    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89d1e5e7-5f6f-45c2-af1f-cccac035bb74-sys\") pod \"tuned-kzft4\" (UID: \"89d1e5e7-5f6f-45c2-af1f-cccac035bb74\") " pod="openshift-cluster-node-tuning-operator/tuned-kzft4"
Aug 05 17:12:47.874808 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.873605    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/feca036a-6aec-43c5-a206-81bd86431621-etc-selinux\") pod \"aws-ebs-csi-driver-node-vv2br\" (UID: \"feca036a-6aec-43c5-a206-81bd86431621\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv2br"
Aug 05 17:12:47.874808 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.873673    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-system-cni-dir\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.874808 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.873706    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbtr8\" (UniqueName: \"kubernetes.io/projected/f4349f2f-ccd4-43c7-bee0-2bb29268387c-kube-api-access-nbtr8\") pod \"node-resolver-7wgm8\" (UID: \"f4349f2f-ccd4-43c7-bee0-2bb29268387c\") " pod="openshift-dns/node-resolver-7wgm8"
Aug 05 17:12:47.874808 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.873740    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4bf26f2b-19d6-42f0-81db-423f51c7982e-host\") pod \"node-ca-8gxfg\" (UID: \"4bf26f2b-19d6-42f0-81db-423f51c7982e\") " pod="openshift-image-registry/node-ca-8gxfg"
Aug 05 17:12:47.874808 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.873814    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4bf26f2b-19d6-42f0-81db-423f51c7982e-host\") pod \"node-ca-8gxfg\" (UID: \"4bf26f2b-19d6-42f0-81db-423f51c7982e\") " pod="openshift-image-registry/node-ca-8gxfg"
Aug 05 17:12:47.874808 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.874362    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4bf26f2b-19d6-42f0-81db-423f51c7982e-serviceca\") pod \"node-ca-8gxfg\" (UID: \"4bf26f2b-19d6-42f0-81db-423f51c7982e\") " pod="openshift-image-registry/node-ca-8gxfg"
Aug 05 17:12:47.874808 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:47.874508    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 17:12:47.874808 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:47.874586    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e53ac33-f7e0-491b-a0fa-3a08b3eb6175-original-pull-secret podName:8e53ac33-f7e0-491b-a0fa-3a08b3eb6175 nodeName:}" failed. No retries permitted until 2026-08-05 17:12:48.374563392 +0000 UTC m=+2.943065796 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e53ac33-f7e0-491b-a0fa-3a08b3eb6175-original-pull-secret") pod "global-pull-secret-syncer-8g5w9" (UID: "8e53ac33-f7e0-491b-a0fa-3a08b3eb6175") : object "kube-system"/"original-pull-secret" not registered
Aug 05 17:12:47.875498 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.874778    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f4349f2f-ccd4-43c7-bee0-2bb29268387c-hosts-file\") pod \"node-resolver-7wgm8\" (UID: \"f4349f2f-ccd4-43c7-bee0-2bb29268387c\") " pod="openshift-dns/node-resolver-7wgm8"
Aug 05 17:12:47.875498 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.874851    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8e53ac33-f7e0-491b-a0fa-3a08b3eb6175-kubelet-config\") pod \"global-pull-secret-syncer-8g5w9\" (UID: \"8e53ac33-f7e0-491b-a0fa-3a08b3eb6175\") " pod="kube-system/global-pull-secret-syncer-8g5w9"
Aug 05 17:12:47.875498 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.874928    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8e53ac33-f7e0-491b-a0fa-3a08b3eb6175-dbus\") pod \"global-pull-secret-syncer-8g5w9\" (UID: \"8e53ac33-f7e0-491b-a0fa-3a08b3eb6175\") " pod="kube-system/global-pull-secret-syncer-8g5w9"
Aug 05 17:12:47.875498 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:47.875147    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 17:12:47.875498 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:47.875202    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0746144f-9064-48d7-ad22-f33bbbc3c16e-metrics-certs podName:0746144f-9064-48d7-ad22-f33bbbc3c16e nodeName:}" failed. No retries permitted until 2026-08-05 17:12:48.375187119 +0000 UTC m=+2.943689522 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0746144f-9064-48d7-ad22-f33bbbc3c16e-metrics-certs") pod "network-metrics-daemon-j48xm" (UID: "0746144f-9064-48d7-ad22-f33bbbc3c16e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 17:12:47.875498 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.875438    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4349f2f-ccd4-43c7-bee0-2bb29268387c-tmp-dir\") pod \"node-resolver-7wgm8\" (UID: \"f4349f2f-ccd4-43c7-bee0-2bb29268387c\") " pod="openshift-dns/node-resolver-7wgm8"
Aug 05 17:12:47.893669 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.893631    2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Aug 05 17:12:47.895642 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:47.895600    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 17:12:47.898744 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:47.895646    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 17:12:47.898744 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:47.895665    2580 projected.go:196] Error preparing data for projected volume kube-api-access-vr4fg for pod openshift-network-diagnostics/network-check-target-fjb99: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 17:12:47.898744 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:47.895747    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb450465-98ef-415c-b5a3-83c3ed6efb16-kube-api-access-vr4fg podName:eb450465-98ef-415c-b5a3-83c3ed6efb16 nodeName:}" failed. No retries permitted until 2026-08-05 17:12:48.395725315 +0000 UTC m=+2.964227747 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vr4fg" (UniqueName: "kubernetes.io/projected/eb450465-98ef-415c-b5a3-83c3ed6efb16-kube-api-access-vr4fg") pod "network-check-target-fjb99" (UID: "eb450465-98ef-415c-b5a3-83c3ed6efb16") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 17:12:47.898744 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.898325    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbtr8\" (UniqueName: \"kubernetes.io/projected/f4349f2f-ccd4-43c7-bee0-2bb29268387c-kube-api-access-nbtr8\") pod \"node-resolver-7wgm8\" (UID: \"f4349f2f-ccd4-43c7-bee0-2bb29268387c\") " pod="openshift-dns/node-resolver-7wgm8"
Aug 05 17:12:47.899786 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.899750    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p87cb\" (UniqueName: \"kubernetes.io/projected/4bf26f2b-19d6-42f0-81db-423f51c7982e-kube-api-access-p87cb\") pod \"node-ca-8gxfg\" (UID: \"4bf26f2b-19d6-42f0-81db-423f51c7982e\") " pod="openshift-image-registry/node-ca-8gxfg"
Aug 05 17:12:47.901584 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.901553    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx8zq\" (UniqueName: \"kubernetes.io/projected/0746144f-9064-48d7-ad22-f33bbbc3c16e-kube-api-access-tx8zq\") pod \"network-metrics-daemon-j48xm\" (UID: \"0746144f-9064-48d7-ad22-f33bbbc3c16e\") " pod="openshift-multus/network-metrics-daemon-j48xm"
Aug 05 17:12:47.945803 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.945755    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 17:12:47.974774 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.974732    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8e22937-0209-4cf9-b262-dacb99128703-run-openvswitch\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.974974 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.974782    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d8e22937-0209-4cf9-b262-dacb99128703-ovnkube-script-lib\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.974974 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.974809    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/feca036a-6aec-43c5-a206-81bd86431621-device-dir\") pod \"aws-ebs-csi-driver-node-vv2br\" (UID: \"feca036a-6aec-43c5-a206-81bd86431621\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv2br"
Aug 05 17:12:47.974974 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.974834    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-host-run-netns\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.974974 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.974861    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3ae8f50f-82eb-4c86-9ea5-6fe09014fa90-cnibin\") pod \"multus-additional-cni-plugins-fg62p\" (UID: \"3ae8f50f-82eb-4c86-9ea5-6fe09014fa90\") " pod="openshift-multus/multus-additional-cni-plugins-fg62p"
Aug 05 17:12:47.974974 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.974890    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc9nc\" (UniqueName: \"kubernetes.io/projected/14800fd4-965e-422e-b8dd-8faf2116ac06-kube-api-access-xc9nc\") pod \"iptables-alerter-pfqnr\" (UID: \"14800fd4-965e-422e-b8dd-8faf2116ac06\") " pod="openshift-network-operator/iptables-alerter-pfqnr"
Aug 05 17:12:47.974974 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.974915    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8e22937-0209-4cf9-b262-dacb99128703-host-kubelet\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.974974 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.974940    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8e22937-0209-4cf9-b262-dacb99128703-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.974974 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.974966    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/89d1e5e7-5f6f-45c2-af1f-cccac035bb74-host\") pod \"tuned-kzft4\" (UID: \"89d1e5e7-5f6f-45c2-af1f-cccac035bb74\") " pod="openshift-cluster-node-tuning-operator/tuned-kzft4"
Aug 05 17:12:47.975402 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.974989    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89d1e5e7-5f6f-45c2-af1f-cccac035bb74-tmp\") pod \"tuned-kzft4\" (UID: \"89d1e5e7-5f6f-45c2-af1f-cccac035bb74\") " pod="openshift-cluster-node-tuning-operator/tuned-kzft4"
Aug 05 17:12:47.975402 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.975013    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-multus-cni-dir\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.975402 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.975041    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3ae8f50f-82eb-4c86-9ea5-6fe09014fa90-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fg62p\" (UID: \"3ae8f50f-82eb-4c86-9ea5-6fe09014fa90\") " pod="openshift-multus/multus-additional-cni-plugins-fg62p"
Aug 05 17:12:47.975402 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.975070    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8e22937-0209-4cf9-b262-dacb99128703-etc-openvswitch\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.975402 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.975094    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/feca036a-6aec-43c5-a206-81bd86431621-registration-dir\") pod \"aws-ebs-csi-driver-node-vv2br\" (UID: \"feca036a-6aec-43c5-a206-81bd86431621\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv2br"
Aug 05 17:12:47.975402 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.975120    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3ae8f50f-82eb-4c86-9ea5-6fe09014fa90-cni-binary-copy\") pod \"multus-additional-cni-plugins-fg62p\" (UID: \"3ae8f50f-82eb-4c86-9ea5-6fe09014fa90\") " pod="openshift-multus/multus-additional-cni-plugins-fg62p"
Aug 05 17:12:47.975402 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.975146    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/89d1e5e7-5f6f-45c2-af1f-cccac035bb74-etc-kubernetes\") pod \"tuned-kzft4\" (UID: \"89d1e5e7-5f6f-45c2-af1f-cccac035bb74\") " pod="openshift-cluster-node-tuning-operator/tuned-kzft4"
Aug 05 17:12:47.975402 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.975171    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/89d1e5e7-5f6f-45c2-af1f-cccac035bb74-etc-systemd\") pod \"tuned-kzft4\" (UID: \"89d1e5e7-5f6f-45c2-af1f-cccac035bb74\") " pod="openshift-cluster-node-tuning-operator/tuned-kzft4"
Aug 05 17:12:47.975402 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.975196    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f0132161-af65-49eb-8335-197fe57259b2-agent-certs\") pod \"konnectivity-agent-8zp9w\" (UID: \"f0132161-af65-49eb-8335-197fe57259b2\") " pod="kube-system/konnectivity-agent-8zp9w"
Aug 05 17:12:47.975402 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.975221    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8e22937-0209-4cf9-b262-dacb99128703-var-lib-openvswitch\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.975402 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.975245    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8e22937-0209-4cf9-b262-dacb99128703-host-cni-bin\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.975402 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.975269    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d8e22937-0209-4cf9-b262-dacb99128703-ovnkube-config\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.975402 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.975292    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/89d1e5e7-5f6f-45c2-af1f-cccac035bb74-etc-sysconfig\") pod \"tuned-kzft4\" (UID: \"89d1e5e7-5f6f-45c2-af1f-cccac035bb74\") " pod="openshift-cluster-node-tuning-operator/tuned-kzft4"
Aug 05 17:12:47.975402 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.975320    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/89d1e5e7-5f6f-45c2-af1f-cccac035bb74-etc-sysctl-d\") pod \"tuned-kzft4\" (UID: \"89d1e5e7-5f6f-45c2-af1f-cccac035bb74\") " pod="openshift-cluster-node-tuning-operator/tuned-kzft4"
Aug 05 17:12:47.975402 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.975348    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-host-var-lib-cni-multus\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.975402 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.975373    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3ae8f50f-82eb-4c86-9ea5-6fe09014fa90-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fg62p\" (UID: \"3ae8f50f-82eb-4c86-9ea5-6fe09014fa90\") " pod="openshift-multus/multus-additional-cni-plugins-fg62p"
Aug 05 17:12:47.975402 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.975400    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d8e22937-0209-4cf9-b262-dacb99128703-systemd-units\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.976285 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.975425    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d8e22937-0209-4cf9-b262-dacb99128703-run-systemd\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.976285 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.975451    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d8e22937-0209-4cf9-b262-dacb99128703-env-overrides\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.976285 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.975475    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-multus-conf-dir\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.976285 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.975503    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-host-run-multus-certs\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.976285 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.975530    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkm66\" (UniqueName: \"kubernetes.io/projected/89d1e5e7-5f6f-45c2-af1f-cccac035bb74-kube-api-access-lkm66\") pod \"tuned-kzft4\" (UID: \"89d1e5e7-5f6f-45c2-af1f-cccac035bb74\") " pod="openshift-cluster-node-tuning-operator/tuned-kzft4"
Aug 05 17:12:47.976285 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.975557    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d8e22937-0209-4cf9-b262-dacb99128703-ovn-node-metrics-cert\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.976285 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.975584    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/89d1e5e7-5f6f-45c2-af1f-cccac035bb74-etc-modprobe-d\") pod \"tuned-kzft4\" (UID: \"89d1e5e7-5f6f-45c2-af1f-cccac035bb74\") " pod="openshift-cluster-node-tuning-operator/tuned-kzft4"
Aug 05 17:12:47.976285 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.975611    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/89d1e5e7-5f6f-45c2-af1f-cccac035bb74-run\") pod \"tuned-kzft4\" (UID: \"89d1e5e7-5f6f-45c2-af1f-cccac035bb74\") " pod="openshift-cluster-node-tuning-operator/tuned-kzft4"
Aug 05 17:12:47.976285 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.975659    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phf4m\" (UniqueName: \"kubernetes.io/projected/feca036a-6aec-43c5-a206-81bd86431621-kube-api-access-phf4m\") pod \"aws-ebs-csi-driver-node-vv2br\" (UID: \"feca036a-6aec-43c5-a206-81bd86431621\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv2br"
Aug 05 17:12:47.976285 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.975687    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-os-release\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.976285 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.975712    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-multus-socket-dir-parent\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.976285 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.975738    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-host-var-lib-kubelet\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.976285 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.975762    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-hostroot\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.976285 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.975788    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d8e22937-0209-4cf9-b262-dacb99128703-host-cni-netd\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.976285 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.975814    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/89d1e5e7-5f6f-45c2-af1f-cccac035bb74-lib-modules\") pod \"tuned-kzft4\" (UID: \"89d1e5e7-5f6f-45c2-af1f-cccac035bb74\") " pod="openshift-cluster-node-tuning-operator/tuned-kzft4"
Aug 05 17:12:47.976285 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.975841    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/feca036a-6aec-43c5-a206-81bd86431621-sys-fs\") pod \"aws-ebs-csi-driver-node-vv2br\" (UID: \"feca036a-6aec-43c5-a206-81bd86431621\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv2br"
Aug 05 17:12:47.976285 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.975869    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3ae8f50f-82eb-4c86-9ea5-6fe09014fa90-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fg62p\" (UID: \"3ae8f50f-82eb-4c86-9ea5-6fe09014fa90\") " pod="openshift-multus/multus-additional-cni-plugins-fg62p"
Aug 05 17:12:47.977202 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.975897    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/14800fd4-965e-422e-b8dd-8faf2116ac06-host-slash\") pod \"iptables-alerter-pfqnr\" (UID: \"14800fd4-965e-422e-b8dd-8faf2116ac06\") " pod="openshift-network-operator/iptables-alerter-pfqnr"
Aug 05 17:12:47.977202 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.975923    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d8e22937-0209-4cf9-b262-dacb99128703-log-socket\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.977202 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.975944    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/89d1e5e7-5f6f-45c2-af1f-cccac035bb74-etc-tuned\") pod \"tuned-kzft4\" (UID: \"89d1e5e7-5f6f-45c2-af1f-cccac035bb74\") " pod="openshift-cluster-node-tuning-operator/tuned-kzft4"
Aug 05 17:12:47.977202 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.975961    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-cnibin\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.977202 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.975977    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-host-var-lib-cni-bin\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.977202 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.975995    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ae8f50f-82eb-4c86-9ea5-6fe09014fa90-system-cni-dir\") pod \"multus-additional-cni-plugins-fg62p\" (UID: \"3ae8f50f-82eb-4c86-9ea5-6fe09014fa90\") " pod="openshift-multus/multus-additional-cni-plugins-fg62p"
Aug 05 17:12:47.977202 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.976011    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/89d1e5e7-5f6f-45c2-af1f-cccac035bb74-etc-sysctl-conf\") pod \"tuned-kzft4\" (UID: \"89d1e5e7-5f6f-45c2-af1f-cccac035bb74\") " pod="openshift-cluster-node-tuning-operator/tuned-kzft4"
Aug 05 17:12:47.977202 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.976028    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/89d1e5e7-5f6f-45c2-af1f-cccac035bb74-var-lib-kubelet\") pod \"tuned-kzft4\" (UID: \"89d1e5e7-5f6f-45c2-af1f-cccac035bb74\") " pod="openshift-cluster-node-tuning-operator/tuned-kzft4"
Aug 05 17:12:47.977202 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.976046    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3ae8f50f-82eb-4c86-9ea5-6fe09014fa90-os-release\") pod \"multus-additional-cni-plugins-fg62p\" (UID: \"3ae8f50f-82eb-4c86-9ea5-6fe09014fa90\") " pod="openshift-multus/multus-additional-cni-plugins-fg62p"
Aug 05 17:12:47.977202 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.976063    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/14800fd4-965e-422e-b8dd-8faf2116ac06-iptables-alerter-script\") pod \"iptables-alerter-pfqnr\" (UID: \"14800fd4-965e-422e-b8dd-8faf2116ac06\") " pod="openshift-network-operator/iptables-alerter-pfqnr"
Aug 05 17:12:47.977202 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.976092    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-cni-binary-copy\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.977202 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.976107    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-etc-kubernetes\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.977202 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.976127    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fpw9\" (UniqueName: \"kubernetes.io/projected/3ae8f50f-82eb-4c86-9ea5-6fe09014fa90-kube-api-access-7fpw9\") pod \"multus-additional-cni-plugins-fg62p\" (UID: \"3ae8f50f-82eb-4c86-9ea5-6fe09014fa90\") " pod="openshift-multus/multus-additional-cni-plugins-fg62p"
Aug 05 17:12:47.977202 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.976151    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8e22937-0209-4cf9-b262-dacb99128703-host-run-netns\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.977202 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.976168    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8e22937-0209-4cf9-b262-dacb99128703-host-run-ovn-kubernetes\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.977202 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.976185    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89d1e5e7-5f6f-45c2-af1f-cccac035bb74-sys\") pod \"tuned-kzft4\" (UID: \"89d1e5e7-5f6f-45c2-af1f-cccac035bb74\") " pod="openshift-cluster-node-tuning-operator/tuned-kzft4"
Aug 05 17:12:47.977202 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.976213    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/feca036a-6aec-43c5-a206-81bd86431621-etc-selinux\") pod \"aws-ebs-csi-driver-node-vv2br\" (UID: \"feca036a-6aec-43c5-a206-81bd86431621\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv2br"
Aug 05 17:12:47.978083 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.976229    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-system-cni-dir\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.978083 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.976258    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d8e22937-0209-4cf9-b262-dacb99128703-host-slash\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.978083 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.976274    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d8e22937-0209-4cf9-b262-dacb99128703-run-ovn\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.978083 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.976290    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hffct\" (UniqueName: \"kubernetes.io/projected/d8e22937-0209-4cf9-b262-dacb99128703-kube-api-access-hffct\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.978083 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.976306    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/feca036a-6aec-43c5-a206-81bd86431621-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vv2br\" (UID: \"feca036a-6aec-43c5-a206-81bd86431621\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv2br"
Aug 05 17:12:47.978083 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.976331    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d8e22937-0209-4cf9-b262-dacb99128703-node-log\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.978083 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.976348    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/feca036a-6aec-43c5-a206-81bd86431621-socket-dir\") pod \"aws-ebs-csi-driver-node-vv2br\" (UID: \"feca036a-6aec-43c5-a206-81bd86431621\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv2br"
Aug 05 17:12:47.978083 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.976365    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-host-run-k8s-cni-cncf-io\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.978083 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.976387    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-multus-daemon-config\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.978083 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.976413    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f0132161-af65-49eb-8335-197fe57259b2-konnectivity-ca\") pod \"konnectivity-agent-8zp9w\" (UID: \"f0132161-af65-49eb-8335-197fe57259b2\") " pod="kube-system/konnectivity-agent-8zp9w"
Aug 05 17:12:47.978083 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.976439    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-742lr\" (UniqueName: \"kubernetes.io/projected/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-kube-api-access-742lr\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.978083 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.976826    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8e22937-0209-4cf9-b262-dacb99128703-run-openvswitch\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.978083 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.977663    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d8e22937-0209-4cf9-b262-dacb99128703-ovnkube-script-lib\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.978083 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.977747    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/feca036a-6aec-43c5-a206-81bd86431621-device-dir\") pod \"aws-ebs-csi-driver-node-vv2br\" (UID: \"feca036a-6aec-43c5-a206-81bd86431621\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv2br"
Aug 05 17:12:47.978083 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.977789    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-host-run-netns\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.978083 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.977827    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3ae8f50f-82eb-4c86-9ea5-6fe09014fa90-cnibin\") pod \"multus-additional-cni-plugins-fg62p\" (UID: \"3ae8f50f-82eb-4c86-9ea5-6fe09014fa90\") " pod="openshift-multus/multus-additional-cni-plugins-fg62p"
Aug 05 17:12:47.978083 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.978057    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8e22937-0209-4cf9-b262-dacb99128703-host-kubelet\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.978999 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.978086    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8e22937-0209-4cf9-b262-dacb99128703-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.978999 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.978133    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/89d1e5e7-5f6f-45c2-af1f-cccac035bb74-host\") pod \"tuned-kzft4\" (UID: \"89d1e5e7-5f6f-45c2-af1f-cccac035bb74\") " pod="openshift-cluster-node-tuning-operator/tuned-kzft4"
Aug 05 17:12:47.978999 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.978591    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d8e22937-0209-4cf9-b262-dacb99128703-host-cni-netd\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.978999 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.978677    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-multus-cni-dir\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.979227 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.979203    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3ae8f50f-82eb-4c86-9ea5-6fe09014fa90-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fg62p\" (UID: \"3ae8f50f-82eb-4c86-9ea5-6fe09014fa90\") " pod="openshift-multus/multus-additional-cni-plugins-fg62p"
Aug 05 17:12:47.979289 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.979272    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8e22937-0209-4cf9-b262-dacb99128703-etc-openvswitch\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.979350 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.979324    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/feca036a-6aec-43c5-a206-81bd86431621-registration-dir\") pod \"aws-ebs-csi-driver-node-vv2br\" (UID: \"feca036a-6aec-43c5-a206-81bd86431621\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv2br"
Aug 05 17:12:47.979818 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.979795    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3ae8f50f-82eb-4c86-9ea5-6fe09014fa90-cni-binary-copy\") pod \"multus-additional-cni-plugins-fg62p\" (UID: \"3ae8f50f-82eb-4c86-9ea5-6fe09014fa90\") " pod="openshift-multus/multus-additional-cni-plugins-fg62p"
Aug 05 17:12:47.979973 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.979871    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/89d1e5e7-5f6f-45c2-af1f-cccac035bb74-etc-kubernetes\") pod \"tuned-kzft4\" (UID: \"89d1e5e7-5f6f-45c2-af1f-cccac035bb74\") " pod="openshift-cluster-node-tuning-operator/tuned-kzft4"
Aug 05 17:12:47.979973 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.979924    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/89d1e5e7-5f6f-45c2-af1f-cccac035bb74-etc-systemd\") pod \"tuned-kzft4\" (UID: \"89d1e5e7-5f6f-45c2-af1f-cccac035bb74\") " pod="openshift-cluster-node-tuning-operator/tuned-kzft4"
Aug 05 17:12:47.985760 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.985720    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/89d1e5e7-5f6f-45c2-af1f-cccac035bb74-lib-modules\") pod \"tuned-kzft4\" (UID: \"89d1e5e7-5f6f-45c2-af1f-cccac035bb74\") " pod="openshift-cluster-node-tuning-operator/tuned-kzft4"
Aug 05 17:12:47.985898 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.985832    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/feca036a-6aec-43c5-a206-81bd86431621-sys-fs\") pod \"aws-ebs-csi-driver-node-vv2br\" (UID: \"feca036a-6aec-43c5-a206-81bd86431621\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv2br"
Aug 05 17:12:47.986050 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.985996    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3ae8f50f-82eb-4c86-9ea5-6fe09014fa90-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fg62p\" (UID: \"3ae8f50f-82eb-4c86-9ea5-6fe09014fa90\") " pod="openshift-multus/multus-additional-cni-plugins-fg62p"
Aug 05 17:12:47.986132 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.986057    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/14800fd4-965e-422e-b8dd-8faf2116ac06-host-slash\") pod \"iptables-alerter-pfqnr\" (UID: \"14800fd4-965e-422e-b8dd-8faf2116ac06\") " pod="openshift-network-operator/iptables-alerter-pfqnr"
Aug 05 17:12:47.986132 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.986119    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d8e22937-0209-4cf9-b262-dacb99128703-log-socket\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.989985 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.989782    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d8e22937-0209-4cf9-b262-dacb99128703-var-lib-openvswitch\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.989985 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.989860    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8e22937-0209-4cf9-b262-dacb99128703-host-cni-bin\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.990400 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.990375    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d8e22937-0209-4cf9-b262-dacb99128703-ovnkube-config\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.990526 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.990472    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/89d1e5e7-5f6f-45c2-af1f-cccac035bb74-etc-sysconfig\") pod \"tuned-kzft4\" (UID: \"89d1e5e7-5f6f-45c2-af1f-cccac035bb74\") " pod="openshift-cluster-node-tuning-operator/tuned-kzft4"
Aug 05 17:12:47.991159 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.990907    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/89d1e5e7-5f6f-45c2-af1f-cccac035bb74-etc-sysctl-d\") pod \"tuned-kzft4\" (UID: \"89d1e5e7-5f6f-45c2-af1f-cccac035bb74\") " pod="openshift-cluster-node-tuning-operator/tuned-kzft4"
Aug 05 17:12:47.991159 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.990961    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/89d1e5e7-5f6f-45c2-af1f-cccac035bb74-etc-modprobe-d\") pod \"tuned-kzft4\" (UID: \"89d1e5e7-5f6f-45c2-af1f-cccac035bb74\") " pod="openshift-cluster-node-tuning-operator/tuned-kzft4"
Aug 05 17:12:47.991159 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.991019    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-host-var-lib-cni-multus\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.991159 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.991032    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/89d1e5e7-5f6f-45c2-af1f-cccac035bb74-run\") pod \"tuned-kzft4\" (UID: \"89d1e5e7-5f6f-45c2-af1f-cccac035bb74\") " pod="openshift-cluster-node-tuning-operator/tuned-kzft4"
Aug 05 17:12:47.991159 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.991100    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-multus-conf-dir\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.991484 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.991177    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d8e22937-0209-4cf9-b262-dacb99128703-run-systemd\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.991484 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.991195    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-os-release\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.991484 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.991232    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-host-run-multus-certs\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.991484 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.991239    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-multus-socket-dir-parent\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.991484 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.991446    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8e22937-0209-4cf9-b262-dacb99128703-host-run-ovn-kubernetes\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.991788 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.991570    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-host-var-lib-kubelet\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.991788 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.991570    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-cnibin\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.991788 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.991668    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-host-var-lib-cni-bin\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.991788 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.991498    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d8e22937-0209-4cf9-b262-dacb99128703-systemd-units\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.991788 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.991691    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-hostroot\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.992089 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.991799    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ae8f50f-82eb-4c86-9ea5-6fe09014fa90-system-cni-dir\") pod \"multus-additional-cni-plugins-fg62p\" (UID: \"3ae8f50f-82eb-4c86-9ea5-6fe09014fa90\") " pod="openshift-multus/multus-additional-cni-plugins-fg62p"
Aug 05 17:12:47.992089 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.991804    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3ae8f50f-82eb-4c86-9ea5-6fe09014fa90-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fg62p\" (UID: \"3ae8f50f-82eb-4c86-9ea5-6fe09014fa90\") " pod="openshift-multus/multus-additional-cni-plugins-fg62p"
Aug 05 17:12:47.992089 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.991765    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d8e22937-0209-4cf9-b262-dacb99128703-env-overrides\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.992089 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.991927    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-system-cni-dir\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.992089 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.991962    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/feca036a-6aec-43c5-a206-81bd86431621-etc-selinux\") pod \"aws-ebs-csi-driver-node-vv2br\" (UID: \"feca036a-6aec-43c5-a206-81bd86431621\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv2br"
Aug 05 17:12:47.992089 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.992010    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-host-run-k8s-cni-cncf-io\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.992089 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.992021    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/89d1e5e7-5f6f-45c2-af1f-cccac035bb74-var-lib-kubelet\") pod \"tuned-kzft4\" (UID: \"89d1e5e7-5f6f-45c2-af1f-cccac035bb74\") " pod="openshift-cluster-node-tuning-operator/tuned-kzft4"
Aug 05 17:12:47.992089 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.992054    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/feca036a-6aec-43c5-a206-81bd86431621-socket-dir\") pod \"aws-ebs-csi-driver-node-vv2br\" (UID: \"feca036a-6aec-43c5-a206-81bd86431621\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv2br"
Aug 05 17:12:47.992694 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.992121    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-etc-kubernetes\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.992694 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.992174    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8e22937-0209-4cf9-b262-dacb99128703-host-run-netns\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.992694 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.992314    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89d1e5e7-5f6f-45c2-af1f-cccac035bb74-sys\") pod \"tuned-kzft4\" (UID: \"89d1e5e7-5f6f-45c2-af1f-cccac035bb74\") " pod="openshift-cluster-node-tuning-operator/tuned-kzft4"
Aug 05 17:12:47.992694 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.992498    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-cni-binary-copy\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.992694 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.992616    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/89d1e5e7-5f6f-45c2-af1f-cccac035bb74-etc-sysctl-conf\") pod \"tuned-kzft4\" (UID: \"89d1e5e7-5f6f-45c2-af1f-cccac035bb74\") " pod="openshift-cluster-node-tuning-operator/tuned-kzft4"
Aug 05 17:12:47.992694 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.992684    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f0132161-af65-49eb-8335-197fe57259b2-konnectivity-ca\") pod \"konnectivity-agent-8zp9w\" (UID: \"f0132161-af65-49eb-8335-197fe57259b2\") " pod="kube-system/konnectivity-agent-8zp9w"
Aug 05 17:12:47.993027 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.992716    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d8e22937-0209-4cf9-b262-dacb99128703-host-slash\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.993027 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.992796    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/feca036a-6aec-43c5-a206-81bd86431621-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vv2br\" (UID: \"feca036a-6aec-43c5-a206-81bd86431621\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv2br"
Aug 05 17:12:47.993027 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.992914    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3ae8f50f-82eb-4c86-9ea5-6fe09014fa90-os-release\") pod \"multus-additional-cni-plugins-fg62p\" (UID: \"3ae8f50f-82eb-4c86-9ea5-6fe09014fa90\") " pod="openshift-multus/multus-additional-cni-plugins-fg62p"
Aug 05 17:12:47.993347 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.993321    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-742lr\" (UniqueName: \"kubernetes.io/projected/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-kube-api-access-742lr\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.993521 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.993395    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d8e22937-0209-4cf9-b262-dacb99128703-node-log\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.993578 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.993545    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3-multus-daemon-config\") pod \"multus-nws8z\" (UID: \"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3\") " pod="openshift-multus/multus-nws8z"
Aug 05 17:12:47.993708 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.993337    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d8e22937-0209-4cf9-b262-dacb99128703-run-ovn\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.993958 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.993903    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/14800fd4-965e-422e-b8dd-8faf2116ac06-iptables-alerter-script\") pod \"iptables-alerter-pfqnr\" (UID: \"14800fd4-965e-422e-b8dd-8faf2116ac06\") " pod="openshift-network-operator/iptables-alerter-pfqnr"
Aug 05 17:12:47.994121 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.994098    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/89d1e5e7-5f6f-45c2-af1f-cccac035bb74-etc-tuned\") pod \"tuned-kzft4\" (UID: \"89d1e5e7-5f6f-45c2-af1f-cccac035bb74\") " pod="openshift-cluster-node-tuning-operator/tuned-kzft4"
Aug 05 17:12:47.995952 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.995928    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89d1e5e7-5f6f-45c2-af1f-cccac035bb74-tmp\") pod \"tuned-kzft4\" (UID: \"89d1e5e7-5f6f-45c2-af1f-cccac035bb74\") " pod="openshift-cluster-node-tuning-operator/tuned-kzft4"
Aug 05 17:12:47.997349 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.997324    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d8e22937-0209-4cf9-b262-dacb99128703-ovn-node-metrics-cert\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:47.999231 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.999204    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f0132161-af65-49eb-8335-197fe57259b2-agent-certs\") pod \"konnectivity-agent-8zp9w\" (UID: \"f0132161-af65-49eb-8335-197fe57259b2\") " pod="kube-system/konnectivity-agent-8zp9w"
Aug 05 17:12:47.999416 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:47.999285    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc9nc\" (UniqueName: \"kubernetes.io/projected/14800fd4-965e-422e-b8dd-8faf2116ac06-kube-api-access-xc9nc\") pod \"iptables-alerter-pfqnr\" (UID: \"14800fd4-965e-422e-b8dd-8faf2116ac06\") " pod="openshift-network-operator/iptables-alerter-pfqnr"
Aug 05 17:12:48.001731 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:48.001576    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-128.ec2.internal" event={"ID":"2906d83a7da9fad32f85769014ae2ba9","Type":"ContainerStarted","Data":"02cb624f01f566b72a773806301db0f6767607a94c1fd510b07dca965e449b9c"}
Aug 05 17:12:48.002429 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:48.002265    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkm66\" (UniqueName: \"kubernetes.io/projected/89d1e5e7-5f6f-45c2-af1f-cccac035bb74-kube-api-access-lkm66\") pod \"tuned-kzft4\" (UID: \"89d1e5e7-5f6f-45c2-af1f-cccac035bb74\") " pod="openshift-cluster-node-tuning-operator/tuned-kzft4"
Aug 05 17:12:48.004356 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:48.004330    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fpw9\" (UniqueName: \"kubernetes.io/projected/3ae8f50f-82eb-4c86-9ea5-6fe09014fa90-kube-api-access-7fpw9\") pod \"multus-additional-cni-plugins-fg62p\" (UID: \"3ae8f50f-82eb-4c86-9ea5-6fe09014fa90\") " pod="openshift-multus/multus-additional-cni-plugins-fg62p"
Aug 05 17:12:48.004476 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:48.004431    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-128.ec2.internal" event={"ID":"e1b83dd9bca61494c59a13c639d8ff7b","Type":"ContainerStarted","Data":"2c99e618f333ddb4ffa7e381edc956fba4cf16f79df308b98c34a071b27a311a"}
Aug 05 17:12:48.005256 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:48.005232    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phf4m\" (UniqueName: \"kubernetes.io/projected/feca036a-6aec-43c5-a206-81bd86431621-kube-api-access-phf4m\") pod \"aws-ebs-csi-driver-node-vv2br\" (UID: \"feca036a-6aec-43c5-a206-81bd86431621\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv2br"
Aug 05 17:12:48.006985 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:48.006956    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hffct\" (UniqueName: \"kubernetes.io/projected/d8e22937-0209-4cf9-b262-dacb99128703-kube-api-access-hffct\") pod \"ovnkube-node-q69wj\" (UID: \"d8e22937-0209-4cf9-b262-dacb99128703\") " pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:48.079604 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:48.079546    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7wgm8"
Aug 05 17:12:48.088145 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:48.088119    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8gxfg"
Aug 05 17:12:48.101220 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:48.101192    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nws8z"
Aug 05 17:12:48.108361 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:48.108334    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8zp9w"
Aug 05 17:12:48.117494 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:48.117469    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:12:48.125497 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:48.125475    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kzft4"
Aug 05 17:12:48.133944 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:48.133920    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fg62p"
Aug 05 17:12:48.142605 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:48.142580    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv2br"
Aug 05 17:12:48.149783 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:48.149759    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pfqnr"
Aug 05 17:12:48.380203 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:48.380114    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e53ac33-f7e0-491b-a0fa-3a08b3eb6175-original-pull-secret\") pod \"global-pull-secret-syncer-8g5w9\" (UID: \"8e53ac33-f7e0-491b-a0fa-3a08b3eb6175\") " pod="kube-system/global-pull-secret-syncer-8g5w9"
Aug 05 17:12:48.380203 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:48.380192    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0746144f-9064-48d7-ad22-f33bbbc3c16e-metrics-certs\") pod \"network-metrics-daemon-j48xm\" (UID: \"0746144f-9064-48d7-ad22-f33bbbc3c16e\") " pod="openshift-multus/network-metrics-daemon-j48xm"
Aug 05 17:12:48.380518 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:48.380258    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 17:12:48.380518 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:48.380280    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 17:12:48.380518 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:48.380327    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e53ac33-f7e0-491b-a0fa-3a08b3eb6175-original-pull-secret podName:8e53ac33-f7e0-491b-a0fa-3a08b3eb6175 nodeName:}" failed. No retries permitted until 2026-08-05 17:12:49.380311214 +0000 UTC m=+3.948813617 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e53ac33-f7e0-491b-a0fa-3a08b3eb6175-original-pull-secret") pod "global-pull-secret-syncer-8g5w9" (UID: "8e53ac33-f7e0-491b-a0fa-3a08b3eb6175") : object "kube-system"/"original-pull-secret" not registered
Aug 05 17:12:48.380518 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:48.380345    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0746144f-9064-48d7-ad22-f33bbbc3c16e-metrics-certs podName:0746144f-9064-48d7-ad22-f33bbbc3c16e nodeName:}" failed. No retries permitted until 2026-08-05 17:12:49.380336075 +0000 UTC m=+3.948838477 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0746144f-9064-48d7-ad22-f33bbbc3c16e-metrics-certs") pod "network-metrics-daemon-j48xm" (UID: "0746144f-9064-48d7-ad22-f33bbbc3c16e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 17:12:48.481472 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:48.481427    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr4fg\" (UniqueName: \"kubernetes.io/projected/eb450465-98ef-415c-b5a3-83c3ed6efb16-kube-api-access-vr4fg\") pod \"network-check-target-fjb99\" (UID: \"eb450465-98ef-415c-b5a3-83c3ed6efb16\") " pod="openshift-network-diagnostics/network-check-target-fjb99"
Aug 05 17:12:48.481680 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:48.481618    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 17:12:48.481680 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:48.481642    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 17:12:48.481680 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:48.481656    2580 projected.go:196] Error preparing data for projected volume kube-api-access-vr4fg for pod openshift-network-diagnostics/network-check-target-fjb99: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 17:12:48.481815 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:48.481725    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb450465-98ef-415c-b5a3-83c3ed6efb16-kube-api-access-vr4fg podName:eb450465-98ef-415c-b5a3-83c3ed6efb16 nodeName:}" failed. No retries permitted until 2026-08-05 17:12:49.481705891 +0000 UTC m=+4.050208313 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vr4fg" (UniqueName: "kubernetes.io/projected/eb450465-98ef-415c-b5a3-83c3ed6efb16-kube-api-access-vr4fg") pod "network-check-target-fjb99" (UID: "eb450465-98ef-415c-b5a3-83c3ed6efb16") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 17:12:48.620128 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:48.620092    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 17:12:48.842095 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:48.842046    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-04 17:07:48 +0000 UTC" deadline="2028-01-09 18:54:04.042196231 +0000 UTC"
Aug 05 17:12:48.842095 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:48.842085    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12529h41m15.200114523s"
Aug 05 17:12:48.996320 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:48.996291    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjb99"
Aug 05 17:12:48.996531 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:48.996414    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjb99" podUID="eb450465-98ef-415c-b5a3-83c3ed6efb16"
Aug 05 17:12:49.127202 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:49.126881    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8e22937_0209_4cf9_b262_dacb99128703.slice/crio-7d92f02fcd72111ae40b4a5c324991fe8dff4fcdf52f063f4fc4038948e9bf5c WatchSource:0}: Error finding container 7d92f02fcd72111ae40b4a5c324991fe8dff4fcdf52f063f4fc4038948e9bf5c: Status 404 returned error can't find the container with id 7d92f02fcd72111ae40b4a5c324991fe8dff4fcdf52f063f4fc4038948e9bf5c
Aug 05 17:12:49.144540 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:49.144510    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bf26f2b_19d6_42f0_81db_423f51c7982e.slice/crio-8ae463fbdb8e43afe514794b7f41adcc38b581769a7dd1b377b0e56d3563d05e WatchSource:0}: Error finding container 8ae463fbdb8e43afe514794b7f41adcc38b581769a7dd1b377b0e56d3563d05e: Status 404 returned error can't find the container with id 8ae463fbdb8e43afe514794b7f41adcc38b581769a7dd1b377b0e56d3563d05e
Aug 05 17:12:49.144855 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:49.144833    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4349f2f_ccd4_43c7_bee0_2bb29268387c.slice/crio-ef4e80ecb71580de2fcefd192cbfb9400534cb89d35573f933bd045764970049 WatchSource:0}: Error finding container ef4e80ecb71580de2fcefd192cbfb9400534cb89d35573f933bd045764970049: Status 404 returned error can't find the container with id ef4e80ecb71580de2fcefd192cbfb9400534cb89d35573f933bd045764970049
Aug 05 17:12:49.145921 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:49.145886    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14800fd4_965e_422e_b8dd_8faf2116ac06.slice/crio-839bc4c7f40ac4566914ad92ebd7c66f81fc5ddacc9775f84d9d00a8b32d7888 WatchSource:0}: Error finding container 839bc4c7f40ac4566914ad92ebd7c66f81fc5ddacc9775f84d9d00a8b32d7888: Status 404 returned error can't find the container with id 839bc4c7f40ac4566914ad92ebd7c66f81fc5ddacc9775f84d9d00a8b32d7888
Aug 05 17:12:49.147358 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:49.147339    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89d1e5e7_5f6f_45c2_af1f_cccac035bb74.slice/crio-bfff9a241f2bc391d342be3268900f13e4a63edbbaacf744e591bdfbd8fc335d WatchSource:0}: Error finding container bfff9a241f2bc391d342be3268900f13e4a63edbbaacf744e591bdfbd8fc335d: Status 404 returned error can't find the container with id bfff9a241f2bc391d342be3268900f13e4a63edbbaacf744e591bdfbd8fc335d
Aug 05 17:12:49.148463 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:49.148438    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ae8f50f_82eb_4c86_9ea5_6fe09014fa90.slice/crio-93c0739c83fed9b027805eb32dd22d11929db1dc190d1333c6a9d21a6e42406c WatchSource:0}: Error finding container 93c0739c83fed9b027805eb32dd22d11929db1dc190d1333c6a9d21a6e42406c: Status 404 returned error can't find the container with id 93c0739c83fed9b027805eb32dd22d11929db1dc190d1333c6a9d21a6e42406c
Aug 05 17:12:49.152369 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:49.152333    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeca036a_6aec_43c5_a206_81bd86431621.slice/crio-b97e134d2e7ffa1fead14420f6eef893f3de7b132b2c6a3543a020f7eafd7d4a WatchSource:0}: Error finding container b97e134d2e7ffa1fead14420f6eef893f3de7b132b2c6a3543a020f7eafd7d4a: Status 404 returned error can't find the container with id b97e134d2e7ffa1fead14420f6eef893f3de7b132b2c6a3543a020f7eafd7d4a
Aug 05 17:12:49.152853 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:49.152827    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c63ef0c_6380_4b2f_80aa_2c1bf0a388a3.slice/crio-c10b149c95813dc25aeb0bb4d3f0e8b88df64351e318bc4db2c9dd281334675e WatchSource:0}: Error finding container c10b149c95813dc25aeb0bb4d3f0e8b88df64351e318bc4db2c9dd281334675e: Status 404 returned error can't find the container with id c10b149c95813dc25aeb0bb4d3f0e8b88df64351e318bc4db2c9dd281334675e
Aug 05 17:12:49.158220 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:12:49.157333    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0132161_af65_49eb_8335_197fe57259b2.slice/crio-dedc1e05564b6cf726660251ffc0103c89ea02d381196688a7c300422f567ae0 WatchSource:0}: Error finding container dedc1e05564b6cf726660251ffc0103c89ea02d381196688a7c300422f567ae0: Status 404 returned error can't find the container with id dedc1e05564b6cf726660251ffc0103c89ea02d381196688a7c300422f567ae0
Aug 05 17:12:49.388654 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:49.388500    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0746144f-9064-48d7-ad22-f33bbbc3c16e-metrics-certs\") pod \"network-metrics-daemon-j48xm\" (UID: \"0746144f-9064-48d7-ad22-f33bbbc3c16e\") " pod="openshift-multus/network-metrics-daemon-j48xm"
Aug 05 17:12:49.388654 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:49.388559    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e53ac33-f7e0-491b-a0fa-3a08b3eb6175-original-pull-secret\") pod \"global-pull-secret-syncer-8g5w9\" (UID: \"8e53ac33-f7e0-491b-a0fa-3a08b3eb6175\") " pod="kube-system/global-pull-secret-syncer-8g5w9"
Aug 05 17:12:49.388849 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:49.388700    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 17:12:49.388849 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:49.388735    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 17:12:49.388849 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:49.388774    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0746144f-9064-48d7-ad22-f33bbbc3c16e-metrics-certs podName:0746144f-9064-48d7-ad22-f33bbbc3c16e nodeName:}" failed. No retries permitted until 2026-08-05 17:12:51.388755188 +0000 UTC m=+5.957257611 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0746144f-9064-48d7-ad22-f33bbbc3c16e-metrics-certs") pod "network-metrics-daemon-j48xm" (UID: "0746144f-9064-48d7-ad22-f33bbbc3c16e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 17:12:49.388849 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:49.388796    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e53ac33-f7e0-491b-a0fa-3a08b3eb6175-original-pull-secret podName:8e53ac33-f7e0-491b-a0fa-3a08b3eb6175 nodeName:}" failed. No retries permitted until 2026-08-05 17:12:51.388782993 +0000 UTC m=+5.957285412 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e53ac33-f7e0-491b-a0fa-3a08b3eb6175-original-pull-secret") pod "global-pull-secret-syncer-8g5w9" (UID: "8e53ac33-f7e0-491b-a0fa-3a08b3eb6175") : object "kube-system"/"original-pull-secret" not registered
Aug 05 17:12:49.489735 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:49.489677    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr4fg\" (UniqueName: \"kubernetes.io/projected/eb450465-98ef-415c-b5a3-83c3ed6efb16-kube-api-access-vr4fg\") pod \"network-check-target-fjb99\" (UID: \"eb450465-98ef-415c-b5a3-83c3ed6efb16\") " pod="openshift-network-diagnostics/network-check-target-fjb99"
Aug 05 17:12:49.489914 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:49.489861    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 17:12:49.489914 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:49.489881    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 17:12:49.489914 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:49.489892    2580 projected.go:196] Error preparing data for projected volume kube-api-access-vr4fg for pod openshift-network-diagnostics/network-check-target-fjb99: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 17:12:49.490015 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:49.489954    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb450465-98ef-415c-b5a3-83c3ed6efb16-kube-api-access-vr4fg podName:eb450465-98ef-415c-b5a3-83c3ed6efb16 nodeName:}" failed. No retries permitted until 2026-08-05 17:12:51.489935758 +0000 UTC m=+6.058438180 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vr4fg" (UniqueName: "kubernetes.io/projected/eb450465-98ef-415c-b5a3-83c3ed6efb16-kube-api-access-vr4fg") pod "network-check-target-fjb99" (UID: "eb450465-98ef-415c-b5a3-83c3ed6efb16") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 17:12:49.842939 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:49.842769    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-04 17:07:48 +0000 UTC" deadline="2028-03-29 07:06:06.219505564 +0000 UTC"
Aug 05 17:12:49.842939 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:49.842853    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14437h53m16.376657883s"
Aug 05 17:12:49.998777 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:49.997771    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j48xm"
Aug 05 17:12:49.998777 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:49.997928    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j48xm" podUID="0746144f-9064-48d7-ad22-f33bbbc3c16e"
Aug 05 17:12:49.998777 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:49.998394    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g5w9"
Aug 05 17:12:49.998777 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:49.998491    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g5w9" podUID="8e53ac33-f7e0-491b-a0fa-3a08b3eb6175"
Aug 05 17:12:50.018694 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:50.018649    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fg62p" event={"ID":"3ae8f50f-82eb-4c86-9ea5-6fe09014fa90","Type":"ContainerStarted","Data":"93c0739c83fed9b027805eb32dd22d11929db1dc190d1333c6a9d21a6e42406c"}
Aug 05 17:12:50.021008 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:50.020933    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7wgm8" event={"ID":"f4349f2f-ccd4-43c7-bee0-2bb29268387c","Type":"ContainerStarted","Data":"ef4e80ecb71580de2fcefd192cbfb9400534cb89d35573f933bd045764970049"}
Aug 05 17:12:50.026933 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:50.026799    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q69wj" event={"ID":"d8e22937-0209-4cf9-b262-dacb99128703","Type":"ContainerStarted","Data":"7d92f02fcd72111ae40b4a5c324991fe8dff4fcdf52f063f4fc4038948e9bf5c"}
Aug 05 17:12:50.036707 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:50.036424    2580 generic.go:356] "Generic (PLEG): container finished" podID="e1b83dd9bca61494c59a13c639d8ff7b" containerID="4a5246d7e849bfc765fe18e41f0b66ace5901fb73bf6c2acce397c3e30f1e293" exitCode=0
Aug 05 17:12:50.036707 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:50.036610    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-128.ec2.internal" event={"ID":"e1b83dd9bca61494c59a13c639d8ff7b","Type":"ContainerDied","Data":"4a5246d7e849bfc765fe18e41f0b66ace5901fb73bf6c2acce397c3e30f1e293"}
Aug 05 17:12:50.044742 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:50.044584    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8zp9w" event={"ID":"f0132161-af65-49eb-8335-197fe57259b2","Type":"ContainerStarted","Data":"dedc1e05564b6cf726660251ffc0103c89ea02d381196688a7c300422f567ae0"}
Aug 05 17:12:50.053875 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:50.053427    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nws8z" event={"ID":"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3","Type":"ContainerStarted","Data":"c10b149c95813dc25aeb0bb4d3f0e8b88df64351e318bc4db2c9dd281334675e"}
Aug 05 17:12:50.058310 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:50.058270    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pfqnr" event={"ID":"14800fd4-965e-422e-b8dd-8faf2116ac06","Type":"ContainerStarted","Data":"839bc4c7f40ac4566914ad92ebd7c66f81fc5ddacc9775f84d9d00a8b32d7888"}
Aug 05 17:12:50.063337 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:50.063303    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8gxfg" event={"ID":"4bf26f2b-19d6-42f0-81db-423f51c7982e","Type":"ContainerStarted","Data":"8ae463fbdb8e43afe514794b7f41adcc38b581769a7dd1b377b0e56d3563d05e"}
Aug 05 17:12:50.084023 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:50.083978    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-128.ec2.internal" event={"ID":"2906d83a7da9fad32f85769014ae2ba9","Type":"ContainerStarted","Data":"d83b013ff3b6e79b57a41404992f106d1a98abad8b5cfcebc1ad65cd0a6b6a87"}
Aug 05 17:12:50.102937 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:50.102838    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv2br" event={"ID":"feca036a-6aec-43c5-a206-81bd86431621","Type":"ContainerStarted","Data":"b97e134d2e7ffa1fead14420f6eef893f3de7b132b2c6a3543a020f7eafd7d4a"}
Aug 05 17:12:50.117803 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:50.117758    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kzft4" event={"ID":"89d1e5e7-5f6f-45c2-af1f-cccac035bb74","Type":"ContainerStarted","Data":"bfff9a241f2bc391d342be3268900f13e4a63edbbaacf744e591bdfbd8fc335d"}
Aug 05 17:12:50.996111 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:50.996065    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjb99"
Aug 05 17:12:50.996658 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:50.996216    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjb99" podUID="eb450465-98ef-415c-b5a3-83c3ed6efb16"
Aug 05 17:12:51.148443 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:51.148398    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-128.ec2.internal" event={"ID":"e1b83dd9bca61494c59a13c639d8ff7b","Type":"ContainerStarted","Data":"1e1dbb98b8dbebaa51aa5500cf33454d415c44c804ea2e2f17824ae949768703"}
Aug 05 17:12:51.164752 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:51.164682    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-128.ec2.internal" podStartSLOduration=4.164653787 podStartE2EDuration="4.164653787s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:12:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:12:50.100646512 +0000 UTC m=+4.669148932" watchObservedRunningTime="2026-08-05 17:12:51.164653787 +0000 UTC m=+5.733156206"
Aug 05 17:12:51.408260 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:51.408138    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0746144f-9064-48d7-ad22-f33bbbc3c16e-metrics-certs\") pod \"network-metrics-daemon-j48xm\" (UID: \"0746144f-9064-48d7-ad22-f33bbbc3c16e\") " pod="openshift-multus/network-metrics-daemon-j48xm"
Aug 05 17:12:51.408260 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:51.408218    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e53ac33-f7e0-491b-a0fa-3a08b3eb6175-original-pull-secret\") pod \"global-pull-secret-syncer-8g5w9\" (UID: \"8e53ac33-f7e0-491b-a0fa-3a08b3eb6175\") " pod="kube-system/global-pull-secret-syncer-8g5w9"
Aug 05 17:12:51.408575 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:51.408388    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 17:12:51.408575 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:51.408458    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e53ac33-f7e0-491b-a0fa-3a08b3eb6175-original-pull-secret podName:8e53ac33-f7e0-491b-a0fa-3a08b3eb6175 nodeName:}" failed. No retries permitted until 2026-08-05 17:12:55.408438321 +0000 UTC m=+9.976940723 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e53ac33-f7e0-491b-a0fa-3a08b3eb6175-original-pull-secret") pod "global-pull-secret-syncer-8g5w9" (UID: "8e53ac33-f7e0-491b-a0fa-3a08b3eb6175") : object "kube-system"/"original-pull-secret" not registered
Aug 05 17:12:51.408730 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:51.408716    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 17:12:51.408788 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:51.408763    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0746144f-9064-48d7-ad22-f33bbbc3c16e-metrics-certs podName:0746144f-9064-48d7-ad22-f33bbbc3c16e nodeName:}" failed. No retries permitted until 2026-08-05 17:12:55.40874775 +0000 UTC m=+9.977250155 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0746144f-9064-48d7-ad22-f33bbbc3c16e-metrics-certs") pod "network-metrics-daemon-j48xm" (UID: "0746144f-9064-48d7-ad22-f33bbbc3c16e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 17:12:51.510175 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:51.509348    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr4fg\" (UniqueName: \"kubernetes.io/projected/eb450465-98ef-415c-b5a3-83c3ed6efb16-kube-api-access-vr4fg\") pod \"network-check-target-fjb99\" (UID: \"eb450465-98ef-415c-b5a3-83c3ed6efb16\") " pod="openshift-network-diagnostics/network-check-target-fjb99"
Aug 05 17:12:51.510175 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:51.509586    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 17:12:51.510175 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:51.509630    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 17:12:51.510175 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:51.509646    2580 projected.go:196] Error preparing data for projected volume kube-api-access-vr4fg for pod openshift-network-diagnostics/network-check-target-fjb99: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 17:12:51.510175 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:51.509711    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb450465-98ef-415c-b5a3-83c3ed6efb16-kube-api-access-vr4fg podName:eb450465-98ef-415c-b5a3-83c3ed6efb16 nodeName:}" failed. No retries permitted until 2026-08-05 17:12:55.509690864 +0000 UTC m=+10.078193286 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vr4fg" (UniqueName: "kubernetes.io/projected/eb450465-98ef-415c-b5a3-83c3ed6efb16-kube-api-access-vr4fg") pod "network-check-target-fjb99" (UID: "eb450465-98ef-415c-b5a3-83c3ed6efb16") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 17:12:51.998534 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:51.997762    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j48xm"
Aug 05 17:12:51.998534 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:51.997920    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j48xm" podUID="0746144f-9064-48d7-ad22-f33bbbc3c16e"
Aug 05 17:12:51.999938 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:51.999317    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g5w9"
Aug 05 17:12:51.999938 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:51.999475    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g5w9" podUID="8e53ac33-f7e0-491b-a0fa-3a08b3eb6175"
Aug 05 17:12:52.996258 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:52.996220    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjb99"
Aug 05 17:12:52.996457 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:52.996352    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjb99" podUID="eb450465-98ef-415c-b5a3-83c3ed6efb16"
Aug 05 17:12:53.997737 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:53.997693    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g5w9"
Aug 05 17:12:53.998199 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:53.997814    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g5w9" podUID="8e53ac33-f7e0-491b-a0fa-3a08b3eb6175"
Aug 05 17:12:53.998199 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:53.997695    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j48xm"
Aug 05 17:12:53.998312 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:53.998202    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j48xm" podUID="0746144f-9064-48d7-ad22-f33bbbc3c16e"
Aug 05 17:12:54.996792 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:54.996754    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjb99"
Aug 05 17:12:54.996967 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:54.996898    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjb99" podUID="eb450465-98ef-415c-b5a3-83c3ed6efb16"
Aug 05 17:12:55.442245 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:55.442148    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e53ac33-f7e0-491b-a0fa-3a08b3eb6175-original-pull-secret\") pod \"global-pull-secret-syncer-8g5w9\" (UID: \"8e53ac33-f7e0-491b-a0fa-3a08b3eb6175\") " pod="kube-system/global-pull-secret-syncer-8g5w9"
Aug 05 17:12:55.442680 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:55.442268    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0746144f-9064-48d7-ad22-f33bbbc3c16e-metrics-certs\") pod \"network-metrics-daemon-j48xm\" (UID: \"0746144f-9064-48d7-ad22-f33bbbc3c16e\") " pod="openshift-multus/network-metrics-daemon-j48xm"
Aug 05 17:12:55.442680 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:55.442393    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 17:12:55.442680 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:55.442458    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0746144f-9064-48d7-ad22-f33bbbc3c16e-metrics-certs podName:0746144f-9064-48d7-ad22-f33bbbc3c16e nodeName:}" failed. No retries permitted until 2026-08-05 17:13:03.442437306 +0000 UTC m=+18.010939726 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0746144f-9064-48d7-ad22-f33bbbc3c16e-metrics-certs") pod "network-metrics-daemon-j48xm" (UID: "0746144f-9064-48d7-ad22-f33bbbc3c16e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 17:12:55.442865 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:55.442849    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 17:12:55.442911 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:55.442902    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e53ac33-f7e0-491b-a0fa-3a08b3eb6175-original-pull-secret podName:8e53ac33-f7e0-491b-a0fa-3a08b3eb6175 nodeName:}" failed. No retries permitted until 2026-08-05 17:13:03.442889427 +0000 UTC m=+18.011391826 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e53ac33-f7e0-491b-a0fa-3a08b3eb6175-original-pull-secret") pod "global-pull-secret-syncer-8g5w9" (UID: "8e53ac33-f7e0-491b-a0fa-3a08b3eb6175") : object "kube-system"/"original-pull-secret" not registered
Aug 05 17:12:55.543510 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:55.543467    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr4fg\" (UniqueName: \"kubernetes.io/projected/eb450465-98ef-415c-b5a3-83c3ed6efb16-kube-api-access-vr4fg\") pod \"network-check-target-fjb99\" (UID: \"eb450465-98ef-415c-b5a3-83c3ed6efb16\") " pod="openshift-network-diagnostics/network-check-target-fjb99"
Aug 05 17:12:55.543728 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:55.543707    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 17:12:55.543794 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:55.543736    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 17:12:55.543794 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:55.543752    2580 projected.go:196] Error preparing data for projected volume kube-api-access-vr4fg for pod openshift-network-diagnostics/network-check-target-fjb99: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 17:12:55.543894 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:55.543818    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb450465-98ef-415c-b5a3-83c3ed6efb16-kube-api-access-vr4fg podName:eb450465-98ef-415c-b5a3-83c3ed6efb16 nodeName:}" failed. No retries permitted until 2026-08-05 17:13:03.543798214 +0000 UTC m=+18.112300617 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vr4fg" (UniqueName: "kubernetes.io/projected/eb450465-98ef-415c-b5a3-83c3ed6efb16-kube-api-access-vr4fg") pod "network-check-target-fjb99" (UID: "eb450465-98ef-415c-b5a3-83c3ed6efb16") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 17:12:55.999230 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:55.999186    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j48xm"
Aug 05 17:12:55.999415 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:55.999339    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j48xm" podUID="0746144f-9064-48d7-ad22-f33bbbc3c16e"
Aug 05 17:12:55.999747 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:55.999730    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g5w9"
Aug 05 17:12:55.999850 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:55.999831    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g5w9" podUID="8e53ac33-f7e0-491b-a0fa-3a08b3eb6175"
Aug 05 17:12:56.996505 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:56.996463    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjb99"
Aug 05 17:12:56.997015 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:56.996620    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjb99" podUID="eb450465-98ef-415c-b5a3-83c3ed6efb16"
Aug 05 17:12:57.997718 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:57.997678    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g5w9"
Aug 05 17:12:57.998176 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:57.997815    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g5w9" podUID="8e53ac33-f7e0-491b-a0fa-3a08b3eb6175"
Aug 05 17:12:57.998176 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:57.997678    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j48xm"
Aug 05 17:12:57.998306 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:57.998286    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j48xm" podUID="0746144f-9064-48d7-ad22-f33bbbc3c16e"
Aug 05 17:12:58.996783 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:58.996731    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjb99"
Aug 05 17:12:58.996960 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:58.996890    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjb99" podUID="eb450465-98ef-415c-b5a3-83c3ed6efb16"
Aug 05 17:12:59.996790 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:59.996740    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j48xm"
Aug 05 17:12:59.996790 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:12:59.996773    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g5w9"
Aug 05 17:12:59.997310 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:59.996885    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j48xm" podUID="0746144f-9064-48d7-ad22-f33bbbc3c16e"
Aug 05 17:12:59.997310 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:12:59.996999    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g5w9" podUID="8e53ac33-f7e0-491b-a0fa-3a08b3eb6175"
Aug 05 17:13:00.996398 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:00.996359    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjb99"
Aug 05 17:13:00.996616 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:00.996484    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjb99" podUID="eb450465-98ef-415c-b5a3-83c3ed6efb16"
Aug 05 17:13:01.996423 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:01.996385    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j48xm"
Aug 05 17:13:01.996948 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:01.996533    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j48xm" podUID="0746144f-9064-48d7-ad22-f33bbbc3c16e"
Aug 05 17:13:01.996948 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:01.996585    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g5w9"
Aug 05 17:13:01.996948 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:01.996697    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g5w9" podUID="8e53ac33-f7e0-491b-a0fa-3a08b3eb6175"
Aug 05 17:13:02.996967 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:02.996928    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjb99"
Aug 05 17:13:02.997393 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:02.997073    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjb99" podUID="eb450465-98ef-415c-b5a3-83c3ed6efb16"
Aug 05 17:13:03.501014 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:03.500973    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0746144f-9064-48d7-ad22-f33bbbc3c16e-metrics-certs\") pod \"network-metrics-daemon-j48xm\" (UID: \"0746144f-9064-48d7-ad22-f33bbbc3c16e\") " pod="openshift-multus/network-metrics-daemon-j48xm"
Aug 05 17:13:03.501189 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:03.501035    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e53ac33-f7e0-491b-a0fa-3a08b3eb6175-original-pull-secret\") pod \"global-pull-secret-syncer-8g5w9\" (UID: \"8e53ac33-f7e0-491b-a0fa-3a08b3eb6175\") " pod="kube-system/global-pull-secret-syncer-8g5w9"
Aug 05 17:13:03.501189 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:03.501147    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 17:13:03.501189 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:03.501183    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 17:13:03.501362 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:03.501234    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0746144f-9064-48d7-ad22-f33bbbc3c16e-metrics-certs podName:0746144f-9064-48d7-ad22-f33bbbc3c16e nodeName:}" failed. No retries permitted until 2026-08-05 17:13:19.501211125 +0000 UTC m=+34.069713539 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0746144f-9064-48d7-ad22-f33bbbc3c16e-metrics-certs") pod "network-metrics-daemon-j48xm" (UID: "0746144f-9064-48d7-ad22-f33bbbc3c16e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 17:13:03.501362 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:03.501258    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e53ac33-f7e0-491b-a0fa-3a08b3eb6175-original-pull-secret podName:8e53ac33-f7e0-491b-a0fa-3a08b3eb6175 nodeName:}" failed. No retries permitted until 2026-08-05 17:13:19.501248073 +0000 UTC m=+34.069750480 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e53ac33-f7e0-491b-a0fa-3a08b3eb6175-original-pull-secret") pod "global-pull-secret-syncer-8g5w9" (UID: "8e53ac33-f7e0-491b-a0fa-3a08b3eb6175") : object "kube-system"/"original-pull-secret" not registered
Aug 05 17:13:03.602012 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:03.601964    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr4fg\" (UniqueName: \"kubernetes.io/projected/eb450465-98ef-415c-b5a3-83c3ed6efb16-kube-api-access-vr4fg\") pod \"network-check-target-fjb99\" (UID: \"eb450465-98ef-415c-b5a3-83c3ed6efb16\") " pod="openshift-network-diagnostics/network-check-target-fjb99"
Aug 05 17:13:03.602203 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:03.602164    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 17:13:03.602203 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:03.602191    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 17:13:03.602203 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:03.602202    2580 projected.go:196] Error preparing data for projected volume kube-api-access-vr4fg for pod openshift-network-diagnostics/network-check-target-fjb99: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 17:13:03.602312 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:03.602260    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb450465-98ef-415c-b5a3-83c3ed6efb16-kube-api-access-vr4fg podName:eb450465-98ef-415c-b5a3-83c3ed6efb16 nodeName:}" failed. No retries permitted until 2026-08-05 17:13:19.602245208 +0000 UTC m=+34.170747611 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vr4fg" (UniqueName: "kubernetes.io/projected/eb450465-98ef-415c-b5a3-83c3ed6efb16-kube-api-access-vr4fg") pod "network-check-target-fjb99" (UID: "eb450465-98ef-415c-b5a3-83c3ed6efb16") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 17:13:03.996090 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:03.996066    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j48xm"
Aug 05 17:13:03.996232 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:03.996212    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j48xm" podUID="0746144f-9064-48d7-ad22-f33bbbc3c16e"
Aug 05 17:13:03.996299 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:03.996256    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g5w9"
Aug 05 17:13:03.996372 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:03.996351    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g5w9" podUID="8e53ac33-f7e0-491b-a0fa-3a08b3eb6175"
Aug 05 17:13:04.997001 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:04.996961    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjb99"
Aug 05 17:13:04.997448 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:04.997087    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjb99" podUID="eb450465-98ef-415c-b5a3-83c3ed6efb16"
Aug 05 17:13:05.997533 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:05.997491    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j48xm"
Aug 05 17:13:05.998039 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:05.997676    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j48xm" podUID="0746144f-9064-48d7-ad22-f33bbbc3c16e"
Aug 05 17:13:05.998039 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:05.997703    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g5w9"
Aug 05 17:13:05.998039 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:05.997826    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g5w9" podUID="8e53ac33-f7e0-491b-a0fa-3a08b3eb6175"
Aug 05 17:13:06.996578 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:06.996524    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjb99"
Aug 05 17:13:06.996761 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:06.996654    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjb99" podUID="eb450465-98ef-415c-b5a3-83c3ed6efb16"
Aug 05 17:13:07.999496 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:07.999424    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g5w9"
Aug 05 17:13:07.999496 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:07.999429    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j48xm"
Aug 05 17:13:07.999950 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:07.999630    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j48xm" podUID="0746144f-9064-48d7-ad22-f33bbbc3c16e"
Aug 05 17:13:08.001351 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:08.001170    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g5w9" podUID="8e53ac33-f7e0-491b-a0fa-3a08b3eb6175"
Aug 05 17:13:08.185601 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:08.185329    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8gxfg" event={"ID":"4bf26f2b-19d6-42f0-81db-423f51c7982e","Type":"ContainerStarted","Data":"8a47d449906b0b98fd734fd5b99f0f7dc567d9964d1708c8704a9cf1165de36d"}
Aug 05 17:13:08.190076 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:08.190034    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv2br" event={"ID":"feca036a-6aec-43c5-a206-81bd86431621","Type":"ContainerStarted","Data":"8dd97e2ec48586f2404075b20a3c8eaf3eed7456ffe1204cd00feaf0ac6002e8"}
Aug 05 17:13:08.191519 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:08.191487    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kzft4" event={"ID":"89d1e5e7-5f6f-45c2-af1f-cccac035bb74","Type":"ContainerStarted","Data":"df0a82a1255086f4b8ee8cc83bb8731cd2ec0ed4cd6f04c98a4c5bea3ce39cc9"}
Aug 05 17:13:08.193357 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:08.193334    2580 generic.go:356] "Generic (PLEG): container finished" podID="3ae8f50f-82eb-4c86-9ea5-6fe09014fa90" containerID="3e1c67a3270cfa5ebd1cdd83658c87c59055274e9fe6afa7ee111a0a180cbca6" exitCode=0
Aug 05 17:13:08.193436 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:08.193408    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fg62p" event={"ID":"3ae8f50f-82eb-4c86-9ea5-6fe09014fa90","Type":"ContainerDied","Data":"3e1c67a3270cfa5ebd1cdd83658c87c59055274e9fe6afa7ee111a0a180cbca6"}
Aug 05 17:13:08.194851 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:08.194768    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7wgm8" event={"ID":"f4349f2f-ccd4-43c7-bee0-2bb29268387c","Type":"ContainerStarted","Data":"439a7fd91faf010c31a3a99d521c7db382751fec6b07b3e7591f0e2b21c21225"}
Aug 05 17:13:08.196819 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:08.196796    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q69wj" event={"ID":"d8e22937-0209-4cf9-b262-dacb99128703","Type":"ContainerStarted","Data":"fa0e44d590c13701267aeb389b70849b3f99f03254b3a6cda0f6a470f4e6ae7c"}
Aug 05 17:13:08.196881 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:08.196857    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q69wj" event={"ID":"d8e22937-0209-4cf9-b262-dacb99128703","Type":"ContainerStarted","Data":"c5982514119d877053aebddca8bae4d0067b77eb5578fa1f58ff4c2ba63be911"}
Aug 05 17:13:08.198011 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:08.197992    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8zp9w" event={"ID":"f0132161-af65-49eb-8335-197fe57259b2","Type":"ContainerStarted","Data":"2f8aa7927976fb83f2c31bc31494e97e8dfddd0c063adaef2ef2c94f7c7f39b4"}
Aug 05 17:13:08.201608 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:08.201570    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8gxfg" podStartSLOduration=3.584700721 podStartE2EDuration="22.201540934s" totalImagesPullingTime="18.616840213s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:12:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:13:08.201386477 +0000 UTC m=+22.769888900" watchObservedRunningTime="2026-08-05 17:13:08.201540934 +0000 UTC m=+22.770043355"
Aug 05 17:13:08.201715 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:08.201654    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-128.ec2.internal" podStartSLOduration=21.201646937 podStartE2EDuration="21.201646937s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:12:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:12:51.165427788 +0000 UTC m=+5.733930214" watchObservedRunningTime="2026-08-05 17:13:08.201646937 +0000 UTC m=+22.770149362"
Aug 05 17:13:08.221515 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:08.221477    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kzft4" podStartSLOduration=3.6041771369999998 podStartE2EDuration="22.221467754s" totalImagesPullingTime="18.617290617s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:12:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:13:08.221324621 +0000 UTC m=+22.789827043" watchObservedRunningTime="2026-08-05 17:13:08.221467754 +0000 UTC m=+22.789970209"
Aug 05 17:13:08.267744 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:08.267706    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7wgm8" podStartSLOduration=3.645270918 podStartE2EDuration="22.267691482s" totalImagesPullingTime="18.622420564s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:12:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:13:08.267600487 +0000 UTC m=+22.836102908" watchObservedRunningTime="2026-08-05 17:13:08.267691482 +0000 UTC m=+22.836193903"
Aug 05 17:13:08.286222 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:08.286176    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8zp9w" podStartSLOduration=3.720967942 podStartE2EDuration="22.286160712s" totalImagesPullingTime="18.56519277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:12:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:13:08.286150673 +0000 UTC m=+22.854653094" watchObservedRunningTime="2026-08-05 17:13:08.286160712 +0000 UTC m=+22.854663134"
Aug 05 17:13:08.329141 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:08.329109    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:08.380160 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:08.380024    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8zp9w"
Aug 05 17:13:08.380650 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:08.380628    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8zp9w"
Aug 05 17:13:08.420279 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:08.420170    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:08.494271 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:08.494244    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:08.698110 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:08.698077    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:08.768087 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:08.767977    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:08.996634 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:08.996594    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjb99"
Aug 05 17:13:08.996814 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:08.996734    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjb99" podUID="eb450465-98ef-415c-b5a3-83c3ed6efb16"
Aug 05 17:13:09.203214 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:09.203178    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q69wj_d8e22937-0209-4cf9-b262-dacb99128703/ovn-acl-logging/0.log"
Aug 05 17:13:09.204033 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:09.203601    2580 generic.go:356] "Generic (PLEG): container finished" podID="d8e22937-0209-4cf9-b262-dacb99128703" containerID="fa0e44d590c13701267aeb389b70849b3f99f03254b3a6cda0f6a470f4e6ae7c" exitCode=1
Aug 05 17:13:09.204033 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:09.203682    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q69wj" event={"ID":"d8e22937-0209-4cf9-b262-dacb99128703","Type":"ContainerDied","Data":"fa0e44d590c13701267aeb389b70849b3f99f03254b3a6cda0f6a470f4e6ae7c"}
Aug 05 17:13:09.204033 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:09.203791    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q69wj" event={"ID":"d8e22937-0209-4cf9-b262-dacb99128703","Type":"ContainerStarted","Data":"635ae00da699d12ea4315e350763403bee67db93599a25e3628e4aeec93b720b"}
Aug 05 17:13:09.204033 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:09.203841    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q69wj" event={"ID":"d8e22937-0209-4cf9-b262-dacb99128703","Type":"ContainerStarted","Data":"8fb718ebf29a39329eb550d2091157f8a60c44cc2e2867ff0111a0e3aa54330a"}
Aug 05 17:13:09.204033 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:09.203881    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q69wj" event={"ID":"d8e22937-0209-4cf9-b262-dacb99128703","Type":"ContainerStarted","Data":"be46114916676c57d4852a575ab9e5a5531aea799c6bcbaec0c9fe9105db42cd"}
Aug 05 17:13:09.204033 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:09.203915    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q69wj" event={"ID":"d8e22937-0209-4cf9-b262-dacb99128703","Type":"ContainerStarted","Data":"3f1ce8ff985657159f023f7b14b9805f2c790ac88ad9be2bbc3ffa973408e2d9"}
Aug 05 17:13:09.205327 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:09.205301    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nws8z" event={"ID":"0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3","Type":"ContainerStarted","Data":"250ac99e880f9fc11569c74bcc4f8906e48a7f586441540d4fdcb49521551014"}
Aug 05 17:13:09.207426 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:09.207397    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pfqnr" event={"ID":"14800fd4-965e-422e-b8dd-8faf2116ac06","Type":"ContainerStarted","Data":"4f9e093d556a08dc8d30f4e3f7b3cfe6b2c42cf39842db037fe5c1ddcc5055df"}
Aug 05 17:13:09.207980 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:09.207959    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8zp9w"
Aug 05 17:13:09.208454 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:09.208434    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8zp9w"
Aug 05 17:13:09.227166 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:09.227101    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-nws8z" podStartSLOduration=4.064844868 podStartE2EDuration="23.227080667s" totalImagesPullingTime="19.162235799s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:12:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:13:09.226649414 +0000 UTC m=+23.795151836" watchObservedRunningTime="2026-08-05 17:13:09.227080667 +0000 UTC m=+23.795583090"
Aug 05 17:13:09.242928 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:09.242860    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pfqnr" podStartSLOduration=4.668730994 podStartE2EDuration="23.242840399s" totalImagesPullingTime="18.574109405s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:12:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:13:09.242722603 +0000 UTC m=+23.811225027" watchObservedRunningTime="2026-08-05 17:13:09.242840399 +0000 UTC m=+23.811342822"
Aug 05 17:13:09.369028 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:09.368934    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:09.468423 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:09.468382    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:09.606569 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:09.606509    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:09.661655 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:09.661631    2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Aug 05 17:13:09.839165 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:09.839037    2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-05T17:13:09.661647892Z","UUID":"ddcc5566-69cd-415a-b9cf-5f8a3042f684","Handler":null,"Name":"","Endpoint":""}
Aug 05 17:13:09.840957 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:09.840927    2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Aug 05 17:13:09.841102 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:09.840975    2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Aug 05 17:13:09.996794 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:09.996694    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j48xm"
Aug 05 17:13:09.996952 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:09.996694    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g5w9"
Aug 05 17:13:09.996952 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:09.996859    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j48xm" podUID="0746144f-9064-48d7-ad22-f33bbbc3c16e"
Aug 05 17:13:09.996952 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:09.996924    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g5w9" podUID="8e53ac33-f7e0-491b-a0fa-3a08b3eb6175"
Aug 05 17:13:10.011643 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:10.011613    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:10.112159 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:10.112128    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:10.213170 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:10.213126    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv2br" event={"ID":"feca036a-6aec-43c5-a206-81bd86431621","Type":"ContainerStarted","Data":"1fbbb0f7e82b11bd6dbb4f3074d4987744f5c8f9ad5d51c7c8da5ebe127efd3c"}
Aug 05 17:13:10.391392 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:10.391296    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:10.475537 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:10.475496    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:10.804207 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:10.804158    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:10.871909 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:10.871865    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:10.966368 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:10.966290    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:10.996460 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:10.996426    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjb99"
Aug 05 17:13:10.996658 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:10.996547    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjb99" podUID="eb450465-98ef-415c-b5a3-83c3ed6efb16"
Aug 05 17:13:11.067141 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:11.067104    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:11.214590 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:11.214543    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:11.218153 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:11.218087    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q69wj_d8e22937-0209-4cf9-b262-dacb99128703/ovn-acl-logging/0.log"
Aug 05 17:13:11.218679 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:11.218655    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q69wj" event={"ID":"d8e22937-0209-4cf9-b262-dacb99128703","Type":"ContainerStarted","Data":"8d5a32fcdb853f5a36af67afdb5f8913d392483b01c86da37578acd77639256a"}
Aug 05 17:13:11.221070 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:11.221043    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv2br" event={"ID":"feca036a-6aec-43c5-a206-81bd86431621","Type":"ContainerStarted","Data":"31c65d49d14ea51716af433aa47f650ac8e0700f995b675188ff9290412a36ee"}
Aug 05 17:13:11.251326 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:11.251274    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vv2br" podStartSLOduration=4.439702594 podStartE2EDuration="25.251258906s" totalImagesPullingTime="20.811556312s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:12:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:13:11.251102342 +0000 UTC m=+25.819604777" watchObservedRunningTime="2026-08-05 17:13:11.251258906 +0000 UTC m=+25.819761327"
Aug 05 17:13:11.315519 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:11.315484    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:11.996703 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:11.996659    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j48xm"
Aug 05 17:13:11.996888 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:11.996660    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g5w9"
Aug 05 17:13:11.996888 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:11.996818    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j48xm" podUID="0746144f-9064-48d7-ad22-f33bbbc3c16e"
Aug 05 17:13:11.997015 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:11.996879    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g5w9" podUID="8e53ac33-f7e0-491b-a0fa-3a08b3eb6175"
Aug 05 17:13:12.996903 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:12.996636    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjb99"
Aug 05 17:13:12.997544 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:12.996937    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjb99" podUID="eb450465-98ef-415c-b5a3-83c3ed6efb16"
Aug 05 17:13:13.227634 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:13.227603    2580 generic.go:356] "Generic (PLEG): container finished" podID="3ae8f50f-82eb-4c86-9ea5-6fe09014fa90" containerID="71cec157a8ffbeca494aaf9b82a673e602034e74b75446afae02c672e81409ed" exitCode=0
Aug 05 17:13:13.227799 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:13.227696    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fg62p" event={"ID":"3ae8f50f-82eb-4c86-9ea5-6fe09014fa90","Type":"ContainerDied","Data":"71cec157a8ffbeca494aaf9b82a673e602034e74b75446afae02c672e81409ed"}
Aug 05 17:13:13.231247 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:13.231226    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q69wj_d8e22937-0209-4cf9-b262-dacb99128703/ovn-acl-logging/0.log"
Aug 05 17:13:13.231645 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:13.231620    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q69wj" event={"ID":"d8e22937-0209-4cf9-b262-dacb99128703","Type":"ContainerStarted","Data":"5e4213ff2aa96b787ee132e101baf4f188035b162b1ba72d2633b574d3218ab6"}
Aug 05 17:13:13.231922 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:13.231902    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:13:13.232186 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:13.232169    2580 scope.go:117] "RemoveContainer" containerID="fa0e44d590c13701267aeb389b70849b3f99f03254b3a6cda0f6a470f4e6ae7c"
Aug 05 17:13:13.250627 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:13.250567    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:13:13.711358 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:13.711264    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:13:13.999322 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:13.998541    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j48xm"
Aug 05 17:13:13.999322 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:13.998925    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j48xm" podUID="0746144f-9064-48d7-ad22-f33bbbc3c16e"
Aug 05 17:13:13.999322 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:13.999117    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g5w9"
Aug 05 17:13:13.999322 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:13.999202    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g5w9" podUID="8e53ac33-f7e0-491b-a0fa-3a08b3eb6175"
Aug 05 17:13:14.236059 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:14.235959    2580 generic.go:356] "Generic (PLEG): container finished" podID="3ae8f50f-82eb-4c86-9ea5-6fe09014fa90" containerID="59960d9c477482a1562d7c3104a1378030791fcd3a2ce3da36ec405b2b3e9551" exitCode=0
Aug 05 17:13:14.236220 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:14.236053    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fg62p" event={"ID":"3ae8f50f-82eb-4c86-9ea5-6fe09014fa90","Type":"ContainerDied","Data":"59960d9c477482a1562d7c3104a1378030791fcd3a2ce3da36ec405b2b3e9551"}
Aug 05 17:13:14.239979 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:14.239956    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q69wj_d8e22937-0209-4cf9-b262-dacb99128703/ovn-acl-logging/0.log"
Aug 05 17:13:14.240379 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:14.240352    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q69wj" event={"ID":"d8e22937-0209-4cf9-b262-dacb99128703","Type":"ContainerStarted","Data":"2f94c10b064f96deeb248822b420f5304f1b1b7475a1d58dcd554007dab423d6"}
Aug 05 17:13:14.240668 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:14.240646    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:13:14.257327 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:14.257299    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:13:14.291710 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:14.291642    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-q69wj" podStartSLOduration=9.633336407 podStartE2EDuration="28.291621681s" totalImagesPullingTime="18.658285274s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:12:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:13:14.291183638 +0000 UTC m=+28.859686061" watchObservedRunningTime="2026-08-05 17:13:14.291621681 +0000 UTC m=+28.860124102"
Aug 05 17:13:14.996821 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:14.996774    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjb99"
Aug 05 17:13:14.996975 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:14.996883    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjb99" podUID="eb450465-98ef-415c-b5a3-83c3ed6efb16"
Aug 05 17:13:15.039988 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:15.039951    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fjb99"]
Aug 05 17:13:15.048356 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:15.048282    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-j48xm"]
Aug 05 17:13:15.048480 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:15.048387    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j48xm"
Aug 05 17:13:15.048521 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:15.048479    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j48xm" podUID="0746144f-9064-48d7-ad22-f33bbbc3c16e"
Aug 05 17:13:15.074974 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:15.074867    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8g5w9"]
Aug 05 17:13:15.075160 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:15.075079    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g5w9"
Aug 05 17:13:15.075287 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:15.075231    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g5w9" podUID="8e53ac33-f7e0-491b-a0fa-3a08b3eb6175"
Aug 05 17:13:15.245034 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:15.245001    2580 generic.go:356] "Generic (PLEG): container finished" podID="3ae8f50f-82eb-4c86-9ea5-6fe09014fa90" containerID="35bba0351dc1db2bf9916b6480917ff4a1510375d4b675308959fe1d5a7c7bb4" exitCode=0
Aug 05 17:13:15.245184 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:15.245090    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fg62p" event={"ID":"3ae8f50f-82eb-4c86-9ea5-6fe09014fa90","Type":"ContainerDied","Data":"35bba0351dc1db2bf9916b6480917ff4a1510375d4b675308959fe1d5a7c7bb4"}
Aug 05 17:13:15.245502 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:15.245480    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjb99"
Aug 05 17:13:15.245636 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:15.245617    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjb99" podUID="eb450465-98ef-415c-b5a3-83c3ed6efb16"
Aug 05 17:13:16.996669 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:16.996628    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g5w9"
Aug 05 17:13:16.996669 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:16.996668    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j48xm"
Aug 05 17:13:16.997182 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:16.996747    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjb99"
Aug 05 17:13:16.997182 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:16.996753    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g5w9" podUID="8e53ac33-f7e0-491b-a0fa-3a08b3eb6175"
Aug 05 17:13:16.997182 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:16.996852    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjb99" podUID="eb450465-98ef-415c-b5a3-83c3ed6efb16"
Aug 05 17:13:16.997182 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:16.996931    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j48xm" podUID="0746144f-9064-48d7-ad22-f33bbbc3c16e"
Aug 05 17:13:17.118373 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:17.118284    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:17.342369 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:17.342315    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:18.996912 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:18.996645    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g5w9"
Aug 05 17:13:18.997353 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:18.996655    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j48xm"
Aug 05 17:13:18.997353 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:18.997020    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g5w9" podUID="8e53ac33-f7e0-491b-a0fa-3a08b3eb6175"
Aug 05 17:13:18.997353 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:18.996655    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjb99"
Aug 05 17:13:18.997353 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:18.997119    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j48xm" podUID="0746144f-9064-48d7-ad22-f33bbbc3c16e"
Aug 05 17:13:18.997353 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:18.997162    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjb99" podUID="eb450465-98ef-415c-b5a3-83c3ed6efb16"
Aug 05 17:13:19.526342 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:19.526310    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e53ac33-f7e0-491b-a0fa-3a08b3eb6175-original-pull-secret\") pod \"global-pull-secret-syncer-8g5w9\" (UID: \"8e53ac33-f7e0-491b-a0fa-3a08b3eb6175\") " pod="kube-system/global-pull-secret-syncer-8g5w9"
Aug 05 17:13:19.526603 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:19.526370    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0746144f-9064-48d7-ad22-f33bbbc3c16e-metrics-certs\") pod \"network-metrics-daemon-j48xm\" (UID: \"0746144f-9064-48d7-ad22-f33bbbc3c16e\") " pod="openshift-multus/network-metrics-daemon-j48xm"
Aug 05 17:13:19.526603 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:19.526465    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 17:13:19.526603 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:19.526467    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 17:13:19.526603 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:19.526523    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0746144f-9064-48d7-ad22-f33bbbc3c16e-metrics-certs podName:0746144f-9064-48d7-ad22-f33bbbc3c16e nodeName:}" failed. No retries permitted until 2026-08-05 17:13:51.526506709 +0000 UTC m=+66.095009110 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0746144f-9064-48d7-ad22-f33bbbc3c16e-metrics-certs") pod "network-metrics-daemon-j48xm" (UID: "0746144f-9064-48d7-ad22-f33bbbc3c16e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 17:13:19.526603 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:19.526580    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e53ac33-f7e0-491b-a0fa-3a08b3eb6175-original-pull-secret podName:8e53ac33-f7e0-491b-a0fa-3a08b3eb6175 nodeName:}" failed. No retries permitted until 2026-08-05 17:13:51.526530589 +0000 UTC m=+66.095032989 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e53ac33-f7e0-491b-a0fa-3a08b3eb6175-original-pull-secret") pod "global-pull-secret-syncer-8g5w9" (UID: "8e53ac33-f7e0-491b-a0fa-3a08b3eb6175") : object "kube-system"/"original-pull-secret" not registered
Aug 05 17:13:19.627643 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:19.627609    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr4fg\" (UniqueName: \"kubernetes.io/projected/eb450465-98ef-415c-b5a3-83c3ed6efb16-kube-api-access-vr4fg\") pod \"network-check-target-fjb99\" (UID: \"eb450465-98ef-415c-b5a3-83c3ed6efb16\") " pod="openshift-network-diagnostics/network-check-target-fjb99"
Aug 05 17:13:19.627796 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:19.627750    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 17:13:19.627796 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:19.627763    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 17:13:19.627796 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:19.627772    2580 projected.go:196] Error preparing data for projected volume kube-api-access-vr4fg for pod openshift-network-diagnostics/network-check-target-fjb99: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 17:13:19.627899 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:19.627819    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb450465-98ef-415c-b5a3-83c3ed6efb16-kube-api-access-vr4fg podName:eb450465-98ef-415c-b5a3-83c3ed6efb16 nodeName:}" failed. No retries permitted until 2026-08-05 17:13:51.627806049 +0000 UTC m=+66.196308448 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vr4fg" (UniqueName: "kubernetes.io/projected/eb450465-98ef-415c-b5a3-83c3ed6efb16-kube-api-access-vr4fg") pod "network-check-target-fjb99" (UID: "eb450465-98ef-415c-b5a3-83c3ed6efb16") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 17:13:20.259122 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:20.259035    2580 generic.go:356] "Generic (PLEG): container finished" podID="3ae8f50f-82eb-4c86-9ea5-6fe09014fa90" containerID="443ae1eb9618f4227f81648434adf22e8295481580eb798f869cc048800cea01" exitCode=0
Aug 05 17:13:20.259122 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:20.259088    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fg62p" event={"ID":"3ae8f50f-82eb-4c86-9ea5-6fe09014fa90","Type":"ContainerDied","Data":"443ae1eb9618f4227f81648434adf22e8295481580eb798f869cc048800cea01"}
Aug 05 17:13:20.996835 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:20.996746    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j48xm"
Aug 05 17:13:20.996835 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:20.996793    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjb99"
Aug 05 17:13:20.997017 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:20.996743    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g5w9"
Aug 05 17:13:20.997017 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:20.996877    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j48xm" podUID="0746144f-9064-48d7-ad22-f33bbbc3c16e"
Aug 05 17:13:20.997017 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:20.996940    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8g5w9" podUID="8e53ac33-f7e0-491b-a0fa-3a08b3eb6175"
Aug 05 17:13:20.997017 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:20.996998    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fjb99" podUID="eb450465-98ef-415c-b5a3-83c3ed6efb16"
Aug 05 17:13:21.264752 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:21.264657    2580 generic.go:356] "Generic (PLEG): container finished" podID="3ae8f50f-82eb-4c86-9ea5-6fe09014fa90" containerID="912465f2be24996236cf3e33fc8641a59b3db03d4ee0117b5eb75abd71811d59" exitCode=0
Aug 05 17:13:21.264752 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:21.264738    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fg62p" event={"ID":"3ae8f50f-82eb-4c86-9ea5-6fe09014fa90","Type":"ContainerDied","Data":"912465f2be24996236cf3e33fc8641a59b3db03d4ee0117b5eb75abd71811d59"}
Aug 05 17:13:21.280097 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:21.280075    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-128.ec2.internal" event="NodeReady"
Aug 05 17:13:21.280236 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:21.280217    2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Aug 05 17:13:21.334071 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:21.334027    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gn6t8"]
Aug 05 17:13:21.358416 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:21.358384    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-62z6z"]
Aug 05 17:13:21.358600 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:21.358484    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gn6t8"
Aug 05 17:13:21.360964 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:21.360942    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Aug 05 17:13:21.360964 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:21.360952    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9hnrl\""
Aug 05 17:13:21.361125 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:21.360941    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Aug 05 17:13:21.374790 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:21.374753    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-62z6z"]
Aug 05 17:13:21.374790 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:21.374793    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gn6t8"]
Aug 05 17:13:21.375036 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:21.374906    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-62z6z"
Aug 05 17:13:21.376926 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:21.376902    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4qzqd\""
Aug 05 17:13:21.377046 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:21.376903    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Aug 05 17:13:21.377103 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:21.377064    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Aug 05 17:13:21.377155 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:21.377138    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Aug 05 17:13:21.442776 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:21.442734    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b112783c-bc73-4ad0-b67d-9c4c831a3dc9-config-volume\") pod \"dns-default-gn6t8\" (UID: \"b112783c-bc73-4ad0-b67d-9c4c831a3dc9\") " pod="openshift-dns/dns-default-gn6t8"
Aug 05 17:13:21.442776 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:21.442777    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b112783c-bc73-4ad0-b67d-9c4c831a3dc9-metrics-tls\") pod \"dns-default-gn6t8\" (UID: \"b112783c-bc73-4ad0-b67d-9c4c831a3dc9\") " pod="openshift-dns/dns-default-gn6t8"
Aug 05 17:13:21.442992 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:21.442799    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b112783c-bc73-4ad0-b67d-9c4c831a3dc9-tmp-dir\") pod \"dns-default-gn6t8\" (UID: \"b112783c-bc73-4ad0-b67d-9c4c831a3dc9\") " pod="openshift-dns/dns-default-gn6t8"
Aug 05 17:13:21.442992 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:21.442819    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hrg9\" (UniqueName: \"kubernetes.io/projected/861e1758-06e6-4164-80df-cd5d8fa4a923-kube-api-access-2hrg9\") pod \"ingress-canary-62z6z\" (UID: \"861e1758-06e6-4164-80df-cd5d8fa4a923\") " pod="openshift-ingress-canary/ingress-canary-62z6z"
Aug 05 17:13:21.442992 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:21.442838    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdr7z\" (UniqueName: \"kubernetes.io/projected/b112783c-bc73-4ad0-b67d-9c4c831a3dc9-kube-api-access-gdr7z\") pod \"dns-default-gn6t8\" (UID: \"b112783c-bc73-4ad0-b67d-9c4c831a3dc9\") " pod="openshift-dns/dns-default-gn6t8"
Aug 05 17:13:21.442992 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:21.442881    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/861e1758-06e6-4164-80df-cd5d8fa4a923-cert\") pod \"ingress-canary-62z6z\" (UID: \"861e1758-06e6-4164-80df-cd5d8fa4a923\") " pod="openshift-ingress-canary/ingress-canary-62z6z"
Aug 05 17:13:21.479429 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:21.479392    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:21.543617 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:21.543524    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b112783c-bc73-4ad0-b67d-9c4c831a3dc9-config-volume\") pod \"dns-default-gn6t8\" (UID: \"b112783c-bc73-4ad0-b67d-9c4c831a3dc9\") " pod="openshift-dns/dns-default-gn6t8"
Aug 05 17:13:21.543617 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:21.543582    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b112783c-bc73-4ad0-b67d-9c4c831a3dc9-metrics-tls\") pod \"dns-default-gn6t8\" (UID: \"b112783c-bc73-4ad0-b67d-9c4c831a3dc9\") " pod="openshift-dns/dns-default-gn6t8"
Aug 05 17:13:21.543617 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:21.543604    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b112783c-bc73-4ad0-b67d-9c4c831a3dc9-tmp-dir\") pod \"dns-default-gn6t8\" (UID: \"b112783c-bc73-4ad0-b67d-9c4c831a3dc9\") " pod="openshift-dns/dns-default-gn6t8"
Aug 05 17:13:21.543840 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:21.543621    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hrg9\" (UniqueName: \"kubernetes.io/projected/861e1758-06e6-4164-80df-cd5d8fa4a923-kube-api-access-2hrg9\") pod \"ingress-canary-62z6z\" (UID: \"861e1758-06e6-4164-80df-cd5d8fa4a923\") " pod="openshift-ingress-canary/ingress-canary-62z6z"
Aug 05 17:13:21.543840 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:21.543638    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdr7z\" (UniqueName: \"kubernetes.io/projected/b112783c-bc73-4ad0-b67d-9c4c831a3dc9-kube-api-access-gdr7z\") pod \"dns-default-gn6t8\" (UID: \"b112783c-bc73-4ad0-b67d-9c4c831a3dc9\") " pod="openshift-dns/dns-default-gn6t8"
Aug 05 17:13:21.543840 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:21.543668    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/861e1758-06e6-4164-80df-cd5d8fa4a923-cert\") pod \"ingress-canary-62z6z\" (UID: \"861e1758-06e6-4164-80df-cd5d8fa4a923\") " pod="openshift-ingress-canary/ingress-canary-62z6z"
Aug 05 17:13:21.543840 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:21.543771    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 17:13:21.543840 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:21.543840    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b112783c-bc73-4ad0-b67d-9c4c831a3dc9-metrics-tls podName:b112783c-bc73-4ad0-b67d-9c4c831a3dc9 nodeName:}" failed. No retries permitted until 2026-08-05 17:13:22.04381922 +0000 UTC m=+36.612321620 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b112783c-bc73-4ad0-b67d-9c4c831a3dc9-metrics-tls") pod "dns-default-gn6t8" (UID: "b112783c-bc73-4ad0-b67d-9c4c831a3dc9") : secret "dns-default-metrics-tls" not found
Aug 05 17:13:21.544055 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:21.544009    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b112783c-bc73-4ad0-b67d-9c4c831a3dc9-tmp-dir\") pod \"dns-default-gn6t8\" (UID: \"b112783c-bc73-4ad0-b67d-9c4c831a3dc9\") " pod="openshift-dns/dns-default-gn6t8"
Aug 05 17:13:21.544233 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:21.544215    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b112783c-bc73-4ad0-b67d-9c4c831a3dc9-config-volume\") pod \"dns-default-gn6t8\" (UID: \"b112783c-bc73-4ad0-b67d-9c4c831a3dc9\") " pod="openshift-dns/dns-default-gn6t8"
Aug 05 17:13:21.548534 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:21.548506    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/861e1758-06e6-4164-80df-cd5d8fa4a923-cert\") pod \"ingress-canary-62z6z\" (UID: \"861e1758-06e6-4164-80df-cd5d8fa4a923\") " pod="openshift-ingress-canary/ingress-canary-62z6z"
Aug 05 17:13:21.553001 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:21.552968    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdr7z\" (UniqueName: \"kubernetes.io/projected/b112783c-bc73-4ad0-b67d-9c4c831a3dc9-kube-api-access-gdr7z\") pod \"dns-default-gn6t8\" (UID: \"b112783c-bc73-4ad0-b67d-9c4c831a3dc9\") " pod="openshift-dns/dns-default-gn6t8"
Aug 05 17:13:21.562749 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:21.562719    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hrg9\" (UniqueName: \"kubernetes.io/projected/861e1758-06e6-4164-80df-cd5d8fa4a923-kube-api-access-2hrg9\") pod \"ingress-canary-62z6z\" (UID: \"861e1758-06e6-4164-80df-cd5d8fa4a923\") " pod="openshift-ingress-canary/ingress-canary-62z6z"
Aug 05 17:13:21.579960 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:21.579922    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:21.690268 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:21.690226    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-62z6z"
Aug 05 17:13:21.880077 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:21.879877    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-62z6z"]
Aug 05 17:13:21.884217 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:13:21.884171    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod861e1758_06e6_4164_80df_cd5d8fa4a923.slice/crio-9f9b306b29e9eaad9f19dc6324555fc3b797d16cdb2e91c7391e04d1c742c83f WatchSource:0}: Error finding container 9f9b306b29e9eaad9f19dc6324555fc3b797d16cdb2e91c7391e04d1c742c83f: Status 404 returned error can't find the container with id 9f9b306b29e9eaad9f19dc6324555fc3b797d16cdb2e91c7391e04d1c742c83f
Aug 05 17:13:22.046721 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:22.046678    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b112783c-bc73-4ad0-b67d-9c4c831a3dc9-metrics-tls\") pod \"dns-default-gn6t8\" (UID: \"b112783c-bc73-4ad0-b67d-9c4c831a3dc9\") " pod="openshift-dns/dns-default-gn6t8"
Aug 05 17:13:22.046899 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:22.046821    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 17:13:22.046899 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:22.046886    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b112783c-bc73-4ad0-b67d-9c4c831a3dc9-metrics-tls podName:b112783c-bc73-4ad0-b67d-9c4c831a3dc9 nodeName:}" failed. No retries permitted until 2026-08-05 17:13:23.046870399 +0000 UTC m=+37.615372800 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b112783c-bc73-4ad0-b67d-9c4c831a3dc9-metrics-tls") pod "dns-default-gn6t8" (UID: "b112783c-bc73-4ad0-b67d-9c4c831a3dc9") : secret "dns-default-metrics-tls" not found
Aug 05 17:13:22.268789 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:22.268686    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-62z6z" event={"ID":"861e1758-06e6-4164-80df-cd5d8fa4a923","Type":"ContainerStarted","Data":"9f9b306b29e9eaad9f19dc6324555fc3b797d16cdb2e91c7391e04d1c742c83f"}
Aug 05 17:13:22.272060 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:22.272033    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fg62p" event={"ID":"3ae8f50f-82eb-4c86-9ea5-6fe09014fa90","Type":"ContainerStarted","Data":"ad0be32fa54ed3244892d45e168cc0f8fa87716883740bfbc952403be289ac9b"}
Aug 05 17:13:22.299588 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:22.299518    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fg62p" podStartSLOduration=7.983162005 podStartE2EDuration="36.299502597s" totalImagesPullingTime="28.316340592s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:12:46 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:13:22.298257211 +0000 UTC m=+36.866759635" watchObservedRunningTime="2026-08-05 17:13:22.299502597 +0000 UTC m=+36.868005019"
Aug 05 17:13:22.431070 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:22.431015    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:22.514167 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:22.514122    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:22.996865 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:22.996833    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j48xm"
Aug 05 17:13:22.997069 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:22.996830    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjb99"
Aug 05 17:13:22.997069 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:22.996829    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g5w9"
Aug 05 17:13:23.000782 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:23.000738    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 05 17:13:23.000934 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:23.000795    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wztxg\""
Aug 05 17:13:23.000934 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:23.000739    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 05 17:13:23.000934 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:23.000747    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 05 17:13:23.000934 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:23.000805    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4hs5f\""
Aug 05 17:13:23.000934 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:23.000748    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 05 17:13:23.054895 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:23.054858    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b112783c-bc73-4ad0-b67d-9c4c831a3dc9-metrics-tls\") pod \"dns-default-gn6t8\" (UID: \"b112783c-bc73-4ad0-b67d-9c4c831a3dc9\") " pod="openshift-dns/dns-default-gn6t8"
Aug 05 17:13:23.055086 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:23.055010    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 17:13:23.055086 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:23.055074    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b112783c-bc73-4ad0-b67d-9c4c831a3dc9-metrics-tls podName:b112783c-bc73-4ad0-b67d-9c4c831a3dc9 nodeName:}" failed. No retries permitted until 2026-08-05 17:13:25.055058007 +0000 UTC m=+39.623560407 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b112783c-bc73-4ad0-b67d-9c4c831a3dc9-metrics-tls") pod "dns-default-gn6t8" (UID: "b112783c-bc73-4ad0-b67d-9c4c831a3dc9") : secret "dns-default-metrics-tls" not found
Aug 05 17:13:25.069853 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:25.069810    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b112783c-bc73-4ad0-b67d-9c4c831a3dc9-metrics-tls\") pod \"dns-default-gn6t8\" (UID: \"b112783c-bc73-4ad0-b67d-9c4c831a3dc9\") " pod="openshift-dns/dns-default-gn6t8"
Aug 05 17:13:25.070222 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:25.069950    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 17:13:25.070222 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:25.070003    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b112783c-bc73-4ad0-b67d-9c4c831a3dc9-metrics-tls podName:b112783c-bc73-4ad0-b67d-9c4c831a3dc9 nodeName:}" failed. No retries permitted until 2026-08-05 17:13:29.06999014 +0000 UTC m=+43.638492540 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b112783c-bc73-4ad0-b67d-9c4c831a3dc9-metrics-tls") pod "dns-default-gn6t8" (UID: "b112783c-bc73-4ad0-b67d-9c4c831a3dc9") : secret "dns-default-metrics-tls" not found
Aug 05 17:13:25.281242 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:25.281206    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-62z6z" event={"ID":"861e1758-06e6-4164-80df-cd5d8fa4a923","Type":"ContainerStarted","Data":"70167c1284a2402c69e7961fd2f90b1b63ece572e2cac511e57727e4586177c9"}
Aug 05 17:13:26.348088 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:26.347892    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:29.100361 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:29.100320    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b112783c-bc73-4ad0-b67d-9c4c831a3dc9-metrics-tls\") pod \"dns-default-gn6t8\" (UID: \"b112783c-bc73-4ad0-b67d-9c4c831a3dc9\") " pod="openshift-dns/dns-default-gn6t8"
Aug 05 17:13:29.100785 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:29.100436    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 17:13:29.100785 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:29.100496    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b112783c-bc73-4ad0-b67d-9c4c831a3dc9-metrics-tls podName:b112783c-bc73-4ad0-b67d-9c4c831a3dc9 nodeName:}" failed. No retries permitted until 2026-08-05 17:13:37.100482179 +0000 UTC m=+51.668984579 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b112783c-bc73-4ad0-b67d-9c4c831a3dc9-metrics-tls") pod "dns-default-gn6t8" (UID: "b112783c-bc73-4ad0-b67d-9c4c831a3dc9") : secret "dns-default-metrics-tls" not found
Aug 05 17:13:30.617415 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:30.617374    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:30.714532 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:30.714485    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:32.233117 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:32.233083    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:32.331244 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:32.331213    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:37.157410 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:37.157368    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b112783c-bc73-4ad0-b67d-9c4c831a3dc9-metrics-tls\") pod \"dns-default-gn6t8\" (UID: \"b112783c-bc73-4ad0-b67d-9c4c831a3dc9\") " pod="openshift-dns/dns-default-gn6t8"
Aug 05 17:13:37.158021 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:37.157533    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 17:13:37.158021 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:37.157633    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b112783c-bc73-4ad0-b67d-9c4c831a3dc9-metrics-tls podName:b112783c-bc73-4ad0-b67d-9c4c831a3dc9 nodeName:}" failed. No retries permitted until 2026-08-05 17:13:53.157611604 +0000 UTC m=+67.726114010 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b112783c-bc73-4ad0-b67d-9c4c831a3dc9-metrics-tls") pod "dns-default-gn6t8" (UID: "b112783c-bc73-4ad0-b67d-9c4c831a3dc9") : secret "dns-default-metrics-tls" not found
Aug 05 17:13:43.087686 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:43.087646    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:43.226909 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:43.226876    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:46.258295 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:46.258256    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q69wj"
Aug 05 17:13:46.305616 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:46.305544    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-62z6z" podStartSLOduration=22.82345142 podStartE2EDuration="25.30552799s" totalImagesPullingTime="2.48207657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:13:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:13:25.301099002 +0000 UTC m=+39.869601424" watchObservedRunningTime="2026-08-05 17:13:46.30552799 +0000 UTC m=+60.874030411"
Aug 05 17:13:46.455958 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:46.455913    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:46.559665 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:46.559591    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:13:51.571389 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:51.571328    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0746144f-9064-48d7-ad22-f33bbbc3c16e-metrics-certs\") pod \"network-metrics-daemon-j48xm\" (UID: \"0746144f-9064-48d7-ad22-f33bbbc3c16e\") " pod="openshift-multus/network-metrics-daemon-j48xm"
Aug 05 17:13:51.571389 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:51.571391    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e53ac33-f7e0-491b-a0fa-3a08b3eb6175-original-pull-secret\") pod \"global-pull-secret-syncer-8g5w9\" (UID: \"8e53ac33-f7e0-491b-a0fa-3a08b3eb6175\") " pod="kube-system/global-pull-secret-syncer-8g5w9"
Aug 05 17:13:51.575584 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:51.575547    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 05 17:13:51.575679 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:51.575660    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 05 17:13:51.582305 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:51.582287    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Aug 05 17:13:51.582357 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:51.582347    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0746144f-9064-48d7-ad22-f33bbbc3c16e-metrics-certs podName:0746144f-9064-48d7-ad22-f33bbbc3c16e nodeName:}" failed. No retries permitted until 2026-08-05 17:14:55.58233092 +0000 UTC m=+130.150833320 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0746144f-9064-48d7-ad22-f33bbbc3c16e-metrics-certs") pod "network-metrics-daemon-j48xm" (UID: "0746144f-9064-48d7-ad22-f33bbbc3c16e") : secret "metrics-daemon-secret" not found
Aug 05 17:13:51.586092 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:51.586062    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e53ac33-f7e0-491b-a0fa-3a08b3eb6175-original-pull-secret\") pod \"global-pull-secret-syncer-8g5w9\" (UID: \"8e53ac33-f7e0-491b-a0fa-3a08b3eb6175\") " pod="kube-system/global-pull-secret-syncer-8g5w9"
Aug 05 17:13:51.672387 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:51.672349    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr4fg\" (UniqueName: \"kubernetes.io/projected/eb450465-98ef-415c-b5a3-83c3ed6efb16-kube-api-access-vr4fg\") pod \"network-check-target-fjb99\" (UID: \"eb450465-98ef-415c-b5a3-83c3ed6efb16\") " pod="openshift-network-diagnostics/network-check-target-fjb99"
Aug 05 17:13:51.675099 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:51.675071    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 05 17:13:51.685263 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:51.685247    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 05 17:13:51.695596 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:51.695572    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr4fg\" (UniqueName: \"kubernetes.io/projected/eb450465-98ef-415c-b5a3-83c3ed6efb16-kube-api-access-vr4fg\") pod \"network-check-target-fjb99\" (UID: \"eb450465-98ef-415c-b5a3-83c3ed6efb16\") " pod="openshift-network-diagnostics/network-check-target-fjb99"
Aug 05 17:13:51.821753 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:51.821656    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wztxg\""
Aug 05 17:13:51.825832 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:51.825810    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8g5w9"
Aug 05 17:13:51.829602 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:51.829583    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fjb99"
Aug 05 17:13:51.977716 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:51.977680    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8g5w9"]
Aug 05 17:13:51.981883 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:13:51.981855    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e53ac33_f7e0_491b_a0fa_3a08b3eb6175.slice/crio-b125a800c4f10c52287b41af4ec544d12e6ac2ae375d2cb262c9758a8881021a WatchSource:0}: Error finding container b125a800c4f10c52287b41af4ec544d12e6ac2ae375d2cb262c9758a8881021a: Status 404 returned error can't find the container with id b125a800c4f10c52287b41af4ec544d12e6ac2ae375d2cb262c9758a8881021a
Aug 05 17:13:51.999701 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:51.999675    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fjb99"]
Aug 05 17:13:52.003309 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:13:52.003286    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb450465_98ef_415c_b5a3_83c3ed6efb16.slice/crio-a301bd058a0acd2a537c469d9369471c09aa66efc631b07c2e6b32e8924ab7b8 WatchSource:0}: Error finding container a301bd058a0acd2a537c469d9369471c09aa66efc631b07c2e6b32e8924ab7b8: Status 404 returned error can't find the container with id a301bd058a0acd2a537c469d9369471c09aa66efc631b07c2e6b32e8924ab7b8
Aug 05 17:13:52.345496 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:52.345456    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8g5w9" event={"ID":"8e53ac33-f7e0-491b-a0fa-3a08b3eb6175","Type":"ContainerStarted","Data":"b125a800c4f10c52287b41af4ec544d12e6ac2ae375d2cb262c9758a8881021a"}
Aug 05 17:13:52.346654 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:52.346619    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fjb99" event={"ID":"eb450465-98ef-415c-b5a3-83c3ed6efb16","Type":"ContainerStarted","Data":"a301bd058a0acd2a537c469d9369471c09aa66efc631b07c2e6b32e8924ab7b8"}
Aug 05 17:13:53.181747 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:53.181699    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b112783c-bc73-4ad0-b67d-9c4c831a3dc9-metrics-tls\") pod \"dns-default-gn6t8\" (UID: \"b112783c-bc73-4ad0-b67d-9c4c831a3dc9\") " pod="openshift-dns/dns-default-gn6t8"
Aug 05 17:13:53.182312 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:53.181870    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 17:13:53.182312 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:13:53.181947    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b112783c-bc73-4ad0-b67d-9c4c831a3dc9-metrics-tls podName:b112783c-bc73-4ad0-b67d-9c4c831a3dc9 nodeName:}" failed. No retries permitted until 2026-08-05 17:14:25.181923823 +0000 UTC m=+99.750426227 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b112783c-bc73-4ad0-b67d-9c4c831a3dc9-metrics-tls") pod "dns-default-gn6t8" (UID: "b112783c-bc73-4ad0-b67d-9c4c831a3dc9") : secret "dns-default-metrics-tls" not found
Aug 05 17:13:56.365062 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:56.365033    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fjb99" event={"ID":"eb450465-98ef-415c-b5a3-83c3ed6efb16","Type":"ContainerStarted","Data":"691f87f5890c71f236d6f5d770fbdcd0df81d10a09812a2143bce2a594aa755d"}
Aug 05 17:13:56.365368 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:56.365151    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fjb99"
Aug 05 17:13:57.369127 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:57.369081    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8g5w9" event={"ID":"8e53ac33-f7e0-491b-a0fa-3a08b3eb6175","Type":"ContainerStarted","Data":"2d1b847ac1c8c2c800ae37006a1c7ff1dfa7bf5b7e220008749261b1ac3cdbb8"}
Aug 05 17:13:57.388685 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:57.388633    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8g5w9" podStartSLOduration=67.09603972 podStartE2EDuration="1m11.388616007s" totalImagesPullingTime="4.292576287s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:12:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:13:57.388027079 +0000 UTC m=+71.956529501" watchObservedRunningTime="2026-08-05 17:13:57.388616007 +0000 UTC m=+71.957118429"
Aug 05 17:13:57.388855 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:13:57.388818    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fjb99" podStartSLOduration=67.123701616 podStartE2EDuration="1m11.388812714s" totalImagesPullingTime="4.265111098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:12:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:13:56.386949663 +0000 UTC m=+70.955452084" watchObservedRunningTime="2026-08-05 17:13:57.388812714 +0000 UTC m=+71.957315135"
Aug 05 17:14:22.288572 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:22.288433    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-bsnxf"]
Aug 05 17:14:22.292680 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:22.292658    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-bsnxf"
Aug 05 17:14:22.295282 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:22.295249    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Aug 05 17:14:22.295447 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:22.295283    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Aug 05 17:14:22.296374 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:22.296354    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-z4bm7\""
Aug 05 17:14:22.297288 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:22.297270    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Aug 05 17:14:22.297396 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:22.297275    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Aug 05 17:14:22.302345 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:22.302324    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-bsnxf"]
Aug 05 17:14:22.388083 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:22.388050    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qf5x\" (UniqueName: \"kubernetes.io/projected/c9058435-3402-4bfd-abca-10a1778d9b49-kube-api-access-2qf5x\") pod \"cluster-monitoring-operator-6f55c4f58d-bsnxf\" (UID: \"c9058435-3402-4bfd-abca-10a1778d9b49\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-bsnxf"
Aug 05 17:14:22.388283 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:22.388123    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c9058435-3402-4bfd-abca-10a1778d9b49-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-bsnxf\" (UID: \"c9058435-3402-4bfd-abca-10a1778d9b49\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-bsnxf"
Aug 05 17:14:22.388283 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:22.388140    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c9058435-3402-4bfd-abca-10a1778d9b49-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-bsnxf\" (UID: \"c9058435-3402-4bfd-abca-10a1778d9b49\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-bsnxf"
Aug 05 17:14:22.489224 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:22.489185    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c9058435-3402-4bfd-abca-10a1778d9b49-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-bsnxf\" (UID: \"c9058435-3402-4bfd-abca-10a1778d9b49\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-bsnxf"
Aug 05 17:14:22.489224 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:22.489223    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c9058435-3402-4bfd-abca-10a1778d9b49-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-bsnxf\" (UID: \"c9058435-3402-4bfd-abca-10a1778d9b49\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-bsnxf"
Aug 05 17:14:22.489466 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:22.489314    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qf5x\" (UniqueName: \"kubernetes.io/projected/c9058435-3402-4bfd-abca-10a1778d9b49-kube-api-access-2qf5x\") pod \"cluster-monitoring-operator-6f55c4f58d-bsnxf\" (UID: \"c9058435-3402-4bfd-abca-10a1778d9b49\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-bsnxf"
Aug 05 17:14:22.489466 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:14:22.489340    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 05 17:14:22.489466 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:14:22.489394    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9058435-3402-4bfd-abca-10a1778d9b49-cluster-monitoring-operator-tls podName:c9058435-3402-4bfd-abca-10a1778d9b49 nodeName:}" failed. No retries permitted until 2026-08-05 17:14:22.989377324 +0000 UTC m=+97.557879723 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c9058435-3402-4bfd-abca-10a1778d9b49-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-bsnxf" (UID: "c9058435-3402-4bfd-abca-10a1778d9b49") : secret "cluster-monitoring-operator-tls" not found
Aug 05 17:14:22.490009 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:22.489989    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c9058435-3402-4bfd-abca-10a1778d9b49-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-bsnxf\" (UID: \"c9058435-3402-4bfd-abca-10a1778d9b49\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-bsnxf"
Aug 05 17:14:22.502829 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:22.502798    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qf5x\" (UniqueName: \"kubernetes.io/projected/c9058435-3402-4bfd-abca-10a1778d9b49-kube-api-access-2qf5x\") pod \"cluster-monitoring-operator-6f55c4f58d-bsnxf\" (UID: \"c9058435-3402-4bfd-abca-10a1778d9b49\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-bsnxf"
Aug 05 17:14:22.580211 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:22.580181    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:22.993889 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:22.993799    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c9058435-3402-4bfd-abca-10a1778d9b49-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-bsnxf\" (UID: \"c9058435-3402-4bfd-abca-10a1778d9b49\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-bsnxf"
Aug 05 17:14:22.994038 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:14:22.993931    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 05 17:14:22.994038 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:14:22.993991    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9058435-3402-4bfd-abca-10a1778d9b49-cluster-monitoring-operator-tls podName:c9058435-3402-4bfd-abca-10a1778d9b49 nodeName:}" failed. No retries permitted until 2026-08-05 17:14:23.993976322 +0000 UTC m=+98.562478723 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c9058435-3402-4bfd-abca-10a1778d9b49-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-bsnxf" (UID: "c9058435-3402-4bfd-abca-10a1778d9b49") : secret "cluster-monitoring-operator-tls" not found
Aug 05 17:14:24.000085 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:24.000050    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c9058435-3402-4bfd-abca-10a1778d9b49-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-bsnxf\" (UID: \"c9058435-3402-4bfd-abca-10a1778d9b49\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-bsnxf"
Aug 05 17:14:24.000431 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:14:24.000164    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 05 17:14:24.000431 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:14:24.000230    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9058435-3402-4bfd-abca-10a1778d9b49-cluster-monitoring-operator-tls podName:c9058435-3402-4bfd-abca-10a1778d9b49 nodeName:}" failed. No retries permitted until 2026-08-05 17:14:26.000213095 +0000 UTC m=+100.568715518 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c9058435-3402-4bfd-abca-10a1778d9b49-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-bsnxf" (UID: "c9058435-3402-4bfd-abca-10a1778d9b49") : secret "cluster-monitoring-operator-tls" not found
Aug 05 17:14:24.525062 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:24.525026    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:25.208790 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:25.208731    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b112783c-bc73-4ad0-b67d-9c4c831a3dc9-metrics-tls\") pod \"dns-default-gn6t8\" (UID: \"b112783c-bc73-4ad0-b67d-9c4c831a3dc9\") " pod="openshift-dns/dns-default-gn6t8"
Aug 05 17:14:25.209192 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:14:25.208887    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 17:14:25.209192 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:14:25.208954    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b112783c-bc73-4ad0-b67d-9c4c831a3dc9-metrics-tls podName:b112783c-bc73-4ad0-b67d-9c4c831a3dc9 nodeName:}" failed. No retries permitted until 2026-08-05 17:15:29.208938827 +0000 UTC m=+163.777441228 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b112783c-bc73-4ad0-b67d-9c4c831a3dc9-metrics-tls") pod "dns-default-gn6t8" (UID: "b112783c-bc73-4ad0-b67d-9c4c831a3dc9") : secret "dns-default-metrics-tls" not found
Aug 05 17:14:26.013588 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:26.013540    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c9058435-3402-4bfd-abca-10a1778d9b49-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-bsnxf\" (UID: \"c9058435-3402-4bfd-abca-10a1778d9b49\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-bsnxf"
Aug 05 17:14:26.013761 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:14:26.013640    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 05 17:14:26.013761 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:14:26.013698    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9058435-3402-4bfd-abca-10a1778d9b49-cluster-monitoring-operator-tls podName:c9058435-3402-4bfd-abca-10a1778d9b49 nodeName:}" failed. No retries permitted until 2026-08-05 17:14:30.013684375 +0000 UTC m=+104.582186774 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c9058435-3402-4bfd-abca-10a1778d9b49-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-bsnxf" (UID: "c9058435-3402-4bfd-abca-10a1778d9b49") : secret "cluster-monitoring-operator-tls" not found
Aug 05 17:14:27.371324 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:27.371295    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fjb99"
Aug 05 17:14:27.427041 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:27.427003    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:27.451178 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:27.451141    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-tr42t"]
Aug 05 17:14:27.454449 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:27.454425    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tr42t"
Aug 05 17:14:27.458748 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:27.458715    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Aug 05 17:14:27.458873 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:27.458765    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Aug 05 17:14:27.458873 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:27.458780    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Aug 05 17:14:27.463331 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:27.463315    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Aug 05 17:14:27.463673 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:27.463658    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-h9fhk\""
Aug 05 17:14:27.475739 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:27.475711    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tr42t"]
Aug 05 17:14:27.524195 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:27.524160    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fa1e6b87-097c-4574-a761-9762d2a8c586-crio-socket\") pod \"insights-runtime-extractor-tr42t\" (UID: \"fa1e6b87-097c-4574-a761-9762d2a8c586\") " pod="openshift-insights/insights-runtime-extractor-tr42t"
Aug 05 17:14:27.524195 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:27.524196    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fa1e6b87-097c-4574-a761-9762d2a8c586-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tr42t\" (UID: \"fa1e6b87-097c-4574-a761-9762d2a8c586\") " pod="openshift-insights/insights-runtime-extractor-tr42t"
Aug 05 17:14:27.524453 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:27.524230    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fa1e6b87-097c-4574-a761-9762d2a8c586-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tr42t\" (UID: \"fa1e6b87-097c-4574-a761-9762d2a8c586\") " pod="openshift-insights/insights-runtime-extractor-tr42t"
Aug 05 17:14:27.524453 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:27.524286    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx7n8\" (UniqueName: \"kubernetes.io/projected/fa1e6b87-097c-4574-a761-9762d2a8c586-kube-api-access-qx7n8\") pod \"insights-runtime-extractor-tr42t\" (UID: \"fa1e6b87-097c-4574-a761-9762d2a8c586\") " pod="openshift-insights/insights-runtime-extractor-tr42t"
Aug 05 17:14:27.524453 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:27.524334    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fa1e6b87-097c-4574-a761-9762d2a8c586-data-volume\") pod \"insights-runtime-extractor-tr42t\" (UID: \"fa1e6b87-097c-4574-a761-9762d2a8c586\") " pod="openshift-insights/insights-runtime-extractor-tr42t"
Aug 05 17:14:27.566951 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:27.566920    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:27.625297 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:27.625215    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fa1e6b87-097c-4574-a761-9762d2a8c586-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tr42t\" (UID: \"fa1e6b87-097c-4574-a761-9762d2a8c586\") " pod="openshift-insights/insights-runtime-extractor-tr42t"
Aug 05 17:14:27.625297 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:27.625259    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx7n8\" (UniqueName: \"kubernetes.io/projected/fa1e6b87-097c-4574-a761-9762d2a8c586-kube-api-access-qx7n8\") pod \"insights-runtime-extractor-tr42t\" (UID: \"fa1e6b87-097c-4574-a761-9762d2a8c586\") " pod="openshift-insights/insights-runtime-extractor-tr42t"
Aug 05 17:14:27.625464 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:14:27.625352    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 05 17:14:27.625464 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:14:27.625437    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fa1e6b87-097c-4574-a761-9762d2a8c586-kube-rbac-proxy-cm podName:fa1e6b87-097c-4574-a761-9762d2a8c586 nodeName:}" failed. No retries permitted until 2026-08-05 17:14:28.125413744 +0000 UTC m=+102.693916158 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fa1e6b87-097c-4574-a761-9762d2a8c586-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tr42t" (UID: "fa1e6b87-097c-4574-a761-9762d2a8c586") : configmap "kube-rbac-proxy" not found
Aug 05 17:14:27.625620 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:27.625598    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fa1e6b87-097c-4574-a761-9762d2a8c586-data-volume\") pod \"insights-runtime-extractor-tr42t\" (UID: \"fa1e6b87-097c-4574-a761-9762d2a8c586\") " pod="openshift-insights/insights-runtime-extractor-tr42t"
Aug 05 17:14:27.625730 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:27.625715    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fa1e6b87-097c-4574-a761-9762d2a8c586-crio-socket\") pod \"insights-runtime-extractor-tr42t\" (UID: \"fa1e6b87-097c-4574-a761-9762d2a8c586\") " pod="openshift-insights/insights-runtime-extractor-tr42t"
Aug 05 17:14:27.625763 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:27.625744    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fa1e6b87-097c-4574-a761-9762d2a8c586-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tr42t\" (UID: \"fa1e6b87-097c-4574-a761-9762d2a8c586\") " pod="openshift-insights/insights-runtime-extractor-tr42t"
Aug 05 17:14:27.625842 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:27.625827    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fa1e6b87-097c-4574-a761-9762d2a8c586-crio-socket\") pod \"insights-runtime-extractor-tr42t\" (UID: \"fa1e6b87-097c-4574-a761-9762d2a8c586\") " pod="openshift-insights/insights-runtime-extractor-tr42t"
Aug 05 17:14:27.625877 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:14:27.625846    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 17:14:27.625915 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:14:27.625906    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa1e6b87-097c-4574-a761-9762d2a8c586-insights-runtime-extractor-tls podName:fa1e6b87-097c-4574-a761-9762d2a8c586 nodeName:}" failed. No retries permitted until 2026-08-05 17:14:28.125889956 +0000 UTC m=+102.694392371 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fa1e6b87-097c-4574-a761-9762d2a8c586-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tr42t" (UID: "fa1e6b87-097c-4574-a761-9762d2a8c586") : secret "insights-runtime-extractor-tls" not found
Aug 05 17:14:27.626011 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:27.625996    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fa1e6b87-097c-4574-a761-9762d2a8c586-data-volume\") pod \"insights-runtime-extractor-tr42t\" (UID: \"fa1e6b87-097c-4574-a761-9762d2a8c586\") " pod="openshift-insights/insights-runtime-extractor-tr42t"
Aug 05 17:14:27.636213 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:27.636185    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx7n8\" (UniqueName: \"kubernetes.io/projected/fa1e6b87-097c-4574-a761-9762d2a8c586-kube-api-access-qx7n8\") pod \"insights-runtime-extractor-tr42t\" (UID: \"fa1e6b87-097c-4574-a761-9762d2a8c586\") " pod="openshift-insights/insights-runtime-extractor-tr42t"
Aug 05 17:14:28.129696 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:28.129654    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fa1e6b87-097c-4574-a761-9762d2a8c586-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tr42t\" (UID: \"fa1e6b87-097c-4574-a761-9762d2a8c586\") " pod="openshift-insights/insights-runtime-extractor-tr42t"
Aug 05 17:14:28.129696 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:28.129706    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fa1e6b87-097c-4574-a761-9762d2a8c586-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tr42t\" (UID: \"fa1e6b87-097c-4574-a761-9762d2a8c586\") " pod="openshift-insights/insights-runtime-extractor-tr42t"
Aug 05 17:14:28.130046 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:14:28.129768    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 05 17:14:28.130046 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:14:28.129817    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fa1e6b87-097c-4574-a761-9762d2a8c586-kube-rbac-proxy-cm podName:fa1e6b87-097c-4574-a761-9762d2a8c586 nodeName:}" failed. No retries permitted until 2026-08-05 17:14:29.129803956 +0000 UTC m=+103.698306355 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fa1e6b87-097c-4574-a761-9762d2a8c586-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tr42t" (UID: "fa1e6b87-097c-4574-a761-9762d2a8c586") : configmap "kube-rbac-proxy" not found
Aug 05 17:14:28.130046 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:14:28.129816    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 17:14:28.130046 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:14:28.129928    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa1e6b87-097c-4574-a761-9762d2a8c586-insights-runtime-extractor-tls podName:fa1e6b87-097c-4574-a761-9762d2a8c586 nodeName:}" failed. No retries permitted until 2026-08-05 17:14:29.129910275 +0000 UTC m=+103.698412675 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fa1e6b87-097c-4574-a761-9762d2a8c586-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tr42t" (UID: "fa1e6b87-097c-4574-a761-9762d2a8c586") : secret "insights-runtime-extractor-tls" not found
Aug 05 17:14:29.127285 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:29.127253    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7wgm8_f4349f2f-ccd4-43c7-bee0-2bb29268387c/dns-node-resolver/0.log"
Aug 05 17:14:29.138591 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:29.138543    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fa1e6b87-097c-4574-a761-9762d2a8c586-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tr42t\" (UID: \"fa1e6b87-097c-4574-a761-9762d2a8c586\") " pod="openshift-insights/insights-runtime-extractor-tr42t"
Aug 05 17:14:29.138666 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:29.138626    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fa1e6b87-097c-4574-a761-9762d2a8c586-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tr42t\" (UID: \"fa1e6b87-097c-4574-a761-9762d2a8c586\") " pod="openshift-insights/insights-runtime-extractor-tr42t"
Aug 05 17:14:29.138701 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:14:29.138690    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 17:14:29.138733 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:14:29.138713    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 05 17:14:29.138765 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:14:29.138751    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa1e6b87-097c-4574-a761-9762d2a8c586-insights-runtime-extractor-tls podName:fa1e6b87-097c-4574-a761-9762d2a8c586 nodeName:}" failed. No retries permitted until 2026-08-05 17:14:31.138734506 +0000 UTC m=+105.707236906 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fa1e6b87-097c-4574-a761-9762d2a8c586-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tr42t" (UID: "fa1e6b87-097c-4574-a761-9762d2a8c586") : secret "insights-runtime-extractor-tls" not found
Aug 05 17:14:29.138810 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:14:29.138772    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fa1e6b87-097c-4574-a761-9762d2a8c586-kube-rbac-proxy-cm podName:fa1e6b87-097c-4574-a761-9762d2a8c586 nodeName:}" failed. No retries permitted until 2026-08-05 17:14:31.138757089 +0000 UTC m=+105.707259492 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fa1e6b87-097c-4574-a761-9762d2a8c586-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tr42t" (UID: "fa1e6b87-097c-4574-a761-9762d2a8c586") : configmap "kube-rbac-proxy" not found
Aug 05 17:14:30.045184 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:30.045136    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c9058435-3402-4bfd-abca-10a1778d9b49-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-bsnxf\" (UID: \"c9058435-3402-4bfd-abca-10a1778d9b49\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-bsnxf"
Aug 05 17:14:30.045370 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:14:30.045293    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 05 17:14:30.045370 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:14:30.045358    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9058435-3402-4bfd-abca-10a1778d9b49-cluster-monitoring-operator-tls podName:c9058435-3402-4bfd-abca-10a1778d9b49 nodeName:}" failed. No retries permitted until 2026-08-05 17:14:38.045342941 +0000 UTC m=+112.613845341 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c9058435-3402-4bfd-abca-10a1778d9b49-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-bsnxf" (UID: "c9058435-3402-4bfd-abca-10a1778d9b49") : secret "cluster-monitoring-operator-tls" not found
Aug 05 17:14:30.129311 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:30.129281    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8gxfg_4bf26f2b-19d6-42f0-81db-423f51c7982e/node-ca/0.log"
Aug 05 17:14:30.929031 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:30.928996    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-62z6z_861e1758-06e6-4164-80df-cd5d8fa4a923/serve-healthcheck-canary/0.log"
Aug 05 17:14:31.151973 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:31.151926    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fa1e6b87-097c-4574-a761-9762d2a8c586-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tr42t\" (UID: \"fa1e6b87-097c-4574-a761-9762d2a8c586\") " pod="openshift-insights/insights-runtime-extractor-tr42t"
Aug 05 17:14:31.152428 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:14:31.152032    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 05 17:14:31.152428 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:14:31.152093    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fa1e6b87-097c-4574-a761-9762d2a8c586-kube-rbac-proxy-cm podName:fa1e6b87-097c-4574-a761-9762d2a8c586 nodeName:}" failed. No retries permitted until 2026-08-05 17:14:35.152076808 +0000 UTC m=+109.720579208 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fa1e6b87-097c-4574-a761-9762d2a8c586-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tr42t" (UID: "fa1e6b87-097c-4574-a761-9762d2a8c586") : configmap "kube-rbac-proxy" not found
Aug 05 17:14:31.152428 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:31.152034    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fa1e6b87-097c-4574-a761-9762d2a8c586-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tr42t\" (UID: \"fa1e6b87-097c-4574-a761-9762d2a8c586\") " pod="openshift-insights/insights-runtime-extractor-tr42t"
Aug 05 17:14:31.152428 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:14:31.152128    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 17:14:31.152428 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:14:31.152204    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa1e6b87-097c-4574-a761-9762d2a8c586-insights-runtime-extractor-tls podName:fa1e6b87-097c-4574-a761-9762d2a8c586 nodeName:}" failed. No retries permitted until 2026-08-05 17:14:35.152186353 +0000 UTC m=+109.720688760 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fa1e6b87-097c-4574-a761-9762d2a8c586-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tr42t" (UID: "fa1e6b87-097c-4574-a761-9762d2a8c586") : secret "insights-runtime-extractor-tls" not found
Aug 05 17:14:32.123860 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.123824    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-cqj2n"]
Aug 05 17:14:32.126896 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.126880    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-cqj2n"
Aug 05 17:14:32.129333 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.129303    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Aug 05 17:14:32.129461 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.129309    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Aug 05 17:14:32.129674 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.129658    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Aug 05 17:14:32.130274 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.130257    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Aug 05 17:14:32.131274 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.131253    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-x9m9h\""
Aug 05 17:14:32.135635 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.135618    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Aug 05 17:14:32.138618 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.138600    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-cqj2n"]
Aug 05 17:14:32.226470 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.226439    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-cfhjn"]
Aug 05 17:14:32.228427 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.228411    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-cfhjn"
Aug 05 17:14:32.231014 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.230964    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-gn2gd"]
Aug 05 17:14:32.231610 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.231590    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-kz7wg\""
Aug 05 17:14:32.231790 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.231647    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Aug 05 17:14:32.233072 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.233017    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gn2gd"
Aug 05 17:14:32.233498 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.233475    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-ww266"]
Aug 05 17:14:32.234117 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.234093    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Aug 05 17:14:32.235071 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.235056    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Aug 05 17:14:32.235155 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.235126    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Aug 05 17:14:32.235284 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.235266    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-ww266"
Aug 05 17:14:32.235501 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.235479    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Aug 05 17:14:32.235855 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.235831    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Aug 05 17:14:32.236033 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.235983    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-pxw8r\""
Aug 05 17:14:32.237949 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.237931    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Aug 05 17:14:32.238128 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.238106    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Aug 05 17:14:32.238249 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.238009    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Aug 05 17:14:32.238352 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.238019    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Aug 05 17:14:32.238486 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.237947    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-cvd95\""
Aug 05 17:14:32.245163 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.245140    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-cfhjn"]
Aug 05 17:14:32.246132 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.246104    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-gn2gd"]
Aug 05 17:14:32.259298 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.259273    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdbn2\" (UniqueName: \"kubernetes.io/projected/17a2b686-e228-4d00-9656-8b03b65f2e29-kube-api-access-jdbn2\") pod \"console-operator-5ccd6b445f-cqj2n\" (UID: \"17a2b686-e228-4d00-9656-8b03b65f2e29\") " pod="openshift-console-operator/console-operator-5ccd6b445f-cqj2n"
Aug 05 17:14:32.259411 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.259305    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/17a2b686-e228-4d00-9656-8b03b65f2e29-config\") pod \"console-operator-5ccd6b445f-cqj2n\" (UID: \"17a2b686-e228-4d00-9656-8b03b65f2e29\") " pod="openshift-console-operator/console-operator-5ccd6b445f-cqj2n"
Aug 05 17:14:32.259411 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.259337    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/17a2b686-e228-4d00-9656-8b03b65f2e29-serving-cert\") pod \"console-operator-5ccd6b445f-cqj2n\" (UID: \"17a2b686-e228-4d00-9656-8b03b65f2e29\") " pod="openshift-console-operator/console-operator-5ccd6b445f-cqj2n"
Aug 05 17:14:32.259411 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.259382    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/17a2b686-e228-4d00-9656-8b03b65f2e29-trusted-ca\") pod \"console-operator-5ccd6b445f-cqj2n\" (UID: \"17a2b686-e228-4d00-9656-8b03b65f2e29\") " pod="openshift-console-operator/console-operator-5ccd6b445f-cqj2n"
Aug 05 17:14:32.261101 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.261078    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-ww266"]
Aug 05 17:14:32.360767 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.360728    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/17a2b686-e228-4d00-9656-8b03b65f2e29-serving-cert\") pod \"console-operator-5ccd6b445f-cqj2n\" (UID: \"17a2b686-e228-4d00-9656-8b03b65f2e29\") " pod="openshift-console-operator/console-operator-5ccd6b445f-cqj2n"
Aug 05 17:14:32.360767 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.360763    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/17a2b686-e228-4d00-9656-8b03b65f2e29-trusted-ca\") pod \"console-operator-5ccd6b445f-cqj2n\" (UID: \"17a2b686-e228-4d00-9656-8b03b65f2e29\") " pod="openshift-console-operator/console-operator-5ccd6b445f-cqj2n"
Aug 05 17:14:32.360991 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.360794    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljtx8\" (UniqueName: \"kubernetes.io/projected/7c888748-b317-44e6-a007-a83edb451861-kube-api-access-ljtx8\") pod \"service-ca-operator-784f97bcf6-gn2gd\" (UID: \"7c888748-b317-44e6-a007-a83edb451861\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gn2gd"
Aug 05 17:14:32.360991 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.360937    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2dp4\" (UniqueName: \"kubernetes.io/projected/91386cb4-60c6-4513-8cb7-39682f9fc29e-kube-api-access-j2dp4\") pod \"kube-storage-version-migrator-operator-7878f4b88c-ww266\" (UID: \"91386cb4-60c6-4513-8cb7-39682f9fc29e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-ww266"
Aug 05 17:14:32.360991 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.360988    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdbn2\" (UniqueName: \"kubernetes.io/projected/17a2b686-e228-4d00-9656-8b03b65f2e29-kube-api-access-jdbn2\") pod \"console-operator-5ccd6b445f-cqj2n\" (UID: \"17a2b686-e228-4d00-9656-8b03b65f2e29\") " pod="openshift-console-operator/console-operator-5ccd6b445f-cqj2n"
Aug 05 17:14:32.361098 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.361007    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hpdv\" (UniqueName: \"kubernetes.io/projected/fbe3e762-befb-4b44-8948-cec992999e97-kube-api-access-5hpdv\") pod \"volume-data-source-validator-5b8776669-cfhjn\" (UID: \"fbe3e762-befb-4b44-8948-cec992999e97\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-cfhjn"
Aug 05 17:14:32.361098 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.361032    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/91386cb4-60c6-4513-8cb7-39682f9fc29e-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-ww266\" (UID: \"91386cb4-60c6-4513-8cb7-39682f9fc29e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-ww266"
Aug 05 17:14:32.361098 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.361063    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/17a2b686-e228-4d00-9656-8b03b65f2e29-config\") pod \"console-operator-5ccd6b445f-cqj2n\" (UID: \"17a2b686-e228-4d00-9656-8b03b65f2e29\") " pod="openshift-console-operator/console-operator-5ccd6b445f-cqj2n"
Aug 05 17:14:32.361241 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.361214    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7c888748-b317-44e6-a007-a83edb451861-config\") pod \"service-ca-operator-784f97bcf6-gn2gd\" (UID: \"7c888748-b317-44e6-a007-a83edb451861\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gn2gd"
Aug 05 17:14:32.361304 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.361265    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/91386cb4-60c6-4513-8cb7-39682f9fc29e-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-ww266\" (UID: \"91386cb4-60c6-4513-8cb7-39682f9fc29e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-ww266"
Aug 05 17:14:32.361304 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.361296    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7c888748-b317-44e6-a007-a83edb451861-serving-cert\") pod \"service-ca-operator-784f97bcf6-gn2gd\" (UID: \"7c888748-b317-44e6-a007-a83edb451861\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gn2gd"
Aug 05 17:14:32.361693 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.361670    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/17a2b686-e228-4d00-9656-8b03b65f2e29-config\") pod \"console-operator-5ccd6b445f-cqj2n\" (UID: \"17a2b686-e228-4d00-9656-8b03b65f2e29\") " pod="openshift-console-operator/console-operator-5ccd6b445f-cqj2n"
Aug 05 17:14:32.361847 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.361717    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/17a2b686-e228-4d00-9656-8b03b65f2e29-trusted-ca\") pod \"console-operator-5ccd6b445f-cqj2n\" (UID: \"17a2b686-e228-4d00-9656-8b03b65f2e29\") " pod="openshift-console-operator/console-operator-5ccd6b445f-cqj2n"
Aug 05 17:14:32.363343 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.363325    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/17a2b686-e228-4d00-9656-8b03b65f2e29-serving-cert\") pod \"console-operator-5ccd6b445f-cqj2n\" (UID: \"17a2b686-e228-4d00-9656-8b03b65f2e29\") " pod="openshift-console-operator/console-operator-5ccd6b445f-cqj2n"
Aug 05 17:14:32.370584 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.370548    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdbn2\" (UniqueName: \"kubernetes.io/projected/17a2b686-e228-4d00-9656-8b03b65f2e29-kube-api-access-jdbn2\") pod \"console-operator-5ccd6b445f-cqj2n\" (UID: \"17a2b686-e228-4d00-9656-8b03b65f2e29\") " pod="openshift-console-operator/console-operator-5ccd6b445f-cqj2n"
Aug 05 17:14:32.436691 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.436602    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-cqj2n"
Aug 05 17:14:32.462655 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.462622    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljtx8\" (UniqueName: \"kubernetes.io/projected/7c888748-b317-44e6-a007-a83edb451861-kube-api-access-ljtx8\") pod \"service-ca-operator-784f97bcf6-gn2gd\" (UID: \"7c888748-b317-44e6-a007-a83edb451861\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gn2gd"
Aug 05 17:14:32.462830 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.462690    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2dp4\" (UniqueName: \"kubernetes.io/projected/91386cb4-60c6-4513-8cb7-39682f9fc29e-kube-api-access-j2dp4\") pod \"kube-storage-version-migrator-operator-7878f4b88c-ww266\" (UID: \"91386cb4-60c6-4513-8cb7-39682f9fc29e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-ww266"
Aug 05 17:14:32.462830 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.462738    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hpdv\" (UniqueName: \"kubernetes.io/projected/fbe3e762-befb-4b44-8948-cec992999e97-kube-api-access-5hpdv\") pod \"volume-data-source-validator-5b8776669-cfhjn\" (UID: \"fbe3e762-befb-4b44-8948-cec992999e97\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-cfhjn"
Aug 05 17:14:32.462830 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.462754    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/91386cb4-60c6-4513-8cb7-39682f9fc29e-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-ww266\" (UID: \"91386cb4-60c6-4513-8cb7-39682f9fc29e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-ww266"
Aug 05 17:14:32.462830 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.462779    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7c888748-b317-44e6-a007-a83edb451861-config\") pod \"service-ca-operator-784f97bcf6-gn2gd\" (UID: \"7c888748-b317-44e6-a007-a83edb451861\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gn2gd"
Aug 05 17:14:32.462830 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.462805    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/91386cb4-60c6-4513-8cb7-39682f9fc29e-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-ww266\" (UID: \"91386cb4-60c6-4513-8cb7-39682f9fc29e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-ww266"
Aug 05 17:14:32.463087 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.462830    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7c888748-b317-44e6-a007-a83edb451861-serving-cert\") pod \"service-ca-operator-784f97bcf6-gn2gd\" (UID: \"7c888748-b317-44e6-a007-a83edb451861\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gn2gd"
Aug 05 17:14:32.463504 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.463468    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/91386cb4-60c6-4513-8cb7-39682f9fc29e-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-ww266\" (UID: \"91386cb4-60c6-4513-8cb7-39682f9fc29e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-ww266"
Aug 05 17:14:32.463685 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.463538    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7c888748-b317-44e6-a007-a83edb451861-config\") pod \"service-ca-operator-784f97bcf6-gn2gd\" (UID: \"7c888748-b317-44e6-a007-a83edb451861\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gn2gd"
Aug 05 17:14:32.465351 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.465324    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7c888748-b317-44e6-a007-a83edb451861-serving-cert\") pod \"service-ca-operator-784f97bcf6-gn2gd\" (UID: \"7c888748-b317-44e6-a007-a83edb451861\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gn2gd"
Aug 05 17:14:32.465439 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.465324    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/91386cb4-60c6-4513-8cb7-39682f9fc29e-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-ww266\" (UID: \"91386cb4-60c6-4513-8cb7-39682f9fc29e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-ww266"
Aug 05 17:14:32.472790 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.472746    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljtx8\" (UniqueName: \"kubernetes.io/projected/7c888748-b317-44e6-a007-a83edb451861-kube-api-access-ljtx8\") pod \"service-ca-operator-784f97bcf6-gn2gd\" (UID: \"7c888748-b317-44e6-a007-a83edb451861\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gn2gd"
Aug 05 17:14:32.472992 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.472970    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hpdv\" (UniqueName: \"kubernetes.io/projected/fbe3e762-befb-4b44-8948-cec992999e97-kube-api-access-5hpdv\") pod \"volume-data-source-validator-5b8776669-cfhjn\" (UID: \"fbe3e762-befb-4b44-8948-cec992999e97\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-cfhjn"
Aug 05 17:14:32.473578 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.473543    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2dp4\" (UniqueName: \"kubernetes.io/projected/91386cb4-60c6-4513-8cb7-39682f9fc29e-kube-api-access-j2dp4\") pod \"kube-storage-version-migrator-operator-7878f4b88c-ww266\" (UID: \"91386cb4-60c6-4513-8cb7-39682f9fc29e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-ww266"
Aug 05 17:14:32.539445 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.539417    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-cfhjn"
Aug 05 17:14:32.547228 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.547202    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gn2gd"
Aug 05 17:14:32.553595 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.553549    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-ww266"
Aug 05 17:14:32.570817 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.570785    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-cqj2n"]
Aug 05 17:14:32.689892 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.689240    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-cfhjn"]
Aug 05 17:14:32.694040 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:14:32.694010    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbe3e762_befb_4b44_8948_cec992999e97.slice/crio-07eed8cd9b5b49f828fdc3e2a4ea2ff96d20728d042a30ad9ccea235864e2272 WatchSource:0}: Error finding container 07eed8cd9b5b49f828fdc3e2a4ea2ff96d20728d042a30ad9ccea235864e2272: Status 404 returned error can't find the container with id 07eed8cd9b5b49f828fdc3e2a4ea2ff96d20728d042a30ad9ccea235864e2272
Aug 05 17:14:32.707718 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.707690    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-gn2gd"]
Aug 05 17:14:32.710887 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:14:32.710861    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c888748_b317_44e6_a007_a83edb451861.slice/crio-2ebcd9195ed360cab602066e8f9c700854632b9e0bfe613c714d49516672a3da WatchSource:0}: Error finding container 2ebcd9195ed360cab602066e8f9c700854632b9e0bfe613c714d49516672a3da: Status 404 returned error can't find the container with id 2ebcd9195ed360cab602066e8f9c700854632b9e0bfe613c714d49516672a3da
Aug 05 17:14:32.725938 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:32.725914    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-ww266"]
Aug 05 17:14:32.728994 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:14:32.728968    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91386cb4_60c6_4513_8cb7_39682f9fc29e.slice/crio-879cdc748ed3074c7b0323ae291c72e3c560b398fbce07b2bef4399f296b2321 WatchSource:0}: Error finding container 879cdc748ed3074c7b0323ae291c72e3c560b398fbce07b2bef4399f296b2321: Status 404 returned error can't find the container with id 879cdc748ed3074c7b0323ae291c72e3c560b398fbce07b2bef4399f296b2321
Aug 05 17:14:33.468900 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:33.468808    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-cfhjn" event={"ID":"fbe3e762-befb-4b44-8948-cec992999e97","Type":"ContainerStarted","Data":"07eed8cd9b5b49f828fdc3e2a4ea2ff96d20728d042a30ad9ccea235864e2272"}
Aug 05 17:14:33.470418 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:33.470348    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-cqj2n" event={"ID":"17a2b686-e228-4d00-9656-8b03b65f2e29","Type":"ContainerStarted","Data":"e0e350f00941411f5be3cbe14b4880f7303b63d9fc975235e11d111693e404bb"}
Aug 05 17:14:33.472088 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:33.472021    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-ww266" event={"ID":"91386cb4-60c6-4513-8cb7-39682f9fc29e","Type":"ContainerStarted","Data":"879cdc748ed3074c7b0323ae291c72e3c560b398fbce07b2bef4399f296b2321"}
Aug 05 17:14:33.473835 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:33.473781    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gn2gd" event={"ID":"7c888748-b317-44e6-a007-a83edb451861","Type":"ContainerStarted","Data":"2ebcd9195ed360cab602066e8f9c700854632b9e0bfe613c714d49516672a3da"}
Aug 05 17:14:35.186804 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:35.186760    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fa1e6b87-097c-4574-a761-9762d2a8c586-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tr42t\" (UID: \"fa1e6b87-097c-4574-a761-9762d2a8c586\") " pod="openshift-insights/insights-runtime-extractor-tr42t"
Aug 05 17:14:35.187322 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:35.186823    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fa1e6b87-097c-4574-a761-9762d2a8c586-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tr42t\" (UID: \"fa1e6b87-097c-4574-a761-9762d2a8c586\") " pod="openshift-insights/insights-runtime-extractor-tr42t"
Aug 05 17:14:35.187322 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:14:35.186909    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 17:14:35.187322 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:14:35.186936    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 05 17:14:35.187322 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:14:35.186986    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa1e6b87-097c-4574-a761-9762d2a8c586-insights-runtime-extractor-tls podName:fa1e6b87-097c-4574-a761-9762d2a8c586 nodeName:}" failed. No retries permitted until 2026-08-05 17:14:43.186966774 +0000 UTC m=+117.755469196 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fa1e6b87-097c-4574-a761-9762d2a8c586-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tr42t" (UID: "fa1e6b87-097c-4574-a761-9762d2a8c586") : secret "insights-runtime-extractor-tls" not found
Aug 05 17:14:35.187322 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:14:35.187003    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fa1e6b87-097c-4574-a761-9762d2a8c586-kube-rbac-proxy-cm podName:fa1e6b87-097c-4574-a761-9762d2a8c586 nodeName:}" failed. No retries permitted until 2026-08-05 17:14:43.1869955 +0000 UTC m=+117.755497899 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fa1e6b87-097c-4574-a761-9762d2a8c586-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tr42t" (UID: "fa1e6b87-097c-4574-a761-9762d2a8c586") : configmap "kube-rbac-proxy" not found
Aug 05 17:14:36.484378 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:36.484338    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-cfhjn" event={"ID":"fbe3e762-befb-4b44-8948-cec992999e97","Type":"ContainerStarted","Data":"31bfa36119f7fa157f038e826fce1f09bfcfca62829aaf2a340329827a2593f1"}
Aug 05 17:14:36.486329 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:36.486303    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-cqj2n_17a2b686-e228-4d00-9656-8b03b65f2e29/console-operator/0.log"
Aug 05 17:14:36.486454 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:36.486348    2580 generic.go:356] "Generic (PLEG): container finished" podID="17a2b686-e228-4d00-9656-8b03b65f2e29" containerID="567591b8bb852d9c27bbea8079067e2126e9b982ebc4bb8aabe3a0d4018f6895" exitCode=255
Aug 05 17:14:36.486454 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:36.486430    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-cqj2n" event={"ID":"17a2b686-e228-4d00-9656-8b03b65f2e29","Type":"ContainerDied","Data":"567591b8bb852d9c27bbea8079067e2126e9b982ebc4bb8aabe3a0d4018f6895"}
Aug 05 17:14:36.486644 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:36.486625    2580 scope.go:117] "RemoveContainer" containerID="567591b8bb852d9c27bbea8079067e2126e9b982ebc4bb8aabe3a0d4018f6895"
Aug 05 17:14:36.488083 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:36.488060    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-ww266" event={"ID":"91386cb4-60c6-4513-8cb7-39682f9fc29e","Type":"ContainerStarted","Data":"b86f1a5c9d4584bfc6343395636331c1d8a2b75630dd251557870e59b90efe79"}
Aug 05 17:14:36.489655 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:36.489635    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gn2gd" event={"ID":"7c888748-b317-44e6-a007-a83edb451861","Type":"ContainerStarted","Data":"d45251406a85116a8efb2ee7406c40daab2c06ee90d155c05466908ba4c64085"}
Aug 05 17:14:36.506930 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:36.506879    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-cfhjn" podStartSLOduration=1.539724606 podStartE2EDuration="4.506859631s" totalImagesPullingTime="2.967135025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:14:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:14:36.505218085 +0000 UTC m=+111.073720508" watchObservedRunningTime="2026-08-05 17:14:36.506859631 +0000 UTC m=+111.075362056"
Aug 05 17:14:36.529867 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:36.529824    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-ww266" podStartSLOduration=1.589428665 podStartE2EDuration="4.529808222s" totalImagesPullingTime="2.940379557s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:14:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:14:36.528616899 +0000 UTC m=+111.097119312" watchObservedRunningTime="2026-08-05 17:14:36.529808222 +0000 UTC m=+111.098310638"
Aug 05 17:14:36.570107 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:36.570055    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gn2gd" podStartSLOduration=1.613062937 podStartE2EDuration="4.570038139s" totalImagesPullingTime="2.956975202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:14:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:14:36.568623355 +0000 UTC m=+111.137125777" watchObservedRunningTime="2026-08-05 17:14:36.570038139 +0000 UTC m=+111.138540561"
Aug 05 17:14:36.629681 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:36.629649    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:37.074398 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:37.074364    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:37.145336 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:37.145297    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:37.368377 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:37.368292    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:37.471972 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:37.471936    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:37.494168 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:37.494144    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-cqj2n_17a2b686-e228-4d00-9656-8b03b65f2e29/console-operator/1.log"
Aug 05 17:14:37.494582 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:37.494568    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-cqj2n_17a2b686-e228-4d00-9656-8b03b65f2e29/console-operator/0.log"
Aug 05 17:14:37.494633 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:37.494602    2580 generic.go:356] "Generic (PLEG): container finished" podID="17a2b686-e228-4d00-9656-8b03b65f2e29" containerID="a18636d5a6765bb4ef29d095de2011e6dd69f763ec26b5e7edc6441860b68038" exitCode=255
Aug 05 17:14:37.494666 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:37.494635    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-cqj2n" event={"ID":"17a2b686-e228-4d00-9656-8b03b65f2e29","Type":"ContainerDied","Data":"a18636d5a6765bb4ef29d095de2011e6dd69f763ec26b5e7edc6441860b68038"}
Aug 05 17:14:37.494704 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:37.494691    2580 scope.go:117] "RemoveContainer" containerID="567591b8bb852d9c27bbea8079067e2126e9b982ebc4bb8aabe3a0d4018f6895"
Aug 05 17:14:37.494923 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:37.494907    2580 scope.go:117] "RemoveContainer" containerID="a18636d5a6765bb4ef29d095de2011e6dd69f763ec26b5e7edc6441860b68038"
Aug 05 17:14:37.495138 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:14:37.495101    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-cqj2n_openshift-console-operator(17a2b686-e228-4d00-9656-8b03b65f2e29)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-cqj2n" podUID="17a2b686-e228-4d00-9656-8b03b65f2e29"
Aug 05 17:14:37.804757 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:37.804657    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-rzvk9"]
Aug 05 17:14:37.809321 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:37.809290    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-rzvk9"
Aug 05 17:14:37.813620 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:37.813597    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Aug 05 17:14:37.813761 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:37.813714    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-dvx7x\""
Aug 05 17:14:37.813815 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:37.813766    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Aug 05 17:14:37.822314 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:37.822284    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-rzvk9"]
Aug 05 17:14:37.868697 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:37.868663    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:37.911724 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:37.911691    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snlnh\" (UniqueName: \"kubernetes.io/projected/0a865de0-040f-491d-9d38-d1ae4b434375-kube-api-access-snlnh\") pod \"migrator-68bc745d87-rzvk9\" (UID: \"0a865de0-040f-491d-9d38-d1ae4b434375\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-rzvk9"
Aug 05 17:14:37.946463 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:37.946429    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:38.012965 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:38.012916    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snlnh\" (UniqueName: \"kubernetes.io/projected/0a865de0-040f-491d-9d38-d1ae4b434375-kube-api-access-snlnh\") pod \"migrator-68bc745d87-rzvk9\" (UID: \"0a865de0-040f-491d-9d38-d1ae4b434375\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-rzvk9"
Aug 05 17:14:38.023162 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:38.023135    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snlnh\" (UniqueName: \"kubernetes.io/projected/0a865de0-040f-491d-9d38-d1ae4b434375-kube-api-access-snlnh\") pod \"migrator-68bc745d87-rzvk9\" (UID: \"0a865de0-040f-491d-9d38-d1ae4b434375\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-rzvk9"
Aug 05 17:14:38.113893 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:38.113850    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c9058435-3402-4bfd-abca-10a1778d9b49-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-bsnxf\" (UID: \"c9058435-3402-4bfd-abca-10a1778d9b49\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-bsnxf"
Aug 05 17:14:38.114107 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:14:38.114019    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 05 17:14:38.114183 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:14:38.114143    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9058435-3402-4bfd-abca-10a1778d9b49-cluster-monitoring-operator-tls podName:c9058435-3402-4bfd-abca-10a1778d9b49 nodeName:}" failed. No retries permitted until 2026-08-05 17:14:54.114126963 +0000 UTC m=+128.682629363 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c9058435-3402-4bfd-abca-10a1778d9b49-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-bsnxf" (UID: "c9058435-3402-4bfd-abca-10a1778d9b49") : secret "cluster-monitoring-operator-tls" not found
Aug 05 17:14:38.117819 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:38.117789    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-rzvk9"
Aug 05 17:14:38.244808 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:38.244778    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-rzvk9"]
Aug 05 17:14:38.247331 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:14:38.247303    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a865de0_040f_491d_9d38_d1ae4b434375.slice/crio-6c14052a48cb619bf9f1e47759c64a3b281f681f37e1cf8ff2e964591f7c8d11 WatchSource:0}: Error finding container 6c14052a48cb619bf9f1e47759c64a3b281f681f37e1cf8ff2e964591f7c8d11: Status 404 returned error can't find the container with id 6c14052a48cb619bf9f1e47759c64a3b281f681f37e1cf8ff2e964591f7c8d11
Aug 05 17:14:38.499781 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:38.499708    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-cqj2n_17a2b686-e228-4d00-9656-8b03b65f2e29/console-operator/1.log"
Aug 05 17:14:38.500195 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:38.500048    2580 scope.go:117] "RemoveContainer" containerID="a18636d5a6765bb4ef29d095de2011e6dd69f763ec26b5e7edc6441860b68038"
Aug 05 17:14:38.500236 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:14:38.500208    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-cqj2n_openshift-console-operator(17a2b686-e228-4d00-9656-8b03b65f2e29)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-cqj2n" podUID="17a2b686-e228-4d00-9656-8b03b65f2e29"
Aug 05 17:14:38.500962 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:38.500942    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-rzvk9" event={"ID":"0a865de0-040f-491d-9d38-d1ae4b434375","Type":"ContainerStarted","Data":"6c14052a48cb619bf9f1e47759c64a3b281f681f37e1cf8ff2e964591f7c8d11"}
Aug 05 17:14:39.015291 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:39.015222    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:39.092701 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:39.092669    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:39.505333 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:39.505304    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-rzvk9" event={"ID":"0a865de0-040f-491d-9d38-d1ae4b434375","Type":"ContainerStarted","Data":"7e55bcff9de2af94fd3b26cfb26d56cd2756dc8e9d9c87aea5e84fbf59946501"}
Aug 05 17:14:40.321086 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:40.321049    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:40.509912 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:40.509872    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-rzvk9" event={"ID":"0a865de0-040f-491d-9d38-d1ae4b434375","Type":"ContainerStarted","Data":"22b32320a2318d7c8034c0d65a627c7069671467da88564b2eda7a2dadaa0505"}
Aug 05 17:14:40.534259 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:40.534201    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-rzvk9" podStartSLOduration=2.3770415160000002 podStartE2EDuration="3.534183699s" totalImagesPullingTime="1.157142183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:14:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:14:40.533760451 +0000 UTC m=+115.102262874" watchObservedRunningTime="2026-08-05 17:14:40.534183699 +0000 UTC m=+115.102686120"
Aug 05 17:14:40.623844 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:40.623761    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:42.436822 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:42.436781    2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5ccd6b445f-cqj2n"
Aug 05 17:14:42.437215 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:42.436872    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-cqj2n"
Aug 05 17:14:42.437255 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:42.437222    2580 scope.go:117] "RemoveContainer" containerID="a18636d5a6765bb4ef29d095de2011e6dd69f763ec26b5e7edc6441860b68038"
Aug 05 17:14:42.437392 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:14:42.437371    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-cqj2n_openshift-console-operator(17a2b686-e228-4d00-9656-8b03b65f2e29)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-cqj2n" podUID="17a2b686-e228-4d00-9656-8b03b65f2e29"
Aug 05 17:14:43.029198 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:43.029157    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:43.187637 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:43.187600    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:43.255519 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:43.255489    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fa1e6b87-097c-4574-a761-9762d2a8c586-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tr42t\" (UID: \"fa1e6b87-097c-4574-a761-9762d2a8c586\") " pod="openshift-insights/insights-runtime-extractor-tr42t"
Aug 05 17:14:43.255725 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:43.255539    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fa1e6b87-097c-4574-a761-9762d2a8c586-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tr42t\" (UID: \"fa1e6b87-097c-4574-a761-9762d2a8c586\") " pod="openshift-insights/insights-runtime-extractor-tr42t"
Aug 05 17:14:43.255725 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:14:43.255675    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 17:14:43.255846 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:14:43.255755    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa1e6b87-097c-4574-a761-9762d2a8c586-insights-runtime-extractor-tls podName:fa1e6b87-097c-4574-a761-9762d2a8c586 nodeName:}" failed. No retries permitted until 2026-08-05 17:14:59.255733773 +0000 UTC m=+133.824236176 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fa1e6b87-097c-4574-a761-9762d2a8c586-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tr42t" (UID: "fa1e6b87-097c-4574-a761-9762d2a8c586") : secret "insights-runtime-extractor-tls" not found
Aug 05 17:14:43.256021 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:43.256001    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fa1e6b87-097c-4574-a761-9762d2a8c586-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tr42t\" (UID: \"fa1e6b87-097c-4574-a761-9762d2a8c586\") " pod="openshift-insights/insights-runtime-extractor-tr42t"
Aug 05 17:14:43.554955 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:43.554901    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:43.670411 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:43.670372    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:44.103836 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:44.103804    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:44.693987 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:44.693952    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:44.882895 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:44.882863    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:45.312803 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:45.312759    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:45.501734 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:45.501703    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:45.760006 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:45.759930    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:45.916963 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:45.916907    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:46.631887 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:46.631847    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:46.733677 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:46.733631    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:46.945846 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:46.945759    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:47.168761 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:47.168723    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:47.279996 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:47.279913    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:47.380188 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:47.380158    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:47.858806 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:47.858773    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:47.961017 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:47.960979    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:48.693873 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:48.693840    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:49.018304 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:49.018230    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:49.119228 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:49.119196    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:49.298158 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:49.298079    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:49.531024 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:49.530993    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:49.696072 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:49.696039    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:51.277397 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:51.277369    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:51.370707 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:51.370675    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:51.515979 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:51.515948    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:51.693206 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:51.693175    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:52.664062 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:52.664025    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:52.770715 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:52.770682    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:53.130764 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:53.130731    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:53.324688 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:53.324649    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:53.515757 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:53.515677    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:53.737159 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:53.737127    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:54.153346 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:54.153308    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c9058435-3402-4bfd-abca-10a1778d9b49-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-bsnxf\" (UID: \"c9058435-3402-4bfd-abca-10a1778d9b49\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-bsnxf"
Aug 05 17:14:54.156020 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:54.155998    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c9058435-3402-4bfd-abca-10a1778d9b49-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-bsnxf\" (UID: \"c9058435-3402-4bfd-abca-10a1778d9b49\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-bsnxf"
Aug 05 17:14:54.404249 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:54.404154    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-z4bm7\""
Aug 05 17:14:54.412275 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:54.412252    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-bsnxf"
Aug 05 17:14:54.561612 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:54.561583    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-bsnxf"]
Aug 05 17:14:54.564512 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:14:54.564474    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9058435_3402_4bfd_abca_10a1778d9b49.slice/crio-918c0c5c3cc074c72413f72d013de4cca0e9d48879818436c737d2eabecad623 WatchSource:0}: Error finding container 918c0c5c3cc074c72413f72d013de4cca0e9d48879818436c737d2eabecad623: Status 404 returned error can't find the container with id 918c0c5c3cc074c72413f72d013de4cca0e9d48879818436c737d2eabecad623
Aug 05 17:14:55.555414 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:55.555381    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-bsnxf" event={"ID":"c9058435-3402-4bfd-abca-10a1778d9b49","Type":"ContainerStarted","Data":"918c0c5c3cc074c72413f72d013de4cca0e9d48879818436c737d2eabecad623"}
Aug 05 17:14:55.666943 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:55.666897    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0746144f-9064-48d7-ad22-f33bbbc3c16e-metrics-certs\") pod \"network-metrics-daemon-j48xm\" (UID: \"0746144f-9064-48d7-ad22-f33bbbc3c16e\") " pod="openshift-multus/network-metrics-daemon-j48xm"
Aug 05 17:14:55.669893 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:55.669867    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0746144f-9064-48d7-ad22-f33bbbc3c16e-metrics-certs\") pod \"network-metrics-daemon-j48xm\" (UID: \"0746144f-9064-48d7-ad22-f33bbbc3c16e\") " pod="openshift-multus/network-metrics-daemon-j48xm"
Aug 05 17:14:55.713501 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:55.713274    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4hs5f\""
Aug 05 17:14:55.720669 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:55.720622    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j48xm"
Aug 05 17:14:55.997926 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:55.997892    2580 scope.go:117] "RemoveContainer" containerID="a18636d5a6765bb4ef29d095de2011e6dd69f763ec26b5e7edc6441860b68038"
Aug 05 17:14:56.317129 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:56.317002    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-j48xm"]
Aug 05 17:14:56.319750 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:14:56.319719    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0746144f_9064_48d7_ad22_f33bbbc3c16e.slice/crio-9df5316f1692d958f06d06d7e5834b2b18ffe2edd8af94f2c43bac74ebd3d8f6 WatchSource:0}: Error finding container 9df5316f1692d958f06d06d7e5834b2b18ffe2edd8af94f2c43bac74ebd3d8f6: Status 404 returned error can't find the container with id 9df5316f1692d958f06d06d7e5834b2b18ffe2edd8af94f2c43bac74ebd3d8f6
Aug 05 17:14:56.560760 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:56.560722    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j48xm" event={"ID":"0746144f-9064-48d7-ad22-f33bbbc3c16e","Type":"ContainerStarted","Data":"9df5316f1692d958f06d06d7e5834b2b18ffe2edd8af94f2c43bac74ebd3d8f6"}
Aug 05 17:14:56.562954 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:56.562926    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-cqj2n_17a2b686-e228-4d00-9656-8b03b65f2e29/console-operator/1.log"
Aug 05 17:14:56.563095 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:56.563018    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-cqj2n" event={"ID":"17a2b686-e228-4d00-9656-8b03b65f2e29","Type":"ContainerStarted","Data":"1be2b2809f16e8fb92f6a4df6c65ce6d52dfa242c8a0c8840c57f7cad47356c3"}
Aug 05 17:14:56.563466 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:56.563324    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-cqj2n"
Aug 05 17:14:56.564762 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:56.564712    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-bsnxf" event={"ID":"c9058435-3402-4bfd-abca-10a1778d9b49","Type":"ContainerStarted","Data":"3249a3462dcda86ff8803d109fdf917aef9adc7e0c95c2438e0b6ff265c71151"}
Aug 05 17:14:56.593251 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:56.593154    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5ccd6b445f-cqj2n" podStartSLOduration=21.504763177 podStartE2EDuration="24.593130811s" totalImagesPullingTime="3.088367634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:14:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:14:56.592035743 +0000 UTC m=+131.160538165" watchObservedRunningTime="2026-08-05 17:14:56.593130811 +0000 UTC m=+131.161633235"
Aug 05 17:14:56.602192 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:56.602143    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:56.605639 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:56.605616    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5ccd6b445f-cqj2n"
Aug 05 17:14:56.618731 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:56.618677    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-bsnxf" podStartSLOduration=32.972537005 podStartE2EDuration="34.618656119s" totalImagesPullingTime="1.646119114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:14:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:14:56.618046103 +0000 UTC m=+131.186548525" watchObservedRunningTime="2026-08-05 17:14:56.618656119 +0000 UTC m=+131.187158547"
Aug 05 17:14:56.706908 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:56.706871    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:56.899371 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:56.899289    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:57.021498 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:57.021424    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:57.127626 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:57.127569    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:57.308354 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:57.308309    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:57.412209 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:57.412128    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:57.521111 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:57.521070    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:57.569210 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:57.569179    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j48xm" event={"ID":"0746144f-9064-48d7-ad22-f33bbbc3c16e","Type":"ContainerStarted","Data":"d323164785e6a0ef5cdcc0fdfb60e35ff52a67642f25fa7bd3236d6f081f55ba"}
Aug 05 17:14:57.569684 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:57.569270    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j48xm" event={"ID":"0746144f-9064-48d7-ad22-f33bbbc3c16e","Type":"ContainerStarted","Data":"99a93b1117632a0a3feb9757920860d69e66e679185bdeba212151f0781800af"}
Aug 05 17:14:57.591442 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:57.591378    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-j48xm" podStartSLOduration=130.632667855 podStartE2EDuration="2m11.59136402s" totalImagesPullingTime="958.696165ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:12:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:14:57.590241143 +0000 UTC m=+132.158743564" watchObservedRunningTime="2026-08-05 17:14:57.59136402 +0000 UTC m=+132.159866441"
Aug 05 17:14:57.889124 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:57.889031    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:57.965753 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:57.965721    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:58.487039 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:58.487012    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:58.696019 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:58.695986    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:58.796475 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:58.796389    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:59.295063 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:59.295023    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fa1e6b87-097c-4574-a761-9762d2a8c586-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tr42t\" (UID: \"fa1e6b87-097c-4574-a761-9762d2a8c586\") " pod="openshift-insights/insights-runtime-extractor-tr42t"
Aug 05 17:14:59.297491 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:59.297460    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fa1e6b87-097c-4574-a761-9762d2a8c586-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tr42t\" (UID: \"fa1e6b87-097c-4574-a761-9762d2a8c586\") " pod="openshift-insights/insights-runtime-extractor-tr42t"
Aug 05 17:14:59.512193 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:59.512150    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:14:59.565784 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:59.565755    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-h9fhk\""
Aug 05 17:14:59.573953 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:59.573929    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tr42t"
Aug 05 17:14:59.706800 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:14:59.706769    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tr42t"]
Aug 05 17:14:59.709309 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:14:59.709279    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa1e6b87_097c_4574_a761_9762d2a8c586.slice/crio-1c69a382cbcbdf862d3a6cd47c32d351eb2542da848715057f11375343caeab1 WatchSource:0}: Error finding container 1c69a382cbcbdf862d3a6cd47c32d351eb2542da848715057f11375343caeab1: Status 404 returned error can't find the container with id 1c69a382cbcbdf862d3a6cd47c32d351eb2542da848715057f11375343caeab1
Aug 05 17:15:00.581087 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:00.581056    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tr42t" event={"ID":"fa1e6b87-097c-4574-a761-9762d2a8c586","Type":"ContainerStarted","Data":"b268d37998c3440eebb0f8064b0d8951d71b580207b7ee2da75991fee502a039"}
Aug 05 17:15:00.581249 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:00.581110    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tr42t" event={"ID":"fa1e6b87-097c-4574-a761-9762d2a8c586","Type":"ContainerStarted","Data":"1c69a382cbcbdf862d3a6cd47c32d351eb2542da848715057f11375343caeab1"}
Aug 05 17:15:01.585953 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:01.585921    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tr42t" event={"ID":"fa1e6b87-097c-4574-a761-9762d2a8c586","Type":"ContainerStarted","Data":"abd6c50020b9dc488d9762e6850c8b270fc545e0b3bbe11f2c965fe340121e5f"}
Aug 05 17:15:02.242510 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:02.242477    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:02.340092 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:02.340044    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:03.598217 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:03.598181    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tr42t" event={"ID":"fa1e6b87-097c-4574-a761-9762d2a8c586","Type":"ContainerStarted","Data":"78f53406e41a60a95ab71c16fac0e34cca9ba6ac6a099c9f36fd1dcac189873d"}
Aug 05 17:15:03.627662 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:03.627613    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-tr42t" podStartSLOduration=33.804715484 podStartE2EDuration="36.62759609s" totalImagesPullingTime="2.822880606s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:14:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:03.627335418 +0000 UTC m=+138.195837840" watchObservedRunningTime="2026-08-05 17:15:03.62759609 +0000 UTC m=+138.196098510"
Aug 05 17:15:05.709404 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:05.709366    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-wqbqq"]
Aug 05 17:15:05.711610 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:05.711590    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-wqbqq"
Aug 05 17:15:05.717741 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:05.717577    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-4mvp4\""
Aug 05 17:15:05.717741 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:05.717582    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Aug 05 17:15:05.724525 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:05.724499    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-wqbqq"]
Aug 05 17:15:05.739539 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:05.739508    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/69aafc28-143b-4332-bef0-fcc64ce5bdde-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-wqbqq\" (UID: \"69aafc28-143b-4332-bef0-fcc64ce5bdde\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-wqbqq"
Aug 05 17:15:05.840711 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:05.840672    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/69aafc28-143b-4332-bef0-fcc64ce5bdde-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-wqbqq\" (UID: \"69aafc28-143b-4332-bef0-fcc64ce5bdde\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-wqbqq"
Aug 05 17:15:05.843364 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:05.843335    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/69aafc28-143b-4332-bef0-fcc64ce5bdde-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-wqbqq\" (UID: \"69aafc28-143b-4332-bef0-fcc64ce5bdde\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-wqbqq"
Aug 05 17:15:05.896044 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:05.896012    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:05.927895 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:05.927858    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7577cb494d-jlsvz"]
Aug 05 17:15:05.930155 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:05.930129    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7577cb494d-jlsvz"
Aug 05 17:15:05.941772 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:05.941749    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/772046af-1b8c-48dd-b9f6-8915d5f611e9-image-registry-private-configuration\") pod \"image-registry-7577cb494d-jlsvz\" (UID: \"772046af-1b8c-48dd-b9f6-8915d5f611e9\") " pod="openshift-image-registry/image-registry-7577cb494d-jlsvz"
Aug 05 17:15:05.941887 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:05.941777    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/772046af-1b8c-48dd-b9f6-8915d5f611e9-registry-certificates\") pod \"image-registry-7577cb494d-jlsvz\" (UID: \"772046af-1b8c-48dd-b9f6-8915d5f611e9\") " pod="openshift-image-registry/image-registry-7577cb494d-jlsvz"
Aug 05 17:15:05.941887 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:05.941796    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/772046af-1b8c-48dd-b9f6-8915d5f611e9-trusted-ca\") pod \"image-registry-7577cb494d-jlsvz\" (UID: \"772046af-1b8c-48dd-b9f6-8915d5f611e9\") " pod="openshift-image-registry/image-registry-7577cb494d-jlsvz"
Aug 05 17:15:05.941887 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:05.941850    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/772046af-1b8c-48dd-b9f6-8915d5f611e9-registry-tls\") pod \"image-registry-7577cb494d-jlsvz\" (UID: \"772046af-1b8c-48dd-b9f6-8915d5f611e9\") " pod="openshift-image-registry/image-registry-7577cb494d-jlsvz"
Aug 05 17:15:05.941992 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:05.941889    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/772046af-1b8c-48dd-b9f6-8915d5f611e9-ca-trust-extracted\") pod \"image-registry-7577cb494d-jlsvz\" (UID: \"772046af-1b8c-48dd-b9f6-8915d5f611e9\") " pod="openshift-image-registry/image-registry-7577cb494d-jlsvz"
Aug 05 17:15:05.941992 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:05.941935    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/772046af-1b8c-48dd-b9f6-8915d5f611e9-bound-sa-token\") pod \"image-registry-7577cb494d-jlsvz\" (UID: \"772046af-1b8c-48dd-b9f6-8915d5f611e9\") " pod="openshift-image-registry/image-registry-7577cb494d-jlsvz"
Aug 05 17:15:05.941992 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:05.941972    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/772046af-1b8c-48dd-b9f6-8915d5f611e9-installation-pull-secrets\") pod \"image-registry-7577cb494d-jlsvz\" (UID: \"772046af-1b8c-48dd-b9f6-8915d5f611e9\") " pod="openshift-image-registry/image-registry-7577cb494d-jlsvz"
Aug 05 17:15:05.942078 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:05.942018    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ngmd\" (UniqueName: \"kubernetes.io/projected/772046af-1b8c-48dd-b9f6-8915d5f611e9-kube-api-access-8ngmd\") pod \"image-registry-7577cb494d-jlsvz\" (UID: \"772046af-1b8c-48dd-b9f6-8915d5f611e9\") " pod="openshift-image-registry/image-registry-7577cb494d-jlsvz"
Aug 05 17:15:05.947348 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:05.947326    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Aug 05 17:15:05.947631 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:05.947617    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xrzw4\""
Aug 05 17:15:05.947780 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:05.947755    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Aug 05 17:15:05.947841 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:05.947829    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Aug 05 17:15:05.961287 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:05.961234    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Aug 05 17:15:05.969099 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:05.969073    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7577cb494d-jlsvz"]
Aug 05 17:15:06.020288 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:06.020257    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-wqbqq"
Aug 05 17:15:06.027138 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:06.027111    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:06.043346 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:06.043316    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/772046af-1b8c-48dd-b9f6-8915d5f611e9-installation-pull-secrets\") pod \"image-registry-7577cb494d-jlsvz\" (UID: \"772046af-1b8c-48dd-b9f6-8915d5f611e9\") " pod="openshift-image-registry/image-registry-7577cb494d-jlsvz"
Aug 05 17:15:06.043505 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:06.043369    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ngmd\" (UniqueName: \"kubernetes.io/projected/772046af-1b8c-48dd-b9f6-8915d5f611e9-kube-api-access-8ngmd\") pod \"image-registry-7577cb494d-jlsvz\" (UID: \"772046af-1b8c-48dd-b9f6-8915d5f611e9\") " pod="openshift-image-registry/image-registry-7577cb494d-jlsvz"
Aug 05 17:15:06.043505 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:06.043393    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/772046af-1b8c-48dd-b9f6-8915d5f611e9-image-registry-private-configuration\") pod \"image-registry-7577cb494d-jlsvz\" (UID: \"772046af-1b8c-48dd-b9f6-8915d5f611e9\") " pod="openshift-image-registry/image-registry-7577cb494d-jlsvz"
Aug 05 17:15:06.043505 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:06.043411    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/772046af-1b8c-48dd-b9f6-8915d5f611e9-registry-certificates\") pod \"image-registry-7577cb494d-jlsvz\" (UID: \"772046af-1b8c-48dd-b9f6-8915d5f611e9\") " pod="openshift-image-registry/image-registry-7577cb494d-jlsvz"
Aug 05 17:15:06.043505 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:06.043433    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/772046af-1b8c-48dd-b9f6-8915d5f611e9-trusted-ca\") pod \"image-registry-7577cb494d-jlsvz\" (UID: \"772046af-1b8c-48dd-b9f6-8915d5f611e9\") " pod="openshift-image-registry/image-registry-7577cb494d-jlsvz"
Aug 05 17:15:06.043741 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:06.043587    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/772046af-1b8c-48dd-b9f6-8915d5f611e9-registry-tls\") pod \"image-registry-7577cb494d-jlsvz\" (UID: \"772046af-1b8c-48dd-b9f6-8915d5f611e9\") " pod="openshift-image-registry/image-registry-7577cb494d-jlsvz"
Aug 05 17:15:06.043741 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:06.043637    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/772046af-1b8c-48dd-b9f6-8915d5f611e9-ca-trust-extracted\") pod \"image-registry-7577cb494d-jlsvz\" (UID: \"772046af-1b8c-48dd-b9f6-8915d5f611e9\") " pod="openshift-image-registry/image-registry-7577cb494d-jlsvz"
Aug 05 17:15:06.043741 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:06.043668    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/772046af-1b8c-48dd-b9f6-8915d5f611e9-bound-sa-token\") pod \"image-registry-7577cb494d-jlsvz\" (UID: \"772046af-1b8c-48dd-b9f6-8915d5f611e9\") " pod="openshift-image-registry/image-registry-7577cb494d-jlsvz"
Aug 05 17:15:06.044488 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:06.044417    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/772046af-1b8c-48dd-b9f6-8915d5f611e9-ca-trust-extracted\") pod \"image-registry-7577cb494d-jlsvz\" (UID: \"772046af-1b8c-48dd-b9f6-8915d5f611e9\") " pod="openshift-image-registry/image-registry-7577cb494d-jlsvz"
Aug 05 17:15:06.049711 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:06.044965    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/772046af-1b8c-48dd-b9f6-8915d5f611e9-trusted-ca\") pod \"image-registry-7577cb494d-jlsvz\" (UID: \"772046af-1b8c-48dd-b9f6-8915d5f611e9\") " pod="openshift-image-registry/image-registry-7577cb494d-jlsvz"
Aug 05 17:15:06.049711 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:06.045302    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/772046af-1b8c-48dd-b9f6-8915d5f611e9-registry-certificates\") pod \"image-registry-7577cb494d-jlsvz\" (UID: \"772046af-1b8c-48dd-b9f6-8915d5f611e9\") " pod="openshift-image-registry/image-registry-7577cb494d-jlsvz"
Aug 05 17:15:06.050784 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:06.050763    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/772046af-1b8c-48dd-b9f6-8915d5f611e9-registry-tls\") pod \"image-registry-7577cb494d-jlsvz\" (UID: \"772046af-1b8c-48dd-b9f6-8915d5f611e9\") " pod="openshift-image-registry/image-registry-7577cb494d-jlsvz"
Aug 05 17:15:06.050978 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:06.050956    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/772046af-1b8c-48dd-b9f6-8915d5f611e9-image-registry-private-configuration\") pod \"image-registry-7577cb494d-jlsvz\" (UID: \"772046af-1b8c-48dd-b9f6-8915d5f611e9\") " pod="openshift-image-registry/image-registry-7577cb494d-jlsvz"
Aug 05 17:15:06.052365 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:06.052341    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/772046af-1b8c-48dd-b9f6-8915d5f611e9-installation-pull-secrets\") pod \"image-registry-7577cb494d-jlsvz\" (UID: \"772046af-1b8c-48dd-b9f6-8915d5f611e9\") " pod="openshift-image-registry/image-registry-7577cb494d-jlsvz"
Aug 05 17:15:06.053690 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:06.053659    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ngmd\" (UniqueName: \"kubernetes.io/projected/772046af-1b8c-48dd-b9f6-8915d5f611e9-kube-api-access-8ngmd\") pod \"image-registry-7577cb494d-jlsvz\" (UID: \"772046af-1b8c-48dd-b9f6-8915d5f611e9\") " pod="openshift-image-registry/image-registry-7577cb494d-jlsvz"
Aug 05 17:15:06.054591 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:06.054550    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/772046af-1b8c-48dd-b9f6-8915d5f611e9-bound-sa-token\") pod \"image-registry-7577cb494d-jlsvz\" (UID: \"772046af-1b8c-48dd-b9f6-8915d5f611e9\") " pod="openshift-image-registry/image-registry-7577cb494d-jlsvz"
Aug 05 17:15:06.130158 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:06.130130    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:06.163288 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:06.163255    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-wqbqq"]
Aug 05 17:15:06.168722 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:15:06.168695    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69aafc28_143b_4332_bef0_fcc64ce5bdde.slice/crio-80ad3dc9cad650087bf30abe25595cdc64b8a16efac3adf967d29118a2eaf231 WatchSource:0}: Error finding container 80ad3dc9cad650087bf30abe25595cdc64b8a16efac3adf967d29118a2eaf231: Status 404 returned error can't find the container with id 80ad3dc9cad650087bf30abe25595cdc64b8a16efac3adf967d29118a2eaf231
Aug 05 17:15:06.239009 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:06.238922    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7577cb494d-jlsvz"
Aug 05 17:15:06.436321 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:06.436203    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7577cb494d-jlsvz"]
Aug 05 17:15:06.438686 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:15:06.438662    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod772046af_1b8c_48dd_b9f6_8915d5f611e9.slice/crio-54d82919d218521c73ab820f0e36e2e3508b141982e8da0e106fbfa1f83781b6 WatchSource:0}: Error finding container 54d82919d218521c73ab820f0e36e2e3508b141982e8da0e106fbfa1f83781b6: Status 404 returned error can't find the container with id 54d82919d218521c73ab820f0e36e2e3508b141982e8da0e106fbfa1f83781b6
Aug 05 17:15:06.610354 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:06.610315    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7577cb494d-jlsvz" event={"ID":"772046af-1b8c-48dd-b9f6-8915d5f611e9","Type":"ContainerStarted","Data":"aa1fa8178c811ebef77f285e9a0f429a8d8e87d9076a3d3cb5fa2421c5e06ea6"}
Aug 05 17:15:06.610528 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:06.610470    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7577cb494d-jlsvz"
Aug 05 17:15:06.610528 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:06.610512    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7577cb494d-jlsvz" event={"ID":"772046af-1b8c-48dd-b9f6-8915d5f611e9","Type":"ContainerStarted","Data":"54d82919d218521c73ab820f0e36e2e3508b141982e8da0e106fbfa1f83781b6"}
Aug 05 17:15:06.611496 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:06.611472    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-wqbqq" event={"ID":"69aafc28-143b-4332-bef0-fcc64ce5bdde","Type":"ContainerStarted","Data":"80ad3dc9cad650087bf30abe25595cdc64b8a16efac3adf967d29118a2eaf231"}
Aug 05 17:15:07.616721 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:07.616689    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-wqbqq" event={"ID":"69aafc28-143b-4332-bef0-fcc64ce5bdde","Type":"ContainerStarted","Data":"97be731a819d9eb7bd54379d314bddb7266431a664713314ac6740299a4e3b9f"}
Aug 05 17:15:07.640185 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:07.640134    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-wqbqq" podStartSLOduration=1.27267483 podStartE2EDuration="2.640119496s" totalImagesPullingTime="1.367444666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:15:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:07.640015754 +0000 UTC m=+142.208518173" watchObservedRunningTime="2026-08-05 17:15:07.640119496 +0000 UTC m=+142.208621917"
Aug 05 17:15:07.640526 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:07.640505    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7577cb494d-jlsvz" podStartSLOduration=2.640498602 podStartE2EDuration="2.640498602s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:15:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:06.638632257 +0000 UTC m=+141.207134679" watchObservedRunningTime="2026-08-05 17:15:07.640498602 +0000 UTC m=+142.209001022"
Aug 05 17:15:08.608997 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:08.608965    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:08.619601 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:08.619571    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-wqbqq"
Aug 05 17:15:08.624035 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:08.624015    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-wqbqq"
Aug 05 17:15:08.709336 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:08.709304    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:08.882115 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:08.882032    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:09.056285 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:09.056249    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:09.151690 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:09.151603    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:10.053850 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:10.053813    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:11.748822 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:11.748765    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:12.422414 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:12.422378    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:12.839357 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:12.839325    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:15.082093 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.082050    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:15.230623 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.230580    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:15.334361 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.334283    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gjl59"]
Aug 05 17:15:15.337902 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.337880    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gjl59"
Aug 05 17:15:15.340017 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.339993    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:15.340568 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.340521    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Aug 05 17:15:15.340738 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.340721    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Aug 05 17:15:15.341527 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.341510    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Aug 05 17:15:15.341646 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.341527    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-8d8w5\""
Aug 05 17:15:15.351327 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.351304    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gjl59"]
Aug 05 17:15:15.357755 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.357733    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-vbdzs"]
Aug 05 17:15:15.359793 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.359778    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-vbdzs"
Aug 05 17:15:15.363183 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.363163    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Aug 05 17:15:15.363319 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.363192    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Aug 05 17:15:15.363319 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.363164    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-5mrr7\""
Aug 05 17:15:15.363792 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.363775    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Aug 05 17:15:15.377862 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.377838    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-vbdzs"]
Aug 05 17:15:15.388059 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.388025    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2qfkz"]
Aug 05 17:15:15.390215 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.390195    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2qfkz"
Aug 05 17:15:15.393019 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.392996    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Aug 05 17:15:15.393019 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.393012    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Aug 05 17:15:15.393238 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.393212    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Aug 05 17:15:15.393238 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.393234    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-64j8g\""
Aug 05 17:15:15.411488 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.411462    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6d5cc792-9c36-476d-9e3a-7839f8371880-node-exporter-accelerators-collector-config\") pod \"node-exporter-2qfkz\" (UID: \"6d5cc792-9c36-476d-9e3a-7839f8371880\") " pod="openshift-monitoring/node-exporter-2qfkz"
Aug 05 17:15:15.411636 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.411493    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6d5cc792-9c36-476d-9e3a-7839f8371880-node-exporter-textfile\") pod \"node-exporter-2qfkz\" (UID: \"6d5cc792-9c36-476d-9e3a-7839f8371880\") " pod="openshift-monitoring/node-exporter-2qfkz"
Aug 05 17:15:15.411636 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.411511    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d5cc792-9c36-476d-9e3a-7839f8371880-metrics-client-ca\") pod \"node-exporter-2qfkz\" (UID: \"6d5cc792-9c36-476d-9e3a-7839f8371880\") " pod="openshift-monitoring/node-exporter-2qfkz"
Aug 05 17:15:15.411636 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.411531    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f26abd48-4f13-4afe-be3e-6fb183e060d6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-vbdzs\" (UID: \"f26abd48-4f13-4afe-be3e-6fb183e060d6\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-vbdzs"
Aug 05 17:15:15.411636 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.411596    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f26abd48-4f13-4afe-be3e-6fb183e060d6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-vbdzs\" (UID: \"f26abd48-4f13-4afe-be3e-6fb183e060d6\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-vbdzs"
Aug 05 17:15:15.411773 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.411639    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d5cc792-9c36-476d-9e3a-7839f8371880-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2qfkz\" (UID: \"6d5cc792-9c36-476d-9e3a-7839f8371880\") " pod="openshift-monitoring/node-exporter-2qfkz"
Aug 05 17:15:15.411773 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.411656    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f26abd48-4f13-4afe-be3e-6fb183e060d6-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-vbdzs\" (UID: \"f26abd48-4f13-4afe-be3e-6fb183e060d6\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-vbdzs"
Aug 05 17:15:15.411773 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.411675    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef2c0d95-3d83-4ffe-b694-12fe23cef1d0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-gjl59\" (UID: \"ef2c0d95-3d83-4ffe-b694-12fe23cef1d0\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gjl59"
Aug 05 17:15:15.411773 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.411693    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6d5cc792-9c36-476d-9e3a-7839f8371880-node-exporter-tls\") pod \"node-exporter-2qfkz\" (UID: \"6d5cc792-9c36-476d-9e3a-7839f8371880\") " pod="openshift-monitoring/node-exporter-2qfkz"
Aug 05 17:15:15.411773 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.411732    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7lk9\" (UniqueName: \"kubernetes.io/projected/f26abd48-4f13-4afe-be3e-6fb183e060d6-kube-api-access-w7lk9\") pod \"kube-state-metrics-6bd9664c4-vbdzs\" (UID: \"f26abd48-4f13-4afe-be3e-6fb183e060d6\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-vbdzs"
Aug 05 17:15:15.411773 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.411760    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f26abd48-4f13-4afe-be3e-6fb183e060d6-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-vbdzs\" (UID: \"f26abd48-4f13-4afe-be3e-6fb183e060d6\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-vbdzs"
Aug 05 17:15:15.415705 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.412157    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6d5cc792-9c36-476d-9e3a-7839f8371880-sys\") pod \"node-exporter-2qfkz\" (UID: \"6d5cc792-9c36-476d-9e3a-7839f8371880\") " pod="openshift-monitoring/node-exporter-2qfkz"
Aug 05 17:15:15.415705 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.412259    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdbxh\" (UniqueName: \"kubernetes.io/projected/6d5cc792-9c36-476d-9e3a-7839f8371880-kube-api-access-mdbxh\") pod \"node-exporter-2qfkz\" (UID: \"6d5cc792-9c36-476d-9e3a-7839f8371880\") " pod="openshift-monitoring/node-exporter-2qfkz"
Aug 05 17:15:15.415705 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.412320    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef2c0d95-3d83-4ffe-b694-12fe23cef1d0-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-gjl59\" (UID: \"ef2c0d95-3d83-4ffe-b694-12fe23cef1d0\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gjl59"
Aug 05 17:15:15.415705 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.412357    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6d5cc792-9c36-476d-9e3a-7839f8371880-root\") pod \"node-exporter-2qfkz\" (UID: \"6d5cc792-9c36-476d-9e3a-7839f8371880\") " pod="openshift-monitoring/node-exporter-2qfkz"
Aug 05 17:15:15.415705 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.412404    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6d5cc792-9c36-476d-9e3a-7839f8371880-node-exporter-wtmp\") pod \"node-exporter-2qfkz\" (UID: \"6d5cc792-9c36-476d-9e3a-7839f8371880\") " pod="openshift-monitoring/node-exporter-2qfkz"
Aug 05 17:15:15.415705 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.412437    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef2c0d95-3d83-4ffe-b694-12fe23cef1d0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-gjl59\" (UID: \"ef2c0d95-3d83-4ffe-b694-12fe23cef1d0\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gjl59"
Aug 05 17:15:15.415705 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.412469    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmmjd\" (UniqueName: \"kubernetes.io/projected/ef2c0d95-3d83-4ffe-b694-12fe23cef1d0-kube-api-access-nmmjd\") pod \"openshift-state-metrics-6bb4d7b4dd-gjl59\" (UID: \"ef2c0d95-3d83-4ffe-b694-12fe23cef1d0\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gjl59"
Aug 05 17:15:15.415705 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.412499    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f26abd48-4f13-4afe-be3e-6fb183e060d6-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-vbdzs\" (UID: \"f26abd48-4f13-4afe-be3e-6fb183e060d6\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-vbdzs"
Aug 05 17:15:15.445128 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.445092    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:15.513413 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.513369    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d5cc792-9c36-476d-9e3a-7839f8371880-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2qfkz\" (UID: \"6d5cc792-9c36-476d-9e3a-7839f8371880\") " pod="openshift-monitoring/node-exporter-2qfkz"
Aug 05 17:15:15.513413 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.513415    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f26abd48-4f13-4afe-be3e-6fb183e060d6-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-vbdzs\" (UID: \"f26abd48-4f13-4afe-be3e-6fb183e060d6\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-vbdzs"
Aug 05 17:15:15.513699 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.513440    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef2c0d95-3d83-4ffe-b694-12fe23cef1d0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-gjl59\" (UID: \"ef2c0d95-3d83-4ffe-b694-12fe23cef1d0\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gjl59"
Aug 05 17:15:15.513699 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.513465    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6d5cc792-9c36-476d-9e3a-7839f8371880-node-exporter-tls\") pod \"node-exporter-2qfkz\" (UID: \"6d5cc792-9c36-476d-9e3a-7839f8371880\") " pod="openshift-monitoring/node-exporter-2qfkz"
Aug 05 17:15:15.513699 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.513483    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7lk9\" (UniqueName: \"kubernetes.io/projected/f26abd48-4f13-4afe-be3e-6fb183e060d6-kube-api-access-w7lk9\") pod \"kube-state-metrics-6bd9664c4-vbdzs\" (UID: \"f26abd48-4f13-4afe-be3e-6fb183e060d6\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-vbdzs"
Aug 05 17:15:15.513699 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.513501    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f26abd48-4f13-4afe-be3e-6fb183e060d6-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-vbdzs\" (UID: \"f26abd48-4f13-4afe-be3e-6fb183e060d6\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-vbdzs"
Aug 05 17:15:15.513699 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.513545    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6d5cc792-9c36-476d-9e3a-7839f8371880-sys\") pod \"node-exporter-2qfkz\" (UID: \"6d5cc792-9c36-476d-9e3a-7839f8371880\") " pod="openshift-monitoring/node-exporter-2qfkz"
Aug 05 17:15:15.513699 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.513598    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdbxh\" (UniqueName: \"kubernetes.io/projected/6d5cc792-9c36-476d-9e3a-7839f8371880-kube-api-access-mdbxh\") pod \"node-exporter-2qfkz\" (UID: \"6d5cc792-9c36-476d-9e3a-7839f8371880\") " pod="openshift-monitoring/node-exporter-2qfkz"
Aug 05 17:15:15.513699 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.513633    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef2c0d95-3d83-4ffe-b694-12fe23cef1d0-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-gjl59\" (UID: \"ef2c0d95-3d83-4ffe-b694-12fe23cef1d0\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gjl59"
Aug 05 17:15:15.513699 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:15:15.513654    2580 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Aug 05 17:15:15.513699 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:15:15.513665    2580 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Aug 05 17:15:15.513699 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.513703    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6d5cc792-9c36-476d-9e3a-7839f8371880-root\") pod \"node-exporter-2qfkz\" (UID: \"6d5cc792-9c36-476d-9e3a-7839f8371880\") " pod="openshift-monitoring/node-exporter-2qfkz"
Aug 05 17:15:15.514175 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:15:15.513728    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f26abd48-4f13-4afe-be3e-6fb183e060d6-kube-state-metrics-tls podName:f26abd48-4f13-4afe-be3e-6fb183e060d6 nodeName:}" failed. No retries permitted until 2026-08-05 17:15:16.013707134 +0000 UTC m=+150.582209538 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/f26abd48-4f13-4afe-be3e-6fb183e060d6-kube-state-metrics-tls") pod "kube-state-metrics-6bd9664c4-vbdzs" (UID: "f26abd48-4f13-4afe-be3e-6fb183e060d6") : secret "kube-state-metrics-tls" not found
Aug 05 17:15:15.514175 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:15:15.513749    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d5cc792-9c36-476d-9e3a-7839f8371880-node-exporter-tls podName:6d5cc792-9c36-476d-9e3a-7839f8371880 nodeName:}" failed. No retries permitted until 2026-08-05 17:15:16.013739631 +0000 UTC m=+150.582242031 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/6d5cc792-9c36-476d-9e3a-7839f8371880-node-exporter-tls") pod "node-exporter-2qfkz" (UID: "6d5cc792-9c36-476d-9e3a-7839f8371880") : secret "node-exporter-tls" not found
Aug 05 17:15:15.514175 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.513750    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6d5cc792-9c36-476d-9e3a-7839f8371880-sys\") pod \"node-exporter-2qfkz\" (UID: \"6d5cc792-9c36-476d-9e3a-7839f8371880\") " pod="openshift-monitoring/node-exporter-2qfkz"
Aug 05 17:15:15.514175 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.513657    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6d5cc792-9c36-476d-9e3a-7839f8371880-root\") pod \"node-exporter-2qfkz\" (UID: \"6d5cc792-9c36-476d-9e3a-7839f8371880\") " pod="openshift-monitoring/node-exporter-2qfkz"
Aug 05 17:15:15.514175 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.513868    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6d5cc792-9c36-476d-9e3a-7839f8371880-node-exporter-wtmp\") pod \"node-exporter-2qfkz\" (UID: \"6d5cc792-9c36-476d-9e3a-7839f8371880\") " pod="openshift-monitoring/node-exporter-2qfkz"
Aug 05 17:15:15.514175 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.513901    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef2c0d95-3d83-4ffe-b694-12fe23cef1d0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-gjl59\" (UID: \"ef2c0d95-3d83-4ffe-b694-12fe23cef1d0\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gjl59"
Aug 05 17:15:15.514175 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.513934    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmmjd\" (UniqueName: \"kubernetes.io/projected/ef2c0d95-3d83-4ffe-b694-12fe23cef1d0-kube-api-access-nmmjd\") pod \"openshift-state-metrics-6bb4d7b4dd-gjl59\" (UID: \"ef2c0d95-3d83-4ffe-b694-12fe23cef1d0\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gjl59"
Aug 05 17:15:15.514175 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.514073    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6d5cc792-9c36-476d-9e3a-7839f8371880-node-exporter-wtmp\") pod \"node-exporter-2qfkz\" (UID: \"6d5cc792-9c36-476d-9e3a-7839f8371880\") " pod="openshift-monitoring/node-exporter-2qfkz"
Aug 05 17:15:15.514175 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.514118    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f26abd48-4f13-4afe-be3e-6fb183e060d6-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-vbdzs\" (UID: \"f26abd48-4f13-4afe-be3e-6fb183e060d6\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-vbdzs"
Aug 05 17:15:15.514175 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.514169    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6d5cc792-9c36-476d-9e3a-7839f8371880-node-exporter-accelerators-collector-config\") pod \"node-exporter-2qfkz\" (UID: \"6d5cc792-9c36-476d-9e3a-7839f8371880\") " pod="openshift-monitoring/node-exporter-2qfkz"
Aug 05 17:15:15.514724 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.514208    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6d5cc792-9c36-476d-9e3a-7839f8371880-node-exporter-textfile\") pod \"node-exporter-2qfkz\" (UID: \"6d5cc792-9c36-476d-9e3a-7839f8371880\") " pod="openshift-monitoring/node-exporter-2qfkz"
Aug 05 17:15:15.514724 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.514241    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d5cc792-9c36-476d-9e3a-7839f8371880-metrics-client-ca\") pod \"node-exporter-2qfkz\" (UID: \"6d5cc792-9c36-476d-9e3a-7839f8371880\") " pod="openshift-monitoring/node-exporter-2qfkz"
Aug 05 17:15:15.514724 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.514275    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f26abd48-4f13-4afe-be3e-6fb183e060d6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-vbdzs\" (UID: \"f26abd48-4f13-4afe-be3e-6fb183e060d6\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-vbdzs"
Aug 05 17:15:15.514724 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.514306    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f26abd48-4f13-4afe-be3e-6fb183e060d6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-vbdzs\" (UID: \"f26abd48-4f13-4afe-be3e-6fb183e060d6\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-vbdzs"
Aug 05 17:15:15.514724 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.514474    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f26abd48-4f13-4afe-be3e-6fb183e060d6-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-vbdzs\" (UID: \"f26abd48-4f13-4afe-be3e-6fb183e060d6\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-vbdzs"
Aug 05 17:15:15.514724 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.514644    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f26abd48-4f13-4afe-be3e-6fb183e060d6-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-vbdzs\" (UID: \"f26abd48-4f13-4afe-be3e-6fb183e060d6\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-vbdzs"
Aug 05 17:15:15.515045 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.514756    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef2c0d95-3d83-4ffe-b694-12fe23cef1d0-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-gjl59\" (UID: \"ef2c0d95-3d83-4ffe-b694-12fe23cef1d0\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gjl59"
Aug 05 17:15:15.515237 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.515154    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d5cc792-9c36-476d-9e3a-7839f8371880-metrics-client-ca\") pod \"node-exporter-2qfkz\" (UID: \"6d5cc792-9c36-476d-9e3a-7839f8371880\") " pod="openshift-monitoring/node-exporter-2qfkz"
Aug 05 17:15:15.515298 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.515280    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6d5cc792-9c36-476d-9e3a-7839f8371880-node-exporter-textfile\") pod \"node-exporter-2qfkz\" (UID: \"6d5cc792-9c36-476d-9e3a-7839f8371880\") " pod="openshift-monitoring/node-exporter-2qfkz"
Aug 05 17:15:15.515359 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.515307    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6d5cc792-9c36-476d-9e3a-7839f8371880-node-exporter-accelerators-collector-config\") pod \"node-exporter-2qfkz\" (UID: \"6d5cc792-9c36-476d-9e3a-7839f8371880\") " pod="openshift-monitoring/node-exporter-2qfkz"
Aug 05 17:15:15.515416 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.515365    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f26abd48-4f13-4afe-be3e-6fb183e060d6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-vbdzs\" (UID: \"f26abd48-4f13-4afe-be3e-6fb183e060d6\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-vbdzs"
Aug 05 17:15:15.516238 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.516215    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d5cc792-9c36-476d-9e3a-7839f8371880-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2qfkz\" (UID: \"6d5cc792-9c36-476d-9e3a-7839f8371880\") " pod="openshift-monitoring/node-exporter-2qfkz"
Aug 05 17:15:15.516436 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.516414    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef2c0d95-3d83-4ffe-b694-12fe23cef1d0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-gjl59\" (UID: \"ef2c0d95-3d83-4ffe-b694-12fe23cef1d0\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gjl59"
Aug 05 17:15:15.516745 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.516728    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef2c0d95-3d83-4ffe-b694-12fe23cef1d0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-gjl59\" (UID: \"ef2c0d95-3d83-4ffe-b694-12fe23cef1d0\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gjl59"
Aug 05 17:15:15.516803 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.516792    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f26abd48-4f13-4afe-be3e-6fb183e060d6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-vbdzs\" (UID: \"f26abd48-4f13-4afe-be3e-6fb183e060d6\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-vbdzs"
Aug 05 17:15:15.525063 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.525031    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdbxh\" (UniqueName: \"kubernetes.io/projected/6d5cc792-9c36-476d-9e3a-7839f8371880-kube-api-access-mdbxh\") pod \"node-exporter-2qfkz\" (UID: \"6d5cc792-9c36-476d-9e3a-7839f8371880\") " pod="openshift-monitoring/node-exporter-2qfkz"
Aug 05 17:15:15.525181 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.525098    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmmjd\" (UniqueName: \"kubernetes.io/projected/ef2c0d95-3d83-4ffe-b694-12fe23cef1d0-kube-api-access-nmmjd\") pod \"openshift-state-metrics-6bb4d7b4dd-gjl59\" (UID: \"ef2c0d95-3d83-4ffe-b694-12fe23cef1d0\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gjl59"
Aug 05 17:15:15.525407 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.525389    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7lk9\" (UniqueName: \"kubernetes.io/projected/f26abd48-4f13-4afe-be3e-6fb183e060d6-kube-api-access-w7lk9\") pod \"kube-state-metrics-6bd9664c4-vbdzs\" (UID: \"f26abd48-4f13-4afe-be3e-6fb183e060d6\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-vbdzs"
Aug 05 17:15:15.538374 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.538350    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:15.638992 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.638905    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:15.646776 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.646749    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gjl59"
Aug 05 17:15:15.756769 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.756739    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:15.782468 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.782438    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gjl59"]
Aug 05 17:15:15.785833 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:15:15.785803    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef2c0d95_3d83_4ffe_b694_12fe23cef1d0.slice/crio-fcec5b454993208862a8d0b4752af0ffee3776248de49e83389c8e2eea6563e3 WatchSource:0}: Error finding container fcec5b454993208862a8d0b4752af0ffee3776248de49e83389c8e2eea6563e3: Status 404 returned error can't find the container with id fcec5b454993208862a8d0b4752af0ffee3776248de49e83389c8e2eea6563e3
Aug 05 17:15:15.895352 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:15.895327    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:16.018484 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:16.018445    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6d5cc792-9c36-476d-9e3a-7839f8371880-node-exporter-tls\") pod \"node-exporter-2qfkz\" (UID: \"6d5cc792-9c36-476d-9e3a-7839f8371880\") " pod="openshift-monitoring/node-exporter-2qfkz"
Aug 05 17:15:16.018484 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:16.018481    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f26abd48-4f13-4afe-be3e-6fb183e060d6-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-vbdzs\" (UID: \"f26abd48-4f13-4afe-be3e-6fb183e060d6\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-vbdzs"
Aug 05 17:15:16.020975 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:16.020956    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6d5cc792-9c36-476d-9e3a-7839f8371880-node-exporter-tls\") pod \"node-exporter-2qfkz\" (UID: \"6d5cc792-9c36-476d-9e3a-7839f8371880\") " pod="openshift-monitoring/node-exporter-2qfkz"
Aug 05 17:15:16.021151 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:16.021115    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f26abd48-4f13-4afe-be3e-6fb183e060d6-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-vbdzs\" (UID: \"f26abd48-4f13-4afe-be3e-6fb183e060d6\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-vbdzs"
Aug 05 17:15:16.269170 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:16.269087    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-vbdzs"
Aug 05 17:15:16.299249 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:16.299220    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2qfkz"
Aug 05 17:15:16.311046 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:15:16.311007    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d5cc792_9c36_476d_9e3a_7839f8371880.slice/crio-9e86794ff06655c01d3c1a0b4dac7d1664783e6c6175053238936f49e8d7fba9 WatchSource:0}: Error finding container 9e86794ff06655c01d3c1a0b4dac7d1664783e6c6175053238936f49e8d7fba9: Status 404 returned error can't find the container with id 9e86794ff06655c01d3c1a0b4dac7d1664783e6c6175053238936f49e8d7fba9
Aug 05 17:15:16.417843 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:16.417813    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-vbdzs"]
Aug 05 17:15:16.420851 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:15:16.420823    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf26abd48_4f13_4afe_be3e_6fb183e060d6.slice/crio-e36eef53ae48a60b20d8723aee27e0a3b0f9e12f072b8bad45dcfea96a3d7d3b WatchSource:0}: Error finding container e36eef53ae48a60b20d8723aee27e0a3b0f9e12f072b8bad45dcfea96a3d7d3b: Status 404 returned error can't find the container with id e36eef53ae48a60b20d8723aee27e0a3b0f9e12f072b8bad45dcfea96a3d7d3b
Aug 05 17:15:16.549678 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:16.549580    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:16.648671 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:16.648633    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2qfkz" event={"ID":"6d5cc792-9c36-476d-9e3a-7839f8371880","Type":"ContainerStarted","Data":"9e86794ff06655c01d3c1a0b4dac7d1664783e6c6175053238936f49e8d7fba9"}
Aug 05 17:15:16.649954 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:16.649915    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-vbdzs" event={"ID":"f26abd48-4f13-4afe-be3e-6fb183e060d6","Type":"ContainerStarted","Data":"e36eef53ae48a60b20d8723aee27e0a3b0f9e12f072b8bad45dcfea96a3d7d3b"}
Aug 05 17:15:16.650624 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:16.650588    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:16.652162 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:16.652125    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gjl59" event={"ID":"ef2c0d95-3d83-4ffe-b694-12fe23cef1d0","Type":"ContainerStarted","Data":"47df08f82e97dd5402180bac274dee045a24bc188647004ee72a40165caa048c"}
Aug 05 17:15:16.652287 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:16.652178    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gjl59" event={"ID":"ef2c0d95-3d83-4ffe-b694-12fe23cef1d0","Type":"ContainerStarted","Data":"01fe95dd4c1443f56b1c34b5c4f9cf35dfcf7d1b2e74c6c04c5c47786659a0a6"}
Aug 05 17:15:16.652287 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:16.652208    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gjl59" event={"ID":"ef2c0d95-3d83-4ffe-b694-12fe23cef1d0","Type":"ContainerStarted","Data":"fcec5b454993208862a8d0b4752af0ffee3776248de49e83389c8e2eea6563e3"}
Aug 05 17:15:17.484542 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:17.484512    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-f56bf8d96-mrbnt"]
Aug 05 17:15:17.487572 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:17.487531    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-f56bf8d96-mrbnt"
Aug 05 17:15:17.498125 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:17.498088    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Aug 05 17:15:17.498241 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:17.498179    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Aug 05 17:15:17.498241 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:17.498216    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-htdt5\""
Aug 05 17:15:17.498670 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:17.498479    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Aug 05 17:15:17.498670 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:17.498533    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Aug 05 17:15:17.498670 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:17.498539    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Aug 05 17:15:17.498885 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:17.498684    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-da6rhcvu9lghi\""
Aug 05 17:15:17.514796 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:17.514741    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-f56bf8d96-mrbnt"]
Aug 05 17:15:17.531857 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:17.531816    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cfbb7139-e70b-4e5f-9e5a-aa719dea7704-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f56bf8d96-mrbnt\" (UID: \"cfbb7139-e70b-4e5f-9e5a-aa719dea7704\") " pod="openshift-monitoring/thanos-querier-f56bf8d96-mrbnt"
Aug 05 17:15:17.531857 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:17.531849    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cfbb7139-e70b-4e5f-9e5a-aa719dea7704-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f56bf8d96-mrbnt\" (UID: \"cfbb7139-e70b-4e5f-9e5a-aa719dea7704\") " pod="openshift-monitoring/thanos-querier-f56bf8d96-mrbnt"
Aug 05 17:15:17.532073 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:17.531877    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfbb7139-e70b-4e5f-9e5a-aa719dea7704-metrics-client-ca\") pod \"thanos-querier-f56bf8d96-mrbnt\" (UID: \"cfbb7139-e70b-4e5f-9e5a-aa719dea7704\") " pod="openshift-monitoring/thanos-querier-f56bf8d96-mrbnt"
Aug 05 17:15:17.532073 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:17.531893    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxm4d\" (UniqueName: \"kubernetes.io/projected/cfbb7139-e70b-4e5f-9e5a-aa719dea7704-kube-api-access-zxm4d\") pod \"thanos-querier-f56bf8d96-mrbnt\" (UID: \"cfbb7139-e70b-4e5f-9e5a-aa719dea7704\") " pod="openshift-monitoring/thanos-querier-f56bf8d96-mrbnt"
Aug 05 17:15:17.532073 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:17.531964    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cfbb7139-e70b-4e5f-9e5a-aa719dea7704-secret-thanos-querier-tls\") pod \"thanos-querier-f56bf8d96-mrbnt\" (UID: \"cfbb7139-e70b-4e5f-9e5a-aa719dea7704\") " pod="openshift-monitoring/thanos-querier-f56bf8d96-mrbnt"
Aug 05 17:15:17.532176 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:17.532063    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cfbb7139-e70b-4e5f-9e5a-aa719dea7704-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f56bf8d96-mrbnt\" (UID: \"cfbb7139-e70b-4e5f-9e5a-aa719dea7704\") " pod="openshift-monitoring/thanos-querier-f56bf8d96-mrbnt"
Aug 05 17:15:17.532176 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:17.532150    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cfbb7139-e70b-4e5f-9e5a-aa719dea7704-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f56bf8d96-mrbnt\" (UID: \"cfbb7139-e70b-4e5f-9e5a-aa719dea7704\") " pod="openshift-monitoring/thanos-querier-f56bf8d96-mrbnt"
Aug 05 17:15:17.532245 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:17.532179    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cfbb7139-e70b-4e5f-9e5a-aa719dea7704-secret-grpc-tls\") pod \"thanos-querier-f56bf8d96-mrbnt\" (UID: \"cfbb7139-e70b-4e5f-9e5a-aa719dea7704\") " pod="openshift-monitoring/thanos-querier-f56bf8d96-mrbnt"
Aug 05 17:15:17.633116 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:17.633072    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cfbb7139-e70b-4e5f-9e5a-aa719dea7704-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f56bf8d96-mrbnt\" (UID: \"cfbb7139-e70b-4e5f-9e5a-aa719dea7704\") " pod="openshift-monitoring/thanos-querier-f56bf8d96-mrbnt"
Aug 05 17:15:17.633306 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:17.633164    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cfbb7139-e70b-4e5f-9e5a-aa719dea7704-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f56bf8d96-mrbnt\" (UID: \"cfbb7139-e70b-4e5f-9e5a-aa719dea7704\") " pod="openshift-monitoring/thanos-querier-f56bf8d96-mrbnt"
Aug 05 17:15:17.633306 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:17.633194    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cfbb7139-e70b-4e5f-9e5a-aa719dea7704-secret-grpc-tls\") pod \"thanos-querier-f56bf8d96-mrbnt\" (UID: \"cfbb7139-e70b-4e5f-9e5a-aa719dea7704\") " pod="openshift-monitoring/thanos-querier-f56bf8d96-mrbnt"
Aug 05 17:15:17.633306 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:17.633244    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cfbb7139-e70b-4e5f-9e5a-aa719dea7704-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f56bf8d96-mrbnt\" (UID: \"cfbb7139-e70b-4e5f-9e5a-aa719dea7704\") " pod="openshift-monitoring/thanos-querier-f56bf8d96-mrbnt"
Aug 05 17:15:17.633438 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:17.633409    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cfbb7139-e70b-4e5f-9e5a-aa719dea7704-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f56bf8d96-mrbnt\" (UID: \"cfbb7139-e70b-4e5f-9e5a-aa719dea7704\") " pod="openshift-monitoring/thanos-querier-f56bf8d96-mrbnt"
Aug 05 17:15:17.633481 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:17.633439    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfbb7139-e70b-4e5f-9e5a-aa719dea7704-metrics-client-ca\") pod \"thanos-querier-f56bf8d96-mrbnt\" (UID: \"cfbb7139-e70b-4e5f-9e5a-aa719dea7704\") " pod="openshift-monitoring/thanos-querier-f56bf8d96-mrbnt"
Aug 05 17:15:17.633481 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:17.633466    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxm4d\" (UniqueName: \"kubernetes.io/projected/cfbb7139-e70b-4e5f-9e5a-aa719dea7704-kube-api-access-zxm4d\") pod \"thanos-querier-f56bf8d96-mrbnt\" (UID: \"cfbb7139-e70b-4e5f-9e5a-aa719dea7704\") " pod="openshift-monitoring/thanos-querier-f56bf8d96-mrbnt"
Aug 05 17:15:17.633637 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:17.633516    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cfbb7139-e70b-4e5f-9e5a-aa719dea7704-secret-thanos-querier-tls\") pod \"thanos-querier-f56bf8d96-mrbnt\" (UID: \"cfbb7139-e70b-4e5f-9e5a-aa719dea7704\") " pod="openshift-monitoring/thanos-querier-f56bf8d96-mrbnt"
Aug 05 17:15:17.634844 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:17.634475    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfbb7139-e70b-4e5f-9e5a-aa719dea7704-metrics-client-ca\") pod \"thanos-querier-f56bf8d96-mrbnt\" (UID: \"cfbb7139-e70b-4e5f-9e5a-aa719dea7704\") " pod="openshift-monitoring/thanos-querier-f56bf8d96-mrbnt"
Aug 05 17:15:17.636366 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:17.636340    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cfbb7139-e70b-4e5f-9e5a-aa719dea7704-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f56bf8d96-mrbnt\" (UID: \"cfbb7139-e70b-4e5f-9e5a-aa719dea7704\") " pod="openshift-monitoring/thanos-querier-f56bf8d96-mrbnt"
Aug 05 17:15:17.636527 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:17.636502    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cfbb7139-e70b-4e5f-9e5a-aa719dea7704-secret-grpc-tls\") pod \"thanos-querier-f56bf8d96-mrbnt\" (UID: \"cfbb7139-e70b-4e5f-9e5a-aa719dea7704\") " pod="openshift-monitoring/thanos-querier-f56bf8d96-mrbnt"
Aug 05 17:15:17.636724 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:17.636679    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cfbb7139-e70b-4e5f-9e5a-aa719dea7704-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f56bf8d96-mrbnt\" (UID: \"cfbb7139-e70b-4e5f-9e5a-aa719dea7704\") " pod="openshift-monitoring/thanos-querier-f56bf8d96-mrbnt"
Aug 05 17:15:17.636833 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:17.636755    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cfbb7139-e70b-4e5f-9e5a-aa719dea7704-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f56bf8d96-mrbnt\" (UID: \"cfbb7139-e70b-4e5f-9e5a-aa719dea7704\") " pod="openshift-monitoring/thanos-querier-f56bf8d96-mrbnt"
Aug 05 17:15:17.638362 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:17.638340    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cfbb7139-e70b-4e5f-9e5a-aa719dea7704-secret-thanos-querier-tls\") pod \"thanos-querier-f56bf8d96-mrbnt\" (UID: \"cfbb7139-e70b-4e5f-9e5a-aa719dea7704\") " pod="openshift-monitoring/thanos-querier-f56bf8d96-mrbnt"
Aug 05 17:15:17.639324 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:17.639300    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cfbb7139-e70b-4e5f-9e5a-aa719dea7704-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f56bf8d96-mrbnt\" (UID: \"cfbb7139-e70b-4e5f-9e5a-aa719dea7704\") " pod="openshift-monitoring/thanos-querier-f56bf8d96-mrbnt"
Aug 05 17:15:17.644228 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:17.644207    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxm4d\" (UniqueName: \"kubernetes.io/projected/cfbb7139-e70b-4e5f-9e5a-aa719dea7704-kube-api-access-zxm4d\") pod \"thanos-querier-f56bf8d96-mrbnt\" (UID: \"cfbb7139-e70b-4e5f-9e5a-aa719dea7704\") " pod="openshift-monitoring/thanos-querier-f56bf8d96-mrbnt"
Aug 05 17:15:17.658587 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:17.658533    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gjl59" event={"ID":"ef2c0d95-3d83-4ffe-b694-12fe23cef1d0","Type":"ContainerStarted","Data":"0a60c9ac886123aa97ae87a892ecbbe1d07e5abdd95b55cda115592a0c46d478"}
Aug 05 17:15:17.687511 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:17.687456    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gjl59" podStartSLOduration=1.700278409 podStartE2EDuration="2.687440243s" totalImagesPullingTime="987.161834ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:15:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:17.685211792 +0000 UTC m=+152.253714213" watchObservedRunningTime="2026-08-05 17:15:17.687440243 +0000 UTC m=+152.255942663"
Aug 05 17:15:17.800758 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:17.800698    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-f56bf8d96-mrbnt"
Aug 05 17:15:17.992891 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:17.992866    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-f56bf8d96-mrbnt"]
Aug 05 17:15:17.999229 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:15:17.999197    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfbb7139_e70b_4e5f_9e5a_aa719dea7704.slice/crio-2675aa84a67a90b396c576f0b704b978b0d33000973a3f9f5cb859fcbb41b6e3 WatchSource:0}: Error finding container 2675aa84a67a90b396c576f0b704b978b0d33000973a3f9f5cb859fcbb41b6e3: Status 404 returned error can't find the container with id 2675aa84a67a90b396c576f0b704b978b0d33000973a3f9f5cb859fcbb41b6e3
Aug 05 17:15:18.498318 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:18.498289    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:18.604928 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:18.604892    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:18.664222 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:18.664184    2580 generic.go:356] "Generic (PLEG): container finished" podID="6d5cc792-9c36-476d-9e3a-7839f8371880" containerID="fe7e31fb3f7dda09c394f78e3e6c95bc5c93b53273664a3c1b642d249bdfb349" exitCode=0
Aug 05 17:15:18.664395 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:18.664266    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2qfkz" event={"ID":"6d5cc792-9c36-476d-9e3a-7839f8371880","Type":"ContainerDied","Data":"fe7e31fb3f7dda09c394f78e3e6c95bc5c93b53273664a3c1b642d249bdfb349"}
Aug 05 17:15:18.666452 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:18.666429    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-vbdzs" event={"ID":"f26abd48-4f13-4afe-be3e-6fb183e060d6","Type":"ContainerStarted","Data":"827957d74e8759ef1ad0a1aecebe03dd4c12937eed689945f34264d10c0d487d"}
Aug 05 17:15:18.666603 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:18.666483    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-vbdzs" event={"ID":"f26abd48-4f13-4afe-be3e-6fb183e060d6","Type":"ContainerStarted","Data":"98adad197d6719dfbce17794c7a5ee66872b4d6871ecd30b24ab7d224ab67192"}
Aug 05 17:15:18.666603 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:18.666513    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-vbdzs" event={"ID":"f26abd48-4f13-4afe-be3e-6fb183e060d6","Type":"ContainerStarted","Data":"70b44cc692fa7e0dd3148458e50f0da2f04be493678caf9860dcc667111cbcb4"}
Aug 05 17:15:18.667602 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:18.667581    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f56bf8d96-mrbnt" event={"ID":"cfbb7139-e70b-4e5f-9e5a-aa719dea7704","Type":"ContainerStarted","Data":"2675aa84a67a90b396c576f0b704b978b0d33000973a3f9f5cb859fcbb41b6e3"}
Aug 05 17:15:18.709398 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:18.709372    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:18.716583 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:18.716525    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-vbdzs" podStartSLOduration=2.388919019 podStartE2EDuration="3.716508206s" totalImagesPullingTime="1.327589187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:15:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:18.715058921 +0000 UTC m=+153.283561343" watchObservedRunningTime="2026-08-05 17:15:18.716508206 +0000 UTC m=+153.285010626"
Aug 05 17:15:19.165078 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:19.165036    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:19.674839 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:19.674805    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-75f748b5b6-8k2rl"]
Aug 05 17:15:19.681891 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:19.681807    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2qfkz" event={"ID":"6d5cc792-9c36-476d-9e3a-7839f8371880","Type":"ContainerStarted","Data":"d6b958ef54f1e49cd99bb03d737d1817d6f1faf5a18d8c5b38873b97d0c9c61b"}
Aug 05 17:15:19.681891 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:19.681858    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2qfkz" event={"ID":"6d5cc792-9c36-476d-9e3a-7839f8371880","Type":"ContainerStarted","Data":"39d6a2c756d0bd7069f0050fb38c8e0d6f8a6b9c38c9dafeb3d935af37fb4383"}
Aug 05 17:15:19.682196 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:19.681957    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-75f748b5b6-8k2rl"
Aug 05 17:15:19.684877 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:19.684852    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Aug 05 17:15:19.685074 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:19.685055    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-6u5ubtk4kmrht\""
Aug 05 17:15:19.686003 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:19.685980    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Aug 05 17:15:19.686115 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:19.686024    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Aug 05 17:15:19.686115 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:19.686049    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Aug 05 17:15:19.686326 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:19.686311    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-9lsm4\""
Aug 05 17:15:19.694601 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:19.694527    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-75f748b5b6-8k2rl"]
Aug 05 17:15:19.705712 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:19.705657    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2qfkz" podStartSLOduration=3.152532609 podStartE2EDuration="4.705640522s" totalImagesPullingTime="1.435112868s" totalInitContainerRuntime="117.995045ms" isStatefulPod=true podCreationTimestamp="2026-08-05 17:15:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:19.703891264 +0000 UTC m=+154.272393680" watchObservedRunningTime="2026-08-05 17:15:19.705640522 +0000 UTC m=+154.274142944"
Aug 05 17:15:19.755758 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:19.755721    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6d2652a5-7ff2-486c-8bfb-2d2c5a75db87-secret-metrics-server-tls\") pod \"metrics-server-75f748b5b6-8k2rl\" (UID: \"6d2652a5-7ff2-486c-8bfb-2d2c5a75db87\") " pod="openshift-monitoring/metrics-server-75f748b5b6-8k2rl"
Aug 05 17:15:19.755758 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:19.755762    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d2652a5-7ff2-486c-8bfb-2d2c5a75db87-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-75f748b5b6-8k2rl\" (UID: \"6d2652a5-7ff2-486c-8bfb-2d2c5a75db87\") " pod="openshift-monitoring/metrics-server-75f748b5b6-8k2rl"
Aug 05 17:15:19.756027 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:19.755877    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6d2652a5-7ff2-486c-8bfb-2d2c5a75db87-metrics-server-audit-profiles\") pod \"metrics-server-75f748b5b6-8k2rl\" (UID: \"6d2652a5-7ff2-486c-8bfb-2d2c5a75db87\") " pod="openshift-monitoring/metrics-server-75f748b5b6-8k2rl"
Aug 05 17:15:19.756098 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:19.756050    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf77b\" (UniqueName: \"kubernetes.io/projected/6d2652a5-7ff2-486c-8bfb-2d2c5a75db87-kube-api-access-pf77b\") pod \"metrics-server-75f748b5b6-8k2rl\" (UID: \"6d2652a5-7ff2-486c-8bfb-2d2c5a75db87\") " pod="openshift-monitoring/metrics-server-75f748b5b6-8k2rl"
Aug 05 17:15:19.756098 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:19.756087    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6d2652a5-7ff2-486c-8bfb-2d2c5a75db87-audit-log\") pod \"metrics-server-75f748b5b6-8k2rl\" (UID: \"6d2652a5-7ff2-486c-8bfb-2d2c5a75db87\") " pod="openshift-monitoring/metrics-server-75f748b5b6-8k2rl"
Aug 05 17:15:19.756280 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:19.756255    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6d2652a5-7ff2-486c-8bfb-2d2c5a75db87-client-ca-bundle\") pod \"metrics-server-75f748b5b6-8k2rl\" (UID: \"6d2652a5-7ff2-486c-8bfb-2d2c5a75db87\") " pod="openshift-monitoring/metrics-server-75f748b5b6-8k2rl"
Aug 05 17:15:19.756334 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:19.756310    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6d2652a5-7ff2-486c-8bfb-2d2c5a75db87-secret-metrics-server-client-certs\") pod \"metrics-server-75f748b5b6-8k2rl\" (UID: \"6d2652a5-7ff2-486c-8bfb-2d2c5a75db87\") " pod="openshift-monitoring/metrics-server-75f748b5b6-8k2rl"
Aug 05 17:15:19.857168 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:19.857130    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf77b\" (UniqueName: \"kubernetes.io/projected/6d2652a5-7ff2-486c-8bfb-2d2c5a75db87-kube-api-access-pf77b\") pod \"metrics-server-75f748b5b6-8k2rl\" (UID: \"6d2652a5-7ff2-486c-8bfb-2d2c5a75db87\") " pod="openshift-monitoring/metrics-server-75f748b5b6-8k2rl"
Aug 05 17:15:19.857168 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:19.857170    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6d2652a5-7ff2-486c-8bfb-2d2c5a75db87-audit-log\") pod \"metrics-server-75f748b5b6-8k2rl\" (UID: \"6d2652a5-7ff2-486c-8bfb-2d2c5a75db87\") " pod="openshift-monitoring/metrics-server-75f748b5b6-8k2rl"
Aug 05 17:15:19.857423 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:19.857219    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6d2652a5-7ff2-486c-8bfb-2d2c5a75db87-client-ca-bundle\") pod \"metrics-server-75f748b5b6-8k2rl\" (UID: \"6d2652a5-7ff2-486c-8bfb-2d2c5a75db87\") " pod="openshift-monitoring/metrics-server-75f748b5b6-8k2rl"
Aug 05 17:15:19.857423 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:19.857240    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6d2652a5-7ff2-486c-8bfb-2d2c5a75db87-secret-metrics-server-client-certs\") pod \"metrics-server-75f748b5b6-8k2rl\" (UID: \"6d2652a5-7ff2-486c-8bfb-2d2c5a75db87\") " pod="openshift-monitoring/metrics-server-75f748b5b6-8k2rl"
Aug 05 17:15:19.857423 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:19.857266    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6d2652a5-7ff2-486c-8bfb-2d2c5a75db87-secret-metrics-server-tls\") pod \"metrics-server-75f748b5b6-8k2rl\" (UID: \"6d2652a5-7ff2-486c-8bfb-2d2c5a75db87\") " pod="openshift-monitoring/metrics-server-75f748b5b6-8k2rl"
Aug 05 17:15:19.857423 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:19.857292    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d2652a5-7ff2-486c-8bfb-2d2c5a75db87-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-75f748b5b6-8k2rl\" (UID: \"6d2652a5-7ff2-486c-8bfb-2d2c5a75db87\") " pod="openshift-monitoring/metrics-server-75f748b5b6-8k2rl"
Aug 05 17:15:19.857423 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:19.857330    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6d2652a5-7ff2-486c-8bfb-2d2c5a75db87-metrics-server-audit-profiles\") pod \"metrics-server-75f748b5b6-8k2rl\" (UID: \"6d2652a5-7ff2-486c-8bfb-2d2c5a75db87\") " pod="openshift-monitoring/metrics-server-75f748b5b6-8k2rl"
Aug 05 17:15:19.858372 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:19.858321    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6d2652a5-7ff2-486c-8bfb-2d2c5a75db87-audit-log\") pod \"metrics-server-75f748b5b6-8k2rl\" (UID: \"6d2652a5-7ff2-486c-8bfb-2d2c5a75db87\") " pod="openshift-monitoring/metrics-server-75f748b5b6-8k2rl"
Aug 05 17:15:19.858549 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:19.858504    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d2652a5-7ff2-486c-8bfb-2d2c5a75db87-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-75f748b5b6-8k2rl\" (UID: \"6d2652a5-7ff2-486c-8bfb-2d2c5a75db87\") " pod="openshift-monitoring/metrics-server-75f748b5b6-8k2rl"
Aug 05 17:15:19.859073 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:19.859050    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6d2652a5-7ff2-486c-8bfb-2d2c5a75db87-metrics-server-audit-profiles\") pod \"metrics-server-75f748b5b6-8k2rl\" (UID: \"6d2652a5-7ff2-486c-8bfb-2d2c5a75db87\") " pod="openshift-monitoring/metrics-server-75f748b5b6-8k2rl"
Aug 05 17:15:19.860403 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:19.860301    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6d2652a5-7ff2-486c-8bfb-2d2c5a75db87-client-ca-bundle\") pod \"metrics-server-75f748b5b6-8k2rl\" (UID: \"6d2652a5-7ff2-486c-8bfb-2d2c5a75db87\") " pod="openshift-monitoring/metrics-server-75f748b5b6-8k2rl"
Aug 05 17:15:19.860492 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:19.860427    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6d2652a5-7ff2-486c-8bfb-2d2c5a75db87-secret-metrics-server-client-certs\") pod \"metrics-server-75f748b5b6-8k2rl\" (UID: \"6d2652a5-7ff2-486c-8bfb-2d2c5a75db87\") " pod="openshift-monitoring/metrics-server-75f748b5b6-8k2rl"
Aug 05 17:15:19.860580 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:19.860501    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6d2652a5-7ff2-486c-8bfb-2d2c5a75db87-secret-metrics-server-tls\") pod \"metrics-server-75f748b5b6-8k2rl\" (UID: \"6d2652a5-7ff2-486c-8bfb-2d2c5a75db87\") " pod="openshift-monitoring/metrics-server-75f748b5b6-8k2rl"
Aug 05 17:15:19.869240 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:19.869215    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf77b\" (UniqueName: \"kubernetes.io/projected/6d2652a5-7ff2-486c-8bfb-2d2c5a75db87-kube-api-access-pf77b\") pod \"metrics-server-75f748b5b6-8k2rl\" (UID: \"6d2652a5-7ff2-486c-8bfb-2d2c5a75db87\") " pod="openshift-monitoring/metrics-server-75f748b5b6-8k2rl"
Aug 05 17:15:19.991790 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:19.991708    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-75f748b5b6-8k2rl"
Aug 05 17:15:20.149470 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:20.149366    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:20.262856 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:20.262830    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:20.337339 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:20.337258    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-75f748b5b6-8k2rl"]
Aug 05 17:15:20.340875 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:15:20.340848    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d2652a5_7ff2_486c_8bfb_2d2c5a75db87.slice/crio-e5fb0b671096c872c9881accee971fa79558ab7a8850e3983883e6866b5d402a WatchSource:0}: Error finding container e5fb0b671096c872c9881accee971fa79558ab7a8850e3983883e6866b5d402a: Status 404 returned error can't find the container with id e5fb0b671096c872c9881accee971fa79558ab7a8850e3983883e6866b5d402a
Aug 05 17:15:20.680739 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:20.680697    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-75f748b5b6-8k2rl" event={"ID":"6d2652a5-7ff2-486c-8bfb-2d2c5a75db87","Type":"ContainerStarted","Data":"e5fb0b671096c872c9881accee971fa79558ab7a8850e3983883e6866b5d402a"}
Aug 05 17:15:20.682813 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:20.682787    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f56bf8d96-mrbnt" event={"ID":"cfbb7139-e70b-4e5f-9e5a-aa719dea7704","Type":"ContainerStarted","Data":"f890dca7ee84dc4ead03cbbb3952db76d4031a4e4f40ed4a95f293320918b7aa"}
Aug 05 17:15:20.682955 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:20.682861    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f56bf8d96-mrbnt" event={"ID":"cfbb7139-e70b-4e5f-9e5a-aa719dea7704","Type":"ContainerStarted","Data":"3745c9f6aedc772f7a72fa01e3d1426476917315a8fd96ca87d579b16541848e"}
Aug 05 17:15:20.682955 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:20.682903    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f56bf8d96-mrbnt" event={"ID":"cfbb7139-e70b-4e5f-9e5a-aa719dea7704","Type":"ContainerStarted","Data":"52be8800c45ea49e9907ba3ae49947433280458d483862523f5071207f468fc7"}
Aug 05 17:15:21.786485 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:21.786451    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:22.035348 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:22.035312    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:22.696054 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:22.696012    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-75f748b5b6-8k2rl" event={"ID":"6d2652a5-7ff2-486c-8bfb-2d2c5a75db87","Type":"ContainerStarted","Data":"690a7588ef9f53014a33f38bf96251b8aac1f3002448546c6066270a4871c19b"}
Aug 05 17:15:22.699122 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:22.699096    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f56bf8d96-mrbnt" event={"ID":"cfbb7139-e70b-4e5f-9e5a-aa719dea7704","Type":"ContainerStarted","Data":"2ba264b89b43f7c357c1182d7719e924f90daca37c51b6be5e0007d572e4f19d"}
Aug 05 17:15:22.699290 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:22.699173    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-f56bf8d96-mrbnt"
Aug 05 17:15:22.699290 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:22.699210    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f56bf8d96-mrbnt" event={"ID":"cfbb7139-e70b-4e5f-9e5a-aa719dea7704","Type":"ContainerStarted","Data":"384ab55278b8ed087be7480c29d471d7ac7936129b872e8be251c39621ff6c7b"}
Aug 05 17:15:22.699396 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:22.699288    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f56bf8d96-mrbnt" event={"ID":"cfbb7139-e70b-4e5f-9e5a-aa719dea7704","Type":"ContainerStarted","Data":"d9877ca3ad38399bfc7ecbc94c968d16533b9f4072db4bbb1c2702bf718609f5"}
Aug 05 17:15:22.718375 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:22.718325    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-75f748b5b6-8k2rl" podStartSLOduration=1.7457583429999999 podStartE2EDuration="3.718310859s" totalImagesPullingTime="1.972552516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:15:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:22.716798574 +0000 UTC m=+157.285300995" watchObservedRunningTime="2026-08-05 17:15:22.718310859 +0000 UTC m=+157.286813280"
Aug 05 17:15:22.746208 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:22.746149    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-f56bf8d96-mrbnt" podStartSLOduration=2.146113789 podStartE2EDuration="5.746131558s" totalImagesPullingTime="3.600017769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:15:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:22.737980373 +0000 UTC m=+157.306482817" watchObservedRunningTime="2026-08-05 17:15:22.746131558 +0000 UTC m=+157.314633979"
Aug 05 17:15:24.384345 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:15:24.384294    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-gn6t8" podUID="b112783c-bc73-4ad0-b67d-9c4c831a3dc9"
Aug 05 17:15:24.706620 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:24.706535    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gn6t8"
Aug 05 17:15:26.188806 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:26.188767    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:26.243079 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:26.243037    2580 patch_prober.go:28] interesting pod/image-registry-7577cb494d-jlsvz container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Aug 05 17:15:26.243237 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:26.243101    2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7577cb494d-jlsvz" podUID="772046af-1b8c-48dd-b9f6-8915d5f611e9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 05 17:15:26.289645 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:26.289607    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:27.131402 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:27.131369    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:27.219756 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:27.219719    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:27.621490 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:27.621464    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7577cb494d-jlsvz"
Aug 05 17:15:27.874145 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:27.874040    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:27.974121 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:27.974088    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:28.092230 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:28.092194    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:28.707936 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:28.707905    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-f56bf8d96-mrbnt"
Aug 05 17:15:29.242788 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:29.242748    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b112783c-bc73-4ad0-b67d-9c4c831a3dc9-metrics-tls\") pod \"dns-default-gn6t8\" (UID: \"b112783c-bc73-4ad0-b67d-9c4c831a3dc9\") " pod="openshift-dns/dns-default-gn6t8"
Aug 05 17:15:29.245149 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:29.245131    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b112783c-bc73-4ad0-b67d-9c4c831a3dc9-metrics-tls\") pod \"dns-default-gn6t8\" (UID: \"b112783c-bc73-4ad0-b67d-9c4c831a3dc9\") " pod="openshift-dns/dns-default-gn6t8"
Aug 05 17:15:29.510762 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:29.510685    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9hnrl\""
Aug 05 17:15:29.517868 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:29.517843    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gn6t8"
Aug 05 17:15:29.678170 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:29.678137    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gn6t8"]
Aug 05 17:15:29.681570 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:15:29.681516    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb112783c_bc73_4ad0_b67d_9c4c831a3dc9.slice/crio-1380639a6309ea1663f2b0247131affadad64f14e699bf253821ee8fbbdd7e41 WatchSource:0}: Error finding container 1380639a6309ea1663f2b0247131affadad64f14e699bf253821ee8fbbdd7e41: Status 404 returned error can't find the container with id 1380639a6309ea1663f2b0247131affadad64f14e699bf253821ee8fbbdd7e41
Aug 05 17:15:29.727098 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:29.727063    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gn6t8" event={"ID":"b112783c-bc73-4ad0-b67d-9c4c831a3dc9","Type":"ContainerStarted","Data":"1380639a6309ea1663f2b0247131affadad64f14e699bf253821ee8fbbdd7e41"}
Aug 05 17:15:29.766279 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:29.766177    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:30.310451 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:30.310419    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:30.413695 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:30.413665    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:30.809620 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:30.809443    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:30.929474 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:30.929429    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:31.653701 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:31.653669    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:31.737578 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:31.737525    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gn6t8" event={"ID":"b112783c-bc73-4ad0-b67d-9c4c831a3dc9","Type":"ContainerStarted","Data":"d89c44c18c42cbdc5b49184e81b56c547c30ea61692121107b7ed1429bc2c1f8"}
Aug 05 17:15:31.737741 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:31.737718    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gn6t8"
Aug 05 17:15:31.737782 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:31.737756    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gn6t8" event={"ID":"b112783c-bc73-4ad0-b67d-9c4c831a3dc9","Type":"ContainerStarted","Data":"8384bde207ed0b5d212324ac4315f48a13f1d82d8b4475c6be06b750c051586f"}
Aug 05 17:15:31.750538 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:31.750511    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:31.759155 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:31.759109    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gn6t8" podStartSLOduration=128.924875424 podStartE2EDuration="2m10.759092867s" totalImagesPullingTime="1.834217443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:13:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:31.757239234 +0000 UTC m=+166.325741661" watchObservedRunningTime="2026-08-05 17:15:31.759092867 +0000 UTC m=+166.327595287"
Aug 05 17:15:33.825222 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:33.825184    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:33.924002 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:33.923968    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:35.079039 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:35.079006    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:39.992810 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:39.992719    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-75f748b5b6-8k2rl"
Aug 05 17:15:39.992810 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:39.992799    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-75f748b5b6-8k2rl"
Aug 05 17:15:41.744390 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:41.744361    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gn6t8"
Aug 05 17:15:41.977851 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:41.977815    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:42.052543 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:42.052465    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:42.326067 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:42.326024    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:42.484029 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:42.483994    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:42.594292 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:42.594206    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:42.941478 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:42.941390    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:43.029126 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:43.029093    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:47.130776 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:47.130741    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:47.271498 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:47.271457    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:51.816731 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:51.816698    2580 generic.go:356] "Generic (PLEG): container finished" podID="91386cb4-60c6-4513-8cb7-39682f9fc29e" containerID="b86f1a5c9d4584bfc6343395636331c1d8a2b75630dd251557870e59b90efe79" exitCode=0
Aug 05 17:15:51.817139 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:51.816772    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-ww266" event={"ID":"91386cb4-60c6-4513-8cb7-39682f9fc29e","Type":"ContainerDied","Data":"b86f1a5c9d4584bfc6343395636331c1d8a2b75630dd251557870e59b90efe79"}
Aug 05 17:15:51.817192 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:51.817170    2580 scope.go:117] "RemoveContainer" containerID="b86f1a5c9d4584bfc6343395636331c1d8a2b75630dd251557870e59b90efe79"
Aug 05 17:15:52.822704 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:52.822669    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-ww266" event={"ID":"91386cb4-60c6-4513-8cb7-39682f9fc29e","Type":"ContainerStarted","Data":"b81b83e3bf40488bd8f3645650bac3287b8ff335add4ac9bc0173b9adc1ea9ec"}
Aug 05 17:15:53.083075 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:53.082992    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:15:53.148179 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:15:53.148150    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:16:00.001438 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:16:00.001408    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-75f748b5b6-8k2rl"
Aug 05 17:16:00.005270 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:16:00.005245    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-75f748b5b6-8k2rl"
Aug 05 17:16:01.858806 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:16:01.858772    2580 generic.go:356] "Generic (PLEG): container finished" podID="7c888748-b317-44e6-a007-a83edb451861" containerID="d45251406a85116a8efb2ee7406c40daab2c06ee90d155c05466908ba4c64085" exitCode=0
Aug 05 17:16:01.859188 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:16:01.858847    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gn2gd" event={"ID":"7c888748-b317-44e6-a007-a83edb451861","Type":"ContainerDied","Data":"d45251406a85116a8efb2ee7406c40daab2c06ee90d155c05466908ba4c64085"}
Aug 05 17:16:01.859188 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:16:01.859162    2580 scope.go:117] "RemoveContainer" containerID="d45251406a85116a8efb2ee7406c40daab2c06ee90d155c05466908ba4c64085"
Aug 05 17:16:02.099607 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:16:02.099569    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:16:02.173582 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:16:02.173481    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:16:02.870036 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:16:02.870000    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-gn2gd" event={"ID":"7c888748-b317-44e6-a007-a83edb451861","Type":"ContainerStarted","Data":"fbbfe8acf53e0cb4c0b83ec026469b2ac9b8ad4d9ed47cbf58d21b68878e4789"}
Aug 05 17:16:34.851879 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:16:34.851843    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:16:35.071211 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:16:35.071182    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:16:43.409519 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:16:43.409480    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:16:43.512932 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:16:43.512896    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:16:46.120914 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:16:46.120882    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:16:46.246368 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:16:46.246337    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:16:54.257416 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:16:54.257376    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:16:54.371777 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:16:54.371750    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:17:22.904036 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:17:22.903947    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:17:22.979965 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:17:22.979929    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:17:33.944134 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:17:33.944098    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:17:45.771206 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:17:45.771173    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-cqj2n_17a2b686-e228-4d00-9656-8b03b65f2e29/console-operator/1.log"
Aug 05 17:17:45.773177 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:17:45.773154    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-cqj2n_17a2b686-e228-4d00-9656-8b03b65f2e29/console-operator/1.log"
Aug 05 17:17:45.779746 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:17:45.779721    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q69wj_d8e22937-0209-4cf9-b262-dacb99128703/ovn-acl-logging/0.log"
Aug 05 17:17:45.781796 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:17:45.781773    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q69wj_d8e22937-0209-4cf9-b262-dacb99128703/ovn-acl-logging/0.log"
Aug 05 17:17:45.783054 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:17:45.783034    2580 kubelet.go:1648] "Image garbage collection succeeded"
Aug 05 17:17:50.182894 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:17:50.182855    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:17:50.282817 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:17:50.282778    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:17:57.110181 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:17:57.110148    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:17:57.215117 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:17:57.215085    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:17:57.312763 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:17:57.312732    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:17:57.842170 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:17:57.842134    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:17:57.918544 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:17:57.918509    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:18:02.145269 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:18:02.145235    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:18:02.216891 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:18:02.216861    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:18:08.466788 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:18:08.466753    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:18:08.562173 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:18:08.562137    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:18:08.721919 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:18:08.721821    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:18:17.168306 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:18:17.168263    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:18:17.297727 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:18:17.297697    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:18:26.047234 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:18:26.047169    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:18:26.126633 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:18:26.126603    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:18:52.832518 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:18:52.832438    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:19:02.755458 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:19:02.755422    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:19:49.578103 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:19:49.578073    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:19:50.653499 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:19:50.653463    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5stjpv"]
Aug 05 17:19:50.656813 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:19:50.656797    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5stjpv"
Aug 05 17:19:50.660243 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:19:50.660223    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-j9bcp\""
Aug 05 17:19:50.660470 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:19:50.660454    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Aug 05 17:19:50.661065 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:19:50.661051    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Aug 05 17:19:50.678134 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:19:50.678107    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5stjpv"]
Aug 05 17:19:50.748600 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:19:50.748547    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5deb0480-8b89-40be-bdc1-bb5f99230e7b-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5stjpv\" (UID: \"5deb0480-8b89-40be-bdc1-bb5f99230e7b\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5stjpv"
Aug 05 17:19:50.748600 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:19:50.748598    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5deb0480-8b89-40be-bdc1-bb5f99230e7b-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5stjpv\" (UID: \"5deb0480-8b89-40be-bdc1-bb5f99230e7b\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5stjpv"
Aug 05 17:19:50.748799 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:19:50.748715    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gcfr\" (UniqueName: \"kubernetes.io/projected/5deb0480-8b89-40be-bdc1-bb5f99230e7b-kube-api-access-8gcfr\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5stjpv\" (UID: \"5deb0480-8b89-40be-bdc1-bb5f99230e7b\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5stjpv"
Aug 05 17:19:50.849525 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:19:50.849490    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gcfr\" (UniqueName: \"kubernetes.io/projected/5deb0480-8b89-40be-bdc1-bb5f99230e7b-kube-api-access-8gcfr\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5stjpv\" (UID: \"5deb0480-8b89-40be-bdc1-bb5f99230e7b\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5stjpv"
Aug 05 17:19:50.849706 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:19:50.849534    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5deb0480-8b89-40be-bdc1-bb5f99230e7b-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5stjpv\" (UID: \"5deb0480-8b89-40be-bdc1-bb5f99230e7b\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5stjpv"
Aug 05 17:19:50.849706 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:19:50.849589    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5deb0480-8b89-40be-bdc1-bb5f99230e7b-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5stjpv\" (UID: \"5deb0480-8b89-40be-bdc1-bb5f99230e7b\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5stjpv"
Aug 05 17:19:50.850024 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:19:50.850006    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5deb0480-8b89-40be-bdc1-bb5f99230e7b-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5stjpv\" (UID: \"5deb0480-8b89-40be-bdc1-bb5f99230e7b\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5stjpv"
Aug 05 17:19:50.850060 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:19:50.850027    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5deb0480-8b89-40be-bdc1-bb5f99230e7b-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5stjpv\" (UID: \"5deb0480-8b89-40be-bdc1-bb5f99230e7b\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5stjpv"
Aug 05 17:19:50.862435 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:19:50.862403    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gcfr\" (UniqueName: \"kubernetes.io/projected/5deb0480-8b89-40be-bdc1-bb5f99230e7b-kube-api-access-8gcfr\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5stjpv\" (UID: \"5deb0480-8b89-40be-bdc1-bb5f99230e7b\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5stjpv"
Aug 05 17:19:50.965914 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:19:50.965810    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5stjpv"
Aug 05 17:19:51.103497 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:19:51.103410    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5stjpv"]
Aug 05 17:19:51.106274 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:19:51.106244    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5deb0480_8b89_40be_bdc1_bb5f99230e7b.slice/crio-3f23be090920814e7bd3dd72a4bd6337a1ab782c4a8ead519be09727281ca6ba WatchSource:0}: Error finding container 3f23be090920814e7bd3dd72a4bd6337a1ab782c4a8ead519be09727281ca6ba: Status 404 returned error can't find the container with id 3f23be090920814e7bd3dd72a4bd6337a1ab782c4a8ead519be09727281ca6ba
Aug 05 17:19:51.108112 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:19:51.108094    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 17:19:51.327962 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:19:51.327920    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:19:51.761365 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:19:51.761284    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5stjpv" event={"ID":"5deb0480-8b89-40be-bdc1-bb5f99230e7b","Type":"ContainerStarted","Data":"3f23be090920814e7bd3dd72a4bd6337a1ab782c4a8ead519be09727281ca6ba"}
Aug 05 17:19:57.788899 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:19:57.788859    2580 generic.go:356] "Generic (PLEG): container finished" podID="5deb0480-8b89-40be-bdc1-bb5f99230e7b" containerID="1eab1c8d9a0cf25739c680e19b0af5b9382517d2e01096b814efc620e91e35de" exitCode=0
Aug 05 17:19:57.789347 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:19:57.788912    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5stjpv" event={"ID":"5deb0480-8b89-40be-bdc1-bb5f99230e7b","Type":"ContainerDied","Data":"1eab1c8d9a0cf25739c680e19b0af5b9382517d2e01096b814efc620e91e35de"}
Aug 05 17:20:02.810426 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:02.810331    2580 generic.go:356] "Generic (PLEG): container finished" podID="5deb0480-8b89-40be-bdc1-bb5f99230e7b" containerID="96a6dd63a5b398a7f182f4c45c4c59fd44809791635d9dfda76f62bd3e3e695b" exitCode=0
Aug 05 17:20:02.810426 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:02.810396    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5stjpv" event={"ID":"5deb0480-8b89-40be-bdc1-bb5f99230e7b","Type":"ContainerDied","Data":"96a6dd63a5b398a7f182f4c45c4c59fd44809791635d9dfda76f62bd3e3e695b"}
Aug 05 17:20:09.843427 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:09.843387    2580 generic.go:356] "Generic (PLEG): container finished" podID="5deb0480-8b89-40be-bdc1-bb5f99230e7b" containerID="8c9110cc25783a66a2f95d70013387961f931ff451048a396c31c32ee454cfd6" exitCode=0
Aug 05 17:20:09.843797 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:09.843468    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5stjpv" event={"ID":"5deb0480-8b89-40be-bdc1-bb5f99230e7b","Type":"ContainerDied","Data":"8c9110cc25783a66a2f95d70013387961f931ff451048a396c31c32ee454cfd6"}
Aug 05 17:20:10.966975 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:10.966953    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5stjpv"
Aug 05 17:20:11.013878 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:11.013845    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5deb0480-8b89-40be-bdc1-bb5f99230e7b-bundle\") pod \"5deb0480-8b89-40be-bdc1-bb5f99230e7b\" (UID: \"5deb0480-8b89-40be-bdc1-bb5f99230e7b\") "
Aug 05 17:20:11.013878 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:11.013878    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5deb0480-8b89-40be-bdc1-bb5f99230e7b-util\") pod \"5deb0480-8b89-40be-bdc1-bb5f99230e7b\" (UID: \"5deb0480-8b89-40be-bdc1-bb5f99230e7b\") "
Aug 05 17:20:11.014070 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:11.013931    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gcfr\" (UniqueName: \"kubernetes.io/projected/5deb0480-8b89-40be-bdc1-bb5f99230e7b-kube-api-access-8gcfr\") pod \"5deb0480-8b89-40be-bdc1-bb5f99230e7b\" (UID: \"5deb0480-8b89-40be-bdc1-bb5f99230e7b\") "
Aug 05 17:20:11.014426 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:11.014405    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5deb0480-8b89-40be-bdc1-bb5f99230e7b-bundle" (OuterVolumeSpecName: "bundle") pod "5deb0480-8b89-40be-bdc1-bb5f99230e7b" (UID: "5deb0480-8b89-40be-bdc1-bb5f99230e7b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:20:11.016206 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:11.016182    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5deb0480-8b89-40be-bdc1-bb5f99230e7b-kube-api-access-8gcfr" (OuterVolumeSpecName: "kube-api-access-8gcfr") pod "5deb0480-8b89-40be-bdc1-bb5f99230e7b" (UID: "5deb0480-8b89-40be-bdc1-bb5f99230e7b"). InnerVolumeSpecName "kube-api-access-8gcfr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:20:11.018104 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:11.018084    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5deb0480-8b89-40be-bdc1-bb5f99230e7b-util" (OuterVolumeSpecName: "util") pod "5deb0480-8b89-40be-bdc1-bb5f99230e7b" (UID: "5deb0480-8b89-40be-bdc1-bb5f99230e7b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:20:11.114996 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:11.114912    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5deb0480-8b89-40be-bdc1-bb5f99230e7b-bundle\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\""
Aug 05 17:20:11.114996 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:11.114941    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5deb0480-8b89-40be-bdc1-bb5f99230e7b-util\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\""
Aug 05 17:20:11.114996 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:11.114955    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gcfr\" (UniqueName: \"kubernetes.io/projected/5deb0480-8b89-40be-bdc1-bb5f99230e7b-kube-api-access-8gcfr\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\""
Aug 05 17:20:11.852972 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:11.852937    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5stjpv" event={"ID":"5deb0480-8b89-40be-bdc1-bb5f99230e7b","Type":"ContainerDied","Data":"3f23be090920814e7bd3dd72a4bd6337a1ab782c4a8ead519be09727281ca6ba"}
Aug 05 17:20:11.852972 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:11.852955    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5stjpv"
Aug 05 17:20:11.853178 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:11.852983    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3f23be090920814e7bd3dd72a4bd6337a1ab782c4a8ead519be09727281ca6ba"
Aug 05 17:20:17.908567 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:17.908521    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:20:18.024343 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:18.024311    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:20:19.653887 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:19.653840    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-bcvrp"]
Aug 05 17:20:19.654237 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:19.654145    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5deb0480-8b89-40be-bdc1-bb5f99230e7b" containerName="pull"
Aug 05 17:20:19.654237 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:19.654156    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5deb0480-8b89-40be-bdc1-bb5f99230e7b" containerName="pull"
Aug 05 17:20:19.654237 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:19.654164    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5deb0480-8b89-40be-bdc1-bb5f99230e7b" containerName="util"
Aug 05 17:20:19.654237 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:19.654169    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5deb0480-8b89-40be-bdc1-bb5f99230e7b" containerName="util"
Aug 05 17:20:19.654237 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:19.654187    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5deb0480-8b89-40be-bdc1-bb5f99230e7b" containerName="extract"
Aug 05 17:20:19.654237 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:19.654193    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5deb0480-8b89-40be-bdc1-bb5f99230e7b" containerName="extract"
Aug 05 17:20:19.654427 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:19.654243    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5deb0480-8b89-40be-bdc1-bb5f99230e7b" containerName="extract"
Aug 05 17:20:19.656105 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:19.656091    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-bcvrp"
Aug 05 17:20:19.659809 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:19.659776    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\""
Aug 05 17:20:19.659946 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:19.659830    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-2npg8\""
Aug 05 17:20:19.660390 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:19.660375    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
Aug 05 17:20:19.660477 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:19.660421    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
Aug 05 17:20:19.675505 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:19.675474    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-bcvrp"]
Aug 05 17:20:19.682316 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:19.682292    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/8e0094fc-e699-4176-b653-43127ea90d81-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-bcvrp\" (UID: \"8e0094fc-e699-4176-b653-43127ea90d81\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-bcvrp"
Aug 05 17:20:19.682421 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:19.682346    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhsr5\" (UniqueName: \"kubernetes.io/projected/8e0094fc-e699-4176-b653-43127ea90d81-kube-api-access-jhsr5\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-bcvrp\" (UID: \"8e0094fc-e699-4176-b653-43127ea90d81\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-bcvrp"
Aug 05 17:20:19.783814 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:19.783784    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/8e0094fc-e699-4176-b653-43127ea90d81-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-bcvrp\" (UID: \"8e0094fc-e699-4176-b653-43127ea90d81\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-bcvrp"
Aug 05 17:20:19.783974 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:19.783829    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhsr5\" (UniqueName: \"kubernetes.io/projected/8e0094fc-e699-4176-b653-43127ea90d81-kube-api-access-jhsr5\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-bcvrp\" (UID: \"8e0094fc-e699-4176-b653-43127ea90d81\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-bcvrp"
Aug 05 17:20:19.786197 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:19.786174    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/8e0094fc-e699-4176-b653-43127ea90d81-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-bcvrp\" (UID: \"8e0094fc-e699-4176-b653-43127ea90d81\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-bcvrp"
Aug 05 17:20:19.793800 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:19.793780    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhsr5\" (UniqueName: \"kubernetes.io/projected/8e0094fc-e699-4176-b653-43127ea90d81-kube-api-access-jhsr5\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-bcvrp\" (UID: \"8e0094fc-e699-4176-b653-43127ea90d81\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-bcvrp"
Aug 05 17:20:19.966050 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:19.965967    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-bcvrp"
Aug 05 17:20:20.107428 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:20.107403    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-bcvrp"]
Aug 05 17:20:20.109503 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:20:20.109482    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e0094fc_e699_4176_b653_43127ea90d81.slice/crio-a5e41f3d4838057e1a0def4dd86d82fba2f18dbfed3f8cdba2ff4fd22ad8ab75 WatchSource:0}: Error finding container a5e41f3d4838057e1a0def4dd86d82fba2f18dbfed3f8cdba2ff4fd22ad8ab75: Status 404 returned error can't find the container with id a5e41f3d4838057e1a0def4dd86d82fba2f18dbfed3f8cdba2ff4fd22ad8ab75
Aug 05 17:20:20.896767 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:20.896716    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-bcvrp" event={"ID":"8e0094fc-e699-4176-b653-43127ea90d81","Type":"ContainerStarted","Data":"a5e41f3d4838057e1a0def4dd86d82fba2f18dbfed3f8cdba2ff4fd22ad8ab75"}
Aug 05 17:20:22.908059 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:22.907995    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-bcvrp" event={"ID":"8e0094fc-e699-4176-b653-43127ea90d81","Type":"ContainerStarted","Data":"f35046eb7386ead74c5305a545d3cd7af9ff3c242ac445bd4f6bf076cf0317e5"}
Aug 05 17:20:22.908416 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:22.908219    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-bcvrp"
Aug 05 17:20:22.940499 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:22.940448    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-bcvrp" podStartSLOduration=1.537398107 podStartE2EDuration="3.940433753s" totalImagesPullingTime="2.403035646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:20:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:20:22.939057066 +0000 UTC m=+457.507559487" watchObservedRunningTime="2026-08-05 17:20:22.940433753 +0000 UTC m=+457.508936173"
Aug 05 17:20:23.056460 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:23.056430    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:20:23.367010 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:23.366978    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-77f648d694-lhwlw"]
Aug 05 17:20:23.369286 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:23.369263    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-lhwlw"
Aug 05 17:20:23.372068 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:23.372046    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-gsksm\""
Aug 05 17:20:23.372198 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:23.372091    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
Aug 05 17:20:23.372387 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:23.372369    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\""
Aug 05 17:20:23.372644 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:23.372629    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:20:23.381400 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:23.381379    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-lhwlw"]
Aug 05 17:20:23.416445 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:23.416409    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/5a1e785a-ea7b-4cf7-9f7d-e2bd8d32c7f5-certificates\") pod \"keda-operator-77f648d694-lhwlw\" (UID: \"5a1e785a-ea7b-4cf7-9f7d-e2bd8d32c7f5\") " pod="openshift-keda/keda-operator-77f648d694-lhwlw"
Aug 05 17:20:23.416445 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:23.416450    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/5a1e785a-ea7b-4cf7-9f7d-e2bd8d32c7f5-cabundle0\") pod \"keda-operator-77f648d694-lhwlw\" (UID: \"5a1e785a-ea7b-4cf7-9f7d-e2bd8d32c7f5\") " pod="openshift-keda/keda-operator-77f648d694-lhwlw"
Aug 05 17:20:23.416696 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:23.416482    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psvdv\" (UniqueName: \"kubernetes.io/projected/5a1e785a-ea7b-4cf7-9f7d-e2bd8d32c7f5-kube-api-access-psvdv\") pod \"keda-operator-77f648d694-lhwlw\" (UID: \"5a1e785a-ea7b-4cf7-9f7d-e2bd8d32c7f5\") " pod="openshift-keda/keda-operator-77f648d694-lhwlw"
Aug 05 17:20:23.517264 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:23.517220    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psvdv\" (UniqueName: \"kubernetes.io/projected/5a1e785a-ea7b-4cf7-9f7d-e2bd8d32c7f5-kube-api-access-psvdv\") pod \"keda-operator-77f648d694-lhwlw\" (UID: \"5a1e785a-ea7b-4cf7-9f7d-e2bd8d32c7f5\") " pod="openshift-keda/keda-operator-77f648d694-lhwlw"
Aug 05 17:20:23.517456 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:23.517297    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/5a1e785a-ea7b-4cf7-9f7d-e2bd8d32c7f5-certificates\") pod \"keda-operator-77f648d694-lhwlw\" (UID: \"5a1e785a-ea7b-4cf7-9f7d-e2bd8d32c7f5\") " pod="openshift-keda/keda-operator-77f648d694-lhwlw"
Aug 05 17:20:23.517456 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:23.517322    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/5a1e785a-ea7b-4cf7-9f7d-e2bd8d32c7f5-cabundle0\") pod \"keda-operator-77f648d694-lhwlw\" (UID: \"5a1e785a-ea7b-4cf7-9f7d-e2bd8d32c7f5\") " pod="openshift-keda/keda-operator-77f648d694-lhwlw"
Aug 05 17:20:23.517456 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:20:23.517438    2580 projected.go:266] Couldn't get secret openshift-keda/keda-operator-certs: secret "keda-operator-certs" not found
Aug 05 17:20:23.517605 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:20:23.517462    2580 secret.go:281] references non-existent secret key: ca.crt
Aug 05 17:20:23.517605 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:20:23.517474    2580 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
Aug 05 17:20:23.517605 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:20:23.517489    2580 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-77f648d694-lhwlw: [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt]
Aug 05 17:20:23.517605 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:20:23.517538    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a1e785a-ea7b-4cf7-9f7d-e2bd8d32c7f5-certificates podName:5a1e785a-ea7b-4cf7-9f7d-e2bd8d32c7f5 nodeName:}" failed. No retries permitted until 2026-08-05 17:20:24.017524237 +0000 UTC m=+458.586026636 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/5a1e785a-ea7b-4cf7-9f7d-e2bd8d32c7f5-certificates") pod "keda-operator-77f648d694-lhwlw" (UID: "5a1e785a-ea7b-4cf7-9f7d-e2bd8d32c7f5") : [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt]
Aug 05 17:20:23.517965 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:23.517949    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/5a1e785a-ea7b-4cf7-9f7d-e2bd8d32c7f5-cabundle0\") pod \"keda-operator-77f648d694-lhwlw\" (UID: \"5a1e785a-ea7b-4cf7-9f7d-e2bd8d32c7f5\") " pod="openshift-keda/keda-operator-77f648d694-lhwlw"
Aug 05 17:20:23.530176 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:23.530153    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psvdv\" (UniqueName: \"kubernetes.io/projected/5a1e785a-ea7b-4cf7-9f7d-e2bd8d32c7f5-kube-api-access-psvdv\") pod \"keda-operator-77f648d694-lhwlw\" (UID: \"5a1e785a-ea7b-4cf7-9f7d-e2bd8d32c7f5\") " pod="openshift-keda/keda-operator-77f648d694-lhwlw"
Aug 05 17:20:23.676100 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:23.676016    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:20:24.008601 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:24.008507    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:20:24.022506 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:24.022475    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/5a1e785a-ea7b-4cf7-9f7d-e2bd8d32c7f5-certificates\") pod \"keda-operator-77f648d694-lhwlw\" (UID: \"5a1e785a-ea7b-4cf7-9f7d-e2bd8d32c7f5\") " pod="openshift-keda/keda-operator-77f648d694-lhwlw"
Aug 05 17:20:24.022649 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:20:24.022596    2580 secret.go:281] references non-existent secret key: ca.crt
Aug 05 17:20:24.022649 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:20:24.022610    2580 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
Aug 05 17:20:24.022649 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:20:24.022618    2580 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-77f648d694-lhwlw: references non-existent secret key: ca.crt
Aug 05 17:20:24.022760 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:20:24.022664    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a1e785a-ea7b-4cf7-9f7d-e2bd8d32c7f5-certificates podName:5a1e785a-ea7b-4cf7-9f7d-e2bd8d32c7f5 nodeName:}" failed. No retries permitted until 2026-08-05 17:20:25.022650593 +0000 UTC m=+459.591152992 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/5a1e785a-ea7b-4cf7-9f7d-e2bd8d32c7f5-certificates") pod "keda-operator-77f648d694-lhwlw" (UID: "5a1e785a-ea7b-4cf7-9f7d-e2bd8d32c7f5") : references non-existent secret key: ca.crt
Aug 05 17:20:24.198638 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:24.198605    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-8t6r7"]
Aug 05 17:20:24.200786 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:24.200770    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-8t6r7"
Aug 05 17:20:24.203706 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:24.203690    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\""
Aug 05 17:20:24.213614 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:24.213590    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-8t6r7"]
Aug 05 17:20:24.279713 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:24.279630    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:20:24.324995 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:24.324966    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/6cc389b1-4e5b-457e-af40-f2be86587e6f-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-8t6r7\" (UID: \"6cc389b1-4e5b-457e-af40-f2be86587e6f\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-8t6r7"
Aug 05 17:20:24.325128 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:24.325029    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jps9\" (UniqueName: \"kubernetes.io/projected/6cc389b1-4e5b-457e-af40-f2be86587e6f-kube-api-access-9jps9\") pod \"keda-metrics-apiserver-55557df8c-8t6r7\" (UID: \"6cc389b1-4e5b-457e-af40-f2be86587e6f\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-8t6r7"
Aug 05 17:20:24.325128 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:24.325068    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/6cc389b1-4e5b-457e-af40-f2be86587e6f-certificates\") pod \"keda-metrics-apiserver-55557df8c-8t6r7\" (UID: \"6cc389b1-4e5b-457e-af40-f2be86587e6f\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-8t6r7"
Aug 05 17:20:24.426244 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:24.426212    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/6cc389b1-4e5b-457e-af40-f2be86587e6f-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-8t6r7\" (UID: \"6cc389b1-4e5b-457e-af40-f2be86587e6f\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-8t6r7"
Aug 05 17:20:24.426527 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:24.425776    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/6cc389b1-4e5b-457e-af40-f2be86587e6f-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-8t6r7\" (UID: \"6cc389b1-4e5b-457e-af40-f2be86587e6f\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-8t6r7"
Aug 05 17:20:24.426735 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:24.426718    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jps9\" (UniqueName: \"kubernetes.io/projected/6cc389b1-4e5b-457e-af40-f2be86587e6f-kube-api-access-9jps9\") pod \"keda-metrics-apiserver-55557df8c-8t6r7\" (UID: \"6cc389b1-4e5b-457e-af40-f2be86587e6f\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-8t6r7"
Aug 05 17:20:24.426864 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:24.426852    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/6cc389b1-4e5b-457e-af40-f2be86587e6f-certificates\") pod \"keda-metrics-apiserver-55557df8c-8t6r7\" (UID: \"6cc389b1-4e5b-457e-af40-f2be86587e6f\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-8t6r7"
Aug 05 17:20:24.427106 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:20:24.427091    2580 secret.go:281] references non-existent secret key: tls.crt
Aug 05 17:20:24.427186 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:20:24.427177    2580 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt
Aug 05 17:20:24.427267 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:20:24.427259    2580 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-55557df8c-8t6r7: references non-existent secret key: tls.crt
Aug 05 17:20:24.427392 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:20:24.427384    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6cc389b1-4e5b-457e-af40-f2be86587e6f-certificates podName:6cc389b1-4e5b-457e-af40-f2be86587e6f nodeName:}" failed. No retries permitted until 2026-08-05 17:20:24.927363682 +0000 UTC m=+459.495866094 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/6cc389b1-4e5b-457e-af40-f2be86587e6f-certificates") pod "keda-metrics-apiserver-55557df8c-8t6r7" (UID: "6cc389b1-4e5b-457e-af40-f2be86587e6f") : references non-existent secret key: tls.crt
Aug 05 17:20:24.441862 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:24.441840    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jps9\" (UniqueName: \"kubernetes.io/projected/6cc389b1-4e5b-457e-af40-f2be86587e6f-kube-api-access-9jps9\") pod \"keda-metrics-apiserver-55557df8c-8t6r7\" (UID: \"6cc389b1-4e5b-457e-af40-f2be86587e6f\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-8t6r7"
Aug 05 17:20:24.647590 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:24.647533    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:20:24.723805 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:24.723778    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-5bz84"]
Aug 05 17:20:24.726033 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:24.726017    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-5bz84"
Aug 05 17:20:24.728621 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:24.728601    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\""
Aug 05 17:20:24.736314 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:24.736290    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-5bz84"]
Aug 05 17:20:24.768229 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:24.768203    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:20:24.829700 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:24.829673    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkxqc\" (UniqueName: \"kubernetes.io/projected/92dfafe8-bfd2-4e70-b27a-974ab80c0fb7-kube-api-access-lkxqc\") pod \"keda-admission-56f9798bb4-5bz84\" (UID: \"92dfafe8-bfd2-4e70-b27a-974ab80c0fb7\") " pod="openshift-keda/keda-admission-56f9798bb4-5bz84"
Aug 05 17:20:24.829808 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:24.829738    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/92dfafe8-bfd2-4e70-b27a-974ab80c0fb7-certificates\") pod \"keda-admission-56f9798bb4-5bz84\" (UID: \"92dfafe8-bfd2-4e70-b27a-974ab80c0fb7\") " pod="openshift-keda/keda-admission-56f9798bb4-5bz84"
Aug 05 17:20:24.866397 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:24.866368    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:20:24.930824 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:24.930750    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/92dfafe8-bfd2-4e70-b27a-974ab80c0fb7-certificates\") pod \"keda-admission-56f9798bb4-5bz84\" (UID: \"92dfafe8-bfd2-4e70-b27a-974ab80c0fb7\") " pod="openshift-keda/keda-admission-56f9798bb4-5bz84"
Aug 05 17:20:24.930824 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:24.930792    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/6cc389b1-4e5b-457e-af40-f2be86587e6f-certificates\") pod \"keda-metrics-apiserver-55557df8c-8t6r7\" (UID: \"6cc389b1-4e5b-457e-af40-f2be86587e6f\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-8t6r7"
Aug 05 17:20:24.930991 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:20:24.930890    2580 projected.go:266] Couldn't get secret openshift-keda/keda-admission-webhooks-certs: secret "keda-admission-webhooks-certs" not found
Aug 05 17:20:24.930991 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:20:24.930913    2580 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-admission-56f9798bb4-5bz84: secret "keda-admission-webhooks-certs" not found
Aug 05 17:20:24.930991 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:24.930913    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkxqc\" (UniqueName: \"kubernetes.io/projected/92dfafe8-bfd2-4e70-b27a-974ab80c0fb7-kube-api-access-lkxqc\") pod \"keda-admission-56f9798bb4-5bz84\" (UID: \"92dfafe8-bfd2-4e70-b27a-974ab80c0fb7\") " pod="openshift-keda/keda-admission-56f9798bb4-5bz84"
Aug 05 17:20:24.930991 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:20:24.930958    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92dfafe8-bfd2-4e70-b27a-974ab80c0fb7-certificates podName:92dfafe8-bfd2-4e70-b27a-974ab80c0fb7 nodeName:}" failed. No retries permitted until 2026-08-05 17:20:25.43094473 +0000 UTC m=+459.999447130 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/92dfafe8-bfd2-4e70-b27a-974ab80c0fb7-certificates") pod "keda-admission-56f9798bb4-5bz84" (UID: "92dfafe8-bfd2-4e70-b27a-974ab80c0fb7") : secret "keda-admission-webhooks-certs" not found
Aug 05 17:20:24.933459 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:24.933431    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/6cc389b1-4e5b-457e-af40-f2be86587e6f-certificates\") pod \"keda-metrics-apiserver-55557df8c-8t6r7\" (UID: \"6cc389b1-4e5b-457e-af40-f2be86587e6f\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-8t6r7"
Aug 05 17:20:24.943360 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:24.943341    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkxqc\" (UniqueName: \"kubernetes.io/projected/92dfafe8-bfd2-4e70-b27a-974ab80c0fb7-kube-api-access-lkxqc\") pod \"keda-admission-56f9798bb4-5bz84\" (UID: \"92dfafe8-bfd2-4e70-b27a-974ab80c0fb7\") " pod="openshift-keda/keda-admission-56f9798bb4-5bz84"
Aug 05 17:20:25.031694 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:25.031654    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/5a1e785a-ea7b-4cf7-9f7d-e2bd8d32c7f5-certificates\") pod \"keda-operator-77f648d694-lhwlw\" (UID: \"5a1e785a-ea7b-4cf7-9f7d-e2bd8d32c7f5\") " pod="openshift-keda/keda-operator-77f648d694-lhwlw"
Aug 05 17:20:25.034602 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:25.034539    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/5a1e785a-ea7b-4cf7-9f7d-e2bd8d32c7f5-certificates\") pod \"keda-operator-77f648d694-lhwlw\" (UID: \"5a1e785a-ea7b-4cf7-9f7d-e2bd8d32c7f5\") " pod="openshift-keda/keda-operator-77f648d694-lhwlw"
Aug 05 17:20:25.080991 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:25.080960    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:20:25.110847 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:25.110826    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-8t6r7"
Aug 05 17:20:25.175254 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:25.175211    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:20:25.180624 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:25.180518    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-lhwlw"
Aug 05 17:20:25.254318 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:25.254288    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-8t6r7"]
Aug 05 17:20:25.257393 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:20:25.257359    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cc389b1_4e5b_457e_af40_f2be86587e6f.slice/crio-467b5dfce93081e3aa3a3b67c4333438d92ed9ede8686bc9d3fbaabcac2cdca4 WatchSource:0}: Error finding container 467b5dfce93081e3aa3a3b67c4333438d92ed9ede8686bc9d3fbaabcac2cdca4: Status 404 returned error can't find the container with id 467b5dfce93081e3aa3a3b67c4333438d92ed9ede8686bc9d3fbaabcac2cdca4
Aug 05 17:20:25.258042 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:25.257951    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:20:25.326763 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:25.326737    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-lhwlw"]
Aug 05 17:20:25.329036 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:20:25.329014    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a1e785a_ea7b_4cf7_9f7d_e2bd8d32c7f5.slice/crio-1facbcf0f6056e09c715a7af9fec46e7907a620be15931719dbc537a8db4e733 WatchSource:0}: Error finding container 1facbcf0f6056e09c715a7af9fec46e7907a620be15931719dbc537a8db4e733: Status 404 returned error can't find the container with id 1facbcf0f6056e09c715a7af9fec46e7907a620be15931719dbc537a8db4e733
Aug 05 17:20:25.404475 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:25.404450    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:20:25.435391 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:25.435358    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/92dfafe8-bfd2-4e70-b27a-974ab80c0fb7-certificates\") pod \"keda-admission-56f9798bb4-5bz84\" (UID: \"92dfafe8-bfd2-4e70-b27a-974ab80c0fb7\") " pod="openshift-keda/keda-admission-56f9798bb4-5bz84"
Aug 05 17:20:25.438091 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:25.438033    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/92dfafe8-bfd2-4e70-b27a-974ab80c0fb7-certificates\") pod \"keda-admission-56f9798bb4-5bz84\" (UID: \"92dfafe8-bfd2-4e70-b27a-974ab80c0fb7\") " pod="openshift-keda/keda-admission-56f9798bb4-5bz84"
Aug 05 17:20:25.503301 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:25.503264    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:20:25.636802 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:25.636769    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-5bz84"
Aug 05 17:20:25.772583 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:25.772535    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-5bz84"]
Aug 05 17:20:25.776507 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:20:25.776481    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92dfafe8_bfd2_4e70_b27a_974ab80c0fb7.slice/crio-ede02738d17534636b97583f60306d719fd2999c09c026545c748cb3b27d7dd0 WatchSource:0}: Error finding container ede02738d17534636b97583f60306d719fd2999c09c026545c748cb3b27d7dd0: Status 404 returned error can't find the container with id ede02738d17534636b97583f60306d719fd2999c09c026545c748cb3b27d7dd0
Aug 05 17:20:25.921361 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:25.921327    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-lhwlw" event={"ID":"5a1e785a-ea7b-4cf7-9f7d-e2bd8d32c7f5","Type":"ContainerStarted","Data":"1facbcf0f6056e09c715a7af9fec46e7907a620be15931719dbc537a8db4e733"}
Aug 05 17:20:25.922455 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:25.922429    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-8t6r7" event={"ID":"6cc389b1-4e5b-457e-af40-f2be86587e6f","Type":"ContainerStarted","Data":"467b5dfce93081e3aa3a3b67c4333438d92ed9ede8686bc9d3fbaabcac2cdca4"}
Aug 05 17:20:25.923489 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:25.923471    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-5bz84" event={"ID":"92dfafe8-bfd2-4e70-b27a-974ab80c0fb7","Type":"ContainerStarted","Data":"ede02738d17534636b97583f60306d719fd2999c09c026545c748cb3b27d7dd0"}
Aug 05 17:20:29.945413 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:29.945380    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-5bz84" event={"ID":"92dfafe8-bfd2-4e70-b27a-974ab80c0fb7","Type":"ContainerStarted","Data":"4eb4b0907a5bb926268bcd02cc09cce2096097fbe1bdd100a61aee35688055ab"}
Aug 05 17:20:29.945917 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:29.945451    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-56f9798bb4-5bz84"
Aug 05 17:20:29.947011 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:29.946987    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-lhwlw" event={"ID":"5a1e785a-ea7b-4cf7-9f7d-e2bd8d32c7f5","Type":"ContainerStarted","Data":"3e169f6a25f96f185bbd1097c96f80ffa81b3c719b2ea653d62014bcfbacf93e"}
Aug 05 17:20:29.947143 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:29.947060    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-77f648d694-lhwlw"
Aug 05 17:20:29.948442 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:29.948420    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-8t6r7" event={"ID":"6cc389b1-4e5b-457e-af40-f2be86587e6f","Type":"ContainerStarted","Data":"e2bebd94595f97afa26f641b2e60d487a9f8b3795a2f054d045a457866b870f8"}
Aug 05 17:20:29.948548 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:29.948538    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-8t6r7"
Aug 05 17:20:29.965174 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:29.965133    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-56f9798bb4-5bz84" podStartSLOduration=2.118960905 podStartE2EDuration="5.965119375s" totalImagesPullingTime="3.84615847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:20:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:20:29.963989724 +0000 UTC m=+464.532492142" watchObservedRunningTime="2026-08-05 17:20:29.965119375 +0000 UTC m=+464.533621795"
Aug 05 17:20:29.985121 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:29.985075    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-55557df8c-8t6r7" podStartSLOduration=1.614497654 podStartE2EDuration="5.985056767s" totalImagesPullingTime="4.370559113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:20:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:20:29.984219949 +0000 UTC m=+464.552722382" watchObservedRunningTime="2026-08-05 17:20:29.985056767 +0000 UTC m=+464.553559187"
Aug 05 17:20:30.002818 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:30.002777    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-77f648d694-lhwlw" podStartSLOduration=2.696990007 podStartE2EDuration="7.002764613s" totalImagesPullingTime="4.305774606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:20:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:20:30.002323857 +0000 UTC m=+464.570826278" watchObservedRunningTime="2026-08-05 17:20:30.002764613 +0000 UTC m=+464.571267025"
Aug 05 17:20:40.957067 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:40.957037    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-8t6r7"
Aug 05 17:20:43.914998 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:43.914969    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-bcvrp"
Aug 05 17:20:50.955227 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:50.955194    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-77f648d694-lhwlw"
Aug 05 17:20:50.955627 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:20:50.955265    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-56f9798bb4-5bz84"
Aug 05 17:21:16.064707 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:21:16.064671    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:21:16.213459 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:21:16.213427    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:21:46.548424 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:21:46.548351    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:21:46.649789 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:21:46.649760    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-mq298"]
Aug 05 17:21:46.650766 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:21:46.650746    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:21:46.652150 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:21:46.652136    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-654c557856-mq298"
Aug 05 17:21:46.655512 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:21:46.655479    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"llmisvc-controller-manager-654c557856-mq298\" is forbidden: User \"system:node:ip-10-0-131-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kserve\": no relationship found between node 'ip-10-0-131-128.ec2.internal' and this object" podUID="36facdf7-b50f-4c3e-b3d6-d7abe4272021" pod="kserve/llmisvc-controller-manager-654c557856-mq298"
Aug 05 17:21:46.655666 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:21:46.655605    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-131-128.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kserve\": no relationship found between node 'ip-10-0-131-128.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Aug 05 17:21:46.656224 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:21:46.656197    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-131-128.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kserve\": no relationship found between node 'ip-10-0-131-128.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Aug 05 17:21:46.656316 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:21:46.656290    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\""
Aug 05 17:21:46.656687 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:21:46.656666    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-jp4f5\""
Aug 05 17:21:46.666752 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:21:46.666730    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-mq298"]
Aug 05 17:21:46.745108 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:21:46.745076    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:21:46.821014 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:21:46.820983    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wpds\" (UniqueName: \"kubernetes.io/projected/36facdf7-b50f-4c3e-b3d6-d7abe4272021-kube-api-access-5wpds\") pod \"llmisvc-controller-manager-654c557856-mq298\" (UID: \"36facdf7-b50f-4c3e-b3d6-d7abe4272021\") " pod="kserve/llmisvc-controller-manager-654c557856-mq298"
Aug 05 17:21:46.821172 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:21:46.821028    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36facdf7-b50f-4c3e-b3d6-d7abe4272021-cert\") pod \"llmisvc-controller-manager-654c557856-mq298\" (UID: \"36facdf7-b50f-4c3e-b3d6-d7abe4272021\") " pod="kserve/llmisvc-controller-manager-654c557856-mq298"
Aug 05 17:21:46.844036 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:21:46.844000    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:21:46.922260 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:21:46.922226    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wpds\" (UniqueName: \"kubernetes.io/projected/36facdf7-b50f-4c3e-b3d6-d7abe4272021-kube-api-access-5wpds\") pod \"llmisvc-controller-manager-654c557856-mq298\" (UID: \"36facdf7-b50f-4c3e-b3d6-d7abe4272021\") " pod="kserve/llmisvc-controller-manager-654c557856-mq298"
Aug 05 17:21:46.922403 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:21:46.922272    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36facdf7-b50f-4c3e-b3d6-d7abe4272021-cert\") pod \"llmisvc-controller-manager-654c557856-mq298\" (UID: \"36facdf7-b50f-4c3e-b3d6-d7abe4272021\") " pod="kserve/llmisvc-controller-manager-654c557856-mq298"
Aug 05 17:21:46.922403 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:21:46.922381    2580 secret.go:189] Couldn't get secret kserve/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Aug 05 17:21:46.922473 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:21:46.922439    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36facdf7-b50f-4c3e-b3d6-d7abe4272021-cert podName:36facdf7-b50f-4c3e-b3d6-d7abe4272021 nodeName:}" failed. No retries permitted until 2026-08-05 17:21:47.422421536 +0000 UTC m=+541.990923953 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/36facdf7-b50f-4c3e-b3d6-d7abe4272021-cert") pod "llmisvc-controller-manager-654c557856-mq298" (UID: "36facdf7-b50f-4c3e-b3d6-d7abe4272021") : secret "llmisvc-webhook-server-cert" not found
Aug 05 17:21:47.346357 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:21:47.346330    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:21:47.424972 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:21:47.424938    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36facdf7-b50f-4c3e-b3d6-d7abe4272021-cert\") pod \"llmisvc-controller-manager-654c557856-mq298\" (UID: \"36facdf7-b50f-4c3e-b3d6-d7abe4272021\") " pod="kserve/llmisvc-controller-manager-654c557856-mq298"
Aug 05 17:21:47.427503 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:21:47.427481    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36facdf7-b50f-4c3e-b3d6-d7abe4272021-cert\") pod \"llmisvc-controller-manager-654c557856-mq298\" (UID: \"36facdf7-b50f-4c3e-b3d6-d7abe4272021\") " pod="kserve/llmisvc-controller-manager-654c557856-mq298"
Aug 05 17:21:47.504257 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:21:47.504227    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Aug 05 17:21:47.715757 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:21:47.715672    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Aug 05 17:21:47.725772 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:21:47.725739    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wpds\" (UniqueName: \"kubernetes.io/projected/36facdf7-b50f-4c3e-b3d6-d7abe4272021-kube-api-access-5wpds\") pod \"llmisvc-controller-manager-654c557856-mq298\" (UID: \"36facdf7-b50f-4c3e-b3d6-d7abe4272021\") " pod="kserve/llmisvc-controller-manager-654c557856-mq298"
Aug 05 17:21:47.753162 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:21:47.753140    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:21:47.862202 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:21:47.862170    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-654c557856-mq298"
Aug 05 17:21:47.873688 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:21:47.873664    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:21:48.000787 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:21:48.000762    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod36facdf7_b50f_4c3e_b3d6_d7abe4272021.slice/crio-5450e0c68e059b7c23d0d9d4540b35855086174753339aadbf87b8aa7245e958 WatchSource:0}: Error finding container 5450e0c68e059b7c23d0d9d4540b35855086174753339aadbf87b8aa7245e958: Status 404 returned error can't find the container with id 5450e0c68e059b7c23d0d9d4540b35855086174753339aadbf87b8aa7245e958
Aug 05 17:21:48.002991 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:21:48.002973    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-mq298"]
Aug 05 17:21:48.305896 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:21:48.305815    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-mq298" event={"ID":"36facdf7-b50f-4c3e-b3d6-d7abe4272021","Type":"ContainerStarted","Data":"5450e0c68e059b7c23d0d9d4540b35855086174753339aadbf87b8aa7245e958"}
Aug 05 17:21:51.324106 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:21:51.324071    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-mq298" event={"ID":"36facdf7-b50f-4c3e-b3d6-d7abe4272021","Type":"ContainerStarted","Data":"41cc490940f1e1e62e3ca94592a9d99e9e7690a3fe7836df333d924234f4df57"}
Aug 05 17:21:51.324472 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:21:51.324233    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-654c557856-mq298"
Aug 05 17:21:57.824471 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:21:57.824433    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:21:57.925547 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:21:57.925517    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:22:09.747455 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:22:09.747418    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:22:22.331522 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:22:22.331493    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-654c557856-mq298"
Aug 05 17:22:22.350927 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:22:22.350877    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-654c557856-mq298" podStartSLOduration=34.066295157 podStartE2EDuration="36.350862501s" totalImagesPullingTime="2.284567344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:21:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:21:51.346541115 +0000 UTC m=+545.915043536" watchObservedRunningTime="2026-08-05 17:22:22.350862501 +0000 UTC m=+576.919364921"
Aug 05 17:22:45.802759 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:22:45.802732    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-cqj2n_17a2b686-e228-4d00-9656-8b03b65f2e29/console-operator/1.log"
Aug 05 17:22:45.803610 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:22:45.803593    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-cqj2n_17a2b686-e228-4d00-9656-8b03b65f2e29/console-operator/1.log"
Aug 05 17:22:45.809858 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:22:45.809792    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q69wj_d8e22937-0209-4cf9-b262-dacb99128703/ovn-acl-logging/0.log"
Aug 05 17:22:45.810372 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:22:45.810356    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q69wj_d8e22937-0209-4cf9-b262-dacb99128703/ovn-acl-logging/0.log"
Aug 05 17:23:04.545767 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:23:04.545735    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:04.585429 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:23:04.585401    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-7b954ffc95-xfftc"]
Aug 05 17:23:04.588633 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:23:04.588613    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-7b954ffc95-xfftc"
Aug 05 17:23:04.590983 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:23:04.590965    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\""
Aug 05 17:23:04.591089 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:23:04.591002    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-vqr4c\""
Aug 05 17:23:04.598823 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:23:04.598802    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-7b954ffc95-xfftc"]
Aug 05 17:23:04.633651 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:23:04.633622    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:04.648192 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:23:04.648166    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4536851-fb20-47be-ba84-e1f4ead6bfa5-tls-certs\") pod \"model-serving-api-7b954ffc95-xfftc\" (UID: \"d4536851-fb20-47be-ba84-e1f4ead6bfa5\") " pod="kserve/model-serving-api-7b954ffc95-xfftc"
Aug 05 17:23:04.648362 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:23:04.648280    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72s5v\" (UniqueName: \"kubernetes.io/projected/d4536851-fb20-47be-ba84-e1f4ead6bfa5-kube-api-access-72s5v\") pod \"model-serving-api-7b954ffc95-xfftc\" (UID: \"d4536851-fb20-47be-ba84-e1f4ead6bfa5\") " pod="kserve/model-serving-api-7b954ffc95-xfftc"
Aug 05 17:23:04.701804 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:23:04.701756    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:04.748796 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:23:04.748764    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4536851-fb20-47be-ba84-e1f4ead6bfa5-tls-certs\") pod \"model-serving-api-7b954ffc95-xfftc\" (UID: \"d4536851-fb20-47be-ba84-e1f4ead6bfa5\") " pod="kserve/model-serving-api-7b954ffc95-xfftc"
Aug 05 17:23:04.748961 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:23:04.748839    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72s5v\" (UniqueName: \"kubernetes.io/projected/d4536851-fb20-47be-ba84-e1f4ead6bfa5-kube-api-access-72s5v\") pod \"model-serving-api-7b954ffc95-xfftc\" (UID: \"d4536851-fb20-47be-ba84-e1f4ead6bfa5\") " pod="kserve/model-serving-api-7b954ffc95-xfftc"
Aug 05 17:23:04.751289 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:23:04.751271    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4536851-fb20-47be-ba84-e1f4ead6bfa5-tls-certs\") pod \"model-serving-api-7b954ffc95-xfftc\" (UID: \"d4536851-fb20-47be-ba84-e1f4ead6bfa5\") " pod="kserve/model-serving-api-7b954ffc95-xfftc"
Aug 05 17:23:04.757662 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:23:04.757641    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72s5v\" (UniqueName: \"kubernetes.io/projected/d4536851-fb20-47be-ba84-e1f4ead6bfa5-kube-api-access-72s5v\") pod \"model-serving-api-7b954ffc95-xfftc\" (UID: \"d4536851-fb20-47be-ba84-e1f4ead6bfa5\") " pod="kserve/model-serving-api-7b954ffc95-xfftc"
Aug 05 17:23:04.814284 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:23:04.814256    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:04.899658 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:23:04.899624    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-7b954ffc95-xfftc"
Aug 05 17:23:05.052036 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:23:05.052013    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-7b954ffc95-xfftc"]
Aug 05 17:23:05.054769 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:23:05.054744    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4536851_fb20_47be_ba84_e1f4ead6bfa5.slice/crio-4226026d9ae1775828491daec3fe57cdfb412bff5d6bbaf9aace2c49abb3dd3c WatchSource:0}: Error finding container 4226026d9ae1775828491daec3fe57cdfb412bff5d6bbaf9aace2c49abb3dd3c: Status 404 returned error can't find the container with id 4226026d9ae1775828491daec3fe57cdfb412bff5d6bbaf9aace2c49abb3dd3c
Aug 05 17:23:05.113384 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:23:05.113294    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:05.441483 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:23:05.441404    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:05.502572 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:23:05.502532    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:23:05.654794 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:23:05.654752    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-7b954ffc95-xfftc" event={"ID":"d4536851-fb20-47be-ba84-e1f4ead6bfa5","Type":"ContainerStarted","Data":"4226026d9ae1775828491daec3fe57cdfb412bff5d6bbaf9aace2c49abb3dd3c"}
Aug 05 17:23:07.666538 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:23:07.666499    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-7b954ffc95-xfftc" event={"ID":"d4536851-fb20-47be-ba84-e1f4ead6bfa5","Type":"ContainerStarted","Data":"a4323e840c8aae92c9330caca0c7067b0558c27405617438b1a79799c29ab5c1"}
Aug 05 17:23:07.666931 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:23:07.666645    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-7b954ffc95-xfftc"
Aug 05 17:23:07.687461 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:23:07.687412    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-7b954ffc95-xfftc" podStartSLOduration=1.491809883 podStartE2EDuration="3.68739699s" totalImagesPullingTime="2.195587107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:23:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:23:07.685600506 +0000 UTC m=+622.254102943" watchObservedRunningTime="2026-08-05 17:23:07.68739699 +0000 UTC m=+622.255899411"
Aug 05 17:23:18.675663 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:23:18.675634    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-7b954ffc95-xfftc"
Aug 05 17:23:45.645964 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:23:45.645932    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:22.471601 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:24:22.471547    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:39.167144 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:24:39.167070    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:39.270068 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:24:39.270039    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:44.898151 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:24:44.898115    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:44.999010 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:24:44.998979    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:52.867066 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:24:52.867028    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:24:54.110345 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:24:54.110311    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:25:14.429601 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:25:14.429570    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:25:53.046744 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:25:53.046708    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:25:58.390902 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:25:58.390864    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:25:58.458016 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:25:58.457986    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:26:42.867586 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:26:42.867527    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc"]
Aug 05 17:26:42.871030 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:26:42.871013    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc"
Aug 05 17:26:42.877318 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:26:42.875958    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Aug 05 17:26:42.877318 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:26:42.876212    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-h9rpc\""
Aug 05 17:26:42.877694 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:26:42.877650    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Aug 05 17:26:42.877882 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:26:42.877864    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-rollback-predictor-serving-cert\""
Aug 05 17:26:42.877882 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:26:42.877874    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-rollback-kube-rbac-proxy-sar-config\""
Aug 05 17:26:42.878082 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:26:42.877654    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Aug 05 17:26:42.878136 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:26:42.878097    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:26:42.878243 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:26:42.878224    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Aug 05 17:26:42.889161 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:26:42.889139    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc"]
Aug 05 17:26:42.949227 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:26:42.949195    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/cf675750-36d3-40b9-9e62-343eda480e57-cabundle-cert\") pod \"isvc-canary-rollback-predictor-55cddd885b-7bjbc\" (UID: \"cf675750-36d3-40b9-9e62-343eda480e57\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc"
Aug 05 17:26:42.949227 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:26:42.949231    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cf675750-36d3-40b9-9e62-343eda480e57-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-55cddd885b-7bjbc\" (UID: \"cf675750-36d3-40b9-9e62-343eda480e57\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc"
Aug 05 17:26:42.949458 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:26:42.949260    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trxdq\" (UniqueName: \"kubernetes.io/projected/cf675750-36d3-40b9-9e62-343eda480e57-kube-api-access-trxdq\") pod \"isvc-canary-rollback-predictor-55cddd885b-7bjbc\" (UID: \"cf675750-36d3-40b9-9e62-343eda480e57\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc"
Aug 05 17:26:42.949458 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:26:42.949342    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cf675750-36d3-40b9-9e62-343eda480e57-proxy-tls\") pod \"isvc-canary-rollback-predictor-55cddd885b-7bjbc\" (UID: \"cf675750-36d3-40b9-9e62-343eda480e57\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc"
Aug 05 17:26:42.949458 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:26:42.949387    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/cf675750-36d3-40b9-9e62-343eda480e57-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-55cddd885b-7bjbc\" (UID: \"cf675750-36d3-40b9-9e62-343eda480e57\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc"
Aug 05 17:26:43.050352 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:26:43.050316    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/cf675750-36d3-40b9-9e62-343eda480e57-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-55cddd885b-7bjbc\" (UID: \"cf675750-36d3-40b9-9e62-343eda480e57\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc"
Aug 05 17:26:43.050530 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:26:43.050413    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/cf675750-36d3-40b9-9e62-343eda480e57-cabundle-cert\") pod \"isvc-canary-rollback-predictor-55cddd885b-7bjbc\" (UID: \"cf675750-36d3-40b9-9e62-343eda480e57\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc"
Aug 05 17:26:43.050530 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:26:43.050439    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cf675750-36d3-40b9-9e62-343eda480e57-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-55cddd885b-7bjbc\" (UID: \"cf675750-36d3-40b9-9e62-343eda480e57\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc"
Aug 05 17:26:43.050530 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:26:43.050464    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trxdq\" (UniqueName: \"kubernetes.io/projected/cf675750-36d3-40b9-9e62-343eda480e57-kube-api-access-trxdq\") pod \"isvc-canary-rollback-predictor-55cddd885b-7bjbc\" (UID: \"cf675750-36d3-40b9-9e62-343eda480e57\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc"
Aug 05 17:26:43.050530 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:26:43.050507    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cf675750-36d3-40b9-9e62-343eda480e57-proxy-tls\") pod \"isvc-canary-rollback-predictor-55cddd885b-7bjbc\" (UID: \"cf675750-36d3-40b9-9e62-343eda480e57\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc"
Aug 05 17:26:43.050942 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:26:43.050909    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cf675750-36d3-40b9-9e62-343eda480e57-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-55cddd885b-7bjbc\" (UID: \"cf675750-36d3-40b9-9e62-343eda480e57\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc"
Aug 05 17:26:43.051053 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:26:43.051035    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/cf675750-36d3-40b9-9e62-343eda480e57-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-55cddd885b-7bjbc\" (UID: \"cf675750-36d3-40b9-9e62-343eda480e57\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc"
Aug 05 17:26:43.051142 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:26:43.051122    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/cf675750-36d3-40b9-9e62-343eda480e57-cabundle-cert\") pod \"isvc-canary-rollback-predictor-55cddd885b-7bjbc\" (UID: \"cf675750-36d3-40b9-9e62-343eda480e57\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc"
Aug 05 17:26:43.053080 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:26:43.053063    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cf675750-36d3-40b9-9e62-343eda480e57-proxy-tls\") pod \"isvc-canary-rollback-predictor-55cddd885b-7bjbc\" (UID: \"cf675750-36d3-40b9-9e62-343eda480e57\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc"
Aug 05 17:26:43.058901 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:26:43.058879    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trxdq\" (UniqueName: \"kubernetes.io/projected/cf675750-36d3-40b9-9e62-343eda480e57-kube-api-access-trxdq\") pod \"isvc-canary-rollback-predictor-55cddd885b-7bjbc\" (UID: \"cf675750-36d3-40b9-9e62-343eda480e57\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc"
Aug 05 17:26:43.186238 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:26:43.186145    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc"
Aug 05 17:26:43.325279 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:26:43.325253    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc"]
Aug 05 17:26:43.327869 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:26:43.327829    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf675750_36d3_40b9_9e62_343eda480e57.slice/crio-8ff7a80b26416e2f8585789b65bfcb5a8c3625c4f3a659433be397e565809b6d WatchSource:0}: Error finding container 8ff7a80b26416e2f8585789b65bfcb5a8c3625c4f3a659433be397e565809b6d: Status 404 returned error can't find the container with id 8ff7a80b26416e2f8585789b65bfcb5a8c3625c4f3a659433be397e565809b6d
Aug 05 17:26:43.329798 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:26:43.329782    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 17:26:43.621259 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:26:43.621227    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc" event={"ID":"cf675750-36d3-40b9-9e62-343eda480e57","Type":"ContainerStarted","Data":"8ff7a80b26416e2f8585789b65bfcb5a8c3625c4f3a659433be397e565809b6d"}
Aug 05 17:26:46.232127 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:26:46.232106    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Aug 05 17:26:46.637991 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:26:46.637956    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc" event={"ID":"cf675750-36d3-40b9-9e62-343eda480e57","Type":"ContainerStarted","Data":"f0b6b376ae5209d8584072aae6d3d2e1ad0fabd854ef6246132bb3504913c9bb"}
Aug 05 17:26:47.879293 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:26:47.879268    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:26:47.958739 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:26:47.958717    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:26:48.031683 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:26:48.031655    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:26:48.108531 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:26:48.108500    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:26:48.177145 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:26:48.177066    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:26:50.657855 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:26:50.657822    2580 generic.go:356] "Generic (PLEG): container finished" podID="cf675750-36d3-40b9-9e62-343eda480e57" containerID="f0b6b376ae5209d8584072aae6d3d2e1ad0fabd854ef6246132bb3504913c9bb" exitCode=0
Aug 05 17:26:50.657855 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:26:50.657860    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc" event={"ID":"cf675750-36d3-40b9-9e62-343eda480e57","Type":"ContainerDied","Data":"f0b6b376ae5209d8584072aae6d3d2e1ad0fabd854ef6246132bb3504913c9bb"}
Aug 05 17:27:03.735424 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:27:03.735388    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc" event={"ID":"cf675750-36d3-40b9-9e62-343eda480e57","Type":"ContainerStarted","Data":"d5917247a22d7253fe08d665440ad32af372bec58821d40f478e71baf395233c"}
Aug 05 17:27:05.747750 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:27:05.747716    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc" event={"ID":"cf675750-36d3-40b9-9e62-343eda480e57","Type":"ContainerStarted","Data":"05a950cd40a0d22742d4e93ef84a1113472e3f5080cde7698aa6978f6a09d221"}
Aug 05 17:27:05.748193 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:27:05.747911    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc"
Aug 05 17:27:05.768055 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:27:05.768008    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc" podStartSLOduration=2.507381064 podStartE2EDuration="23.767993271s" totalImagesPullingTime="17.745596272s" totalInitContainerRuntime="3.515015935s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:26:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:27:05.766343444 +0000 UTC m=+860.334845865" watchObservedRunningTime="2026-08-05 17:27:05.767993271 +0000 UTC m=+860.336495754"
Aug 05 17:27:06.752623 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:27:06.752591    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc"
Aug 05 17:27:06.754239 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:27:06.754209    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc" podUID="cf675750-36d3-40b9-9e62-343eda480e57" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Aug 05 17:27:07.757724 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:27:07.757682    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc" podUID="cf675750-36d3-40b9-9e62-343eda480e57" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Aug 05 17:27:12.761783 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:27:12.761751    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc"
Aug 05 17:27:12.762290 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:27:12.762260    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc" podUID="cf675750-36d3-40b9-9e62-343eda480e57" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Aug 05 17:27:22.762870 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:27:22.762833    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc" podUID="cf675750-36d3-40b9-9e62-343eda480e57" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Aug 05 17:27:32.762434 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:27:32.762396    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc" podUID="cf675750-36d3-40b9-9e62-343eda480e57" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Aug 05 17:27:42.762855 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:27:42.762767    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc" podUID="cf675750-36d3-40b9-9e62-343eda480e57" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Aug 05 17:27:45.829873 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:27:45.829847    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-cqj2n_17a2b686-e228-4d00-9656-8b03b65f2e29/console-operator/1.log"
Aug 05 17:27:45.831951 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:27:45.831930    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-cqj2n_17a2b686-e228-4d00-9656-8b03b65f2e29/console-operator/1.log"
Aug 05 17:27:45.836804 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:27:45.836785    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q69wj_d8e22937-0209-4cf9-b262-dacb99128703/ovn-acl-logging/0.log"
Aug 05 17:27:45.839065 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:27:45.839050    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q69wj_d8e22937-0209-4cf9-b262-dacb99128703/ovn-acl-logging/0.log"
Aug 05 17:27:52.762401 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:27:52.762361    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc" podUID="cf675750-36d3-40b9-9e62-343eda480e57" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Aug 05 17:28:02.762349 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:02.762310    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc" podUID="cf675750-36d3-40b9-9e62-343eda480e57" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Aug 05 17:28:12.762869 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:12.762826    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc" podUID="cf675750-36d3-40b9-9e62-343eda480e57" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.28:8080: connect: connection refused"
Aug 05 17:28:22.763329 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:22.763302    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc"
Aug 05 17:28:28.064878 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:28.064841    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:28.386718 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:28.386644    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:32.961193 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:32.961159    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc"]
Aug 05 17:28:32.961693 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:32.961509    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc" podUID="cf675750-36d3-40b9-9e62-343eda480e57" containerName="kserve-container" containerID="cri-o://d5917247a22d7253fe08d665440ad32af372bec58821d40f478e71baf395233c" gracePeriod=30
Aug 05 17:28:32.961693 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:32.961635    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc" podUID="cf675750-36d3-40b9-9e62-343eda480e57" containerName="kube-rbac-proxy" containerID="cri-o://05a950cd40a0d22742d4e93ef84a1113472e3f5080cde7698aa6978f6a09d221" gracePeriod=30
Aug 05 17:28:32.991053 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:32.991025    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:33.134034 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:33.134000    2580 generic.go:356] "Generic (PLEG): container finished" podID="cf675750-36d3-40b9-9e62-343eda480e57" containerID="05a950cd40a0d22742d4e93ef84a1113472e3f5080cde7698aa6978f6a09d221" exitCode=2
Aug 05 17:28:33.134185 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:33.134070    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc" event={"ID":"cf675750-36d3-40b9-9e62-343eda480e57","Type":"ContainerDied","Data":"05a950cd40a0d22742d4e93ef84a1113472e3f5080cde7698aa6978f6a09d221"}
Aug 05 17:28:37.507784 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:37.507756    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc"
Aug 05 17:28:37.660227 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:37.660140    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/cf675750-36d3-40b9-9e62-343eda480e57-kube-rbac-proxy-sar-config\") pod \"cf675750-36d3-40b9-9e62-343eda480e57\" (UID: \"cf675750-36d3-40b9-9e62-343eda480e57\") "
Aug 05 17:28:37.660227 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:37.660187    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/cf675750-36d3-40b9-9e62-343eda480e57-cabundle-cert\") pod \"cf675750-36d3-40b9-9e62-343eda480e57\" (UID: \"cf675750-36d3-40b9-9e62-343eda480e57\") "
Aug 05 17:28:37.660227 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:37.660214    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cf675750-36d3-40b9-9e62-343eda480e57-proxy-tls\") pod \"cf675750-36d3-40b9-9e62-343eda480e57\" (UID: \"cf675750-36d3-40b9-9e62-343eda480e57\") "
Aug 05 17:28:37.660506 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:37.660280    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cf675750-36d3-40b9-9e62-343eda480e57-kserve-provision-location\") pod \"cf675750-36d3-40b9-9e62-343eda480e57\" (UID: \"cf675750-36d3-40b9-9e62-343eda480e57\") "
Aug 05 17:28:37.660506 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:37.660299    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trxdq\" (UniqueName: \"kubernetes.io/projected/cf675750-36d3-40b9-9e62-343eda480e57-kube-api-access-trxdq\") pod \"cf675750-36d3-40b9-9e62-343eda480e57\" (UID: \"cf675750-36d3-40b9-9e62-343eda480e57\") "
Aug 05 17:28:37.660643 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:37.660617    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf675750-36d3-40b9-9e62-343eda480e57-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "cf675750-36d3-40b9-9e62-343eda480e57" (UID: "cf675750-36d3-40b9-9e62-343eda480e57"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:28:37.660695 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:37.660630    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf675750-36d3-40b9-9e62-343eda480e57-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "cf675750-36d3-40b9-9e62-343eda480e57" (UID: "cf675750-36d3-40b9-9e62-343eda480e57"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:28:37.660695 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:37.660619    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf675750-36d3-40b9-9e62-343eda480e57-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "cf675750-36d3-40b9-9e62-343eda480e57" (UID: "cf675750-36d3-40b9-9e62-343eda480e57"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:28:37.662568 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:37.662534    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf675750-36d3-40b9-9e62-343eda480e57-kube-api-access-trxdq" (OuterVolumeSpecName: "kube-api-access-trxdq") pod "cf675750-36d3-40b9-9e62-343eda480e57" (UID: "cf675750-36d3-40b9-9e62-343eda480e57"). InnerVolumeSpecName "kube-api-access-trxdq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:28:37.662632 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:37.662586    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf675750-36d3-40b9-9e62-343eda480e57-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "cf675750-36d3-40b9-9e62-343eda480e57" (UID: "cf675750-36d3-40b9-9e62-343eda480e57"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:28:37.761515 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:37.761479    2580 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/cf675750-36d3-40b9-9e62-343eda480e57-kube-rbac-proxy-sar-config\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\""
Aug 05 17:28:37.761515 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:37.761507    2580 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/cf675750-36d3-40b9-9e62-343eda480e57-cabundle-cert\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\""
Aug 05 17:28:37.761515 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:37.761517    2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cf675750-36d3-40b9-9e62-343eda480e57-proxy-tls\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\""
Aug 05 17:28:37.761744 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:37.761525    2580 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cf675750-36d3-40b9-9e62-343eda480e57-kserve-provision-location\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\""
Aug 05 17:28:37.761744 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:37.761535    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trxdq\" (UniqueName: \"kubernetes.io/projected/cf675750-36d3-40b9-9e62-343eda480e57-kube-api-access-trxdq\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\""
Aug 05 17:28:38.079484 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.079452    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:38.138609 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.137969    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5"]
Aug 05 17:28:38.139181 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.139124    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf675750-36d3-40b9-9e62-343eda480e57" containerName="kube-rbac-proxy"
Aug 05 17:28:38.139181 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.139151    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf675750-36d3-40b9-9e62-343eda480e57" containerName="kube-rbac-proxy"
Aug 05 17:28:38.140274 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.139417    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf675750-36d3-40b9-9e62-343eda480e57" containerName="storage-initializer"
Aug 05 17:28:38.140274 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.139435    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf675750-36d3-40b9-9e62-343eda480e57" containerName="storage-initializer"
Aug 05 17:28:38.140274 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.139469    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf675750-36d3-40b9-9e62-343eda480e57" containerName="kserve-container"
Aug 05 17:28:38.140274 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.139478    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf675750-36d3-40b9-9e62-343eda480e57" containerName="kserve-container"
Aug 05 17:28:38.140274 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.139673    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf675750-36d3-40b9-9e62-343eda480e57" containerName="kserve-container"
Aug 05 17:28:38.140274 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.139698    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf675750-36d3-40b9-9e62-343eda480e57" containerName="kube-rbac-proxy"
Aug 05 17:28:38.143636 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.143598    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5"
Aug 05 17:28:38.146016 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.145994    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-stop-predictor-serving-cert\""
Aug 05 17:28:38.146016 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.146007    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-stop-kube-rbac-proxy-sar-config\""
Aug 05 17:28:38.151158 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.151136    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5"]
Aug 05 17:28:38.158994 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.158968    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:38.159439 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.159415    2580 generic.go:356] "Generic (PLEG): container finished" podID="cf675750-36d3-40b9-9e62-343eda480e57" containerID="d5917247a22d7253fe08d665440ad32af372bec58821d40f478e71baf395233c" exitCode=0
Aug 05 17:28:38.159530 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.159487    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc"
Aug 05 17:28:38.159530 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.159491    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc" event={"ID":"cf675750-36d3-40b9-9e62-343eda480e57","Type":"ContainerDied","Data":"d5917247a22d7253fe08d665440ad32af372bec58821d40f478e71baf395233c"}
Aug 05 17:28:38.159673 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.159543    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc" event={"ID":"cf675750-36d3-40b9-9e62-343eda480e57","Type":"ContainerDied","Data":"8ff7a80b26416e2f8585789b65bfcb5a8c3625c4f3a659433be397e565809b6d"}
Aug 05 17:28:38.159673 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.159593    2580 scope.go:117] "RemoveContainer" containerID="05a950cd40a0d22742d4e93ef84a1113472e3f5080cde7698aa6978f6a09d221"
Aug 05 17:28:38.168623 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.168582    2580 scope.go:117] "RemoveContainer" containerID="d5917247a22d7253fe08d665440ad32af372bec58821d40f478e71baf395233c"
Aug 05 17:28:38.176459 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.176436    2580 scope.go:117] "RemoveContainer" containerID="f0b6b376ae5209d8584072aae6d3d2e1ad0fabd854ef6246132bb3504913c9bb"
Aug 05 17:28:38.184521 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.184497    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc"]
Aug 05 17:28:38.184910 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.184895    2580 scope.go:117] "RemoveContainer" containerID="05a950cd40a0d22742d4e93ef84a1113472e3f5080cde7698aa6978f6a09d221"
Aug 05 17:28:38.185162 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:28:38.185144    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05a950cd40a0d22742d4e93ef84a1113472e3f5080cde7698aa6978f6a09d221\": container with ID starting with 05a950cd40a0d22742d4e93ef84a1113472e3f5080cde7698aa6978f6a09d221 not found: ID does not exist" containerID="05a950cd40a0d22742d4e93ef84a1113472e3f5080cde7698aa6978f6a09d221"
Aug 05 17:28:38.185223 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.185175    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05a950cd40a0d22742d4e93ef84a1113472e3f5080cde7698aa6978f6a09d221"} err="failed to get container status \"05a950cd40a0d22742d4e93ef84a1113472e3f5080cde7698aa6978f6a09d221\": rpc error: code = NotFound desc = could not find container \"05a950cd40a0d22742d4e93ef84a1113472e3f5080cde7698aa6978f6a09d221\": container with ID starting with 05a950cd40a0d22742d4e93ef84a1113472e3f5080cde7698aa6978f6a09d221 not found: ID does not exist"
Aug 05 17:28:38.185223 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.185210    2580 scope.go:117] "RemoveContainer" containerID="d5917247a22d7253fe08d665440ad32af372bec58821d40f478e71baf395233c"
Aug 05 17:28:38.185400 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:28:38.185386    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5917247a22d7253fe08d665440ad32af372bec58821d40f478e71baf395233c\": container with ID starting with d5917247a22d7253fe08d665440ad32af372bec58821d40f478e71baf395233c not found: ID does not exist" containerID="d5917247a22d7253fe08d665440ad32af372bec58821d40f478e71baf395233c"
Aug 05 17:28:38.185440 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.185405    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5917247a22d7253fe08d665440ad32af372bec58821d40f478e71baf395233c"} err="failed to get container status \"d5917247a22d7253fe08d665440ad32af372bec58821d40f478e71baf395233c\": rpc error: code = NotFound desc = could not find container \"d5917247a22d7253fe08d665440ad32af372bec58821d40f478e71baf395233c\": container with ID starting with d5917247a22d7253fe08d665440ad32af372bec58821d40f478e71baf395233c not found: ID does not exist"
Aug 05 17:28:38.185440 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.185418    2580 scope.go:117] "RemoveContainer" containerID="f0b6b376ae5209d8584072aae6d3d2e1ad0fabd854ef6246132bb3504913c9bb"
Aug 05 17:28:38.185702 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:28:38.185682    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0b6b376ae5209d8584072aae6d3d2e1ad0fabd854ef6246132bb3504913c9bb\": container with ID starting with f0b6b376ae5209d8584072aae6d3d2e1ad0fabd854ef6246132bb3504913c9bb not found: ID does not exist" containerID="f0b6b376ae5209d8584072aae6d3d2e1ad0fabd854ef6246132bb3504913c9bb"
Aug 05 17:28:38.185773 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.185708    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0b6b376ae5209d8584072aae6d3d2e1ad0fabd854ef6246132bb3504913c9bb"} err="failed to get container status \"f0b6b376ae5209d8584072aae6d3d2e1ad0fabd854ef6246132bb3504913c9bb\": rpc error: code = NotFound desc = could not find container \"f0b6b376ae5209d8584072aae6d3d2e1ad0fabd854ef6246132bb3504913c9bb\": container with ID starting with f0b6b376ae5209d8584072aae6d3d2e1ad0fabd854ef6246132bb3504913c9bb not found: ID does not exist"
Aug 05 17:28:38.188879 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.188859    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-55cddd885b-7bjbc"]
Aug 05 17:28:38.265607 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.265459    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggq5h\" (UniqueName: \"kubernetes.io/projected/cb25b353-53b3-4768-8389-1f9cd5b6372a-kube-api-access-ggq5h\") pod \"isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5\" (UID: \"cb25b353-53b3-4768-8389-1f9cd5b6372a\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5"
Aug 05 17:28:38.265607 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.265531    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/cb25b353-53b3-4768-8389-1f9cd5b6372a-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5\" (UID: \"cb25b353-53b3-4768-8389-1f9cd5b6372a\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5"
Aug 05 17:28:38.265812 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.265636    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/cb25b353-53b3-4768-8389-1f9cd5b6372a-cabundle-cert\") pod \"isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5\" (UID: \"cb25b353-53b3-4768-8389-1f9cd5b6372a\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5"
Aug 05 17:28:38.265812 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.265674    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cb25b353-53b3-4768-8389-1f9cd5b6372a-kserve-provision-location\") pod \"isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5\" (UID: \"cb25b353-53b3-4768-8389-1f9cd5b6372a\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5"
Aug 05 17:28:38.265812 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.265699    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cb25b353-53b3-4768-8389-1f9cd5b6372a-proxy-tls\") pod \"isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5\" (UID: \"cb25b353-53b3-4768-8389-1f9cd5b6372a\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5"
Aug 05 17:28:38.316063 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.316032    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:38.366683 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.366653    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/cb25b353-53b3-4768-8389-1f9cd5b6372a-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5\" (UID: \"cb25b353-53b3-4768-8389-1f9cd5b6372a\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5"
Aug 05 17:28:38.366850 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.366709    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/cb25b353-53b3-4768-8389-1f9cd5b6372a-cabundle-cert\") pod \"isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5\" (UID: \"cb25b353-53b3-4768-8389-1f9cd5b6372a\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5"
Aug 05 17:28:38.366850 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.366751    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cb25b353-53b3-4768-8389-1f9cd5b6372a-kserve-provision-location\") pod \"isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5\" (UID: \"cb25b353-53b3-4768-8389-1f9cd5b6372a\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5"
Aug 05 17:28:38.366850 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.366770    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cb25b353-53b3-4768-8389-1f9cd5b6372a-proxy-tls\") pod \"isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5\" (UID: \"cb25b353-53b3-4768-8389-1f9cd5b6372a\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5"
Aug 05 17:28:38.366850 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.366804    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggq5h\" (UniqueName: \"kubernetes.io/projected/cb25b353-53b3-4768-8389-1f9cd5b6372a-kube-api-access-ggq5h\") pod \"isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5\" (UID: \"cb25b353-53b3-4768-8389-1f9cd5b6372a\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5"
Aug 05 17:28:38.367195 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:28:38.367171    2580 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-canary-stop-predictor-serving-cert: secret "isvc-canary-stop-predictor-serving-cert" not found
Aug 05 17:28:38.367413 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:28:38.367399    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb25b353-53b3-4768-8389-1f9cd5b6372a-proxy-tls podName:cb25b353-53b3-4768-8389-1f9cd5b6372a nodeName:}" failed. No retries permitted until 2026-08-05 17:28:38.867375279 +0000 UTC m=+953.435877695 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/cb25b353-53b3-4768-8389-1f9cd5b6372a-proxy-tls") pod "isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5" (UID: "cb25b353-53b3-4768-8389-1f9cd5b6372a") : secret "isvc-canary-stop-predictor-serving-cert" not found
Aug 05 17:28:38.367511 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.367317    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cb25b353-53b3-4768-8389-1f9cd5b6372a-kserve-provision-location\") pod \"isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5\" (UID: \"cb25b353-53b3-4768-8389-1f9cd5b6372a\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5"
Aug 05 17:28:38.367594 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.367512    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/cb25b353-53b3-4768-8389-1f9cd5b6372a-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5\" (UID: \"cb25b353-53b3-4768-8389-1f9cd5b6372a\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5"
Aug 05 17:28:38.367594 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.367580    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/cb25b353-53b3-4768-8389-1f9cd5b6372a-cabundle-cert\") pod \"isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5\" (UID: \"cb25b353-53b3-4768-8389-1f9cd5b6372a\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5"
Aug 05 17:28:38.384949 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.384919    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggq5h\" (UniqueName: \"kubernetes.io/projected/cb25b353-53b3-4768-8389-1f9cd5b6372a-kube-api-access-ggq5h\") pod \"isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5\" (UID: \"cb25b353-53b3-4768-8389-1f9cd5b6372a\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5"
Aug 05 17:28:38.421034 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.421007    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:38.428773 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.428751    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx"]
Aug 05 17:28:38.432225 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.432210    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx"
Aug 05 17:28:38.434334 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.434312    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-raw-hpa-f37da-predictor-serving-cert\""
Aug 05 17:28:38.434427 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.434360    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-raw-hpa-f37da-kube-rbac-proxy-sar-config\""
Aug 05 17:28:38.443598 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.443576    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx"]
Aug 05 17:28:38.513213 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.513181    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:38.568174 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.568145    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqqfs\" (UniqueName: \"kubernetes.io/projected/a12885b1-256c-4763-b9e9-8c521ab957ee-kube-api-access-sqqfs\") pod \"isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx\" (UID: \"a12885b1-256c-4763-b9e9-8c521ab957ee\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx"
Aug 05 17:28:38.568325 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.568207    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a12885b1-256c-4763-b9e9-8c521ab957ee-proxy-tls\") pod \"isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx\" (UID: \"a12885b1-256c-4763-b9e9-8c521ab957ee\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx"
Aug 05 17:28:38.568325 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.568239    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a12885b1-256c-4763-b9e9-8c521ab957ee-cabundle-cert\") pod \"isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx\" (UID: \"a12885b1-256c-4763-b9e9-8c521ab957ee\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx"
Aug 05 17:28:38.568325 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.568260    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a12885b1-256c-4763-b9e9-8c521ab957ee-kserve-provision-location\") pod \"isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx\" (UID: \"a12885b1-256c-4763-b9e9-8c521ab957ee\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx"
Aug 05 17:28:38.568429 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.568363    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a12885b1-256c-4763-b9e9-8c521ab957ee-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx\" (UID: \"a12885b1-256c-4763-b9e9-8c521ab957ee\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx"
Aug 05 17:28:38.580740 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.580711    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:38.669801 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.669753    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqqfs\" (UniqueName: \"kubernetes.io/projected/a12885b1-256c-4763-b9e9-8c521ab957ee-kube-api-access-sqqfs\") pod \"isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx\" (UID: \"a12885b1-256c-4763-b9e9-8c521ab957ee\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx"
Aug 05 17:28:38.669957 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.669846    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a12885b1-256c-4763-b9e9-8c521ab957ee-proxy-tls\") pod \"isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx\" (UID: \"a12885b1-256c-4763-b9e9-8c521ab957ee\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx"
Aug 05 17:28:38.669957 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.669881    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a12885b1-256c-4763-b9e9-8c521ab957ee-cabundle-cert\") pod \"isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx\" (UID: \"a12885b1-256c-4763-b9e9-8c521ab957ee\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx"
Aug 05 17:28:38.669957 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.669900    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a12885b1-256c-4763-b9e9-8c521ab957ee-kserve-provision-location\") pod \"isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx\" (UID: \"a12885b1-256c-4763-b9e9-8c521ab957ee\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx"
Aug 05 17:28:38.669957 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.669952    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a12885b1-256c-4763-b9e9-8c521ab957ee-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx\" (UID: \"a12885b1-256c-4763-b9e9-8c521ab957ee\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx"
Aug 05 17:28:38.670122 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:28:38.669991    2580 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-serving-cert: secret "isvc-sklearn-graph-raw-hpa-f37da-predictor-serving-cert" not found
Aug 05 17:28:38.670122 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:28:38.670059    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a12885b1-256c-4763-b9e9-8c521ab957ee-proxy-tls podName:a12885b1-256c-4763-b9e9-8c521ab957ee nodeName:}" failed. No retries permitted until 2026-08-05 17:28:39.170040262 +0000 UTC m=+953.738542661 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/a12885b1-256c-4763-b9e9-8c521ab957ee-proxy-tls") pod "isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx" (UID: "a12885b1-256c-4763-b9e9-8c521ab957ee") : secret "isvc-sklearn-graph-raw-hpa-f37da-predictor-serving-cert" not found
Aug 05 17:28:38.670363 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.670346    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a12885b1-256c-4763-b9e9-8c521ab957ee-kserve-provision-location\") pod \"isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx\" (UID: \"a12885b1-256c-4763-b9e9-8c521ab957ee\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx"
Aug 05 17:28:38.670550 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.670534    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a12885b1-256c-4763-b9e9-8c521ab957ee-cabundle-cert\") pod \"isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx\" (UID: \"a12885b1-256c-4763-b9e9-8c521ab957ee\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx"
Aug 05 17:28:38.670550 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.670545    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a12885b1-256c-4763-b9e9-8c521ab957ee-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx\" (UID: \"a12885b1-256c-4763-b9e9-8c521ab957ee\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx"
Aug 05 17:28:38.683900 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.683879    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqqfs\" (UniqueName: \"kubernetes.io/projected/a12885b1-256c-4763-b9e9-8c521ab957ee-kube-api-access-sqqfs\") pod \"isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx\" (UID: \"a12885b1-256c-4763-b9e9-8c521ab957ee\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx"
Aug 05 17:28:38.730690 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.730659    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:28:38.871751 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.871671    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cb25b353-53b3-4768-8389-1f9cd5b6372a-proxy-tls\") pod \"isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5\" (UID: \"cb25b353-53b3-4768-8389-1f9cd5b6372a\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5"
Aug 05 17:28:38.874145 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:38.874114    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cb25b353-53b3-4768-8389-1f9cd5b6372a-proxy-tls\") pod \"isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5\" (UID: \"cb25b353-53b3-4768-8389-1f9cd5b6372a\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5"
Aug 05 17:28:39.055326 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:39.055285    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5"
Aug 05 17:28:39.174984 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:39.174954    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a12885b1-256c-4763-b9e9-8c521ab957ee-proxy-tls\") pod \"isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx\" (UID: \"a12885b1-256c-4763-b9e9-8c521ab957ee\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx"
Aug 05 17:28:39.177270 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:39.177252    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a12885b1-256c-4763-b9e9-8c521ab957ee-proxy-tls\") pod \"isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx\" (UID: \"a12885b1-256c-4763-b9e9-8c521ab957ee\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx"
Aug 05 17:28:39.188288 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:39.188270    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5"]
Aug 05 17:28:39.190310 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:28:39.190291    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb25b353_53b3_4768_8389_1f9cd5b6372a.slice/crio-7036b38e0e100a55e45bb5ac9bd979fb485d6866a393d4fc2959b4934d8018a4 WatchSource:0}: Error finding container 7036b38e0e100a55e45bb5ac9bd979fb485d6866a393d4fc2959b4934d8018a4: Status 404 returned error can't find the container with id 7036b38e0e100a55e45bb5ac9bd979fb485d6866a393d4fc2959b4934d8018a4
Aug 05 17:28:39.343110 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:39.343076    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx"
Aug 05 17:28:39.479770 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:39.479748    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx"]
Aug 05 17:28:39.481945 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:28:39.481913    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda12885b1_256c_4763_b9e9_8c521ab957ee.slice/crio-9bfd6f4310039943a2491664540688c11a6f0826fa800b1d233ff2b785fb7528 WatchSource:0}: Error finding container 9bfd6f4310039943a2491664540688c11a6f0826fa800b1d233ff2b785fb7528: Status 404 returned error can't find the container with id 9bfd6f4310039943a2491664540688c11a6f0826fa800b1d233ff2b785fb7528
Aug 05 17:28:40.002827 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:40.002789    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf675750-36d3-40b9-9e62-343eda480e57" path="/var/lib/kubelet/pods/cf675750-36d3-40b9-9e62-343eda480e57/volumes"
Aug 05 17:28:40.171488 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:40.171451    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx" event={"ID":"a12885b1-256c-4763-b9e9-8c521ab957ee","Type":"ContainerStarted","Data":"3b05483f15c2247d4157bf6be9b88e2fde3e886d6669eb81f4b76b57097dcc17"}
Aug 05 17:28:40.171670 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:40.171510    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx" event={"ID":"a12885b1-256c-4763-b9e9-8c521ab957ee","Type":"ContainerStarted","Data":"9bfd6f4310039943a2491664540688c11a6f0826fa800b1d233ff2b785fb7528"}
Aug 05 17:28:40.172991 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:40.172969    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5" event={"ID":"cb25b353-53b3-4768-8389-1f9cd5b6372a","Type":"ContainerStarted","Data":"c7855f1afa9e69241dbf77723ccbaa7b8b5efab042ea1ccfe23782d62957cbfd"}
Aug 05 17:28:40.173090 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:40.173012    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5" event={"ID":"cb25b353-53b3-4768-8389-1f9cd5b6372a","Type":"ContainerStarted","Data":"7036b38e0e100a55e45bb5ac9bd979fb485d6866a393d4fc2959b4934d8018a4"}
Aug 05 17:28:44.193744 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:44.193711    2580 generic.go:356] "Generic (PLEG): container finished" podID="a12885b1-256c-4763-b9e9-8c521ab957ee" containerID="3b05483f15c2247d4157bf6be9b88e2fde3e886d6669eb81f4b76b57097dcc17" exitCode=0
Aug 05 17:28:44.194188 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:44.193790    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx" event={"ID":"a12885b1-256c-4763-b9e9-8c521ab957ee","Type":"ContainerDied","Data":"3b05483f15c2247d4157bf6be9b88e2fde3e886d6669eb81f4b76b57097dcc17"}
Aug 05 17:28:44.195282 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:44.195262    2580 generic.go:356] "Generic (PLEG): container finished" podID="cb25b353-53b3-4768-8389-1f9cd5b6372a" containerID="c7855f1afa9e69241dbf77723ccbaa7b8b5efab042ea1ccfe23782d62957cbfd" exitCode=0
Aug 05 17:28:44.195386 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:44.195333    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5" event={"ID":"cb25b353-53b3-4768-8389-1f9cd5b6372a","Type":"ContainerDied","Data":"c7855f1afa9e69241dbf77723ccbaa7b8b5efab042ea1ccfe23782d62957cbfd"}
Aug 05 17:28:45.203069 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:45.203029    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx" event={"ID":"a12885b1-256c-4763-b9e9-8c521ab957ee","Type":"ContainerStarted","Data":"bab84b3c8a0efe4d32dc32f947c1d454fcb2491a71f53a10a4f6936591eba64a"}
Aug 05 17:28:45.203617 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:45.203102    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx" event={"ID":"a12885b1-256c-4763-b9e9-8c521ab957ee","Type":"ContainerStarted","Data":"9bd7272a30e3a2eb3dcfc188c3a418e83a5d5b02e213b68f42ea6c6e319e8242"}
Aug 05 17:28:45.203617 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:45.203332    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx"
Aug 05 17:28:45.205063 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:45.205041    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5" event={"ID":"cb25b353-53b3-4768-8389-1f9cd5b6372a","Type":"ContainerStarted","Data":"054b3dfc483d774164bcadea51a0b415848523e70a5a8559c62bd0149ca45d59"}
Aug 05 17:28:45.205152 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:45.205084    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5" event={"ID":"cb25b353-53b3-4768-8389-1f9cd5b6372a","Type":"ContainerStarted","Data":"2838b94c9ead63aa5f44d5399c5a52596edc1b45a1877e0c480d47073b435999"}
Aug 05 17:28:45.205324 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:45.205308    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5"
Aug 05 17:28:45.205384 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:45.205349    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5"
Aug 05 17:28:45.206889 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:45.206863    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5" podUID="cb25b353-53b3-4768-8389-1f9cd5b6372a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Aug 05 17:28:45.224686 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:45.224636    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx" podStartSLOduration=3.521507259 podStartE2EDuration="7.224621556s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.703114297s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:28:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:28:45.222387472 +0000 UTC m=+959.790889917" watchObservedRunningTime="2026-08-05 17:28:45.224621556 +0000 UTC m=+959.793123977"
Aug 05 17:28:45.245371 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:45.245320    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5" podStartSLOduration=3.3024411750000002 podStartE2EDuration="7.245307083s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.942865908s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:28:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:28:45.243812135 +0000 UTC m=+959.812314580" watchObservedRunningTime="2026-08-05 17:28:45.245307083 +0000 UTC m=+959.813809552"
Aug 05 17:28:46.209925 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:46.209824    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5" podUID="cb25b353-53b3-4768-8389-1f9cd5b6372a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Aug 05 17:28:46.210355 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:46.209946    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx"
Aug 05 17:28:46.211384 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:46.211363    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx" podUID="a12885b1-256c-4763-b9e9-8c521ab957ee" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Aug 05 17:28:47.219633 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:47.219590    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx" podUID="a12885b1-256c-4763-b9e9-8c521ab957ee" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Aug 05 17:28:51.214847 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:51.214819    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5"
Aug 05 17:28:51.215305 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:51.215281    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5" podUID="cb25b353-53b3-4768-8389-1f9cd5b6372a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Aug 05 17:28:52.224734 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:52.224705    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx"
Aug 05 17:28:52.225182 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:28:52.225157    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx" podUID="a12885b1-256c-4763-b9e9-8c521ab957ee" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Aug 05 17:29:01.216033 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:29:01.215993    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5" podUID="cb25b353-53b3-4768-8389-1f9cd5b6372a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Aug 05 17:29:02.226003 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:29:02.225964    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx" podUID="a12885b1-256c-4763-b9e9-8c521ab957ee" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Aug 05 17:29:11.216063 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:29:11.215976    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5" podUID="cb25b353-53b3-4768-8389-1f9cd5b6372a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Aug 05 17:29:12.225357 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:29:12.225308    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx" podUID="a12885b1-256c-4763-b9e9-8c521ab957ee" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Aug 05 17:29:21.215472 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:29:21.215426    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5" podUID="cb25b353-53b3-4768-8389-1f9cd5b6372a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Aug 05 17:29:22.225970 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:29:22.225930    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx" podUID="a12885b1-256c-4763-b9e9-8c521ab957ee" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Aug 05 17:29:31.216267 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:29:31.216228    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5" podUID="cb25b353-53b3-4768-8389-1f9cd5b6372a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Aug 05 17:29:32.225626 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:29:32.225585    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx" podUID="a12885b1-256c-4763-b9e9-8c521ab957ee" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Aug 05 17:29:41.215825 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:29:41.215786    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5" podUID="cb25b353-53b3-4768-8389-1f9cd5b6372a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Aug 05 17:29:42.225113 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:29:42.225078    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx" podUID="a12885b1-256c-4763-b9e9-8c521ab957ee" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Aug 05 17:29:51.215806 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:29:51.215767    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5" podUID="cb25b353-53b3-4768-8389-1f9cd5b6372a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Aug 05 17:29:52.225194 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:29:52.225160    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx" podUID="a12885b1-256c-4763-b9e9-8c521ab957ee" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Aug 05 17:29:58.997685 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:29:58.997650    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx"
Aug 05 17:30:01.216249 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:01.216220    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5"
Aug 05 17:30:08.145377 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:08.145335    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5"]
Aug 05 17:30:08.145888 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:08.145600    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5" podUID="cb25b353-53b3-4768-8389-1f9cd5b6372a" containerName="kserve-container" containerID="cri-o://2838b94c9ead63aa5f44d5399c5a52596edc1b45a1877e0c480d47073b435999" gracePeriod=30
Aug 05 17:30:08.145888 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:08.145667    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5" podUID="cb25b353-53b3-4768-8389-1f9cd5b6372a" containerName="kube-rbac-proxy" containerID="cri-o://054b3dfc483d774164bcadea51a0b415848523e70a5a8559c62bd0149ca45d59" gracePeriod=30
Aug 05 17:30:08.157901 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:08.157878    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:08.173526 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:30:08.173501    2580 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb25b353_53b3_4768_8389_1f9cd5b6372a.slice/crio-054b3dfc483d774164bcadea51a0b415848523e70a5a8559c62bd0149ca45d59.scope\": RecentStats: unable to find data in memory cache]"
Aug 05 17:30:08.609200 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:08.609168    2580 generic.go:356] "Generic (PLEG): container finished" podID="cb25b353-53b3-4768-8389-1f9cd5b6372a" containerID="054b3dfc483d774164bcadea51a0b415848523e70a5a8559c62bd0149ca45d59" exitCode=2
Aug 05 17:30:08.609365 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:08.609206    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5" event={"ID":"cb25b353-53b3-4768-8389-1f9cd5b6372a","Type":"ContainerDied","Data":"054b3dfc483d774164bcadea51a0b415848523e70a5a8559c62bd0149ca45d59"}
Aug 05 17:30:10.103997 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:10.103967    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:11.210344 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:11.210298    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5" podUID="cb25b353-53b3-4768-8389-1f9cd5b6372a" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.29:8643/healthz\": dial tcp 10.134.0.29:8643: connect: connection refused"
Aug 05 17:30:11.216126 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:11.216101    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5" podUID="cb25b353-53b3-4768-8389-1f9cd5b6372a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.29:8080: connect: connection refused"
Aug 05 17:30:12.795378 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:12.795356    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5"
Aug 05 17:30:12.891826 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:12.891795    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cb25b353-53b3-4768-8389-1f9cd5b6372a-kserve-provision-location\") pod \"cb25b353-53b3-4768-8389-1f9cd5b6372a\" (UID: \"cb25b353-53b3-4768-8389-1f9cd5b6372a\") "
Aug 05 17:30:12.892019 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:12.891873    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/cb25b353-53b3-4768-8389-1f9cd5b6372a-cabundle-cert\") pod \"cb25b353-53b3-4768-8389-1f9cd5b6372a\" (UID: \"cb25b353-53b3-4768-8389-1f9cd5b6372a\") "
Aug 05 17:30:12.892019 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:12.891902    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggq5h\" (UniqueName: \"kubernetes.io/projected/cb25b353-53b3-4768-8389-1f9cd5b6372a-kube-api-access-ggq5h\") pod \"cb25b353-53b3-4768-8389-1f9cd5b6372a\" (UID: \"cb25b353-53b3-4768-8389-1f9cd5b6372a\") "
Aug 05 17:30:12.892019 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:12.891935    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/cb25b353-53b3-4768-8389-1f9cd5b6372a-kube-rbac-proxy-sar-config\") pod \"cb25b353-53b3-4768-8389-1f9cd5b6372a\" (UID: \"cb25b353-53b3-4768-8389-1f9cd5b6372a\") "
Aug 05 17:30:12.892019 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:12.891977    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cb25b353-53b3-4768-8389-1f9cd5b6372a-proxy-tls\") pod \"cb25b353-53b3-4768-8389-1f9cd5b6372a\" (UID: \"cb25b353-53b3-4768-8389-1f9cd5b6372a\") "
Aug 05 17:30:12.892218 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:12.892129    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb25b353-53b3-4768-8389-1f9cd5b6372a-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "cb25b353-53b3-4768-8389-1f9cd5b6372a" (UID: "cb25b353-53b3-4768-8389-1f9cd5b6372a"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:30:12.892256 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:12.892234    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb25b353-53b3-4768-8389-1f9cd5b6372a-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "cb25b353-53b3-4768-8389-1f9cd5b6372a" (UID: "cb25b353-53b3-4768-8389-1f9cd5b6372a"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:30:12.892300 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:12.892271    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb25b353-53b3-4768-8389-1f9cd5b6372a-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "cb25b353-53b3-4768-8389-1f9cd5b6372a" (UID: "cb25b353-53b3-4768-8389-1f9cd5b6372a"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:30:12.894108 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:12.894089    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb25b353-53b3-4768-8389-1f9cd5b6372a-kube-api-access-ggq5h" (OuterVolumeSpecName: "kube-api-access-ggq5h") pod "cb25b353-53b3-4768-8389-1f9cd5b6372a" (UID: "cb25b353-53b3-4768-8389-1f9cd5b6372a"). InnerVolumeSpecName "kube-api-access-ggq5h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:30:12.894169 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:12.894147    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb25b353-53b3-4768-8389-1f9cd5b6372a-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "cb25b353-53b3-4768-8389-1f9cd5b6372a" (UID: "cb25b353-53b3-4768-8389-1f9cd5b6372a"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:30:12.993206 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:12.993170    2580 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/cb25b353-53b3-4768-8389-1f9cd5b6372a-cabundle-cert\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\""
Aug 05 17:30:12.993206 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:12.993199    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggq5h\" (UniqueName: \"kubernetes.io/projected/cb25b353-53b3-4768-8389-1f9cd5b6372a-kube-api-access-ggq5h\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\""
Aug 05 17:30:12.993206 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:12.993209    2580 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/cb25b353-53b3-4768-8389-1f9cd5b6372a-kube-rbac-proxy-sar-config\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\""
Aug 05 17:30:12.993491 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:12.993217    2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cb25b353-53b3-4768-8389-1f9cd5b6372a-proxy-tls\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\""
Aug 05 17:30:12.993491 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:12.993225    2580 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cb25b353-53b3-4768-8389-1f9cd5b6372a-kserve-provision-location\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\""
Aug 05 17:30:13.633904 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:13.633867    2580 generic.go:356] "Generic (PLEG): container finished" podID="cb25b353-53b3-4768-8389-1f9cd5b6372a" containerID="2838b94c9ead63aa5f44d5399c5a52596edc1b45a1877e0c480d47073b435999" exitCode=0
Aug 05 17:30:13.634082 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:13.633911    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5"
Aug 05 17:30:13.634082 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:13.633991    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5" event={"ID":"cb25b353-53b3-4768-8389-1f9cd5b6372a","Type":"ContainerDied","Data":"2838b94c9ead63aa5f44d5399c5a52596edc1b45a1877e0c480d47073b435999"}
Aug 05 17:30:13.634082 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:13.634051    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5" event={"ID":"cb25b353-53b3-4768-8389-1f9cd5b6372a","Type":"ContainerDied","Data":"7036b38e0e100a55e45bb5ac9bd979fb485d6866a393d4fc2959b4934d8018a4"}
Aug 05 17:30:13.634183 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:13.634083    2580 scope.go:117] "RemoveContainer" containerID="054b3dfc483d774164bcadea51a0b415848523e70a5a8559c62bd0149ca45d59"
Aug 05 17:30:13.643817 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:13.643799    2580 scope.go:117] "RemoveContainer" containerID="2838b94c9ead63aa5f44d5399c5a52596edc1b45a1877e0c480d47073b435999"
Aug 05 17:30:13.652051 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:13.652035    2580 scope.go:117] "RemoveContainer" containerID="c7855f1afa9e69241dbf77723ccbaa7b8b5efab042ea1ccfe23782d62957cbfd"
Aug 05 17:30:13.659617 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:13.659594    2580 scope.go:117] "RemoveContainer" containerID="054b3dfc483d774164bcadea51a0b415848523e70a5a8559c62bd0149ca45d59"
Aug 05 17:30:13.659935 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:30:13.659918    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"054b3dfc483d774164bcadea51a0b415848523e70a5a8559c62bd0149ca45d59\": container with ID starting with 054b3dfc483d774164bcadea51a0b415848523e70a5a8559c62bd0149ca45d59 not found: ID does not exist" containerID="054b3dfc483d774164bcadea51a0b415848523e70a5a8559c62bd0149ca45d59"
Aug 05 17:30:13.660009 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:13.659948    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"054b3dfc483d774164bcadea51a0b415848523e70a5a8559c62bd0149ca45d59"} err="failed to get container status \"054b3dfc483d774164bcadea51a0b415848523e70a5a8559c62bd0149ca45d59\": rpc error: code = NotFound desc = could not find container \"054b3dfc483d774164bcadea51a0b415848523e70a5a8559c62bd0149ca45d59\": container with ID starting with 054b3dfc483d774164bcadea51a0b415848523e70a5a8559c62bd0149ca45d59 not found: ID does not exist"
Aug 05 17:30:13.660009 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:13.659967    2580 scope.go:117] "RemoveContainer" containerID="2838b94c9ead63aa5f44d5399c5a52596edc1b45a1877e0c480d47073b435999"
Aug 05 17:30:13.660198 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:30:13.660181    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2838b94c9ead63aa5f44d5399c5a52596edc1b45a1877e0c480d47073b435999\": container with ID starting with 2838b94c9ead63aa5f44d5399c5a52596edc1b45a1877e0c480d47073b435999 not found: ID does not exist" containerID="2838b94c9ead63aa5f44d5399c5a52596edc1b45a1877e0c480d47073b435999"
Aug 05 17:30:13.660241 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:13.660204    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2838b94c9ead63aa5f44d5399c5a52596edc1b45a1877e0c480d47073b435999"} err="failed to get container status \"2838b94c9ead63aa5f44d5399c5a52596edc1b45a1877e0c480d47073b435999\": rpc error: code = NotFound desc = could not find container \"2838b94c9ead63aa5f44d5399c5a52596edc1b45a1877e0c480d47073b435999\": container with ID starting with 2838b94c9ead63aa5f44d5399c5a52596edc1b45a1877e0c480d47073b435999 not found: ID does not exist"
Aug 05 17:30:13.660241 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:13.660222    2580 scope.go:117] "RemoveContainer" containerID="c7855f1afa9e69241dbf77723ccbaa7b8b5efab042ea1ccfe23782d62957cbfd"
Aug 05 17:30:13.660471 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:30:13.660453    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7855f1afa9e69241dbf77723ccbaa7b8b5efab042ea1ccfe23782d62957cbfd\": container with ID starting with c7855f1afa9e69241dbf77723ccbaa7b8b5efab042ea1ccfe23782d62957cbfd not found: ID does not exist" containerID="c7855f1afa9e69241dbf77723ccbaa7b8b5efab042ea1ccfe23782d62957cbfd"
Aug 05 17:30:13.660514 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:13.660474    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7855f1afa9e69241dbf77723ccbaa7b8b5efab042ea1ccfe23782d62957cbfd"} err="failed to get container status \"c7855f1afa9e69241dbf77723ccbaa7b8b5efab042ea1ccfe23782d62957cbfd\": rpc error: code = NotFound desc = could not find container \"c7855f1afa9e69241dbf77723ccbaa7b8b5efab042ea1ccfe23782d62957cbfd\": container with ID starting with c7855f1afa9e69241dbf77723ccbaa7b8b5efab042ea1ccfe23782d62957cbfd not found: ID does not exist"
Aug 05 17:30:13.661503 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:13.661485    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5"]
Aug 05 17:30:13.665603 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:13.665582    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-stop-predictor-6fcf5b6d4d-fhnw5"]
Aug 05 17:30:14.002564 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:14.002479    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb25b353-53b3-4768-8389-1f9cd5b6372a" path="/var/lib/kubelet/pods/cb25b353-53b3-4768-8389-1f9cd5b6372a/volumes"
Aug 05 17:30:18.127622 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:18.127573    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:18.450589 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:18.450485    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:18.554989 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:18.554955    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:18.960524 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:18.960491    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:19.170214 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:19.170172    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:28.421785 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:28.421753    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:28.519986 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:28.519950    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:28.555671 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:28.555638    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx"]
Aug 05 17:30:28.555926 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:28.555900    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx" podUID="a12885b1-256c-4763-b9e9-8c521ab957ee" containerName="kserve-container" containerID="cri-o://9bd7272a30e3a2eb3dcfc188c3a418e83a5d5b02e213b68f42ea6c6e319e8242" gracePeriod=30
Aug 05 17:30:28.556035 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:28.555943    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx" podUID="a12885b1-256c-4763-b9e9-8c521ab957ee" containerName="kube-rbac-proxy" containerID="cri-o://bab84b3c8a0efe4d32dc32f947c1d454fcb2491a71f53a10a4f6936591eba64a" gracePeriod=30
Aug 05 17:30:28.600774 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:28.600745    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:28.702769 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:28.702743    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:28.707420 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:28.707395    2580 generic.go:356] "Generic (PLEG): container finished" podID="a12885b1-256c-4763-b9e9-8c521ab957ee" containerID="bab84b3c8a0efe4d32dc32f947c1d454fcb2491a71f53a10a4f6936591eba64a" exitCode=2
Aug 05 17:30:28.707550 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:28.707441    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx" event={"ID":"a12885b1-256c-4763-b9e9-8c521ab957ee","Type":"ContainerDied","Data":"bab84b3c8a0efe4d32dc32f947c1d454fcb2491a71f53a10a4f6936591eba64a"}
Aug 05 17:30:28.997086 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:28.996985    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx" podUID="a12885b1-256c-4763-b9e9-8c521ab957ee" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Aug 05 17:30:32.220165 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:32.220114    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx" podUID="a12885b1-256c-4763-b9e9-8c521ab957ee" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.30:8643/healthz\": dial tcp 10.134.0.30:8643: connect: connection refused"
Aug 05 17:30:33.005059 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:33.005035    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx"
Aug 05 17:30:33.169095 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:33.169008    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a12885b1-256c-4763-b9e9-8c521ab957ee-kserve-provision-location\") pod \"a12885b1-256c-4763-b9e9-8c521ab957ee\" (UID: \"a12885b1-256c-4763-b9e9-8c521ab957ee\") "
Aug 05 17:30:33.169095 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:33.169057    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a12885b1-256c-4763-b9e9-8c521ab957ee-proxy-tls\") pod \"a12885b1-256c-4763-b9e9-8c521ab957ee\" (UID: \"a12885b1-256c-4763-b9e9-8c521ab957ee\") "
Aug 05 17:30:33.169095 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:33.169089    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a12885b1-256c-4763-b9e9-8c521ab957ee-cabundle-cert\") pod \"a12885b1-256c-4763-b9e9-8c521ab957ee\" (UID: \"a12885b1-256c-4763-b9e9-8c521ab957ee\") "
Aug 05 17:30:33.169364 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:33.169147    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqqfs\" (UniqueName: \"kubernetes.io/projected/a12885b1-256c-4763-b9e9-8c521ab957ee-kube-api-access-sqqfs\") pod \"a12885b1-256c-4763-b9e9-8c521ab957ee\" (UID: \"a12885b1-256c-4763-b9e9-8c521ab957ee\") "
Aug 05 17:30:33.169364 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:33.169279    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a12885b1-256c-4763-b9e9-8c521ab957ee-kube-rbac-proxy-sar-config\") pod \"a12885b1-256c-4763-b9e9-8c521ab957ee\" (UID: \"a12885b1-256c-4763-b9e9-8c521ab957ee\") "
Aug 05 17:30:33.169463 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:33.169376    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a12885b1-256c-4763-b9e9-8c521ab957ee-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "a12885b1-256c-4763-b9e9-8c521ab957ee" (UID: "a12885b1-256c-4763-b9e9-8c521ab957ee"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:30:33.169602 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:33.169574    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a12885b1-256c-4763-b9e9-8c521ab957ee-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "a12885b1-256c-4763-b9e9-8c521ab957ee" (UID: "a12885b1-256c-4763-b9e9-8c521ab957ee"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:30:33.169721 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:33.169642    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a12885b1-256c-4763-b9e9-8c521ab957ee-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "a12885b1-256c-4763-b9e9-8c521ab957ee" (UID: "a12885b1-256c-4763-b9e9-8c521ab957ee"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:30:33.169721 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:33.169683    2580 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a12885b1-256c-4763-b9e9-8c521ab957ee-kserve-provision-location\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\""
Aug 05 17:30:33.169721 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:33.169707    2580 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a12885b1-256c-4763-b9e9-8c521ab957ee-cabundle-cert\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\""
Aug 05 17:30:33.171340 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:33.171313    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a12885b1-256c-4763-b9e9-8c521ab957ee-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "a12885b1-256c-4763-b9e9-8c521ab957ee" (UID: "a12885b1-256c-4763-b9e9-8c521ab957ee"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:30:33.171430 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:33.171415    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a12885b1-256c-4763-b9e9-8c521ab957ee-kube-api-access-sqqfs" (OuterVolumeSpecName: "kube-api-access-sqqfs") pod "a12885b1-256c-4763-b9e9-8c521ab957ee" (UID: "a12885b1-256c-4763-b9e9-8c521ab957ee"). InnerVolumeSpecName "kube-api-access-sqqfs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:30:33.270698 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:33.270659    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqqfs\" (UniqueName: \"kubernetes.io/projected/a12885b1-256c-4763-b9e9-8c521ab957ee-kube-api-access-sqqfs\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\""
Aug 05 17:30:33.270698 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:33.270694    2580 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a12885b1-256c-4763-b9e9-8c521ab957ee-kube-rbac-proxy-sar-config\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\""
Aug 05 17:30:33.270698 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:33.270704    2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a12885b1-256c-4763-b9e9-8c521ab957ee-proxy-tls\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\""
Aug 05 17:30:33.734825 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:33.734791    2580 generic.go:356] "Generic (PLEG): container finished" podID="a12885b1-256c-4763-b9e9-8c521ab957ee" containerID="9bd7272a30e3a2eb3dcfc188c3a418e83a5d5b02e213b68f42ea6c6e319e8242" exitCode=0
Aug 05 17:30:33.734998 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:33.734856    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx"
Aug 05 17:30:33.734998 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:33.734879    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx" event={"ID":"a12885b1-256c-4763-b9e9-8c521ab957ee","Type":"ContainerDied","Data":"9bd7272a30e3a2eb3dcfc188c3a418e83a5d5b02e213b68f42ea6c6e319e8242"}
Aug 05 17:30:33.734998 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:33.734940    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx" event={"ID":"a12885b1-256c-4763-b9e9-8c521ab957ee","Type":"ContainerDied","Data":"9bfd6f4310039943a2491664540688c11a6f0826fa800b1d233ff2b785fb7528"}
Aug 05 17:30:33.734998 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:33.734967    2580 scope.go:117] "RemoveContainer" containerID="bab84b3c8a0efe4d32dc32f947c1d454fcb2491a71f53a10a4f6936591eba64a"
Aug 05 17:30:33.744250 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:33.744235    2580 scope.go:117] "RemoveContainer" containerID="9bd7272a30e3a2eb3dcfc188c3a418e83a5d5b02e213b68f42ea6c6e319e8242"
Aug 05 17:30:33.751603 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:33.751578    2580 scope.go:117] "RemoveContainer" containerID="3b05483f15c2247d4157bf6be9b88e2fde3e886d6669eb81f4b76b57097dcc17"
Aug 05 17:30:33.758388 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:33.758366    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx"]
Aug 05 17:30:33.759451 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:33.759432    2580 scope.go:117] "RemoveContainer" containerID="bab84b3c8a0efe4d32dc32f947c1d454fcb2491a71f53a10a4f6936591eba64a"
Aug 05 17:30:33.759727 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:30:33.759707    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bab84b3c8a0efe4d32dc32f947c1d454fcb2491a71f53a10a4f6936591eba64a\": container with ID starting with bab84b3c8a0efe4d32dc32f947c1d454fcb2491a71f53a10a4f6936591eba64a not found: ID does not exist" containerID="bab84b3c8a0efe4d32dc32f947c1d454fcb2491a71f53a10a4f6936591eba64a"
Aug 05 17:30:33.759779 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:33.759735    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bab84b3c8a0efe4d32dc32f947c1d454fcb2491a71f53a10a4f6936591eba64a"} err="failed to get container status \"bab84b3c8a0efe4d32dc32f947c1d454fcb2491a71f53a10a4f6936591eba64a\": rpc error: code = NotFound desc = could not find container \"bab84b3c8a0efe4d32dc32f947c1d454fcb2491a71f53a10a4f6936591eba64a\": container with ID starting with bab84b3c8a0efe4d32dc32f947c1d454fcb2491a71f53a10a4f6936591eba64a not found: ID does not exist"
Aug 05 17:30:33.759779 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:33.759752    2580 scope.go:117] "RemoveContainer" containerID="9bd7272a30e3a2eb3dcfc188c3a418e83a5d5b02e213b68f42ea6c6e319e8242"
Aug 05 17:30:33.760032 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:30:33.759985    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bd7272a30e3a2eb3dcfc188c3a418e83a5d5b02e213b68f42ea6c6e319e8242\": container with ID starting with 9bd7272a30e3a2eb3dcfc188c3a418e83a5d5b02e213b68f42ea6c6e319e8242 not found: ID does not exist" containerID="9bd7272a30e3a2eb3dcfc188c3a418e83a5d5b02e213b68f42ea6c6e319e8242"
Aug 05 17:30:33.760032 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:33.760011    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bd7272a30e3a2eb3dcfc188c3a418e83a5d5b02e213b68f42ea6c6e319e8242"} err="failed to get container status \"9bd7272a30e3a2eb3dcfc188c3a418e83a5d5b02e213b68f42ea6c6e319e8242\": rpc error: code = NotFound desc = could not find container \"9bd7272a30e3a2eb3dcfc188c3a418e83a5d5b02e213b68f42ea6c6e319e8242\": container with ID starting with 9bd7272a30e3a2eb3dcfc188c3a418e83a5d5b02e213b68f42ea6c6e319e8242 not found: ID does not exist"
Aug 05 17:30:33.760175 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:33.760033    2580 scope.go:117] "RemoveContainer" containerID="3b05483f15c2247d4157bf6be9b88e2fde3e886d6669eb81f4b76b57097dcc17"
Aug 05 17:30:33.760276 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:30:33.760256    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b05483f15c2247d4157bf6be9b88e2fde3e886d6669eb81f4b76b57097dcc17\": container with ID starting with 3b05483f15c2247d4157bf6be9b88e2fde3e886d6669eb81f4b76b57097dcc17 not found: ID does not exist" containerID="3b05483f15c2247d4157bf6be9b88e2fde3e886d6669eb81f4b76b57097dcc17"
Aug 05 17:30:33.760350 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:33.760281    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b05483f15c2247d4157bf6be9b88e2fde3e886d6669eb81f4b76b57097dcc17"} err="failed to get container status \"3b05483f15c2247d4157bf6be9b88e2fde3e886d6669eb81f4b76b57097dcc17\": rpc error: code = NotFound desc = could not find container \"3b05483f15c2247d4157bf6be9b88e2fde3e886d6669eb81f4b76b57097dcc17\": container with ID starting with 3b05483f15c2247d4157bf6be9b88e2fde3e886d6669eb81f4b76b57097dcc17 not found: ID does not exist"
Aug 05 17:30:33.762680 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:33.762662    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-f37da-predictor-5ccd78bf7-875mx"]
Aug 05 17:30:34.002122 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:34.002048    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a12885b1-256c-4763-b9e9-8c521ab957ee" path="/var/lib/kubelet/pods/a12885b1-256c-4763-b9e9-8c521ab957ee/volumes"
Aug 05 17:30:38.637921 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:38.637844    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:38.903288 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:38.903172    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:57.891737 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:57.891703    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:30:57.958761 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:30:57.958731    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:31:08.540034 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:31:08.539996    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:31:08.630925 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:31:08.630898    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:31:08.731432 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:31:08.731394    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:32:03.553280 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:03.553191    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:32:03.582662 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:03.582631    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb"]
Aug 05 17:32:03.583010 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:03.582998    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb25b353-53b3-4768-8389-1f9cd5b6372a" containerName="kube-rbac-proxy"
Aug 05 17:32:03.583049 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:03.583012    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb25b353-53b3-4768-8389-1f9cd5b6372a" containerName="kube-rbac-proxy"
Aug 05 17:32:03.583049 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:03.583024    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb25b353-53b3-4768-8389-1f9cd5b6372a" containerName="storage-initializer"
Aug 05 17:32:03.583049 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:03.583029    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb25b353-53b3-4768-8389-1f9cd5b6372a" containerName="storage-initializer"
Aug 05 17:32:03.583049 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:03.583042    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a12885b1-256c-4763-b9e9-8c521ab957ee" containerName="kube-rbac-proxy"
Aug 05 17:32:03.583049 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:03.583047    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a12885b1-256c-4763-b9e9-8c521ab957ee" containerName="kube-rbac-proxy"
Aug 05 17:32:03.583197 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:03.583057    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb25b353-53b3-4768-8389-1f9cd5b6372a" containerName="kserve-container"
Aug 05 17:32:03.583197 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:03.583062    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb25b353-53b3-4768-8389-1f9cd5b6372a" containerName="kserve-container"
Aug 05 17:32:03.583197 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:03.583070    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a12885b1-256c-4763-b9e9-8c521ab957ee" containerName="kserve-container"
Aug 05 17:32:03.583197 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:03.583075    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a12885b1-256c-4763-b9e9-8c521ab957ee" containerName="kserve-container"
Aug 05 17:32:03.583197 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:03.583087    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a12885b1-256c-4763-b9e9-8c521ab957ee" containerName="storage-initializer"
Aug 05 17:32:03.583197 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:03.583091    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a12885b1-256c-4763-b9e9-8c521ab957ee" containerName="storage-initializer"
Aug 05 17:32:03.583197 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:03.583142    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a12885b1-256c-4763-b9e9-8c521ab957ee" containerName="kube-rbac-proxy"
Aug 05 17:32:03.583197 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:03.583151    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a12885b1-256c-4763-b9e9-8c521ab957ee" containerName="kserve-container"
Aug 05 17:32:03.583197 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:03.583163    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb25b353-53b3-4768-8389-1f9cd5b6372a" containerName="kserve-container"
Aug 05 17:32:03.583197 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:03.583173    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb25b353-53b3-4768-8389-1f9cd5b6372a" containerName="kube-rbac-proxy"
Aug 05 17:32:03.586504 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:03.586490    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb"
Aug 05 17:32:03.588763 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:03.588731    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-secondary-d2f65d-kube-rbac-proxy-sar-config\""
Aug 05 17:32:03.588763 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:03.588755    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Aug 05 17:32:03.588931 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:03.588733    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-secondary-d2f65d-predictor-serving-cert\""
Aug 05 17:32:03.588931 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:03.588814    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"invalid-s3-secret-d2f65d\""
Aug 05 17:32:03.588931 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:03.588882    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"invalid-s3-sa-d2f65d-dockercfg-66vsq\""
Aug 05 17:32:03.589121 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:03.589107    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Aug 05 17:32:03.589576 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:03.589543    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Aug 05 17:32:03.597606 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:03.597587    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb"]
Aug 05 17:32:03.711396 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:03.711361    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c353ea9c-ae87-47ba-adf6-a424ebc56c25-kserve-provision-location\") pod \"isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb\" (UID: \"c353ea9c-ae87-47ba-adf6-a424ebc56c25\") " pod="kserve-ci-e2e-test/isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb"
Aug 05 17:32:03.711577 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:03.711402    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-294cc\" (UniqueName: \"kubernetes.io/projected/c353ea9c-ae87-47ba-adf6-a424ebc56c25-kube-api-access-294cc\") pod \"isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb\" (UID: \"c353ea9c-ae87-47ba-adf6-a424ebc56c25\") " pod="kserve-ci-e2e-test/isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb"
Aug 05 17:32:03.711577 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:03.711421    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c353ea9c-ae87-47ba-adf6-a424ebc56c25-cabundle-cert\") pod \"isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb\" (UID: \"c353ea9c-ae87-47ba-adf6-a424ebc56c25\") " pod="kserve-ci-e2e-test/isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb"
Aug 05 17:32:03.711577 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:03.711467    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c353ea9c-ae87-47ba-adf6-a424ebc56c25-proxy-tls\") pod \"isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb\" (UID: \"c353ea9c-ae87-47ba-adf6-a424ebc56c25\") " pod="kserve-ci-e2e-test/isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb"
Aug 05 17:32:03.711577 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:03.711510    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c353ea9c-ae87-47ba-adf6-a424ebc56c25-kube-rbac-proxy-sar-config\") pod \"isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb\" (UID: \"c353ea9c-ae87-47ba-adf6-a424ebc56c25\") " pod="kserve-ci-e2e-test/isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb"
Aug 05 17:32:03.812834 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:03.812807    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c353ea9c-ae87-47ba-adf6-a424ebc56c25-kube-rbac-proxy-sar-config\") pod \"isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb\" (UID: \"c353ea9c-ae87-47ba-adf6-a424ebc56c25\") " pod="kserve-ci-e2e-test/isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb"
Aug 05 17:32:03.812953 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:03.812852    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c353ea9c-ae87-47ba-adf6-a424ebc56c25-kserve-provision-location\") pod \"isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb\" (UID: \"c353ea9c-ae87-47ba-adf6-a424ebc56c25\") " pod="kserve-ci-e2e-test/isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb"
Aug 05 17:32:03.812953 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:03.812880    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-294cc\" (UniqueName: \"kubernetes.io/projected/c353ea9c-ae87-47ba-adf6-a424ebc56c25-kube-api-access-294cc\") pod \"isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb\" (UID: \"c353ea9c-ae87-47ba-adf6-a424ebc56c25\") " pod="kserve-ci-e2e-test/isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb"
Aug 05 17:32:03.812953 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:03.812898    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c353ea9c-ae87-47ba-adf6-a424ebc56c25-cabundle-cert\") pod \"isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb\" (UID: \"c353ea9c-ae87-47ba-adf6-a424ebc56c25\") " pod="kserve-ci-e2e-test/isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb"
Aug 05 17:32:03.812953 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:03.812921    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c353ea9c-ae87-47ba-adf6-a424ebc56c25-proxy-tls\") pod \"isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb\" (UID: \"c353ea9c-ae87-47ba-adf6-a424ebc56c25\") " pod="kserve-ci-e2e-test/isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb"
Aug 05 17:32:03.813127 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:32:03.813026    2580 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-secondary-d2f65d-predictor-serving-cert: secret "isvc-secondary-d2f65d-predictor-serving-cert" not found
Aug 05 17:32:03.813127 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:32:03.813096    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c353ea9c-ae87-47ba-adf6-a424ebc56c25-proxy-tls podName:c353ea9c-ae87-47ba-adf6-a424ebc56c25 nodeName:}" failed. No retries permitted until 2026-08-05 17:32:04.313077326 +0000 UTC m=+1158.881579744 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/c353ea9c-ae87-47ba-adf6-a424ebc56c25-proxy-tls") pod "isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb" (UID: "c353ea9c-ae87-47ba-adf6-a424ebc56c25") : secret "isvc-secondary-d2f65d-predictor-serving-cert" not found
Aug 05 17:32:03.813440 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:03.813421    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c353ea9c-ae87-47ba-adf6-a424ebc56c25-kube-rbac-proxy-sar-config\") pod \"isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb\" (UID: \"c353ea9c-ae87-47ba-adf6-a424ebc56c25\") " pod="kserve-ci-e2e-test/isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb"
Aug 05 17:32:03.813548 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:03.813529    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c353ea9c-ae87-47ba-adf6-a424ebc56c25-cabundle-cert\") pod \"isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb\" (UID: \"c353ea9c-ae87-47ba-adf6-a424ebc56c25\") " pod="kserve-ci-e2e-test/isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb"
Aug 05 17:32:03.813700 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:03.813680    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c353ea9c-ae87-47ba-adf6-a424ebc56c25-kserve-provision-location\") pod \"isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb\" (UID: \"c353ea9c-ae87-47ba-adf6-a424ebc56c25\") " pod="kserve-ci-e2e-test/isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb"
Aug 05 17:32:03.823836 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:03.823814    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-294cc\" (UniqueName: \"kubernetes.io/projected/c353ea9c-ae87-47ba-adf6-a424ebc56c25-kube-api-access-294cc\") pod \"isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb\" (UID: \"c353ea9c-ae87-47ba-adf6-a424ebc56c25\") " pod="kserve-ci-e2e-test/isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb"
Aug 05 17:32:03.905610 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:03.905550    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:32:04.317856 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:04.317823    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c353ea9c-ae87-47ba-adf6-a424ebc56c25-proxy-tls\") pod \"isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb\" (UID: \"c353ea9c-ae87-47ba-adf6-a424ebc56c25\") " pod="kserve-ci-e2e-test/isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb"
Aug 05 17:32:04.320278 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:04.320259    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c353ea9c-ae87-47ba-adf6-a424ebc56c25-proxy-tls\") pod \"isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb\" (UID: \"c353ea9c-ae87-47ba-adf6-a424ebc56c25\") " pod="kserve-ci-e2e-test/isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb"
Aug 05 17:32:04.496705 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:04.496671    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb"
Aug 05 17:32:04.632599 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:04.632574    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb"]
Aug 05 17:32:04.634573 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:32:04.634533    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc353ea9c_ae87_47ba_adf6_a424ebc56c25.slice/crio-093c4772d8485a6467b68076607d0864a551b46c06f997c33ea593ea4f2075ce WatchSource:0}: Error finding container 093c4772d8485a6467b68076607d0864a551b46c06f997c33ea593ea4f2075ce: Status 404 returned error can't find the container with id 093c4772d8485a6467b68076607d0864a551b46c06f997c33ea593ea4f2075ce
Aug 05 17:32:05.150500 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:05.150468    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb" event={"ID":"c353ea9c-ae87-47ba-adf6-a424ebc56c25","Type":"ContainerStarted","Data":"bc387dcd89c380918fbd42e16b21dcb7a94aaa3548eb5c7a876c608eb02f4629"}
Aug 05 17:32:05.150700 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:05.150536    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb" event={"ID":"c353ea9c-ae87-47ba-adf6-a424ebc56c25","Type":"ContainerStarted","Data":"093c4772d8485a6467b68076607d0864a551b46c06f997c33ea593ea4f2075ce"}
Aug 05 17:32:11.179321 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:11.179293    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb_c353ea9c-ae87-47ba-adf6-a424ebc56c25/storage-initializer/0.log"
Aug 05 17:32:11.179727 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:11.179329    2580 generic.go:356] "Generic (PLEG): container finished" podID="c353ea9c-ae87-47ba-adf6-a424ebc56c25" containerID="bc387dcd89c380918fbd42e16b21dcb7a94aaa3548eb5c7a876c608eb02f4629" exitCode=1
Aug 05 17:32:11.179727 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:11.179412    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb" event={"ID":"c353ea9c-ae87-47ba-adf6-a424ebc56c25","Type":"ContainerDied","Data":"bc387dcd89c380918fbd42e16b21dcb7a94aaa3548eb5c7a876c608eb02f4629"}
Aug 05 17:32:12.186222 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:12.186193    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb_c353ea9c-ae87-47ba-adf6-a424ebc56c25/storage-initializer/0.log"
Aug 05 17:32:12.186629 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:12.186240    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb" event={"ID":"c353ea9c-ae87-47ba-adf6-a424ebc56c25","Type":"ContainerStarted","Data":"394c1af1fc48206dd1a0825b667077ef593dec4848776dc5467de11726e2feb9"}
Aug 05 17:32:13.864100 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:13.864060    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:32:13.910666 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:13.910633    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts"]
Aug 05 17:32:13.914301 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:13.914279    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts"
Aug 05 17:32:13.916984 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:13.916962    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-h9rpc\""
Aug 05 17:32:13.917120 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:13.917004    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-scale-raw-606ec-predictor-serving-cert\""
Aug 05 17:32:13.917120 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:13.917066    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Aug 05 17:32:13.917120 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:13.917083    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-scale-raw-606ec-kube-rbac-proxy-sar-config\""
Aug 05 17:32:13.925242 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:13.925219    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts"]
Aug 05 17:32:13.951219 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:13.951189    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:32:14.002313 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:14.002277    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c-cabundle-cert\") pod \"isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts\" (UID: \"cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c\") " pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts"
Aug 05 17:32:14.002313 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:14.002319    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c-proxy-tls\") pod \"isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts\" (UID: \"cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c\") " pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts"
Aug 05 17:32:14.002575 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:14.002367    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h548w\" (UniqueName: \"kubernetes.io/projected/cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c-kube-api-access-h548w\") pod \"isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts\" (UID: \"cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c\") " pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts"
Aug 05 17:32:14.002575 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:14.002420    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c-kserve-provision-location\") pod \"isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts\" (UID: \"cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c\") " pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts"
Aug 05 17:32:14.002575 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:14.002458    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts\" (UID: \"cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c\") " pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts"
Aug 05 17:32:14.103634 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:14.103597    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h548w\" (UniqueName: \"kubernetes.io/projected/cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c-kube-api-access-h548w\") pod \"isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts\" (UID: \"cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c\") " pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts"
Aug 05 17:32:14.103804 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:14.103652    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c-kserve-provision-location\") pod \"isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts\" (UID: \"cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c\") " pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts"
Aug 05 17:32:14.103804 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:14.103688    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts\" (UID: \"cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c\") " pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts"
Aug 05 17:32:14.103804 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:14.103732    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c-cabundle-cert\") pod \"isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts\" (UID: \"cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c\") " pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts"
Aug 05 17:32:14.103804 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:14.103757    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c-proxy-tls\") pod \"isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts\" (UID: \"cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c\") " pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts"
Aug 05 17:32:14.103984 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:32:14.103858    2580 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-serving-cert: secret "isvc-sklearn-scale-raw-606ec-predictor-serving-cert" not found
Aug 05 17:32:14.104034 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:32:14.103954    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c-proxy-tls podName:cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c nodeName:}" failed. No retries permitted until 2026-08-05 17:32:14.603915459 +0000 UTC m=+1169.172417872 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c-proxy-tls") pod "isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts" (UID: "cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c") : secret "isvc-sklearn-scale-raw-606ec-predictor-serving-cert" not found
Aug 05 17:32:14.104156 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:14.104137    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c-kserve-provision-location\") pod \"isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts\" (UID: \"cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c\") " pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts"
Aug 05 17:32:14.104365 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:14.104350    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts\" (UID: \"cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c\") " pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts"
Aug 05 17:32:14.104402 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:14.104385    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c-cabundle-cert\") pod \"isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts\" (UID: \"cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c\") " pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts"
Aug 05 17:32:14.112716 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:14.112694    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h548w\" (UniqueName: \"kubernetes.io/projected/cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c-kube-api-access-h548w\") pod \"isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts\" (UID: \"cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c\") " pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts"
Aug 05 17:32:14.608700 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:14.608663    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c-proxy-tls\") pod \"isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts\" (UID: \"cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c\") " pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts"
Aug 05 17:32:14.608902 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:32:14.608847    2580 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-serving-cert: secret "isvc-sklearn-scale-raw-606ec-predictor-serving-cert" not found
Aug 05 17:32:14.608947 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:32:14.608922    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c-proxy-tls podName:cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c nodeName:}" failed. No retries permitted until 2026-08-05 17:32:15.608907398 +0000 UTC m=+1170.177409799 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c-proxy-tls") pod "isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts" (UID: "cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c") : secret "isvc-sklearn-scale-raw-606ec-predictor-serving-cert" not found
Aug 05 17:32:14.736004 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:14.735969    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:32:15.618348 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:15.618298    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c-proxy-tls\") pod \"isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts\" (UID: \"cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c\") " pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts"
Aug 05 17:32:15.620918 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:15.620892    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c-proxy-tls\") pod \"isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts\" (UID: \"cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c\") " pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts"
Aug 05 17:32:15.725858 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:15.725824    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts"
Aug 05 17:32:15.861449 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:15.861414    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts"]
Aug 05 17:32:15.865143 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:32:15.865111    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd6cfc4a_68b5_41e6_a81b_ced99a9cc21c.slice/crio-91b717960ad02cd61877096dc1fd864750b3adc1a269d249ea317f6ebbb00ba3 WatchSource:0}: Error finding container 91b717960ad02cd61877096dc1fd864750b3adc1a269d249ea317f6ebbb00ba3: Status 404 returned error can't find the container with id 91b717960ad02cd61877096dc1fd864750b3adc1a269d249ea317f6ebbb00ba3
Aug 05 17:32:16.207704 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:16.207621    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts" event={"ID":"cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c","Type":"ContainerStarted","Data":"ca546fd1b21f7a162de95d7d20e6f55d6a9e251ab8905757072b22c18db19eda"}
Aug 05 17:32:16.207704 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:16.207695    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts" event={"ID":"cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c","Type":"ContainerStarted","Data":"91b717960ad02cd61877096dc1fd864750b3adc1a269d249ea317f6ebbb00ba3"}
Aug 05 17:32:17.214746 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:17.214720    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb_c353ea9c-ae87-47ba-adf6-a424ebc56c25/storage-initializer/1.log"
Aug 05 17:32:17.215194 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:17.215094    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb_c353ea9c-ae87-47ba-adf6-a424ebc56c25/storage-initializer/0.log"
Aug 05 17:32:17.215194 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:17.215125    2580 generic.go:356] "Generic (PLEG): container finished" podID="c353ea9c-ae87-47ba-adf6-a424ebc56c25" containerID="394c1af1fc48206dd1a0825b667077ef593dec4848776dc5467de11726e2feb9" exitCode=1
Aug 05 17:32:17.215259 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:17.215204    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb" event={"ID":"c353ea9c-ae87-47ba-adf6-a424ebc56c25","Type":"ContainerDied","Data":"394c1af1fc48206dd1a0825b667077ef593dec4848776dc5467de11726e2feb9"}
Aug 05 17:32:17.215302 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:17.215278    2580 scope.go:117] "RemoveContainer" containerID="bc387dcd89c380918fbd42e16b21dcb7a94aaa3548eb5c7a876c608eb02f4629"
Aug 05 17:32:17.215807 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:17.215792    2580 scope.go:117] "RemoveContainer" containerID="bc387dcd89c380918fbd42e16b21dcb7a94aaa3548eb5c7a876c608eb02f4629"
Aug 05 17:32:17.225903 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:32:17.225877    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"storage-initializer\" with CrashLoopBackOff: \"back-off 10s restarting failed container=storage-initializer pod=isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb_kserve-ci-e2e-test(c353ea9c-ae87-47ba-adf6-a424ebc56c25)\"" pod="kserve-ci-e2e-test/isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb" podUID="c353ea9c-ae87-47ba-adf6-a424ebc56c25"
Aug 05 17:32:17.226064 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:32:17.226040    2580 log.go:32] "RemoveContainer from runtime service failed" err="rpc error: code = Unknown desc = failed to delete container k8s_storage-initializer_isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb_kserve-ci-e2e-test_c353ea9c-ae87-47ba-adf6-a424ebc56c25_0 in pod sandbox 093c4772d8485a6467b68076607d0864a551b46c06f997c33ea593ea4f2075ce from index: no such id: 'bc387dcd89c380918fbd42e16b21dcb7a94aaa3548eb5c7a876c608eb02f4629'" containerID="bc387dcd89c380918fbd42e16b21dcb7a94aaa3548eb5c7a876c608eb02f4629"
Aug 05 17:32:17.226130 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:17.226088    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc387dcd89c380918fbd42e16b21dcb7a94aaa3548eb5c7a876c608eb02f4629"} err="rpc error: code = Unknown desc = failed to delete container k8s_storage-initializer_isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb_kserve-ci-e2e-test_c353ea9c-ae87-47ba-adf6-a424ebc56c25_0 in pod sandbox 093c4772d8485a6467b68076607d0864a551b46c06f997c33ea593ea4f2075ce from index: no such id: 'bc387dcd89c380918fbd42e16b21dcb7a94aaa3548eb5c7a876c608eb02f4629'"
Aug 05 17:32:18.221383 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:18.221355    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb_c353ea9c-ae87-47ba-adf6-a424ebc56c25/storage-initializer/1.log"
Aug 05 17:32:20.231416 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:20.231384    2580 generic.go:356] "Generic (PLEG): container finished" podID="cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c" containerID="ca546fd1b21f7a162de95d7d20e6f55d6a9e251ab8905757072b22c18db19eda" exitCode=0
Aug 05 17:32:20.231816 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:20.231425    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts" event={"ID":"cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c","Type":"ContainerDied","Data":"ca546fd1b21f7a162de95d7d20e6f55d6a9e251ab8905757072b22c18db19eda"}
Aug 05 17:32:21.238230 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:21.238195    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts" event={"ID":"cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c","Type":"ContainerStarted","Data":"0511914329ef6bc7729bf97a9ddec8c18b3b9f37c23bb988ac155bf65a8024d9"}
Aug 05 17:32:21.238631 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:21.238265    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts" event={"ID":"cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c","Type":"ContainerStarted","Data":"4587873ec8937b2ecfef6f514a91f6894aaf61ca1b53a800918cfdea5dd682e8"}
Aug 05 17:32:21.238631 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:21.238461    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts"
Aug 05 17:32:21.260297 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:21.260242    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts" podStartSLOduration=4.483932659 podStartE2EDuration="8.260224372s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.776291713s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:32:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:32:21.259080296 +0000 UTC m=+1175.827582719" watchObservedRunningTime="2026-08-05 17:32:21.260224372 +0000 UTC m=+1175.828726794"
Aug 05 17:32:21.636757 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:21.636709    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb"]
Aug 05 17:32:21.660119 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:21.660089    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:32:21.729862 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:21.729833    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:32:21.773360 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:21.773339    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb_c353ea9c-ae87-47ba-adf6-a424ebc56c25/storage-initializer/1.log"
Aug 05 17:32:21.775442 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:21.775427    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb"
Aug 05 17:32:21.869626 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:21.869583    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c353ea9c-ae87-47ba-adf6-a424ebc56c25-cabundle-cert\") pod \"c353ea9c-ae87-47ba-adf6-a424ebc56c25\" (UID: \"c353ea9c-ae87-47ba-adf6-a424ebc56c25\") "
Aug 05 17:32:21.869816 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:21.869662    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c353ea9c-ae87-47ba-adf6-a424ebc56c25-kube-rbac-proxy-sar-config\") pod \"c353ea9c-ae87-47ba-adf6-a424ebc56c25\" (UID: \"c353ea9c-ae87-47ba-adf6-a424ebc56c25\") "
Aug 05 17:32:21.869816 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:21.869696    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c353ea9c-ae87-47ba-adf6-a424ebc56c25-kserve-provision-location\") pod \"c353ea9c-ae87-47ba-adf6-a424ebc56c25\" (UID: \"c353ea9c-ae87-47ba-adf6-a424ebc56c25\") "
Aug 05 17:32:21.869816 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:21.869774    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c353ea9c-ae87-47ba-adf6-a424ebc56c25-proxy-tls\") pod \"c353ea9c-ae87-47ba-adf6-a424ebc56c25\" (UID: \"c353ea9c-ae87-47ba-adf6-a424ebc56c25\") "
Aug 05 17:32:21.869816 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:21.869805    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-294cc\" (UniqueName: \"kubernetes.io/projected/c353ea9c-ae87-47ba-adf6-a424ebc56c25-kube-api-access-294cc\") pod \"c353ea9c-ae87-47ba-adf6-a424ebc56c25\" (UID: \"c353ea9c-ae87-47ba-adf6-a424ebc56c25\") "
Aug 05 17:32:21.870022 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:21.869840    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c353ea9c-ae87-47ba-adf6-a424ebc56c25-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "c353ea9c-ae87-47ba-adf6-a424ebc56c25" (UID: "c353ea9c-ae87-47ba-adf6-a424ebc56c25"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:32:21.870022 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:21.869997    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c353ea9c-ae87-47ba-adf6-a424ebc56c25-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "c353ea9c-ae87-47ba-adf6-a424ebc56c25" (UID: "c353ea9c-ae87-47ba-adf6-a424ebc56c25"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:32:21.870093 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:21.870022    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c353ea9c-ae87-47ba-adf6-a424ebc56c25-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "c353ea9c-ae87-47ba-adf6-a424ebc56c25" (UID: "c353ea9c-ae87-47ba-adf6-a424ebc56c25"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:32:21.870127 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:21.870116    2580 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c353ea9c-ae87-47ba-adf6-a424ebc56c25-cabundle-cert\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\""
Aug 05 17:32:21.870160 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:21.870136    2580 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c353ea9c-ae87-47ba-adf6-a424ebc56c25-kube-rbac-proxy-sar-config\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\""
Aug 05 17:32:21.870160 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:21.870150    2580 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c353ea9c-ae87-47ba-adf6-a424ebc56c25-kserve-provision-location\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\""
Aug 05 17:32:21.872005 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:21.871982    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c353ea9c-ae87-47ba-adf6-a424ebc56c25-kube-api-access-294cc" (OuterVolumeSpecName: "kube-api-access-294cc") pod "c353ea9c-ae87-47ba-adf6-a424ebc56c25" (UID: "c353ea9c-ae87-47ba-adf6-a424ebc56c25"). InnerVolumeSpecName "kube-api-access-294cc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:32:21.872100 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:21.872016    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c353ea9c-ae87-47ba-adf6-a424ebc56c25-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "c353ea9c-ae87-47ba-adf6-a424ebc56c25" (UID: "c353ea9c-ae87-47ba-adf6-a424ebc56c25"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:32:21.971159 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:21.971063    2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c353ea9c-ae87-47ba-adf6-a424ebc56c25-proxy-tls\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\""
Aug 05 17:32:21.971159 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:21.971101    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-294cc\" (UniqueName: \"kubernetes.io/projected/c353ea9c-ae87-47ba-adf6-a424ebc56c25-kube-api-access-294cc\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\""
Aug 05 17:32:22.244151 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:22.244079    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb_c353ea9c-ae87-47ba-adf6-a424ebc56c25/storage-initializer/1.log"
Aug 05 17:32:22.244654 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:22.244180    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb"
Aug 05 17:32:22.244654 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:22.244209    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb" event={"ID":"c353ea9c-ae87-47ba-adf6-a424ebc56c25","Type":"ContainerDied","Data":"093c4772d8485a6467b68076607d0864a551b46c06f997c33ea593ea4f2075ce"}
Aug 05 17:32:22.244654 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:22.244275    2580 scope.go:117] "RemoveContainer" containerID="394c1af1fc48206dd1a0825b667077ef593dec4848776dc5467de11726e2feb9"
Aug 05 17:32:22.244850 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:22.244816    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts"
Aug 05 17:32:22.246605 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:22.246576    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts" podUID="cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Aug 05 17:32:22.282769 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:22.282729    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb"]
Aug 05 17:32:22.286617 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:22.286588    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-secondary-d2f65d-predictor-8684c68fdc-zjzbb"]
Aug 05 17:32:23.251473 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:23.251430    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts" podUID="cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Aug 05 17:32:24.002993 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:24.002959    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c353ea9c-ae87-47ba-adf6-a424ebc56c25" path="/var/lib/kubelet/pods/c353ea9c-ae87-47ba-adf6-a424ebc56c25/volumes"
Aug 05 17:32:26.826116 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:26.826081    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:32:27.153465 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:27.153387    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:32:28.256361 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:28.256326    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts"
Aug 05 17:32:28.257004 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:28.256975    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts" podUID="cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Aug 05 17:32:31.870053 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:31.870018    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:32:37.042615 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:37.042581    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:32:37.182674 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:37.182634    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:32:38.257317 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:38.257273    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts" podUID="cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Aug 05 17:32:45.859573 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:45.859523    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-cqj2n_17a2b686-e228-4d00-9656-8b03b65f2e29/console-operator/1.log"
Aug 05 17:32:45.863776 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:45.863753    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-cqj2n_17a2b686-e228-4d00-9656-8b03b65f2e29/console-operator/1.log"
Aug 05 17:32:45.867261 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:45.867236    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q69wj_d8e22937-0209-4cf9-b262-dacb99128703/ovn-acl-logging/0.log"
Aug 05 17:32:45.871060 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:45.871038    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q69wj_d8e22937-0209-4cf9-b262-dacb99128703/ovn-acl-logging/0.log"
Aug 05 17:32:48.256999 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:48.256953    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts" podUID="cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Aug 05 17:32:58.257002 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:32:58.256956    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts" podUID="cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Aug 05 17:33:08.257671 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:33:08.257614    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts" podUID="cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Aug 05 17:33:18.257650 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:33:18.257601    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts" podUID="cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Aug 05 17:33:28.257371 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:33:28.257324    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts" podUID="cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Aug 05 17:33:38.257202 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:33:38.257115    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts" podUID="cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Aug 05 17:33:41.142838 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:33:41.142790    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:33:43.997682 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:33:43.997625    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts" podUID="cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Aug 05 17:33:53.998220 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:33:53.998159    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts" podUID="cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Aug 05 17:34:03.998093 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:34:03.998042    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts" podUID="cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Aug 05 17:34:07.242945 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:34:07.242907    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:34:12.310367 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:34:12.310329    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:34:12.559049 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:34:12.559009    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:34:13.997615 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:34:13.997550    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts" podUID="cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Aug 05 17:34:23.998221 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:34:23.998171    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts" podUID="cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Aug 05 17:34:33.997760 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:34:33.997720    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts" podUID="cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Aug 05 17:34:43.997674 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:34:43.997622    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts" podUID="cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Aug 05 17:34:53.998100 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:34:53.998052    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts" podUID="cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Aug 05 17:35:04.002263 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:04.002231    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts"
Aug 05 17:35:14.069153 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:14.069118    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts"]
Aug 05 17:35:14.069670 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:14.069353    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts" podUID="cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c" containerName="kserve-container" containerID="cri-o://4587873ec8937b2ecfef6f514a91f6894aaf61ca1b53a800918cfdea5dd682e8" gracePeriod=30
Aug 05 17:35:14.069670 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:14.069393    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts" podUID="cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c" containerName="kube-rbac-proxy" containerID="cri-o://0511914329ef6bc7729bf97a9ddec8c18b3b9f37c23bb988ac155bf65a8024d9" gracePeriod=30
Aug 05 17:35:14.094181 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:14.094148    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:35:15.081020 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:15.080982    2580 generic.go:356] "Generic (PLEG): container finished" podID="cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c" containerID="0511914329ef6bc7729bf97a9ddec8c18b3b9f37c23bb988ac155bf65a8024d9" exitCode=2
Aug 05 17:35:15.081392 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:15.081050    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts" event={"ID":"cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c","Type":"ContainerDied","Data":"0511914329ef6bc7729bf97a9ddec8c18b3b9f37c23bb988ac155bf65a8024d9"}
Aug 05 17:35:18.251967 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:18.251915    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts" podUID="cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.32:8643/healthz\": dial tcp 10.134.0.32:8643: connect: connection refused"
Aug 05 17:35:19.213137 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:19.213106    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:35:19.290609 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:19.290576    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:35:19.582380 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:19.582352    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:35:23.251741 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:23.251701    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts" podUID="cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.32:8643/healthz\": dial tcp 10.134.0.32:8643: connect: connection refused"
Aug 05 17:35:23.924210 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:23.924187    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts"
Aug 05 17:35:24.029374 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:24.029293    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c-kserve-provision-location\") pod \"cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c\" (UID: \"cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c\") "
Aug 05 17:35:24.029374 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:24.029338    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c-proxy-tls\") pod \"cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c\" (UID: \"cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c\") "
Aug 05 17:35:24.029374 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:24.029355    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c-kube-rbac-proxy-sar-config\") pod \"cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c\" (UID: \"cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c\") "
Aug 05 17:35:24.029684 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:24.029406    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c-cabundle-cert\") pod \"cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c\" (UID: \"cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c\") "
Aug 05 17:35:24.029684 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:24.029450    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h548w\" (UniqueName: \"kubernetes.io/projected/cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c-kube-api-access-h548w\") pod \"cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c\" (UID: \"cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c\") "
Aug 05 17:35:24.029797 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:24.029619    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c" (UID: "cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:35:24.029851 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:24.029807    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c" (UID: "cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:35:24.029851 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:24.029814    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c" (UID: "cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:35:24.031645 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:24.031622    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c" (UID: "cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:35:24.031645 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:24.031630    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c-kube-api-access-h548w" (OuterVolumeSpecName: "kube-api-access-h548w") pod "cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c" (UID: "cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c"). InnerVolumeSpecName "kube-api-access-h548w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:35:24.129277 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:24.129243    2580 generic.go:356] "Generic (PLEG): container finished" podID="cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c" containerID="4587873ec8937b2ecfef6f514a91f6894aaf61ca1b53a800918cfdea5dd682e8" exitCode=0
Aug 05 17:35:24.129431 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:24.129301    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts"
Aug 05 17:35:24.129431 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:24.129327    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts" event={"ID":"cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c","Type":"ContainerDied","Data":"4587873ec8937b2ecfef6f514a91f6894aaf61ca1b53a800918cfdea5dd682e8"}
Aug 05 17:35:24.129431 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:24.129397    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts" event={"ID":"cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c","Type":"ContainerDied","Data":"91b717960ad02cd61877096dc1fd864750b3adc1a269d249ea317f6ebbb00ba3"}
Aug 05 17:35:24.129528 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:24.129435    2580 scope.go:117] "RemoveContainer" containerID="0511914329ef6bc7729bf97a9ddec8c18b3b9f37c23bb988ac155bf65a8024d9"
Aug 05 17:35:24.130031 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:24.129998    2580 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c-cabundle-cert\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\""
Aug 05 17:35:24.130155 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:24.130038    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h548w\" (UniqueName: \"kubernetes.io/projected/cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c-kube-api-access-h548w\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\""
Aug 05 17:35:24.130155 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:24.130054    2580 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c-kserve-provision-location\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\""
Aug 05 17:35:24.130155 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:24.130069    2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c-proxy-tls\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\""
Aug 05 17:35:24.130155 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:24.130082    2580 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c-kube-rbac-proxy-sar-config\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\""
Aug 05 17:35:24.138892 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:24.138878    2580 scope.go:117] "RemoveContainer" containerID="4587873ec8937b2ecfef6f514a91f6894aaf61ca1b53a800918cfdea5dd682e8"
Aug 05 17:35:24.146717 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:24.146701    2580 scope.go:117] "RemoveContainer" containerID="ca546fd1b21f7a162de95d7d20e6f55d6a9e251ab8905757072b22c18db19eda"
Aug 05 17:35:24.154111 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:24.154067    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts"]
Aug 05 17:35:24.156494 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:24.156475    2580 scope.go:117] "RemoveContainer" containerID="0511914329ef6bc7729bf97a9ddec8c18b3b9f37c23bb988ac155bf65a8024d9"
Aug 05 17:35:24.156792 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:35:24.156772    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0511914329ef6bc7729bf97a9ddec8c18b3b9f37c23bb988ac155bf65a8024d9\": container with ID starting with 0511914329ef6bc7729bf97a9ddec8c18b3b9f37c23bb988ac155bf65a8024d9 not found: ID does not exist" containerID="0511914329ef6bc7729bf97a9ddec8c18b3b9f37c23bb988ac155bf65a8024d9"
Aug 05 17:35:24.156845 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:24.156801    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0511914329ef6bc7729bf97a9ddec8c18b3b9f37c23bb988ac155bf65a8024d9"} err="failed to get container status \"0511914329ef6bc7729bf97a9ddec8c18b3b9f37c23bb988ac155bf65a8024d9\": rpc error: code = NotFound desc = could not find container \"0511914329ef6bc7729bf97a9ddec8c18b3b9f37c23bb988ac155bf65a8024d9\": container with ID starting with 0511914329ef6bc7729bf97a9ddec8c18b3b9f37c23bb988ac155bf65a8024d9 not found: ID does not exist"
Aug 05 17:35:24.156845 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:24.156820    2580 scope.go:117] "RemoveContainer" containerID="4587873ec8937b2ecfef6f514a91f6894aaf61ca1b53a800918cfdea5dd682e8"
Aug 05 17:35:24.157056 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:35:24.157039    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4587873ec8937b2ecfef6f514a91f6894aaf61ca1b53a800918cfdea5dd682e8\": container with ID starting with 4587873ec8937b2ecfef6f514a91f6894aaf61ca1b53a800918cfdea5dd682e8 not found: ID does not exist" containerID="4587873ec8937b2ecfef6f514a91f6894aaf61ca1b53a800918cfdea5dd682e8"
Aug 05 17:35:24.157101 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:24.157062    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4587873ec8937b2ecfef6f514a91f6894aaf61ca1b53a800918cfdea5dd682e8"} err="failed to get container status \"4587873ec8937b2ecfef6f514a91f6894aaf61ca1b53a800918cfdea5dd682e8\": rpc error: code = NotFound desc = could not find container \"4587873ec8937b2ecfef6f514a91f6894aaf61ca1b53a800918cfdea5dd682e8\": container with ID starting with 4587873ec8937b2ecfef6f514a91f6894aaf61ca1b53a800918cfdea5dd682e8 not found: ID does not exist"
Aug 05 17:35:24.157101 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:24.157077    2580 scope.go:117] "RemoveContainer" containerID="ca546fd1b21f7a162de95d7d20e6f55d6a9e251ab8905757072b22c18db19eda"
Aug 05 17:35:24.157313 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:35:24.157298    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca546fd1b21f7a162de95d7d20e6f55d6a9e251ab8905757072b22c18db19eda\": container with ID starting with ca546fd1b21f7a162de95d7d20e6f55d6a9e251ab8905757072b22c18db19eda not found: ID does not exist" containerID="ca546fd1b21f7a162de95d7d20e6f55d6a9e251ab8905757072b22c18db19eda"
Aug 05 17:35:24.157377 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:24.157318    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca546fd1b21f7a162de95d7d20e6f55d6a9e251ab8905757072b22c18db19eda"} err="failed to get container status \"ca546fd1b21f7a162de95d7d20e6f55d6a9e251ab8905757072b22c18db19eda\": rpc error: code = NotFound desc = could not find container \"ca546fd1b21f7a162de95d7d20e6f55d6a9e251ab8905757072b22c18db19eda\": container with ID starting with ca546fd1b21f7a162de95d7d20e6f55d6a9e251ab8905757072b22c18db19eda not found: ID does not exist"
Aug 05 17:35:24.160173 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:24.160149    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-scale-raw-606ec-predictor-5df6959b9f-pfrts"]
Aug 05 17:35:26.002692 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:26.002657    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c" path="/var/lib/kubelet/pods/cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c/volumes"
Aug 05 17:35:39.057242 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:39.057211    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:35:42.521209 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:42.521172    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:35:55.184665 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:55.184632    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:35:55.252252 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:35:55.252224    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:36:49.369176 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:49.369102    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:36:54.482007 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:54.481975    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:36:54.547781 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:54.547745    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88"]
Aug 05 17:36:54.548084 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:54.548072    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c" containerName="kube-rbac-proxy"
Aug 05 17:36:54.548125 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:54.548086    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c" containerName="kube-rbac-proxy"
Aug 05 17:36:54.548125 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:54.548100    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c353ea9c-ae87-47ba-adf6-a424ebc56c25" containerName="storage-initializer"
Aug 05 17:36:54.548125 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:54.548106    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c353ea9c-ae87-47ba-adf6-a424ebc56c25" containerName="storage-initializer"
Aug 05 17:36:54.548125 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:54.548114    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c" containerName="kserve-container"
Aug 05 17:36:54.548125 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:54.548119    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c" containerName="kserve-container"
Aug 05 17:36:54.548125 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:54.548126    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c353ea9c-ae87-47ba-adf6-a424ebc56c25" containerName="storage-initializer"
Aug 05 17:36:54.548313 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:54.548131    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c353ea9c-ae87-47ba-adf6-a424ebc56c25" containerName="storage-initializer"
Aug 05 17:36:54.548313 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:54.548138    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c" containerName="storage-initializer"
Aug 05 17:36:54.548313 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:54.548143    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c" containerName="storage-initializer"
Aug 05 17:36:54.548313 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:54.548189    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c" containerName="kserve-container"
Aug 05 17:36:54.548313 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:54.548198    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c353ea9c-ae87-47ba-adf6-a424ebc56c25" containerName="storage-initializer"
Aug 05 17:36:54.548313 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:54.548203    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd6cfc4a-68b5-41e6-a81b-ced99a9cc21c" containerName="kube-rbac-proxy"
Aug 05 17:36:54.548313 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:54.548209    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c353ea9c-ae87-47ba-adf6-a424ebc56c25" containerName="storage-initializer"
Aug 05 17:36:54.551377 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:54.551361    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88"
Aug 05 17:36:54.553468 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:54.553450    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Aug 05 17:36:54.553618 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:54.553594    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Aug 05 17:36:54.553678 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:54.553663    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Aug 05 17:36:54.554479 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:54.554462    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-h9rpc\""
Aug 05 17:36:54.554594 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:54.554502    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Aug 05 17:36:54.554594 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:54.554465    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-promote-v2-predictor-serving-cert\""
Aug 05 17:36:54.554714 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:54.554602    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-promote-kube-rbac-proxy-sar-config\""
Aug 05 17:36:54.565593 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:54.565538    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88"]
Aug 05 17:36:54.571139 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:54.571112    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:36:54.695225 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:54.695182    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88\" (UID: \"c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88"
Aug 05 17:36:54.695225 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:54.695224    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88\" (UID: \"c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88"
Aug 05 17:36:54.695432 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:54.695243    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck8v4\" (UniqueName: \"kubernetes.io/projected/c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1-kube-api-access-ck8v4\") pod \"isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88\" (UID: \"c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88"
Aug 05 17:36:54.695432 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:54.695363    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88\" (UID: \"c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88"
Aug 05 17:36:54.695432 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:54.695395    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88\" (UID: \"c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88"
Aug 05 17:36:54.795915 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:54.795824    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88\" (UID: \"c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88"
Aug 05 17:36:54.795915 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:54.795860    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88\" (UID: \"c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88"
Aug 05 17:36:54.795915 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:54.795902    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88\" (UID: \"c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88"
Aug 05 17:36:54.796191 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:54.795921    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88\" (UID: \"c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88"
Aug 05 17:36:54.796191 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:54.795940    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck8v4\" (UniqueName: \"kubernetes.io/projected/c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1-kube-api-access-ck8v4\") pod \"isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88\" (UID: \"c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88"
Aug 05 17:36:54.796191 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:36:54.795998    2580 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-serving-cert: secret "isvc-canary-promote-v2-predictor-serving-cert" not found
Aug 05 17:36:54.796191 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:36:54.796079    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1-proxy-tls podName:c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1 nodeName:}" failed. No retries permitted until 2026-08-05 17:36:55.296058724 +0000 UTC m=+1449.864561124 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1-proxy-tls") pod "isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88" (UID: "c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1") : secret "isvc-canary-promote-v2-predictor-serving-cert" not found
Aug 05 17:36:54.796361 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:54.796321    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88\" (UID: \"c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88"
Aug 05 17:36:54.796592 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:54.796544    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88\" (UID: \"c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88"
Aug 05 17:36:54.796706 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:54.796652    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88\" (UID: \"c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88"
Aug 05 17:36:54.806742 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:54.806721    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck8v4\" (UniqueName: \"kubernetes.io/projected/c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1-kube-api-access-ck8v4\") pod \"isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88\" (UID: \"c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88"
Aug 05 17:36:54.809883 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:54.809863    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:36:54.899730 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:54.899701    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:36:55.300047 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:55.300003    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88\" (UID: \"c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88"
Aug 05 17:36:55.302600 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:55.302569    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88\" (UID: \"c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88"
Aug 05 17:36:55.461982 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:55.461943    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88"
Aug 05 17:36:55.595491 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:55.595465    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88"]
Aug 05 17:36:55.597944 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:36:55.597916    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc26b7d0d_aaaf_4fd4_a755_1c0a5a5ea0e1.slice/crio-61f0e94b4923a3bb9318209173631aadf3e6982b1e05015daf3ac57033202f39 WatchSource:0}: Error finding container 61f0e94b4923a3bb9318209173631aadf3e6982b1e05015daf3ac57033202f39: Status 404 returned error can't find the container with id 61f0e94b4923a3bb9318209173631aadf3e6982b1e05015daf3ac57033202f39
Aug 05 17:36:56.551036 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:56.550998    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88" event={"ID":"c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1","Type":"ContainerStarted","Data":"7c499d6c33dd30c9f5a251aa5618663c20ba65be8c8acc633eac376e443fea92"}
Aug 05 17:36:56.551251 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:36:56.551056    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88" event={"ID":"c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1","Type":"ContainerStarted","Data":"61f0e94b4923a3bb9318209173631aadf3e6982b1e05015daf3ac57033202f39"}
Aug 05 17:37:00.572207 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:37:00.572170    2580 generic.go:356] "Generic (PLEG): container finished" podID="c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1" containerID="7c499d6c33dd30c9f5a251aa5618663c20ba65be8c8acc633eac376e443fea92" exitCode=0
Aug 05 17:37:00.572637 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:37:00.572240    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88" event={"ID":"c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1","Type":"ContainerDied","Data":"7c499d6c33dd30c9f5a251aa5618663c20ba65be8c8acc633eac376e443fea92"}
Aug 05 17:37:01.579414 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:37:01.579380    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88" event={"ID":"c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1","Type":"ContainerStarted","Data":"889f39a5057578e4f9668bba5469b7c52cfa82615a98b9c0f399733c79148533"}
Aug 05 17:37:01.579871 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:37:01.579439    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88" event={"ID":"c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1","Type":"ContainerStarted","Data":"5db7edd4b84137486cee5b8d4fc15cf2b4cf14b28de3a95b200fe98554357cfd"}
Aug 05 17:37:01.579871 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:37:01.579706    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88"
Aug 05 17:37:01.579871 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:37:01.579861    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88"
Aug 05 17:37:01.581088 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:37:01.581065    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88" podUID="c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused"
Aug 05 17:37:01.602300 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:37:01.602249    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88" podStartSLOduration=3.6695197569999998 podStartE2EDuration="7.602232555s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.932712798s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:36:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:37:01.600850478 +0000 UTC m=+1456.169352921" watchObservedRunningTime="2026-08-05 17:37:01.602232555 +0000 UTC m=+1456.170734975"
Aug 05 17:37:02.584111 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:37:02.584064    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88" podUID="c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused"
Aug 05 17:37:07.588477 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:37:07.588447    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88"
Aug 05 17:37:07.588960 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:37:07.588935    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88" podUID="c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused"
Aug 05 17:37:17.589321 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:37:17.589280    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88" podUID="c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused"
Aug 05 17:37:27.589606 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:37:27.589537    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88" podUID="c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused"
Aug 05 17:37:37.589804 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:37:37.589759    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88" podUID="c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused"
Aug 05 17:37:45.888817 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:37:45.888792    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-cqj2n_17a2b686-e228-4d00-9656-8b03b65f2e29/console-operator/1.log"
Aug 05 17:37:45.892433 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:37:45.892412    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-cqj2n_17a2b686-e228-4d00-9656-8b03b65f2e29/console-operator/1.log"
Aug 05 17:37:45.895669 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:37:45.895653    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q69wj_d8e22937-0209-4cf9-b262-dacb99128703/ovn-acl-logging/0.log"
Aug 05 17:37:45.899185 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:37:45.899171    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q69wj_d8e22937-0209-4cf9-b262-dacb99128703/ovn-acl-logging/0.log"
Aug 05 17:37:47.589124 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:37:47.589084    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88" podUID="c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused"
Aug 05 17:37:57.589128 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:37:57.589082    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88" podUID="c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused"
Aug 05 17:38:07.589090 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:38:07.589009    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88" podUID="c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused"
Aug 05 17:38:17.590456 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:38:17.590427    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88"
Aug 05 17:38:24.700210 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:38:24.700174    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:39:54.962377 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:39:54.962298    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88"]
Aug 05 17:39:54.962923 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:39:54.962518    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88" podUID="c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1" containerName="kserve-container" containerID="cri-o://5db7edd4b84137486cee5b8d4fc15cf2b4cf14b28de3a95b200fe98554357cfd" gracePeriod=30
Aug 05 17:39:54.962923 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:39:54.962603    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88" podUID="c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1" containerName="kube-rbac-proxy" containerID="cri-o://889f39a5057578e4f9668bba5469b7c52cfa82615a98b9c0f399733c79148533" gracePeriod=30
Aug 05 17:39:55.376501 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:39:55.376469    2580 generic.go:356] "Generic (PLEG): container finished" podID="c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1" containerID="889f39a5057578e4f9668bba5469b7c52cfa82615a98b9c0f399733c79148533" exitCode=2
Aug 05 17:39:55.376501 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:39:55.376505    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88" event={"ID":"c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1","Type":"ContainerDied","Data":"889f39a5057578e4f9668bba5469b7c52cfa82615a98b9c0f399733c79148533"}
Aug 05 17:39:56.018853 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:39:56.018788    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:39:57.584507 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:39:57.584465    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88" podUID="c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.33:8643/healthz\": dial tcp 10.134.0.33:8643: connect: connection refused"
Aug 05 17:39:57.589020 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:39:57.588993    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88" podUID="c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused"
Aug 05 17:39:59.611921 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:39:59.611891    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88"
Aug 05 17:39:59.724483 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:39:59.724393    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ck8v4\" (UniqueName: \"kubernetes.io/projected/c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1-kube-api-access-ck8v4\") pod \"c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1\" (UID: \"c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1\") "
Aug 05 17:39:59.724483 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:39:59.724434    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1-kube-rbac-proxy-sar-config\") pod \"c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1\" (UID: \"c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1\") "
Aug 05 17:39:59.724483 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:39:59.724467    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1-kserve-provision-location\") pod \"c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1\" (UID: \"c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1\") "
Aug 05 17:39:59.724802 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:39:59.724494    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1-proxy-tls\") pod \"c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1\" (UID: \"c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1\") "
Aug 05 17:39:59.724802 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:39:59.724548    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1-cabundle-cert\") pod \"c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1\" (UID: \"c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1\") "
Aug 05 17:39:59.724973 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:39:59.724935    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1" (UID: "c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:39:59.725035 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:39:59.724989    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1" (UID: "c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:39:59.725035 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:39:59.725009    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1" (UID: "c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:39:59.730016 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:39:59.729988    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1-kube-api-access-ck8v4" (OuterVolumeSpecName: "kube-api-access-ck8v4") pod "c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1" (UID: "c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1"). InnerVolumeSpecName "kube-api-access-ck8v4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:39:59.730147 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:39:59.730068    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1" (UID: "c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:39:59.825599 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:39:59.825541    2580 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1-kserve-provision-location\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\""
Aug 05 17:39:59.825599 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:39:59.825589    2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1-proxy-tls\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\""
Aug 05 17:39:59.825599 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:39:59.825600    2580 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1-cabundle-cert\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\""
Aug 05 17:39:59.825599 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:39:59.825608    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ck8v4\" (UniqueName: \"kubernetes.io/projected/c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1-kube-api-access-ck8v4\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\""
Aug 05 17:39:59.825861 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:39:59.825616    2580 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1-kube-rbac-proxy-sar-config\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\""
Aug 05 17:40:00.399398 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:00.399368    2580 generic.go:356] "Generic (PLEG): container finished" podID="c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1" containerID="5db7edd4b84137486cee5b8d4fc15cf2b4cf14b28de3a95b200fe98554357cfd" exitCode=0
Aug 05 17:40:00.399590 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:00.399427    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88"
Aug 05 17:40:00.399590 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:00.399457    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88" event={"ID":"c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1","Type":"ContainerDied","Data":"5db7edd4b84137486cee5b8d4fc15cf2b4cf14b28de3a95b200fe98554357cfd"}
Aug 05 17:40:00.399590 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:00.399521    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88" event={"ID":"c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1","Type":"ContainerDied","Data":"61f0e94b4923a3bb9318209173631aadf3e6982b1e05015daf3ac57033202f39"}
Aug 05 17:40:00.399590 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:00.399546    2580 scope.go:117] "RemoveContainer" containerID="889f39a5057578e4f9668bba5469b7c52cfa82615a98b9c0f399733c79148533"
Aug 05 17:40:00.408229 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:00.408205    2580 scope.go:117] "RemoveContainer" containerID="5db7edd4b84137486cee5b8d4fc15cf2b4cf14b28de3a95b200fe98554357cfd"
Aug 05 17:40:00.418039 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:00.417088    2580 scope.go:117] "RemoveContainer" containerID="7c499d6c33dd30c9f5a251aa5618663c20ba65be8c8acc633eac376e443fea92"
Aug 05 17:40:00.420801 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:00.420769    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88"]
Aug 05 17:40:00.423127 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:00.423107    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-7fb86b4d87-nmf88"]
Aug 05 17:40:00.427304 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:00.427288    2580 scope.go:117] "RemoveContainer" containerID="889f39a5057578e4f9668bba5469b7c52cfa82615a98b9c0f399733c79148533"
Aug 05 17:40:00.427634 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:40:00.427613    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"889f39a5057578e4f9668bba5469b7c52cfa82615a98b9c0f399733c79148533\": container with ID starting with 889f39a5057578e4f9668bba5469b7c52cfa82615a98b9c0f399733c79148533 not found: ID does not exist" containerID="889f39a5057578e4f9668bba5469b7c52cfa82615a98b9c0f399733c79148533"
Aug 05 17:40:00.427693 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:00.427645    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"889f39a5057578e4f9668bba5469b7c52cfa82615a98b9c0f399733c79148533"} err="failed to get container status \"889f39a5057578e4f9668bba5469b7c52cfa82615a98b9c0f399733c79148533\": rpc error: code = NotFound desc = could not find container \"889f39a5057578e4f9668bba5469b7c52cfa82615a98b9c0f399733c79148533\": container with ID starting with 889f39a5057578e4f9668bba5469b7c52cfa82615a98b9c0f399733c79148533 not found: ID does not exist"
Aug 05 17:40:00.427693 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:00.427664    2580 scope.go:117] "RemoveContainer" containerID="5db7edd4b84137486cee5b8d4fc15cf2b4cf14b28de3a95b200fe98554357cfd"
Aug 05 17:40:00.427907 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:40:00.427891    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5db7edd4b84137486cee5b8d4fc15cf2b4cf14b28de3a95b200fe98554357cfd\": container with ID starting with 5db7edd4b84137486cee5b8d4fc15cf2b4cf14b28de3a95b200fe98554357cfd not found: ID does not exist" containerID="5db7edd4b84137486cee5b8d4fc15cf2b4cf14b28de3a95b200fe98554357cfd"
Aug 05 17:40:00.427948 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:00.427910    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5db7edd4b84137486cee5b8d4fc15cf2b4cf14b28de3a95b200fe98554357cfd"} err="failed to get container status \"5db7edd4b84137486cee5b8d4fc15cf2b4cf14b28de3a95b200fe98554357cfd\": rpc error: code = NotFound desc = could not find container \"5db7edd4b84137486cee5b8d4fc15cf2b4cf14b28de3a95b200fe98554357cfd\": container with ID starting with 5db7edd4b84137486cee5b8d4fc15cf2b4cf14b28de3a95b200fe98554357cfd not found: ID does not exist"
Aug 05 17:40:00.427948 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:00.427924    2580 scope.go:117] "RemoveContainer" containerID="7c499d6c33dd30c9f5a251aa5618663c20ba65be8c8acc633eac376e443fea92"
Aug 05 17:40:00.428102 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:40:00.428086    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c499d6c33dd30c9f5a251aa5618663c20ba65be8c8acc633eac376e443fea92\": container with ID starting with 7c499d6c33dd30c9f5a251aa5618663c20ba65be8c8acc633eac376e443fea92 not found: ID does not exist" containerID="7c499d6c33dd30c9f5a251aa5618663c20ba65be8c8acc633eac376e443fea92"
Aug 05 17:40:00.428142 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:00.428104    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c499d6c33dd30c9f5a251aa5618663c20ba65be8c8acc633eac376e443fea92"} err="failed to get container status \"7c499d6c33dd30c9f5a251aa5618663c20ba65be8c8acc633eac376e443fea92\": rpc error: code = NotFound desc = could not find container \"7c499d6c33dd30c9f5a251aa5618663c20ba65be8c8acc633eac376e443fea92\": container with ID starting with 7c499d6c33dd30c9f5a251aa5618663c20ba65be8c8acc633eac376e443fea92 not found: ID does not exist"
Aug 05 17:40:02.002199 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:02.002164    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1" path="/var/lib/kubelet/pods/c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1/volumes"
Aug 05 17:40:09.169052 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:09.169017    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-nvpfg"]
Aug 05 17:40:09.169464 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:09.169356    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1" containerName="kube-rbac-proxy"
Aug 05 17:40:09.169464 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:09.169368    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1" containerName="kube-rbac-proxy"
Aug 05 17:40:09.169464 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:09.169386    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1" containerName="kserve-container"
Aug 05 17:40:09.169464 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:09.169395    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1" containerName="kserve-container"
Aug 05 17:40:09.169464 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:09.169409    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1" containerName="storage-initializer"
Aug 05 17:40:09.169464 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:09.169414    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1" containerName="storage-initializer"
Aug 05 17:40:09.169711 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:09.169481    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1" containerName="kube-rbac-proxy"
Aug 05 17:40:09.169711 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:09.169494    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c26b7d0d-aaaf-4fd4-a755-1c0a5a5ea0e1" containerName="kserve-container"
Aug 05 17:40:09.174200 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:09.174184    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-nvpfg"
Aug 05 17:40:09.176740 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:09.176719    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"message-dumper-raw-cipn-predictor-serving-cert\""
Aug 05 17:40:09.177018 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:09.176996    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"message-dumper-raw-cipn-kube-rbac-proxy-sar-config\""
Aug 05 17:40:09.177291 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:09.177278    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-h9rpc\""
Aug 05 17:40:09.177928 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:09.177911    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Aug 05 17:40:09.178015 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:09.177949    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Aug 05 17:40:09.186270 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:09.186245    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:40:09.186539 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:09.186523    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-nvpfg"]
Aug 05 17:40:09.309811 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:09.309770    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g47gw\" (UniqueName: \"kubernetes.io/projected/fcd81901-eb76-4360-8cc9-007163f1677b-kube-api-access-g47gw\") pod \"message-dumper-raw-cipn-predictor-9774bf55d-nvpfg\" (UID: \"fcd81901-eb76-4360-8cc9-007163f1677b\") " pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-nvpfg"
Aug 05 17:40:09.309811 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:09.309820    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fcd81901-eb76-4360-8cc9-007163f1677b-proxy-tls\") pod \"message-dumper-raw-cipn-predictor-9774bf55d-nvpfg\" (UID: \"fcd81901-eb76-4360-8cc9-007163f1677b\") " pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-nvpfg"
Aug 05 17:40:09.310017 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:09.309892    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fcd81901-eb76-4360-8cc9-007163f1677b-kube-rbac-proxy-sar-config\") pod \"message-dumper-raw-cipn-predictor-9774bf55d-nvpfg\" (UID: \"fcd81901-eb76-4360-8cc9-007163f1677b\") " pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-nvpfg"
Aug 05 17:40:09.365582 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:09.365527    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:40:09.410542 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:09.410512    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g47gw\" (UniqueName: \"kubernetes.io/projected/fcd81901-eb76-4360-8cc9-007163f1677b-kube-api-access-g47gw\") pod \"message-dumper-raw-cipn-predictor-9774bf55d-nvpfg\" (UID: \"fcd81901-eb76-4360-8cc9-007163f1677b\") " pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-nvpfg"
Aug 05 17:40:09.410709 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:09.410582    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fcd81901-eb76-4360-8cc9-007163f1677b-proxy-tls\") pod \"message-dumper-raw-cipn-predictor-9774bf55d-nvpfg\" (UID: \"fcd81901-eb76-4360-8cc9-007163f1677b\") " pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-nvpfg"
Aug 05 17:40:09.410709 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:09.410630    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fcd81901-eb76-4360-8cc9-007163f1677b-kube-rbac-proxy-sar-config\") pod \"message-dumper-raw-cipn-predictor-9774bf55d-nvpfg\" (UID: \"fcd81901-eb76-4360-8cc9-007163f1677b\") " pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-nvpfg"
Aug 05 17:40:09.411293 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:09.411274    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fcd81901-eb76-4360-8cc9-007163f1677b-kube-rbac-proxy-sar-config\") pod \"message-dumper-raw-cipn-predictor-9774bf55d-nvpfg\" (UID: \"fcd81901-eb76-4360-8cc9-007163f1677b\") " pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-nvpfg"
Aug 05 17:40:09.413245 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:09.413225    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fcd81901-eb76-4360-8cc9-007163f1677b-proxy-tls\") pod \"message-dumper-raw-cipn-predictor-9774bf55d-nvpfg\" (UID: \"fcd81901-eb76-4360-8cc9-007163f1677b\") " pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-nvpfg"
Aug 05 17:40:09.420910 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:09.420860    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g47gw\" (UniqueName: \"kubernetes.io/projected/fcd81901-eb76-4360-8cc9-007163f1677b-kube-api-access-g47gw\") pod \"message-dumper-raw-cipn-predictor-9774bf55d-nvpfg\" (UID: \"fcd81901-eb76-4360-8cc9-007163f1677b\") " pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-nvpfg"
Aug 05 17:40:09.484087 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:09.484064    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-nvpfg"
Aug 05 17:40:09.616753 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:09.616727    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-nvpfg"]
Aug 05 17:40:09.619364 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:40:09.619338    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcd81901_eb76_4360_8cc9_007163f1677b.slice/crio-ed11bfe27d69b678014ef57fc68a75d330902e71024c19e5beb9c2d08be9193e WatchSource:0}: Error finding container ed11bfe27d69b678014ef57fc68a75d330902e71024c19e5beb9c2d08be9193e: Status 404 returned error can't find the container with id ed11bfe27d69b678014ef57fc68a75d330902e71024c19e5beb9c2d08be9193e
Aug 05 17:40:09.621185 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:09.621170    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 17:40:10.447299 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:10.447269    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-nvpfg" event={"ID":"fcd81901-eb76-4360-8cc9-007163f1677b","Type":"ContainerStarted","Data":"ed11bfe27d69b678014ef57fc68a75d330902e71024c19e5beb9c2d08be9193e"}
Aug 05 17:40:11.453063 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:11.453027    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-nvpfg" event={"ID":"fcd81901-eb76-4360-8cc9-007163f1677b","Type":"ContainerStarted","Data":"4207be0a201a2db8baa9f92ebf64b3980295c5bad7f286301f5d7e385835460b"}
Aug 05 17:40:11.453466 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:11.453118    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-nvpfg"
Aug 05 17:40:11.453466 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:11.453148    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-nvpfg" event={"ID":"fcd81901-eb76-4360-8cc9-007163f1677b","Type":"ContainerStarted","Data":"54e7f3af64ab811b7ceb5196d70d054a9c4c47169befc2b5606c21da4fbea52a"}
Aug 05 17:40:11.453466 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:11.453286    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-nvpfg"
Aug 05 17:40:11.455178 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:11.455158    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-nvpfg"
Aug 05 17:40:11.500516 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:11.500466    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-nvpfg" podStartSLOduration=1.328879262 podStartE2EDuration="2.500449946s" totalImagesPullingTime="1.171570684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:40:11.478692272 +0000 UTC m=+1646.047194693" watchObservedRunningTime="2026-08-05 17:40:11.500449946 +0000 UTC m=+1646.068952370"
Aug 05 17:40:18.467103 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:18.467075    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-nvpfg"
Aug 05 17:40:19.140182 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:19.140152    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:40:21.613420 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:40:21.613383    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:41:46.883756 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:41:46.883722    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:41:54.204571 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:41:54.204524    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-raw-cipn-predictor-9774bf55d-nvpfg_fcd81901-eb76-4360-8cc9-007163f1677b/kserve-container/0.log"
Aug 05 17:41:54.503455 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:41:54.503363    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:41:54.568194 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:41:54.568165    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-nvpfg"]
Aug 05 17:41:54.568413 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:41:54.568388    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-nvpfg" podUID="fcd81901-eb76-4360-8cc9-007163f1677b" containerName="kserve-container" containerID="cri-o://54e7f3af64ab811b7ceb5196d70d054a9c4c47169befc2b5606c21da4fbea52a" gracePeriod=30
Aug 05 17:41:54.568489 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:41:54.568441    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-nvpfg" podUID="fcd81901-eb76-4360-8cc9-007163f1677b" containerName="kube-rbac-proxy" containerID="cri-o://4207be0a201a2db8baa9f92ebf64b3980295c5bad7f286301f5d7e385835460b" gracePeriod=30
Aug 05 17:41:54.600837 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:41:54.600813    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:41:54.808284 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:41:54.808261    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-nvpfg"
Aug 05 17:41:54.868712 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:41:54.868682    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fcd81901-eb76-4360-8cc9-007163f1677b-proxy-tls\") pod \"fcd81901-eb76-4360-8cc9-007163f1677b\" (UID: \"fcd81901-eb76-4360-8cc9-007163f1677b\") "
Aug 05 17:41:54.868870 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:41:54.868725    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g47gw\" (UniqueName: \"kubernetes.io/projected/fcd81901-eb76-4360-8cc9-007163f1677b-kube-api-access-g47gw\") pod \"fcd81901-eb76-4360-8cc9-007163f1677b\" (UID: \"fcd81901-eb76-4360-8cc9-007163f1677b\") "
Aug 05 17:41:54.868870 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:41:54.868802    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fcd81901-eb76-4360-8cc9-007163f1677b-kube-rbac-proxy-sar-config\") pod \"fcd81901-eb76-4360-8cc9-007163f1677b\" (UID: \"fcd81901-eb76-4360-8cc9-007163f1677b\") "
Aug 05 17:41:54.869160 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:41:54.869134    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcd81901-eb76-4360-8cc9-007163f1677b-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "fcd81901-eb76-4360-8cc9-007163f1677b" (UID: "fcd81901-eb76-4360-8cc9-007163f1677b"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:41:54.870814 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:41:54.870789    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fcd81901-eb76-4360-8cc9-007163f1677b-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "fcd81901-eb76-4360-8cc9-007163f1677b" (UID: "fcd81901-eb76-4360-8cc9-007163f1677b"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:41:54.870919 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:41:54.870900    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcd81901-eb76-4360-8cc9-007163f1677b-kube-api-access-g47gw" (OuterVolumeSpecName: "kube-api-access-g47gw") pod "fcd81901-eb76-4360-8cc9-007163f1677b" (UID: "fcd81901-eb76-4360-8cc9-007163f1677b"). InnerVolumeSpecName "kube-api-access-g47gw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:41:54.934327 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:41:54.934293    2580 generic.go:356] "Generic (PLEG): container finished" podID="fcd81901-eb76-4360-8cc9-007163f1677b" containerID="4207be0a201a2db8baa9f92ebf64b3980295c5bad7f286301f5d7e385835460b" exitCode=2
Aug 05 17:41:54.934327 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:41:54.934315    2580 generic.go:356] "Generic (PLEG): container finished" podID="fcd81901-eb76-4360-8cc9-007163f1677b" containerID="54e7f3af64ab811b7ceb5196d70d054a9c4c47169befc2b5606c21da4fbea52a" exitCode=2
Aug 05 17:41:54.934587 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:41:54.934344    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-nvpfg" event={"ID":"fcd81901-eb76-4360-8cc9-007163f1677b","Type":"ContainerDied","Data":"4207be0a201a2db8baa9f92ebf64b3980295c5bad7f286301f5d7e385835460b"}
Aug 05 17:41:54.934587 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:41:54.934346    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-nvpfg"
Aug 05 17:41:54.934587 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:41:54.934393    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-nvpfg" event={"ID":"fcd81901-eb76-4360-8cc9-007163f1677b","Type":"ContainerDied","Data":"54e7f3af64ab811b7ceb5196d70d054a9c4c47169befc2b5606c21da4fbea52a"}
Aug 05 17:41:54.934587 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:41:54.934416    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-nvpfg" event={"ID":"fcd81901-eb76-4360-8cc9-007163f1677b","Type":"ContainerDied","Data":"ed11bfe27d69b678014ef57fc68a75d330902e71024c19e5beb9c2d08be9193e"}
Aug 05 17:41:54.934587 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:41:54.934445    2580 scope.go:117] "RemoveContainer" containerID="4207be0a201a2db8baa9f92ebf64b3980295c5bad7f286301f5d7e385835460b"
Aug 05 17:41:54.942809 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:41:54.942787    2580 scope.go:117] "RemoveContainer" containerID="54e7f3af64ab811b7ceb5196d70d054a9c4c47169befc2b5606c21da4fbea52a"
Aug 05 17:41:54.951017 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:41:54.951003    2580 scope.go:117] "RemoveContainer" containerID="4207be0a201a2db8baa9f92ebf64b3980295c5bad7f286301f5d7e385835460b"
Aug 05 17:41:54.951273 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:41:54.951253    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4207be0a201a2db8baa9f92ebf64b3980295c5bad7f286301f5d7e385835460b\": container with ID starting with 4207be0a201a2db8baa9f92ebf64b3980295c5bad7f286301f5d7e385835460b not found: ID does not exist" containerID="4207be0a201a2db8baa9f92ebf64b3980295c5bad7f286301f5d7e385835460b"
Aug 05 17:41:54.951357 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:41:54.951280    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4207be0a201a2db8baa9f92ebf64b3980295c5bad7f286301f5d7e385835460b"} err="failed to get container status \"4207be0a201a2db8baa9f92ebf64b3980295c5bad7f286301f5d7e385835460b\": rpc error: code = NotFound desc = could not find container \"4207be0a201a2db8baa9f92ebf64b3980295c5bad7f286301f5d7e385835460b\": container with ID starting with 4207be0a201a2db8baa9f92ebf64b3980295c5bad7f286301f5d7e385835460b not found: ID does not exist"
Aug 05 17:41:54.951357 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:41:54.951297    2580 scope.go:117] "RemoveContainer" containerID="54e7f3af64ab811b7ceb5196d70d054a9c4c47169befc2b5606c21da4fbea52a"
Aug 05 17:41:54.951544 ip-10-0-131-128 kubenswrapper[2580]: E0805 17:41:54.951526    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54e7f3af64ab811b7ceb5196d70d054a9c4c47169befc2b5606c21da4fbea52a\": container with ID starting with 54e7f3af64ab811b7ceb5196d70d054a9c4c47169befc2b5606c21da4fbea52a not found: ID does not exist" containerID="54e7f3af64ab811b7ceb5196d70d054a9c4c47169befc2b5606c21da4fbea52a"
Aug 05 17:41:54.951652 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:41:54.951548    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54e7f3af64ab811b7ceb5196d70d054a9c4c47169befc2b5606c21da4fbea52a"} err="failed to get container status \"54e7f3af64ab811b7ceb5196d70d054a9c4c47169befc2b5606c21da4fbea52a\": rpc error: code = NotFound desc = could not find container \"54e7f3af64ab811b7ceb5196d70d054a9c4c47169befc2b5606c21da4fbea52a\": container with ID starting with 54e7f3af64ab811b7ceb5196d70d054a9c4c47169befc2b5606c21da4fbea52a not found: ID does not exist"
Aug 05 17:41:54.951652 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:41:54.951619    2580 scope.go:117] "RemoveContainer" containerID="4207be0a201a2db8baa9f92ebf64b3980295c5bad7f286301f5d7e385835460b"
Aug 05 17:41:54.951861 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:41:54.951841    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4207be0a201a2db8baa9f92ebf64b3980295c5bad7f286301f5d7e385835460b"} err="failed to get container status \"4207be0a201a2db8baa9f92ebf64b3980295c5bad7f286301f5d7e385835460b\": rpc error: code = NotFound desc = could not find container \"4207be0a201a2db8baa9f92ebf64b3980295c5bad7f286301f5d7e385835460b\": container with ID starting with 4207be0a201a2db8baa9f92ebf64b3980295c5bad7f286301f5d7e385835460b not found: ID does not exist"
Aug 05 17:41:54.951929 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:41:54.951862    2580 scope.go:117] "RemoveContainer" containerID="54e7f3af64ab811b7ceb5196d70d054a9c4c47169befc2b5606c21da4fbea52a"
Aug 05 17:41:54.952076 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:41:54.952060    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54e7f3af64ab811b7ceb5196d70d054a9c4c47169befc2b5606c21da4fbea52a"} err="failed to get container status \"54e7f3af64ab811b7ceb5196d70d054a9c4c47169befc2b5606c21da4fbea52a\": rpc error: code = NotFound desc = could not find container \"54e7f3af64ab811b7ceb5196d70d054a9c4c47169befc2b5606c21da4fbea52a\": container with ID starting with 54e7f3af64ab811b7ceb5196d70d054a9c4c47169befc2b5606c21da4fbea52a not found: ID does not exist"
Aug 05 17:41:54.956945 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:41:54.956924    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-nvpfg"]
Aug 05 17:41:54.961840 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:41:54.961817    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-nvpfg"]
Aug 05 17:41:54.969377 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:41:54.969357    2580 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fcd81901-eb76-4360-8cc9-007163f1677b-kube-rbac-proxy-sar-config\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\""
Aug 05 17:41:54.969463 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:41:54.969380    2580 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fcd81901-eb76-4360-8cc9-007163f1677b-proxy-tls\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\""
Aug 05 17:41:54.969463 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:41:54.969395    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g47gw\" (UniqueName: \"kubernetes.io/projected/fcd81901-eb76-4360-8cc9-007163f1677b-kube-api-access-g47gw\") on node \"ip-10-0-131-128.ec2.internal\" DevicePath \"\""
Aug 05 17:41:55.964103 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:41:55.964073    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:41:56.001921 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:41:56.001878    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcd81901-eb76-4360-8cc9-007163f1677b" path="/var/lib/kubelet/pods/fcd81901-eb76-4360-8cc9-007163f1677b/volumes"
Aug 05 17:41:56.057633 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:41:56.057598    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:42:27.224001 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:27.223965    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:42:27.393130 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:27.393096    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:42:27.492599 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:27.492490    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:42:30.203541 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:30.203508    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8g5w9_8e53ac33-f7e0-491b-a0fa-3a08b3eb6175/global-pull-secret-syncer/0.log"
Aug 05 17:42:30.374810 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:30.374784    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log"
Aug 05 17:42:30.492754 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:30.492659    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-128.ec2.internal_2906d83a7da9fad32f85769014ae2ba9/haproxy/0.log"
Aug 05 17:42:33.352420 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:33.352385    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:42:33.448542 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:33.448504    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zp9w_f0132161-af65-49eb-8335-197fe57259b2/konnectivity-agent/0.log" limit=1024
Aug 05 17:42:34.690699 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:34.690667    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-bsnxf_c9058435-3402-4bfd-abca-10a1778d9b49/cluster-monitoring-operator/0.log"
Aug 05 17:42:34.728982 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:34.728959    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-vbdzs_f26abd48-4f13-4afe-be3e-6fb183e060d6/kube-state-metrics/0.log"
Aug 05 17:42:34.756899 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:34.756878    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-vbdzs_f26abd48-4f13-4afe-be3e-6fb183e060d6/kube-rbac-proxy-main/0.log"
Aug 05 17:42:34.787091 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:34.787070    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-vbdzs_f26abd48-4f13-4afe-be3e-6fb183e060d6/kube-rbac-proxy-self/0.log"
Aug 05 17:42:34.826153 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:34.826134    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-75f748b5b6-8k2rl_6d2652a5-7ff2-486c-8bfb-2d2c5a75db87/metrics-server/0.log"
Aug 05 17:42:34.912321 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:34.912297    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2qfkz_6d5cc792-9c36-476d-9e3a-7839f8371880/node-exporter/0.log"
Aug 05 17:42:34.940891 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:34.940837    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2qfkz_6d5cc792-9c36-476d-9e3a-7839f8371880/kube-rbac-proxy/0.log"
Aug 05 17:42:34.973489 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:34.973467    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2qfkz_6d5cc792-9c36-476d-9e3a-7839f8371880/init-textfile/0.log"
Aug 05 17:42:35.216486 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:35.216400    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-gjl59_ef2c0d95-3d83-4ffe-b694-12fe23cef1d0/kube-rbac-proxy-main/0.log"
Aug 05 17:42:35.262925 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:35.262896    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-gjl59_ef2c0d95-3d83-4ffe-b694-12fe23cef1d0/kube-rbac-proxy-self/0.log"
Aug 05 17:42:35.309267 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:35.309229    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-gjl59_ef2c0d95-3d83-4ffe-b694-12fe23cef1d0/openshift-state-metrics/0.log"
Aug 05 17:42:35.659823 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:35.659795    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-66685ff6d4-wqbqq_69aafc28-143b-4332-bef0-fcc64ce5bdde/prometheus-operator-admission-webhook/0.log"
Aug 05 17:42:35.837223 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:35.837162    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f56bf8d96-mrbnt_cfbb7139-e70b-4e5f-9e5a-aa719dea7704/thanos-query/0.log"
Aug 05 17:42:35.879489 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:35.879466    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f56bf8d96-mrbnt_cfbb7139-e70b-4e5f-9e5a-aa719dea7704/kube-rbac-proxy-web/0.log"
Aug 05 17:42:35.918604 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:35.918529    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f56bf8d96-mrbnt_cfbb7139-e70b-4e5f-9e5a-aa719dea7704/kube-rbac-proxy/0.log"
Aug 05 17:42:35.953673 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:35.953618    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f56bf8d96-mrbnt_cfbb7139-e70b-4e5f-9e5a-aa719dea7704/prom-label-proxy/0.log"
Aug 05 17:42:35.984386 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:35.984363    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f56bf8d96-mrbnt_cfbb7139-e70b-4e5f-9e5a-aa719dea7704/kube-rbac-proxy-rules/0.log"
Aug 05 17:42:36.020035 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:36.020011    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f56bf8d96-mrbnt_cfbb7139-e70b-4e5f-9e5a-aa719dea7704/kube-rbac-proxy-metrics/0.log"
Aug 05 17:42:37.753520 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:37.753487    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-cqj2n_17a2b686-e228-4d00-9656-8b03b65f2e29/console-operator/1.log"
Aug 05 17:42:37.761180 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:37.761153    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-cqj2n_17a2b686-e228-4d00-9656-8b03b65f2e29/console-operator/2.log"
Aug 05 17:42:37.995396 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:37.995364    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jjq9m/perf-node-gather-daemonset-fzbg2"]
Aug 05 17:42:37.995747 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:37.995734    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcd81901-eb76-4360-8cc9-007163f1677b" containerName="kube-rbac-proxy"
Aug 05 17:42:37.995799 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:37.995751    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcd81901-eb76-4360-8cc9-007163f1677b" containerName="kube-rbac-proxy"
Aug 05 17:42:37.995799 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:37.995769    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcd81901-eb76-4360-8cc9-007163f1677b" containerName="kserve-container"
Aug 05 17:42:37.995799 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:37.995775    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcd81901-eb76-4360-8cc9-007163f1677b" containerName="kserve-container"
Aug 05 17:42:37.995892 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:37.995826    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcd81901-eb76-4360-8cc9-007163f1677b" containerName="kserve-container"
Aug 05 17:42:37.995892 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:37.995845    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcd81901-eb76-4360-8cc9-007163f1677b" containerName="kube-rbac-proxy"
Aug 05 17:42:37.999107 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:37.999091    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jjq9m/perf-node-gather-daemonset-fzbg2"
Aug 05 17:42:38.002346 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:38.002314    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jjq9m\"/\"kube-root-ca.crt\""
Aug 05 17:42:38.003092 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:38.003066    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jjq9m\"/\"openshift-service-ca.crt\""
Aug 05 17:42:38.003354 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:38.003333    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jjq9m\"/\"default-dockercfg-fndrf\""
Aug 05 17:42:38.010871 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:38.010810    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jjq9m/perf-node-gather-daemonset-fzbg2"]
Aug 05 17:42:38.013010 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:38.012987    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0664d686-c36e-48ee-bb43-a88ef3003b26-podres\") pod \"perf-node-gather-daemonset-fzbg2\" (UID: \"0664d686-c36e-48ee-bb43-a88ef3003b26\") " pod="openshift-must-gather-jjq9m/perf-node-gather-daemonset-fzbg2"
Aug 05 17:42:38.013114 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:38.013024    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0664d686-c36e-48ee-bb43-a88ef3003b26-proc\") pod \"perf-node-gather-daemonset-fzbg2\" (UID: \"0664d686-c36e-48ee-bb43-a88ef3003b26\") " pod="openshift-must-gather-jjq9m/perf-node-gather-daemonset-fzbg2"
Aug 05 17:42:38.013114 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:38.013073    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0664d686-c36e-48ee-bb43-a88ef3003b26-lib-modules\") pod \"perf-node-gather-daemonset-fzbg2\" (UID: \"0664d686-c36e-48ee-bb43-a88ef3003b26\") " pod="openshift-must-gather-jjq9m/perf-node-gather-daemonset-fzbg2"
Aug 05 17:42:38.013223 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:38.013186    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr7q4\" (UniqueName: \"kubernetes.io/projected/0664d686-c36e-48ee-bb43-a88ef3003b26-kube-api-access-lr7q4\") pod \"perf-node-gather-daemonset-fzbg2\" (UID: \"0664d686-c36e-48ee-bb43-a88ef3003b26\") " pod="openshift-must-gather-jjq9m/perf-node-gather-daemonset-fzbg2"
Aug 05 17:42:38.013223 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:38.013209    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0664d686-c36e-48ee-bb43-a88ef3003b26-sys\") pod \"perf-node-gather-daemonset-fzbg2\" (UID: \"0664d686-c36e-48ee-bb43-a88ef3003b26\") " pod="openshift-must-gather-jjq9m/perf-node-gather-daemonset-fzbg2"
Aug 05 17:42:38.114206 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:38.114172    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0664d686-c36e-48ee-bb43-a88ef3003b26-lib-modules\") pod \"perf-node-gather-daemonset-fzbg2\" (UID: \"0664d686-c36e-48ee-bb43-a88ef3003b26\") " pod="openshift-must-gather-jjq9m/perf-node-gather-daemonset-fzbg2"
Aug 05 17:42:38.114206 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:38.114207    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr7q4\" (UniqueName: \"kubernetes.io/projected/0664d686-c36e-48ee-bb43-a88ef3003b26-kube-api-access-lr7q4\") pod \"perf-node-gather-daemonset-fzbg2\" (UID: \"0664d686-c36e-48ee-bb43-a88ef3003b26\") " pod="openshift-must-gather-jjq9m/perf-node-gather-daemonset-fzbg2"
Aug 05 17:42:38.114444 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:38.114231    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0664d686-c36e-48ee-bb43-a88ef3003b26-sys\") pod \"perf-node-gather-daemonset-fzbg2\" (UID: \"0664d686-c36e-48ee-bb43-a88ef3003b26\") " pod="openshift-must-gather-jjq9m/perf-node-gather-daemonset-fzbg2"
Aug 05 17:42:38.114444 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:38.114267    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0664d686-c36e-48ee-bb43-a88ef3003b26-podres\") pod \"perf-node-gather-daemonset-fzbg2\" (UID: \"0664d686-c36e-48ee-bb43-a88ef3003b26\") " pod="openshift-must-gather-jjq9m/perf-node-gather-daemonset-fzbg2"
Aug 05 17:42:38.114444 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:38.114312    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0664d686-c36e-48ee-bb43-a88ef3003b26-proc\") pod \"perf-node-gather-daemonset-fzbg2\" (UID: \"0664d686-c36e-48ee-bb43-a88ef3003b26\") " pod="openshift-must-gather-jjq9m/perf-node-gather-daemonset-fzbg2"
Aug 05 17:42:38.114444 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:38.114358    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0664d686-c36e-48ee-bb43-a88ef3003b26-sys\") pod \"perf-node-gather-daemonset-fzbg2\" (UID: \"0664d686-c36e-48ee-bb43-a88ef3003b26\") " pod="openshift-must-gather-jjq9m/perf-node-gather-daemonset-fzbg2"
Aug 05 17:42:38.114444 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:38.114386    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0664d686-c36e-48ee-bb43-a88ef3003b26-proc\") pod \"perf-node-gather-daemonset-fzbg2\" (UID: \"0664d686-c36e-48ee-bb43-a88ef3003b26\") " pod="openshift-must-gather-jjq9m/perf-node-gather-daemonset-fzbg2"
Aug 05 17:42:38.114444 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:38.114358    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0664d686-c36e-48ee-bb43-a88ef3003b26-lib-modules\") pod \"perf-node-gather-daemonset-fzbg2\" (UID: \"0664d686-c36e-48ee-bb43-a88ef3003b26\") " pod="openshift-must-gather-jjq9m/perf-node-gather-daemonset-fzbg2"
Aug 05 17:42:38.114444 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:38.114415    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0664d686-c36e-48ee-bb43-a88ef3003b26-podres\") pod \"perf-node-gather-daemonset-fzbg2\" (UID: \"0664d686-c36e-48ee-bb43-a88ef3003b26\") " pod="openshift-must-gather-jjq9m/perf-node-gather-daemonset-fzbg2"
Aug 05 17:42:38.124160 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:38.124134    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr7q4\" (UniqueName: \"kubernetes.io/projected/0664d686-c36e-48ee-bb43-a88ef3003b26-kube-api-access-lr7q4\") pod \"perf-node-gather-daemonset-fzbg2\" (UID: \"0664d686-c36e-48ee-bb43-a88ef3003b26\") " pod="openshift-must-gather-jjq9m/perf-node-gather-daemonset-fzbg2"
Aug 05 17:42:38.315119 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:38.315094    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jjq9m/perf-node-gather-daemonset-fzbg2"
Aug 05 17:42:38.448879 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:38.448855    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jjq9m/perf-node-gather-daemonset-fzbg2"]
Aug 05 17:42:38.451451 ip-10-0-131-128 kubenswrapper[2580]: W0805 17:42:38.451425    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0664d686_c36e_48ee_bb43_a88ef3003b26.slice/crio-d1c3c51f7918df72b490c55cb150f54fcef06ec42220b2a0dc6dff9731cd2744 WatchSource:0}: Error finding container d1c3c51f7918df72b490c55cb150f54fcef06ec42220b2a0dc6dff9731cd2744: Status 404 returned error can't find the container with id d1c3c51f7918df72b490c55cb150f54fcef06ec42220b2a0dc6dff9731cd2744
Aug 05 17:42:38.857731 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:38.857706    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5b8776669-cfhjn_fbe3e762-befb-4b44-8948-cec992999e97/volume-data-source-validator/0.log"
Aug 05 17:42:39.128340 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:39.128240    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jjq9m/perf-node-gather-daemonset-fzbg2" event={"ID":"0664d686-c36e-48ee-bb43-a88ef3003b26","Type":"ContainerStarted","Data":"20ce3de7d9952287aa562293468f66862920120303024e73899ad19d3fd0a5cd"}
Aug 05 17:42:39.128340 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:39.128301    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jjq9m/perf-node-gather-daemonset-fzbg2" event={"ID":"0664d686-c36e-48ee-bb43-a88ef3003b26","Type":"ContainerStarted","Data":"d1c3c51f7918df72b490c55cb150f54fcef06ec42220b2a0dc6dff9731cd2744"}
Aug 05 17:42:39.128340 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:39.128331    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jjq9m/perf-node-gather-daemonset-fzbg2"
Aug 05 17:42:39.147461 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:39.147417    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jjq9m/perf-node-gather-daemonset-fzbg2" podStartSLOduration=2.147401549 podStartE2EDuration="2.147401549s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:42:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:42:39.145334994 +0000 UTC m=+1793.713837414" watchObservedRunningTime="2026-08-05 17:42:39.147401549 +0000 UTC m=+1793.715903969"
Aug 05 17:42:39.958204 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:39.958173    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gn6t8_b112783c-bc73-4ad0-b67d-9c4c831a3dc9/dns/0.log"
Aug 05 17:42:40.006176 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:40.006150    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gn6t8_b112783c-bc73-4ad0-b67d-9c4c831a3dc9/kube-rbac-proxy/0.log"
Aug 05 17:42:40.201367 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:40.201343    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7wgm8_f4349f2f-ccd4-43c7-bee0-2bb29268387c/dns-node-resolver/0.log"
Aug 05 17:42:40.809396 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:40.809364    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7577cb494d-jlsvz_772046af-1b8c-48dd-b9f6-8915d5f611e9/registry/0.log"
Aug 05 17:42:40.871136 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:40.871109    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8gxfg_4bf26f2b-19d6-42f0-81db-423f51c7982e/node-ca/0.log"
Aug 05 17:42:42.161721 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:42.161683    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-62z6z_861e1758-06e6-4164-80df-cd5d8fa4a923/serve-healthcheck-canary/0.log"
Aug 05 17:42:42.846116 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:42.846088    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tr42t_fa1e6b87-097c-4574-a761-9762d2a8c586/kube-rbac-proxy/0.log"
Aug 05 17:42:42.872415 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:42.872391    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tr42t_fa1e6b87-097c-4574-a761-9762d2a8c586/exporter/0.log"
Aug 05 17:42:42.899812 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:42.899793    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tr42t_fa1e6b87-097c-4574-a761-9762d2a8c586/extractor/0.log"
Aug 05 17:42:45.143100 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:45.143074    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jjq9m/perf-node-gather-daemonset-fzbg2"
Aug 05 17:42:45.366018 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:45.365987    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-654c557856-mq298_36facdf7-b50f-4c3e-b3d6-d7abe4272021/manager/0.log"
Aug 05 17:42:45.388008 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:45.387988    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-7b954ffc95-xfftc_d4536851-fb20-47be-ba84-e1f4ead6bfa5/server/0.log"
Aug 05 17:42:45.915758 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:45.915732    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-cqj2n_17a2b686-e228-4d00-9656-8b03b65f2e29/console-operator/1.log"
Aug 05 17:42:45.921431 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:45.921402    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-cqj2n_17a2b686-e228-4d00-9656-8b03b65f2e29/console-operator/1.log"
Aug 05 17:42:45.922593 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:45.922576    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q69wj_d8e22937-0209-4cf9-b262-dacb99128703/ovn-acl-logging/0.log"
Aug 05 17:42:45.927952 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:45.927936    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q69wj_d8e22937-0209-4cf9-b262-dacb99128703/ovn-acl-logging/0.log"
Aug 05 17:42:50.340882 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:50.340847    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-rzvk9_0a865de0-040f-491d-9d38-d1ae4b434375/migrator/0.log"
Aug 05 17:42:50.368137 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:50.368105    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-rzvk9_0a865de0-040f-491d-9d38-d1ae4b434375/graceful-termination/0.log"
Aug 05 17:42:50.763059 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:50.762969    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-ww266_91386cb4-60c6-4513-8cb7-39682f9fc29e/kube-storage-version-migrator-operator/1.log"
Aug 05 17:42:50.764681 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:50.764654    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-ww266_91386cb4-60c6-4513-8cb7-39682f9fc29e/kube-storage-version-migrator-operator/0.log"
Aug 05 17:42:52.051607 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:52.051575    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fg62p_3ae8f50f-82eb-4c86-9ea5-6fe09014fa90/kube-multus-additional-cni-plugins/0.log"
Aug 05 17:42:52.082771 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:52.082744    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fg62p_3ae8f50f-82eb-4c86-9ea5-6fe09014fa90/egress-router-binary-copy/0.log"
Aug 05 17:42:52.109955 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:52.109935    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fg62p_3ae8f50f-82eb-4c86-9ea5-6fe09014fa90/cni-plugins/0.log"
Aug 05 17:42:52.140985 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:52.140951    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fg62p_3ae8f50f-82eb-4c86-9ea5-6fe09014fa90/bond-cni-plugin/0.log"
Aug 05 17:42:52.171128 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:52.171105    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fg62p_3ae8f50f-82eb-4c86-9ea5-6fe09014fa90/routeoverride-cni/0.log"
Aug 05 17:42:52.200402 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:52.200356    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fg62p_3ae8f50f-82eb-4c86-9ea5-6fe09014fa90/whereabouts-cni-bincopy/0.log"
Aug 05 17:42:52.241697 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:52.241666    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fg62p_3ae8f50f-82eb-4c86-9ea5-6fe09014fa90/whereabouts-cni/0.log"
Aug 05 17:42:52.529904 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:52.529874    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nws8z_0c63ef0c-6380-4b2f-80aa-2c1bf0a388a3/kube-multus/0.log"
Aug 05 17:42:52.555004 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:52.554974    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-j48xm_0746144f-9064-48d7-ad22-f33bbbc3c16e/network-metrics-daemon/0.log"
Aug 05 17:42:52.577916 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:52.577895    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-j48xm_0746144f-9064-48d7-ad22-f33bbbc3c16e/kube-rbac-proxy/0.log"
Aug 05 17:42:53.500916 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:53.500886    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q69wj_d8e22937-0209-4cf9-b262-dacb99128703/ovn-controller/0.log"
Aug 05 17:42:53.523695 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:53.523669    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q69wj_d8e22937-0209-4cf9-b262-dacb99128703/ovn-acl-logging/1.log"
Aug 05 17:42:53.523854 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:53.523737    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q69wj_d8e22937-0209-4cf9-b262-dacb99128703/ovn-acl-logging/0.log"
Aug 05 17:42:53.544858 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:53.544835    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q69wj_d8e22937-0209-4cf9-b262-dacb99128703/kube-rbac-proxy-node/0.log"
Aug 05 17:42:53.575538 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:53.575517    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q69wj_d8e22937-0209-4cf9-b262-dacb99128703/kube-rbac-proxy-ovn-metrics/0.log"
Aug 05 17:42:53.598850 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:53.598821    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q69wj_d8e22937-0209-4cf9-b262-dacb99128703/northd/0.log"
Aug 05 17:42:53.624212 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:53.624192    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q69wj_d8e22937-0209-4cf9-b262-dacb99128703/nbdb/0.log"
Aug 05 17:42:53.651071 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:53.651036    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q69wj_d8e22937-0209-4cf9-b262-dacb99128703/sbdb/0.log"
Aug 05 17:42:53.707420 ip-10-0-131-128 kubenswrapper[2580]: I0805 17:42:53.707382    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q69wj_d8e22937-0209-4cf9-b262-dacb99128703/ovnkube-controller/0.log"