Jul 15 10:43:20.224119 ip-10-0-134-216 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 15 10:43:20.224132 ip-10-0-134-216 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 15 10:43:20.224142 ip-10-0-134-216 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 15 10:43:20.224452 ip-10-0-134-216 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 15 10:43:29.767418 ip-10-0-134-216 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 15 10:43:29.767433 ip-10-0-134-216 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 39a1a4a7b0b544a6a33313809828c5e2 --
Jul 15 10:45:00.964072 ip-10-0-134-216 systemd[1]: Starting Kubernetes Kubelet...
Jul 15 10:45:01.429074 ip-10-0-134-216 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 10:45:01.429074 ip-10-0-134-216 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 15 10:45:01.429074 ip-10-0-134-216 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 10:45:01.429074 ip-10-0-134-216 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 15 10:45:01.429074 ip-10-0-134-216 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 10:45:01.430158 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.430056    2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 15 10:45:01.435324 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435302    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 10:45:01.435324 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435323    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 10:45:01.435324 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435328    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 10:45:01.435454 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435333    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 10:45:01.435454 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435336    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 10:45:01.435454 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435339    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 10:45:01.435454 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435342    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 10:45:01.435454 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435346    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 10:45:01.435454 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435349    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 10:45:01.435454 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435351    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 10:45:01.435454 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435354    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 10:45:01.435454 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435356    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 10:45:01.435454 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435359    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 10:45:01.435454 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435362    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 10:45:01.435454 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435364    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 10:45:01.435454 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435367    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 10:45:01.435454 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435369    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 10:45:01.435454 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435372    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 10:45:01.435454 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435375    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 10:45:01.435454 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435377    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 10:45:01.435454 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435379    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 10:45:01.435454 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435384    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 10:45:01.435454 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435387    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 10:45:01.435939 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435389    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 10:45:01.435939 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435392    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 10:45:01.435939 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435394    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 10:45:01.435939 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435397    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 10:45:01.435939 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435399    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 10:45:01.435939 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435402    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 10:45:01.435939 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435404    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 10:45:01.435939 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435407    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 10:45:01.435939 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435410    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 10:45:01.435939 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435413    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 10:45:01.435939 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435416    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 10:45:01.435939 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435420    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 10:45:01.435939 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435424    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 10:45:01.435939 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435429    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 10:45:01.435939 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435433    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 10:45:01.435939 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435436    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 10:45:01.435939 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435440    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 10:45:01.435939 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435443    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 10:45:01.435939 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435446    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 10:45:01.436401 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435448    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 10:45:01.436401 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435451    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 10:45:01.436401 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435454    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 10:45:01.436401 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435456    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 10:45:01.436401 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435460    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 10:45:01.436401 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435463    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 10:45:01.436401 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435466    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 10:45:01.436401 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435468    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 10:45:01.436401 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435471    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 10:45:01.436401 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435473    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 10:45:01.436401 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435476    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 10:45:01.436401 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435479    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 10:45:01.436401 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435482    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 10:45:01.436401 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435484    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 10:45:01.436401 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435488    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 10:45:01.436401 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435492    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 10:45:01.436401 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435496    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 10:45:01.436401 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435498    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 10:45:01.436401 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435501    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 10:45:01.436907 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435504    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 10:45:01.436907 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435507    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 10:45:01.436907 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435509    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 10:45:01.436907 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435512    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 10:45:01.436907 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435515    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 10:45:01.436907 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435518    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 10:45:01.436907 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435520    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 10:45:01.436907 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435524    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 10:45:01.436907 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435527    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 10:45:01.436907 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435529    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 10:45:01.436907 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435532    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 10:45:01.436907 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435534    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 10:45:01.436907 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435537    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 10:45:01.436907 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435540    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 10:45:01.436907 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435542    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 10:45:01.436907 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435545    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 10:45:01.436907 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435548    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 10:45:01.436907 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435550    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 10:45:01.436907 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435553    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 10:45:01.436907 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435556    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 10:45:01.437663 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435560    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 10:45:01.437663 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435563    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 10:45:01.437663 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435566    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 10:45:01.437663 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435568    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 10:45:01.437663 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435572    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 10:45:01.437663 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435574    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 10:45:01.437663 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435577    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 10:45:01.437663 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435580    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 10:45:01.437663 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435582    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 10:45:01.437663 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435585    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 10:45:01.437663 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435587    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 10:45:01.437663 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435589    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 10:45:01.437663 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435592    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 10:45:01.437663 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435595    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 10:45:01.437663 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435597    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 10:45:01.437663 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435600    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 10:45:01.437663 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435602    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 10:45:01.437663 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.435605    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 10:45:01.437663 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436353    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 10:45:01.437663 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436362    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 10:45:01.438494 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436366    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 10:45:01.438494 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436369    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 10:45:01.438494 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436372    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 10:45:01.438494 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436374    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 10:45:01.438494 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436377    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 10:45:01.438494 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436380    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 10:45:01.438494 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436382    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 10:45:01.438494 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436385    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 10:45:01.438494 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436387    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 10:45:01.438494 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436390    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 10:45:01.438494 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436393    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 10:45:01.438494 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436395    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 10:45:01.438494 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436398    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 10:45:01.438494 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436400    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 10:45:01.438494 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436403    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 10:45:01.438494 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436406    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 10:45:01.438494 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436409    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 10:45:01.438494 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436411    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 10:45:01.438494 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436414    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 10:45:01.438494 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436418    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 10:45:01.439101 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436422    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 10:45:01.439101 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436424    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 10:45:01.439101 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436427    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 10:45:01.439101 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436429    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 10:45:01.439101 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436432    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 10:45:01.439101 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436435    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 10:45:01.439101 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436438    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 10:45:01.439101 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436441    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 10:45:01.439101 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436443    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 10:45:01.439101 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436446    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 10:45:01.439101 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436449    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 10:45:01.439101 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436452    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 10:45:01.439101 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436455    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 10:45:01.439101 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436457    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 10:45:01.439101 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436459    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 10:45:01.439101 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436462    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 10:45:01.439101 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436464    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 10:45:01.439101 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436467    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 10:45:01.439101 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436470    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 10:45:01.439101 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436472    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 10:45:01.439606 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436475    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 10:45:01.439606 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436477    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 10:45:01.439606 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436480    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 10:45:01.439606 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436482    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 10:45:01.439606 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436484    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 10:45:01.439606 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436489    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 10:45:01.439606 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436492    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 10:45:01.439606 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436495    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 10:45:01.439606 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436498    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 10:45:01.439606 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436501    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 10:45:01.439606 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436503    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 10:45:01.439606 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436506    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 10:45:01.439606 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436512    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 10:45:01.439606 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436514    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 10:45:01.439606 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436517    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 10:45:01.439606 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436519    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 10:45:01.439606 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436522    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 10:45:01.439606 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436525    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 10:45:01.439606 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436528    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 10:45:01.439606 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436530    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 10:45:01.440125 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436533    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 10:45:01.440125 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436535    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 10:45:01.440125 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436538    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 10:45:01.440125 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436542    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 10:45:01.440125 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436544    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 10:45:01.440125 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436548    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 10:45:01.440125 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436552    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 10:45:01.440125 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436555    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 10:45:01.440125 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436557    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 10:45:01.440125 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436559    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 10:45:01.440125 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436562    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 10:45:01.440125 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436565    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 10:45:01.440125 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436567    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 10:45:01.440125 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436570    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 10:45:01.440125 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436573    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 10:45:01.440125 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436577    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 10:45:01.440125 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436580    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 10:45:01.440125 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436583    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 10:45:01.440125 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436586    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 10:45:01.440581 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436589    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 10:45:01.440581 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436591    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 10:45:01.440581 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436594    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 10:45:01.440581 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436597    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 10:45:01.440581 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436599    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 10:45:01.440581 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436602    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 10:45:01.440581 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436606    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 10:45:01.440581 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436608    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 10:45:01.440581 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436611    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 10:45:01.440581 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436613    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 10:45:01.440581 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436616    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 10:45:01.440581 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436621    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 10:45:01.440581 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436624    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 10:45:01.440581 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436626    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 10:45:01.440581 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436629    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 10:45:01.440581 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436631    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 10:45:01.440581 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436634    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 10:45:01.440581 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.436637    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 10:45:01.440581 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438016    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 10:45:01.440581 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438037    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 10:45:01.441088 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438052    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 10:45:01.441088 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438058    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 10:45:01.441088 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438063    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 10:45:01.441088 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438067    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 10:45:01.441088 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438072    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 10:45:01.441088 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438077    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 10:45:01.441088 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438082    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 10:45:01.441088 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438087    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 10:45:01.441088 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438092    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 10:45:01.441088 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438097    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 10:45:01.441088 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438102    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 10:45:01.441088 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438107    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 10:45:01.441088 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438112    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 10:45:01.441088 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438122    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 10:45:01.441088 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438127    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 10:45:01.441088 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438132    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 10:45:01.441088 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438137    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 10:45:01.441088 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438143    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 10:45:01.441088 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438148    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 10:45:01.441088 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438153    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 10:45:01.441580 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438160    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 10:45:01.441580 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438167    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 10:45:01.441580 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438172    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 10:45:01.441580 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438177    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 10:45:01.441580 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438182    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 10:45:01.441580 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438192    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 10:45:01.441580 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438197    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 10:45:01.441580 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438201    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 10:45:01.441580 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438206    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 10:45:01.441580 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438210    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 10:45:01.441580 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438215    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 10:45:01.441580 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438225    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 10:45:01.441580 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438232    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 10:45:01.441580 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438237    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 10:45:01.441580 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438243    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 10:45:01.441580 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438249    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 10:45:01.441580 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438286    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 10:45:01.441580 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438308    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 10:45:01.441580 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438313    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 10:45:01.442078 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438319    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 10:45:01.442078 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438323    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 10:45:01.442078 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438326    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 10:45:01.442078 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438329    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 10:45:01.442078 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438332    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 10:45:01.442078 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438335    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 10:45:01.442078 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438338    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 10:45:01.442078 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438341    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 10:45:01.442078 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438346    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 10:45:01.442078 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438353    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 10:45:01.442078 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438357    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 10:45:01.442078 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438360    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 10:45:01.442078 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438364    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 10:45:01.442078 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438367    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 10:45:01.442078 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438371    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 10:45:01.442078 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438374    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 10:45:01.442078 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438376    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 10:45:01.442078 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438379    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 10:45:01.442078 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438382    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 10:45:01.442531 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438385    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 10:45:01.442531 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438388    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 10:45:01.442531 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438393    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 10:45:01.442531 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438396    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 10:45:01.442531 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438398    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 10:45:01.442531 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438401    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 10:45:01.442531 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438404    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 10:45:01.442531 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438406    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 10:45:01.442531 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438409    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 10:45:01.442531 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438412    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 10:45:01.442531 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438416    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 10:45:01.442531 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438424    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 10:45:01.442531 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438429    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 10:45:01.442531 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438432    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 10:45:01.442531 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438459    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 10:45:01.442531 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438465    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 10:45:01.442531 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438468    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 10:45:01.442531 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438471    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 10:45:01.442531 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438474    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 10:45:01.442531 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438478    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 10:45:01.443028 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438481    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 10:45:01.443028 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438484    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 10:45:01.443028 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438486    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 10:45:01.443028 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438489    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 10:45:01.443028 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438491    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 10:45:01.443028 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438494    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 10:45:01.443028 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438500    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 10:45:01.443028 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438502    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 10:45:01.443028 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438506    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 10:45:01.443028 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438508    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 10:45:01.443028 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438511    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 10:45:01.443028 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438514    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 10:45:01.443028 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438538    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 10:45:01.443028 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438541    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 10:45:01.443028 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438558    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 10:45:01.443028 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438675    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 10:45:01.443028 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438681    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 10:45:01.443028 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438683    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 10:45:01.443028 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.438686    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 10:45:01.443028 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.438807    2565 flags.go:64] FLAG: --address="0.0.0.0"
Jul 15 10:45:01.443028 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.438837    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 15 10:45:01.443639 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.438848    2565 flags.go:64] FLAG: --anonymous-auth="true"
Jul 15 10:45:01.443639 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.438855    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 15 10:45:01.443639 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.438861    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 15 10:45:01.443639 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.438866    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 15 10:45:01.443639 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.438872    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 15 10:45:01.443639 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.438880    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 15 10:45:01.443639 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.438884    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 15 10:45:01.443639 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.438887    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 15 10:45:01.443639 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.438891    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 15 10:45:01.443639 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.438894    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 15 10:45:01.443639 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.438897    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 15 10:45:01.443639 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.438900    2565 flags.go:64] FLAG: --cgroup-root=""
Jul 15 10:45:01.443639 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.438904    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 15 10:45:01.443639 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.438906    2565 flags.go:64] FLAG: --client-ca-file=""
Jul 15 10:45:01.443639 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.438909    2565 flags.go:64] FLAG: --cloud-provider="external"
Jul 15 10:45:01.443639 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.438912    2565 flags.go:64] FLAG: --cluster-dns="[]"
Jul 15 10:45:01.443639 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.438916    2565 flags.go:64] FLAG: --cluster-domain=""
Jul 15 10:45:01.443639 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.438919    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 15 10:45:01.443639 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.438921    2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 15 10:45:01.443639 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.438924    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 15 10:45:01.443639 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.438927    2565 flags.go:64] FLAG: --container-log-max-files="5"
Jul 15 10:45:01.443639 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.438931    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 15 10:45:01.443639 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.438934    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 15 10:45:01.444245 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.438937    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 15 10:45:01.444245 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.438941    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 15 10:45:01.444245 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.438944    2565 flags.go:64] FLAG: --contention-profiling="false"
Jul 15 10:45:01.444245 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.438947    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 15 10:45:01.444245 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.438949    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 15 10:45:01.444245 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.438953    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 15 10:45:01.444245 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.438955    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 15 10:45:01.444245 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.438960    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 15 10:45:01.444245 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.438964    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 15 10:45:01.444245 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.438967    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 15 10:45:01.444245 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.438970    2565 flags.go:64] FLAG: --enable-load-reader="false"
Jul 15 10:45:01.444245 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.438973    2565 flags.go:64] FLAG: --enable-server="true"
Jul 15 10:45:01.444245 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.438976    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 15 10:45:01.444245 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.438980    2565 flags.go:64] FLAG: --event-burst="100"
Jul 15 10:45:01.444245 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.438983    2565 flags.go:64] FLAG: --event-qps="50"
Jul 15 10:45:01.444245 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.438986    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 15 10:45:01.444245 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.438989    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 15 10:45:01.444245 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.438992    2565 flags.go:64] FLAG: --eviction-hard=""
Jul 15 10:45:01.444245 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.438996    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 15 10:45:01.444245 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.438999    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 15 10:45:01.444245 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439002    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 15 10:45:01.444245 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439005    2565 flags.go:64] FLAG: --eviction-soft=""
Jul 15 10:45:01.444245 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439008    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 15 10:45:01.444245 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439011    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 15 10:45:01.444245 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439014    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 15 10:45:01.444879 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439016    2565 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 15 10:45:01.444879 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439019    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 15 10:45:01.444879 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439022    2565 flags.go:64] FLAG: --fail-swap-on="true"
Jul 15 10:45:01.444879 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439025    2565 flags.go:64] FLAG: --feature-gates=""
Jul 15 10:45:01.444879 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439029    2565 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 15 10:45:01.444879 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439032    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 15 10:45:01.444879 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439034    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 15 10:45:01.444879 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439038    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 15 10:45:01.444879 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439041    2565 flags.go:64] FLAG: --healthz-port="10248"
Jul 15 10:45:01.444879 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439044    2565 flags.go:64] FLAG: --help="false"
Jul 15 10:45:01.444879 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439046    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-134-216.ec2.internal"
Jul 15 10:45:01.444879 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439050    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 15 10:45:01.444879 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439052    2565 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 15 10:45:01.444879 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439055    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 15 10:45:01.444879 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439060    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 15 10:45:01.444879 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439064    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 15 10:45:01.444879 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439067    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 15 10:45:01.444879 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439070    2565 flags.go:64] FLAG: --image-service-endpoint=""
Jul 15 10:45:01.444879 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439073    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 15 10:45:01.444879 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439075    2565 flags.go:64] FLAG: --kube-api-burst="100"
Jul 15 10:45:01.444879 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439078    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 15 10:45:01.444879 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439082    2565 flags.go:64] FLAG: --kube-api-qps="50"
Jul 15 10:45:01.444879 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439084    2565 flags.go:64] FLAG: --kube-reserved=""
Jul 15 10:45:01.444879 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439088    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 15 10:45:01.445468 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439091    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 15 10:45:01.445468 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439094    2565 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 15 10:45:01.445468 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439097    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 15 10:45:01.445468 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439099    2565 flags.go:64] FLAG: --lock-file=""
Jul 15 10:45:01.445468 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439102    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 15 10:45:01.445468 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439105    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 15 10:45:01.445468 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439108    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 15 10:45:01.445468 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439115    2565 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 15 10:45:01.445468 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439117    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 15 10:45:01.445468 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439120    2565 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 15 10:45:01.445468 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439123    2565 flags.go:64] FLAG: --logging-format="text"
Jul 15 10:45:01.445468 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439126    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 15 10:45:01.445468 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439129    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 15 10:45:01.445468 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439132    2565 flags.go:64] FLAG: --manifest-url=""
Jul 15 10:45:01.445468 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439135    2565 flags.go:64] FLAG: --manifest-url-header=""
Jul 15 10:45:01.445468 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439140    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 15 10:45:01.445468 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439143    2565 flags.go:64] FLAG: --max-open-files="1000000"
Jul 15 10:45:01.445468 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439148    2565 flags.go:64] FLAG: --max-pods="110"
Jul 15 10:45:01.445468 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439151    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 15 10:45:01.445468 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439153    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 15 10:45:01.445468 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439157    2565 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 15 10:45:01.445468 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439160    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 15 10:45:01.445468 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439163    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 15 10:45:01.445468 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439169    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 15 10:45:01.445468 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439172    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 15 10:45:01.446125 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439180    2565 flags.go:64] FLAG: --node-status-max-images="50"
Jul 15 10:45:01.446125 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439184    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 15 10:45:01.446125 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439186    2565 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 15 10:45:01.446125 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439189    2565 flags.go:64] FLAG: --pod-cidr=""
Jul 15 10:45:01.446125 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439192    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 15 10:45:01.446125 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439197    2565 flags.go:64] FLAG: --pod-manifest-path=""
Jul 15 10:45:01.446125 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439200    2565 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 15 10:45:01.446125 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439203    2565 flags.go:64] FLAG: --pods-per-core="0"
Jul 15 10:45:01.446125 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439206    2565 flags.go:64] FLAG: --port="10250"
Jul 15 10:45:01.446125 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439208    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 15 10:45:01.446125 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439211    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e238115d709f78a9"
Jul 15 10:45:01.446125 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439218    2565 flags.go:64] FLAG: --qos-reserved=""
Jul 15 10:45:01.446125 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439221    2565 flags.go:64] FLAG: --read-only-port="10255"
Jul 15 10:45:01.446125 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439223    2565 flags.go:64] FLAG: --register-node="true"
Jul 15 10:45:01.446125 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439226    2565 flags.go:64] FLAG: --register-with-taints=""
Jul 15 10:45:01.446125 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439230    2565 flags.go:64] FLAG: --registry-burst="10"
Jul 15 10:45:01.446125 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439233    2565 flags.go:64] FLAG: --registry-qps="5"
Jul 15 10:45:01.446125 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439236    2565 flags.go:64] FLAG: --reserved-cpus=""
Jul 15 10:45:01.446125 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439238    2565 flags.go:64] FLAG: --reserved-memory=""
Jul 15 10:45:01.446125 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439242    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 15 10:45:01.446125 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439245    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 15 10:45:01.446125 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439248    2565 flags.go:64] FLAG: --rotate-certificates="false"
Jul 15 10:45:01.446125 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439251    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 15 10:45:01.446125 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439253    2565 flags.go:64] FLAG: --runonce="false"
Jul 15 10:45:01.446125 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439258    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 15 10:45:01.446816 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439261    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 15 10:45:01.446816 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439264    2565 flags.go:64] FLAG: --seccomp-default="false"
Jul 15 10:45:01.446816 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439266    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 15 10:45:01.446816 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439269    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 15 10:45:01.446816 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439272    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 15 10:45:01.446816 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439275    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 15 10:45:01.446816 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439280    2565 flags.go:64] FLAG: --storage-driver-password="root"
Jul 15 10:45:01.446816 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439283    2565 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 15 10:45:01.446816 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439286    2565 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 15 10:45:01.446816 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439289    2565 flags.go:64] FLAG: --storage-driver-user="root"
Jul 15 10:45:01.446816 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439291    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 15 10:45:01.446816 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439294    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 15 10:45:01.446816 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439297    2565 flags.go:64] FLAG: --system-cgroups=""
Jul 15 10:45:01.446816 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439300    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 15 10:45:01.446816 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439306    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 15 10:45:01.446816 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439309    2565 flags.go:64] FLAG: --tls-cert-file=""
Jul 15 10:45:01.446816 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439312    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 15 10:45:01.446816 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439317    2565 flags.go:64] FLAG: --tls-min-version=""
Jul 15 10:45:01.446816 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439320    2565 flags.go:64] FLAG: --tls-private-key-file=""
Jul 15 10:45:01.446816 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439323    2565 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 15 10:45:01.446816 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439326    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 15 10:45:01.446816 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439328    2565 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 15 10:45:01.446816 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439331    2565 flags.go:64] FLAG: --v="2"
Jul 15 10:45:01.446816 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439335    2565 flags.go:64] FLAG: --version="false"
Jul 15 10:45:01.446816 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439339    2565 flags.go:64] FLAG: --vmodule=""
Jul 15 10:45:01.447427 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439343    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 15 10:45:01.447427 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.439346    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 15 10:45:01.447427 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439465    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 10:45:01.447427 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439469    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 10:45:01.447427 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439472    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 10:45:01.447427 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439475    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 10:45:01.447427 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439478    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 10:45:01.447427 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439481    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 10:45:01.447427 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439484    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 10:45:01.447427 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439486    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 10:45:01.447427 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439489    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 10:45:01.447427 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439491    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 10:45:01.447427 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439495    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 10:45:01.447427 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439499    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 10:45:01.447427 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439501    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 10:45:01.447427 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439504    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 10:45:01.447427 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439506    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 10:45:01.447427 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439509    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 10:45:01.447427 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439512    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 10:45:01.447427 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439514    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 10:45:01.447948 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439517    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 10:45:01.447948 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439519    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 10:45:01.447948 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439522    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 10:45:01.447948 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439524    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 10:45:01.447948 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439527    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 10:45:01.447948 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439529    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 10:45:01.447948 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439532    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 10:45:01.447948 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439534    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 10:45:01.447948 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439537    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 10:45:01.447948 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439540    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 10:45:01.447948 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439542    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 10:45:01.447948 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439545    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 10:45:01.447948 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439548    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 10:45:01.447948 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439550    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 10:45:01.447948 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439553    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 10:45:01.447948 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439556    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 10:45:01.447948 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439558    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 10:45:01.447948 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439561    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 10:45:01.447948 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439563    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 10:45:01.448412 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439566    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 10:45:01.448412 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439569    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 10:45:01.448412 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439573    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 10:45:01.448412 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439578    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 10:45:01.448412 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439581    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 10:45:01.448412 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439584    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 10:45:01.448412 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439588    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 10:45:01.448412 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439590    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 10:45:01.448412 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439593    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 10:45:01.448412 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439595    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 10:45:01.448412 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439598    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 10:45:01.448412 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439601    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 10:45:01.448412 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439603    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 10:45:01.448412 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439606    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 10:45:01.448412 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439608    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 10:45:01.448412 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439611    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 10:45:01.448412 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439614    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 10:45:01.448412 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439617    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 10:45:01.448412 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439620    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 10:45:01.448412 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439622    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 10:45:01.449769 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439626    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 10:45:01.449769 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439630    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 10:45:01.449769 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439633    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 10:45:01.449769 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439636    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 10:45:01.449769 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439639    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 10:45:01.449769 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439641    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 10:45:01.449769 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439644    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 10:45:01.449769 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439646    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 10:45:01.449769 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439649    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 10:45:01.449769 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439651    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 10:45:01.449769 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439654    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 10:45:01.449769 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439656    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 10:45:01.449769 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439659    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 10:45:01.449769 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439661    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 10:45:01.449769 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439664    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 10:45:01.449769 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439667    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 10:45:01.449769 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439669    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 10:45:01.449769 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439674    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 10:45:01.449769 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439677    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 10:45:01.449769 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439680    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 10:45:01.450265 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439682    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 10:45:01.450265 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439685    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 10:45:01.450265 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439687    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 10:45:01.450265 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439690    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 10:45:01.450265 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439692    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 10:45:01.450265 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439695    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 10:45:01.450265 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439698    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 10:45:01.450265 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439700    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 10:45:01.450265 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439703    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 10:45:01.450265 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439705    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 10:45:01.450265 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439708    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 10:45:01.450265 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439710    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 10:45:01.450265 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439713    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 10:45:01.450265 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439715    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 10:45:01.450265 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439717    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 10:45:01.450265 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439720    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 10:45:01.450265 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439737    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 10:45:01.450265 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439740    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 10:45:01.450265 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439742    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 10:45:01.450265 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439745    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 10:45:01.450960 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439747    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 10:45:01.450960 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.439751    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 10:45:01.450960 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.440533    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 10:45:01.450960 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.447850    2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 15 10:45:01.450960 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.447871    2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 15 10:45:01.450960 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.447893    2565 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 15 10:45:01.450960 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.447899    2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 15 10:45:01.450960 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.447955    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 10:45:01.450960 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.447961    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 10:45:01.450960 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.447964    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 10:45:01.450960 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.447967    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 10:45:01.450960 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.447970    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 10:45:01.450960 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.447974    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 10:45:01.450960 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.447976    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 10:45:01.450960 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.447979    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 10:45:01.451344 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.447984    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 10:45:01.451344 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.447988    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 10:45:01.451344 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.447991    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 10:45:01.451344 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448004    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 10:45:01.451344 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448008    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 10:45:01.451344 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448011    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 10:45:01.451344 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448014    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 10:45:01.451344 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448017    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 10:45:01.451344 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448020    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 10:45:01.451344 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448023    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 10:45:01.451344 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448025    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 10:45:01.451344 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448028    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 10:45:01.451344 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448031    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 10:45:01.451344 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448033    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 10:45:01.451344 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448036    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 10:45:01.451344 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448038    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 10:45:01.451344 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448041    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 10:45:01.451344 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448044    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 10:45:01.451344 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448046    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 10:45:01.451848 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448048    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 10:45:01.451848 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448051    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 10:45:01.451848 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448056    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 10:45:01.451848 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448059    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 10:45:01.451848 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448062    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 10:45:01.451848 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448064    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 10:45:01.451848 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448067    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 10:45:01.451848 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448070    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 10:45:01.451848 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448072    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 10:45:01.451848 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448075    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 10:45:01.451848 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448077    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 10:45:01.451848 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448080    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 10:45:01.451848 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448082    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 10:45:01.451848 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448085    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 10:45:01.451848 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448087    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 10:45:01.451848 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448090    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 10:45:01.451848 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448092    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 10:45:01.451848 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448095    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 10:45:01.451848 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448098    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 10:45:01.452357 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448100    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 10:45:01.452357 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448103    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 10:45:01.452357 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448105    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 10:45:01.452357 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448108    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 10:45:01.452357 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448110    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 10:45:01.452357 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448113    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 10:45:01.452357 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448115    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 10:45:01.452357 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448118    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 10:45:01.452357 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448120    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 10:45:01.452357 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448123    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 10:45:01.452357 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448126    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 10:45:01.452357 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448128    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 10:45:01.452357 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448131    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 10:45:01.452357 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448133    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 10:45:01.452357 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448136    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 10:45:01.452357 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448140    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 10:45:01.452357 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448143    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 10:45:01.452357 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448145    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 10:45:01.452357 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448148    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 10:45:01.452357 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448151    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 10:45:01.452854 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448153    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 10:45:01.452854 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448156    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 10:45:01.452854 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448158    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 10:45:01.452854 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448161    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 10:45:01.452854 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448165    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 10:45:01.452854 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448168    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 10:45:01.452854 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448171    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 10:45:01.452854 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448174    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 10:45:01.452854 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448176    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 10:45:01.452854 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448178    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 10:45:01.452854 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448181    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 10:45:01.452854 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448184    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 10:45:01.452854 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448187    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 10:45:01.452854 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448190    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 10:45:01.452854 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448192    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 10:45:01.452854 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448195    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 10:45:01.452854 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448198    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 10:45:01.452854 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448201    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 10:45:01.452854 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448203    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 10:45:01.453339 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448206    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 10:45:01.453339 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448208    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 10:45:01.453339 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448210    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 10:45:01.453339 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448213    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 10:45:01.453339 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448216    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 10:45:01.453339 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448218    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 10:45:01.453339 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448221    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 10:45:01.453339 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448224    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 10:45:01.453339 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448227    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 10:45:01.453339 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448229    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 10:45:01.453339 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448232    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 10:45:01.453339 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448235    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 10:45:01.453339 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448238    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 10:45:01.453339 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448240    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 10:45:01.453339 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.448246    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 10:45:01.453713 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448389    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 10:45:01.453713 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448394    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 10:45:01.453713 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448397    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 10:45:01.453713 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448399    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 10:45:01.453713 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448402    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 10:45:01.453713 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448405    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 10:45:01.453713 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448408    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 10:45:01.453713 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448411    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 10:45:01.453713 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448413    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 10:45:01.453713 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448416    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 10:45:01.453713 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448419    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 10:45:01.453713 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448422    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 10:45:01.453713 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448425    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 10:45:01.453713 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448428    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 10:45:01.453713 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448430    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 10:45:01.453713 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448433    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 10:45:01.453713 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448436    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 10:45:01.453713 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448438    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 10:45:01.453713 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448441    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 10:45:01.454187 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448444    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 10:45:01.454187 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448446    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 10:45:01.454187 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448449    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 10:45:01.454187 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448451    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 10:45:01.454187 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448455    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 10:45:01.454187 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448458    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 10:45:01.454187 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448461    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 10:45:01.454187 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448464    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 10:45:01.454187 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448467    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 10:45:01.454187 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448470    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 10:45:01.454187 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448473    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 10:45:01.454187 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448476    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 10:45:01.454187 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448479    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 10:45:01.454187 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448483    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 10:45:01.454187 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448486    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 10:45:01.454187 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448488    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 10:45:01.454187 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448491    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 10:45:01.454187 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448494    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 10:45:01.454187 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448496    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 10:45:01.454646 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448499    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 10:45:01.454646 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448502    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 10:45:01.454646 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448504    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 10:45:01.454646 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448507    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 10:45:01.454646 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448509    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 10:45:01.454646 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448512    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 10:45:01.454646 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448514    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 10:45:01.454646 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448517    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 10:45:01.454646 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448519    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 10:45:01.454646 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448522    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 10:45:01.454646 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448524    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 10:45:01.454646 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448526    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 10:45:01.454646 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448529    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 10:45:01.454646 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448531    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 10:45:01.454646 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448533    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 10:45:01.454646 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448536    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 10:45:01.454646 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448538    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 10:45:01.454646 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448541    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 10:45:01.454646 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448543    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 10:45:01.454646 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448546    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 10:45:01.455215 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448548    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 10:45:01.455215 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448551    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 10:45:01.455215 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448553    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 10:45:01.455215 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448556    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 10:45:01.455215 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448558    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 10:45:01.455215 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448561    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 10:45:01.455215 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448563    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 10:45:01.455215 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448566    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 10:45:01.455215 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448568    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 10:45:01.455215 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448571    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 10:45:01.455215 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448573    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 10:45:01.455215 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448576    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 10:45:01.455215 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448578    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 10:45:01.455215 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448581    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 10:45:01.455215 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448583    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 10:45:01.455215 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448585    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 10:45:01.455215 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448588    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 10:45:01.455215 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448591    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 10:45:01.455215 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448594    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 10:45:01.455215 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448597    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 10:45:01.455696 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448600    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 10:45:01.455696 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448602    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 10:45:01.455696 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448605    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 10:45:01.455696 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448607    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 10:45:01.455696 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448609    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 10:45:01.455696 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448612    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 10:45:01.455696 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448614    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 10:45:01.455696 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448617    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 10:45:01.455696 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448619    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 10:45:01.455696 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448622    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 10:45:01.455696 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448624    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 10:45:01.455696 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448627    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 10:45:01.455696 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448629    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 10:45:01.455696 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448632    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 10:45:01.455696 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448634    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 10:45:01.455696 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448637    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 10:45:01.455696 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448640    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 10:45:01.455696 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448642    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 10:45:01.455696 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448644    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 10:45:01.455696 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448647    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 10:45:01.456248 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:01.448649    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 10:45:01.456248 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.448654    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 10:45:01.456248 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.448806    2565 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 15 10:45:01.456248 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.451306    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 15 10:45:01.456248 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.453086    2565 server.go:1019] "Starting client certificate rotation"
Jul 15 10:45:01.456248 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.453186    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 10:45:01.456248 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.453223    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 10:45:01.456248 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.456133    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 10:45:01.462334 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.462315    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 10:45:01.472406 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.472381    2565 log.go:25] "Validated CRI v1 runtime API"
Jul 15 10:45:01.475859 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.475841    2565 log.go:25] "Validated CRI v1 image API"
Jul 15 10:45:01.476708 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.476694    2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 15 10:45:01.480412 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.480391    2565 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 c205be09-484d-49b8-9af1-ee983757192e:/dev/nvme0n1p3 c88b2008-e1db-46c7-9d71-678767d790ce:/dev/nvme0n1p4]
Jul 15 10:45:01.480458 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.480412    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 15 10:45:01.484479 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.484457    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 10:45:01.487743 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.487586    2565 manager.go:216] Machine: {Timestamp:2026-07-15 10:45:01.485244097 +0000 UTC m=+0.378389296 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3128850 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29b651823577e976fb0ba8536376d3 SystemUUID:ec29b651-8235-77e9-76fb-0ba8536376d3 BootID:39a1a4a7-b0b5-44a6-a333-13809828c5e2 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:47:63:13:0f:25 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:47:63:13:0f:25 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:fc:2b:c9:99:39 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 15 10:45:01.487743 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.487717    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 15 10:45:01.487898 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.487885    2565 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 15 10:45:01.491459 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.491424    2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 15 10:45:01.491618 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.491463    2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-216.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 15 10:45:01.492353 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.492340    2565 topology_manager.go:138] "Creating topology manager with none policy"
Jul 15 10:45:01.492394 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.492356    2565 container_manager_linux.go:309] "Creating device plugin manager"
Jul 15 10:45:01.492394 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.492365    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 10:45:01.492394 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.492380    2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 10:45:01.493672 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.493659    2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 15 10:45:01.498428 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.498412    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 10:45:01.498561 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.498550    2565 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 15 10:45:01.498599 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.498588    2565 kubelet.go:486] "Attempting to sync node with API server"
Jul 15 10:45:01.498627 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.498599    2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 15 10:45:01.498627 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.498611    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 15 10:45:01.498627 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.498621    2565 kubelet.go:398] "Adding apiserver pod source"
Jul 15 10:45:01.498741 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.498635    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 15 10:45:01.499097 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.499084    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 10:45:01.499142 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.499103    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 10:45:01.501682 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.501662    2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 15 10:45:01.503488 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.503474    2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 15 10:45:01.503534 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.503505    2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 15 10:45:01.504269 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.504256    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 15 10:45:01.504269 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.504274    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 15 10:45:01.504269 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.504280    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 15 10:45:01.504414 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.504286    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 15 10:45:01.504414 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.504294    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 15 10:45:01.504414 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.504300    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 15 10:45:01.504414 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.504315    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 15 10:45:01.504414 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.504320    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 15 10:45:01.504414 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.504328    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 15 10:45:01.504414 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.504333    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 15 10:45:01.504414 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.504341    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 15 10:45:01.504414 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.504349    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 15 10:45:01.504414 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.504373    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 15 10:45:01.504414 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.504379    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 15 10:45:01.507778 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.507763    2565 server.go:1268] "Started kubelet"
Jul 15 10:45:01.508248 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.508032    2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 15 10:45:01.508427 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.508409    2565 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 15 10:45:01.508502 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.508412    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 15 10:45:01.509049 ip-10-0-134-216 systemd[1]: Started Kubernetes Kubelet.
Jul 15 10:45:01.509877 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.509846    2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 15 10:45:01.510074 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.510011    2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-216.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 15 10:45:01.510140 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:01.510092    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-216.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 15 10:45:01.510262 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:01.510222    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 15 10:45:01.510629 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.510609    2565 server.go:310] "Adding debug handlers to kubelet server"
Jul 15 10:45:01.518439 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:01.517061    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-216.ec2.internal.18c270af82c59ccf  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-216.ec2.internal,UID:ip-10-0-134-216.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-216.ec2.internal,},FirstTimestamp:2026-07-15 10:45:01.507714255 +0000 UTC m=+0.400859507,LastTimestamp:2026-07-15 10:45:01.507714255 +0000 UTC m=+0.400859507,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-216.ec2.internal,}"
Jul 15 10:45:01.520759 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.520713    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 15 10:45:01.520759 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.520742    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 15 10:45:01.520924 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:01.520844    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-216.ec2.internal\" not found"
Jul 15 10:45:01.521561 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.521540    2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 15 10:45:01.521655 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.521581    2565 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 15 10:45:01.521655 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.521598    2565 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 15 10:45:01.521797 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.521763    2565 reconstruct.go:97] "Volume reconstruction finished"
Jul 15 10:45:01.521797 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.521776    2565 reconciler.go:29] "Reconciler: start to sync state"
Jul 15 10:45:01.522039 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:01.522017    2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 15 10:45:01.522145 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.522131    2565 factory.go:55] Registering systemd factory
Jul 15 10:45:01.522191 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.522149    2565 factory.go:223] Registration of the systemd container factory successfully
Jul 15 10:45:01.522421 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.522407    2565 factory.go:153] Registering CRI-O factory
Jul 15 10:45:01.522483 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.522424    2565 factory.go:223] Registration of the crio container factory successfully
Jul 15 10:45:01.522483 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.522475    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 15 10:45:01.522541 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.522503    2565 factory.go:103] Registering Raw factory
Jul 15 10:45:01.522541 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.522521    2565 manager.go:1196] Started watching for new ooms in manager
Jul 15 10:45:01.522908 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.522895    2565 manager.go:349] Starting recovery of all containers
Jul 15 10:45:01.524958 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:01.524847    2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-216.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 15 10:45:01.525025 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:01.524974    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 15 10:45:01.530857 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.530616    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 15 10:45:01.533798 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.533781    2565 manager.go:354] Recovery completed
Jul 15 10:45:01.535399 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:01.535307    2565 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 15 10:45:01.538891 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.538869    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 10:45:01.540014 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.539987    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xjcmg"
Jul 15 10:45:01.541024 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.541006    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-216.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 10:45:01.541077 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.541046    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-216.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 10:45:01.541077 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.541059    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-216.ec2.internal" event="NodeHasSufficientPID"
Jul 15 10:45:01.541595 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.541582    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 15 10:45:01.541648 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.541595    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 10:45:01.541648 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.541595    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 15 10:45:01.541648 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.541642    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 10:45:01.542357 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.542344    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-216.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 10:45:01.542429 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.542369    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-216.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 10:45:01.542429 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.542377    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-216.ec2.internal" event="NodeHasSufficientPID"
Jul 15 10:45:01.543451 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:01.543376    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-216.ec2.internal.18c270af84c1f18a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-216.ec2.internal,UID:ip-10-0-134-216.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-216.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-216.ec2.internal,},FirstTimestamp:2026-07-15 10:45:01.541028234 +0000 UTC m=+0.434173436,LastTimestamp:2026-07-15 10:45:01.541028234 +0000 UTC m=+0.434173436,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-216.ec2.internal,}"
Jul 15 10:45:01.543986 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.543974    2565 policy_none.go:49] "None policy: Start"
Jul 15 10:45:01.544054 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.543991    2565 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 15 10:45:01.544054 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.544009    2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 15 10:45:01.545964 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.545953    2565 policy_none.go:47] "Start"
Jul 15 10:45:01.549027 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.549007    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xjcmg"
Jul 15 10:45:01.554425 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:01.554345    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-216.ec2.internal.18c270af84c25183  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-216.ec2.internal,UID:ip-10-0-134-216.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-216.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-216.ec2.internal,},FirstTimestamp:2026-07-15 10:45:01.541052803 +0000 UTC m=+0.434198002,LastTimestamp:2026-07-15 10:45:01.541052803 +0000 UTC m=+0.434198002,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-216.ec2.internal,}"
Jul 15 10:45:01.582964 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.582943    2565 manager.go:337] "Starting Device Plugin manager"
Jul 15 10:45:01.607205 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:01.583001    2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 15 10:45:01.607205 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.583012    2565 server.go:87] "Starting device plugin registration server"
Jul 15 10:45:01.607205 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.583282    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 15 10:45:01.607205 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.583298    2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 15 10:45:01.607205 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.583398    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 15 10:45:01.607205 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.583484    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 15 10:45:01.607205 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.583492    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 15 10:45:01.607205 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:01.584196    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 15 10:45:01.607205 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:01.584240    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-216.ec2.internal\" not found"
Jul 15 10:45:01.634028 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.633949    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 15 10:45:01.634028 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.633997    2565 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 15 10:45:01.634028 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.634022    2565 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 15 10:45:01.634225 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:01.634056    2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 15 10:45:01.636998 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.636977    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 10:45:01.683706 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.683667    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 10:45:01.684971 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.684951    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-216.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 10:45:01.685097 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.684982    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-216.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 10:45:01.685097 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.684993    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-216.ec2.internal" event="NodeHasSufficientPID"
Jul 15 10:45:01.685097 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.685020    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-216.ec2.internal"
Jul 15 10:45:01.694559 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.694538    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-216.ec2.internal"
Jul 15 10:45:01.694559 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:01.694566    2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-216.ec2.internal\": node \"ip-10-0-134-216.ec2.internal\" not found"
Jul 15 10:45:01.722258 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:01.722234    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-216.ec2.internal\" not found"
Jul 15 10:45:01.734154 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.734129    2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-216.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-216.ec2.internal"]
Jul 15 10:45:01.734252 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.734195    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 10:45:01.735255 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.735238    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-216.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 10:45:01.735310 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.735266    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-216.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 10:45:01.735310 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.735279    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-216.ec2.internal" event="NodeHasSufficientPID"
Jul 15 10:45:01.737745 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.737717    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 10:45:01.737849 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.737833    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-216.ec2.internal"
Jul 15 10:45:01.737904 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.737865    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 10:45:01.738502 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.738487    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-216.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 10:45:01.738582 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.738509    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-216.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 10:45:01.738582 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.738490    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-216.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 10:45:01.738582 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.738543    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-216.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 10:45:01.738582 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.738519    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-216.ec2.internal" event="NodeHasSufficientPID"
Jul 15 10:45:01.738696 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.738561    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-216.ec2.internal" event="NodeHasSufficientPID"
Jul 15 10:45:01.740945 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.740930    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-216.ec2.internal"
Jul 15 10:45:01.740989 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.740958    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 10:45:01.741695 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.741682    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-216.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 10:45:01.741759 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.741704    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-216.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 10:45:01.741759 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.741713    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-216.ec2.internal" event="NodeHasSufficientPID"
Jul 15 10:45:01.771655 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:01.771623    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-216.ec2.internal\" not found" node="ip-10-0-134-216.ec2.internal"
Jul 15 10:45:01.776242 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:01.776221    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-216.ec2.internal\" not found" node="ip-10-0-134-216.ec2.internal"
Jul 15 10:45:01.822523 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:01.822484    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-216.ec2.internal\" not found"
Jul 15 10:45:01.823274 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.823256    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/555b18a426b488b1398d4227fda6ee59-config\") pod \"kube-apiserver-proxy-ip-10-0-134-216.ec2.internal\" (UID: \"555b18a426b488b1398d4227fda6ee59\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-216.ec2.internal"
Jul 15 10:45:01.823351 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.823282    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0e5e62cf154ddbdbbccda45b7fc44e8f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-216.ec2.internal\" (UID: \"0e5e62cf154ddbdbbccda45b7fc44e8f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-216.ec2.internal"
Jul 15 10:45:01.823351 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.823298    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e5e62cf154ddbdbbccda45b7fc44e8f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-216.ec2.internal\" (UID: \"0e5e62cf154ddbdbbccda45b7fc44e8f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-216.ec2.internal"
Jul 15 10:45:01.922617 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:01.922541    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-216.ec2.internal\" not found"
Jul 15 10:45:01.923666 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.923646    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e5e62cf154ddbdbbccda45b7fc44e8f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-216.ec2.internal\" (UID: \"0e5e62cf154ddbdbbccda45b7fc44e8f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-216.ec2.internal"
Jul 15 10:45:01.923714 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.923675    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/555b18a426b488b1398d4227fda6ee59-config\") pod \"kube-apiserver-proxy-ip-10-0-134-216.ec2.internal\" (UID: \"555b18a426b488b1398d4227fda6ee59\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-216.ec2.internal"
Jul 15 10:45:01.923714 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.923693    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0e5e62cf154ddbdbbccda45b7fc44e8f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-216.ec2.internal\" (UID: \"0e5e62cf154ddbdbbccda45b7fc44e8f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-216.ec2.internal"
Jul 15 10:45:01.923832 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.923749    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0e5e62cf154ddbdbbccda45b7fc44e8f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-216.ec2.internal\" (UID: \"0e5e62cf154ddbdbbccda45b7fc44e8f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-216.ec2.internal"
Jul 15 10:45:01.923832 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.923766    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e5e62cf154ddbdbbccda45b7fc44e8f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-216.ec2.internal\" (UID: \"0e5e62cf154ddbdbbccda45b7fc44e8f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-216.ec2.internal"
Jul 15 10:45:01.923832 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:01.923799    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/555b18a426b488b1398d4227fda6ee59-config\") pod \"kube-apiserver-proxy-ip-10-0-134-216.ec2.internal\" (UID: \"555b18a426b488b1398d4227fda6ee59\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-216.ec2.internal"
Jul 15 10:45:02.023333 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:02.023278    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-216.ec2.internal\" not found"
Jul 15 10:45:02.074548 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.074520    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-216.ec2.internal"
Jul 15 10:45:02.079778 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.079539    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-216.ec2.internal"
Jul 15 10:45:02.123541 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:02.123503    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-216.ec2.internal\" not found"
Jul 15 10:45:02.224018 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:02.223925    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-216.ec2.internal\" not found"
Jul 15 10:45:02.324501 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:02.324453    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-216.ec2.internal\" not found"
Jul 15 10:45:02.362392 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.362362    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 10:45:02.421781 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.421745    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-216.ec2.internal"
Jul 15 10:45:02.439245 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.439217    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 10:45:02.440808 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.440791    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-216.ec2.internal"
Jul 15 10:45:02.449427 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.449408    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 10:45:02.452534 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.452515    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 15 10:45:02.452651 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.452636    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 10:45:02.452706 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.452684    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 10:45:02.498918 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.498837    2565 apiserver.go:52] "Watching apiserver"
Jul 15 10:45:02.515958 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.515927    2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 15 10:45:02.516359 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.516337    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-whhb7","openshift-dns/node-resolver-ww2zd","openshift-image-registry/node-ca-fqz5r","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-216.ec2.internal","openshift-multus/multus-v9wb9","openshift-multus/network-metrics-daemon-c4bht","openshift-network-diagnostics/network-check-target-5zwx4","kube-system/global-pull-secret-syncer-zrr95","kube-system/kube-apiserver-proxy-ip-10-0-134-216.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2pzx","openshift-multus/multus-additional-cni-plugins-tktcw","openshift-network-operator/iptables-alerter-776nq","openshift-ovn-kubernetes/ovnkube-node-qsch8","kube-system/konnectivity-agent-qbkwp"]
Jul 15 10:45:02.519465 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.519445    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.521576 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.521555    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 15 10:45:02.522017 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.521997    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4bht"
Jul 15 10:45:02.522108 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:02.522082    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4bht" podUID="f16a7597-8022-437b-a82b-ab187296ecdf"
Jul 15 10:45:02.524701 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.524672    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zwx4"
Jul 15 10:45:02.524701 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.524696    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 15 10:45:02.524852 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:02.524772    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zwx4" podUID="e2a51efd-e7a8-4db0-8ded-c90e680619c8"
Jul 15 10:45:02.525011 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.524992    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 15 10:45:02.525043 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.525011    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-74zps\""
Jul 15 10:45:02.525081 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.525065    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 15 10:45:02.525147 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.525134    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 15 10:45:02.526138 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.526120    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/12698506-aebe-4df1-aecc-e7d7d7aef8ec-cni-binary-copy\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.526263 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.526146    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/12698506-aebe-4df1-aecc-e7d7d7aef8ec-hostroot\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.526263 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.526162    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srk9t\" (UniqueName: \"kubernetes.io/projected/12698506-aebe-4df1-aecc-e7d7d7aef8ec-kube-api-access-srk9t\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.526263 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.526175    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/12698506-aebe-4df1-aecc-e7d7d7aef8ec-host-var-lib-kubelet\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.526263 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.526195    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/12698506-aebe-4df1-aecc-e7d7d7aef8ec-multus-cni-dir\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.526263 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.526216    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/12698506-aebe-4df1-aecc-e7d7d7aef8ec-cnibin\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.526263 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.526270    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/12698506-aebe-4df1-aecc-e7d7d7aef8ec-host-run-netns\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.526485 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.526294    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/12698506-aebe-4df1-aecc-e7d7d7aef8ec-host-run-multus-certs\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.526485 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.526316    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f16a7597-8022-437b-a82b-ab187296ecdf-metrics-certs\") pod \"network-metrics-daemon-c4bht\" (UID: \"f16a7597-8022-437b-a82b-ab187296ecdf\") " pod="openshift-multus/network-metrics-daemon-c4bht"
Jul 15 10:45:02.526485 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.526339    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/12698506-aebe-4df1-aecc-e7d7d7aef8ec-system-cni-dir\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.526485 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.526362    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/12698506-aebe-4df1-aecc-e7d7d7aef8ec-host-run-k8s-cni-cncf-io\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.526485 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.526398    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/12698506-aebe-4df1-aecc-e7d7d7aef8ec-host-var-lib-cni-bin\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.526485 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.526422    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/12698506-aebe-4df1-aecc-e7d7d7aef8ec-multus-conf-dir\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.526485 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.526447    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/12698506-aebe-4df1-aecc-e7d7d7aef8ec-multus-daemon-config\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.526485 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.526463    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4nfs\" (UniqueName: \"kubernetes.io/projected/f16a7597-8022-437b-a82b-ab187296ecdf-kube-api-access-d4nfs\") pod \"network-metrics-daemon-c4bht\" (UID: \"f16a7597-8022-437b-a82b-ab187296ecdf\") " pod="openshift-multus/network-metrics-daemon-c4bht"
Jul 15 10:45:02.526485 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.526484    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxrvg\" (UniqueName: \"kubernetes.io/projected/e2a51efd-e7a8-4db0-8ded-c90e680619c8-kube-api-access-xxrvg\") pod \"network-check-target-5zwx4\" (UID: \"e2a51efd-e7a8-4db0-8ded-c90e680619c8\") " pod="openshift-network-diagnostics/network-check-target-5zwx4"
Jul 15 10:45:02.526816 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.526508    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/12698506-aebe-4df1-aecc-e7d7d7aef8ec-host-var-lib-cni-multus\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.526816 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.526540    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/12698506-aebe-4df1-aecc-e7d7d7aef8ec-os-release\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.526816 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.526564    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/12698506-aebe-4df1-aecc-e7d7d7aef8ec-multus-socket-dir-parent\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.526816 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.526586    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12698506-aebe-4df1-aecc-e7d7d7aef8ec-etc-kubernetes\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.527372 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.527346    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fqz5r"
Jul 15 10:45:02.530083 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.530065    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ww2zd"
Jul 15 10:45:02.530794 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.530776    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 15 10:45:02.531044 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.531023    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5gp8k\""
Jul 15 10:45:02.531044 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.531040    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 15 10:45:02.533197 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.533179    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-whhb7"
Jul 15 10:45:02.535978 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.535960    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrr95"
Jul 15 10:45:02.536071 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:02.536037    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrr95" podUID="82f6960e-f41d-4ad3-83c4-c515ff206787"
Jul 15 10:45:02.536871 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.536658    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 15 10:45:02.536871 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.536699    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 15 10:45:02.536871 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.536741    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 15 10:45:02.536871 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.536769    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6bq74\""
Jul 15 10:45:02.536871 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.536658    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 15 10:45:02.536871 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.536810    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5nzzt\""
Jul 15 10:45:02.537122 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.537046    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 15 10:45:02.538264 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.538245    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2pzx"
Jul 15 10:45:02.540913 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.540894    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tktcw"
Jul 15 10:45:02.541337 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.541322    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 15 10:45:02.542002 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.541982    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 15 10:45:02.542107 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.542081    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 15 10:45:02.542193 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.542178    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cnsjh\""
Jul 15 10:45:02.542980 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.542961    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 10:45:02.543265 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.543244    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-776nq"
Jul 15 10:45:02.543353 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.543272    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 15 10:45:02.543353 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.543250    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 15 10:45:02.544085 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.544050    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qmrgq\""
Jul 15 10:45:02.545765 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.545746    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.546682 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.546663    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xn5wp\""
Jul 15 10:45:02.547304 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.547287    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 15 10:45:02.548379 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.548359    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qbkwp"
Jul 15 10:45:02.549397 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.549379    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 15 10:45:02.549504 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.549427    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 15 10:45:02.549504 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.549434    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 15 10:45:02.549822 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.549804    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 15 10:45:02.550331 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.550315    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 15 10:45:02.550521 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.550410    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 15 10:45:02.550521 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.550421    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 15 10:45:02.550521 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.550439    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mhnp9\""
Jul 15 10:45:02.551628 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.551611    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 15 10:45:02.551801 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.551780    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 15 10:45:02.551908 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.551872    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qb56n\""
Jul 15 10:45:02.552628 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.552608    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 15 10:45:02.555872 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.555836    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 10:40:02 +0000 UTC" deadline="2028-04-05 20:06:48.666335516 +0000 UTC"
Jul 15 10:45:02.555872 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.555864    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15129h21m46.110475352s"
Jul 15 10:45:02.581030 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.581002    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hfjtx"
Jul 15 10:45:02.595301 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.595275    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hfjtx"
Jul 15 10:45:02.622549 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.622528    2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 15 10:45:02.627045 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.627025    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e288a6cb-6662-4b30-ab6b-dc839a2cd17c-etc-sysconfig\") pod \"tuned-whhb7\" (UID: \"e288a6cb-6662-4b30-ab6b-dc839a2cd17c\") " pod="openshift-cluster-node-tuning-operator/tuned-whhb7"
Jul 15 10:45:02.627130 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.627053    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e288a6cb-6662-4b30-ab6b-dc839a2cd17c-etc-sysctl-conf\") pod \"tuned-whhb7\" (UID: \"e288a6cb-6662-4b30-ab6b-dc839a2cd17c\") " pod="openshift-cluster-node-tuning-operator/tuned-whhb7"
Jul 15 10:45:02.627130 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.627070    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e288a6cb-6662-4b30-ab6b-dc839a2cd17c-host\") pod \"tuned-whhb7\" (UID: \"e288a6cb-6662-4b30-ab6b-dc839a2cd17c\") " pod="openshift-cluster-node-tuning-operator/tuned-whhb7"
Jul 15 10:45:02.627130 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.627089    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/12698506-aebe-4df1-aecc-e7d7d7aef8ec-host-var-lib-cni-multus\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.627130 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.627106    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6334daaf-6478-49ab-a989-ce254cc9a0d0-cnibin\") pod \"multus-additional-cni-plugins-tktcw\" (UID: \"6334daaf-6478-49ab-a989-ce254cc9a0d0\") " pod="openshift-multus/multus-additional-cni-plugins-tktcw"
Jul 15 10:45:02.627130 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.627128    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/94259076-1de7-4312-a19a-5760311ec791-hosts-file\") pod \"node-resolver-ww2zd\" (UID: \"94259076-1de7-4312-a19a-5760311ec791\") " pod="openshift-dns/node-resolver-ww2zd"
Jul 15 10:45:02.627358 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.627162    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/12698506-aebe-4df1-aecc-e7d7d7aef8ec-host-var-lib-cni-multus\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.627358 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.627211    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/12698506-aebe-4df1-aecc-e7d7d7aef8ec-cni-binary-copy\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.627358 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.627253    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/12698506-aebe-4df1-aecc-e7d7d7aef8ec-hostroot\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.627358 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.627291    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e288a6cb-6662-4b30-ab6b-dc839a2cd17c-run\") pod \"tuned-whhb7\" (UID: \"e288a6cb-6662-4b30-ab6b-dc839a2cd17c\") " pod="openshift-cluster-node-tuning-operator/tuned-whhb7"
Jul 15 10:45:02.627358 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.627302    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/12698506-aebe-4df1-aecc-e7d7d7aef8ec-hostroot\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.627358 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.627317    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-host-slash\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.627358 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.627337    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-env-overrides\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.627677 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.627416    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/12698506-aebe-4df1-aecc-e7d7d7aef8ec-host-var-lib-kubelet\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.627677 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.627452    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6334daaf-6478-49ab-a989-ce254cc9a0d0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tktcw\" (UID: \"6334daaf-6478-49ab-a989-ce254cc9a0d0\") " pod="openshift-multus/multus-additional-cni-plugins-tktcw"
Jul 15 10:45:02.627677 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.627484    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4e117f92-f585-4797-9dfa-b9cf0f00026d-device-dir\") pod \"aws-ebs-csi-driver-node-k2pzx\" (UID: \"4e117f92-f585-4797-9dfa-b9cf0f00026d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2pzx"
Jul 15 10:45:02.627677 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.627510    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-ovnkube-config\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.627677 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.627522    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/12698506-aebe-4df1-aecc-e7d7d7aef8ec-host-var-lib-kubelet\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.627677 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.627550    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/12698506-aebe-4df1-aecc-e7d7d7aef8ec-multus-conf-dir\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.627677 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.627573    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/12698506-aebe-4df1-aecc-e7d7d7aef8ec-multus-daemon-config\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.627677 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.627602    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/12698506-aebe-4df1-aecc-e7d7d7aef8ec-multus-conf-dir\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.627677 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.627640    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4nfs\" (UniqueName: \"kubernetes.io/projected/f16a7597-8022-437b-a82b-ab187296ecdf-kube-api-access-d4nfs\") pod \"network-metrics-daemon-c4bht\" (UID: \"f16a7597-8022-437b-a82b-ab187296ecdf\") " pod="openshift-multus/network-metrics-daemon-c4bht"
Jul 15 10:45:02.628141 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.627764    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6334daaf-6478-49ab-a989-ce254cc9a0d0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tktcw\" (UID: \"6334daaf-6478-49ab-a989-ce254cc9a0d0\") " pod="openshift-multus/multus-additional-cni-plugins-tktcw"
Jul 15 10:45:02.628141 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.627794    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-run-openvswitch\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.628141 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.627820    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e512c0b0-fbba-491f-8024-0243b8f12f54-serviceca\") pod \"node-ca-fqz5r\" (UID: \"e512c0b0-fbba-491f-8024-0243b8f12f54\") " pod="openshift-image-registry/node-ca-fqz5r"
Jul 15 10:45:02.628141 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.627842    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e288a6cb-6662-4b30-ab6b-dc839a2cd17c-etc-modprobe-d\") pod \"tuned-whhb7\" (UID: \"e288a6cb-6662-4b30-ab6b-dc839a2cd17c\") " pod="openshift-cluster-node-tuning-operator/tuned-whhb7"
Jul 15 10:45:02.628141 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.627867    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e288a6cb-6662-4b30-ab6b-dc839a2cd17c-sys\") pod \"tuned-whhb7\" (UID: \"e288a6cb-6662-4b30-ab6b-dc839a2cd17c\") " pod="openshift-cluster-node-tuning-operator/tuned-whhb7"
Jul 15 10:45:02.628141 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.627884    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/12698506-aebe-4df1-aecc-e7d7d7aef8ec-cni-binary-copy\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.628141 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.627892    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvx4t\" (UniqueName: \"kubernetes.io/projected/e288a6cb-6662-4b30-ab6b-dc839a2cd17c-kube-api-access-xvx4t\") pod \"tuned-whhb7\" (UID: \"e288a6cb-6662-4b30-ab6b-dc839a2cd17c\") " pod="openshift-cluster-node-tuning-operator/tuned-whhb7"
Jul 15 10:45:02.628141 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.627957    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/66820680-27f1-431d-aa6e-d2d0e4a10f15-iptables-alerter-script\") pod \"iptables-alerter-776nq\" (UID: \"66820680-27f1-431d-aa6e-d2d0e4a10f15\") " pod="openshift-network-operator/iptables-alerter-776nq"
Jul 15 10:45:02.628141 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.627984    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e288a6cb-6662-4b30-ab6b-dc839a2cd17c-var-lib-kubelet\") pod \"tuned-whhb7\" (UID: \"e288a6cb-6662-4b30-ab6b-dc839a2cd17c\") " pod="openshift-cluster-node-tuning-operator/tuned-whhb7"
Jul 15 10:45:02.628141 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.628016    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4e117f92-f585-4797-9dfa-b9cf0f00026d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k2pzx\" (UID: \"4e117f92-f585-4797-9dfa-b9cf0f00026d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2pzx"
Jul 15 10:45:02.628141 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.628046    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/12698506-aebe-4df1-aecc-e7d7d7aef8ec-multus-cni-dir\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.628141 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.628070    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/12698506-aebe-4df1-aecc-e7d7d7aef8ec-host-run-multus-certs\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.628141 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.628083    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/12698506-aebe-4df1-aecc-e7d7d7aef8ec-multus-daemon-config\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.628141 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.628088    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6334daaf-6478-49ab-a989-ce254cc9a0d0-os-release\") pod \"multus-additional-cni-plugins-tktcw\" (UID: \"6334daaf-6478-49ab-a989-ce254cc9a0d0\") " pod="openshift-multus/multus-additional-cni-plugins-tktcw"
Jul 15 10:45:02.628141 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.628119    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/12698506-aebe-4df1-aecc-e7d7d7aef8ec-multus-cni-dir\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.628141 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.628133    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/12698506-aebe-4df1-aecc-e7d7d7aef8ec-host-run-multus-certs\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.628708 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.628156    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4e117f92-f585-4797-9dfa-b9cf0f00026d-sys-fs\") pod \"aws-ebs-csi-driver-node-k2pzx\" (UID: \"4e117f92-f585-4797-9dfa-b9cf0f00026d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2pzx"
Jul 15 10:45:02.628708 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.628176    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e288a6cb-6662-4b30-ab6b-dc839a2cd17c-etc-systemd\") pod \"tuned-whhb7\" (UID: \"e288a6cb-6662-4b30-ab6b-dc839a2cd17c\") " pod="openshift-cluster-node-tuning-operator/tuned-whhb7"
Jul 15 10:45:02.628708 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.628195    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e288a6cb-6662-4b30-ab6b-dc839a2cd17c-etc-tuned\") pod \"tuned-whhb7\" (UID: \"e288a6cb-6662-4b30-ab6b-dc839a2cd17c\") " pod="openshift-cluster-node-tuning-operator/tuned-whhb7"
Jul 15 10:45:02.628708 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.628211    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/12698506-aebe-4df1-aecc-e7d7d7aef8ec-system-cni-dir\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.628708 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.628225    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e512c0b0-fbba-491f-8024-0243b8f12f54-host\") pod \"node-ca-fqz5r\" (UID: \"e512c0b0-fbba-491f-8024-0243b8f12f54\") " pod="openshift-image-registry/node-ca-fqz5r"
Jul 15 10:45:02.628708 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.628245    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6334daaf-6478-49ab-a989-ce254cc9a0d0-system-cni-dir\") pod \"multus-additional-cni-plugins-tktcw\" (UID: \"6334daaf-6478-49ab-a989-ce254cc9a0d0\") " pod="openshift-multus/multus-additional-cni-plugins-tktcw"
Jul 15 10:45:02.628708 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.628269    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhrrk\" (UniqueName: \"kubernetes.io/projected/94259076-1de7-4312-a19a-5760311ec791-kube-api-access-hhrrk\") pod \"node-resolver-ww2zd\" (UID: \"94259076-1de7-4312-a19a-5760311ec791\") " pod="openshift-dns/node-resolver-ww2zd"
Jul 15 10:45:02.628708 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.628285    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/12698506-aebe-4df1-aecc-e7d7d7aef8ec-system-cni-dir\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.628708 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.628299    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4e117f92-f585-4797-9dfa-b9cf0f00026d-etc-selinux\") pod \"aws-ebs-csi-driver-node-k2pzx\" (UID: \"4e117f92-f585-4797-9dfa-b9cf0f00026d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2pzx"
Jul 15 10:45:02.628708 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.628351    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-var-lib-openvswitch\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.628708 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.628378    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/12698506-aebe-4df1-aecc-e7d7d7aef8ec-os-release\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.628708 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.628395    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/12698506-aebe-4df1-aecc-e7d7d7aef8ec-multus-socket-dir-parent\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.628708 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.628414    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12698506-aebe-4df1-aecc-e7d7d7aef8ec-etc-kubernetes\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.628708 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.628437    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94259076-1de7-4312-a19a-5760311ec791-tmp-dir\") pod \"node-resolver-ww2zd\" (UID: \"94259076-1de7-4312-a19a-5760311ec791\") " pod="openshift-dns/node-resolver-ww2zd"
Jul 15 10:45:02.628708 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.628463    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12698506-aebe-4df1-aecc-e7d7d7aef8ec-etc-kubernetes\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.628708 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.628475    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqjfc\" (UniqueName: \"kubernetes.io/projected/4e117f92-f585-4797-9dfa-b9cf0f00026d-kube-api-access-rqjfc\") pod \"aws-ebs-csi-driver-node-k2pzx\" (UID: \"4e117f92-f585-4797-9dfa-b9cf0f00026d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2pzx"
Jul 15 10:45:02.628708 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.628466    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/12698506-aebe-4df1-aecc-e7d7d7aef8ec-os-release\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.629418 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.628482    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/12698506-aebe-4df1-aecc-e7d7d7aef8ec-multus-socket-dir-parent\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.629418 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.628498    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-node-log\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.629418 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.628527    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.629418 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.628553    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-ovnkube-script-lib\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.629418 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.628580    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srk9t\" (UniqueName: \"kubernetes.io/projected/12698506-aebe-4df1-aecc-e7d7d7aef8ec-kube-api-access-srk9t\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.629418 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.628598    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/82f6960e-f41d-4ad3-83c4-c515ff206787-original-pull-secret\") pod \"global-pull-secret-syncer-zrr95\" (UID: \"82f6960e-f41d-4ad3-83c4-c515ff206787\") " pod="kube-system/global-pull-secret-syncer-zrr95"
Jul 15 10:45:02.629418 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.628613    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6334daaf-6478-49ab-a989-ce254cc9a0d0-cni-binary-copy\") pod \"multus-additional-cni-plugins-tktcw\" (UID: \"6334daaf-6478-49ab-a989-ce254cc9a0d0\") " pod="openshift-multus/multus-additional-cni-plugins-tktcw"
Jul 15 10:45:02.629418 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.628739    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e288a6cb-6662-4b30-ab6b-dc839a2cd17c-etc-sysctl-d\") pod \"tuned-whhb7\" (UID: \"e288a6cb-6662-4b30-ab6b-dc839a2cd17c\") " pod="openshift-cluster-node-tuning-operator/tuned-whhb7"
Jul 15 10:45:02.629418 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.628780    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-host-cni-netd\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.629418 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.628813    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89jl5\" (UniqueName: \"kubernetes.io/projected/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-kube-api-access-89jl5\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.629418 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.628838    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/12698506-aebe-4df1-aecc-e7d7d7aef8ec-cnibin\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.629418 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.628875    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-run-systemd\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.629418 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.628909    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6334daaf-6478-49ab-a989-ce254cc9a0d0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tktcw\" (UID: \"6334daaf-6478-49ab-a989-ce254cc9a0d0\") " pod="openshift-multus/multus-additional-cni-plugins-tktcw"
Jul 15 10:45:02.629418 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.628919    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/12698506-aebe-4df1-aecc-e7d7d7aef8ec-cnibin\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.629418 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.628936    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-host-kubelet\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.629418 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.628959    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-host-run-netns\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.630129 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.628980    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-run-ovn\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.630129 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.629030    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-host-run-ovn-kubernetes\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.630129 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.629080    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-host-cni-bin\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.630129 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.629113    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-ovn-node-metrics-cert\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.630129 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.629141    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e288a6cb-6662-4b30-ab6b-dc839a2cd17c-tmp\") pod \"tuned-whhb7\" (UID: \"e288a6cb-6662-4b30-ab6b-dc839a2cd17c\") " pod="openshift-cluster-node-tuning-operator/tuned-whhb7"
Jul 15 10:45:02.630129 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.629168    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/66820680-27f1-431d-aa6e-d2d0e4a10f15-host-slash\") pod \"iptables-alerter-776nq\" (UID: \"66820680-27f1-431d-aa6e-d2d0e4a10f15\") " pod="openshift-network-operator/iptables-alerter-776nq"
Jul 15 10:45:02.630129 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.629190    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czcmk\" (UniqueName: \"kubernetes.io/projected/66820680-27f1-431d-aa6e-d2d0e4a10f15-kube-api-access-czcmk\") pod \"iptables-alerter-776nq\" (UID: \"66820680-27f1-431d-aa6e-d2d0e4a10f15\") " pod="openshift-network-operator/iptables-alerter-776nq"
Jul 15 10:45:02.630129 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.629207    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-systemd-units\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.630129 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.629221    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-log-socket\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.630129 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.629245    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1f06a99c-0c14-4fde-abcc-0b6cdf8bc447-agent-certs\") pod \"konnectivity-agent-qbkwp\" (UID: \"1f06a99c-0c14-4fde-abcc-0b6cdf8bc447\") " pod="kube-system/konnectivity-agent-qbkwp"
Jul 15 10:45:02.630129 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.629338    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xhdz\" (UniqueName: \"kubernetes.io/projected/6334daaf-6478-49ab-a989-ce254cc9a0d0-kube-api-access-2xhdz\") pod \"multus-additional-cni-plugins-tktcw\" (UID: \"6334daaf-6478-49ab-a989-ce254cc9a0d0\") " pod="openshift-multus/multus-additional-cni-plugins-tktcw"
Jul 15 10:45:02.630129 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.629363    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-etc-openvswitch\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.630129 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.629388    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1f06a99c-0c14-4fde-abcc-0b6cdf8bc447-konnectivity-ca\") pod \"konnectivity-agent-qbkwp\" (UID: \"1f06a99c-0c14-4fde-abcc-0b6cdf8bc447\") " pod="kube-system/konnectivity-agent-qbkwp"
Jul 15 10:45:02.630129 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.629407    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e288a6cb-6662-4b30-ab6b-dc839a2cd17c-etc-kubernetes\") pod \"tuned-whhb7\" (UID: \"e288a6cb-6662-4b30-ab6b-dc839a2cd17c\") " pod="openshift-cluster-node-tuning-operator/tuned-whhb7"
Jul 15 10:45:02.630129 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.629425    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e288a6cb-6662-4b30-ab6b-dc839a2cd17c-lib-modules\") pod \"tuned-whhb7\" (UID: \"e288a6cb-6662-4b30-ab6b-dc839a2cd17c\") " pod="openshift-cluster-node-tuning-operator/tuned-whhb7"
Jul 15 10:45:02.630129 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.629452    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/12698506-aebe-4df1-aecc-e7d7d7aef8ec-host-run-netns\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.630129 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.629482    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/12698506-aebe-4df1-aecc-e7d7d7aef8ec-host-run-netns\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.630613 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.629534    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f16a7597-8022-437b-a82b-ab187296ecdf-metrics-certs\") pod \"network-metrics-daemon-c4bht\" (UID: \"f16a7597-8022-437b-a82b-ab187296ecdf\") " pod="openshift-multus/network-metrics-daemon-c4bht"
Jul 15 10:45:02.630613 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.629563    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxrvg\" (UniqueName: \"kubernetes.io/projected/e2a51efd-e7a8-4db0-8ded-c90e680619c8-kube-api-access-xxrvg\") pod \"network-check-target-5zwx4\" (UID: \"e2a51efd-e7a8-4db0-8ded-c90e680619c8\") " pod="openshift-network-diagnostics/network-check-target-5zwx4"
Jul 15 10:45:02.630613 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:02.629604    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 10:45:02.630613 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.629608    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4e117f92-f585-4797-9dfa-b9cf0f00026d-registration-dir\") pod \"aws-ebs-csi-driver-node-k2pzx\" (UID: \"4e117f92-f585-4797-9dfa-b9cf0f00026d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2pzx"
Jul 15 10:45:02.630613 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.629763    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4e117f92-f585-4797-9dfa-b9cf0f00026d-socket-dir\") pod \"aws-ebs-csi-driver-node-k2pzx\" (UID: \"4e117f92-f585-4797-9dfa-b9cf0f00026d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2pzx"
Jul 15 10:45:02.630613 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:02.629797    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f16a7597-8022-437b-a82b-ab187296ecdf-metrics-certs podName:f16a7597-8022-437b-a82b-ab187296ecdf nodeName:}" failed. No retries permitted until 2026-07-15 10:45:03.1297622 +0000 UTC m=+2.022907387 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f16a7597-8022-437b-a82b-ab187296ecdf-metrics-certs") pod "network-metrics-daemon-c4bht" (UID: "f16a7597-8022-437b-a82b-ab187296ecdf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 10:45:02.630613 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.629896    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/82f6960e-f41d-4ad3-83c4-c515ff206787-dbus\") pod \"global-pull-secret-syncer-zrr95\" (UID: \"82f6960e-f41d-4ad3-83c4-c515ff206787\") " pod="kube-system/global-pull-secret-syncer-zrr95"
Jul 15 10:45:02.630613 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.629933    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/12698506-aebe-4df1-aecc-e7d7d7aef8ec-host-run-k8s-cni-cncf-io\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.630613 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.629957    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/12698506-aebe-4df1-aecc-e7d7d7aef8ec-host-var-lib-cni-bin\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.630613 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.629983    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/12698506-aebe-4df1-aecc-e7d7d7aef8ec-host-run-k8s-cni-cncf-io\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.630613 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.629982    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp9fv\" (UniqueName: \"kubernetes.io/projected/e512c0b0-fbba-491f-8024-0243b8f12f54-kube-api-access-hp9fv\") pod \"node-ca-fqz5r\" (UID: \"e512c0b0-fbba-491f-8024-0243b8f12f54\") " pod="openshift-image-registry/node-ca-fqz5r"
Jul 15 10:45:02.630613 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.630034    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/12698506-aebe-4df1-aecc-e7d7d7aef8ec-host-var-lib-cni-bin\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.630613 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.630038    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/82f6960e-f41d-4ad3-83c4-c515ff206787-kubelet-config\") pod \"global-pull-secret-syncer-zrr95\" (UID: \"82f6960e-f41d-4ad3-83c4-c515ff206787\") " pod="kube-system/global-pull-secret-syncer-zrr95"
Jul 15 10:45:02.634879 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.634853    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 15 10:45:02.637897 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.637878    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4nfs\" (UniqueName: \"kubernetes.io/projected/f16a7597-8022-437b-a82b-ab187296ecdf-kube-api-access-d4nfs\") pod \"network-metrics-daemon-c4bht\" (UID: \"f16a7597-8022-437b-a82b-ab187296ecdf\") " pod="openshift-multus/network-metrics-daemon-c4bht"
Jul 15 10:45:02.639098 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:02.639081    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 10:45:02.639170 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:02.639106    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 10:45:02.639170 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:02.639117    2565 projected.go:196] Error preparing data for projected volume kube-api-access-xxrvg for pod openshift-network-diagnostics/network-check-target-5zwx4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 10:45:02.639170 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:02.639165    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2a51efd-e7a8-4db0-8ded-c90e680619c8-kube-api-access-xxrvg podName:e2a51efd-e7a8-4db0-8ded-c90e680619c8 nodeName:}" failed. No retries permitted until 2026-07-15 10:45:03.139152653 +0000 UTC m=+2.032297839 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xxrvg" (UniqueName: "kubernetes.io/projected/e2a51efd-e7a8-4db0-8ded-c90e680619c8-kube-api-access-xxrvg") pod "network-check-target-5zwx4" (UID: "e2a51efd-e7a8-4db0-8ded-c90e680619c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 10:45:02.641498 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.641424    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 10:45:02.642709 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.642686    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srk9t\" (UniqueName: \"kubernetes.io/projected/12698506-aebe-4df1-aecc-e7d7d7aef8ec-kube-api-access-srk9t\") pod \"multus-v9wb9\" (UID: \"12698506-aebe-4df1-aecc-e7d7d7aef8ec\") " pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.659081 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:02.659048    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod555b18a426b488b1398d4227fda6ee59.slice/crio-9df0b339fcb26d90eb6201d17a05c7e2ab55006cd7c9b4c93f02a3bf4e556ff2 WatchSource:0}: Error finding container 9df0b339fcb26d90eb6201d17a05c7e2ab55006cd7c9b4c93f02a3bf4e556ff2: Status 404 returned error can't find the container with id 9df0b339fcb26d90eb6201d17a05c7e2ab55006cd7c9b4c93f02a3bf4e556ff2
Jul 15 10:45:02.663573 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.663557    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 10:45:02.730813 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.730778    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4e117f92-f585-4797-9dfa-b9cf0f00026d-etc-selinux\") pod \"aws-ebs-csi-driver-node-k2pzx\" (UID: \"4e117f92-f585-4797-9dfa-b9cf0f00026d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2pzx"
Jul 15 10:45:02.731010 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.730827    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-var-lib-openvswitch\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.731010 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.730854    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94259076-1de7-4312-a19a-5760311ec791-tmp-dir\") pod \"node-resolver-ww2zd\" (UID: \"94259076-1de7-4312-a19a-5760311ec791\") " pod="openshift-dns/node-resolver-ww2zd"
Jul 15 10:45:02.731010 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.730875    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqjfc\" (UniqueName: \"kubernetes.io/projected/4e117f92-f585-4797-9dfa-b9cf0f00026d-kube-api-access-rqjfc\") pod \"aws-ebs-csi-driver-node-k2pzx\" (UID: \"4e117f92-f585-4797-9dfa-b9cf0f00026d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2pzx"
Jul 15 10:45:02.731010 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.730892    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-var-lib-openvswitch\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.731010 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.730922    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-node-log\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.731010 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.730924    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4e117f92-f585-4797-9dfa-b9cf0f00026d-etc-selinux\") pod \"aws-ebs-csi-driver-node-k2pzx\" (UID: \"4e117f92-f585-4797-9dfa-b9cf0f00026d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2pzx"
Jul 15 10:45:02.731010 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.730961    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.731010 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.730989    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-ovnkube-script-lib\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.731010 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.730997    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.731010 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.730963    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-node-log\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.731550 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.731018    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/82f6960e-f41d-4ad3-83c4-c515ff206787-original-pull-secret\") pod \"global-pull-secret-syncer-zrr95\" (UID: \"82f6960e-f41d-4ad3-83c4-c515ff206787\") " pod="kube-system/global-pull-secret-syncer-zrr95"
Jul 15 10:45:02.731550 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.731142    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6334daaf-6478-49ab-a989-ce254cc9a0d0-cni-binary-copy\") pod \"multus-additional-cni-plugins-tktcw\" (UID: \"6334daaf-6478-49ab-a989-ce254cc9a0d0\") " pod="openshift-multus/multus-additional-cni-plugins-tktcw"
Jul 15 10:45:02.731550 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.731199    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e288a6cb-6662-4b30-ab6b-dc839a2cd17c-etc-sysctl-d\") pod \"tuned-whhb7\" (UID: \"e288a6cb-6662-4b30-ab6b-dc839a2cd17c\") " pod="openshift-cluster-node-tuning-operator/tuned-whhb7"
Jul 15 10:45:02.731550 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.731229    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-host-cni-netd\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.731550 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:02.731163    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 10:45:02.731550 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.731236    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94259076-1de7-4312-a19a-5760311ec791-tmp-dir\") pod \"node-resolver-ww2zd\" (UID: \"94259076-1de7-4312-a19a-5760311ec791\") " pod="openshift-dns/node-resolver-ww2zd"
Jul 15 10:45:02.731550 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.731270    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89jl5\" (UniqueName: \"kubernetes.io/projected/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-kube-api-access-89jl5\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.731550 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.731296    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-run-systemd\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.731550 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.731320    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6334daaf-6478-49ab-a989-ce254cc9a0d0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tktcw\" (UID: \"6334daaf-6478-49ab-a989-ce254cc9a0d0\") " pod="openshift-multus/multus-additional-cni-plugins-tktcw"
Jul 15 10:45:02.731550 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:02.731339    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82f6960e-f41d-4ad3-83c4-c515ff206787-original-pull-secret podName:82f6960e-f41d-4ad3-83c4-c515ff206787 nodeName:}" failed. No retries permitted until 2026-07-15 10:45:03.231318862 +0000 UTC m=+2.124464048 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/82f6960e-f41d-4ad3-83c4-c515ff206787-original-pull-secret") pod "global-pull-secret-syncer-zrr95" (UID: "82f6960e-f41d-4ad3-83c4-c515ff206787") : object "kube-system"/"original-pull-secret" not registered
Jul 15 10:45:02.731550 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.731339    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-host-cni-netd\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.731550 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.731373    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-host-kubelet\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.731550 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.731401    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-host-run-netns\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.731550 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.731413    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e288a6cb-6662-4b30-ab6b-dc839a2cd17c-etc-sysctl-d\") pod \"tuned-whhb7\" (UID: \"e288a6cb-6662-4b30-ab6b-dc839a2cd17c\") " pod="openshift-cluster-node-tuning-operator/tuned-whhb7"
Jul 15 10:45:02.731550 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.731424    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-run-ovn\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.731550 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.731449    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-host-run-ovn-kubernetes\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.731550 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.731476    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-host-cni-bin\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.732375 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.731484    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-run-systemd\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.732375 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.731520    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-ovn-node-metrics-cert\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.732375 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.731528    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-run-ovn\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.732375 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.731533    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-host-run-ovn-kubernetes\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.732375 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.731550    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e288a6cb-6662-4b30-ab6b-dc839a2cd17c-tmp\") pod \"tuned-whhb7\" (UID: \"e288a6cb-6662-4b30-ab6b-dc839a2cd17c\") " pod="openshift-cluster-node-tuning-operator/tuned-whhb7"
Jul 15 10:45:02.732375 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.731569    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-host-kubelet\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.732375 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.731583    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/66820680-27f1-431d-aa6e-d2d0e4a10f15-host-slash\") pod \"iptables-alerter-776nq\" (UID: \"66820680-27f1-431d-aa6e-d2d0e4a10f15\") " pod="openshift-network-operator/iptables-alerter-776nq"
Jul 15 10:45:02.732375 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.731613    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-host-run-netns\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.732375 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.731614    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czcmk\" (UniqueName: \"kubernetes.io/projected/66820680-27f1-431d-aa6e-d2d0e4a10f15-kube-api-access-czcmk\") pod \"iptables-alerter-776nq\" (UID: \"66820680-27f1-431d-aa6e-d2d0e4a10f15\") " pod="openshift-network-operator/iptables-alerter-776nq"
Jul 15 10:45:02.732375 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.731652    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-systemd-units\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.732375 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.731660    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-ovnkube-script-lib\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.732375 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.731680    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-log-socket\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.732375 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.731710    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1f06a99c-0c14-4fde-abcc-0b6cdf8bc447-agent-certs\") pod \"konnectivity-agent-qbkwp\" (UID: \"1f06a99c-0c14-4fde-abcc-0b6cdf8bc447\") " pod="kube-system/konnectivity-agent-qbkwp"
Jul 15 10:45:02.732375 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.731792    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xhdz\" (UniqueName: \"kubernetes.io/projected/6334daaf-6478-49ab-a989-ce254cc9a0d0-kube-api-access-2xhdz\") pod \"multus-additional-cni-plugins-tktcw\" (UID: \"6334daaf-6478-49ab-a989-ce254cc9a0d0\") " pod="openshift-multus/multus-additional-cni-plugins-tktcw"
Jul 15 10:45:02.732375 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.731846    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6334daaf-6478-49ab-a989-ce254cc9a0d0-cni-binary-copy\") pod \"multus-additional-cni-plugins-tktcw\" (UID: \"6334daaf-6478-49ab-a989-ce254cc9a0d0\") " pod="openshift-multus/multus-additional-cni-plugins-tktcw"
Jul 15 10:45:02.732375 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.731852    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-etc-openvswitch\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.732375 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.731885    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-etc-openvswitch\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.733155 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.731893    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6334daaf-6478-49ab-a989-ce254cc9a0d0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tktcw\" (UID: \"6334daaf-6478-49ab-a989-ce254cc9a0d0\") " pod="openshift-multus/multus-additional-cni-plugins-tktcw"
Jul 15 10:45:02.733155 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.731908    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1f06a99c-0c14-4fde-abcc-0b6cdf8bc447-konnectivity-ca\") pod \"konnectivity-agent-qbkwp\" (UID: \"1f06a99c-0c14-4fde-abcc-0b6cdf8bc447\") " pod="kube-system/konnectivity-agent-qbkwp"
Jul 15 10:45:02.733155 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.731930    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-systemd-units\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.733155 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.731934    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e288a6cb-6662-4b30-ab6b-dc839a2cd17c-etc-kubernetes\") pod \"tuned-whhb7\" (UID: \"e288a6cb-6662-4b30-ab6b-dc839a2cd17c\") " pod="openshift-cluster-node-tuning-operator/tuned-whhb7"
Jul 15 10:45:02.733155 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.731974    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e288a6cb-6662-4b30-ab6b-dc839a2cd17c-lib-modules\") pod \"tuned-whhb7\" (UID: \"e288a6cb-6662-4b30-ab6b-dc839a2cd17c\") " pod="openshift-cluster-node-tuning-operator/tuned-whhb7"
Jul 15 10:45:02.733155 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.731987    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-log-socket\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.733155 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.732033    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-host-cni-bin\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.733155 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.732094    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/66820680-27f1-431d-aa6e-d2d0e4a10f15-host-slash\") pod \"iptables-alerter-776nq\" (UID: \"66820680-27f1-431d-aa6e-d2d0e4a10f15\") " pod="openshift-network-operator/iptables-alerter-776nq"
Jul 15 10:45:02.733155 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.732134    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e288a6cb-6662-4b30-ab6b-dc839a2cd17c-lib-modules\") pod \"tuned-whhb7\" (UID: \"e288a6cb-6662-4b30-ab6b-dc839a2cd17c\") " pod="openshift-cluster-node-tuning-operator/tuned-whhb7"
Jul 15 10:45:02.733155 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.732135    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4e117f92-f585-4797-9dfa-b9cf0f00026d-registration-dir\") pod \"aws-ebs-csi-driver-node-k2pzx\" (UID: \"4e117f92-f585-4797-9dfa-b9cf0f00026d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2pzx"
Jul 15 10:45:02.733155 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.732171    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4e117f92-f585-4797-9dfa-b9cf0f00026d-socket-dir\") pod \"aws-ebs-csi-driver-node-k2pzx\" (UID: \"4e117f92-f585-4797-9dfa-b9cf0f00026d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2pzx"
Jul 15 10:45:02.733155 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.732185    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4e117f92-f585-4797-9dfa-b9cf0f00026d-registration-dir\") pod \"aws-ebs-csi-driver-node-k2pzx\" (UID: \"4e117f92-f585-4797-9dfa-b9cf0f00026d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2pzx"
Jul 15 10:45:02.733155 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.732201    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/82f6960e-f41d-4ad3-83c4-c515ff206787-dbus\") pod \"global-pull-secret-syncer-zrr95\" (UID: \"82f6960e-f41d-4ad3-83c4-c515ff206787\") " pod="kube-system/global-pull-secret-syncer-zrr95"
Jul 15 10:45:02.733155 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.732258    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hp9fv\" (UniqueName: \"kubernetes.io/projected/e512c0b0-fbba-491f-8024-0243b8f12f54-kube-api-access-hp9fv\") pod \"node-ca-fqz5r\" (UID: \"e512c0b0-fbba-491f-8024-0243b8f12f54\") " pod="openshift-image-registry/node-ca-fqz5r"
Jul 15 10:45:02.733155 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.732273    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4e117f92-f585-4797-9dfa-b9cf0f00026d-socket-dir\") pod \"aws-ebs-csi-driver-node-k2pzx\" (UID: \"4e117f92-f585-4797-9dfa-b9cf0f00026d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2pzx"
Jul 15 10:45:02.733155 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.732285    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/82f6960e-f41d-4ad3-83c4-c515ff206787-kubelet-config\") pod \"global-pull-secret-syncer-zrr95\" (UID: \"82f6960e-f41d-4ad3-83c4-c515ff206787\") " pod="kube-system/global-pull-secret-syncer-zrr95"
Jul 15 10:45:02.733155 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.732310    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e288a6cb-6662-4b30-ab6b-dc839a2cd17c-etc-sysconfig\") pod \"tuned-whhb7\" (UID: \"e288a6cb-6662-4b30-ab6b-dc839a2cd17c\") " pod="openshift-cluster-node-tuning-operator/tuned-whhb7"
Jul 15 10:45:02.733956 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.732333    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e288a6cb-6662-4b30-ab6b-dc839a2cd17c-etc-sysctl-conf\") pod \"tuned-whhb7\" (UID: \"e288a6cb-6662-4b30-ab6b-dc839a2cd17c\") " pod="openshift-cluster-node-tuning-operator/tuned-whhb7"
Jul 15 10:45:02.733956 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.732340    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e288a6cb-6662-4b30-ab6b-dc839a2cd17c-etc-kubernetes\") pod \"tuned-whhb7\" (UID: \"e288a6cb-6662-4b30-ab6b-dc839a2cd17c\") " pod="openshift-cluster-node-tuning-operator/tuned-whhb7"
Jul 15 10:45:02.733956 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.732342    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/82f6960e-f41d-4ad3-83c4-c515ff206787-dbus\") pod \"global-pull-secret-syncer-zrr95\" (UID: \"82f6960e-f41d-4ad3-83c4-c515ff206787\") " pod="kube-system/global-pull-secret-syncer-zrr95"
Jul 15 10:45:02.733956 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.732357    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e288a6cb-6662-4b30-ab6b-dc839a2cd17c-host\") pod \"tuned-whhb7\" (UID: \"e288a6cb-6662-4b30-ab6b-dc839a2cd17c\") " pod="openshift-cluster-node-tuning-operator/tuned-whhb7"
Jul 15 10:45:02.733956 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.732384    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6334daaf-6478-49ab-a989-ce254cc9a0d0-cnibin\") pod \"multus-additional-cni-plugins-tktcw\" (UID: \"6334daaf-6478-49ab-a989-ce254cc9a0d0\") " pod="openshift-multus/multus-additional-cni-plugins-tktcw"
Jul 15 10:45:02.733956 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.732394    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e288a6cb-6662-4b30-ab6b-dc839a2cd17c-etc-sysconfig\") pod \"tuned-whhb7\" (UID: \"e288a6cb-6662-4b30-ab6b-dc839a2cd17c\") " pod="openshift-cluster-node-tuning-operator/tuned-whhb7"
Jul 15 10:45:02.733956 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.732409    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/94259076-1de7-4312-a19a-5760311ec791-hosts-file\") pod \"node-resolver-ww2zd\" (UID: \"94259076-1de7-4312-a19a-5760311ec791\") " pod="openshift-dns/node-resolver-ww2zd"
Jul 15 10:45:02.733956 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.732438    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e288a6cb-6662-4b30-ab6b-dc839a2cd17c-run\") pod \"tuned-whhb7\" (UID: \"e288a6cb-6662-4b30-ab6b-dc839a2cd17c\") " pod="openshift-cluster-node-tuning-operator/tuned-whhb7"
Jul 15 10:45:02.733956 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.732442    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e288a6cb-6662-4b30-ab6b-dc839a2cd17c-host\") pod \"tuned-whhb7\" (UID: \"e288a6cb-6662-4b30-ab6b-dc839a2cd17c\") " pod="openshift-cluster-node-tuning-operator/tuned-whhb7"
Jul 15 10:45:02.733956 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.732461    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-host-slash\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.733956 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.732490    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/94259076-1de7-4312-a19a-5760311ec791-hosts-file\") pod \"node-resolver-ww2zd\" (UID: \"94259076-1de7-4312-a19a-5760311ec791\") " pod="openshift-dns/node-resolver-ww2zd"
Jul 15 10:45:02.733956 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.732515    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-env-overrides\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.733956 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.732527    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6334daaf-6478-49ab-a989-ce254cc9a0d0-cnibin\") pod \"multus-additional-cni-plugins-tktcw\" (UID: \"6334daaf-6478-49ab-a989-ce254cc9a0d0\") " pod="openshift-multus/multus-additional-cni-plugins-tktcw"
Jul 15 10:45:02.733956 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.732385    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/82f6960e-f41d-4ad3-83c4-c515ff206787-kubelet-config\") pod \"global-pull-secret-syncer-zrr95\" (UID: \"82f6960e-f41d-4ad3-83c4-c515ff206787\") " pod="kube-system/global-pull-secret-syncer-zrr95"
Jul 15 10:45:02.733956 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.732544    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e288a6cb-6662-4b30-ab6b-dc839a2cd17c-run\") pod \"tuned-whhb7\" (UID: \"e288a6cb-6662-4b30-ab6b-dc839a2cd17c\") " pod="openshift-cluster-node-tuning-operator/tuned-whhb7"
Jul 15 10:45:02.733956 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.732543    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6334daaf-6478-49ab-a989-ce254cc9a0d0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tktcw\" (UID: \"6334daaf-6478-49ab-a989-ce254cc9a0d0\") " pod="openshift-multus/multus-additional-cni-plugins-tktcw"
Jul 15 10:45:02.733956 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.732581    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-host-slash\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.733956 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.732586    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4e117f92-f585-4797-9dfa-b9cf0f00026d-device-dir\") pod \"aws-ebs-csi-driver-node-k2pzx\" (UID: \"4e117f92-f585-4797-9dfa-b9cf0f00026d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2pzx"
Jul 15 10:45:02.734670 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.732561    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e288a6cb-6662-4b30-ab6b-dc839a2cd17c-etc-sysctl-conf\") pod \"tuned-whhb7\" (UID: \"e288a6cb-6662-4b30-ab6b-dc839a2cd17c\") " pod="openshift-cluster-node-tuning-operator/tuned-whhb7"
Jul 15 10:45:02.734670 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.732642    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-ovnkube-config\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.734670 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.732676    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6334daaf-6478-49ab-a989-ce254cc9a0d0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tktcw\" (UID: \"6334daaf-6478-49ab-a989-ce254cc9a0d0\") " pod="openshift-multus/multus-additional-cni-plugins-tktcw"
Jul 15 10:45:02.734670 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.732701    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-run-openvswitch\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.734670 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.732747    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4e117f92-f585-4797-9dfa-b9cf0f00026d-device-dir\") pod \"aws-ebs-csi-driver-node-k2pzx\" (UID: \"4e117f92-f585-4797-9dfa-b9cf0f00026d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2pzx"
Jul 15 10:45:02.734670 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.732761    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e512c0b0-fbba-491f-8024-0243b8f12f54-serviceca\") pod \"node-ca-fqz5r\" (UID: \"e512c0b0-fbba-491f-8024-0243b8f12f54\") " pod="openshift-image-registry/node-ca-fqz5r"
Jul 15 10:45:02.734670 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.732801    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e288a6cb-6662-4b30-ab6b-dc839a2cd17c-etc-modprobe-d\") pod \"tuned-whhb7\" (UID: \"e288a6cb-6662-4b30-ab6b-dc839a2cd17c\") " pod="openshift-cluster-node-tuning-operator/tuned-whhb7"
Jul 15 10:45:02.734670 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.732831    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e288a6cb-6662-4b30-ab6b-dc839a2cd17c-sys\") pod \"tuned-whhb7\" (UID: \"e288a6cb-6662-4b30-ab6b-dc839a2cd17c\") " pod="openshift-cluster-node-tuning-operator/tuned-whhb7"
Jul 15 10:45:02.734670 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.732854    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6334daaf-6478-49ab-a989-ce254cc9a0d0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tktcw\" (UID: \"6334daaf-6478-49ab-a989-ce254cc9a0d0\") " pod="openshift-multus/multus-additional-cni-plugins-tktcw"
Jul 15 10:45:02.734670 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.732857    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvx4t\" (UniqueName: \"kubernetes.io/projected/e288a6cb-6662-4b30-ab6b-dc839a2cd17c-kube-api-access-xvx4t\") pod \"tuned-whhb7\" (UID: \"e288a6cb-6662-4b30-ab6b-dc839a2cd17c\") " pod="openshift-cluster-node-tuning-operator/tuned-whhb7"
Jul 15 10:45:02.734670 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.732937    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/66820680-27f1-431d-aa6e-d2d0e4a10f15-iptables-alerter-script\") pod \"iptables-alerter-776nq\" (UID: \"66820680-27f1-431d-aa6e-d2d0e4a10f15\") " pod="openshift-network-operator/iptables-alerter-776nq"
Jul 15 10:45:02.734670 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.732976    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-env-overrides\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.734670 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.732967    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e288a6cb-6662-4b30-ab6b-dc839a2cd17c-var-lib-kubelet\") pod \"tuned-whhb7\" (UID: \"e288a6cb-6662-4b30-ab6b-dc839a2cd17c\") " pod="openshift-cluster-node-tuning-operator/tuned-whhb7"
Jul 15 10:45:02.734670 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.733056    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4e117f92-f585-4797-9dfa-b9cf0f00026d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k2pzx\" (UID: \"4e117f92-f585-4797-9dfa-b9cf0f00026d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2pzx"
Jul 15 10:45:02.734670 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.733126    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e512c0b0-fbba-491f-8024-0243b8f12f54-serviceca\") pod \"node-ca-fqz5r\" (UID: \"e512c0b0-fbba-491f-8024-0243b8f12f54\") " pod="openshift-image-registry/node-ca-fqz5r"
Jul 15 10:45:02.734670 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.733097    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6334daaf-6478-49ab-a989-ce254cc9a0d0-os-release\") pod \"multus-additional-cni-plugins-tktcw\" (UID: \"6334daaf-6478-49ab-a989-ce254cc9a0d0\") " pod="openshift-multus/multus-additional-cni-plugins-tktcw"
Jul 15 10:45:02.734670 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.733161    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4e117f92-f585-4797-9dfa-b9cf0f00026d-sys-fs\") pod \"aws-ebs-csi-driver-node-k2pzx\" (UID: \"4e117f92-f585-4797-9dfa-b9cf0f00026d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2pzx"
Jul 15 10:45:02.735302 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.733180    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4e117f92-f585-4797-9dfa-b9cf0f00026d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k2pzx\" (UID: \"4e117f92-f585-4797-9dfa-b9cf0f00026d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2pzx"
Jul 15 10:45:02.735302 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.733199    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e288a6cb-6662-4b30-ab6b-dc839a2cd17c-etc-systemd\") pod \"tuned-whhb7\" (UID: \"e288a6cb-6662-4b30-ab6b-dc839a2cd17c\") " pod="openshift-cluster-node-tuning-operator/tuned-whhb7"
Jul 15 10:45:02.735302 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.733200    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-run-openvswitch\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.735302 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.733221    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e288a6cb-6662-4b30-ab6b-dc839a2cd17c-etc-tuned\") pod \"tuned-whhb7\" (UID: \"e288a6cb-6662-4b30-ab6b-dc839a2cd17c\") " pod="openshift-cluster-node-tuning-operator/tuned-whhb7"
Jul 15 10:45:02.735302 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.733245    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e512c0b0-fbba-491f-8024-0243b8f12f54-host\") pod \"node-ca-fqz5r\" (UID: \"e512c0b0-fbba-491f-8024-0243b8f12f54\") " pod="openshift-image-registry/node-ca-fqz5r"
Jul 15 10:45:02.735302 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.733268    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6334daaf-6478-49ab-a989-ce254cc9a0d0-system-cni-dir\") pod \"multus-additional-cni-plugins-tktcw\" (UID: \"6334daaf-6478-49ab-a989-ce254cc9a0d0\") " pod="openshift-multus/multus-additional-cni-plugins-tktcw"
Jul 15 10:45:02.735302 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.733314    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4e117f92-f585-4797-9dfa-b9cf0f00026d-sys-fs\") pod \"aws-ebs-csi-driver-node-k2pzx\" (UID: \"4e117f92-f585-4797-9dfa-b9cf0f00026d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2pzx"
Jul 15 10:45:02.735302 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.733294    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhrrk\" (UniqueName: \"kubernetes.io/projected/94259076-1de7-4312-a19a-5760311ec791-kube-api-access-hhrrk\") pod \"node-resolver-ww2zd\" (UID: \"94259076-1de7-4312-a19a-5760311ec791\") " pod="openshift-dns/node-resolver-ww2zd"
Jul 15 10:45:02.735302 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.733329    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e512c0b0-fbba-491f-8024-0243b8f12f54-host\") pod \"node-ca-fqz5r\" (UID: \"e512c0b0-fbba-491f-8024-0243b8f12f54\") " pod="openshift-image-registry/node-ca-fqz5r"
Jul 15 10:45:02.735302 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.733134    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e288a6cb-6662-4b30-ab6b-dc839a2cd17c-sys\") pod \"tuned-whhb7\" (UID: \"e288a6cb-6662-4b30-ab6b-dc839a2cd17c\") " pod="openshift-cluster-node-tuning-operator/tuned-whhb7"
Jul 15 10:45:02.735302 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.733270    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e288a6cb-6662-4b30-ab6b-dc839a2cd17c-var-lib-kubelet\") pod \"tuned-whhb7\" (UID: \"e288a6cb-6662-4b30-ab6b-dc839a2cd17c\") " pod="openshift-cluster-node-tuning-operator/tuned-whhb7"
Jul 15 10:45:02.735302 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.733405    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e288a6cb-6662-4b30-ab6b-dc839a2cd17c-etc-modprobe-d\") pod \"tuned-whhb7\" (UID: \"e288a6cb-6662-4b30-ab6b-dc839a2cd17c\") " pod="openshift-cluster-node-tuning-operator/tuned-whhb7"
Jul 15 10:45:02.735302 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.733442    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6334daaf-6478-49ab-a989-ce254cc9a0d0-system-cni-dir\") pod \"multus-additional-cni-plugins-tktcw\" (UID: \"6334daaf-6478-49ab-a989-ce254cc9a0d0\") " pod="openshift-multus/multus-additional-cni-plugins-tktcw"
Jul 15 10:45:02.735302 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.733480    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e288a6cb-6662-4b30-ab6b-dc839a2cd17c-etc-systemd\") pod \"tuned-whhb7\" (UID: \"e288a6cb-6662-4b30-ab6b-dc839a2cd17c\") " pod="openshift-cluster-node-tuning-operator/tuned-whhb7"
Jul 15 10:45:02.735302 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.733469    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6334daaf-6478-49ab-a989-ce254cc9a0d0-os-release\") pod \"multus-additional-cni-plugins-tktcw\" (UID: \"6334daaf-6478-49ab-a989-ce254cc9a0d0\") " pod="openshift-multus/multus-additional-cni-plugins-tktcw"
Jul 15 10:45:02.735302 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.733717    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/66820680-27f1-431d-aa6e-d2d0e4a10f15-iptables-alerter-script\") pod \"iptables-alerter-776nq\" (UID: \"66820680-27f1-431d-aa6e-d2d0e4a10f15\") " pod="openshift-network-operator/iptables-alerter-776nq"
Jul 15 10:45:02.735302 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.734194    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-ovnkube-config\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.735875 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.734201    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6334daaf-6478-49ab-a989-ce254cc9a0d0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tktcw\" (UID: \"6334daaf-6478-49ab-a989-ce254cc9a0d0\") " pod="openshift-multus/multus-additional-cni-plugins-tktcw"
Jul 15 10:45:02.735875 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.734327    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1f06a99c-0c14-4fde-abcc-0b6cdf8bc447-konnectivity-ca\") pod \"konnectivity-agent-qbkwp\" (UID: \"1f06a99c-0c14-4fde-abcc-0b6cdf8bc447\") " pod="kube-system/konnectivity-agent-qbkwp"
Jul 15 10:45:02.735875 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.734647    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-ovn-node-metrics-cert\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.735875 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.734990    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e288a6cb-6662-4b30-ab6b-dc839a2cd17c-tmp\") pod \"tuned-whhb7\" (UID: \"e288a6cb-6662-4b30-ab6b-dc839a2cd17c\") " pod="openshift-cluster-node-tuning-operator/tuned-whhb7"
Jul 15 10:45:02.735875 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.735346    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1f06a99c-0c14-4fde-abcc-0b6cdf8bc447-agent-certs\") pod \"konnectivity-agent-qbkwp\" (UID: \"1f06a99c-0c14-4fde-abcc-0b6cdf8bc447\") " pod="kube-system/konnectivity-agent-qbkwp"
Jul 15 10:45:02.735875 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.735614    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e288a6cb-6662-4b30-ab6b-dc839a2cd17c-etc-tuned\") pod \"tuned-whhb7\" (UID: \"e288a6cb-6662-4b30-ab6b-dc839a2cd17c\") " pod="openshift-cluster-node-tuning-operator/tuned-whhb7"
Jul 15 10:45:02.747703 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.747669    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqjfc\" (UniqueName: \"kubernetes.io/projected/4e117f92-f585-4797-9dfa-b9cf0f00026d-kube-api-access-rqjfc\") pod \"aws-ebs-csi-driver-node-k2pzx\" (UID: \"4e117f92-f585-4797-9dfa-b9cf0f00026d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2pzx"
Jul 15 10:45:02.751133 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.751060    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvx4t\" (UniqueName: \"kubernetes.io/projected/e288a6cb-6662-4b30-ab6b-dc839a2cd17c-kube-api-access-xvx4t\") pod \"tuned-whhb7\" (UID: \"e288a6cb-6662-4b30-ab6b-dc839a2cd17c\") " pod="openshift-cluster-node-tuning-operator/tuned-whhb7"
Jul 15 10:45:02.751429 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.751400    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp9fv\" (UniqueName: \"kubernetes.io/projected/e512c0b0-fbba-491f-8024-0243b8f12f54-kube-api-access-hp9fv\") pod \"node-ca-fqz5r\" (UID: \"e512c0b0-fbba-491f-8024-0243b8f12f54\") " pod="openshift-image-registry/node-ca-fqz5r"
Jul 15 10:45:02.751785 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.751765    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czcmk\" (UniqueName: \"kubernetes.io/projected/66820680-27f1-431d-aa6e-d2d0e4a10f15-kube-api-access-czcmk\") pod \"iptables-alerter-776nq\" (UID: \"66820680-27f1-431d-aa6e-d2d0e4a10f15\") " pod="openshift-network-operator/iptables-alerter-776nq"
Jul 15 10:45:02.752234 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.752194    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhrrk\" (UniqueName: \"kubernetes.io/projected/94259076-1de7-4312-a19a-5760311ec791-kube-api-access-hhrrk\") pod \"node-resolver-ww2zd\" (UID: \"94259076-1de7-4312-a19a-5760311ec791\") " pod="openshift-dns/node-resolver-ww2zd"
Jul 15 10:45:02.754158 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.754137    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89jl5\" (UniqueName: \"kubernetes.io/projected/f3b175c1-34f8-4e74-bce6-f866e4bd25b0-kube-api-access-89jl5\") pod \"ovnkube-node-qsch8\" (UID: \"f3b175c1-34f8-4e74-bce6-f866e4bd25b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.755131 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.755112    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xhdz\" (UniqueName: \"kubernetes.io/projected/6334daaf-6478-49ab-a989-ce254cc9a0d0-kube-api-access-2xhdz\") pod \"multus-additional-cni-plugins-tktcw\" (UID: \"6334daaf-6478-49ab-a989-ce254cc9a0d0\") " pod="openshift-multus/multus-additional-cni-plugins-tktcw"
Jul 15 10:45:02.842439 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.842402    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v9wb9"
Jul 15 10:45:02.853095 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:02.853066    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12698506_aebe_4df1_aecc_e7d7d7aef8ec.slice/crio-addff87743957ef80002d6cab23aeff26c76b590f6c676fba2b8d7e29261bafc WatchSource:0}: Error finding container addff87743957ef80002d6cab23aeff26c76b590f6c676fba2b8d7e29261bafc: Status 404 returned error can't find the container with id addff87743957ef80002d6cab23aeff26c76b590f6c676fba2b8d7e29261bafc
Jul 15 10:45:02.854839 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.854799    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fqz5r"
Jul 15 10:45:02.863269 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:02.863245    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode512c0b0_fbba_491f_8024_0243b8f12f54.slice/crio-e3e64569c5398791faa3660313c6bbc253f7478330b5b7d5b256cdc47ee62c05 WatchSource:0}: Error finding container e3e64569c5398791faa3660313c6bbc253f7478330b5b7d5b256cdc47ee62c05: Status 404 returned error can't find the container with id e3e64569c5398791faa3660313c6bbc253f7478330b5b7d5b256cdc47ee62c05
Jul 15 10:45:02.869482 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.869459    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ww2zd"
Jul 15 10:45:02.879198 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:02.879175    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94259076_1de7_4312_a19a_5760311ec791.slice/crio-425c0766ac475cdc26ece26fc9f9388ffac3c45c695938509e24393461a915e5 WatchSource:0}: Error finding container 425c0766ac475cdc26ece26fc9f9388ffac3c45c695938509e24393461a915e5: Status 404 returned error can't find the container with id 425c0766ac475cdc26ece26fc9f9388ffac3c45c695938509e24393461a915e5
Jul 15 10:45:02.884698 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.884670    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-whhb7"
Jul 15 10:45:02.894034 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:02.893992    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode288a6cb_6662_4b30_ab6b_dc839a2cd17c.slice/crio-848e100470c72c44021b8eef7b11e618168e52b284b87d455448eaed598b88d7 WatchSource:0}: Error finding container 848e100470c72c44021b8eef7b11e618168e52b284b87d455448eaed598b88d7: Status 404 returned error can't find the container with id 848e100470c72c44021b8eef7b11e618168e52b284b87d455448eaed598b88d7
Jul 15 10:45:02.902918 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.902892    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2pzx"
Jul 15 10:45:02.912048 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:02.912023    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e117f92_f585_4797_9dfa_b9cf0f00026d.slice/crio-ee04779d6de156fa8f68e868b5e4c5884ac08e468eae323720863738a55dc955 WatchSource:0}: Error finding container ee04779d6de156fa8f68e868b5e4c5884ac08e468eae323720863738a55dc955: Status 404 returned error can't find the container with id ee04779d6de156fa8f68e868b5e4c5884ac08e468eae323720863738a55dc955
Jul 15 10:45:02.917278 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.917258    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tktcw"
Jul 15 10:45:02.925465 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:02.925439    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6334daaf_6478_49ab_a989_ce254cc9a0d0.slice/crio-c1185d953df54c00a4bc0f5cf51b8528ad07b1489a2c2ba668b21b7b1c57e4be WatchSource:0}: Error finding container c1185d953df54c00a4bc0f5cf51b8528ad07b1489a2c2ba668b21b7b1c57e4be: Status 404 returned error can't find the container with id c1185d953df54c00a4bc0f5cf51b8528ad07b1489a2c2ba668b21b7b1c57e4be
Jul 15 10:45:02.937868 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.937843    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-776nq"
Jul 15 10:45:02.946454 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:02.946430    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66820680_27f1_431d_aa6e_d2d0e4a10f15.slice/crio-e286dbc3c8ebc686c26859c9d705129b46cb9b790a81ef0fd0d53c29abd5377f WatchSource:0}: Error finding container e286dbc3c8ebc686c26859c9d705129b46cb9b790a81ef0fd0d53c29abd5377f: Status 404 returned error can't find the container with id e286dbc3c8ebc686c26859c9d705129b46cb9b790a81ef0fd0d53c29abd5377f
Jul 15 10:45:02.957032 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.957006    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:02.962088 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:02.962059    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qbkwp"
Jul 15 10:45:02.965938 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:02.965910    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3b175c1_34f8_4e74_bce6_f866e4bd25b0.slice/crio-e229d0b7c7189fd3af63f971f8781723536957b489f96a63881fb62e1c0f5dc9 WatchSource:0}: Error finding container e229d0b7c7189fd3af63f971f8781723536957b489f96a63881fb62e1c0f5dc9: Status 404 returned error can't find the container with id e229d0b7c7189fd3af63f971f8781723536957b489f96a63881fb62e1c0f5dc9
Jul 15 10:45:02.970762 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:02.970713    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f06a99c_0c14_4fde_abcc_0b6cdf8bc447.slice/crio-35e7273139278e2ecaff58d711aecff64a2c13bfe2f735edb7e812c7a82ef2a9 WatchSource:0}: Error finding container 35e7273139278e2ecaff58d711aecff64a2c13bfe2f735edb7e812c7a82ef2a9: Status 404 returned error can't find the container with id 35e7273139278e2ecaff58d711aecff64a2c13bfe2f735edb7e812c7a82ef2a9
Jul 15 10:45:04.394197 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:04.394010    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 10:45:04.420647 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:04.420599    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f16a7597-8022-437b-a82b-ab187296ecdf-metrics-certs\") pod \"network-metrics-daemon-c4bht\" (UID: \"f16a7597-8022-437b-a82b-ab187296ecdf\") " pod="openshift-multus/network-metrics-daemon-c4bht"
Jul 15 10:45:04.420824 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:04.420733    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 10:45:04.420824 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:04.420806    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f16a7597-8022-437b-a82b-ab187296ecdf-metrics-certs podName:f16a7597-8022-437b-a82b-ab187296ecdf nodeName:}" failed. No retries permitted until 2026-07-15 10:45:05.420787191 +0000 UTC m=+3.029323193 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f16a7597-8022-437b-a82b-ab187296ecdf-metrics-certs") pod "network-metrics-daemon-c4bht" (UID: "f16a7597-8022-437b-a82b-ab187296ecdf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 10:45:04.521795 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:04.521754    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/82f6960e-f41d-4ad3-83c4-c515ff206787-original-pull-secret\") pod \"global-pull-secret-syncer-zrr95\" (UID: \"82f6960e-f41d-4ad3-83c4-c515ff206787\") " pod="kube-system/global-pull-secret-syncer-zrr95"
Jul 15 10:45:04.521999 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:04.521812    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxrvg\" (UniqueName: \"kubernetes.io/projected/e2a51efd-e7a8-4db0-8ded-c90e680619c8-kube-api-access-xxrvg\") pod \"network-check-target-5zwx4\" (UID: \"e2a51efd-e7a8-4db0-8ded-c90e680619c8\") " pod="openshift-network-diagnostics/network-check-target-5zwx4"
Jul 15 10:45:04.521999 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:04.521939    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 10:45:04.521999 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:04.521952    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 10:45:04.521999 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:04.521962    2565 projected.go:196] Error preparing data for projected volume kube-api-access-xxrvg for pod openshift-network-diagnostics/network-check-target-5zwx4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 10:45:04.521999 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:04.521963    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 10:45:04.522213 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:04.522025    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2a51efd-e7a8-4db0-8ded-c90e680619c8-kube-api-access-xxrvg podName:e2a51efd-e7a8-4db0-8ded-c90e680619c8 nodeName:}" failed. No retries permitted until 2026-07-15 10:45:05.522005761 +0000 UTC m=+3.130541778 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xxrvg" (UniqueName: "kubernetes.io/projected/e2a51efd-e7a8-4db0-8ded-c90e680619c8-kube-api-access-xxrvg") pod "network-check-target-5zwx4" (UID: "e2a51efd-e7a8-4db0-8ded-c90e680619c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 10:45:04.522213 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:04.522045    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82f6960e-f41d-4ad3-83c4-c515ff206787-original-pull-secret podName:82f6960e-f41d-4ad3-83c4-c515ff206787 nodeName:}" failed. No retries permitted until 2026-07-15 10:45:05.522036499 +0000 UTC m=+3.130572499 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/82f6960e-f41d-4ad3-83c4-c515ff206787-original-pull-secret") pod "global-pull-secret-syncer-zrr95" (UID: "82f6960e-f41d-4ad3-83c4-c515ff206787") : object "kube-system"/"original-pull-secret" not registered
Jul 15 10:45:04.643319 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:04.643286    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e5e62cf154ddbdbbccda45b7fc44e8f.slice/crio-80c46efa4eb58744a98d0470cce9765ed8bbb1606b6f1898b99c5f48fb153e22 WatchSource:0}: Error finding container 80c46efa4eb58744a98d0470cce9765ed8bbb1606b6f1898b99c5f48fb153e22: Status 404 returned error can't find the container with id 80c46efa4eb58744a98d0470cce9765ed8bbb1606b6f1898b99c5f48fb153e22
Jul 15 10:45:04.722113 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:04.721889    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 10:45:04.883432 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:04.883389    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 10:40:03 +0000 UTC" deadline="2028-02-10 01:58:05.799013812 +0000 UTC"
Jul 15 10:45:04.883432 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:04.883432    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13791h13m0.915587102s"
Jul 15 10:45:04.935919 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:04.935761    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qbkwp" event={"ID":"1f06a99c-0c14-4fde-abcc-0b6cdf8bc447","Type":"ContainerStarted","Data":"35e7273139278e2ecaff58d711aecff64a2c13bfe2f735edb7e812c7a82ef2a9"}
Jul 15 10:45:04.940374 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:04.940228    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qsch8" event={"ID":"f3b175c1-34f8-4e74-bce6-f866e4bd25b0","Type":"ContainerStarted","Data":"e229d0b7c7189fd3af63f971f8781723536957b489f96a63881fb62e1c0f5dc9"}
Jul 15 10:45:04.947971 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:04.947900    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-776nq" event={"ID":"66820680-27f1-431d-aa6e-d2d0e4a10f15","Type":"ContainerStarted","Data":"e286dbc3c8ebc686c26859c9d705129b46cb9b790a81ef0fd0d53c29abd5377f"}
Jul 15 10:45:04.951199 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:04.951162    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tktcw" event={"ID":"6334daaf-6478-49ab-a989-ce254cc9a0d0","Type":"ContainerStarted","Data":"c1185d953df54c00a4bc0f5cf51b8528ad07b1489a2c2ba668b21b7b1c57e4be"}
Jul 15 10:45:04.954461 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:04.954427    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2pzx" event={"ID":"4e117f92-f585-4797-9dfa-b9cf0f00026d","Type":"ContainerStarted","Data":"ee04779d6de156fa8f68e868b5e4c5884ac08e468eae323720863738a55dc955"}
Jul 15 10:45:04.959874 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:04.959831    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-whhb7" event={"ID":"e288a6cb-6662-4b30-ab6b-dc839a2cd17c","Type":"ContainerStarted","Data":"848e100470c72c44021b8eef7b11e618168e52b284b87d455448eaed598b88d7"}
Jul 15 10:45:04.971422 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:04.971320    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ww2zd" event={"ID":"94259076-1de7-4312-a19a-5760311ec791","Type":"ContainerStarted","Data":"425c0766ac475cdc26ece26fc9f9388ffac3c45c695938509e24393461a915e5"}
Jul 15 10:45:04.974169 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:04.974113    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fqz5r" event={"ID":"e512c0b0-fbba-491f-8024-0243b8f12f54","Type":"ContainerStarted","Data":"e3e64569c5398791faa3660313c6bbc253f7478330b5b7d5b256cdc47ee62c05"}
Jul 15 10:45:04.985131 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:04.985056    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-216.ec2.internal" event={"ID":"0e5e62cf154ddbdbbccda45b7fc44e8f","Type":"ContainerStarted","Data":"80c46efa4eb58744a98d0470cce9765ed8bbb1606b6f1898b99c5f48fb153e22"}
Jul 15 10:45:04.988447 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:04.988413    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v9wb9" event={"ID":"12698506-aebe-4df1-aecc-e7d7d7aef8ec","Type":"ContainerStarted","Data":"addff87743957ef80002d6cab23aeff26c76b590f6c676fba2b8d7e29261bafc"}
Jul 15 10:45:04.995261 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:04.995220    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-216.ec2.internal" event={"ID":"555b18a426b488b1398d4227fda6ee59","Type":"ContainerStarted","Data":"9df0b339fcb26d90eb6201d17a05c7e2ab55006cd7c9b4c93f02a3bf4e556ff2"}
Jul 15 10:45:05.430746 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:05.430642    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f16a7597-8022-437b-a82b-ab187296ecdf-metrics-certs\") pod \"network-metrics-daemon-c4bht\" (UID: \"f16a7597-8022-437b-a82b-ab187296ecdf\") " pod="openshift-multus/network-metrics-daemon-c4bht"
Jul 15 10:45:05.430906 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:05.430846    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 10:45:05.430960 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:05.430931    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f16a7597-8022-437b-a82b-ab187296ecdf-metrics-certs podName:f16a7597-8022-437b-a82b-ab187296ecdf nodeName:}" failed. No retries permitted until 2026-07-15 10:45:07.430909615 +0000 UTC m=+5.039445639 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f16a7597-8022-437b-a82b-ab187296ecdf-metrics-certs") pod "network-metrics-daemon-c4bht" (UID: "f16a7597-8022-437b-a82b-ab187296ecdf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 10:45:05.532143 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:05.532104    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/82f6960e-f41d-4ad3-83c4-c515ff206787-original-pull-secret\") pod \"global-pull-secret-syncer-zrr95\" (UID: \"82f6960e-f41d-4ad3-83c4-c515ff206787\") " pod="kube-system/global-pull-secret-syncer-zrr95"
Jul 15 10:45:05.532367 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:05.532196    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxrvg\" (UniqueName: \"kubernetes.io/projected/e2a51efd-e7a8-4db0-8ded-c90e680619c8-kube-api-access-xxrvg\") pod \"network-check-target-5zwx4\" (UID: \"e2a51efd-e7a8-4db0-8ded-c90e680619c8\") " pod="openshift-network-diagnostics/network-check-target-5zwx4"
Jul 15 10:45:05.532442 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:05.532370    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 10:45:05.532442 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:05.532392    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 10:45:05.532442 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:05.532404    2565 projected.go:196] Error preparing data for projected volume kube-api-access-xxrvg for pod openshift-network-diagnostics/network-check-target-5zwx4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 10:45:05.532580 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:05.532464    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2a51efd-e7a8-4db0-8ded-c90e680619c8-kube-api-access-xxrvg podName:e2a51efd-e7a8-4db0-8ded-c90e680619c8 nodeName:}" failed. No retries permitted until 2026-07-15 10:45:07.532446559 +0000 UTC m=+5.140982566 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xxrvg" (UniqueName: "kubernetes.io/projected/e2a51efd-e7a8-4db0-8ded-c90e680619c8-kube-api-access-xxrvg") pod "network-check-target-5zwx4" (UID: "e2a51efd-e7a8-4db0-8ded-c90e680619c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 10:45:05.532914 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:05.532891    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 10:45:05.533019 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:05.532949    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82f6960e-f41d-4ad3-83c4-c515ff206787-original-pull-secret podName:82f6960e-f41d-4ad3-83c4-c515ff206787 nodeName:}" failed. No retries permitted until 2026-07-15 10:45:07.532933797 +0000 UTC m=+5.141469798 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/82f6960e-f41d-4ad3-83c4-c515ff206787-original-pull-secret") pod "global-pull-secret-syncer-zrr95" (UID: "82f6960e-f41d-4ad3-83c4-c515ff206787") : object "kube-system"/"original-pull-secret" not registered
Jul 15 10:45:05.884367 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:05.884254    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 10:40:03 +0000 UTC" deadline="2028-02-03 00:50:44.81673215 +0000 UTC"
Jul 15 10:45:05.884367 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:05.884293    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13622h5m38.932443804s"
Jul 15 10:45:05.920664 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:05.920619    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrr95"
Jul 15 10:45:05.920844 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:05.920783    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrr95" podUID="82f6960e-f41d-4ad3-83c4-c515ff206787"
Jul 15 10:45:05.920926 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:05.920911    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4bht"
Jul 15 10:45:05.921036 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:05.921016    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4bht" podUID="f16a7597-8022-437b-a82b-ab187296ecdf"
Jul 15 10:45:05.921095 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:05.921084    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zwx4"
Jul 15 10:45:05.921173 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:05.921154    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zwx4" podUID="e2a51efd-e7a8-4db0-8ded-c90e680619c8"
Jul 15 10:45:05.937353 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:05.937312    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 10:45:07.448678 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:07.448637    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f16a7597-8022-437b-a82b-ab187296ecdf-metrics-certs\") pod \"network-metrics-daemon-c4bht\" (UID: \"f16a7597-8022-437b-a82b-ab187296ecdf\") " pod="openshift-multus/network-metrics-daemon-c4bht"
Jul 15 10:45:07.449163 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:07.448801    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 10:45:07.449163 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:07.448862    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f16a7597-8022-437b-a82b-ab187296ecdf-metrics-certs podName:f16a7597-8022-437b-a82b-ab187296ecdf nodeName:}" failed. No retries permitted until 2026-07-15 10:45:11.448845597 +0000 UTC m=+9.057381601 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f16a7597-8022-437b-a82b-ab187296ecdf-metrics-certs") pod "network-metrics-daemon-c4bht" (UID: "f16a7597-8022-437b-a82b-ab187296ecdf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 10:45:07.550579 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:07.549963    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxrvg\" (UniqueName: \"kubernetes.io/projected/e2a51efd-e7a8-4db0-8ded-c90e680619c8-kube-api-access-xxrvg\") pod \"network-check-target-5zwx4\" (UID: \"e2a51efd-e7a8-4db0-8ded-c90e680619c8\") " pod="openshift-network-diagnostics/network-check-target-5zwx4"
Jul 15 10:45:07.550579 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:07.550049    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/82f6960e-f41d-4ad3-83c4-c515ff206787-original-pull-secret\") pod \"global-pull-secret-syncer-zrr95\" (UID: \"82f6960e-f41d-4ad3-83c4-c515ff206787\") " pod="kube-system/global-pull-secret-syncer-zrr95"
Jul 15 10:45:07.550579 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:07.550153    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 10:45:07.550579 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:07.550163    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 10:45:07.550579 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:07.550184    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 10:45:07.550579 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:07.550197    2565 projected.go:196] Error preparing data for projected volume kube-api-access-xxrvg for pod openshift-network-diagnostics/network-check-target-5zwx4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 10:45:07.550579 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:07.550236    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82f6960e-f41d-4ad3-83c4-c515ff206787-original-pull-secret podName:82f6960e-f41d-4ad3-83c4-c515ff206787 nodeName:}" failed. No retries permitted until 2026-07-15 10:45:11.550217521 +0000 UTC m=+9.158753536 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/82f6960e-f41d-4ad3-83c4-c515ff206787-original-pull-secret") pod "global-pull-secret-syncer-zrr95" (UID: "82f6960e-f41d-4ad3-83c4-c515ff206787") : object "kube-system"/"original-pull-secret" not registered
Jul 15 10:45:07.550579 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:07.550256    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2a51efd-e7a8-4db0-8ded-c90e680619c8-kube-api-access-xxrvg podName:e2a51efd-e7a8-4db0-8ded-c90e680619c8 nodeName:}" failed. No retries permitted until 2026-07-15 10:45:11.550246908 +0000 UTC m=+9.158782908 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xxrvg" (UniqueName: "kubernetes.io/projected/e2a51efd-e7a8-4db0-8ded-c90e680619c8-kube-api-access-xxrvg") pod "network-check-target-5zwx4" (UID: "e2a51efd-e7a8-4db0-8ded-c90e680619c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 10:45:07.919900 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:07.919822    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrr95"
Jul 15 10:45:07.920067 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:07.919961    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrr95" podUID="82f6960e-f41d-4ad3-83c4-c515ff206787"
Jul 15 10:45:07.920067 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:07.920046    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4bht"
Jul 15 10:45:07.920406 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:07.920184    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4bht" podUID="f16a7597-8022-437b-a82b-ab187296ecdf"
Jul 15 10:45:07.920406 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:07.920267    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zwx4"
Jul 15 10:45:07.920406 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:07.920358    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zwx4" podUID="e2a51efd-e7a8-4db0-8ded-c90e680619c8"
Jul 15 10:45:09.920660 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:09.919854    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrr95"
Jul 15 10:45:09.920660 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:09.919991    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrr95" podUID="82f6960e-f41d-4ad3-83c4-c515ff206787"
Jul 15 10:45:09.920660 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:09.920381    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4bht"
Jul 15 10:45:09.920660 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:09.920491    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4bht" podUID="f16a7597-8022-437b-a82b-ab187296ecdf"
Jul 15 10:45:09.920660 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:09.920538    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zwx4"
Jul 15 10:45:09.920660 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:09.920610    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zwx4" podUID="e2a51efd-e7a8-4db0-8ded-c90e680619c8"
Jul 15 10:45:11.486084 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:11.485474    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f16a7597-8022-437b-a82b-ab187296ecdf-metrics-certs\") pod \"network-metrics-daemon-c4bht\" (UID: \"f16a7597-8022-437b-a82b-ab187296ecdf\") " pod="openshift-multus/network-metrics-daemon-c4bht"
Jul 15 10:45:11.486084 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:11.485675    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 10:45:11.486084 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:11.485737    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f16a7597-8022-437b-a82b-ab187296ecdf-metrics-certs podName:f16a7597-8022-437b-a82b-ab187296ecdf nodeName:}" failed. No retries permitted until 2026-07-15 10:45:19.485717299 +0000 UTC m=+17.094253311 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f16a7597-8022-437b-a82b-ab187296ecdf-metrics-certs") pod "network-metrics-daemon-c4bht" (UID: "f16a7597-8022-437b-a82b-ab187296ecdf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 10:45:11.586936 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:11.586896    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxrvg\" (UniqueName: \"kubernetes.io/projected/e2a51efd-e7a8-4db0-8ded-c90e680619c8-kube-api-access-xxrvg\") pod \"network-check-target-5zwx4\" (UID: \"e2a51efd-e7a8-4db0-8ded-c90e680619c8\") " pod="openshift-network-diagnostics/network-check-target-5zwx4"
Jul 15 10:45:11.587132 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:11.586986    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/82f6960e-f41d-4ad3-83c4-c515ff206787-original-pull-secret\") pod \"global-pull-secret-syncer-zrr95\" (UID: \"82f6960e-f41d-4ad3-83c4-c515ff206787\") " pod="kube-system/global-pull-secret-syncer-zrr95"
Jul 15 10:45:11.587132 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:11.587106    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 10:45:11.587242 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:11.587170    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82f6960e-f41d-4ad3-83c4-c515ff206787-original-pull-secret podName:82f6960e-f41d-4ad3-83c4-c515ff206787 nodeName:}" failed. No retries permitted until 2026-07-15 10:45:19.587150535 +0000 UTC m=+17.195686561 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/82f6960e-f41d-4ad3-83c4-c515ff206787-original-pull-secret") pod "global-pull-secret-syncer-zrr95" (UID: "82f6960e-f41d-4ad3-83c4-c515ff206787") : object "kube-system"/"original-pull-secret" not registered
Jul 15 10:45:11.587573 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:11.587444    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 10:45:11.587573 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:11.587469    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 10:45:11.587573 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:11.587496    2565 projected.go:196] Error preparing data for projected volume kube-api-access-xxrvg for pod openshift-network-diagnostics/network-check-target-5zwx4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 10:45:11.587573 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:11.587535    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2a51efd-e7a8-4db0-8ded-c90e680619c8-kube-api-access-xxrvg podName:e2a51efd-e7a8-4db0-8ded-c90e680619c8 nodeName:}" failed. No retries permitted until 2026-07-15 10:45:19.587523176 +0000 UTC m=+17.196059175 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xxrvg" (UniqueName: "kubernetes.io/projected/e2a51efd-e7a8-4db0-8ded-c90e680619c8-kube-api-access-xxrvg") pod "network-check-target-5zwx4" (UID: "e2a51efd-e7a8-4db0-8ded-c90e680619c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 10:45:11.919750 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:11.919715    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrr95"
Jul 15 10:45:11.919915 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:11.919832    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrr95" podUID="82f6960e-f41d-4ad3-83c4-c515ff206787"
Jul 15 10:45:11.920224 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:11.920201    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4bht"
Jul 15 10:45:11.920360 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:11.920317    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4bht" podUID="f16a7597-8022-437b-a82b-ab187296ecdf"
Jul 15 10:45:11.920487 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:11.920385    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zwx4"
Jul 15 10:45:11.920487 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:11.920449    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zwx4" podUID="e2a51efd-e7a8-4db0-8ded-c90e680619c8"
Jul 15 10:45:13.919472 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:13.919428    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrr95"
Jul 15 10:45:13.919865 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:13.919571    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrr95" podUID="82f6960e-f41d-4ad3-83c4-c515ff206787"
Jul 15 10:45:13.920002 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:13.919983    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4bht"
Jul 15 10:45:13.920112 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:13.920092    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4bht" podUID="f16a7597-8022-437b-a82b-ab187296ecdf"
Jul 15 10:45:13.920167 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:13.920155    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zwx4"
Jul 15 10:45:13.920223 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:13.920205    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zwx4" podUID="e2a51efd-e7a8-4db0-8ded-c90e680619c8"
Jul 15 10:45:15.919391 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:15.919359    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrr95"
Jul 15 10:45:15.919391 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:15.919385    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4bht"
Jul 15 10:45:15.919845 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:15.919410    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zwx4"
Jul 15 10:45:15.919845 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:15.919481    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrr95" podUID="82f6960e-f41d-4ad3-83c4-c515ff206787"
Jul 15 10:45:15.919845 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:15.919533    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4bht" podUID="f16a7597-8022-437b-a82b-ab187296ecdf"
Jul 15 10:45:15.919845 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:15.919615    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zwx4" podUID="e2a51efd-e7a8-4db0-8ded-c90e680619c8"
Jul 15 10:45:17.919223 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:17.919185    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrr95"
Jul 15 10:45:17.919725 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:17.919200    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zwx4"
Jul 15 10:45:17.919725 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:17.919322    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrr95" podUID="82f6960e-f41d-4ad3-83c4-c515ff206787"
Jul 15 10:45:17.919725 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:17.919200    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4bht"
Jul 15 10:45:17.919725 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:17.919429    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zwx4" podUID="e2a51efd-e7a8-4db0-8ded-c90e680619c8"
Jul 15 10:45:17.919725 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:17.919529    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4bht" podUID="f16a7597-8022-437b-a82b-ab187296ecdf"
Jul 15 10:45:19.547360 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:19.547311    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f16a7597-8022-437b-a82b-ab187296ecdf-metrics-certs\") pod \"network-metrics-daemon-c4bht\" (UID: \"f16a7597-8022-437b-a82b-ab187296ecdf\") " pod="openshift-multus/network-metrics-daemon-c4bht"
Jul 15 10:45:19.547883 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:19.547453    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 10:45:19.547883 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:19.547528    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f16a7597-8022-437b-a82b-ab187296ecdf-metrics-certs podName:f16a7597-8022-437b-a82b-ab187296ecdf nodeName:}" failed. No retries permitted until 2026-07-15 10:45:35.547507873 +0000 UTC m=+33.156043896 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f16a7597-8022-437b-a82b-ab187296ecdf-metrics-certs") pod "network-metrics-daemon-c4bht" (UID: "f16a7597-8022-437b-a82b-ab187296ecdf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 10:45:19.647834 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:19.647797    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/82f6960e-f41d-4ad3-83c4-c515ff206787-original-pull-secret\") pod \"global-pull-secret-syncer-zrr95\" (UID: \"82f6960e-f41d-4ad3-83c4-c515ff206787\") " pod="kube-system/global-pull-secret-syncer-zrr95"
Jul 15 10:45:19.647999 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:19.647857    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxrvg\" (UniqueName: \"kubernetes.io/projected/e2a51efd-e7a8-4db0-8ded-c90e680619c8-kube-api-access-xxrvg\") pod \"network-check-target-5zwx4\" (UID: \"e2a51efd-e7a8-4db0-8ded-c90e680619c8\") " pod="openshift-network-diagnostics/network-check-target-5zwx4"
Jul 15 10:45:19.647999 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:19.647988    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 10:45:19.648078 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:19.648058    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82f6960e-f41d-4ad3-83c4-c515ff206787-original-pull-secret podName:82f6960e-f41d-4ad3-83c4-c515ff206787 nodeName:}" failed. No retries permitted until 2026-07-15 10:45:35.648039329 +0000 UTC m=+33.256575334 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/82f6960e-f41d-4ad3-83c4-c515ff206787-original-pull-secret") pod "global-pull-secret-syncer-zrr95" (UID: "82f6960e-f41d-4ad3-83c4-c515ff206787") : object "kube-system"/"original-pull-secret" not registered
Jul 15 10:45:19.648136 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:19.647992    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 10:45:19.648136 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:19.648109    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 10:45:19.648136 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:19.648124    2565 projected.go:196] Error preparing data for projected volume kube-api-access-xxrvg for pod openshift-network-diagnostics/network-check-target-5zwx4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 10:45:19.648245 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:19.648176    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2a51efd-e7a8-4db0-8ded-c90e680619c8-kube-api-access-xxrvg podName:e2a51efd-e7a8-4db0-8ded-c90e680619c8 nodeName:}" failed. No retries permitted until 2026-07-15 10:45:35.648162873 +0000 UTC m=+33.256698874 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xxrvg" (UniqueName: "kubernetes.io/projected/e2a51efd-e7a8-4db0-8ded-c90e680619c8-kube-api-access-xxrvg") pod "network-check-target-5zwx4" (UID: "e2a51efd-e7a8-4db0-8ded-c90e680619c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 10:45:19.919634 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:19.919554    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zwx4"
Jul 15 10:45:19.919798 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:19.919561    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrr95"
Jul 15 10:45:19.919798 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:19.919669    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zwx4" podUID="e2a51efd-e7a8-4db0-8ded-c90e680619c8"
Jul 15 10:45:19.919798 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:19.919571    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4bht"
Jul 15 10:45:19.919960 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:19.919731    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrr95" podUID="82f6960e-f41d-4ad3-83c4-c515ff206787"
Jul 15 10:45:19.919960 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:19.919853    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4bht" podUID="f16a7597-8022-437b-a82b-ab187296ecdf"
Jul 15 10:45:21.919209 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:21.919155    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zwx4"
Jul 15 10:45:21.919209 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:21.919155    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrr95"
Jul 15 10:45:21.919845 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:21.919158    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4bht"
Jul 15 10:45:21.919845 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:21.919305    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zwx4" podUID="e2a51efd-e7a8-4db0-8ded-c90e680619c8"
Jul 15 10:45:21.919845 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:21.919798    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrr95" podUID="82f6960e-f41d-4ad3-83c4-c515ff206787"
Jul 15 10:45:21.919988 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:21.919900    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4bht" podUID="f16a7597-8022-437b-a82b-ab187296ecdf"
Jul 15 10:45:23.919708 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:23.919675    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4bht"
Jul 15 10:45:23.919708 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:23.919691    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrr95"
Jul 15 10:45:23.919708 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:23.919711    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zwx4"
Jul 15 10:45:23.920220 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:23.919807    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4bht" podUID="f16a7597-8022-437b-a82b-ab187296ecdf"
Jul 15 10:45:23.920220 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:23.919960    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrr95" podUID="82f6960e-f41d-4ad3-83c4-c515ff206787"
Jul 15 10:45:23.920220 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:23.920055    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zwx4" podUID="e2a51efd-e7a8-4db0-8ded-c90e680619c8"
Jul 15 10:45:25.919479 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:25.919151    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zwx4"
Jul 15 10:45:25.920014 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:25.919171    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrr95"
Jul 15 10:45:25.920014 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:25.919608    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zwx4" podUID="e2a51efd-e7a8-4db0-8ded-c90e680619c8"
Jul 15 10:45:25.920014 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:25.919659    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrr95" podUID="82f6960e-f41d-4ad3-83c4-c515ff206787"
Jul 15 10:45:25.920014 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:25.919203    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4bht"
Jul 15 10:45:25.920014 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:25.919768    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4bht" podUID="f16a7597-8022-437b-a82b-ab187296ecdf"
Jul 15 10:45:26.040939 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:26.040913    2565 generic.go:356] "Generic (PLEG): container finished" podID="0e5e62cf154ddbdbbccda45b7fc44e8f" containerID="c71a42aae77f34f1a529ca1b2f09cfd65bd3283bb6712f80fbdd780fc232f84f" exitCode=0
Jul 15 10:45:26.041046 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:26.040989    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-216.ec2.internal" event={"ID":"0e5e62cf154ddbdbbccda45b7fc44e8f","Type":"ContainerDied","Data":"c71a42aae77f34f1a529ca1b2f09cfd65bd3283bb6712f80fbdd780fc232f84f"}
Jul 15 10:45:26.042579 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:26.042558    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v9wb9" event={"ID":"12698506-aebe-4df1-aecc-e7d7d7aef8ec","Type":"ContainerStarted","Data":"015fa210980cd520a5dda552f56d6b382cf82bf5af3d48be1abea0f2518a1016"}
Jul 15 10:45:26.044186 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:26.044157    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-216.ec2.internal" event={"ID":"555b18a426b488b1398d4227fda6ee59","Type":"ContainerStarted","Data":"83a6354aabdedfc2bf81753e936e48d59256993212e6454effa853bddc350729"}
Jul 15 10:45:26.045603 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:26.045579    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qbkwp" event={"ID":"1f06a99c-0c14-4fde-abcc-0b6cdf8bc447","Type":"ContainerStarted","Data":"be503d62db68dd2359c44941beb6888104c97999db1690b0a156acfa2ace12bc"}
Jul 15 10:45:26.047646 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:26.047629    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qsch8_f3b175c1-34f8-4e74-bce6-f866e4bd25b0/ovn-acl-logging/0.log"
Jul 15 10:45:26.047971 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:26.047944    2565 generic.go:356] "Generic (PLEG): container finished" podID="f3b175c1-34f8-4e74-bce6-f866e4bd25b0" containerID="012120863fdf202507475034213b479ccb82a0e2a40d2300f984d28444b9847e" exitCode=1
Jul 15 10:45:26.048092 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:26.048015    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qsch8" event={"ID":"f3b175c1-34f8-4e74-bce6-f866e4bd25b0","Type":"ContainerDied","Data":"012120863fdf202507475034213b479ccb82a0e2a40d2300f984d28444b9847e"}
Jul 15 10:45:26.048161 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:26.048094    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qsch8" event={"ID":"f3b175c1-34f8-4e74-bce6-f866e4bd25b0","Type":"ContainerStarted","Data":"02574e40a3f702e7c4ab6df3dd6e915e07c241f14851f2aa1bd47280c314cebb"}
Jul 15 10:45:26.049631 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:26.049596    2565 generic.go:356] "Generic (PLEG): container finished" podID="6334daaf-6478-49ab-a989-ce254cc9a0d0" containerID="c6166629e63b703fe96e47331b232aef1d00f17d530a106b9910e8f2f01895b9" exitCode=0
Jul 15 10:45:26.049731 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:26.049627    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tktcw" event={"ID":"6334daaf-6478-49ab-a989-ce254cc9a0d0","Type":"ContainerDied","Data":"c6166629e63b703fe96e47331b232aef1d00f17d530a106b9910e8f2f01895b9"}
Jul 15 10:45:26.052071 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:26.051997    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2pzx" event={"ID":"4e117f92-f585-4797-9dfa-b9cf0f00026d","Type":"ContainerStarted","Data":"ffc58ce4c47c07e5c10718cfe12f1f01c8933a87287b2e5c29a1671a6618a6f0"}
Jul 15 10:45:26.057730 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:26.057703    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-whhb7" event={"ID":"e288a6cb-6662-4b30-ab6b-dc839a2cd17c","Type":"ContainerStarted","Data":"d3aa80360be6f3d445ff8f5eed39625cb35154e51ccc6eeb501a8f841185e8c4"}
Jul 15 10:45:26.059187 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:26.059162    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ww2zd" event={"ID":"94259076-1de7-4312-a19a-5760311ec791","Type":"ContainerStarted","Data":"339d26366785424014914659348777cb4ce2e1ebbc49ed4b37c7f5fda22fac36"}
Jul 15 10:45:26.060552 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:26.060530    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fqz5r" event={"ID":"e512c0b0-fbba-491f-8024-0243b8f12f54","Type":"ContainerStarted","Data":"577305578c4a0cf2d12a4ba6fe805c242014a9806b5601bbeb3621e0e42d48ae"}
Jul 15 10:45:26.062348 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:26.062299    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-v9wb9" podStartSLOduration=2.694850498 podStartE2EDuration="24.062287515s" totalImagesPullingTime="21.367437017s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:45:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:45:26.061716931 +0000 UTC m=+23.670252953" watchObservedRunningTime="2026-07-15 10:45:26.062287515 +0000 UTC m=+23.670823581"
Jul 15 10:45:26.080540 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:26.080500    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ww2zd" podStartSLOduration=1.798278758 podStartE2EDuration="23.080484695s" totalImagesPullingTime="21.282205937s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:45:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:45:26.079684848 +0000 UTC m=+23.688220870" watchObservedRunningTime="2026-07-15 10:45:26.080484695 +0000 UTC m=+23.689020718"
Jul 15 10:45:26.096971 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:26.096934    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-whhb7" podStartSLOduration=1.853531748 podStartE2EDuration="23.096923151s" totalImagesPullingTime="21.243391403s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:45:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:45:26.096653885 +0000 UTC m=+23.705189908" watchObservedRunningTime="2026-07-15 10:45:26.096923151 +0000 UTC m=+23.705459172"
Jul 15 10:45:26.139853 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:26.139807    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-216.ec2.internal" podStartSLOduration=23.139792901 podStartE2EDuration="23.139792901s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:45:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:45:26.139547672 +0000 UTC m=+23.748083694" watchObservedRunningTime="2026-07-15 10:45:26.139792901 +0000 UTC m=+23.748328923"
Jul 15 10:45:26.162573 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:26.162539    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fqz5r" podStartSLOduration=1.814198413 podStartE2EDuration="23.162526979s" totalImagesPullingTime="21.348328566s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:45:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:45:26.162430302 +0000 UTC m=+23.770966324" watchObservedRunningTime="2026-07-15 10:45:26.162526979 +0000 UTC m=+23.771063000"
Jul 15 10:45:26.177163 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:26.177124    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qbkwp" podStartSLOduration=1.985896643 podStartE2EDuration="23.177111242s" totalImagesPullingTime="21.191214599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:45:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:45:26.176865786 +0000 UTC m=+23.785401808" watchObservedRunningTime="2026-07-15 10:45:26.177111242 +0000 UTC m=+23.785647266"
Jul 15 10:45:26.244181 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:26.244161    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qbkwp"
Jul 15 10:45:26.244860 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:26.244844    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qbkwp"
Jul 15 10:45:27.066067 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:27.066035    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qsch8_f3b175c1-34f8-4e74-bce6-f866e4bd25b0/ovn-acl-logging/0.log"
Jul 15 10:45:27.066627 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:27.066485    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qsch8" event={"ID":"f3b175c1-34f8-4e74-bce6-f866e4bd25b0","Type":"ContainerStarted","Data":"e281c31b9aaa48396c7e0e30f73ec43182b37b6dfb6f93631e4fba04feab9097"}
Jul 15 10:45:27.066627 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:27.066553    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qsch8" event={"ID":"f3b175c1-34f8-4e74-bce6-f866e4bd25b0","Type":"ContainerStarted","Data":"79667ed0e2cc6da360ef0226347d0618d55b8ef60a97bf03c868163ace4b6316"}
Jul 15 10:45:27.066627 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:27.066582    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qsch8" event={"ID":"f3b175c1-34f8-4e74-bce6-f866e4bd25b0","Type":"ContainerStarted","Data":"02f9c41890112af2e3cea292c3387dd688d432306b8b77e418b0654c41167af2"}
Jul 15 10:45:27.066627 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:27.066621    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qsch8" event={"ID":"f3b175c1-34f8-4e74-bce6-f866e4bd25b0","Type":"ContainerStarted","Data":"08a50b67dd9d3ef5c44f08287425e9f5e6c30d179e684c7b3f8ba6dc9dc32487"}
Jul 15 10:45:27.068185 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:27.068157    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-776nq" event={"ID":"66820680-27f1-431d-aa6e-d2d0e4a10f15","Type":"ContainerStarted","Data":"f93c5032486de500c537119c532246f74ae9835efb2ee3b54789a076c0a13bde"}
Jul 15 10:45:27.068912 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:27.068893    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qbkwp"
Jul 15 10:45:27.069438 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:27.069298    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qbkwp"
Jul 15 10:45:27.084564 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:27.084514    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-776nq" podStartSLOduration=2.811997107 podStartE2EDuration="24.084501449s" totalImagesPullingTime="21.272504342s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:45:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:45:27.083733131 +0000 UTC m=+24.692269154" watchObservedRunningTime="2026-07-15 10:45:27.084501449 +0000 UTC m=+24.693037471"
Jul 15 10:45:27.310019 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:27.309984    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 15 10:45:27.882690 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:27.882363    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T10:45:27.310002926Z","UUID":"d29d940b-cbdc-4a7d-ba38-895a92a0b435","Handler":null,"Name":"","Endpoint":""}
Jul 15 10:45:27.884152 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:27.884121    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 15 10:45:27.884274 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:27.884169    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 15 10:45:27.919328 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:27.919046    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrr95"
Jul 15 10:45:27.919328 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:27.919219    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4bht"
Jul 15 10:45:27.919328 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:27.919223    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrr95" podUID="82f6960e-f41d-4ad3-83c4-c515ff206787"
Jul 15 10:45:27.919328 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:27.919225    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zwx4"
Jul 15 10:45:27.919669 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:27.919326    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4bht" podUID="f16a7597-8022-437b-a82b-ab187296ecdf"
Jul 15 10:45:27.919669 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:27.919436    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zwx4" podUID="e2a51efd-e7a8-4db0-8ded-c90e680619c8"
Jul 15 10:45:28.072923 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:28.072870    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2pzx" event={"ID":"4e117f92-f585-4797-9dfa-b9cf0f00026d","Type":"ContainerStarted","Data":"398278095be08e28007be620f0573c9224a96563870e542cf50715330abc57c4"}
Jul 15 10:45:28.075394 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:28.075368    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-216.ec2.internal" event={"ID":"0e5e62cf154ddbdbbccda45b7fc44e8f","Type":"ContainerStarted","Data":"c28d7e0470d2cd1ac9590a96c78263190dbd396790c1b63f4e1d89d23660891a"}
Jul 15 10:45:28.092628 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:28.092567    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-216.ec2.internal" podStartSLOduration=25.092549276 podStartE2EDuration="25.092549276s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:45:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:45:28.091918965 +0000 UTC m=+25.700454988" watchObservedRunningTime="2026-07-15 10:45:28.092549276 +0000 UTC m=+25.701085301"
Jul 15 10:45:29.080912 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:29.080836    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qsch8_f3b175c1-34f8-4e74-bce6-f866e4bd25b0/ovn-acl-logging/0.log"
Jul 15 10:45:29.081464 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:29.081267    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qsch8" event={"ID":"f3b175c1-34f8-4e74-bce6-f866e4bd25b0","Type":"ContainerStarted","Data":"fa5fa7b792eb828062f08d496400bd3725e1c38a74f78e324b9ca4afa30f21d3"}
Jul 15 10:45:29.083771 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:29.083744    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2pzx" event={"ID":"4e117f92-f585-4797-9dfa-b9cf0f00026d","Type":"ContainerStarted","Data":"41ef7dd6055371f6eee1819c900c1926f57679b5ff15fffcc46a62c93a5842a6"}
Jul 15 10:45:29.918890 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:29.918852    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrr95"
Jul 15 10:45:29.919072 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:29.918890    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4bht"
Jul 15 10:45:29.919072 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:29.918976    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrr95" podUID="82f6960e-f41d-4ad3-83c4-c515ff206787"
Jul 15 10:45:29.919072 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:29.919030    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zwx4"
Jul 15 10:45:29.919231 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:29.919114    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zwx4" podUID="e2a51efd-e7a8-4db0-8ded-c90e680619c8"
Jul 15 10:45:29.919231 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:29.919192    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4bht" podUID="f16a7597-8022-437b-a82b-ab187296ecdf"
Jul 15 10:45:31.092744 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:31.092506    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qsch8_f3b175c1-34f8-4e74-bce6-f866e4bd25b0/ovn-acl-logging/0.log"
Jul 15 10:45:31.093438 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:31.093052    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qsch8" event={"ID":"f3b175c1-34f8-4e74-bce6-f866e4bd25b0","Type":"ContainerStarted","Data":"57549a9b8dc6bc2dde6a4385ad8ac473d026f8370cda6fdd4dae74b7ff95d2a4"}
Jul 15 10:45:31.093438 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:31.093291    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:31.093438 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:31.093375    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:31.093585 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:31.093509    2565 scope.go:117] "RemoveContainer" containerID="012120863fdf202507475034213b479ccb82a0e2a40d2300f984d28444b9847e"
Jul 15 10:45:31.098279 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:31.097991    2565 generic.go:356] "Generic (PLEG): container finished" podID="6334daaf-6478-49ab-a989-ce254cc9a0d0" containerID="ef7371e7ce69c573874c8a1e80cbd11906ea9f3168732e0ccaa7994c00bf9262" exitCode=0
Jul 15 10:45:31.098279 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:31.098040    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tktcw" event={"ID":"6334daaf-6478-49ab-a989-ce254cc9a0d0","Type":"ContainerDied","Data":"ef7371e7ce69c573874c8a1e80cbd11906ea9f3168732e0ccaa7994c00bf9262"}
Jul 15 10:45:31.111294 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:31.111278    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:31.111860 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:31.111842    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:31.127183 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:31.127143    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k2pzx" podStartSLOduration=4.283338853 podStartE2EDuration="28.127130567s" totalImagesPullingTime="23.843791714s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:45:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:45:29.107920841 +0000 UTC m=+26.716456888" watchObservedRunningTime="2026-07-15 10:45:31.127130567 +0000 UTC m=+28.735666641"
Jul 15 10:45:31.777321 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:31.777294    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:45:31.919135 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:31.919089    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrr95"
Jul 15 10:45:31.919135 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:31.919110    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4bht"
Jul 15 10:45:31.919372 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:31.919139    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zwx4"
Jul 15 10:45:31.919372 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:31.919216    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrr95" podUID="82f6960e-f41d-4ad3-83c4-c515ff206787"
Jul 15 10:45:31.919454 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:31.919367    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4bht" podUID="f16a7597-8022-437b-a82b-ab187296ecdf"
Jul 15 10:45:31.919454 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:31.919431    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zwx4" podUID="e2a51efd-e7a8-4db0-8ded-c90e680619c8"
Jul 15 10:45:32.105358 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:32.105260    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qsch8_f3b175c1-34f8-4e74-bce6-f866e4bd25b0/ovn-acl-logging/0.log"
Jul 15 10:45:32.105895 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:32.105654    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qsch8" event={"ID":"f3b175c1-34f8-4e74-bce6-f866e4bd25b0","Type":"ContainerStarted","Data":"b3ac2490a80b3c1f43aaa4271d6038e711c57a39d4a4d487061e47355dac8317"}
Jul 15 10:45:32.146276 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:32.146217    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qsch8" podStartSLOduration=7.822070875 podStartE2EDuration="29.146197004s" totalImagesPullingTime="21.324126129s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:45:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:45:32.144191992 +0000 UTC m=+29.752728016" watchObservedRunningTime="2026-07-15 10:45:32.146197004 +0000 UTC m=+29.754733031"
Jul 15 10:45:33.110207 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:33.109950    2565 generic.go:356] "Generic (PLEG): container finished" podID="6334daaf-6478-49ab-a989-ce254cc9a0d0" containerID="f38cde99608b01f1d30c2306f52afe335abb06c6a5e161557fe2d2421683b6ee" exitCode=0
Jul 15 10:45:33.110670 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:33.110022    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tktcw" event={"ID":"6334daaf-6478-49ab-a989-ce254cc9a0d0","Type":"ContainerDied","Data":"f38cde99608b01f1d30c2306f52afe335abb06c6a5e161557fe2d2421683b6ee"}
Jul 15 10:45:33.330192 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:33.330155    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zrr95"]
Jul 15 10:45:33.330374 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:33.330259    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrr95"
Jul 15 10:45:33.330473 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:33.330361    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrr95" podUID="82f6960e-f41d-4ad3-83c4-c515ff206787"
Jul 15 10:45:33.331276 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:33.331233    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5zwx4"]
Jul 15 10:45:33.331406 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:33.331327    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zwx4"
Jul 15 10:45:33.331451 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:33.331417    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zwx4" podUID="e2a51efd-e7a8-4db0-8ded-c90e680619c8"
Jul 15 10:45:33.347166 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:33.347139    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-c4bht"]
Jul 15 10:45:33.347256 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:33.347243    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4bht"
Jul 15 10:45:33.347380 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:33.347360    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4bht" podUID="f16a7597-8022-437b-a82b-ab187296ecdf"
Jul 15 10:45:34.922703 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:34.922675    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrr95"
Jul 15 10:45:34.923120 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:34.922797    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zwx4"
Jul 15 10:45:34.923120 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:34.922791    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrr95" podUID="82f6960e-f41d-4ad3-83c4-c515ff206787"
Jul 15 10:45:34.923120 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:34.922829    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4bht"
Jul 15 10:45:34.923120 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:34.922901    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zwx4" podUID="e2a51efd-e7a8-4db0-8ded-c90e680619c8"
Jul 15 10:45:34.923120 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:34.922984    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4bht" podUID="f16a7597-8022-437b-a82b-ab187296ecdf"
Jul 15 10:45:35.117054 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:35.116957    2565 generic.go:356] "Generic (PLEG): container finished" podID="6334daaf-6478-49ab-a989-ce254cc9a0d0" containerID="973dd2d3326a85b13f35cbb4a1ba73c71a0acd0188960710b247177aecbac324" exitCode=0
Jul 15 10:45:35.117054 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:35.117017    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tktcw" event={"ID":"6334daaf-6478-49ab-a989-ce254cc9a0d0","Type":"ContainerDied","Data":"973dd2d3326a85b13f35cbb4a1ba73c71a0acd0188960710b247177aecbac324"}
Jul 15 10:45:35.561937 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:35.561903    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f16a7597-8022-437b-a82b-ab187296ecdf-metrics-certs\") pod \"network-metrics-daemon-c4bht\" (UID: \"f16a7597-8022-437b-a82b-ab187296ecdf\") " pod="openshift-multus/network-metrics-daemon-c4bht"
Jul 15 10:45:35.562090 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:35.562054    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 10:45:35.562140 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:35.562130    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f16a7597-8022-437b-a82b-ab187296ecdf-metrics-certs podName:f16a7597-8022-437b-a82b-ab187296ecdf nodeName:}" failed. No retries permitted until 2026-07-15 10:46:07.562113701 +0000 UTC m=+65.170649704 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f16a7597-8022-437b-a82b-ab187296ecdf-metrics-certs") pod "network-metrics-daemon-c4bht" (UID: "f16a7597-8022-437b-a82b-ab187296ecdf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 10:45:35.663197 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:35.663158    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxrvg\" (UniqueName: \"kubernetes.io/projected/e2a51efd-e7a8-4db0-8ded-c90e680619c8-kube-api-access-xxrvg\") pod \"network-check-target-5zwx4\" (UID: \"e2a51efd-e7a8-4db0-8ded-c90e680619c8\") " pod="openshift-network-diagnostics/network-check-target-5zwx4"
Jul 15 10:45:35.663382 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:35.663233    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/82f6960e-f41d-4ad3-83c4-c515ff206787-original-pull-secret\") pod \"global-pull-secret-syncer-zrr95\" (UID: \"82f6960e-f41d-4ad3-83c4-c515ff206787\") " pod="kube-system/global-pull-secret-syncer-zrr95"
Jul 15 10:45:35.663382 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:35.663328    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 10:45:35.663469 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:35.663386    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 10:45:35.663469 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:35.663404    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 10:45:35.663469 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:35.663413    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82f6960e-f41d-4ad3-83c4-c515ff206787-original-pull-secret podName:82f6960e-f41d-4ad3-83c4-c515ff206787 nodeName:}" failed. No retries permitted until 2026-07-15 10:46:07.663396332 +0000 UTC m=+65.271932354 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/82f6960e-f41d-4ad3-83c4-c515ff206787-original-pull-secret") pod "global-pull-secret-syncer-zrr95" (UID: "82f6960e-f41d-4ad3-83c4-c515ff206787") : object "kube-system"/"original-pull-secret" not registered
Jul 15 10:45:35.663469 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:35.663417    2565 projected.go:196] Error preparing data for projected volume kube-api-access-xxrvg for pod openshift-network-diagnostics/network-check-target-5zwx4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 10:45:35.663469 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:35.663454    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2a51efd-e7a8-4db0-8ded-c90e680619c8-kube-api-access-xxrvg podName:e2a51efd-e7a8-4db0-8ded-c90e680619c8 nodeName:}" failed. No retries permitted until 2026-07-15 10:46:07.66344479 +0000 UTC m=+65.271980789 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xxrvg" (UniqueName: "kubernetes.io/projected/e2a51efd-e7a8-4db0-8ded-c90e680619c8-kube-api-access-xxrvg") pod "network-check-target-5zwx4" (UID: "e2a51efd-e7a8-4db0-8ded-c90e680619c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 10:45:36.922927 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:36.922896    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zwx4"
Jul 15 10:45:36.922927 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:36.922927    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrr95"
Jul 15 10:45:36.923760 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:36.922896    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4bht"
Jul 15 10:45:36.923760 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:36.923009    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5zwx4" podUID="e2a51efd-e7a8-4db0-8ded-c90e680619c8"
Jul 15 10:45:36.923760 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:36.923100    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4bht" podUID="f16a7597-8022-437b-a82b-ab187296ecdf"
Jul 15 10:45:36.923760 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:36.923158    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrr95" podUID="82f6960e-f41d-4ad3-83c4-c515ff206787"
Jul 15 10:45:38.152603 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.152573    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-216.ec2.internal" event="NodeReady"
Jul 15 10:45:38.153106 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.152744    2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 15 10:45:38.207468 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.207436    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c875865b-2sfdx"]
Jul 15 10:45:38.209885 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.209860    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c875865b-2sfdx"
Jul 15 10:45:38.216657 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.216633    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 15 10:45:38.216947 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.216907    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 15 10:45:38.217100 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.217048    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kw2sk\""
Jul 15 10:45:38.218640 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.218168    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 15 10:45:38.231058 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.231031    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 15 10:45:38.231986 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.231829    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c875865b-2sfdx"]
Jul 15 10:45:38.232640 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.232619    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5xbp6"]
Jul 15 10:45:38.235014 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.234993    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5xbp6"
Jul 15 10:45:38.242907 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.242887    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 15 10:45:38.243181 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.243165    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bd4vk\""
Jul 15 10:45:38.243956 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.243939    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-htj8h"]
Jul 15 10:45:38.244999 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.244978    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 15 10:45:38.246095 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.246076    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-htj8h"
Jul 15 10:45:38.250277 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:38.250250    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"default-dockercfg-6fwk8\" is forbidden: User \"system:node:ip-10-0-134-216.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress-canary\": no relationship found between node 'ip-10-0-134-216.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6fwk8\"" type="*v1.Secret"
Jul 15 10:45:38.250627 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:38.250510    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-134-216.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress-canary\": no relationship found between node 'ip-10-0-134-216.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 15 10:45:38.250627 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:38.250591    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"canary-serving-cert\" is forbidden: User \"system:node:ip-10-0-134-216.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress-canary\": no relationship found between node 'ip-10-0-134-216.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" type="*v1.Secret"
Jul 15 10:45:38.250891 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:38.250860    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-134-216.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress-canary\": no relationship found between node 'ip-10-0-134-216.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 15 10:45:38.251872 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.251808    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5xbp6"]
Jul 15 10:45:38.262071 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.262051    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-htj8h"]
Jul 15 10:45:38.281548 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.281520    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fb687929-8af4-470e-8679-26c69f00ca68-installation-pull-secrets\") pod \"image-registry-7c875865b-2sfdx\" (UID: \"fb687929-8af4-470e-8679-26c69f00ca68\") " pod="openshift-image-registry/image-registry-7c875865b-2sfdx"
Jul 15 10:45:38.281672 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.281557    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fb687929-8af4-470e-8679-26c69f00ca68-image-registry-private-configuration\") pod \"image-registry-7c875865b-2sfdx\" (UID: \"fb687929-8af4-470e-8679-26c69f00ca68\") " pod="openshift-image-registry/image-registry-7c875865b-2sfdx"
Jul 15 10:45:38.281672 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.281594    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fb687929-8af4-470e-8679-26c69f00ca68-bound-sa-token\") pod \"image-registry-7c875865b-2sfdx\" (UID: \"fb687929-8af4-470e-8679-26c69f00ca68\") " pod="openshift-image-registry/image-registry-7c875865b-2sfdx"
Jul 15 10:45:38.281672 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.281621    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lb5zw\" (UniqueName: \"kubernetes.io/projected/fb687929-8af4-470e-8679-26c69f00ca68-kube-api-access-lb5zw\") pod \"image-registry-7c875865b-2sfdx\" (UID: \"fb687929-8af4-470e-8679-26c69f00ca68\") " pod="openshift-image-registry/image-registry-7c875865b-2sfdx"
Jul 15 10:45:38.281832 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.281724    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fb687929-8af4-470e-8679-26c69f00ca68-registry-tls\") pod \"image-registry-7c875865b-2sfdx\" (UID: \"fb687929-8af4-470e-8679-26c69f00ca68\") " pod="openshift-image-registry/image-registry-7c875865b-2sfdx"
Jul 15 10:45:38.281832 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.281784    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fb687929-8af4-470e-8679-26c69f00ca68-ca-trust-extracted\") pod \"image-registry-7c875865b-2sfdx\" (UID: \"fb687929-8af4-470e-8679-26c69f00ca68\") " pod="openshift-image-registry/image-registry-7c875865b-2sfdx"
Jul 15 10:45:38.281832 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.281810    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fb687929-8af4-470e-8679-26c69f00ca68-registry-certificates\") pod \"image-registry-7c875865b-2sfdx\" (UID: \"fb687929-8af4-470e-8679-26c69f00ca68\") " pod="openshift-image-registry/image-registry-7c875865b-2sfdx"
Jul 15 10:45:38.281984 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.281843    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fb687929-8af4-470e-8679-26c69f00ca68-trusted-ca\") pod \"image-registry-7c875865b-2sfdx\" (UID: \"fb687929-8af4-470e-8679-26c69f00ca68\") " pod="openshift-image-registry/image-registry-7c875865b-2sfdx"
Jul 15 10:45:38.382230 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.382146    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfc5835e-29ae-4048-bf6f-d1685d6ec89c-metrics-tls\") pod \"dns-default-5xbp6\" (UID: \"cfc5835e-29ae-4048-bf6f-d1685d6ec89c\") " pod="openshift-dns/dns-default-5xbp6"
Jul 15 10:45:38.382230 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.382187    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fb687929-8af4-470e-8679-26c69f00ca68-ca-trust-extracted\") pod \"image-registry-7c875865b-2sfdx\" (UID: \"fb687929-8af4-470e-8679-26c69f00ca68\") " pod="openshift-image-registry/image-registry-7c875865b-2sfdx"
Jul 15 10:45:38.382230 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.382207    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fb687929-8af4-470e-8679-26c69f00ca68-registry-certificates\") pod \"image-registry-7c875865b-2sfdx\" (UID: \"fb687929-8af4-470e-8679-26c69f00ca68\") " pod="openshift-image-registry/image-registry-7c875865b-2sfdx"
Jul 15 10:45:38.382534 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.382235    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fb687929-8af4-470e-8679-26c69f00ca68-trusted-ca\") pod \"image-registry-7c875865b-2sfdx\" (UID: \"fb687929-8af4-470e-8679-26c69f00ca68\") " pod="openshift-image-registry/image-registry-7c875865b-2sfdx"
Jul 15 10:45:38.382534 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.382277    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfc5835e-29ae-4048-bf6f-d1685d6ec89c-tmp-dir\") pod \"dns-default-5xbp6\" (UID: \"cfc5835e-29ae-4048-bf6f-d1685d6ec89c\") " pod="openshift-dns/dns-default-5xbp6"
Jul 15 10:45:38.382534 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.382380    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fb687929-8af4-470e-8679-26c69f00ca68-installation-pull-secrets\") pod \"image-registry-7c875865b-2sfdx\" (UID: \"fb687929-8af4-470e-8679-26c69f00ca68\") " pod="openshift-image-registry/image-registry-7c875865b-2sfdx"
Jul 15 10:45:38.382534 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.382409    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cfc5835e-29ae-4048-bf6f-d1685d6ec89c-config-volume\") pod \"dns-default-5xbp6\" (UID: \"cfc5835e-29ae-4048-bf6f-d1685d6ec89c\") " pod="openshift-dns/dns-default-5xbp6"
Jul 15 10:45:38.382534 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.382510    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fb687929-8af4-470e-8679-26c69f00ca68-image-registry-private-configuration\") pod \"image-registry-7c875865b-2sfdx\" (UID: \"fb687929-8af4-470e-8679-26c69f00ca68\") " pod="openshift-image-registry/image-registry-7c875865b-2sfdx"
Jul 15 10:45:38.382773 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.382540    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fb687929-8af4-470e-8679-26c69f00ca68-bound-sa-token\") pod \"image-registry-7c875865b-2sfdx\" (UID: \"fb687929-8af4-470e-8679-26c69f00ca68\") " pod="openshift-image-registry/image-registry-7c875865b-2sfdx"
Jul 15 10:45:38.382773 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.382573    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lb5zw\" (UniqueName: \"kubernetes.io/projected/fb687929-8af4-470e-8679-26c69f00ca68-kube-api-access-lb5zw\") pod \"image-registry-7c875865b-2sfdx\" (UID: \"fb687929-8af4-470e-8679-26c69f00ca68\") " pod="openshift-image-registry/image-registry-7c875865b-2sfdx"
Jul 15 10:45:38.382773 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.382608    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqg89\" (UniqueName: \"kubernetes.io/projected/55c9eec3-1148-4ea6-8e77-1e1dcb085d3f-kube-api-access-nqg89\") pod \"ingress-canary-htj8h\" (UID: \"55c9eec3-1148-4ea6-8e77-1e1dcb085d3f\") " pod="openshift-ingress-canary/ingress-canary-htj8h"
Jul 15 10:45:38.382773 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.382622    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fb687929-8af4-470e-8679-26c69f00ca68-ca-trust-extracted\") pod \"image-registry-7c875865b-2sfdx\" (UID: \"fb687929-8af4-470e-8679-26c69f00ca68\") " pod="openshift-image-registry/image-registry-7c875865b-2sfdx"
Jul 15 10:45:38.382773 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.382637    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkgzc\" (UniqueName: \"kubernetes.io/projected/cfc5835e-29ae-4048-bf6f-d1685d6ec89c-kube-api-access-kkgzc\") pod \"dns-default-5xbp6\" (UID: \"cfc5835e-29ae-4048-bf6f-d1685d6ec89c\") " pod="openshift-dns/dns-default-5xbp6"
Jul 15 10:45:38.382980 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.382812    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fb687929-8af4-470e-8679-26c69f00ca68-registry-tls\") pod \"image-registry-7c875865b-2sfdx\" (UID: \"fb687929-8af4-470e-8679-26c69f00ca68\") " pod="openshift-image-registry/image-registry-7c875865b-2sfdx"
Jul 15 10:45:38.382980 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.382855    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55c9eec3-1148-4ea6-8e77-1e1dcb085d3f-cert\") pod \"ingress-canary-htj8h\" (UID: \"55c9eec3-1148-4ea6-8e77-1e1dcb085d3f\") " pod="openshift-ingress-canary/ingress-canary-htj8h"
Jul 15 10:45:38.382980 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:38.382967    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 10:45:38.382980 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:38.382981    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c875865b-2sfdx: secret "image-registry-tls" not found
Jul 15 10:45:38.383146 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.382993    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fb687929-8af4-470e-8679-26c69f00ca68-registry-certificates\") pod \"image-registry-7c875865b-2sfdx\" (UID: \"fb687929-8af4-470e-8679-26c69f00ca68\") " pod="openshift-image-registry/image-registry-7c875865b-2sfdx"
Jul 15 10:45:38.383146 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:38.383044    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb687929-8af4-470e-8679-26c69f00ca68-registry-tls podName:fb687929-8af4-470e-8679-26c69f00ca68 nodeName:}" failed. No retries permitted until 2026-07-15 10:45:38.883026284 +0000 UTC m=+36.491562283 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fb687929-8af4-470e-8679-26c69f00ca68-registry-tls") pod "image-registry-7c875865b-2sfdx" (UID: "fb687929-8af4-470e-8679-26c69f00ca68") : secret "image-registry-tls" not found
Jul 15 10:45:38.383274 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.383256    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fb687929-8af4-470e-8679-26c69f00ca68-trusted-ca\") pod \"image-registry-7c875865b-2sfdx\" (UID: \"fb687929-8af4-470e-8679-26c69f00ca68\") " pod="openshift-image-registry/image-registry-7c875865b-2sfdx"
Jul 15 10:45:38.387211 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.387047    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fb687929-8af4-470e-8679-26c69f00ca68-image-registry-private-configuration\") pod \"image-registry-7c875865b-2sfdx\" (UID: \"fb687929-8af4-470e-8679-26c69f00ca68\") " pod="openshift-image-registry/image-registry-7c875865b-2sfdx"
Jul 15 10:45:38.387326 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.387076    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fb687929-8af4-470e-8679-26c69f00ca68-installation-pull-secrets\") pod \"image-registry-7c875865b-2sfdx\" (UID: \"fb687929-8af4-470e-8679-26c69f00ca68\") " pod="openshift-image-registry/image-registry-7c875865b-2sfdx"
Jul 15 10:45:38.428625 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.428586    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fb687929-8af4-470e-8679-26c69f00ca68-bound-sa-token\") pod \"image-registry-7c875865b-2sfdx\" (UID: \"fb687929-8af4-470e-8679-26c69f00ca68\") " pod="openshift-image-registry/image-registry-7c875865b-2sfdx"
Jul 15 10:45:38.445373 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.445322    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lb5zw\" (UniqueName: \"kubernetes.io/projected/fb687929-8af4-470e-8679-26c69f00ca68-kube-api-access-lb5zw\") pod \"image-registry-7c875865b-2sfdx\" (UID: \"fb687929-8af4-470e-8679-26c69f00ca68\") " pod="openshift-image-registry/image-registry-7c875865b-2sfdx"
Jul 15 10:45:38.484172 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.484140    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cfc5835e-29ae-4048-bf6f-d1685d6ec89c-config-volume\") pod \"dns-default-5xbp6\" (UID: \"cfc5835e-29ae-4048-bf6f-d1685d6ec89c\") " pod="openshift-dns/dns-default-5xbp6"
Jul 15 10:45:38.484316 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.484199    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqg89\" (UniqueName: \"kubernetes.io/projected/55c9eec3-1148-4ea6-8e77-1e1dcb085d3f-kube-api-access-nqg89\") pod \"ingress-canary-htj8h\" (UID: \"55c9eec3-1148-4ea6-8e77-1e1dcb085d3f\") " pod="openshift-ingress-canary/ingress-canary-htj8h"
Jul 15 10:45:38.484316 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.484225    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkgzc\" (UniqueName: \"kubernetes.io/projected/cfc5835e-29ae-4048-bf6f-d1685d6ec89c-kube-api-access-kkgzc\") pod \"dns-default-5xbp6\" (UID: \"cfc5835e-29ae-4048-bf6f-d1685d6ec89c\") " pod="openshift-dns/dns-default-5xbp6"
Jul 15 10:45:38.484456 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.484355    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55c9eec3-1148-4ea6-8e77-1e1dcb085d3f-cert\") pod \"ingress-canary-htj8h\" (UID: \"55c9eec3-1148-4ea6-8e77-1e1dcb085d3f\") " pod="openshift-ingress-canary/ingress-canary-htj8h"
Jul 15 10:45:38.484456 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.484409    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfc5835e-29ae-4048-bf6f-d1685d6ec89c-metrics-tls\") pod \"dns-default-5xbp6\" (UID: \"cfc5835e-29ae-4048-bf6f-d1685d6ec89c\") " pod="openshift-dns/dns-default-5xbp6"
Jul 15 10:45:38.484456 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.484451    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfc5835e-29ae-4048-bf6f-d1685d6ec89c-tmp-dir\") pod \"dns-default-5xbp6\" (UID: \"cfc5835e-29ae-4048-bf6f-d1685d6ec89c\") " pod="openshift-dns/dns-default-5xbp6"
Jul 15 10:45:38.484759 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.484729    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cfc5835e-29ae-4048-bf6f-d1685d6ec89c-config-volume\") pod \"dns-default-5xbp6\" (UID: \"cfc5835e-29ae-4048-bf6f-d1685d6ec89c\") " pod="openshift-dns/dns-default-5xbp6"
Jul 15 10:45:38.484854 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.484799    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfc5835e-29ae-4048-bf6f-d1685d6ec89c-tmp-dir\") pod \"dns-default-5xbp6\" (UID: \"cfc5835e-29ae-4048-bf6f-d1685d6ec89c\") " pod="openshift-dns/dns-default-5xbp6"
Jul 15 10:45:38.484854 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:38.484818    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 10:45:38.484925 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:38.484907    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfc5835e-29ae-4048-bf6f-d1685d6ec89c-metrics-tls podName:cfc5835e-29ae-4048-bf6f-d1685d6ec89c nodeName:}" failed. No retries permitted until 2026-07-15 10:45:38.98488324 +0000 UTC m=+36.593419258 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cfc5835e-29ae-4048-bf6f-d1685d6ec89c-metrics-tls") pod "dns-default-5xbp6" (UID: "cfc5835e-29ae-4048-bf6f-d1685d6ec89c") : secret "dns-default-metrics-tls" not found
Jul 15 10:45:38.501052 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.501027    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkgzc\" (UniqueName: \"kubernetes.io/projected/cfc5835e-29ae-4048-bf6f-d1685d6ec89c-kube-api-access-kkgzc\") pod \"dns-default-5xbp6\" (UID: \"cfc5835e-29ae-4048-bf6f-d1685d6ec89c\") " pod="openshift-dns/dns-default-5xbp6"
Jul 15 10:45:38.888938 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.888901    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fb687929-8af4-470e-8679-26c69f00ca68-registry-tls\") pod \"image-registry-7c875865b-2sfdx\" (UID: \"fb687929-8af4-470e-8679-26c69f00ca68\") " pod="openshift-image-registry/image-registry-7c875865b-2sfdx"
Jul 15 10:45:38.889122 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:38.889099    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 10:45:38.889189 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:38.889127    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c875865b-2sfdx: secret "image-registry-tls" not found
Jul 15 10:45:38.889235 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:38.889198    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb687929-8af4-470e-8679-26c69f00ca68-registry-tls podName:fb687929-8af4-470e-8679-26c69f00ca68 nodeName:}" failed. No retries permitted until 2026-07-15 10:45:39.889175973 +0000 UTC m=+37.497711973 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fb687929-8af4-470e-8679-26c69f00ca68-registry-tls") pod "image-registry-7c875865b-2sfdx" (UID: "fb687929-8af4-470e-8679-26c69f00ca68") : secret "image-registry-tls" not found
Jul 15 10:45:38.918952 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.918923    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4bht"
Jul 15 10:45:38.919110 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.918923    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zwx4"
Jul 15 10:45:38.919162 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.919150    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrr95"
Jul 15 10:45:38.922135 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.922116    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 10:45:38.922377 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.922313    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-n9w8s\""
Jul 15 10:45:38.922466 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.922388    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 10:45:38.922682 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.922665    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cs2nv\""
Jul 15 10:45:38.922750 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.922702    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 10:45:38.922788 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.922666    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 10:45:38.990443 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:38.990408    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfc5835e-29ae-4048-bf6f-d1685d6ec89c-metrics-tls\") pod \"dns-default-5xbp6\" (UID: \"cfc5835e-29ae-4048-bf6f-d1685d6ec89c\") " pod="openshift-dns/dns-default-5xbp6"
Jul 15 10:45:38.990605 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:38.990550    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 10:45:38.990654 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:38.990624    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfc5835e-29ae-4048-bf6f-d1685d6ec89c-metrics-tls podName:cfc5835e-29ae-4048-bf6f-d1685d6ec89c nodeName:}" failed. No retries permitted until 2026-07-15 10:45:39.990606752 +0000 UTC m=+37.599142758 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cfc5835e-29ae-4048-bf6f-d1685d6ec89c-metrics-tls") pod "dns-default-5xbp6" (UID: "cfc5835e-29ae-4048-bf6f-d1685d6ec89c") : secret "dns-default-metrics-tls" not found
Jul 15 10:45:39.341436 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:39.341405    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6fwk8\""
Jul 15 10:45:39.349031 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:39.349000    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 15 10:45:39.438425 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:39.438388    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 15 10:45:39.442621 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:39.442598    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqg89\" (UniqueName: \"kubernetes.io/projected/55c9eec3-1148-4ea6-8e77-1e1dcb085d3f-kube-api-access-nqg89\") pod \"ingress-canary-htj8h\" (UID: \"55c9eec3-1148-4ea6-8e77-1e1dcb085d3f\") " pod="openshift-ingress-canary/ingress-canary-htj8h"
Jul 15 10:45:39.485095 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:39.485064    2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: failed to sync secret cache: timed out waiting for the condition
Jul 15 10:45:39.485228 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:39.485148    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55c9eec3-1148-4ea6-8e77-1e1dcb085d3f-cert podName:55c9eec3-1148-4ea6-8e77-1e1dcb085d3f nodeName:}" failed. No retries permitted until 2026-07-15 10:45:39.985125361 +0000 UTC m=+37.593661361 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/55c9eec3-1148-4ea6-8e77-1e1dcb085d3f-cert") pod "ingress-canary-htj8h" (UID: "55c9eec3-1148-4ea6-8e77-1e1dcb085d3f") : failed to sync secret cache: timed out waiting for the condition
Jul 15 10:45:39.576119 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:39.576092    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 15 10:45:39.899173 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:39.899134    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fb687929-8af4-470e-8679-26c69f00ca68-registry-tls\") pod \"image-registry-7c875865b-2sfdx\" (UID: \"fb687929-8af4-470e-8679-26c69f00ca68\") " pod="openshift-image-registry/image-registry-7c875865b-2sfdx"
Jul 15 10:45:39.899368 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:39.899286    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 10:45:39.899368 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:39.899311    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c875865b-2sfdx: secret "image-registry-tls" not found
Jul 15 10:45:39.899494 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:39.899394    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb687929-8af4-470e-8679-26c69f00ca68-registry-tls podName:fb687929-8af4-470e-8679-26c69f00ca68 nodeName:}" failed. No retries permitted until 2026-07-15 10:45:41.899378839 +0000 UTC m=+39.507914838 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fb687929-8af4-470e-8679-26c69f00ca68-registry-tls") pod "image-registry-7c875865b-2sfdx" (UID: "fb687929-8af4-470e-8679-26c69f00ca68") : secret "image-registry-tls" not found
Jul 15 10:45:39.999879 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:39.999841    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55c9eec3-1148-4ea6-8e77-1e1dcb085d3f-cert\") pod \"ingress-canary-htj8h\" (UID: \"55c9eec3-1148-4ea6-8e77-1e1dcb085d3f\") " pod="openshift-ingress-canary/ingress-canary-htj8h"
Jul 15 10:45:39.999879 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:39.999884    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfc5835e-29ae-4048-bf6f-d1685d6ec89c-metrics-tls\") pod \"dns-default-5xbp6\" (UID: \"cfc5835e-29ae-4048-bf6f-d1685d6ec89c\") " pod="openshift-dns/dns-default-5xbp6"
Jul 15 10:45:40.000064 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:40.000020    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 10:45:40.000102 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:40.000086    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfc5835e-29ae-4048-bf6f-d1685d6ec89c-metrics-tls podName:cfc5835e-29ae-4048-bf6f-d1685d6ec89c nodeName:}" failed. No retries permitted until 2026-07-15 10:45:42.000070537 +0000 UTC m=+39.608606549 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cfc5835e-29ae-4048-bf6f-d1685d6ec89c-metrics-tls") pod "dns-default-5xbp6" (UID: "cfc5835e-29ae-4048-bf6f-d1685d6ec89c") : secret "dns-default-metrics-tls" not found
Jul 15 10:45:40.002384 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:40.002361    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55c9eec3-1148-4ea6-8e77-1e1dcb085d3f-cert\") pod \"ingress-canary-htj8h\" (UID: \"55c9eec3-1148-4ea6-8e77-1e1dcb085d3f\") " pod="openshift-ingress-canary/ingress-canary-htj8h"
Jul 15 10:45:40.057760 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:40.057726    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-htj8h"
Jul 15 10:45:40.142209 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:40.141635    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:45:40.202940 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:40.202913    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-htj8h"]
Jul 15 10:45:40.207278 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:45:40.207250    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55c9eec3_1148_4ea6_8e77_1e1dcb085d3f.slice/crio-4da8b6534f911782b217477d9d33d1980cec7f3d0cae2a1461b0061cdd4439c1 WatchSource:0}: Error finding container 4da8b6534f911782b217477d9d33d1980cec7f3d0cae2a1461b0061cdd4439c1: Status 404 returned error can't find the container with id 4da8b6534f911782b217477d9d33d1980cec7f3d0cae2a1461b0061cdd4439c1
Jul 15 10:45:40.238202 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:40.238167    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:45:40.336561 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:40.336524    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:45:41.133530 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:41.133491    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-htj8h" event={"ID":"55c9eec3-1148-4ea6-8e77-1e1dcb085d3f","Type":"ContainerStarted","Data":"4da8b6534f911782b217477d9d33d1980cec7f3d0cae2a1461b0061cdd4439c1"}
Jul 15 10:45:41.136763 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:41.136736    2565 generic.go:356] "Generic (PLEG): container finished" podID="6334daaf-6478-49ab-a989-ce254cc9a0d0" containerID="be2e4ac6fe93421ab1d1b04acd45f9490153816ff50f2987eb41e7deccdb82b7" exitCode=0
Jul 15 10:45:41.136881 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:41.136790    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tktcw" event={"ID":"6334daaf-6478-49ab-a989-ce254cc9a0d0","Type":"ContainerDied","Data":"be2e4ac6fe93421ab1d1b04acd45f9490153816ff50f2987eb41e7deccdb82b7"}
Jul 15 10:45:41.916215 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:41.915991    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fb687929-8af4-470e-8679-26c69f00ca68-registry-tls\") pod \"image-registry-7c875865b-2sfdx\" (UID: \"fb687929-8af4-470e-8679-26c69f00ca68\") " pod="openshift-image-registry/image-registry-7c875865b-2sfdx"
Jul 15 10:45:41.916421 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:41.916182    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 10:45:41.916421 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:41.916243    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c875865b-2sfdx: secret "image-registry-tls" not found
Jul 15 10:45:41.916421 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:41.916301    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb687929-8af4-470e-8679-26c69f00ca68-registry-tls podName:fb687929-8af4-470e-8679-26c69f00ca68 nodeName:}" failed. No retries permitted until 2026-07-15 10:45:45.916280219 +0000 UTC m=+43.524816220 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fb687929-8af4-470e-8679-26c69f00ca68-registry-tls") pod "image-registry-7c875865b-2sfdx" (UID: "fb687929-8af4-470e-8679-26c69f00ca68") : secret "image-registry-tls" not found
Jul 15 10:45:42.017059 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:42.017022    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfc5835e-29ae-4048-bf6f-d1685d6ec89c-metrics-tls\") pod \"dns-default-5xbp6\" (UID: \"cfc5835e-29ae-4048-bf6f-d1685d6ec89c\") " pod="openshift-dns/dns-default-5xbp6"
Jul 15 10:45:42.017291 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:42.017177    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 10:45:42.017291 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:42.017260    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfc5835e-29ae-4048-bf6f-d1685d6ec89c-metrics-tls podName:cfc5835e-29ae-4048-bf6f-d1685d6ec89c nodeName:}" failed. No retries permitted until 2026-07-15 10:45:46.017240589 +0000 UTC m=+43.625776612 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cfc5835e-29ae-4048-bf6f-d1685d6ec89c-metrics-tls") pod "dns-default-5xbp6" (UID: "cfc5835e-29ae-4048-bf6f-d1685d6ec89c") : secret "dns-default-metrics-tls" not found
Jul 15 10:45:42.146430 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:42.146390    2565 generic.go:356] "Generic (PLEG): container finished" podID="6334daaf-6478-49ab-a989-ce254cc9a0d0" containerID="f7506165c7a77661450a7d22179f009e6b79fcf34399b32145eb65a8967d0d68" exitCode=0
Jul 15 10:45:42.146984 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:42.146458    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tktcw" event={"ID":"6334daaf-6478-49ab-a989-ce254cc9a0d0","Type":"ContainerDied","Data":"f7506165c7a77661450a7d22179f009e6b79fcf34399b32145eb65a8967d0d68"}
Jul 15 10:45:42.822329 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:42.822299    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:45:42.917129 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:42.917085    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:45:43.151990 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:43.151897    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tktcw" event={"ID":"6334daaf-6478-49ab-a989-ce254cc9a0d0","Type":"ContainerStarted","Data":"4472244aae40b547e538d9ea06fed16786c607b0b6986bc9cf4980da9b9c3891"}
Jul 15 10:45:43.153787 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:43.153764    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-htj8h" event={"ID":"55c9eec3-1148-4ea6-8e77-1e1dcb085d3f","Type":"ContainerStarted","Data":"e9a71c3b4332e2dae20bd4c193ea38f11578d8b79eb43f1d42111462337640fa"}
Jul 15 10:45:43.233945 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:43.233798    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tktcw" podStartSLOduration=6.86839174 podStartE2EDuration="40.233778755s" totalImagesPullingTime="33.365387015s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:45:03 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:45:43.200951955 +0000 UTC m=+40.809487975" watchObservedRunningTime="2026-07-15 10:45:43.233778755 +0000 UTC m=+40.842314779"
Jul 15 10:45:43.234135 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:43.234092    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-htj8h" podStartSLOduration=2.657564366 podStartE2EDuration="5.234079297s" totalImagesPullingTime="2.576514931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:45:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:45:43.232900416 +0000 UTC m=+40.841436438" watchObservedRunningTime="2026-07-15 10:45:43.234079297 +0000 UTC m=+40.842615324"
Jul 15 10:45:43.324540 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:43.324500    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:45:43.384456 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:43.384410    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:45:43.449782 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:43.449712    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:45:45.946838 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:45.946793    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fb687929-8af4-470e-8679-26c69f00ca68-registry-tls\") pod \"image-registry-7c875865b-2sfdx\" (UID: \"fb687929-8af4-470e-8679-26c69f00ca68\") " pod="openshift-image-registry/image-registry-7c875865b-2sfdx"
Jul 15 10:45:45.947227 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:45.946951    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 10:45:45.947227 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:45.946967    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c875865b-2sfdx: secret "image-registry-tls" not found
Jul 15 10:45:45.947227 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:45.947026    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb687929-8af4-470e-8679-26c69f00ca68-registry-tls podName:fb687929-8af4-470e-8679-26c69f00ca68 nodeName:}" failed. No retries permitted until 2026-07-15 10:45:53.947009485 +0000 UTC m=+51.555545485 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fb687929-8af4-470e-8679-26c69f00ca68-registry-tls") pod "image-registry-7c875865b-2sfdx" (UID: "fb687929-8af4-470e-8679-26c69f00ca68") : secret "image-registry-tls" not found
Jul 15 10:45:46.047586 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:46.047549    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfc5835e-29ae-4048-bf6f-d1685d6ec89c-metrics-tls\") pod \"dns-default-5xbp6\" (UID: \"cfc5835e-29ae-4048-bf6f-d1685d6ec89c\") " pod="openshift-dns/dns-default-5xbp6"
Jul 15 10:45:46.047750 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:46.047664    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 10:45:46.047750 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:46.047714    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfc5835e-29ae-4048-bf6f-d1685d6ec89c-metrics-tls podName:cfc5835e-29ae-4048-bf6f-d1685d6ec89c nodeName:}" failed. No retries permitted until 2026-07-15 10:45:54.047701725 +0000 UTC m=+51.656237725 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cfc5835e-29ae-4048-bf6f-d1685d6ec89c-metrics-tls") pod "dns-default-5xbp6" (UID: "cfc5835e-29ae-4048-bf6f-d1685d6ec89c") : secret "dns-default-metrics-tls" not found
Jul 15 10:45:54.008237 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:54.008201    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fb687929-8af4-470e-8679-26c69f00ca68-registry-tls\") pod \"image-registry-7c875865b-2sfdx\" (UID: \"fb687929-8af4-470e-8679-26c69f00ca68\") " pod="openshift-image-registry/image-registry-7c875865b-2sfdx"
Jul 15 10:45:54.008751 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:54.008328    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 10:45:54.008751 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:54.008361    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c875865b-2sfdx: secret "image-registry-tls" not found
Jul 15 10:45:54.008751 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:54.008412    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb687929-8af4-470e-8679-26c69f00ca68-registry-tls podName:fb687929-8af4-470e-8679-26c69f00ca68 nodeName:}" failed. No retries permitted until 2026-07-15 10:46:10.00839744 +0000 UTC m=+67.616933440 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fb687929-8af4-470e-8679-26c69f00ca68-registry-tls") pod "image-registry-7c875865b-2sfdx" (UID: "fb687929-8af4-470e-8679-26c69f00ca68") : secret "image-registry-tls" not found
Jul 15 10:45:54.109562 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:54.109521    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfc5835e-29ae-4048-bf6f-d1685d6ec89c-metrics-tls\") pod \"dns-default-5xbp6\" (UID: \"cfc5835e-29ae-4048-bf6f-d1685d6ec89c\") " pod="openshift-dns/dns-default-5xbp6"
Jul 15 10:45:54.109705 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:54.109685    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 10:45:54.109775 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:45:54.109764    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfc5835e-29ae-4048-bf6f-d1685d6ec89c-metrics-tls podName:cfc5835e-29ae-4048-bf6f-d1685d6ec89c nodeName:}" failed. No retries permitted until 2026-07-15 10:46:10.109741349 +0000 UTC m=+67.718277350 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cfc5835e-29ae-4048-bf6f-d1685d6ec89c-metrics-tls") pod "dns-default-5xbp6" (UID: "cfc5835e-29ae-4048-bf6f-d1685d6ec89c") : secret "dns-default-metrics-tls" not found
Jul 15 10:45:56.760132 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:56.760095    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:45:56.823736 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:56.823705    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:45:57.775231 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:57.775187    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:45:57.877146 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:57.877111    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:45:59.039225 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:59.039188    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:45:59.129459 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:59.129426    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:45:59.229170 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:45:59.229140    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:00.089132 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:00.089099    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:00.187851 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:00.187813    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:01.448187 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.448154    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2x6fl"]
Jul 15 10:46:01.451000 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.450981    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-g9swl"]
Jul 15 10:46:01.451120 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.451102    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2x6fl"
Jul 15 10:46:01.453080 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.453065    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-g9swl"
Jul 15 10:46:01.455949 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.455925    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 15 10:46:01.456059 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.455929    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 15 10:46:01.456059 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.455929    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-wmgtx\""
Jul 15 10:46:01.457593 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.457438    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 15 10:46:01.457593 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.457453    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 15 10:46:01.457593 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.457468    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 15 10:46:01.457593 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.457484    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 15 10:46:01.457593 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.457494    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-kmbdx\""
Jul 15 10:46:01.457593 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.457494    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 15 10:46:01.457593 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.457576    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 15 10:46:01.460021 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.459998    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/63270ef2-9f47-4772-9807-6c7fb426005b-snapshots\") pod \"insights-operator-68d9dd94cf-g9swl\" (UID: \"63270ef2-9f47-4772-9807-6c7fb426005b\") " pod="openshift-insights/insights-operator-68d9dd94cf-g9swl"
Jul 15 10:46:01.460118 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.460043    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63270ef2-9f47-4772-9807-6c7fb426005b-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-g9swl\" (UID: \"63270ef2-9f47-4772-9807-6c7fb426005b\") " pod="openshift-insights/insights-operator-68d9dd94cf-g9swl"
Jul 15 10:46:01.460156 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.460123    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-2x6fl\" (UID: \"5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2x6fl"
Jul 15 10:46:01.460189 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.460171    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66mlw\" (UniqueName: \"kubernetes.io/projected/5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e-kube-api-access-66mlw\") pod \"cluster-monitoring-operator-5f7f494dd4-2x6fl\" (UID: \"5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2x6fl"
Jul 15 10:46:01.460221 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.460206    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63270ef2-9f47-4772-9807-6c7fb426005b-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-g9swl\" (UID: \"63270ef2-9f47-4772-9807-6c7fb426005b\") " pod="openshift-insights/insights-operator-68d9dd94cf-g9swl"
Jul 15 10:46:01.460254 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.460225    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/63270ef2-9f47-4772-9807-6c7fb426005b-serving-cert\") pod \"insights-operator-68d9dd94cf-g9swl\" (UID: \"63270ef2-9f47-4772-9807-6c7fb426005b\") " pod="openshift-insights/insights-operator-68d9dd94cf-g9swl"
Jul 15 10:46:01.460292 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.460256    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-2x6fl\" (UID: \"5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2x6fl"
Jul 15 10:46:01.460327 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.460312    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2mx5\" (UniqueName: \"kubernetes.io/projected/63270ef2-9f47-4772-9807-6c7fb426005b-kube-api-access-b2mx5\") pod \"insights-operator-68d9dd94cf-g9swl\" (UID: \"63270ef2-9f47-4772-9807-6c7fb426005b\") " pod="openshift-insights/insights-operator-68d9dd94cf-g9swl"
Jul 15 10:46:01.460436 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.460417    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63270ef2-9f47-4772-9807-6c7fb426005b-tmp\") pod \"insights-operator-68d9dd94cf-g9swl\" (UID: \"63270ef2-9f47-4772-9807-6c7fb426005b\") " pod="openshift-insights/insights-operator-68d9dd94cf-g9swl"
Jul 15 10:46:01.461212 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.461196    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 15 10:46:01.471015 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.470992    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2x6fl"]
Jul 15 10:46:01.471843 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.471819    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-g9swl"]
Jul 15 10:46:01.550281 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.550247    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-9984c7d94-5kjkb"]
Jul 15 10:46:01.554896 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.554867    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-9984c7d94-5kjkb"
Jul 15 10:46:01.557295 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.557270    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 15 10:46:01.560798 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.560768    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/63270ef2-9f47-4772-9807-6c7fb426005b-snapshots\") pod \"insights-operator-68d9dd94cf-g9swl\" (UID: \"63270ef2-9f47-4772-9807-6c7fb426005b\") " pod="openshift-insights/insights-operator-68d9dd94cf-g9swl"
Jul 15 10:46:01.560934 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.560856    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/725cfee7-4a3b-424f-9412-ff710b7218e3-service-ca-bundle\") pod \"router-default-9984c7d94-5kjkb\" (UID: \"725cfee7-4a3b-424f-9412-ff710b7218e3\") " pod="openshift-ingress/router-default-9984c7d94-5kjkb"
Jul 15 10:46:01.560934 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.560901    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/725cfee7-4a3b-424f-9412-ff710b7218e3-stats-auth\") pod \"router-default-9984c7d94-5kjkb\" (UID: \"725cfee7-4a3b-424f-9412-ff710b7218e3\") " pod="openshift-ingress/router-default-9984c7d94-5kjkb"
Jul 15 10:46:01.560934 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.560928    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp8gx\" (UniqueName: \"kubernetes.io/projected/725cfee7-4a3b-424f-9412-ff710b7218e3-kube-api-access-gp8gx\") pod \"router-default-9984c7d94-5kjkb\" (UID: \"725cfee7-4a3b-424f-9412-ff710b7218e3\") " pod="openshift-ingress/router-default-9984c7d94-5kjkb"
Jul 15 10:46:01.561093 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.560962    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-2x6fl\" (UID: \"5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2x6fl"
Jul 15 10:46:01.561093 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.561015    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/63270ef2-9f47-4772-9807-6c7fb426005b-serving-cert\") pod \"insights-operator-68d9dd94cf-g9swl\" (UID: \"63270ef2-9f47-4772-9807-6c7fb426005b\") " pod="openshift-insights/insights-operator-68d9dd94cf-g9swl"
Jul 15 10:46:01.561093 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:01.561062    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 10:46:01.561093 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.561081    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/725cfee7-4a3b-424f-9412-ff710b7218e3-default-certificate\") pod \"router-default-9984c7d94-5kjkb\" (UID: \"725cfee7-4a3b-424f-9412-ff710b7218e3\") " pod="openshift-ingress/router-default-9984c7d94-5kjkb"
Jul 15 10:46:01.561437 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:01.561123    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e-cluster-monitoring-operator-tls podName:5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e nodeName:}" failed. No retries permitted until 2026-07-15 10:46:02.061102822 +0000 UTC m=+59.669638823 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-2x6fl" (UID: "5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e") : secret "cluster-monitoring-operator-tls" not found
Jul 15 10:46:01.561437 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.561143    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-2x6fl\" (UID: \"5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2x6fl"
Jul 15 10:46:01.561437 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.561172    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/725cfee7-4a3b-424f-9412-ff710b7218e3-metrics-certs\") pod \"router-default-9984c7d94-5kjkb\" (UID: \"725cfee7-4a3b-424f-9412-ff710b7218e3\") " pod="openshift-ingress/router-default-9984c7d94-5kjkb"
Jul 15 10:46:01.561437 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.561204    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2mx5\" (UniqueName: \"kubernetes.io/projected/63270ef2-9f47-4772-9807-6c7fb426005b-kube-api-access-b2mx5\") pod \"insights-operator-68d9dd94cf-g9swl\" (UID: \"63270ef2-9f47-4772-9807-6c7fb426005b\") " pod="openshift-insights/insights-operator-68d9dd94cf-g9swl"
Jul 15 10:46:01.561437 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.561242    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63270ef2-9f47-4772-9807-6c7fb426005b-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-g9swl\" (UID: \"63270ef2-9f47-4772-9807-6c7fb426005b\") " pod="openshift-insights/insights-operator-68d9dd94cf-g9swl"
Jul 15 10:46:01.561437 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.561292    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63270ef2-9f47-4772-9807-6c7fb426005b-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-g9swl\" (UID: \"63270ef2-9f47-4772-9807-6c7fb426005b\") " pod="openshift-insights/insights-operator-68d9dd94cf-g9swl"
Jul 15 10:46:01.561437 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.561357    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66mlw\" (UniqueName: \"kubernetes.io/projected/5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e-kube-api-access-66mlw\") pod \"cluster-monitoring-operator-5f7f494dd4-2x6fl\" (UID: \"5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2x6fl"
Jul 15 10:46:01.561437 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.561389    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63270ef2-9f47-4772-9807-6c7fb426005b-tmp\") pod \"insights-operator-68d9dd94cf-g9swl\" (UID: \"63270ef2-9f47-4772-9807-6c7fb426005b\") " pod="openshift-insights/insights-operator-68d9dd94cf-g9swl"
Jul 15 10:46:01.561437 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.561393    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 15 10:46:01.561866 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.561510    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/63270ef2-9f47-4772-9807-6c7fb426005b-snapshots\") pod \"insights-operator-68d9dd94cf-g9swl\" (UID: \"63270ef2-9f47-4772-9807-6c7fb426005b\") " pod="openshift-insights/insights-operator-68d9dd94cf-g9swl"
Jul 15 10:46:01.561866 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.561554    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 15 10:46:01.561970 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.561915    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 15 10:46:01.562026 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.561965    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63270ef2-9f47-4772-9807-6c7fb426005b-tmp\") pod \"insights-operator-68d9dd94cf-g9swl\" (UID: \"63270ef2-9f47-4772-9807-6c7fb426005b\") " pod="openshift-insights/insights-operator-68d9dd94cf-g9swl"
Jul 15 10:46:01.562169 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.562130    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 15 10:46:01.562169 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.562149    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 15 10:46:01.562272 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.562232    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-2x6fl\" (UID: \"5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2x6fl"
Jul 15 10:46:01.562484 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.562467    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-r4kwn\""
Jul 15 10:46:01.562545 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.562488    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63270ef2-9f47-4772-9807-6c7fb426005b-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-g9swl\" (UID: \"63270ef2-9f47-4772-9807-6c7fb426005b\") " pod="openshift-insights/insights-operator-68d9dd94cf-g9swl"
Jul 15 10:46:01.562545 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.562468    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63270ef2-9f47-4772-9807-6c7fb426005b-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-g9swl\" (UID: \"63270ef2-9f47-4772-9807-6c7fb426005b\") " pod="openshift-insights/insights-operator-68d9dd94cf-g9swl"
Jul 15 10:46:01.565029 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.565008    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/63270ef2-9f47-4772-9807-6c7fb426005b-serving-cert\") pod \"insights-operator-68d9dd94cf-g9swl\" (UID: \"63270ef2-9f47-4772-9807-6c7fb426005b\") " pod="openshift-insights/insights-operator-68d9dd94cf-g9swl"
Jul 15 10:46:01.574107 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.574084    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-9984c7d94-5kjkb"]
Jul 15 10:46:01.575791 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.575768    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66mlw\" (UniqueName: \"kubernetes.io/projected/5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e-kube-api-access-66mlw\") pod \"cluster-monitoring-operator-5f7f494dd4-2x6fl\" (UID: \"5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2x6fl"
Jul 15 10:46:01.576047 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.576026    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2mx5\" (UniqueName: \"kubernetes.io/projected/63270ef2-9f47-4772-9807-6c7fb426005b-kube-api-access-b2mx5\") pod \"insights-operator-68d9dd94cf-g9swl\" (UID: \"63270ef2-9f47-4772-9807-6c7fb426005b\") " pod="openshift-insights/insights-operator-68d9dd94cf-g9swl"
Jul 15 10:46:01.661695 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.661663    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/725cfee7-4a3b-424f-9412-ff710b7218e3-service-ca-bundle\") pod \"router-default-9984c7d94-5kjkb\" (UID: \"725cfee7-4a3b-424f-9412-ff710b7218e3\") " pod="openshift-ingress/router-default-9984c7d94-5kjkb"
Jul 15 10:46:01.661695 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.661704    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/725cfee7-4a3b-424f-9412-ff710b7218e3-stats-auth\") pod \"router-default-9984c7d94-5kjkb\" (UID: \"725cfee7-4a3b-424f-9412-ff710b7218e3\") " pod="openshift-ingress/router-default-9984c7d94-5kjkb"
Jul 15 10:46:01.661895 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.661727    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp8gx\" (UniqueName: \"kubernetes.io/projected/725cfee7-4a3b-424f-9412-ff710b7218e3-kube-api-access-gp8gx\") pod \"router-default-9984c7d94-5kjkb\" (UID: \"725cfee7-4a3b-424f-9412-ff710b7218e3\") " pod="openshift-ingress/router-default-9984c7d94-5kjkb"
Jul 15 10:46:01.661895 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.661776    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/725cfee7-4a3b-424f-9412-ff710b7218e3-default-certificate\") pod \"router-default-9984c7d94-5kjkb\" (UID: \"725cfee7-4a3b-424f-9412-ff710b7218e3\") " pod="openshift-ingress/router-default-9984c7d94-5kjkb"
Jul 15 10:46:01.661895 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.661807    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/725cfee7-4a3b-424f-9412-ff710b7218e3-metrics-certs\") pod \"router-default-9984c7d94-5kjkb\" (UID: \"725cfee7-4a3b-424f-9412-ff710b7218e3\") " pod="openshift-ingress/router-default-9984c7d94-5kjkb"
Jul 15 10:46:01.661895 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:01.661841    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/725cfee7-4a3b-424f-9412-ff710b7218e3-service-ca-bundle podName:725cfee7-4a3b-424f-9412-ff710b7218e3 nodeName:}" failed. No retries permitted until 2026-07-15 10:46:02.161817829 +0000 UTC m=+59.770353830 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/725cfee7-4a3b-424f-9412-ff710b7218e3-service-ca-bundle") pod "router-default-9984c7d94-5kjkb" (UID: "725cfee7-4a3b-424f-9412-ff710b7218e3") : configmap references non-existent config key: service-ca.crt
Jul 15 10:46:01.662049 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:01.662014    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 10:46:01.662087 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:01.662069    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/725cfee7-4a3b-424f-9412-ff710b7218e3-metrics-certs podName:725cfee7-4a3b-424f-9412-ff710b7218e3 nodeName:}" failed. No retries permitted until 2026-07-15 10:46:02.162054134 +0000 UTC m=+59.770590134 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/725cfee7-4a3b-424f-9412-ff710b7218e3-metrics-certs") pod "router-default-9984c7d94-5kjkb" (UID: "725cfee7-4a3b-424f-9412-ff710b7218e3") : secret "router-metrics-certs-default" not found
Jul 15 10:46:01.664502 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.664478    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/725cfee7-4a3b-424f-9412-ff710b7218e3-default-certificate\") pod \"router-default-9984c7d94-5kjkb\" (UID: \"725cfee7-4a3b-424f-9412-ff710b7218e3\") " pod="openshift-ingress/router-default-9984c7d94-5kjkb"
Jul 15 10:46:01.664600 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.664484    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/725cfee7-4a3b-424f-9412-ff710b7218e3-stats-auth\") pod \"router-default-9984c7d94-5kjkb\" (UID: \"725cfee7-4a3b-424f-9412-ff710b7218e3\") " pod="openshift-ingress/router-default-9984c7d94-5kjkb"
Jul 15 10:46:01.681320 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.681291    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp8gx\" (UniqueName: \"kubernetes.io/projected/725cfee7-4a3b-424f-9412-ff710b7218e3-kube-api-access-gp8gx\") pod \"router-default-9984c7d94-5kjkb\" (UID: \"725cfee7-4a3b-424f-9412-ff710b7218e3\") " pod="openshift-ingress/router-default-9984c7d94-5kjkb"
Jul 15 10:46:01.767516 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.767433    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-g9swl"
Jul 15 10:46:01.781602 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.781570    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:01.887672 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.887640    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:01.904457 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:01.904424    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-g9swl"]
Jul 15 10:46:01.907018 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:46:01.906993    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63270ef2_9f47_4772_9807_6c7fb426005b.slice/crio-ca162c2b19b4469d092713d3f709f054b1e89f904d049aaa0e367531b7a5e87c WatchSource:0}: Error finding container ca162c2b19b4469d092713d3f709f054b1e89f904d049aaa0e367531b7a5e87c: Status 404 returned error can't find the container with id ca162c2b19b4469d092713d3f709f054b1e89f904d049aaa0e367531b7a5e87c
Jul 15 10:46:02.064493 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:02.064453    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-2x6fl\" (UID: \"5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2x6fl"
Jul 15 10:46:02.064668 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:02.064603    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 10:46:02.064717 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:02.064669    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e-cluster-monitoring-operator-tls podName:5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e nodeName:}" failed. No retries permitted until 2026-07-15 10:46:03.06465288 +0000 UTC m=+60.673188880 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-2x6fl" (UID: "5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e") : secret "cluster-monitoring-operator-tls" not found
Jul 15 10:46:02.164871 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:02.164833    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/725cfee7-4a3b-424f-9412-ff710b7218e3-service-ca-bundle\") pod \"router-default-9984c7d94-5kjkb\" (UID: \"725cfee7-4a3b-424f-9412-ff710b7218e3\") " pod="openshift-ingress/router-default-9984c7d94-5kjkb"
Jul 15 10:46:02.165035 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:02.164921    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/725cfee7-4a3b-424f-9412-ff710b7218e3-metrics-certs\") pod \"router-default-9984c7d94-5kjkb\" (UID: \"725cfee7-4a3b-424f-9412-ff710b7218e3\") " pod="openshift-ingress/router-default-9984c7d94-5kjkb"
Jul 15 10:46:02.165035 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:02.165009    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/725cfee7-4a3b-424f-9412-ff710b7218e3-service-ca-bundle podName:725cfee7-4a3b-424f-9412-ff710b7218e3 nodeName:}" failed. No retries permitted until 2026-07-15 10:46:03.164985896 +0000 UTC m=+60.773521904 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/725cfee7-4a3b-424f-9412-ff710b7218e3-service-ca-bundle") pod "router-default-9984c7d94-5kjkb" (UID: "725cfee7-4a3b-424f-9412-ff710b7218e3") : configmap references non-existent config key: service-ca.crt
Jul 15 10:46:02.165130 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:02.165065    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 10:46:02.165130 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:02.165115    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/725cfee7-4a3b-424f-9412-ff710b7218e3-metrics-certs podName:725cfee7-4a3b-424f-9412-ff710b7218e3 nodeName:}" failed. No retries permitted until 2026-07-15 10:46:03.165102291 +0000 UTC m=+60.773638291 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/725cfee7-4a3b-424f-9412-ff710b7218e3-metrics-certs") pod "router-default-9984c7d94-5kjkb" (UID: "725cfee7-4a3b-424f-9412-ff710b7218e3") : secret "router-metrics-certs-default" not found
Jul 15 10:46:02.197510 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:02.197474    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-g9swl" event={"ID":"63270ef2-9f47-4772-9807-6c7fb426005b","Type":"ContainerStarted","Data":"ca162c2b19b4469d092713d3f709f054b1e89f904d049aaa0e367531b7a5e87c"}
Jul 15 10:46:02.833234 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:02.833198    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:03.072214 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:03.072168    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-2x6fl\" (UID: \"5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2x6fl"
Jul 15 10:46:03.072400 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:03.072325    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 10:46:03.072447 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:03.072414    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e-cluster-monitoring-operator-tls podName:5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e nodeName:}" failed. No retries permitted until 2026-07-15 10:46:05.072397982 +0000 UTC m=+62.680933981 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-2x6fl" (UID: "5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e") : secret "cluster-monitoring-operator-tls" not found
Jul 15 10:46:03.122901 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:03.122810    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qsch8"
Jul 15 10:46:03.173122 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:03.172798    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/725cfee7-4a3b-424f-9412-ff710b7218e3-service-ca-bundle\") pod \"router-default-9984c7d94-5kjkb\" (UID: \"725cfee7-4a3b-424f-9412-ff710b7218e3\") " pod="openshift-ingress/router-default-9984c7d94-5kjkb"
Jul 15 10:46:03.173122 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:03.172912    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/725cfee7-4a3b-424f-9412-ff710b7218e3-metrics-certs\") pod \"router-default-9984c7d94-5kjkb\" (UID: \"725cfee7-4a3b-424f-9412-ff710b7218e3\") " pod="openshift-ingress/router-default-9984c7d94-5kjkb"
Jul 15 10:46:03.173122 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:03.173026    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 10:46:03.173122 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:03.173081    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/725cfee7-4a3b-424f-9412-ff710b7218e3-service-ca-bundle podName:725cfee7-4a3b-424f-9412-ff710b7218e3 nodeName:}" failed. No retries permitted until 2026-07-15 10:46:05.173061978 +0000 UTC m=+62.781597981 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/725cfee7-4a3b-424f-9412-ff710b7218e3-service-ca-bundle") pod "router-default-9984c7d94-5kjkb" (UID: "725cfee7-4a3b-424f-9412-ff710b7218e3") : configmap references non-existent config key: service-ca.crt
Jul 15 10:46:03.173122 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:03.173100    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/725cfee7-4a3b-424f-9412-ff710b7218e3-metrics-certs podName:725cfee7-4a3b-424f-9412-ff710b7218e3 nodeName:}" failed. No retries permitted until 2026-07-15 10:46:05.173094502 +0000 UTC m=+62.781630503 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/725cfee7-4a3b-424f-9412-ff710b7218e3-metrics-certs") pod "router-default-9984c7d94-5kjkb" (UID: "725cfee7-4a3b-424f-9412-ff710b7218e3") : secret "router-metrics-certs-default" not found
Jul 15 10:46:03.327810 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:03.327771    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:03.436187 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:03.436104    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:03.475964 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:03.475926    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-49ndh"]
Jul 15 10:46:03.478764 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:03.478741    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-49ndh"
Jul 15 10:46:03.489983 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:03.489955    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 15 10:46:03.490150 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:03.490131    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-lnbkr\""
Jul 15 10:46:03.490209 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:03.489952    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 15 10:46:03.494461 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:03.494435    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2bq2k"]
Jul 15 10:46:03.497380 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:03.497358    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2bq2k"
Jul 15 10:46:03.500625 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:03.500601    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-b62xg\""
Jul 15 10:46:03.500881 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:03.500863    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 15 10:46:03.501132 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:03.501110    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 15 10:46:03.501280 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:03.501263    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 15 10:46:03.523085 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:03.523054    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-49ndh"]
Jul 15 10:46:03.524026 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:03.524002    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2bq2k"]
Jul 15 10:46:03.560561 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:03.560525    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:03.575649 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:03.575599    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cslsn\" (UniqueName: \"kubernetes.io/projected/6c3cafa2-db95-44f4-b921-0245d9607e59-kube-api-access-cslsn\") pod \"cluster-samples-operator-65db858894-2bq2k\" (UID: \"6c3cafa2-db95-44f4-b921-0245d9607e59\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2bq2k"
Jul 15 10:46:03.575833 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:03.575701    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf47s\" (UniqueName: \"kubernetes.io/projected/987f29db-b67d-4cbc-84c6-9e407aa031bc-kube-api-access-nf47s\") pod \"volume-data-source-validator-78495597f6-49ndh\" (UID: \"987f29db-b67d-4cbc-84c6-9e407aa031bc\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-49ndh"
Jul 15 10:46:03.575915 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:03.575851    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c3cafa2-db95-44f4-b921-0245d9607e59-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-2bq2k\" (UID: \"6c3cafa2-db95-44f4-b921-0245d9607e59\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2bq2k"
Jul 15 10:46:03.677062 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:03.677026    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf47s\" (UniqueName: \"kubernetes.io/projected/987f29db-b67d-4cbc-84c6-9e407aa031bc-kube-api-access-nf47s\") pod \"volume-data-source-validator-78495597f6-49ndh\" (UID: \"987f29db-b67d-4cbc-84c6-9e407aa031bc\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-49ndh"
Jul 15 10:46:03.677219 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:03.677101    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c3cafa2-db95-44f4-b921-0245d9607e59-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-2bq2k\" (UID: \"6c3cafa2-db95-44f4-b921-0245d9607e59\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2bq2k"
Jul 15 10:46:03.677219 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:03.677189    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cslsn\" (UniqueName: \"kubernetes.io/projected/6c3cafa2-db95-44f4-b921-0245d9607e59-kube-api-access-cslsn\") pod \"cluster-samples-operator-65db858894-2bq2k\" (UID: \"6c3cafa2-db95-44f4-b921-0245d9607e59\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2bq2k"
Jul 15 10:46:03.677325 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:03.677251    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 10:46:03.677325 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:03.677315    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c3cafa2-db95-44f4-b921-0245d9607e59-samples-operator-tls podName:6c3cafa2-db95-44f4-b921-0245d9607e59 nodeName:}" failed. No retries permitted until 2026-07-15 10:46:04.177299637 +0000 UTC m=+61.785835640 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6c3cafa2-db95-44f4-b921-0245d9607e59-samples-operator-tls") pod "cluster-samples-operator-65db858894-2bq2k" (UID: "6c3cafa2-db95-44f4-b921-0245d9607e59") : secret "samples-operator-tls" not found
Jul 15 10:46:03.693175 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:03.693114    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf47s\" (UniqueName: \"kubernetes.io/projected/987f29db-b67d-4cbc-84c6-9e407aa031bc-kube-api-access-nf47s\") pod \"volume-data-source-validator-78495597f6-49ndh\" (UID: \"987f29db-b67d-4cbc-84c6-9e407aa031bc\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-49ndh"
Jul 15 10:46:03.711778 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:03.711746    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cslsn\" (UniqueName: \"kubernetes.io/projected/6c3cafa2-db95-44f4-b921-0245d9607e59-kube-api-access-cslsn\") pod \"cluster-samples-operator-65db858894-2bq2k\" (UID: \"6c3cafa2-db95-44f4-b921-0245d9607e59\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2bq2k"
Jul 15 10:46:03.788555 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:03.788513    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-49ndh"
Jul 15 10:46:03.935136 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:03.935102    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-49ndh"]
Jul 15 10:46:04.182499 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:04.182457    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c3cafa2-db95-44f4-b921-0245d9607e59-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-2bq2k\" (UID: \"6c3cafa2-db95-44f4-b921-0245d9607e59\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2bq2k"
Jul 15 10:46:04.182700 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:04.182683    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 10:46:04.182782 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:04.182768    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c3cafa2-db95-44f4-b921-0245d9607e59-samples-operator-tls podName:6c3cafa2-db95-44f4-b921-0245d9607e59 nodeName:}" failed. No retries permitted until 2026-07-15 10:46:05.18274639 +0000 UTC m=+62.791282391 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6c3cafa2-db95-44f4-b921-0245d9607e59-samples-operator-tls") pod "cluster-samples-operator-65db858894-2bq2k" (UID: "6c3cafa2-db95-44f4-b921-0245d9607e59") : secret "samples-operator-tls" not found
Jul 15 10:46:04.312129 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:46:04.312080    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod987f29db_b67d_4cbc_84c6_9e407aa031bc.slice/crio-6d4564abc22e3e18103bd980412320dba659fb2772e790f0d1bf93e548143d82 WatchSource:0}: Error finding container 6d4564abc22e3e18103bd980412320dba659fb2772e790f0d1bf93e548143d82: Status 404 returned error can't find the container with id 6d4564abc22e3e18103bd980412320dba659fb2772e790f0d1bf93e548143d82
Jul 15 10:46:04.460534 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:04.460509    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-8dcjj"]
Jul 15 10:46:04.500575 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:04.500548    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-8dcjj"]
Jul 15 10:46:04.500705 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:04.500647    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-8dcjj"
Jul 15 10:46:04.503372 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:04.503325    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 15 10:46:04.503487 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:04.503382    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 15 10:46:04.503487 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:04.503421    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 15 10:46:04.503487 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:04.503468    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-n4wpc\""
Jul 15 10:46:04.503626 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:04.503515    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 15 10:46:04.509624 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:04.509605    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 15 10:46:04.586311 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:04.586270    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff4ht\" (UniqueName: \"kubernetes.io/projected/8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9-kube-api-access-ff4ht\") pod \"console-operator-7866497494-8dcjj\" (UID: \"8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9\") " pod="openshift-console-operator/console-operator-7866497494-8dcjj"
Jul 15 10:46:04.586495 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:04.586377    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9-serving-cert\") pod \"console-operator-7866497494-8dcjj\" (UID: \"8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9\") " pod="openshift-console-operator/console-operator-7866497494-8dcjj"
Jul 15 10:46:04.586495 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:04.586414    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9-trusted-ca\") pod \"console-operator-7866497494-8dcjj\" (UID: \"8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9\") " pod="openshift-console-operator/console-operator-7866497494-8dcjj"
Jul 15 10:46:04.586495 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:04.586482    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9-config\") pod \"console-operator-7866497494-8dcjj\" (UID: \"8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9\") " pod="openshift-console-operator/console-operator-7866497494-8dcjj"
Jul 15 10:46:04.687510 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:04.687423    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff4ht\" (UniqueName: \"kubernetes.io/projected/8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9-kube-api-access-ff4ht\") pod \"console-operator-7866497494-8dcjj\" (UID: \"8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9\") " pod="openshift-console-operator/console-operator-7866497494-8dcjj"
Jul 15 10:46:04.687510 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:04.687493    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9-serving-cert\") pod \"console-operator-7866497494-8dcjj\" (UID: \"8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9\") " pod="openshift-console-operator/console-operator-7866497494-8dcjj"
Jul 15 10:46:04.687699 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:04.687552    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9-trusted-ca\") pod \"console-operator-7866497494-8dcjj\" (UID: \"8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9\") " pod="openshift-console-operator/console-operator-7866497494-8dcjj"
Jul 15 10:46:04.687799 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:04.687767    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9-config\") pod \"console-operator-7866497494-8dcjj\" (UID: \"8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9\") " pod="openshift-console-operator/console-operator-7866497494-8dcjj"
Jul 15 10:46:04.688373 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:04.688324    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9-trusted-ca\") pod \"console-operator-7866497494-8dcjj\" (UID: \"8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9\") " pod="openshift-console-operator/console-operator-7866497494-8dcjj"
Jul 15 10:46:04.688478 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:04.688378    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9-config\") pod \"console-operator-7866497494-8dcjj\" (UID: \"8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9\") " pod="openshift-console-operator/console-operator-7866497494-8dcjj"
Jul 15 10:46:04.690041 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:04.690015    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9-serving-cert\") pod \"console-operator-7866497494-8dcjj\" (UID: \"8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9\") " pod="openshift-console-operator/console-operator-7866497494-8dcjj"
Jul 15 10:46:04.701593 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:04.696929    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff4ht\" (UniqueName: \"kubernetes.io/projected/8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9-kube-api-access-ff4ht\") pod \"console-operator-7866497494-8dcjj\" (UID: \"8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9\") " pod="openshift-console-operator/console-operator-7866497494-8dcjj"
Jul 15 10:46:04.810703 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:04.810665    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-8dcjj"
Jul 15 10:46:04.978314 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:04.976485    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-8dcjj"]
Jul 15 10:46:04.980129 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:46:04.980098    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e2cd50c_0fd4_4fbf_a0cf_38616f8207c9.slice/crio-4e3b79371658aa0e4e6a5c0b34536d60fe223fee3da504d8c46d0d23376744a8 WatchSource:0}: Error finding container 4e3b79371658aa0e4e6a5c0b34536d60fe223fee3da504d8c46d0d23376744a8: Status 404 returned error can't find the container with id 4e3b79371658aa0e4e6a5c0b34536d60fe223fee3da504d8c46d0d23376744a8
Jul 15 10:46:05.091903 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:05.091864    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-2x6fl\" (UID: \"5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2x6fl"
Jul 15 10:46:05.092146 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:05.092006    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 10:46:05.092146 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:05.092073    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e-cluster-monitoring-operator-tls podName:5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e nodeName:}" failed. No retries permitted until 2026-07-15 10:46:09.092055146 +0000 UTC m=+66.700591166 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-2x6fl" (UID: "5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e") : secret "cluster-monitoring-operator-tls" not found
Jul 15 10:46:05.193047 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:05.192740    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/725cfee7-4a3b-424f-9412-ff710b7218e3-service-ca-bundle\") pod \"router-default-9984c7d94-5kjkb\" (UID: \"725cfee7-4a3b-424f-9412-ff710b7218e3\") " pod="openshift-ingress/router-default-9984c7d94-5kjkb"
Jul 15 10:46:05.193047 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:05.192865    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/725cfee7-4a3b-424f-9412-ff710b7218e3-metrics-certs\") pod \"router-default-9984c7d94-5kjkb\" (UID: \"725cfee7-4a3b-424f-9412-ff710b7218e3\") " pod="openshift-ingress/router-default-9984c7d94-5kjkb"
Jul 15 10:46:05.193896 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:05.193792    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c3cafa2-db95-44f4-b921-0245d9607e59-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-2bq2k\" (UID: \"6c3cafa2-db95-44f4-b921-0245d9607e59\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2bq2k"
Jul 15 10:46:05.194205 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:05.194127    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 10:46:05.194705 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:05.194353    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c3cafa2-db95-44f4-b921-0245d9607e59-samples-operator-tls podName:6c3cafa2-db95-44f4-b921-0245d9607e59 nodeName:}" failed. No retries permitted until 2026-07-15 10:46:07.194310218 +0000 UTC m=+64.802846222 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6c3cafa2-db95-44f4-b921-0245d9607e59-samples-operator-tls") pod "cluster-samples-operator-65db858894-2bq2k" (UID: "6c3cafa2-db95-44f4-b921-0245d9607e59") : secret "samples-operator-tls" not found
Jul 15 10:46:05.194705 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:05.194381    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/725cfee7-4a3b-424f-9412-ff710b7218e3-service-ca-bundle podName:725cfee7-4a3b-424f-9412-ff710b7218e3 nodeName:}" failed. No retries permitted until 2026-07-15 10:46:09.194370141 +0000 UTC m=+66.802906148 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/725cfee7-4a3b-424f-9412-ff710b7218e3-service-ca-bundle") pod "router-default-9984c7d94-5kjkb" (UID: "725cfee7-4a3b-424f-9412-ff710b7218e3") : configmap references non-existent config key: service-ca.crt
Jul 15 10:46:05.194705 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:05.194414    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 10:46:05.194705 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:05.194467    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/725cfee7-4a3b-424f-9412-ff710b7218e3-metrics-certs podName:725cfee7-4a3b-424f-9412-ff710b7218e3 nodeName:}" failed. No retries permitted until 2026-07-15 10:46:09.19444967 +0000 UTC m=+66.802985672 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/725cfee7-4a3b-424f-9412-ff710b7218e3-metrics-certs") pod "router-default-9984c7d94-5kjkb" (UID: "725cfee7-4a3b-424f-9412-ff710b7218e3") : secret "router-metrics-certs-default" not found
Jul 15 10:46:05.207668 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:05.207626    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-8dcjj" event={"ID":"8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9","Type":"ContainerStarted","Data":"4e3b79371658aa0e4e6a5c0b34536d60fe223fee3da504d8c46d0d23376744a8"}
Jul 15 10:46:05.211093 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:05.211054    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-49ndh" event={"ID":"987f29db-b67d-4cbc-84c6-9e407aa031bc","Type":"ContainerStarted","Data":"6d4564abc22e3e18103bd980412320dba659fb2772e790f0d1bf93e548143d82"}
Jul 15 10:46:05.214380 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:05.214328    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-g9swl" event={"ID":"63270ef2-9f47-4772-9807-6c7fb426005b","Type":"ContainerStarted","Data":"cbe1c3d32963bc533ae9ad4b7bce7f714ae050b0fbde1e9c3e9b9f9487fe9766"}
Jul 15 10:46:05.242729 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:05.242635    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-g9swl" podStartSLOduration=1.7425210180000001 podStartE2EDuration="4.242616071s" totalImagesPullingTime="2.500095053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:46:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:46:05.24073283 +0000 UTC m=+62.849268852" watchObservedRunningTime="2026-07-15 10:46:05.242616071 +0000 UTC m=+62.851152104"
Jul 15 10:46:05.264894 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:05.264858    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bqw5l"]
Jul 15 10:46:05.277759 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:05.277730    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bqw5l"
Jul 15 10:46:05.280221 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:05.280186    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 15 10:46:05.280388 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:05.280191    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 15 10:46:05.280388 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:05.280273    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-d5wdr\""
Jul 15 10:46:05.284042 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:05.284007    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bqw5l"]
Jul 15 10:46:05.294858 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:05.294835    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/da96848b-337e-4448-9275-3ea664ebdec8-data-volume\") pod \"insights-runtime-extractor-bqw5l\" (UID: \"da96848b-337e-4448-9275-3ea664ebdec8\") " pod="openshift-insights/insights-runtime-extractor-bqw5l"
Jul 15 10:46:05.294974 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:05.294885    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sw9z\" (UniqueName: \"kubernetes.io/projected/da96848b-337e-4448-9275-3ea664ebdec8-kube-api-access-2sw9z\") pod \"insights-runtime-extractor-bqw5l\" (UID: \"da96848b-337e-4448-9275-3ea664ebdec8\") " pod="openshift-insights/insights-runtime-extractor-bqw5l"
Jul 15 10:46:05.295057 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:05.295033    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da96848b-337e-4448-9275-3ea664ebdec8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bqw5l\" (UID: \"da96848b-337e-4448-9275-3ea664ebdec8\") " pod="openshift-insights/insights-runtime-extractor-bqw5l"
Jul 15 10:46:05.295113 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:05.295099    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/da96848b-337e-4448-9275-3ea664ebdec8-crio-socket\") pod \"insights-runtime-extractor-bqw5l\" (UID: \"da96848b-337e-4448-9275-3ea664ebdec8\") " pod="openshift-insights/insights-runtime-extractor-bqw5l"
Jul 15 10:46:05.295192 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:05.295176    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/da96848b-337e-4448-9275-3ea664ebdec8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bqw5l\" (UID: \"da96848b-337e-4448-9275-3ea664ebdec8\") " pod="openshift-insights/insights-runtime-extractor-bqw5l"
Jul 15 10:46:05.395674 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:05.395639    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da96848b-337e-4448-9275-3ea664ebdec8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bqw5l\" (UID: \"da96848b-337e-4448-9275-3ea664ebdec8\") " pod="openshift-insights/insights-runtime-extractor-bqw5l"
Jul 15 10:46:05.395845 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:05.395692    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/da96848b-337e-4448-9275-3ea664ebdec8-crio-socket\") pod \"insights-runtime-extractor-bqw5l\" (UID: \"da96848b-337e-4448-9275-3ea664ebdec8\") " pod="openshift-insights/insights-runtime-extractor-bqw5l"
Jul 15 10:46:05.395845 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:05.395729    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/da96848b-337e-4448-9275-3ea664ebdec8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bqw5l\" (UID: \"da96848b-337e-4448-9275-3ea664ebdec8\") " pod="openshift-insights/insights-runtime-extractor-bqw5l"
Jul 15 10:46:05.395845 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:05.395808    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/da96848b-337e-4448-9275-3ea664ebdec8-data-volume\") pod \"insights-runtime-extractor-bqw5l\" (UID: \"da96848b-337e-4448-9275-3ea664ebdec8\") " pod="openshift-insights/insights-runtime-extractor-bqw5l"
Jul 15 10:46:05.395845 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:05.395833    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sw9z\" (UniqueName: \"kubernetes.io/projected/da96848b-337e-4448-9275-3ea664ebdec8-kube-api-access-2sw9z\") pod \"insights-runtime-extractor-bqw5l\" (UID: \"da96848b-337e-4448-9275-3ea664ebdec8\") " pod="openshift-insights/insights-runtime-extractor-bqw5l"
Jul 15 10:46:05.395845 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:05.395837    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 10:46:05.396166 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:05.395865    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/da96848b-337e-4448-9275-3ea664ebdec8-crio-socket\") pod \"insights-runtime-extractor-bqw5l\" (UID: \"da96848b-337e-4448-9275-3ea664ebdec8\") " pod="openshift-insights/insights-runtime-extractor-bqw5l"
Jul 15 10:46:05.396166 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:05.395899    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da96848b-337e-4448-9275-3ea664ebdec8-insights-runtime-extractor-tls podName:da96848b-337e-4448-9275-3ea664ebdec8 nodeName:}" failed. No retries permitted until 2026-07-15 10:46:05.895884735 +0000 UTC m=+63.504420735 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/da96848b-337e-4448-9275-3ea664ebdec8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bqw5l" (UID: "da96848b-337e-4448-9275-3ea664ebdec8") : secret "insights-runtime-extractor-tls" not found
Jul 15 10:46:05.396166 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:05.395961    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 10:46:05.396166 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:05.396012    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/da96848b-337e-4448-9275-3ea664ebdec8-kube-rbac-proxy-cm podName:da96848b-337e-4448-9275-3ea664ebdec8 nodeName:}" failed. No retries permitted until 2026-07-15 10:46:05.895994695 +0000 UTC m=+63.504530701 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/da96848b-337e-4448-9275-3ea664ebdec8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bqw5l" (UID: "da96848b-337e-4448-9275-3ea664ebdec8") : configmap "kube-rbac-proxy" not found
Jul 15 10:46:05.396364 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:05.396328    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/da96848b-337e-4448-9275-3ea664ebdec8-data-volume\") pod \"insights-runtime-extractor-bqw5l\" (UID: \"da96848b-337e-4448-9275-3ea664ebdec8\") " pod="openshift-insights/insights-runtime-extractor-bqw5l"
Jul 15 10:46:05.406023 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:05.405993    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sw9z\" (UniqueName: \"kubernetes.io/projected/da96848b-337e-4448-9275-3ea664ebdec8-kube-api-access-2sw9z\") pod \"insights-runtime-extractor-bqw5l\" (UID: \"da96848b-337e-4448-9275-3ea664ebdec8\") " pod="openshift-insights/insights-runtime-extractor-bqw5l"
Jul 15 10:46:05.520314 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:05.520236    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:05.901308 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:05.901268    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da96848b-337e-4448-9275-3ea664ebdec8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bqw5l\" (UID: \"da96848b-337e-4448-9275-3ea664ebdec8\") " pod="openshift-insights/insights-runtime-extractor-bqw5l"
Jul 15 10:46:05.901483 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:05.901363    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/da96848b-337e-4448-9275-3ea664ebdec8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bqw5l\" (UID: \"da96848b-337e-4448-9275-3ea664ebdec8\") " pod="openshift-insights/insights-runtime-extractor-bqw5l"
Jul 15 10:46:05.901483 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:05.901444    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 10:46:05.901571 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:05.901483    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 10:46:05.901571 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:05.901523    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da96848b-337e-4448-9275-3ea664ebdec8-insights-runtime-extractor-tls podName:da96848b-337e-4448-9275-3ea664ebdec8 nodeName:}" failed. No retries permitted until 2026-07-15 10:46:06.901507803 +0000 UTC m=+64.510043823 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/da96848b-337e-4448-9275-3ea664ebdec8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bqw5l" (UID: "da96848b-337e-4448-9275-3ea664ebdec8") : secret "insights-runtime-extractor-tls" not found
Jul 15 10:46:05.901571 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:05.901557    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/da96848b-337e-4448-9275-3ea664ebdec8-kube-rbac-proxy-cm podName:da96848b-337e-4448-9275-3ea664ebdec8 nodeName:}" failed. No retries permitted until 2026-07-15 10:46:06.901530124 +0000 UTC m=+64.510066125 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/da96848b-337e-4448-9275-3ea664ebdec8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bqw5l" (UID: "da96848b-337e-4448-9275-3ea664ebdec8") : configmap "kube-rbac-proxy" not found
Jul 15 10:46:06.218235 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:06.218197    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-49ndh" event={"ID":"987f29db-b67d-4cbc-84c6-9e407aa031bc","Type":"ContainerStarted","Data":"c253ba1db60555bb110b5778ba49cdfcf03f61f11674a164392f8f48b465713b"}
Jul 15 10:46:06.235882 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:06.235821    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-49ndh" podStartSLOduration=1.7708847680000002 podStartE2EDuration="3.235802629s" totalImagesPullingTime="1.464917861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:46:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:46:06.235093304 +0000 UTC m=+63.843629319" watchObservedRunningTime="2026-07-15 10:46:06.235802629 +0000 UTC m=+63.844338652"
Jul 15 10:46:06.328548 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:06.328518    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:06.634387 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:06.634358    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ww2zd_94259076-1de7-4312-a19a-5760311ec791/dns-node-resolver/0.log"
Jul 15 10:46:06.759203 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:06.759164    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:06.910523 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:06.910434    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da96848b-337e-4448-9275-3ea664ebdec8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bqw5l\" (UID: \"da96848b-337e-4448-9275-3ea664ebdec8\") " pod="openshift-insights/insights-runtime-extractor-bqw5l"
Jul 15 10:46:06.910523 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:06.910505    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/da96848b-337e-4448-9275-3ea664ebdec8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bqw5l\" (UID: \"da96848b-337e-4448-9275-3ea664ebdec8\") " pod="openshift-insights/insights-runtime-extractor-bqw5l"
Jul 15 10:46:06.910751 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:06.910589    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 10:46:06.910751 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:06.910615    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 10:46:06.910751 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:06.910664    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/da96848b-337e-4448-9275-3ea664ebdec8-kube-rbac-proxy-cm podName:da96848b-337e-4448-9275-3ea664ebdec8 nodeName:}" failed. No retries permitted until 2026-07-15 10:46:08.910641925 +0000 UTC m=+66.519177942 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/da96848b-337e-4448-9275-3ea664ebdec8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bqw5l" (UID: "da96848b-337e-4448-9275-3ea664ebdec8") : configmap "kube-rbac-proxy" not found
Jul 15 10:46:06.910751 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:06.910683    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da96848b-337e-4448-9275-3ea664ebdec8-insights-runtime-extractor-tls podName:da96848b-337e-4448-9275-3ea664ebdec8 nodeName:}" failed. No retries permitted until 2026-07-15 10:46:08.910673283 +0000 UTC m=+66.519209287 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/da96848b-337e-4448-9275-3ea664ebdec8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bqw5l" (UID: "da96848b-337e-4448-9275-3ea664ebdec8") : secret "insights-runtime-extractor-tls" not found
Jul 15 10:46:07.036971 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:07.036939    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fqz5r_e512c0b0-fbba-491f-8024-0243b8f12f54/node-ca/0.log"
Jul 15 10:46:07.214253 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:07.214173    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c3cafa2-db95-44f4-b921-0245d9607e59-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-2bq2k\" (UID: \"6c3cafa2-db95-44f4-b921-0245d9607e59\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2bq2k"
Jul 15 10:46:07.214410 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:07.214352    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 10:46:07.214455 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:07.214414    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c3cafa2-db95-44f4-b921-0245d9607e59-samples-operator-tls podName:6c3cafa2-db95-44f4-b921-0245d9607e59 nodeName:}" failed. No retries permitted until 2026-07-15 10:46:11.21439932 +0000 UTC m=+68.822935322 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6c3cafa2-db95-44f4-b921-0245d9607e59-samples-operator-tls") pod "cluster-samples-operator-65db858894-2bq2k" (UID: "6c3cafa2-db95-44f4-b921-0245d9607e59") : secret "samples-operator-tls" not found
Jul 15 10:46:07.619314 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:07.619265    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f16a7597-8022-437b-a82b-ab187296ecdf-metrics-certs\") pod \"network-metrics-daemon-c4bht\" (UID: \"f16a7597-8022-437b-a82b-ab187296ecdf\") " pod="openshift-multus/network-metrics-daemon-c4bht"
Jul 15 10:46:07.624537 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:07.624511    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 10:46:07.630001 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:07.629977    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 15 10:46:07.630129 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:07.630054    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f16a7597-8022-437b-a82b-ab187296ecdf-metrics-certs podName:f16a7597-8022-437b-a82b-ab187296ecdf nodeName:}" failed. No retries permitted until 2026-07-15 10:47:11.630034333 +0000 UTC m=+129.238570334 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f16a7597-8022-437b-a82b-ab187296ecdf-metrics-certs") pod "network-metrics-daemon-c4bht" (UID: "f16a7597-8022-437b-a82b-ab187296ecdf") : secret "metrics-daemon-secret" not found
Jul 15 10:46:07.720405 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:07.720368    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxrvg\" (UniqueName: \"kubernetes.io/projected/e2a51efd-e7a8-4db0-8ded-c90e680619c8-kube-api-access-xxrvg\") pod \"network-check-target-5zwx4\" (UID: \"e2a51efd-e7a8-4db0-8ded-c90e680619c8\") " pod="openshift-network-diagnostics/network-check-target-5zwx4"
Jul 15 10:46:07.720563 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:07.720506    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/82f6960e-f41d-4ad3-83c4-c515ff206787-original-pull-secret\") pod \"global-pull-secret-syncer-zrr95\" (UID: \"82f6960e-f41d-4ad3-83c4-c515ff206787\") " pod="kube-system/global-pull-secret-syncer-zrr95"
Jul 15 10:46:07.723312 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:07.723289    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 10:46:07.723412 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:07.723350    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 10:46:07.733466 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:07.733447    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 10:46:07.733616 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:07.733595    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/82f6960e-f41d-4ad3-83c4-c515ff206787-original-pull-secret\") pod \"global-pull-secret-syncer-zrr95\" (UID: \"82f6960e-f41d-4ad3-83c4-c515ff206787\") " pod="kube-system/global-pull-secret-syncer-zrr95"
Jul 15 10:46:07.743978 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:07.743956    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxrvg\" (UniqueName: \"kubernetes.io/projected/e2a51efd-e7a8-4db0-8ded-c90e680619c8-kube-api-access-xxrvg\") pod \"network-check-target-5zwx4\" (UID: \"e2a51efd-e7a8-4db0-8ded-c90e680619c8\") " pod="openshift-network-diagnostics/network-check-target-5zwx4"
Jul 15 10:46:07.746613 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:07.746594    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrr95"
Jul 15 10:46:07.832093 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:07.832070    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-htj8h_55c9eec3-1148-4ea6-8e77-1e1dcb085d3f/serve-healthcheck-canary/0.log"
Jul 15 10:46:07.895588 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:07.895445    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zrr95"]
Jul 15 10:46:07.897986 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:46:07.897955    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82f6960e_f41d_4ad3_83c4_c515ff206787.slice/crio-1abe26fd10e65f3dc299a57ad0e355ac4091ec848d49569af16646f1747129de WatchSource:0}: Error finding container 1abe26fd10e65f3dc299a57ad0e355ac4091ec848d49569af16646f1747129de: Status 404 returned error can't find the container with id 1abe26fd10e65f3dc299a57ad0e355ac4091ec848d49569af16646f1747129de
Jul 15 10:46:08.044317 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:08.044283    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-n9w8s\""
Jul 15 10:46:08.051934 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:08.051911    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5zwx4"
Jul 15 10:46:08.176573 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:08.176496    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5zwx4"]
Jul 15 10:46:08.179265 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:46:08.179237    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2a51efd_e7a8_4db0_8ded_c90e680619c8.slice/crio-c4f628e2f2799249b8d82f2fc3fe47ee84140b8bf4ef70e043fc454dc68c9064 WatchSource:0}: Error finding container c4f628e2f2799249b8d82f2fc3fe47ee84140b8bf4ef70e043fc454dc68c9064: Status 404 returned error can't find the container with id c4f628e2f2799249b8d82f2fc3fe47ee84140b8bf4ef70e043fc454dc68c9064
Jul 15 10:46:08.225435 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:08.225410    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8dcjj_8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9/console-operator/0.log"
Jul 15 10:46:08.225613 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:08.225449    2565 generic.go:356] "Generic (PLEG): container finished" podID="8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9" containerID="2b4b41581a45d05fbb7f4adbd923b6def55b390e8fde4ddb5b8b3a2c997305fa" exitCode=255
Jul 15 10:46:08.225613 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:08.225548    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-8dcjj" event={"ID":"8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9","Type":"ContainerDied","Data":"2b4b41581a45d05fbb7f4adbd923b6def55b390e8fde4ddb5b8b3a2c997305fa"}
Jul 15 10:46:08.225897 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:08.225871    2565 scope.go:117] "RemoveContainer" containerID="2b4b41581a45d05fbb7f4adbd923b6def55b390e8fde4ddb5b8b3a2c997305fa"
Jul 15 10:46:08.226894 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:08.226842    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5zwx4" event={"ID":"e2a51efd-e7a8-4db0-8ded-c90e680619c8","Type":"ContainerStarted","Data":"c4f628e2f2799249b8d82f2fc3fe47ee84140b8bf4ef70e043fc454dc68c9064"}
Jul 15 10:46:08.227911 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:08.227886    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zrr95" event={"ID":"82f6960e-f41d-4ad3-83c4-c515ff206787","Type":"ContainerStarted","Data":"1abe26fd10e65f3dc299a57ad0e355ac4091ec848d49569af16646f1747129de"}
Jul 15 10:46:08.466430 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:08.466354    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-n7jtx"]
Jul 15 10:46:08.469527 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:08.469502    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-n7jtx"
Jul 15 10:46:08.478836 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:08.478815    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 15 10:46:08.478836 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:08.478826    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 15 10:46:08.479143 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:08.479125    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 15 10:46:08.479245 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:08.479203    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 15 10:46:08.485298 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:08.485270    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-bjzsb\""
Jul 15 10:46:08.486182 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:08.486161    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-n7jtx"]
Jul 15 10:46:08.528625 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:08.528587    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7dcd6c11-9e60-45e9-9d89-dae4e2594c7f-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-n7jtx\" (UID: \"7dcd6c11-9e60-45e9-9d89-dae4e2594c7f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-n7jtx"
Jul 15 10:46:08.528815 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:08.528642    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqwcs\" (UniqueName: \"kubernetes.io/projected/7dcd6c11-9e60-45e9-9d89-dae4e2594c7f-kube-api-access-mqwcs\") pod \"kube-storage-version-migrator-operator-799cb7f958-n7jtx\" (UID: \"7dcd6c11-9e60-45e9-9d89-dae4e2594c7f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-n7jtx"
Jul 15 10:46:08.528815 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:08.528786    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7dcd6c11-9e60-45e9-9d89-dae4e2594c7f-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-n7jtx\" (UID: \"7dcd6c11-9e60-45e9-9d89-dae4e2594c7f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-n7jtx"
Jul 15 10:46:08.629681 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:08.629645    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7dcd6c11-9e60-45e9-9d89-dae4e2594c7f-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-n7jtx\" (UID: \"7dcd6c11-9e60-45e9-9d89-dae4e2594c7f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-n7jtx"
Jul 15 10:46:08.630115 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:08.629787    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7dcd6c11-9e60-45e9-9d89-dae4e2594c7f-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-n7jtx\" (UID: \"7dcd6c11-9e60-45e9-9d89-dae4e2594c7f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-n7jtx"
Jul 15 10:46:08.630115 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:08.629838    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqwcs\" (UniqueName: \"kubernetes.io/projected/7dcd6c11-9e60-45e9-9d89-dae4e2594c7f-kube-api-access-mqwcs\") pod \"kube-storage-version-migrator-operator-799cb7f958-n7jtx\" (UID: \"7dcd6c11-9e60-45e9-9d89-dae4e2594c7f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-n7jtx"
Jul 15 10:46:08.630314 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:08.630287    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7dcd6c11-9e60-45e9-9d89-dae4e2594c7f-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-n7jtx\" (UID: \"7dcd6c11-9e60-45e9-9d89-dae4e2594c7f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-n7jtx"
Jul 15 10:46:08.632745 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:08.632713    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7dcd6c11-9e60-45e9-9d89-dae4e2594c7f-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-n7jtx\" (UID: \"7dcd6c11-9e60-45e9-9d89-dae4e2594c7f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-n7jtx"
Jul 15 10:46:08.640013 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:08.639992    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqwcs\" (UniqueName: \"kubernetes.io/projected/7dcd6c11-9e60-45e9-9d89-dae4e2594c7f-kube-api-access-mqwcs\") pod \"kube-storage-version-migrator-operator-799cb7f958-n7jtx\" (UID: \"7dcd6c11-9e60-45e9-9d89-dae4e2594c7f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-n7jtx"
Jul 15 10:46:08.665625 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:08.665583    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:08.781091 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:08.781059    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-n7jtx"
Jul 15 10:46:08.886408 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:08.886372    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:08.925963 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:08.925939    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-n7jtx"]
Jul 15 10:46:08.927786 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:46:08.927757    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dcd6c11_9e60_45e9_9d89_dae4e2594c7f.slice/crio-3a082d5514f564c6dd0d43449d49728337a0148ebd670a8bcd031c5fd24d7585 WatchSource:0}: Error finding container 3a082d5514f564c6dd0d43449d49728337a0148ebd670a8bcd031c5fd24d7585: Status 404 returned error can't find the container with id 3a082d5514f564c6dd0d43449d49728337a0148ebd670a8bcd031c5fd24d7585
Jul 15 10:46:08.933316 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:08.933294    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da96848b-337e-4448-9275-3ea664ebdec8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bqw5l\" (UID: \"da96848b-337e-4448-9275-3ea664ebdec8\") " pod="openshift-insights/insights-runtime-extractor-bqw5l"
Jul 15 10:46:08.933452 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:08.933387    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/da96848b-337e-4448-9275-3ea664ebdec8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bqw5l\" (UID: \"da96848b-337e-4448-9275-3ea664ebdec8\") " pod="openshift-insights/insights-runtime-extractor-bqw5l"
Jul 15 10:46:08.933515 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:08.933451    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 10:46:08.933515 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:08.933501    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da96848b-337e-4448-9275-3ea664ebdec8-insights-runtime-extractor-tls podName:da96848b-337e-4448-9275-3ea664ebdec8 nodeName:}" failed. No retries permitted until 2026-07-15 10:46:12.933488506 +0000 UTC m=+70.542024505 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/da96848b-337e-4448-9275-3ea664ebdec8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bqw5l" (UID: "da96848b-337e-4448-9275-3ea664ebdec8") : secret "insights-runtime-extractor-tls" not found
Jul 15 10:46:08.933611 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:08.933509    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 10:46:08.933611 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:08.933575    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/da96848b-337e-4448-9275-3ea664ebdec8-kube-rbac-proxy-cm podName:da96848b-337e-4448-9275-3ea664ebdec8 nodeName:}" failed. No retries permitted until 2026-07-15 10:46:12.933556575 +0000 UTC m=+70.542092580 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/da96848b-337e-4448-9275-3ea664ebdec8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bqw5l" (UID: "da96848b-337e-4448-9275-3ea664ebdec8") : configmap "kube-rbac-proxy" not found
Jul 15 10:46:08.986572 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:08.986517    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:09.135873 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:09.135837    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-2x6fl\" (UID: \"5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2x6fl"
Jul 15 10:46:09.136036 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:09.135976    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 10:46:09.136087 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:09.136052    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e-cluster-monitoring-operator-tls podName:5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e nodeName:}" failed. No retries permitted until 2026-07-15 10:46:17.136030478 +0000 UTC m=+74.744566490 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-2x6fl" (UID: "5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e") : secret "cluster-monitoring-operator-tls" not found
Jul 15 10:46:09.233566 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:09.233496    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-n7jtx" event={"ID":"7dcd6c11-9e60-45e9-9d89-dae4e2594c7f","Type":"ContainerStarted","Data":"3a082d5514f564c6dd0d43449d49728337a0148ebd670a8bcd031c5fd24d7585"}
Jul 15 10:46:09.235320 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:09.235232    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8dcjj_8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9/console-operator/1.log"
Jul 15 10:46:09.235684 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:09.235659    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8dcjj_8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9/console-operator/0.log"
Jul 15 10:46:09.235779 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:09.235694    2565 generic.go:356] "Generic (PLEG): container finished" podID="8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9" containerID="05b20c15742e2daa660141039f5558b1b6bb9ad6a8599e77d1f9c80115094808" exitCode=255
Jul 15 10:46:09.235779 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:09.235765    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-8dcjj" event={"ID":"8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9","Type":"ContainerDied","Data":"05b20c15742e2daa660141039f5558b1b6bb9ad6a8599e77d1f9c80115094808"}
Jul 15 10:46:09.235876 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:09.235811    2565 scope.go:117] "RemoveContainer" containerID="2b4b41581a45d05fbb7f4adbd923b6def55b390e8fde4ddb5b8b3a2c997305fa"
Jul 15 10:46:09.236088 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:09.236062    2565 scope.go:117] "RemoveContainer" containerID="05b20c15742e2daa660141039f5558b1b6bb9ad6a8599e77d1f9c80115094808"
Jul 15 10:46:09.236255 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:09.236235    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-8dcjj_openshift-console-operator(8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9)\"" pod="openshift-console-operator/console-operator-7866497494-8dcjj" podUID="8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9"
Jul 15 10:46:09.236353 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:09.236281    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/725cfee7-4a3b-424f-9412-ff710b7218e3-service-ca-bundle\") pod \"router-default-9984c7d94-5kjkb\" (UID: \"725cfee7-4a3b-424f-9412-ff710b7218e3\") " pod="openshift-ingress/router-default-9984c7d94-5kjkb"
Jul 15 10:46:09.236420 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:09.236359    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/725cfee7-4a3b-424f-9412-ff710b7218e3-metrics-certs\") pod \"router-default-9984c7d94-5kjkb\" (UID: \"725cfee7-4a3b-424f-9412-ff710b7218e3\") " pod="openshift-ingress/router-default-9984c7d94-5kjkb"
Jul 15 10:46:09.236468 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:09.236448    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/725cfee7-4a3b-424f-9412-ff710b7218e3-service-ca-bundle podName:725cfee7-4a3b-424f-9412-ff710b7218e3 nodeName:}" failed. No retries permitted until 2026-07-15 10:46:17.236427998 +0000 UTC m=+74.844964012 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/725cfee7-4a3b-424f-9412-ff710b7218e3-service-ca-bundle") pod "router-default-9984c7d94-5kjkb" (UID: "725cfee7-4a3b-424f-9412-ff710b7218e3") : configmap references non-existent config key: service-ca.crt
Jul 15 10:46:09.236523 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:09.236470    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 10:46:09.236523 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:09.236507    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/725cfee7-4a3b-424f-9412-ff710b7218e3-metrics-certs podName:725cfee7-4a3b-424f-9412-ff710b7218e3 nodeName:}" failed. No retries permitted until 2026-07-15 10:46:17.236494315 +0000 UTC m=+74.845030315 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/725cfee7-4a3b-424f-9412-ff710b7218e3-metrics-certs") pod "router-default-9984c7d94-5kjkb" (UID: "725cfee7-4a3b-424f-9412-ff710b7218e3") : secret "router-metrics-certs-default" not found
Jul 15 10:46:10.043949 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:10.043762    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fb687929-8af4-470e-8679-26c69f00ca68-registry-tls\") pod \"image-registry-7c875865b-2sfdx\" (UID: \"fb687929-8af4-470e-8679-26c69f00ca68\") " pod="openshift-image-registry/image-registry-7c875865b-2sfdx"
Jul 15 10:46:10.043949 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:10.043915    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 10:46:10.043949 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:10.043933    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c875865b-2sfdx: secret "image-registry-tls" not found
Jul 15 10:46:10.044574 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:10.043997    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb687929-8af4-470e-8679-26c69f00ca68-registry-tls podName:fb687929-8af4-470e-8679-26c69f00ca68 nodeName:}" failed. No retries permitted until 2026-07-15 10:46:42.043977399 +0000 UTC m=+99.652513405 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fb687929-8af4-470e-8679-26c69f00ca68-registry-tls") pod "image-registry-7c875865b-2sfdx" (UID: "fb687929-8af4-470e-8679-26c69f00ca68") : secret "image-registry-tls" not found
Jul 15 10:46:10.145033 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:10.144994    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfc5835e-29ae-4048-bf6f-d1685d6ec89c-metrics-tls\") pod \"dns-default-5xbp6\" (UID: \"cfc5835e-29ae-4048-bf6f-d1685d6ec89c\") " pod="openshift-dns/dns-default-5xbp6"
Jul 15 10:46:10.145185 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:10.145176    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 10:46:10.145243 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:10.145231    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfc5835e-29ae-4048-bf6f-d1685d6ec89c-metrics-tls podName:cfc5835e-29ae-4048-bf6f-d1685d6ec89c nodeName:}" failed. No retries permitted until 2026-07-15 10:46:42.145213983 +0000 UTC m=+99.753749986 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cfc5835e-29ae-4048-bf6f-d1685d6ec89c-metrics-tls") pod "dns-default-5xbp6" (UID: "cfc5835e-29ae-4048-bf6f-d1685d6ec89c") : secret "dns-default-metrics-tls" not found
Jul 15 10:46:10.241398 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:10.241366    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8dcjj_8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9/console-operator/1.log"
Jul 15 10:46:10.241803 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:10.241786    2565 scope.go:117] "RemoveContainer" containerID="05b20c15742e2daa660141039f5558b1b6bb9ad6a8599e77d1f9c80115094808"
Jul 15 10:46:10.241977 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:10.241956    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-8dcjj_openshift-console-operator(8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9)\"" pod="openshift-console-operator/console-operator-7866497494-8dcjj" podUID="8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9"
Jul 15 10:46:11.254955 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:11.254723    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c3cafa2-db95-44f4-b921-0245d9607e59-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-2bq2k\" (UID: \"6c3cafa2-db95-44f4-b921-0245d9607e59\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2bq2k"
Jul 15 10:46:11.255488 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:11.254984    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 10:46:11.255488 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:11.255049    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c3cafa2-db95-44f4-b921-0245d9607e59-samples-operator-tls podName:6c3cafa2-db95-44f4-b921-0245d9607e59 nodeName:}" failed. No retries permitted until 2026-07-15 10:46:19.255029479 +0000 UTC m=+76.863565498 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6c3cafa2-db95-44f4-b921-0245d9607e59-samples-operator-tls") pod "cluster-samples-operator-65db858894-2bq2k" (UID: "6c3cafa2-db95-44f4-b921-0245d9607e59") : secret "samples-operator-tls" not found
Jul 15 10:46:11.850414 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:11.850370    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:11.983874 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:11.983838    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:12.943103 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:12.943067    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:12.971866 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:12.971823    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da96848b-337e-4448-9275-3ea664ebdec8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bqw5l\" (UID: \"da96848b-337e-4448-9275-3ea664ebdec8\") " pod="openshift-insights/insights-runtime-extractor-bqw5l"
Jul 15 10:46:12.972052 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:12.971912    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/da96848b-337e-4448-9275-3ea664ebdec8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bqw5l\" (UID: \"da96848b-337e-4448-9275-3ea664ebdec8\") " pod="openshift-insights/insights-runtime-extractor-bqw5l"
Jul 15 10:46:12.972052 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:12.971972    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 10:46:12.972052 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:12.972008    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 10:46:12.972052 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:12.972052    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da96848b-337e-4448-9275-3ea664ebdec8-insights-runtime-extractor-tls podName:da96848b-337e-4448-9275-3ea664ebdec8 nodeName:}" failed. No retries permitted until 2026-07-15 10:46:20.972031449 +0000 UTC m=+78.580567451 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/da96848b-337e-4448-9275-3ea664ebdec8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bqw5l" (UID: "da96848b-337e-4448-9275-3ea664ebdec8") : secret "insights-runtime-extractor-tls" not found
Jul 15 10:46:12.972266 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:12.972071    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/da96848b-337e-4448-9275-3ea664ebdec8-kube-rbac-proxy-cm podName:da96848b-337e-4448-9275-3ea664ebdec8 nodeName:}" failed. No retries permitted until 2026-07-15 10:46:20.972061666 +0000 UTC m=+78.580597666 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/da96848b-337e-4448-9275-3ea664ebdec8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bqw5l" (UID: "da96848b-337e-4448-9275-3ea664ebdec8") : configmap "kube-rbac-proxy" not found
Jul 15 10:46:13.043916 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:13.043872    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:13.138622 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:13.138584    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:14.431860 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:14.431817    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:14.532370 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:14.532302    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:14.811257 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:14.811226    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-8dcjj"
Jul 15 10:46:14.811426 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:14.811283    2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-8dcjj"
Jul 15 10:46:14.811644 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:14.811632    2565 scope.go:117] "RemoveContainer" containerID="05b20c15742e2daa660141039f5558b1b6bb9ad6a8599e77d1f9c80115094808"
Jul 15 10:46:14.811793 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:14.811773    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-8dcjj_openshift-console-operator(8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9)\"" pod="openshift-console-operator/console-operator-7866497494-8dcjj" podUID="8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9"
Jul 15 10:46:15.260923 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:15.260813    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-n7jtx" event={"ID":"7dcd6c11-9e60-45e9-9d89-dae4e2594c7f","Type":"ContainerStarted","Data":"4289697ff6087eddf1af5db6e52d1f0263740564a764c53f076a95797054bf39"}
Jul 15 10:46:15.262373 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:15.262326    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5zwx4" event={"ID":"e2a51efd-e7a8-4db0-8ded-c90e680619c8","Type":"ContainerStarted","Data":"f52b417fd4ce8f11fc416fca40ac9be3a61f0f5e9b52d50cda5b570048e4daa7"}
Jul 15 10:46:15.262492 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:15.262405    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5zwx4"
Jul 15 10:46:15.263854 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:15.263833    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zrr95" event={"ID":"82f6960e-f41d-4ad3-83c4-c515ff206787","Type":"ContainerStarted","Data":"5734901d5bee26ced534785c22d24c5039aaaaef861df26b6a9d8a62b4e3d568"}
Jul 15 10:46:15.282290 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:15.282243    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-n7jtx" podStartSLOduration=1.8390104649999999 podStartE2EDuration="7.282229044s" totalImagesPullingTime="5.443218579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:46:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:46:15.281858785 +0000 UTC m=+72.890394808" watchObservedRunningTime="2026-07-15 10:46:15.282229044 +0000 UTC m=+72.890765065"
Jul 15 10:46:15.321940 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:15.321888    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5zwx4" podStartSLOduration=66.135499999 podStartE2EDuration="1m12.321867677s" totalImagesPullingTime="6.186367678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:45:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:46:15.321158674 +0000 UTC m=+72.929694887" watchObservedRunningTime="2026-07-15 10:46:15.321867677 +0000 UTC m=+72.930403702"
Jul 15 10:46:15.322523 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:15.322495    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zrr95" podStartSLOduration=65.855491443 podStartE2EDuration="1m12.322486214s" totalImagesPullingTime="6.466994771s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:45:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:46:15.303244624 +0000 UTC m=+72.911780643" watchObservedRunningTime="2026-07-15 10:46:15.322486214 +0000 UTC m=+72.931022237"
Jul 15 10:46:15.585853 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:15.585810    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:16.440794 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:16.440755    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:16.535280 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:16.535246    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:16.794972 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:16.794935    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:16.906970 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:16.906933    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:17.020240 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:17.020201    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:17.210130 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:17.210054    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-2x6fl\" (UID: \"5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2x6fl"
Jul 15 10:46:17.210264 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:17.210215    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 10:46:17.210302 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:17.210291    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e-cluster-monitoring-operator-tls podName:5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e nodeName:}" failed. No retries permitted until 2026-07-15 10:46:33.210273629 +0000 UTC m=+90.818809631 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-2x6fl" (UID: "5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e") : secret "cluster-monitoring-operator-tls" not found
Jul 15 10:46:17.310967 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:17.310932    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/725cfee7-4a3b-424f-9412-ff710b7218e3-metrics-certs\") pod \"router-default-9984c7d94-5kjkb\" (UID: \"725cfee7-4a3b-424f-9412-ff710b7218e3\") " pod="openshift-ingress/router-default-9984c7d94-5kjkb"
Jul 15 10:46:17.311133 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:17.311064    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/725cfee7-4a3b-424f-9412-ff710b7218e3-service-ca-bundle\") pod \"router-default-9984c7d94-5kjkb\" (UID: \"725cfee7-4a3b-424f-9412-ff710b7218e3\") " pod="openshift-ingress/router-default-9984c7d94-5kjkb"
Jul 15 10:46:17.311133 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:17.311093    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 10:46:17.311210 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:17.311159    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/725cfee7-4a3b-424f-9412-ff710b7218e3-metrics-certs podName:725cfee7-4a3b-424f-9412-ff710b7218e3 nodeName:}" failed. No retries permitted until 2026-07-15 10:46:33.311139159 +0000 UTC m=+90.919675168 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/725cfee7-4a3b-424f-9412-ff710b7218e3-metrics-certs") pod "router-default-9984c7d94-5kjkb" (UID: "725cfee7-4a3b-424f-9412-ff710b7218e3") : secret "router-metrics-certs-default" not found
Jul 15 10:46:17.311251 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:17.311212    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/725cfee7-4a3b-424f-9412-ff710b7218e3-service-ca-bundle podName:725cfee7-4a3b-424f-9412-ff710b7218e3 nodeName:}" failed. No retries permitted until 2026-07-15 10:46:33.311197618 +0000 UTC m=+90.919733619 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/725cfee7-4a3b-424f-9412-ff710b7218e3-service-ca-bundle") pod "router-default-9984c7d94-5kjkb" (UID: "725cfee7-4a3b-424f-9412-ff710b7218e3") : configmap references non-existent config key: service-ca.crt
Jul 15 10:46:18.488030 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:18.487997    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:18.622738 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:18.622700    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:18.729702 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:18.729671    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:19.327432 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:19.327385    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c3cafa2-db95-44f4-b921-0245d9607e59-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-2bq2k\" (UID: \"6c3cafa2-db95-44f4-b921-0245d9607e59\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2bq2k"
Jul 15 10:46:19.327622 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:19.327556    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 10:46:19.327622 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:19.327619    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c3cafa2-db95-44f4-b921-0245d9607e59-samples-operator-tls podName:6c3cafa2-db95-44f4-b921-0245d9607e59 nodeName:}" failed. No retries permitted until 2026-07-15 10:46:35.327604591 +0000 UTC m=+92.936140592 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6c3cafa2-db95-44f4-b921-0245d9607e59-samples-operator-tls") pod "cluster-samples-operator-65db858894-2bq2k" (UID: "6c3cafa2-db95-44f4-b921-0245d9607e59") : secret "samples-operator-tls" not found
Jul 15 10:46:19.687095 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:19.687009    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:21.039159 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:21.039120    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da96848b-337e-4448-9275-3ea664ebdec8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bqw5l\" (UID: \"da96848b-337e-4448-9275-3ea664ebdec8\") " pod="openshift-insights/insights-runtime-extractor-bqw5l"
Jul 15 10:46:21.039545 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:21.039181    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/da96848b-337e-4448-9275-3ea664ebdec8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bqw5l\" (UID: \"da96848b-337e-4448-9275-3ea664ebdec8\") " pod="openshift-insights/insights-runtime-extractor-bqw5l"
Jul 15 10:46:21.039545 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:21.039279    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 10:46:21.039545 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:46:21.039374    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da96848b-337e-4448-9275-3ea664ebdec8-insights-runtime-extractor-tls podName:da96848b-337e-4448-9275-3ea664ebdec8 nodeName:}" failed. No retries permitted until 2026-07-15 10:46:37.039350363 +0000 UTC m=+94.647886380 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/da96848b-337e-4448-9275-3ea664ebdec8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bqw5l" (UID: "da96848b-337e-4448-9275-3ea664ebdec8") : secret "insights-runtime-extractor-tls" not found
Jul 15 10:46:21.039698 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:21.039677    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/da96848b-337e-4448-9275-3ea664ebdec8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bqw5l\" (UID: \"da96848b-337e-4448-9275-3ea664ebdec8\") " pod="openshift-insights/insights-runtime-extractor-bqw5l"
Jul 15 10:46:23.740131 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:23.740094    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:23.826823 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:23.826705    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:24.735782 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:24.735746    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:25.118804 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:25.118772    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:25.201589 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:25.201556    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:25.327416 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:25.327382    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:25.538993 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:25.538962    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:25.661624 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:25.661595    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:25.935221 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:25.935131    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:26.546219 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:26.546166    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:26.730453 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:26.730405    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:26.919527 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:26.919454    2565 scope.go:117] "RemoveContainer" containerID="05b20c15742e2daa660141039f5558b1b6bb9ad6a8599e77d1f9c80115094808"
Jul 15 10:46:26.961752 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:26.961721    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:27.138145 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:27.138110    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:27.303772 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:27.303744    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8dcjj_8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9/console-operator/1.log"
Jul 15 10:46:27.303936 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:27.303807    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-8dcjj" event={"ID":"8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9","Type":"ContainerStarted","Data":"26b3e78722c3acde2918f152a53784b862d23c27f2e6390e8b6c29d84879fc97"}
Jul 15 10:46:27.304190 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:27.304167    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-8dcjj"
Jul 15 10:46:27.326142 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:27.326096    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-8dcjj" podStartSLOduration=20.531426647 podStartE2EDuration="23.32608276s" totalImagesPullingTime="2.794656113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:46:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:46:27.325189684 +0000 UTC m=+84.933725718" watchObservedRunningTime="2026-07-15 10:46:27.32608276 +0000 UTC m=+84.934618782"
Jul 15 10:46:27.327172 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:27.327145    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:27.672283 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:27.672202    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-8dcjj"
Jul 15 10:46:27.776297 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:27.776264    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:27.898446 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:27.898407    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:27.981554 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:27.981470    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:28.045104 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:28.045059    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:28.139285 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:28.139254    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:28.212514 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:28.212482    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:28.535022 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:28.534990    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:28.636067 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:28.636033    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:28.947403 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:28.947302    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:29.259299 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:29.257813    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:29.357751 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:29.357718    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:29.538724 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:29.538687    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:29.635708 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:29.635673    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:29.737483 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:29.737450    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:29.804812 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:29.804708    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:29.939717 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:29.939680    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:30.041344 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:30.041291    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:30.149412 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:30.149294    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:31.265297 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:31.265263    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:31.361145 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:31.361099    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:31.536307 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:31.536259    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:31.820306 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:31.820218    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:31.914014 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:31.913972    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:31.992261 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:31.992226    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:32.132711 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:32.132613    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:32.936760 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:32.936727    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:33.242090 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:33.242001    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-2x6fl\" (UID: \"5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2x6fl"
Jul 15 10:46:33.244460 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:33.244423    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-2x6fl\" (UID: \"5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2x6fl"
Jul 15 10:46:33.267807 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:33.267783    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-wmgtx\""
Jul 15 10:46:33.272418 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:33.272403    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2x6fl"
Jul 15 10:46:33.343220 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:33.343193    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/725cfee7-4a3b-424f-9412-ff710b7218e3-service-ca-bundle\") pod \"router-default-9984c7d94-5kjkb\" (UID: \"725cfee7-4a3b-424f-9412-ff710b7218e3\") " pod="openshift-ingress/router-default-9984c7d94-5kjkb"
Jul 15 10:46:33.343406 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:33.343281    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/725cfee7-4a3b-424f-9412-ff710b7218e3-metrics-certs\") pod \"router-default-9984c7d94-5kjkb\" (UID: \"725cfee7-4a3b-424f-9412-ff710b7218e3\") " pod="openshift-ingress/router-default-9984c7d94-5kjkb"
Jul 15 10:46:33.343844 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:33.343816    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/725cfee7-4a3b-424f-9412-ff710b7218e3-service-ca-bundle\") pod \"router-default-9984c7d94-5kjkb\" (UID: \"725cfee7-4a3b-424f-9412-ff710b7218e3\") " pod="openshift-ingress/router-default-9984c7d94-5kjkb"
Jul 15 10:46:33.345768 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:33.345743    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/725cfee7-4a3b-424f-9412-ff710b7218e3-metrics-certs\") pod \"router-default-9984c7d94-5kjkb\" (UID: \"725cfee7-4a3b-424f-9412-ff710b7218e3\") " pod="openshift-ingress/router-default-9984c7d94-5kjkb"
Jul 15 10:46:33.368762 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:33.368736    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-r4kwn\""
Jul 15 10:46:33.375260 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:33.375235    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-9984c7d94-5kjkb"
Jul 15 10:46:33.406245 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:33.406216    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2x6fl"]
Jul 15 10:46:33.409065 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:46:33.409039    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bce2734_6aa0_48ce_b9e0_bf29dcd3ac3e.slice/crio-4629024fead2d738d30dc14a7581058dc0765acd95502978121c6593898ff711 WatchSource:0}: Error finding container 4629024fead2d738d30dc14a7581058dc0765acd95502978121c6593898ff711: Status 404 returned error can't find the container with id 4629024fead2d738d30dc14a7581058dc0765acd95502978121c6593898ff711
Jul 15 10:46:33.530517 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:33.530482    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-9984c7d94-5kjkb"]
Jul 15 10:46:33.536169 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:46:33.536146    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod725cfee7_4a3b_424f_9412_ff710b7218e3.slice/crio-96a78179dca7fc6cb13bd7fd428db16598f711d41b5622023742d6bcd42483bf WatchSource:0}: Error finding container 96a78179dca7fc6cb13bd7fd428db16598f711d41b5622023742d6bcd42483bf: Status 404 returned error can't find the container with id 96a78179dca7fc6cb13bd7fd428db16598f711d41b5622023742d6bcd42483bf
Jul 15 10:46:33.538622 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:33.538571    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:33.741593 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:33.741557    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:33.940900 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:33.940752    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:34.147046 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:34.147011    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:34.328165 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:34.328105    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-9984c7d94-5kjkb" event={"ID":"725cfee7-4a3b-424f-9412-ff710b7218e3","Type":"ContainerStarted","Data":"9edd23869c135569a60bb4969ecb9bed05d8b6e43a22eaaeb44c8cd1f4e07307"}
Jul 15 10:46:34.328165 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:34.328165    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-9984c7d94-5kjkb" event={"ID":"725cfee7-4a3b-424f-9412-ff710b7218e3","Type":"ContainerStarted","Data":"96a78179dca7fc6cb13bd7fd428db16598f711d41b5622023742d6bcd42483bf"}
Jul 15 10:46:34.329642 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:34.329610    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2x6fl" event={"ID":"5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e","Type":"ContainerStarted","Data":"4629024fead2d738d30dc14a7581058dc0765acd95502978121c6593898ff711"}
Jul 15 10:46:34.350250 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:34.350132    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-9984c7d94-5kjkb" podStartSLOduration=33.350114182 podStartE2EDuration="33.350114182s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:46:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:46:34.349530018 +0000 UTC m=+91.958066041" watchObservedRunningTime="2026-07-15 10:46:34.350114182 +0000 UTC m=+91.958650184"
Jul 15 10:46:34.375770 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:34.375733    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-9984c7d94-5kjkb"
Jul 15 10:46:34.378594 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:34.378571    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-9984c7d94-5kjkb"
Jul 15 10:46:35.334973 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:35.334938    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2x6fl" event={"ID":"5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e","Type":"ContainerStarted","Data":"55dcd4bdfd2129ca09a662352e64540b6a695f92a25437c71165597ef6f71316"}
Jul 15 10:46:35.335453 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:35.335194    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-9984c7d94-5kjkb"
Jul 15 10:46:35.337615 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:35.337593    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-9984c7d94-5kjkb"
Jul 15 10:46:35.354570 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:35.353358    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-2x6fl" podStartSLOduration=32.544743266 podStartE2EDuration="34.353315519s" totalImagesPullingTime="1.808572253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:46:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:46:35.352009457 +0000 UTC m=+92.960545482" watchObservedRunningTime="2026-07-15 10:46:35.353315519 +0000 UTC m=+92.961851542"
Jul 15 10:46:35.363955 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:35.363907    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c3cafa2-db95-44f4-b921-0245d9607e59-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-2bq2k\" (UID: \"6c3cafa2-db95-44f4-b921-0245d9607e59\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2bq2k"
Jul 15 10:46:35.366844 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:35.366811    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c3cafa2-db95-44f4-b921-0245d9607e59-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-2bq2k\" (UID: \"6c3cafa2-db95-44f4-b921-0245d9607e59\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2bq2k"
Jul 15 10:46:35.607067 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:35.607034    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2bq2k"
Jul 15 10:46:35.723493 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:35.723448    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:35.751156 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:35.751127    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2bq2k"]
Jul 15 10:46:35.795255 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:35.795212    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:36.339353 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:36.339294    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2bq2k" event={"ID":"6c3cafa2-db95-44f4-b921-0245d9607e59","Type":"ContainerStarted","Data":"7b55b45042ef36461c0ba1c6fdba12e3db44e37f42cf3b8ae6817df8bb519cfd"}
Jul 15 10:46:36.597520 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:36.597433    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:37.080382 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:37.080317    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da96848b-337e-4448-9275-3ea664ebdec8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bqw5l\" (UID: \"da96848b-337e-4448-9275-3ea664ebdec8\") " pod="openshift-insights/insights-runtime-extractor-bqw5l"
Jul 15 10:46:37.083000 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:37.082967    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/da96848b-337e-4448-9275-3ea664ebdec8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bqw5l\" (UID: \"da96848b-337e-4448-9275-3ea664ebdec8\") " pod="openshift-insights/insights-runtime-extractor-bqw5l"
Jul 15 10:46:37.089895 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:37.089867    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bqw5l"
Jul 15 10:46:37.586009 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:37.585962    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bqw5l"]
Jul 15 10:46:37.592604 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:46:37.592580    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda96848b_337e_4448_9275_3ea664ebdec8.slice/crio-1075e6252f34747bb268efe4d5addc1b061d87721d8772ddb12d3098de2fef3a WatchSource:0}: Error finding container 1075e6252f34747bb268efe4d5addc1b061d87721d8772ddb12d3098de2fef3a: Status 404 returned error can't find the container with id 1075e6252f34747bb268efe4d5addc1b061d87721d8772ddb12d3098de2fef3a
Jul 15 10:46:38.079818 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:38.079780    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:38.145563 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:38.145533    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:38.352831 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:38.352664    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2bq2k" event={"ID":"6c3cafa2-db95-44f4-b921-0245d9607e59","Type":"ContainerStarted","Data":"abdcf14b8b45d6c7eaf5529fe070c9f229e97ce467cc5cfe05bf48a20b1a3577"}
Jul 15 10:46:38.352831 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:38.352731    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2bq2k" event={"ID":"6c3cafa2-db95-44f4-b921-0245d9607e59","Type":"ContainerStarted","Data":"6112ad6b06aa9e98cb74fe792c2ec84a38249da1c072386c1101c7e3d038eb4d"}
Jul 15 10:46:38.354938 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:38.354881    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bqw5l" event={"ID":"da96848b-337e-4448-9275-3ea664ebdec8","Type":"ContainerStarted","Data":"1075e6252f34747bb268efe4d5addc1b061d87721d8772ddb12d3098de2fef3a"}
Jul 15 10:46:38.373228 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:38.373174    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-2bq2k" podStartSLOduration=33.685899465 podStartE2EDuration="35.373154438s" totalImagesPullingTime="1.687254973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:46:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:46:38.371824515 +0000 UTC m=+95.980360553" watchObservedRunningTime="2026-07-15 10:46:38.373154438 +0000 UTC m=+95.981690460"
Jul 15 10:46:40.121929 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:40.121881    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:40.191429 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:40.191376    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:40.385383 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:40.385280    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:40.452341 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:40.452303    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:42.127776 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:42.127733    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fb687929-8af4-470e-8679-26c69f00ca68-registry-tls\") pod \"image-registry-7c875865b-2sfdx\" (UID: \"fb687929-8af4-470e-8679-26c69f00ca68\") " pod="openshift-image-registry/image-registry-7c875865b-2sfdx"
Jul 15 10:46:42.130201 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:42.130176    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fb687929-8af4-470e-8679-26c69f00ca68-registry-tls\") pod \"image-registry-7c875865b-2sfdx\" (UID: \"fb687929-8af4-470e-8679-26c69f00ca68\") " pod="openshift-image-registry/image-registry-7c875865b-2sfdx"
Jul 15 10:46:42.228564 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:42.228516    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfc5835e-29ae-4048-bf6f-d1685d6ec89c-metrics-tls\") pod \"dns-default-5xbp6\" (UID: \"cfc5835e-29ae-4048-bf6f-d1685d6ec89c\") " pod="openshift-dns/dns-default-5xbp6"
Jul 15 10:46:42.231422 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:42.231395    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfc5835e-29ae-4048-bf6f-d1685d6ec89c-metrics-tls\") pod \"dns-default-5xbp6\" (UID: \"cfc5835e-29ae-4048-bf6f-d1685d6ec89c\") " pod="openshift-dns/dns-default-5xbp6"
Jul 15 10:46:42.424135 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:42.424055    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kw2sk\""
Jul 15 10:46:42.432429 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:42.432147    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c875865b-2sfdx"
Jul 15 10:46:42.449650 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:42.449621    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bd4vk\""
Jul 15 10:46:42.456711 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:42.456685    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5xbp6"
Jul 15 10:46:43.105664 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:43.105579    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c875865b-2sfdx"]
Jul 15 10:46:43.107855 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:46:43.107828    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb687929_8af4_470e_8679_26c69f00ca68.slice/crio-affe143674e6f717ddb0e60048daebf56d6930ecf9775d8a222cfffa6156fa92 WatchSource:0}: Error finding container affe143674e6f717ddb0e60048daebf56d6930ecf9775d8a222cfffa6156fa92: Status 404 returned error can't find the container with id affe143674e6f717ddb0e60048daebf56d6930ecf9775d8a222cfffa6156fa92
Jul 15 10:46:43.110998 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:43.110977    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5xbp6"]
Jul 15 10:46:43.114667 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:46:43.114640    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfc5835e_29ae_4048_bf6f_d1685d6ec89c.slice/crio-09ad9d05337306b92b274ade526dc633fea6c644d6f9670b1d5497d8cf785101 WatchSource:0}: Error finding container 09ad9d05337306b92b274ade526dc633fea6c644d6f9670b1d5497d8cf785101: Status 404 returned error can't find the container with id 09ad9d05337306b92b274ade526dc633fea6c644d6f9670b1d5497d8cf785101
Jul 15 10:46:43.375208 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:43.375179    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5xbp6" event={"ID":"cfc5835e-29ae-4048-bf6f-d1685d6ec89c","Type":"ContainerStarted","Data":"09ad9d05337306b92b274ade526dc633fea6c644d6f9670b1d5497d8cf785101"}
Jul 15 10:46:43.376496 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:43.376473    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c875865b-2sfdx" event={"ID":"fb687929-8af4-470e-8679-26c69f00ca68","Type":"ContainerStarted","Data":"affe143674e6f717ddb0e60048daebf56d6930ecf9775d8a222cfffa6156fa92"}
Jul 15 10:46:44.094682 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:44.094645    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:44.383122 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:44.383086    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c875865b-2sfdx" event={"ID":"fb687929-8af4-470e-8679-26c69f00ca68","Type":"ContainerStarted","Data":"a826862e8a60c5ad31b3e4d0d3b7b780ae1551e01059f76044f655469b2fa3c5"}
Jul 15 10:46:44.383974 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:44.383903    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7c875865b-2sfdx"
Jul 15 10:46:44.386266 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:44.386238    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bqw5l" event={"ID":"da96848b-337e-4448-9275-3ea664ebdec8","Type":"ContainerStarted","Data":"07f5882d2add5e1b71180d4ec9df85e6c5310a0aad6feeaf309fad39a39b175a"}
Jul 15 10:46:44.429497 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:44.429441    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7c875865b-2sfdx" podStartSLOduration=101.429420452 podStartE2EDuration="1m41.429420452s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:45:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:46:44.427109535 +0000 UTC m=+102.035645552" watchObservedRunningTime="2026-07-15 10:46:44.429420452 +0000 UTC m=+102.037956471"
Jul 15 10:46:44.745670 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:44.745576    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:44.846946 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:44.846901    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:45.271638 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:45.271552    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:45.581818 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:45.581780    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:45.639928 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:45.639837    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:45.783872 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:45.783820    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:45.885615 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:45.885534    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:46.270307 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:46.270238    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5zwx4"
Jul 15 10:46:46.777494 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:46.777453    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65f65c77d-ldjd9"]
Jul 15 10:46:46.782377 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:46.782347    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65f65c77d-ldjd9"
Jul 15 10:46:46.785958 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:46.785932    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 15 10:46:46.786122 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:46.785956    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 15 10:46:46.786660 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:46.786638    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-88bmp\""
Jul 15 10:46:46.792113 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:46.792092    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 15 10:46:46.792258 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:46.792237    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 15 10:46:46.792424 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:46.792313    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 15 10:46:46.792424 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:46.792093    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 15 10:46:46.792633 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:46.792617    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 15 10:46:46.804143 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:46.804120    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 15 10:46:46.807394 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:46.807370    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65f65c77d-ldjd9"]
Jul 15 10:46:46.865689 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:46.865650    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e-service-ca\") pod \"console-65f65c77d-ldjd9\" (UID: \"8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e\") " pod="openshift-console/console-65f65c77d-ldjd9"
Jul 15 10:46:46.865689 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:46.865694    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e-trusted-ca-bundle\") pod \"console-65f65c77d-ldjd9\" (UID: \"8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e\") " pod="openshift-console/console-65f65c77d-ldjd9"
Jul 15 10:46:46.865890 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:46.865725    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e-console-config\") pod \"console-65f65c77d-ldjd9\" (UID: \"8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e\") " pod="openshift-console/console-65f65c77d-ldjd9"
Jul 15 10:46:46.865890 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:46.865797    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e-console-serving-cert\") pod \"console-65f65c77d-ldjd9\" (UID: \"8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e\") " pod="openshift-console/console-65f65c77d-ldjd9"
Jul 15 10:46:46.865890 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:46.865861    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e-console-oauth-config\") pod \"console-65f65c77d-ldjd9\" (UID: \"8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e\") " pod="openshift-console/console-65f65c77d-ldjd9"
Jul 15 10:46:46.866009 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:46.865891    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hdbm\" (UniqueName: \"kubernetes.io/projected/8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e-kube-api-access-6hdbm\") pod \"console-65f65c77d-ldjd9\" (UID: \"8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e\") " pod="openshift-console/console-65f65c77d-ldjd9"
Jul 15 10:46:46.866009 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:46.865914    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e-oauth-serving-cert\") pod \"console-65f65c77d-ldjd9\" (UID: \"8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e\") " pod="openshift-console/console-65f65c77d-ldjd9"
Jul 15 10:46:46.966526 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:46.966449    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hdbm\" (UniqueName: \"kubernetes.io/projected/8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e-kube-api-access-6hdbm\") pod \"console-65f65c77d-ldjd9\" (UID: \"8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e\") " pod="openshift-console/console-65f65c77d-ldjd9"
Jul 15 10:46:46.966526 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:46.966494    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e-oauth-serving-cert\") pod \"console-65f65c77d-ldjd9\" (UID: \"8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e\") " pod="openshift-console/console-65f65c77d-ldjd9"
Jul 15 10:46:46.966526 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:46.966515    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e-service-ca\") pod \"console-65f65c77d-ldjd9\" (UID: \"8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e\") " pod="openshift-console/console-65f65c77d-ldjd9"
Jul 15 10:46:46.966825 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:46.966531    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e-trusted-ca-bundle\") pod \"console-65f65c77d-ldjd9\" (UID: \"8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e\") " pod="openshift-console/console-65f65c77d-ldjd9"
Jul 15 10:46:46.966825 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:46.966591    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e-console-config\") pod \"console-65f65c77d-ldjd9\" (UID: \"8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e\") " pod="openshift-console/console-65f65c77d-ldjd9"
Jul 15 10:46:46.966825 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:46.966703    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e-console-serving-cert\") pod \"console-65f65c77d-ldjd9\" (UID: \"8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e\") " pod="openshift-console/console-65f65c77d-ldjd9"
Jul 15 10:46:46.966825 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:46.966791    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e-console-oauth-config\") pod \"console-65f65c77d-ldjd9\" (UID: \"8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e\") " pod="openshift-console/console-65f65c77d-ldjd9"
Jul 15 10:46:46.967355 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:46.967287    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e-oauth-serving-cert\") pod \"console-65f65c77d-ldjd9\" (UID: \"8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e\") " pod="openshift-console/console-65f65c77d-ldjd9"
Jul 15 10:46:46.967355 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:46.967317    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e-service-ca\") pod \"console-65f65c77d-ldjd9\" (UID: \"8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e\") " pod="openshift-console/console-65f65c77d-ldjd9"
Jul 15 10:46:46.967978 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:46.967566    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e-trusted-ca-bundle\") pod \"console-65f65c77d-ldjd9\" (UID: \"8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e\") " pod="openshift-console/console-65f65c77d-ldjd9"
Jul 15 10:46:46.967978 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:46.967732    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e-console-config\") pod \"console-65f65c77d-ldjd9\" (UID: \"8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e\") " pod="openshift-console/console-65f65c77d-ldjd9"
Jul 15 10:46:46.969934 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:46.969906    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e-console-serving-cert\") pod \"console-65f65c77d-ldjd9\" (UID: \"8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e\") " pod="openshift-console/console-65f65c77d-ldjd9"
Jul 15 10:46:46.970017 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:46.969962    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e-console-oauth-config\") pod \"console-65f65c77d-ldjd9\" (UID: \"8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e\") " pod="openshift-console/console-65f65c77d-ldjd9"
Jul 15 10:46:46.980888 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:46.980861    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hdbm\" (UniqueName: \"kubernetes.io/projected/8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e-kube-api-access-6hdbm\") pod \"console-65f65c77d-ldjd9\" (UID: \"8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e\") " pod="openshift-console/console-65f65c77d-ldjd9"
Jul 15 10:46:47.093237 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:47.093195    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65f65c77d-ldjd9"
Jul 15 10:46:47.497020 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:47.496947    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65f65c77d-ldjd9"]
Jul 15 10:46:48.405001 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:48.404963    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65f65c77d-ldjd9" event={"ID":"8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e","Type":"ContainerStarted","Data":"b1e3c4f2c81515505ad4b2305d1e112a2a81d4a4721089c34086dfa613ebe989"}
Jul 15 10:46:48.407544 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:48.407505    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bqw5l" event={"ID":"da96848b-337e-4448-9275-3ea664ebdec8","Type":"ContainerStarted","Data":"89dd40d091daaa92962433cfdd48a7d5748b2a6a54a913883d2757e839af3147"}
Jul 15 10:46:48.409734 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:48.409699    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5xbp6" event={"ID":"cfc5835e-29ae-4048-bf6f-d1685d6ec89c","Type":"ContainerStarted","Data":"74246597d0314410b847f489b506bae29721eb225b02acc08cd6759e12eb0008"}
Jul 15 10:46:48.409856 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:48.409755    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5xbp6" event={"ID":"cfc5835e-29ae-4048-bf6f-d1685d6ec89c","Type":"ContainerStarted","Data":"ac2bd7533c35098ece5f4edddadcf7a46a95cd63a970c304e9d20433549852e9"}
Jul 15 10:46:48.410518 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:48.410480    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5xbp6"
Jul 15 10:46:48.433657 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:48.433596    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5xbp6" podStartSLOduration=66.200014505 podStartE2EDuration="1m10.433574084s" totalImagesPullingTime="4.233559579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:45:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:46:48.432483238 +0000 UTC m=+106.041019261" watchObservedRunningTime="2026-07-15 10:46:48.433574084 +0000 UTC m=+106.042110109"
Jul 15 10:46:49.402792 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:49.402746    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:49.504561 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:49.504529    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:52.427669 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:52.427635    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65f65c77d-ldjd9" event={"ID":"8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e","Type":"ContainerStarted","Data":"fa992cf9f7d146f3281fc6cec28258ac95fa4d65a44ee6057c83794053b3b086"}
Jul 15 10:46:52.429712 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:52.429679    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bqw5l" event={"ID":"da96848b-337e-4448-9275-3ea664ebdec8","Type":"ContainerStarted","Data":"3663f700ef700796420194b82487311d914e6a15f6902b3f1c063facf28b2b7d"}
Jul 15 10:46:52.449194 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:52.449139    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65f65c77d-ldjd9" podStartSLOduration=1.979877407 podStartE2EDuration="6.449123185s" totalImagesPullingTime="4.469245778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:46:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:46:52.448702378 +0000 UTC m=+110.057238400" watchObservedRunningTime="2026-07-15 10:46:52.449123185 +0000 UTC m=+110.057659208"
Jul 15 10:46:52.468261 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:52.468218    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bqw5l" podStartSLOduration=33.258907532 podStartE2EDuration="47.468204366s" totalImagesPullingTime="14.209296834s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 10:46:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:46:52.468065282 +0000 UTC m=+110.076601305" watchObservedRunningTime="2026-07-15 10:46:52.468204366 +0000 UTC m=+110.076740388"
Jul 15 10:46:52.985219 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:52.985178    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:53.086161 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:53.086123    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:55.780311 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:55.780278    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:57.064978 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:57.064946    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:57.093829 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:57.093803    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65f65c77d-ldjd9"
Jul 15 10:46:57.094011 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:57.093994    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65f65c77d-ldjd9"
Jul 15 10:46:57.098838 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:57.098817    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65f65c77d-ldjd9"
Jul 15 10:46:57.151179 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:57.151144    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:57.233652 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:57.233607    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:57.450013 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:57.449943    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65f65c77d-ldjd9"
Jul 15 10:46:57.628921 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:57.628880    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:57.819632 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:57.819603    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:57.884826 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:57.884784    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:58.208734 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:58.208644    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:58.309713 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:58.309670    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:58.371146 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:58.371116    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:46:59.421847 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:46:59.421819    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5xbp6"
Jul 15 10:47:00.920709 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:00.920670    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:47:00.983919 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:00.983884    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:47:05.230643 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:05.230604    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:47:05.328799 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:05.328749    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:47:06.399972 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:06.399946    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7c875865b-2sfdx"
Jul 15 10:47:06.712398 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:06.712289    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:47:06.814123 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:06.814088    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:47:08.185887 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:08.185849    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:47:08.374013 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:08.373976    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:47:10.011810 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:10.011774    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:47:10.085736 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:10.085696    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:47:10.183309 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:10.183271    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:47:10.413504 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:10.413469    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:47:10.939612 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:10.939578    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c875865b-2sfdx"]
Jul 15 10:47:11.252240 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:11.252162    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:47:11.335742 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:11.335704    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:47:11.676887 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:11.676855    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f16a7597-8022-437b-a82b-ab187296ecdf-metrics-certs\") pod \"network-metrics-daemon-c4bht\" (UID: \"f16a7597-8022-437b-a82b-ab187296ecdf\") " pod="openshift-multus/network-metrics-daemon-c4bht"
Jul 15 10:47:11.679229 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:11.679201    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f16a7597-8022-437b-a82b-ab187296ecdf-metrics-certs\") pod \"network-metrics-daemon-c4bht\" (UID: \"f16a7597-8022-437b-a82b-ab187296ecdf\") " pod="openshift-multus/network-metrics-daemon-c4bht"
Jul 15 10:47:11.731236 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:11.731196    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:47:11.815442 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:11.815399    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:47:11.935433 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:11.935320    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cs2nv\""
Jul 15 10:47:11.942784 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:11.942754    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4bht"
Jul 15 10:47:12.071713 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:12.071692    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-c4bht"]
Jul 15 10:47:12.074202 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:47:12.074178    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf16a7597_8022_437b_a82b_ab187296ecdf.slice/crio-96aca6d4ecaea5e4c1788d701ea4e5bf588a6a17786707b28e18f3580e102591 WatchSource:0}: Error finding container 96aca6d4ecaea5e4c1788d701ea4e5bf588a6a17786707b28e18f3580e102591: Status 404 returned error can't find the container with id 96aca6d4ecaea5e4c1788d701ea4e5bf588a6a17786707b28e18f3580e102591
Jul 15 10:47:12.502833 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:12.502792    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c4bht" event={"ID":"f16a7597-8022-437b-a82b-ab187296ecdf","Type":"ContainerStarted","Data":"96aca6d4ecaea5e4c1788d701ea4e5bf588a6a17786707b28e18f3580e102591"}
Jul 15 10:47:13.192905 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.192872    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:47:13.331033 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.331001    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:47:13.442367 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.442316    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:47:13.538128 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.538099    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-g5jpg"]
Jul 15 10:47:13.554353 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.554317    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-zch97"]
Jul 15 10:47:13.554465 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.554449    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-g5jpg"
Jul 15 10:47:13.558305 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.558264    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:47:13.563237 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.563204    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 15 10:47:13.564433 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.564412    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-g5jpg"]
Jul 15 10:47:13.564581 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.564566    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-zch97"
Jul 15 10:47:13.567961 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.567837    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 15 10:47:13.568298 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.568221    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 15 10:47:13.568670 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.568648    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-5qnj8\""
Jul 15 10:47:13.572742 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.572722    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 15 10:47:13.572841 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.572780    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-lsjzz\""
Jul 15 10:47:13.573623 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.573592    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 15 10:47:13.573828 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.573660    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 15 10:47:13.598145 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.598122    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-zch97"]
Jul 15 10:47:13.665070 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.665045    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cqmh9"]
Jul 15 10:47:13.687455 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.687424    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cqmh9"
Jul 15 10:47:13.692441 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.692412    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a71211d6-6eb8-4a68-867d-8b3e21192d9c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-g5jpg\" (UID: \"a71211d6-6eb8-4a68-867d-8b3e21192d9c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-g5jpg"
Jul 15 10:47:13.692555 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.692445    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 15 10:47:13.692555 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.692466    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 15 10:47:13.692555 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.692468    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2781bf89-0c22-473c-baf4-8a2b47cbe05f-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-zch97\" (UID: \"2781bf89-0c22-473c-baf4-8a2b47cbe05f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zch97"
Jul 15 10:47:13.692555 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.692534    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a71211d6-6eb8-4a68-867d-8b3e21192d9c-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-g5jpg\" (UID: \"a71211d6-6eb8-4a68-867d-8b3e21192d9c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-g5jpg"
Jul 15 10:47:13.692760 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.692580    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a71211d6-6eb8-4a68-867d-8b3e21192d9c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-g5jpg\" (UID: \"a71211d6-6eb8-4a68-867d-8b3e21192d9c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-g5jpg"
Jul 15 10:47:13.692760 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.692611    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2781bf89-0c22-473c-baf4-8a2b47cbe05f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-zch97\" (UID: \"2781bf89-0c22-473c-baf4-8a2b47cbe05f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zch97"
Jul 15 10:47:13.692760 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.692681    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2pzn\" (UniqueName: \"kubernetes.io/projected/a71211d6-6eb8-4a68-867d-8b3e21192d9c-kube-api-access-t2pzn\") pod \"openshift-state-metrics-84bd68b896-g5jpg\" (UID: \"a71211d6-6eb8-4a68-867d-8b3e21192d9c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-g5jpg"
Jul 15 10:47:13.692902 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.692761    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2781bf89-0c22-473c-baf4-8a2b47cbe05f-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-zch97\" (UID: \"2781bf89-0c22-473c-baf4-8a2b47cbe05f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zch97"
Jul 15 10:47:13.692902 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.692792    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2781bf89-0c22-473c-baf4-8a2b47cbe05f-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-zch97\" (UID: \"2781bf89-0c22-473c-baf4-8a2b47cbe05f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zch97"
Jul 15 10:47:13.692902 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.692839    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl7cc\" (UniqueName: \"kubernetes.io/projected/2781bf89-0c22-473c-baf4-8a2b47cbe05f-kube-api-access-dl7cc\") pod \"kube-state-metrics-785778ff74-zch97\" (UID: \"2781bf89-0c22-473c-baf4-8a2b47cbe05f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zch97"
Jul 15 10:47:13.693015 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.692921    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2781bf89-0c22-473c-baf4-8a2b47cbe05f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-zch97\" (UID: \"2781bf89-0c22-473c-baf4-8a2b47cbe05f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zch97"
Jul 15 10:47:13.693467 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.693444    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 15 10:47:13.693592 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.693451    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bfwql\""
Jul 15 10:47:13.700320 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.700300    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:47:13.794352 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.794251    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2781bf89-0c22-473c-baf4-8a2b47cbe05f-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-zch97\" (UID: \"2781bf89-0c22-473c-baf4-8a2b47cbe05f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zch97"
Jul 15 10:47:13.794352 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.794288    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2-node-exporter-textfile\") pod \"node-exporter-cqmh9\" (UID: \"b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2\") " pod="openshift-monitoring/node-exporter-cqmh9"
Jul 15 10:47:13.794352 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.794313    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dl7cc\" (UniqueName: \"kubernetes.io/projected/2781bf89-0c22-473c-baf4-8a2b47cbe05f-kube-api-access-dl7cc\") pod \"kube-state-metrics-785778ff74-zch97\" (UID: \"2781bf89-0c22-473c-baf4-8a2b47cbe05f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zch97"
Jul 15 10:47:13.794622 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.794354    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2-metrics-client-ca\") pod \"node-exporter-cqmh9\" (UID: \"b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2\") " pod="openshift-monitoring/node-exporter-cqmh9"
Jul 15 10:47:13.794622 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.794498    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2781bf89-0c22-473c-baf4-8a2b47cbe05f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-zch97\" (UID: \"2781bf89-0c22-473c-baf4-8a2b47cbe05f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zch97"
Jul 15 10:47:13.794622 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.794534    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2-node-exporter-wtmp\") pod \"node-exporter-cqmh9\" (UID: \"b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2\") " pod="openshift-monitoring/node-exporter-cqmh9"
Jul 15 10:47:13.794622 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.794552    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cqmh9\" (UID: \"b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2\") " pod="openshift-monitoring/node-exporter-cqmh9"
Jul 15 10:47:13.794622 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.794583    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2-sys\") pod \"node-exporter-cqmh9\" (UID: \"b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2\") " pod="openshift-monitoring/node-exporter-cqmh9"
Jul 15 10:47:13.794874 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.794643    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2-root\") pod \"node-exporter-cqmh9\" (UID: \"b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2\") " pod="openshift-monitoring/node-exporter-cqmh9"
Jul 15 10:47:13.794874 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.794688    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2-node-exporter-tls\") pod \"node-exporter-cqmh9\" (UID: \"b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2\") " pod="openshift-monitoring/node-exporter-cqmh9"
Jul 15 10:47:13.794874 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.794721    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a71211d6-6eb8-4a68-867d-8b3e21192d9c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-g5jpg\" (UID: \"a71211d6-6eb8-4a68-867d-8b3e21192d9c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-g5jpg"
Jul 15 10:47:13.794874 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.794764    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2781bf89-0c22-473c-baf4-8a2b47cbe05f-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-zch97\" (UID: \"2781bf89-0c22-473c-baf4-8a2b47cbe05f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zch97"
Jul 15 10:47:13.794874 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.794797    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a71211d6-6eb8-4a68-867d-8b3e21192d9c-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-g5jpg\" (UID: \"a71211d6-6eb8-4a68-867d-8b3e21192d9c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-g5jpg"
Jul 15 10:47:13.794874 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.794835    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a71211d6-6eb8-4a68-867d-8b3e21192d9c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-g5jpg\" (UID: \"a71211d6-6eb8-4a68-867d-8b3e21192d9c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-g5jpg"
Jul 15 10:47:13.794874 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.794861    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2781bf89-0c22-473c-baf4-8a2b47cbe05f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-zch97\" (UID: \"2781bf89-0c22-473c-baf4-8a2b47cbe05f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zch97"
Jul 15 10:47:13.795220 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.794892    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2pzn\" (UniqueName: \"kubernetes.io/projected/a71211d6-6eb8-4a68-867d-8b3e21192d9c-kube-api-access-t2pzn\") pod \"openshift-state-metrics-84bd68b896-g5jpg\" (UID: \"a71211d6-6eb8-4a68-867d-8b3e21192d9c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-g5jpg"
Jul 15 10:47:13.795220 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.794922    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2-node-exporter-accelerators-collector-config\") pod \"node-exporter-cqmh9\" (UID: \"b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2\") " pod="openshift-monitoring/node-exporter-cqmh9"
Jul 15 10:47:13.795220 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.794953    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj8cv\" (UniqueName: \"kubernetes.io/projected/b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2-kube-api-access-bj8cv\") pod \"node-exporter-cqmh9\" (UID: \"b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2\") " pod="openshift-monitoring/node-exporter-cqmh9"
Jul 15 10:47:13.795220 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.794987    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2781bf89-0c22-473c-baf4-8a2b47cbe05f-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-zch97\" (UID: \"2781bf89-0c22-473c-baf4-8a2b47cbe05f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zch97"
Jul 15 10:47:13.795220 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.795144    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2781bf89-0c22-473c-baf4-8a2b47cbe05f-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-zch97\" (UID: \"2781bf89-0c22-473c-baf4-8a2b47cbe05f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zch97"
Jul 15 10:47:13.795220 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.795147    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2781bf89-0c22-473c-baf4-8a2b47cbe05f-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-zch97\" (UID: \"2781bf89-0c22-473c-baf4-8a2b47cbe05f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zch97"
Jul 15 10:47:13.795519 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.795372    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2781bf89-0c22-473c-baf4-8a2b47cbe05f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-zch97\" (UID: \"2781bf89-0c22-473c-baf4-8a2b47cbe05f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zch97"
Jul 15 10:47:13.795519 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.795513    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a71211d6-6eb8-4a68-867d-8b3e21192d9c-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-g5jpg\" (UID: \"a71211d6-6eb8-4a68-867d-8b3e21192d9c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-g5jpg"
Jul 15 10:47:13.797401 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.797371    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a71211d6-6eb8-4a68-867d-8b3e21192d9c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-g5jpg\" (UID: \"a71211d6-6eb8-4a68-867d-8b3e21192d9c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-g5jpg"
Jul 15 10:47:13.797527 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.797423    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a71211d6-6eb8-4a68-867d-8b3e21192d9c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-g5jpg\" (UID: \"a71211d6-6eb8-4a68-867d-8b3e21192d9c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-g5jpg"
Jul 15 10:47:13.797608 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.797592    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2781bf89-0c22-473c-baf4-8a2b47cbe05f-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-zch97\" (UID: \"2781bf89-0c22-473c-baf4-8a2b47cbe05f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zch97"
Jul 15 10:47:13.797782 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.797762    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2781bf89-0c22-473c-baf4-8a2b47cbe05f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-zch97\" (UID: \"2781bf89-0c22-473c-baf4-8a2b47cbe05f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zch97"
Jul 15 10:47:13.818167 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.818138    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:47:13.821619 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.821587    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl7cc\" (UniqueName: \"kubernetes.io/projected/2781bf89-0c22-473c-baf4-8a2b47cbe05f-kube-api-access-dl7cc\") pod \"kube-state-metrics-785778ff74-zch97\" (UID: \"2781bf89-0c22-473c-baf4-8a2b47cbe05f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zch97"
Jul 15 10:47:13.822437 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.822416    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2pzn\" (UniqueName: \"kubernetes.io/projected/a71211d6-6eb8-4a68-867d-8b3e21192d9c-kube-api-access-t2pzn\") pod \"openshift-state-metrics-84bd68b896-g5jpg\" (UID: \"a71211d6-6eb8-4a68-867d-8b3e21192d9c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-g5jpg"
Jul 15 10:47:13.874272 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.874241    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-g5jpg"
Jul 15 10:47:13.882429 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.882401    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-zch97"
Jul 15 10:47:13.896128 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.896098    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2-sys\") pod \"node-exporter-cqmh9\" (UID: \"b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2\") " pod="openshift-monitoring/node-exporter-cqmh9"
Jul 15 10:47:13.896255 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.896131    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2-root\") pod \"node-exporter-cqmh9\" (UID: \"b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2\") " pod="openshift-monitoring/node-exporter-cqmh9"
Jul 15 10:47:13.896255 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.896151    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2-node-exporter-tls\") pod \"node-exporter-cqmh9\" (UID: \"b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2\") " pod="openshift-monitoring/node-exporter-cqmh9"
Jul 15 10:47:13.896255 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.896230    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2-sys\") pod \"node-exporter-cqmh9\" (UID: \"b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2\") " pod="openshift-monitoring/node-exporter-cqmh9"
Jul 15 10:47:13.896423 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.896270    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2-root\") pod \"node-exporter-cqmh9\" (UID: \"b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2\") " pod="openshift-monitoring/node-exporter-cqmh9"
Jul 15 10:47:13.896423 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.896283    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2-node-exporter-accelerators-collector-config\") pod \"node-exporter-cqmh9\" (UID: \"b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2\") " pod="openshift-monitoring/node-exporter-cqmh9"
Jul 15 10:47:13.896423 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.896325    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bj8cv\" (UniqueName: \"kubernetes.io/projected/b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2-kube-api-access-bj8cv\") pod \"node-exporter-cqmh9\" (UID: \"b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2\") " pod="openshift-monitoring/node-exporter-cqmh9"
Jul 15 10:47:13.896423 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.896395    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2-node-exporter-textfile\") pod \"node-exporter-cqmh9\" (UID: \"b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2\") " pod="openshift-monitoring/node-exporter-cqmh9"
Jul 15 10:47:13.896603 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.896439    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2-metrics-client-ca\") pod \"node-exporter-cqmh9\" (UID: \"b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2\") " pod="openshift-monitoring/node-exporter-cqmh9"
Jul 15 10:47:13.896603 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.896476    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2-node-exporter-wtmp\") pod \"node-exporter-cqmh9\" (UID: \"b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2\") " pod="openshift-monitoring/node-exporter-cqmh9"
Jul 15 10:47:13.896603 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.896501    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cqmh9\" (UID: \"b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2\") " pod="openshift-monitoring/node-exporter-cqmh9"
Jul 15 10:47:13.896874 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.896841    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2-node-exporter-wtmp\") pod \"node-exporter-cqmh9\" (UID: \"b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2\") " pod="openshift-monitoring/node-exporter-cqmh9"
Jul 15 10:47:13.897077 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.897051    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2-node-exporter-textfile\") pod \"node-exporter-cqmh9\" (UID: \"b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2\") " pod="openshift-monitoring/node-exporter-cqmh9"
Jul 15 10:47:13.897200 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.897164    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2-node-exporter-accelerators-collector-config\") pod \"node-exporter-cqmh9\" (UID: \"b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2\") " pod="openshift-monitoring/node-exporter-cqmh9"
Jul 15 10:47:13.897458 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.897438    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2-metrics-client-ca\") pod \"node-exporter-cqmh9\" (UID: \"b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2\") " pod="openshift-monitoring/node-exporter-cqmh9"
Jul 15 10:47:13.898826 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.898803    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2-node-exporter-tls\") pod \"node-exporter-cqmh9\" (UID: \"b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2\") " pod="openshift-monitoring/node-exporter-cqmh9"
Jul 15 10:47:13.899446 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.899426    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cqmh9\" (UID: \"b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2\") " pod="openshift-monitoring/node-exporter-cqmh9"
Jul 15 10:47:13.930162 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:13.928927    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj8cv\" (UniqueName: \"kubernetes.io/projected/b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2-kube-api-access-bj8cv\") pod \"node-exporter-cqmh9\" (UID: \"b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2\") " pod="openshift-monitoring/node-exporter-cqmh9"
Jul 15 10:47:14.009954 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:14.009719    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cqmh9"
Jul 15 10:47:14.042213 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:47:14.042185    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1fe65e3_3d9a_4f86_b2e0_8e4d24c96fe2.slice/crio-f10c456655773ce3b97494f243e077be3ad55dd68e3912288782ed3f0bf03db3 WatchSource:0}: Error finding container f10c456655773ce3b97494f243e077be3ad55dd68e3912288782ed3f0bf03db3: Status 404 returned error can't find the container with id f10c456655773ce3b97494f243e077be3ad55dd68e3912288782ed3f0bf03db3
Jul 15 10:47:14.079104 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:14.079066    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-g5jpg"]
Jul 15 10:47:14.083102 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:47:14.083064    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda71211d6_6eb8_4a68_867d_8b3e21192d9c.slice/crio-668d156eda343216427cbff53fd95c7349afce3e41950bf6f331408ed96516a7 WatchSource:0}: Error finding container 668d156eda343216427cbff53fd95c7349afce3e41950bf6f331408ed96516a7: Status 404 returned error can't find the container with id 668d156eda343216427cbff53fd95c7349afce3e41950bf6f331408ed96516a7
Jul 15 10:47:14.086858 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:14.086825    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:47:14.103253 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:14.103226    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-zch97"]
Jul 15 10:47:14.105043 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:47:14.105015    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2781bf89_0c22_473c_baf4_8a2b47cbe05f.slice/crio-60acabc0a96cb2c3767c2a156a6baccbbd08715ba83ccdb960889bc10eea9d11 WatchSource:0}: Error finding container 60acabc0a96cb2c3767c2a156a6baccbbd08715ba83ccdb960889bc10eea9d11: Status 404 returned error can't find the container with id 60acabc0a96cb2c3767c2a156a6baccbbd08715ba83ccdb960889bc10eea9d11
Jul 15 10:47:14.234262 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:14.234234    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:47:14.396206 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:14.396156    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:47:14.511142 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:14.511107    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cqmh9" event={"ID":"b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2","Type":"ContainerStarted","Data":"f10c456655773ce3b97494f243e077be3ad55dd68e3912288782ed3f0bf03db3"}
Jul 15 10:47:14.512523 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:14.512451    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-zch97" event={"ID":"2781bf89-0c22-473c-baf4-8a2b47cbe05f","Type":"ContainerStarted","Data":"60acabc0a96cb2c3767c2a156a6baccbbd08715ba83ccdb960889bc10eea9d11"}
Jul 15 10:47:14.514744 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:14.514709    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-g5jpg" event={"ID":"a71211d6-6eb8-4a68-867d-8b3e21192d9c","Type":"ContainerStarted","Data":"0c314417de560fef4ef393caad9d7f1d6bac16b10b1f3e50eb94c87fac45d267"}
Jul 15 10:47:14.514862 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:14.514769    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-g5jpg" event={"ID":"a71211d6-6eb8-4a68-867d-8b3e21192d9c","Type":"ContainerStarted","Data":"54710ad19223ba15b385459f0b1e8e31872ce246a0f18cc7ef22b84023bb2c64"}
Jul 15 10:47:14.514862 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:14.514799    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-g5jpg" event={"ID":"a71211d6-6eb8-4a68-867d-8b3e21192d9c","Type":"ContainerStarted","Data":"668d156eda343216427cbff53fd95c7349afce3e41950bf6f331408ed96516a7"}
Jul 15 10:47:14.516560 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:14.516537    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c4bht" event={"ID":"f16a7597-8022-437b-a82b-ab187296ecdf","Type":"ContainerStarted","Data":"4e4138851dab45676e52ede7ac9a1bf23cfdfc1ddb92ab4ad0260fc033fb4c74"}
Jul 15 10:47:14.516648 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:14.516579    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c4bht" event={"ID":"f16a7597-8022-437b-a82b-ab187296ecdf","Type":"ContainerStarted","Data":"670378dc00f878068e0fb54b8e85a4b9833a95a9178daba72130cc91cdf10ef1"}
Jul 15 10:47:14.554797 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:14.554739    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-c4bht" podStartSLOduration=131.102355367 podStartE2EDuration="2m12.554717274s" totalImagesPullingTime="1.452361907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:45:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:47:14.552847863 +0000 UTC m=+132.161383887" watchObservedRunningTime="2026-07-15 10:47:14.554717274 +0000 UTC m=+132.163253295"
Jul 15 10:47:14.559751 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:14.559676    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:47:14.722233 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:14.722137    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:47:14.727971 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:14.727941    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 10:47:14.755827 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:14.755796    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:47:14.758977 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:14.758948    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rtmpq\""
Jul 15 10:47:14.760025 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:14.759785    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 15 10:47:14.760025 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:14.760002    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 15 10:47:14.762464 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:14.762441    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 15 10:47:14.763633 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:14.763613    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 15 10:47:14.764945 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:14.764454    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 15 10:47:14.765176 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:14.765139    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 15 10:47:14.765267 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:14.765245    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 15 10:47:14.765360 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:14.765319    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 15 10:47:14.765809 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:14.765790    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 15 10:47:14.778289 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:14.778247    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 10:47:14.818040 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:14.817960    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:47:14.908353 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:14.908293    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62162859-ec3c-4d0c-84af-3668b92739ca-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:47:14.908524 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:14.908363    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/62162859-ec3c-4d0c-84af-3668b92739ca-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:47:14.908524 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:14.908393    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/62162859-ec3c-4d0c-84af-3668b92739ca-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:47:14.908524 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:14.908453    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62162859-ec3c-4d0c-84af-3668b92739ca-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:47:14.908524 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:14.908506    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/62162859-ec3c-4d0c-84af-3668b92739ca-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:47:14.908668 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:14.908529    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62162859-ec3c-4d0c-84af-3668b92739ca-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:47:14.908668 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:14.908570    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62162859-ec3c-4d0c-84af-3668b92739ca-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:47:14.908668 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:14.908595    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/62162859-ec3c-4d0c-84af-3668b92739ca-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:47:14.908668 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:14.908641    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/62162859-ec3c-4d0c-84af-3668b92739ca-config-volume\") pod \"alertmanager-main-0\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:47:14.908668 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:14.908663    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/62162859-ec3c-4d0c-84af-3668b92739ca-web-config\") pod \"alertmanager-main-0\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:47:14.908895 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:14.908686    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvfhq\" (UniqueName: \"kubernetes.io/projected/62162859-ec3c-4d0c-84af-3668b92739ca-kube-api-access-fvfhq\") pod \"alertmanager-main-0\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:47:14.908895 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:14.908711    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/62162859-ec3c-4d0c-84af-3668b92739ca-config-out\") pod \"alertmanager-main-0\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:47:14.908895 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:14.908736    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/62162859-ec3c-4d0c-84af-3668b92739ca-tls-assets\") pod \"alertmanager-main-0\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:47:15.009958 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:15.009913    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/62162859-ec3c-4d0c-84af-3668b92739ca-config-volume\") pod \"alertmanager-main-0\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:47:15.009958 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:15.009961    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/62162859-ec3c-4d0c-84af-3668b92739ca-web-config\") pod \"alertmanager-main-0\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:47:15.010205 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:15.009988    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvfhq\" (UniqueName: \"kubernetes.io/projected/62162859-ec3c-4d0c-84af-3668b92739ca-kube-api-access-fvfhq\") pod \"alertmanager-main-0\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:47:15.010205 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:15.010042    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/62162859-ec3c-4d0c-84af-3668b92739ca-config-out\") pod \"alertmanager-main-0\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:47:15.010205 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:15.010117    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/62162859-ec3c-4d0c-84af-3668b92739ca-tls-assets\") pod \"alertmanager-main-0\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:47:15.010205 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:15.010169    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62162859-ec3c-4d0c-84af-3668b92739ca-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:47:15.010205 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:15.010202    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/62162859-ec3c-4d0c-84af-3668b92739ca-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:47:15.010483 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:15.010229    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/62162859-ec3c-4d0c-84af-3668b92739ca-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:47:15.010483 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:15.010370    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62162859-ec3c-4d0c-84af-3668b92739ca-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:47:15.010483 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:15.010408    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/62162859-ec3c-4d0c-84af-3668b92739ca-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:47:15.010483 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:15.010435    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62162859-ec3c-4d0c-84af-3668b92739ca-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:47:15.010680 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:15.010495    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62162859-ec3c-4d0c-84af-3668b92739ca-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:47:15.010680 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:15.010520    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/62162859-ec3c-4d0c-84af-3668b92739ca-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:47:15.010799 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:15.010768    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/62162859-ec3c-4d0c-84af-3668b92739ca-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:47:15.010929 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:47:15.010890    2565 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 15 10:47:15.011014 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:47:15.010957    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62162859-ec3c-4d0c-84af-3668b92739ca-secret-alertmanager-main-tls podName:62162859-ec3c-4d0c-84af-3668b92739ca nodeName:}" failed. No retries permitted until 2026-07-15 10:47:15.510935425 +0000 UTC m=+133.119471425 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/62162859-ec3c-4d0c-84af-3668b92739ca-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "62162859-ec3c-4d0c-84af-3668b92739ca") : secret "alertmanager-main-tls" not found
Jul 15 10:47:15.013830 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:15.013804    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62162859-ec3c-4d0c-84af-3668b92739ca-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:47:15.014065 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:15.014039    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/62162859-ec3c-4d0c-84af-3668b92739ca-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:47:15.014388 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:15.014318    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62162859-ec3c-4d0c-84af-3668b92739ca-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:47:15.014507 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:15.014484    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/62162859-ec3c-4d0c-84af-3668b92739ca-config-volume\") pod \"alertmanager-main-0\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:47:15.014569 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:15.014501    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62162859-ec3c-4d0c-84af-3668b92739ca-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:47:15.015570 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:15.015531    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/62162859-ec3c-4d0c-84af-3668b92739ca-config-out\") pod \"alertmanager-main-0\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:47:15.015570 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:15.015556    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/62162859-ec3c-4d0c-84af-3668b92739ca-web-config\") pod \"alertmanager-main-0\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:47:15.016376 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:15.016298    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62162859-ec3c-4d0c-84af-3668b92739ca-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:47:15.016376 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:15.016298    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/62162859-ec3c-4d0c-84af-3668b92739ca-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:47:15.016884 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:15.016863    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/62162859-ec3c-4d0c-84af-3668b92739ca-tls-assets\") pod \"alertmanager-main-0\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:47:15.065749 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:15.065683    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvfhq\" (UniqueName: \"kubernetes.io/projected/62162859-ec3c-4d0c-84af-3668b92739ca-kube-api-access-fvfhq\") pod \"alertmanager-main-0\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:47:15.253805 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:15.253711    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:47:15.515574 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:15.515473    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/62162859-ec3c-4d0c-84af-3668b92739ca-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:47:15.518713 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:15.518686    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/62162859-ec3c-4d0c-84af-3668b92739ca-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:47:15.668386 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:15.668323    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:47:16.150691 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:16.150180    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 10:47:16.154308 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:47:16.154255    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62162859_ec3c_4d0c_84af_3668b92739ca.slice/crio-d00648242c8c79570a4a8650419b31458599aa465009b62f23427fc4dded865d WatchSource:0}: Error finding container d00648242c8c79570a4a8650419b31458599aa465009b62f23427fc4dded865d: Status 404 returned error can't find the container with id d00648242c8c79570a4a8650419b31458599aa465009b62f23427fc4dded865d
Jul 15 10:47:16.459614 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:16.459580    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:47:16.534725 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:16.534684    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-g5jpg" event={"ID":"a71211d6-6eb8-4a68-867d-8b3e21192d9c","Type":"ContainerStarted","Data":"81a9ce635b30f9b703e0054c9e301109626936550b2f6dee985241b1fe7f7830"}
Jul 15 10:47:16.536574 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:16.536540    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-zch97" event={"ID":"2781bf89-0c22-473c-baf4-8a2b47cbe05f","Type":"ContainerStarted","Data":"a88705efc986fdcacae1de7ba560224af6b947090de23c5f96a788f6282d904e"}
Jul 15 10:47:16.536691 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:16.536594    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-zch97" event={"ID":"2781bf89-0c22-473c-baf4-8a2b47cbe05f","Type":"ContainerStarted","Data":"5a1323723ac107f89d52a375a4e112f5713a48a925e00429311dc25b28a08295"}
Jul 15 10:47:16.537729 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:16.537704    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62162859-ec3c-4d0c-84af-3668b92739ca","Type":"ContainerStarted","Data":"d00648242c8c79570a4a8650419b31458599aa465009b62f23427fc4dded865d"}
Jul 15 10:47:16.560972 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:16.560916    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-g5jpg" podStartSLOduration=1.916330693 podStartE2EDuration="3.560897062s" totalImagesPullingTime="1.644566369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:47:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:47:16.559842964 +0000 UTC m=+134.168378986" watchObservedRunningTime="2026-07-15 10:47:16.560897062 +0000 UTC m=+134.169433084"
Jul 15 10:47:16.562674 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:16.562646    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:47:16.672243 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:16.672210    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:47:16.766959 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:16.766925    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:47:17.087201 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:17.087162    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:47:17.544083 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:17.544050    2565 generic.go:356] "Generic (PLEG): container finished" podID="b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2" containerID="0ddd8e85081edd15b522cd4676fa6d3546f4cff06548a210f9ec1733216b554d" exitCode=0
Jul 15 10:47:17.544254 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:17.544146    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cqmh9" event={"ID":"b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2","Type":"ContainerDied","Data":"0ddd8e85081edd15b522cd4676fa6d3546f4cff06548a210f9ec1733216b554d"}
Jul 15 10:47:17.546393 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:17.546366    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-zch97" event={"ID":"2781bf89-0c22-473c-baf4-8a2b47cbe05f","Type":"ContainerStarted","Data":"dc43bdcf693a953ed16617a350bfc2d05c9de86a61dd82e349385382b7d4897e"}
Jul 15 10:47:17.599213 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:17.599161    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-zch97" podStartSLOduration=2.7348227400000003 podStartE2EDuration="4.599144443s" totalImagesPullingTime="1.864321703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:47:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:47:17.598363214 +0000 UTC m=+135.206899235" watchObservedRunningTime="2026-07-15 10:47:17.599144443 +0000 UTC m=+135.207680465"
Jul 15 10:47:18.083995 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:18.083902    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:47:18.149292 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:18.149260    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:47:18.184490 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:18.184455    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-584d8d9b95-kktf5"]
Jul 15 10:47:18.187041 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:18.187024    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-584d8d9b95-kktf5"
Jul 15 10:47:18.189701 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:18.189638    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 15 10:47:18.189862 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:18.189840    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 15 10:47:18.189927 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:18.189864    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 15 10:47:18.189927 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:18.189882    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 15 10:47:18.189927 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:18.189893    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-23ibev8l1eiu9\""
Jul 15 10:47:18.189927 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:18.189884    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-v7vtr\""
Jul 15 10:47:18.200060 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:18.200039    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-584d8d9b95-kktf5"]
Jul 15 10:47:18.343039 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:18.342947    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0fdd648a-0c7b-4aac-8980-2c7fb46e9b51-client-ca-bundle\") pod \"metrics-server-584d8d9b95-kktf5\" (UID: \"0fdd648a-0c7b-4aac-8980-2c7fb46e9b51\") " pod="openshift-monitoring/metrics-server-584d8d9b95-kktf5"
Jul 15 10:47:18.343039 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:18.342986    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fdd648a-0c7b-4aac-8980-2c7fb46e9b51-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-584d8d9b95-kktf5\" (UID: \"0fdd648a-0c7b-4aac-8980-2c7fb46e9b51\") " pod="openshift-monitoring/metrics-server-584d8d9b95-kktf5"
Jul 15 10:47:18.343039 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:18.343003    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0fdd648a-0c7b-4aac-8980-2c7fb46e9b51-audit-log\") pod \"metrics-server-584d8d9b95-kktf5\" (UID: \"0fdd648a-0c7b-4aac-8980-2c7fb46e9b51\") " pod="openshift-monitoring/metrics-server-584d8d9b95-kktf5"
Jul 15 10:47:18.343039 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:18.343022    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0fdd648a-0c7b-4aac-8980-2c7fb46e9b51-secret-metrics-server-client-certs\") pod \"metrics-server-584d8d9b95-kktf5\" (UID: \"0fdd648a-0c7b-4aac-8980-2c7fb46e9b51\") " pod="openshift-monitoring/metrics-server-584d8d9b95-kktf5"
Jul 15 10:47:18.343404 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:18.343079    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcdxg\" (UniqueName: \"kubernetes.io/projected/0fdd648a-0c7b-4aac-8980-2c7fb46e9b51-kube-api-access-fcdxg\") pod \"metrics-server-584d8d9b95-kktf5\" (UID: \"0fdd648a-0c7b-4aac-8980-2c7fb46e9b51\") " pod="openshift-monitoring/metrics-server-584d8d9b95-kktf5"
Jul 15 10:47:18.343404 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:18.343131    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0fdd648a-0c7b-4aac-8980-2c7fb46e9b51-secret-metrics-server-tls\") pod \"metrics-server-584d8d9b95-kktf5\" (UID: \"0fdd648a-0c7b-4aac-8980-2c7fb46e9b51\") " pod="openshift-monitoring/metrics-server-584d8d9b95-kktf5"
Jul 15 10:47:18.343404 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:18.343177    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0fdd648a-0c7b-4aac-8980-2c7fb46e9b51-metrics-server-audit-profiles\") pod \"metrics-server-584d8d9b95-kktf5\" (UID: \"0fdd648a-0c7b-4aac-8980-2c7fb46e9b51\") " pod="openshift-monitoring/metrics-server-584d8d9b95-kktf5"
Jul 15 10:47:18.445002 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:18.444491    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0fdd648a-0c7b-4aac-8980-2c7fb46e9b51-secret-metrics-server-tls\") pod \"metrics-server-584d8d9b95-kktf5\" (UID: \"0fdd648a-0c7b-4aac-8980-2c7fb46e9b51\") " pod="openshift-monitoring/metrics-server-584d8d9b95-kktf5"
Jul 15 10:47:18.445002 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:18.444570    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0fdd648a-0c7b-4aac-8980-2c7fb46e9b51-metrics-server-audit-profiles\") pod \"metrics-server-584d8d9b95-kktf5\" (UID: \"0fdd648a-0c7b-4aac-8980-2c7fb46e9b51\") " pod="openshift-monitoring/metrics-server-584d8d9b95-kktf5"
Jul 15 10:47:18.445002 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:18.444650    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0fdd648a-0c7b-4aac-8980-2c7fb46e9b51-client-ca-bundle\") pod \"metrics-server-584d8d9b95-kktf5\" (UID: \"0fdd648a-0c7b-4aac-8980-2c7fb46e9b51\") " pod="openshift-monitoring/metrics-server-584d8d9b95-kktf5"
Jul 15 10:47:18.445002 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:18.444691    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fdd648a-0c7b-4aac-8980-2c7fb46e9b51-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-584d8d9b95-kktf5\" (UID: \"0fdd648a-0c7b-4aac-8980-2c7fb46e9b51\") " pod="openshift-monitoring/metrics-server-584d8d9b95-kktf5"
Jul 15 10:47:18.445002 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:18.444730    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0fdd648a-0c7b-4aac-8980-2c7fb46e9b51-audit-log\") pod \"metrics-server-584d8d9b95-kktf5\" (UID: \"0fdd648a-0c7b-4aac-8980-2c7fb46e9b51\") " pod="openshift-monitoring/metrics-server-584d8d9b95-kktf5"
Jul 15 10:47:18.445002 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:18.444774    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0fdd648a-0c7b-4aac-8980-2c7fb46e9b51-secret-metrics-server-client-certs\") pod \"metrics-server-584d8d9b95-kktf5\" (UID: \"0fdd648a-0c7b-4aac-8980-2c7fb46e9b51\") " pod="openshift-monitoring/metrics-server-584d8d9b95-kktf5"
Jul 15 10:47:18.445002 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:18.444824    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcdxg\" (UniqueName: \"kubernetes.io/projected/0fdd648a-0c7b-4aac-8980-2c7fb46e9b51-kube-api-access-fcdxg\") pod \"metrics-server-584d8d9b95-kktf5\" (UID: \"0fdd648a-0c7b-4aac-8980-2c7fb46e9b51\") " pod="openshift-monitoring/metrics-server-584d8d9b95-kktf5"
Jul 15 10:47:18.449756 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:18.449727    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0fdd648a-0c7b-4aac-8980-2c7fb46e9b51-audit-log\") pod \"metrics-server-584d8d9b95-kktf5\" (UID: \"0fdd648a-0c7b-4aac-8980-2c7fb46e9b51\") " pod="openshift-monitoring/metrics-server-584d8d9b95-kktf5"
Jul 15 10:47:18.450011 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:18.449842    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0fdd648a-0c7b-4aac-8980-2c7fb46e9b51-secret-metrics-server-tls\") pod \"metrics-server-584d8d9b95-kktf5\" (UID: \"0fdd648a-0c7b-4aac-8980-2c7fb46e9b51\") " pod="openshift-monitoring/metrics-server-584d8d9b95-kktf5"
Jul 15 10:47:18.450133 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:18.450065    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fdd648a-0c7b-4aac-8980-2c7fb46e9b51-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-584d8d9b95-kktf5\" (UID: \"0fdd648a-0c7b-4aac-8980-2c7fb46e9b51\") " pod="openshift-monitoring/metrics-server-584d8d9b95-kktf5"
Jul 15 10:47:18.450713 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:18.450688    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0fdd648a-0c7b-4aac-8980-2c7fb46e9b51-metrics-server-audit-profiles\") pod \"metrics-server-584d8d9b95-kktf5\" (UID: \"0fdd648a-0c7b-4aac-8980-2c7fb46e9b51\") " pod="openshift-monitoring/metrics-server-584d8d9b95-kktf5"
Jul 15 10:47:18.451981 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:18.451950    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0fdd648a-0c7b-4aac-8980-2c7fb46e9b51-client-ca-bundle\") pod \"metrics-server-584d8d9b95-kktf5\" (UID: \"0fdd648a-0c7b-4aac-8980-2c7fb46e9b51\") " pod="openshift-monitoring/metrics-server-584d8d9b95-kktf5"
Jul 15 10:47:18.452264 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:18.452245    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0fdd648a-0c7b-4aac-8980-2c7fb46e9b51-secret-metrics-server-client-certs\") pod \"metrics-server-584d8d9b95-kktf5\" (UID: \"0fdd648a-0c7b-4aac-8980-2c7fb46e9b51\") " pod="openshift-monitoring/metrics-server-584d8d9b95-kktf5"
Jul 15 10:47:18.454014 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:18.453993    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcdxg\" (UniqueName: \"kubernetes.io/projected/0fdd648a-0c7b-4aac-8980-2c7fb46e9b51-kube-api-access-fcdxg\") pod \"metrics-server-584d8d9b95-kktf5\" (UID: \"0fdd648a-0c7b-4aac-8980-2c7fb46e9b51\") " pod="openshift-monitoring/metrics-server-584d8d9b95-kktf5"
Jul 15 10:47:18.497130 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:18.497095    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-584d8d9b95-kktf5"
Jul 15 10:47:18.498276 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:18.498244    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:47:18.553872 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:18.553565    2565 generic.go:356] "Generic (PLEG): container finished" podID="62162859-ec3c-4d0c-84af-3668b92739ca" containerID="3a6e35e2d145cf48997f91f634e91788a19bb9e06f73660025e7b02535f4bbfa" exitCode=0
Jul 15 10:47:18.553872 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:18.553737    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62162859-ec3c-4d0c-84af-3668b92739ca","Type":"ContainerDied","Data":"3a6e35e2d145cf48997f91f634e91788a19bb9e06f73660025e7b02535f4bbfa"}
Jul 15 10:47:18.557582 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:18.557554    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cqmh9" event={"ID":"b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2","Type":"ContainerStarted","Data":"a72f7c5dc68e4a9776cfb3e415eaf4f9f873e7386b9dbc170d6f4d5f0cb3d2d0"}
Jul 15 10:47:18.557737 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:18.557612    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cqmh9" event={"ID":"b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2","Type":"ContainerStarted","Data":"f0e45c4fef02b221c102206e983e1fefe4b9b519d43e7cdf898f39c9409a47ce"}
Jul 15 10:47:18.602206 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:18.602101    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cqmh9" podStartSLOduration=2.625646843 podStartE2EDuration="5.602083688s" totalImagesPullingTime="2.887189232s" totalInitContainerRuntime="89.247613ms" isStatefulPod=true podCreationTimestamp="2026-07-15 10:47:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:47:18.600910065 +0000 UTC m=+136.209446105" watchObservedRunningTime="2026-07-15 10:47:18.602083688 +0000 UTC m=+136.210619710"
Jul 15 10:47:18.650871 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:18.650839    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-584d8d9b95-kktf5"]
Jul 15 10:47:18.653774 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:47:18.653749    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fdd648a_0c7b_4aac_8980_2c7fb46e9b51.slice/crio-19630de0b40b6b55cec2c50f254987b474f87a6fb5cfba84a36e2b938a01cd67 WatchSource:0}: Error finding container 19630de0b40b6b55cec2c50f254987b474f87a6fb5cfba84a36e2b938a01cd67: Status 404 returned error can't find the container with id 19630de0b40b6b55cec2c50f254987b474f87a6fb5cfba84a36e2b938a01cd67
Jul 15 10:47:19.564418 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:19.564378    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-584d8d9b95-kktf5" event={"ID":"0fdd648a-0c7b-4aac-8980-2c7fb46e9b51","Type":"ContainerStarted","Data":"19630de0b40b6b55cec2c50f254987b474f87a6fb5cfba84a36e2b938a01cd67"}
Jul 15 10:47:19.825063 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:19.824969    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:47:20.120870 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:20.120789    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:47:20.327261 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:20.327235    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:47:20.427042 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:20.427015    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:47:20.569678 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:20.569654    2565 generic.go:356] "Generic (PLEG): container finished" podID="63270ef2-9f47-4772-9807-6c7fb426005b" containerID="cbe1c3d32963bc533ae9ad4b7bce7f714ae050b0fbde1e9c3e9b9f9487fe9766" exitCode=0
Jul 15 10:47:20.570064 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:20.569734    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-g9swl" event={"ID":"63270ef2-9f47-4772-9807-6c7fb426005b","Type":"ContainerDied","Data":"cbe1c3d32963bc533ae9ad4b7bce7f714ae050b0fbde1e9c3e9b9f9487fe9766"}
Jul 15 10:47:20.570146 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:20.570130    2565 scope.go:117] "RemoveContainer" containerID="cbe1c3d32963bc533ae9ad4b7bce7f714ae050b0fbde1e9c3e9b9f9487fe9766"
Jul 15 10:47:20.571728 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:20.571703    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-584d8d9b95-kktf5" event={"ID":"0fdd648a-0c7b-4aac-8980-2c7fb46e9b51","Type":"ContainerStarted","Data":"9c8055c87db39e65577f3ac943776ac964a9bfe31a09160480e5a7904281b277"}
Jul 15 10:47:20.575105 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:20.575079    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62162859-ec3c-4d0c-84af-3668b92739ca","Type":"ContainerStarted","Data":"b738a44e9a92fa3c4a03b88f8b83b0e4757f91d6addd8362892c01bb5b01848a"}
Jul 15 10:47:20.575204 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:20.575138    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62162859-ec3c-4d0c-84af-3668b92739ca","Type":"ContainerStarted","Data":"ffde0474f853453dd32cd8dca4ecf48df661927a0ddf86c43522c6ae831ab511"}
Jul 15 10:47:20.575204 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:20.575164    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62162859-ec3c-4d0c-84af-3668b92739ca","Type":"ContainerStarted","Data":"b31d0ffe69b41276c696c25d2cdd06fd0a2a60dc836a2d334a230c546d6b0e78"}
Jul 15 10:47:20.575204 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:20.575194    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62162859-ec3c-4d0c-84af-3668b92739ca","Type":"ContainerStarted","Data":"bb9c1ab7e4760e65ab330138490a48cee3a230b2647df956b568abdcb2069a5c"}
Jul 15 10:47:21.583071 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:21.583035    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62162859-ec3c-4d0c-84af-3668b92739ca","Type":"ContainerStarted","Data":"efe5a4ede43b557d2fe7ad90da813adb72b62441dde8910044165f66c619c2de"}
Jul 15 10:47:21.584642 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:21.584615    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-g9swl" event={"ID":"63270ef2-9f47-4772-9807-6c7fb426005b","Type":"ContainerStarted","Data":"ce2e0349af0918f38bd9f4d57bea1846fcbd50badd93b8b4dfe24f46f2ea45ea"}
Jul 15 10:47:21.609199 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:21.609150    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-584d8d9b95-kktf5" podStartSLOduration=2.020236655 podStartE2EDuration="3.609135516s" totalImagesPullingTime="1.588898861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:47:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:47:20.612676929 +0000 UTC m=+138.221212953" watchObservedRunningTime="2026-07-15 10:47:21.609135516 +0000 UTC m=+139.217671537"
Jul 15 10:47:22.592321 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:22.592279    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62162859-ec3c-4d0c-84af-3668b92739ca","Type":"ContainerStarted","Data":"0708322e65968b04ff8d220ee73a58c147acc4c67611e550d913368ad73c00c8"}
Jul 15 10:47:22.626773 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:22.626721    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.320627342 podStartE2EDuration="8.626705214s" totalImagesPullingTime="4.293256616s" totalInitContainerRuntime="12.821256ms" isStatefulPod=false podCreationTimestamp="2026-07-15 10:47:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:47:22.624858646 +0000 UTC m=+140.233394668" watchObservedRunningTime="2026-07-15 10:47:22.626705214 +0000 UTC m=+140.235241236"
Jul 15 10:47:25.126383 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:25.126322    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:47:25.228699 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:25.228659    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:47:26.166769 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:26.166729    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-dc75cc457-6vdb9"]
Jul 15 10:47:26.179172 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:26.179143    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dc75cc457-6vdb9"
Jul 15 10:47:26.186480 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:26.186182    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dc75cc457-6vdb9"]
Jul 15 10:47:26.227936 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:26.227910    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8cd3dcc1-5f67-4e80-a47b-9b87a534ea98-console-serving-cert\") pod \"console-dc75cc457-6vdb9\" (UID: \"8cd3dcc1-5f67-4e80-a47b-9b87a534ea98\") " pod="openshift-console/console-dc75cc457-6vdb9"
Jul 15 10:47:26.228074 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:26.227960    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8cd3dcc1-5f67-4e80-a47b-9b87a534ea98-console-oauth-config\") pod \"console-dc75cc457-6vdb9\" (UID: \"8cd3dcc1-5f67-4e80-a47b-9b87a534ea98\") " pod="openshift-console/console-dc75cc457-6vdb9"
Jul 15 10:47:26.228074 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:26.227985    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cd3dcc1-5f67-4e80-a47b-9b87a534ea98-trusted-ca-bundle\") pod \"console-dc75cc457-6vdb9\" (UID: \"8cd3dcc1-5f67-4e80-a47b-9b87a534ea98\") " pod="openshift-console/console-dc75cc457-6vdb9"
Jul 15 10:47:26.228074 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:26.228004    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8cd3dcc1-5f67-4e80-a47b-9b87a534ea98-oauth-serving-cert\") pod \"console-dc75cc457-6vdb9\" (UID: \"8cd3dcc1-5f67-4e80-a47b-9b87a534ea98\") " pod="openshift-console/console-dc75cc457-6vdb9"
Jul 15 10:47:26.228074 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:26.228027    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8cd3dcc1-5f67-4e80-a47b-9b87a534ea98-service-ca\") pod \"console-dc75cc457-6vdb9\" (UID: \"8cd3dcc1-5f67-4e80-a47b-9b87a534ea98\") " pod="openshift-console/console-dc75cc457-6vdb9"
Jul 15 10:47:26.228074 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:26.228062    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8cd3dcc1-5f67-4e80-a47b-9b87a534ea98-console-config\") pod \"console-dc75cc457-6vdb9\" (UID: \"8cd3dcc1-5f67-4e80-a47b-9b87a534ea98\") " pod="openshift-console/console-dc75cc457-6vdb9"
Jul 15 10:47:26.228248 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:26.228084    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htdj9\" (UniqueName: \"kubernetes.io/projected/8cd3dcc1-5f67-4e80-a47b-9b87a534ea98-kube-api-access-htdj9\") pod \"console-dc75cc457-6vdb9\" (UID: \"8cd3dcc1-5f67-4e80-a47b-9b87a534ea98\") " pod="openshift-console/console-dc75cc457-6vdb9"
Jul 15 10:47:26.329219 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:26.329182    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8cd3dcc1-5f67-4e80-a47b-9b87a534ea98-console-oauth-config\") pod \"console-dc75cc457-6vdb9\" (UID: \"8cd3dcc1-5f67-4e80-a47b-9b87a534ea98\") " pod="openshift-console/console-dc75cc457-6vdb9"
Jul 15 10:47:26.329219 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:26.329220    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cd3dcc1-5f67-4e80-a47b-9b87a534ea98-trusted-ca-bundle\") pod \"console-dc75cc457-6vdb9\" (UID: \"8cd3dcc1-5f67-4e80-a47b-9b87a534ea98\") " pod="openshift-console/console-dc75cc457-6vdb9"
Jul 15 10:47:26.329521 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:26.329236    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8cd3dcc1-5f67-4e80-a47b-9b87a534ea98-oauth-serving-cert\") pod \"console-dc75cc457-6vdb9\" (UID: \"8cd3dcc1-5f67-4e80-a47b-9b87a534ea98\") " pod="openshift-console/console-dc75cc457-6vdb9"
Jul 15 10:47:26.329521 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:26.329262    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8cd3dcc1-5f67-4e80-a47b-9b87a534ea98-service-ca\") pod \"console-dc75cc457-6vdb9\" (UID: \"8cd3dcc1-5f67-4e80-a47b-9b87a534ea98\") " pod="openshift-console/console-dc75cc457-6vdb9"
Jul 15 10:47:26.329521 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:26.329287    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8cd3dcc1-5f67-4e80-a47b-9b87a534ea98-console-config\") pod \"console-dc75cc457-6vdb9\" (UID: \"8cd3dcc1-5f67-4e80-a47b-9b87a534ea98\") " pod="openshift-console/console-dc75cc457-6vdb9"
Jul 15 10:47:26.329521 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:26.329302    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htdj9\" (UniqueName: \"kubernetes.io/projected/8cd3dcc1-5f67-4e80-a47b-9b87a534ea98-kube-api-access-htdj9\") pod \"console-dc75cc457-6vdb9\" (UID: \"8cd3dcc1-5f67-4e80-a47b-9b87a534ea98\") " pod="openshift-console/console-dc75cc457-6vdb9"
Jul 15 10:47:26.329521 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:26.329374    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8cd3dcc1-5f67-4e80-a47b-9b87a534ea98-console-serving-cert\") pod \"console-dc75cc457-6vdb9\" (UID: \"8cd3dcc1-5f67-4e80-a47b-9b87a534ea98\") " pod="openshift-console/console-dc75cc457-6vdb9"
Jul 15 10:47:26.330112 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:26.330084    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8cd3dcc1-5f67-4e80-a47b-9b87a534ea98-console-config\") pod \"console-dc75cc457-6vdb9\" (UID: \"8cd3dcc1-5f67-4e80-a47b-9b87a534ea98\") " pod="openshift-console/console-dc75cc457-6vdb9"
Jul 15 10:47:26.330222 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:26.330199    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8cd3dcc1-5f67-4e80-a47b-9b87a534ea98-oauth-serving-cert\") pod \"console-dc75cc457-6vdb9\" (UID: \"8cd3dcc1-5f67-4e80-a47b-9b87a534ea98\") " pod="openshift-console/console-dc75cc457-6vdb9"
Jul 15 10:47:26.330320 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:26.330299    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8cd3dcc1-5f67-4e80-a47b-9b87a534ea98-service-ca\") pod \"console-dc75cc457-6vdb9\" (UID: \"8cd3dcc1-5f67-4e80-a47b-9b87a534ea98\") " pod="openshift-console/console-dc75cc457-6vdb9"
Jul 15 10:47:26.330388 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:26.330359    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cd3dcc1-5f67-4e80-a47b-9b87a534ea98-trusted-ca-bundle\") pod \"console-dc75cc457-6vdb9\" (UID: \"8cd3dcc1-5f67-4e80-a47b-9b87a534ea98\") " pod="openshift-console/console-dc75cc457-6vdb9"
Jul 15 10:47:26.331964 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:26.331927    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8cd3dcc1-5f67-4e80-a47b-9b87a534ea98-console-oauth-config\") pod \"console-dc75cc457-6vdb9\" (UID: \"8cd3dcc1-5f67-4e80-a47b-9b87a534ea98\") " pod="openshift-console/console-dc75cc457-6vdb9"
Jul 15 10:47:26.332063 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:26.332031    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8cd3dcc1-5f67-4e80-a47b-9b87a534ea98-console-serving-cert\") pod \"console-dc75cc457-6vdb9\" (UID: \"8cd3dcc1-5f67-4e80-a47b-9b87a534ea98\") " pod="openshift-console/console-dc75cc457-6vdb9"
Jul 15 10:47:26.337837 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:26.337817    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htdj9\" (UniqueName: \"kubernetes.io/projected/8cd3dcc1-5f67-4e80-a47b-9b87a534ea98-kube-api-access-htdj9\") pod \"console-dc75cc457-6vdb9\" (UID: \"8cd3dcc1-5f67-4e80-a47b-9b87a534ea98\") " pod="openshift-console/console-dc75cc457-6vdb9"
Jul 15 10:47:26.489784 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:26.489700    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dc75cc457-6vdb9"
Jul 15 10:47:26.628466 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:26.628440    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dc75cc457-6vdb9"]
Jul 15 10:47:27.615441 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:27.615405    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dc75cc457-6vdb9" event={"ID":"8cd3dcc1-5f67-4e80-a47b-9b87a534ea98","Type":"ContainerStarted","Data":"516ad879f1d17636d5328947b194e72ab41e30e9d7f227a1d0849b534a7ba3ed"}
Jul 15 10:47:27.615834 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:27.615455    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dc75cc457-6vdb9" event={"ID":"8cd3dcc1-5f67-4e80-a47b-9b87a534ea98","Type":"ContainerStarted","Data":"f0b7fd40e44404ed6bc09720f197328dc30e3243782c3d5752582f3922690f9c"}
Jul 15 10:47:27.634469 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:27.634417    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-dc75cc457-6vdb9" podStartSLOduration=1.634401958 podStartE2EDuration="1.634401958s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:47:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:47:27.633536951 +0000 UTC m=+145.242072974" watchObservedRunningTime="2026-07-15 10:47:27.634401958 +0000 UTC m=+145.242937980"
Jul 15 10:47:35.960446 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:35.960395    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7c875865b-2sfdx" podUID="fb687929-8af4-470e-8679-26c69f00ca68" containerName="registry" containerID="cri-o://a826862e8a60c5ad31b3e4d0d3b7b780ae1551e01059f76044f655469b2fa3c5" gracePeriod=30
Jul 15 10:47:36.213955 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:36.213890    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c875865b-2sfdx"
Jul 15 10:47:36.317879 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:36.317848    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fb687929-8af4-470e-8679-26c69f00ca68-bound-sa-token\") pod \"fb687929-8af4-470e-8679-26c69f00ca68\" (UID: \"fb687929-8af4-470e-8679-26c69f00ca68\") "
Jul 15 10:47:36.317879 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:36.317881    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fb687929-8af4-470e-8679-26c69f00ca68-registry-certificates\") pod \"fb687929-8af4-470e-8679-26c69f00ca68\" (UID: \"fb687929-8af4-470e-8679-26c69f00ca68\") "
Jul 15 10:47:36.318132 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:36.317899    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fb687929-8af4-470e-8679-26c69f00ca68-trusted-ca\") pod \"fb687929-8af4-470e-8679-26c69f00ca68\" (UID: \"fb687929-8af4-470e-8679-26c69f00ca68\") "
Jul 15 10:47:36.318132 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:36.317920    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fb687929-8af4-470e-8679-26c69f00ca68-image-registry-private-configuration\") pod \"fb687929-8af4-470e-8679-26c69f00ca68\" (UID: \"fb687929-8af4-470e-8679-26c69f00ca68\") "
Jul 15 10:47:36.318132 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:36.317944    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fb687929-8af4-470e-8679-26c69f00ca68-installation-pull-secrets\") pod \"fb687929-8af4-470e-8679-26c69f00ca68\" (UID: \"fb687929-8af4-470e-8679-26c69f00ca68\") "
Jul 15 10:47:36.318132 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:36.317976    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fb687929-8af4-470e-8679-26c69f00ca68-registry-tls\") pod \"fb687929-8af4-470e-8679-26c69f00ca68\" (UID: \"fb687929-8af4-470e-8679-26c69f00ca68\") "
Jul 15 10:47:36.318305 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:36.318173    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fb687929-8af4-470e-8679-26c69f00ca68-ca-trust-extracted\") pod \"fb687929-8af4-470e-8679-26c69f00ca68\" (UID: \"fb687929-8af4-470e-8679-26c69f00ca68\") "
Jul 15 10:47:36.318305 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:36.318220    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lb5zw\" (UniqueName: \"kubernetes.io/projected/fb687929-8af4-470e-8679-26c69f00ca68-kube-api-access-lb5zw\") pod \"fb687929-8af4-470e-8679-26c69f00ca68\" (UID: \"fb687929-8af4-470e-8679-26c69f00ca68\") "
Jul 15 10:47:36.319488 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:36.319293    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb687929-8af4-470e-8679-26c69f00ca68-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "fb687929-8af4-470e-8679-26c69f00ca68" (UID: "fb687929-8af4-470e-8679-26c69f00ca68"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:47:36.319803 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:36.319769    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb687929-8af4-470e-8679-26c69f00ca68-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "fb687929-8af4-470e-8679-26c69f00ca68" (UID: "fb687929-8af4-470e-8679-26c69f00ca68"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:47:36.321254 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:36.321200    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb687929-8af4-470e-8679-26c69f00ca68-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "fb687929-8af4-470e-8679-26c69f00ca68" (UID: "fb687929-8af4-470e-8679-26c69f00ca68"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 10:47:36.321459 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:36.321414    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb687929-8af4-470e-8679-26c69f00ca68-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "fb687929-8af4-470e-8679-26c69f00ca68" (UID: "fb687929-8af4-470e-8679-26c69f00ca68"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 10:47:36.321459 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:36.321429    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb687929-8af4-470e-8679-26c69f00ca68-kube-api-access-lb5zw" (OuterVolumeSpecName: "kube-api-access-lb5zw") pod "fb687929-8af4-470e-8679-26c69f00ca68" (UID: "fb687929-8af4-470e-8679-26c69f00ca68"). InnerVolumeSpecName "kube-api-access-lb5zw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 10:47:36.321928 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:36.321896    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb687929-8af4-470e-8679-26c69f00ca68-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "fb687929-8af4-470e-8679-26c69f00ca68" (UID: "fb687929-8af4-470e-8679-26c69f00ca68"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 10:47:36.322176 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:36.322160    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb687929-8af4-470e-8679-26c69f00ca68-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "fb687929-8af4-470e-8679-26c69f00ca68" (UID: "fb687929-8af4-470e-8679-26c69f00ca68"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 10:47:36.327526 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:36.327497    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb687929-8af4-470e-8679-26c69f00ca68-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "fb687929-8af4-470e-8679-26c69f00ca68" (UID: "fb687929-8af4-470e-8679-26c69f00ca68"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:47:36.419586 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:36.419547    2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fb687929-8af4-470e-8679-26c69f00ca68-registry-certificates\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:47:36.419586 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:36.419577    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fb687929-8af4-470e-8679-26c69f00ca68-trusted-ca\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:47:36.419586 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:36.419587    2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fb687929-8af4-470e-8679-26c69f00ca68-image-registry-private-configuration\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:47:36.419586 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:36.419596    2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fb687929-8af4-470e-8679-26c69f00ca68-installation-pull-secrets\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:47:36.419837 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:36.419604    2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fb687929-8af4-470e-8679-26c69f00ca68-registry-tls\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:47:36.419837 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:36.419625    2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fb687929-8af4-470e-8679-26c69f00ca68-ca-trust-extracted\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:47:36.419837 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:36.419634    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lb5zw\" (UniqueName: \"kubernetes.io/projected/fb687929-8af4-470e-8679-26c69f00ca68-kube-api-access-lb5zw\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:47:36.419837 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:36.419642    2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fb687929-8af4-470e-8679-26c69f00ca68-bound-sa-token\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:47:36.490505 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:36.490429    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-dc75cc457-6vdb9"
Jul 15 10:47:36.490730 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:36.490711    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-dc75cc457-6vdb9"
Jul 15 10:47:36.495393 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:36.495372    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-dc75cc457-6vdb9"
Jul 15 10:47:36.659079 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:36.659040    2565 generic.go:356] "Generic (PLEG): container finished" podID="fb687929-8af4-470e-8679-26c69f00ca68" containerID="a826862e8a60c5ad31b3e4d0d3b7b780ae1551e01059f76044f655469b2fa3c5" exitCode=0
Jul 15 10:47:36.659259 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:36.659086    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c875865b-2sfdx"
Jul 15 10:47:36.659259 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:36.659131    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c875865b-2sfdx" event={"ID":"fb687929-8af4-470e-8679-26c69f00ca68","Type":"ContainerDied","Data":"a826862e8a60c5ad31b3e4d0d3b7b780ae1551e01059f76044f655469b2fa3c5"}
Jul 15 10:47:36.659259 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:36.659176    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c875865b-2sfdx" event={"ID":"fb687929-8af4-470e-8679-26c69f00ca68","Type":"ContainerDied","Data":"affe143674e6f717ddb0e60048daebf56d6930ecf9775d8a222cfffa6156fa92"}
Jul 15 10:47:36.659259 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:36.659196    2565 scope.go:117] "RemoveContainer" containerID="a826862e8a60c5ad31b3e4d0d3b7b780ae1551e01059f76044f655469b2fa3c5"
Jul 15 10:47:36.663746 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:36.663724    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-dc75cc457-6vdb9"
Jul 15 10:47:36.668606 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:36.668590    2565 scope.go:117] "RemoveContainer" containerID="a826862e8a60c5ad31b3e4d0d3b7b780ae1551e01059f76044f655469b2fa3c5"
Jul 15 10:47:36.668864 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:47:36.668847    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a826862e8a60c5ad31b3e4d0d3b7b780ae1551e01059f76044f655469b2fa3c5\": container with ID starting with a826862e8a60c5ad31b3e4d0d3b7b780ae1551e01059f76044f655469b2fa3c5 not found: ID does not exist" containerID="a826862e8a60c5ad31b3e4d0d3b7b780ae1551e01059f76044f655469b2fa3c5"
Jul 15 10:47:36.668921 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:36.668871    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a826862e8a60c5ad31b3e4d0d3b7b780ae1551e01059f76044f655469b2fa3c5"} err="failed to get container status \"a826862e8a60c5ad31b3e4d0d3b7b780ae1551e01059f76044f655469b2fa3c5\": rpc error: code = NotFound desc = could not find container \"a826862e8a60c5ad31b3e4d0d3b7b780ae1551e01059f76044f655469b2fa3c5\": container with ID starting with a826862e8a60c5ad31b3e4d0d3b7b780ae1551e01059f76044f655469b2fa3c5 not found: ID does not exist"
Jul 15 10:47:36.699265 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:36.699234    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c875865b-2sfdx"]
Jul 15 10:47:36.706293 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:36.706269    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7c875865b-2sfdx"]
Jul 15 10:47:36.713770 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:36.713739    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65f65c77d-ldjd9"]
Jul 15 10:47:36.822385 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:36.822356    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:47:36.923497 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:36.923465    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:47:36.925011 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:36.924986    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb687929-8af4-470e-8679-26c69f00ca68" path="/var/lib/kubelet/pods/fb687929-8af4-470e-8679-26c69f00ca68/volumes"
Jul 15 10:47:36.990083 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:36.990050    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:47:38.497352 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:38.497293    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-584d8d9b95-kktf5"
Jul 15 10:47:38.497727 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:38.497372    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-584d8d9b95-kktf5"
Jul 15 10:47:45.703268 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:45.703232    2565 generic.go:356] "Generic (PLEG): container finished" podID="7dcd6c11-9e60-45e9-9d89-dae4e2594c7f" containerID="4289697ff6087eddf1af5db6e52d1f0263740564a764c53f076a95797054bf39" exitCode=0
Jul 15 10:47:45.703693 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:45.703301    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-n7jtx" event={"ID":"7dcd6c11-9e60-45e9-9d89-dae4e2594c7f","Type":"ContainerDied","Data":"4289697ff6087eddf1af5db6e52d1f0263740564a764c53f076a95797054bf39"}
Jul 15 10:47:45.703693 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:45.703635    2565 scope.go:117] "RemoveContainer" containerID="4289697ff6087eddf1af5db6e52d1f0263740564a764c53f076a95797054bf39"
Jul 15 10:47:46.709733 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:46.709695    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-n7jtx" event={"ID":"7dcd6c11-9e60-45e9-9d89-dae4e2594c7f","Type":"ContainerStarted","Data":"33ee371e22858969ad0a8b17582a14afc557c8795e3b382ffb1e6a90e1f81f1e"}
Jul 15 10:47:58.503306 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:58.503218    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-584d8d9b95-kktf5"
Jul 15 10:47:58.506871 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:47:58.506849    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-584d8d9b95-kktf5"
Jul 15 10:48:01.737204 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:01.737164    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-65f65c77d-ldjd9" podUID="8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e" containerName="console" containerID="cri-o://fa992cf9f7d146f3281fc6cec28258ac95fa4d65a44ee6057c83794053b3b086" gracePeriod=15
Jul 15 10:48:02.002501 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:02.002472    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65f65c77d-ldjd9"
Jul 15 10:48:02.151282 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:02.151244    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hdbm\" (UniqueName: \"kubernetes.io/projected/8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e-kube-api-access-6hdbm\") pod \"8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e\" (UID: \"8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e\") "
Jul 15 10:48:02.151498 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:02.151305    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e-console-serving-cert\") pod \"8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e\" (UID: \"8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e\") "
Jul 15 10:48:02.151498 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:02.151361    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e-oauth-serving-cert\") pod \"8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e\" (UID: \"8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e\") "
Jul 15 10:48:02.151498 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:02.151385    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e-console-config\") pod \"8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e\" (UID: \"8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e\") "
Jul 15 10:48:02.151498 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:02.151418    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e-console-oauth-config\") pod \"8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e\" (UID: \"8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e\") "
Jul 15 10:48:02.151498 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:02.151479    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e-service-ca\") pod \"8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e\" (UID: \"8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e\") "
Jul 15 10:48:02.151766 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:02.151506    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e-trusted-ca-bundle\") pod \"8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e\" (UID: \"8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e\") "
Jul 15 10:48:02.151857 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:02.151809    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e" (UID: "8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:48:02.151857 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:02.151827    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e-console-config" (OuterVolumeSpecName: "console-config") pod "8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e" (UID: "8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:48:02.151857 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:02.151954    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e-service-ca" (OuterVolumeSpecName: "service-ca") pod "8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e" (UID: "8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:48:02.152164 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:02.152046    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e" (UID: "8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:48:02.153773 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:02.153748    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e" (UID: "8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 10:48:02.154186 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:02.154158    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e" (UID: "8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 10:48:02.154186 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:02.154176    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e-kube-api-access-6hdbm" (OuterVolumeSpecName: "kube-api-access-6hdbm") pod "8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e" (UID: "8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e"). InnerVolumeSpecName "kube-api-access-6hdbm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 10:48:02.253070 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:02.252970    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e-oauth-serving-cert\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:48:02.253070 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:02.253007    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e-console-config\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:48:02.253070 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:02.253020    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e-console-oauth-config\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:48:02.253070 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:02.253033    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e-service-ca\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:48:02.253070 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:02.253045    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e-trusted-ca-bundle\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:48:02.253070 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:02.253057    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hdbm\" (UniqueName: \"kubernetes.io/projected/8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e-kube-api-access-6hdbm\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:48:02.253070 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:02.253070    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e-console-serving-cert\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:48:02.771074 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:02.771034    2565 generic.go:356] "Generic (PLEG): container finished" podID="8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e" containerID="fa992cf9f7d146f3281fc6cec28258ac95fa4d65a44ee6057c83794053b3b086" exitCode=0
Jul 15 10:48:02.771496 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:02.771100    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65f65c77d-ldjd9"
Jul 15 10:48:02.771496 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:02.771132    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65f65c77d-ldjd9" event={"ID":"8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e","Type":"ContainerDied","Data":"fa992cf9f7d146f3281fc6cec28258ac95fa4d65a44ee6057c83794053b3b086"}
Jul 15 10:48:02.771496 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:02.771219    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65f65c77d-ldjd9" event={"ID":"8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e","Type":"ContainerDied","Data":"b1e3c4f2c81515505ad4b2305d1e112a2a81d4a4721089c34086dfa613ebe989"}
Jul 15 10:48:02.771496 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:02.771247    2565 scope.go:117] "RemoveContainer" containerID="fa992cf9f7d146f3281fc6cec28258ac95fa4d65a44ee6057c83794053b3b086"
Jul 15 10:48:02.780174 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:02.780156    2565 scope.go:117] "RemoveContainer" containerID="fa992cf9f7d146f3281fc6cec28258ac95fa4d65a44ee6057c83794053b3b086"
Jul 15 10:48:02.780531 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:48:02.780513    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa992cf9f7d146f3281fc6cec28258ac95fa4d65a44ee6057c83794053b3b086\": container with ID starting with fa992cf9f7d146f3281fc6cec28258ac95fa4d65a44ee6057c83794053b3b086 not found: ID does not exist" containerID="fa992cf9f7d146f3281fc6cec28258ac95fa4d65a44ee6057c83794053b3b086"
Jul 15 10:48:02.780605 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:02.780543    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa992cf9f7d146f3281fc6cec28258ac95fa4d65a44ee6057c83794053b3b086"} err="failed to get container status \"fa992cf9f7d146f3281fc6cec28258ac95fa4d65a44ee6057c83794053b3b086\": rpc error: code = NotFound desc = could not find container \"fa992cf9f7d146f3281fc6cec28258ac95fa4d65a44ee6057c83794053b3b086\": container with ID starting with fa992cf9f7d146f3281fc6cec28258ac95fa4d65a44ee6057c83794053b3b086 not found: ID does not exist"
Jul 15 10:48:02.793279 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:02.793245    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65f65c77d-ldjd9"]
Jul 15 10:48:02.798453 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:02.798422    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65f65c77d-ldjd9"]
Jul 15 10:48:02.924346 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:02.924282    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e" path="/var/lib/kubelet/pods/8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e/volumes"
Jul 15 10:48:29.623967 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:29.623926    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:48:29.683614 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:29.683576    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:48:33.929532 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:33.929493    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 10:48:33.929998 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:33.929790    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="62162859-ec3c-4d0c-84af-3668b92739ca" containerName="alertmanager" containerID="cri-o://bb9c1ab7e4760e65ab330138490a48cee3a230b2647df956b568abdcb2069a5c" gracePeriod=120
Jul 15 10:48:33.929998 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:33.929871    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="62162859-ec3c-4d0c-84af-3668b92739ca" containerName="kube-rbac-proxy-metric" containerID="cri-o://efe5a4ede43b557d2fe7ad90da813adb72b62441dde8910044165f66c619c2de" gracePeriod=120
Jul 15 10:48:33.929998 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:33.929874    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="62162859-ec3c-4d0c-84af-3668b92739ca" containerName="kube-rbac-proxy-web" containerID="cri-o://ffde0474f853453dd32cd8dca4ecf48df661927a0ddf86c43522c6ae831ab511" gracePeriod=120
Jul 15 10:48:33.929998 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:33.929903    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="62162859-ec3c-4d0c-84af-3668b92739ca" containerName="kube-rbac-proxy" containerID="cri-o://b738a44e9a92fa3c4a03b88f8b83b0e4757f91d6addd8362892c01bb5b01848a" gracePeriod=120
Jul 15 10:48:33.929998 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:33.929965    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="62162859-ec3c-4d0c-84af-3668b92739ca" containerName="prom-label-proxy" containerID="cri-o://0708322e65968b04ff8d220ee73a58c147acc4c67611e550d913368ad73c00c8" gracePeriod=120
Jul 15 10:48:33.930240 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:33.929900    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="62162859-ec3c-4d0c-84af-3668b92739ca" containerName="config-reloader" containerID="cri-o://b31d0ffe69b41276c696c25d2cdd06fd0a2a60dc836a2d334a230c546d6b0e78" gracePeriod=120
Jul 15 10:48:34.900697 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:34.900661    2565 generic.go:356] "Generic (PLEG): container finished" podID="62162859-ec3c-4d0c-84af-3668b92739ca" containerID="0708322e65968b04ff8d220ee73a58c147acc4c67611e550d913368ad73c00c8" exitCode=0
Jul 15 10:48:34.900697 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:34.900688    2565 generic.go:356] "Generic (PLEG): container finished" podID="62162859-ec3c-4d0c-84af-3668b92739ca" containerID="b738a44e9a92fa3c4a03b88f8b83b0e4757f91d6addd8362892c01bb5b01848a" exitCode=0
Jul 15 10:48:34.900697 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:34.900695    2565 generic.go:356] "Generic (PLEG): container finished" podID="62162859-ec3c-4d0c-84af-3668b92739ca" containerID="b31d0ffe69b41276c696c25d2cdd06fd0a2a60dc836a2d334a230c546d6b0e78" exitCode=0
Jul 15 10:48:34.900697 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:34.900702    2565 generic.go:356] "Generic (PLEG): container finished" podID="62162859-ec3c-4d0c-84af-3668b92739ca" containerID="bb9c1ab7e4760e65ab330138490a48cee3a230b2647df956b568abdcb2069a5c" exitCode=0
Jul 15 10:48:34.900971 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:34.900731    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62162859-ec3c-4d0c-84af-3668b92739ca","Type":"ContainerDied","Data":"0708322e65968b04ff8d220ee73a58c147acc4c67611e550d913368ad73c00c8"}
Jul 15 10:48:34.900971 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:34.900826    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62162859-ec3c-4d0c-84af-3668b92739ca","Type":"ContainerDied","Data":"b738a44e9a92fa3c4a03b88f8b83b0e4757f91d6addd8362892c01bb5b01848a"}
Jul 15 10:48:34.900971 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:34.900854    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62162859-ec3c-4d0c-84af-3668b92739ca","Type":"ContainerDied","Data":"b31d0ffe69b41276c696c25d2cdd06fd0a2a60dc836a2d334a230c546d6b0e78"}
Jul 15 10:48:34.900971 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:34.900878    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62162859-ec3c-4d0c-84af-3668b92739ca","Type":"ContainerDied","Data":"bb9c1ab7e4760e65ab330138490a48cee3a230b2647df956b568abdcb2069a5c"}
Jul 15 10:48:35.184697 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.184667    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:48:35.330517 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.330481    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62162859-ec3c-4d0c-84af-3668b92739ca-alertmanager-trusted-ca-bundle\") pod \"62162859-ec3c-4d0c-84af-3668b92739ca\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") "
Jul 15 10:48:35.330517 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.330522    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/62162859-ec3c-4d0c-84af-3668b92739ca-secret-alertmanager-kube-rbac-proxy-metric\") pod \"62162859-ec3c-4d0c-84af-3668b92739ca\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") "
Jul 15 10:48:35.330729 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.330551    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62162859-ec3c-4d0c-84af-3668b92739ca-metrics-client-ca\") pod \"62162859-ec3c-4d0c-84af-3668b92739ca\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") "
Jul 15 10:48:35.330729 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.330572    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62162859-ec3c-4d0c-84af-3668b92739ca-secret-alertmanager-kube-rbac-proxy-web\") pod \"62162859-ec3c-4d0c-84af-3668b92739ca\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") "
Jul 15 10:48:35.330729 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.330699    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/62162859-ec3c-4d0c-84af-3668b92739ca-config-out\") pod \"62162859-ec3c-4d0c-84af-3668b92739ca\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") "
Jul 15 10:48:35.330876 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.330755    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/62162859-ec3c-4d0c-84af-3668b92739ca-config-volume\") pod \"62162859-ec3c-4d0c-84af-3668b92739ca\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") "
Jul 15 10:48:35.330876 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.330796    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/62162859-ec3c-4d0c-84af-3668b92739ca-secret-alertmanager-main-tls\") pod \"62162859-ec3c-4d0c-84af-3668b92739ca\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") "
Jul 15 10:48:35.330876 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.330823    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/62162859-ec3c-4d0c-84af-3668b92739ca-alertmanager-main-db\") pod \"62162859-ec3c-4d0c-84af-3668b92739ca\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") "
Jul 15 10:48:35.330876 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.330852    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62162859-ec3c-4d0c-84af-3668b92739ca-secret-alertmanager-kube-rbac-proxy\") pod \"62162859-ec3c-4d0c-84af-3668b92739ca\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") "
Jul 15 10:48:35.331089 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.330892    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/62162859-ec3c-4d0c-84af-3668b92739ca-tls-assets\") pod \"62162859-ec3c-4d0c-84af-3668b92739ca\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") "
Jul 15 10:48:35.331089 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.330923    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/62162859-ec3c-4d0c-84af-3668b92739ca-web-config\") pod \"62162859-ec3c-4d0c-84af-3668b92739ca\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") "
Jul 15 10:48:35.331089 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.330954    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvfhq\" (UniqueName: \"kubernetes.io/projected/62162859-ec3c-4d0c-84af-3668b92739ca-kube-api-access-fvfhq\") pod \"62162859-ec3c-4d0c-84af-3668b92739ca\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") "
Jul 15 10:48:35.331089 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.330971    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62162859-ec3c-4d0c-84af-3668b92739ca-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "62162859-ec3c-4d0c-84af-3668b92739ca" (UID: "62162859-ec3c-4d0c-84af-3668b92739ca"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:48:35.331089 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.330969    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62162859-ec3c-4d0c-84af-3668b92739ca-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "62162859-ec3c-4d0c-84af-3668b92739ca" (UID: "62162859-ec3c-4d0c-84af-3668b92739ca"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:48:35.331089 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.330988    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/62162859-ec3c-4d0c-84af-3668b92739ca-cluster-tls-config\") pod \"62162859-ec3c-4d0c-84af-3668b92739ca\" (UID: \"62162859-ec3c-4d0c-84af-3668b92739ca\") "
Jul 15 10:48:35.331435 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.331299    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62162859-ec3c-4d0c-84af-3668b92739ca-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "62162859-ec3c-4d0c-84af-3668b92739ca" (UID: "62162859-ec3c-4d0c-84af-3668b92739ca"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:48:35.331435 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.331301    2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62162859-ec3c-4d0c-84af-3668b92739ca-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:48:35.331435 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.331381    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62162859-ec3c-4d0c-84af-3668b92739ca-metrics-client-ca\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:48:35.333667 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.333374    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62162859-ec3c-4d0c-84af-3668b92739ca-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "62162859-ec3c-4d0c-84af-3668b92739ca" (UID: "62162859-ec3c-4d0c-84af-3668b92739ca"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 10:48:35.333667 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.333538    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62162859-ec3c-4d0c-84af-3668b92739ca-config-out" (OuterVolumeSpecName: "config-out") pod "62162859-ec3c-4d0c-84af-3668b92739ca" (UID: "62162859-ec3c-4d0c-84af-3668b92739ca"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:48:35.334270 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.334239    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62162859-ec3c-4d0c-84af-3668b92739ca-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "62162859-ec3c-4d0c-84af-3668b92739ca" (UID: "62162859-ec3c-4d0c-84af-3668b92739ca"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 10:48:35.334445 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.334417    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62162859-ec3c-4d0c-84af-3668b92739ca-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "62162859-ec3c-4d0c-84af-3668b92739ca" (UID: "62162859-ec3c-4d0c-84af-3668b92739ca"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 10:48:35.334771 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.334745    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62162859-ec3c-4d0c-84af-3668b92739ca-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "62162859-ec3c-4d0c-84af-3668b92739ca" (UID: "62162859-ec3c-4d0c-84af-3668b92739ca"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 10:48:35.334839 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.334762    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62162859-ec3c-4d0c-84af-3668b92739ca-config-volume" (OuterVolumeSpecName: "config-volume") pod "62162859-ec3c-4d0c-84af-3668b92739ca" (UID: "62162859-ec3c-4d0c-84af-3668b92739ca"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 10:48:35.335644 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.335620    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62162859-ec3c-4d0c-84af-3668b92739ca-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "62162859-ec3c-4d0c-84af-3668b92739ca" (UID: "62162859-ec3c-4d0c-84af-3668b92739ca"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 10:48:35.335717 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.335690    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62162859-ec3c-4d0c-84af-3668b92739ca-kube-api-access-fvfhq" (OuterVolumeSpecName: "kube-api-access-fvfhq") pod "62162859-ec3c-4d0c-84af-3668b92739ca" (UID: "62162859-ec3c-4d0c-84af-3668b92739ca"). InnerVolumeSpecName "kube-api-access-fvfhq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 10:48:35.338932 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.338913    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62162859-ec3c-4d0c-84af-3668b92739ca-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "62162859-ec3c-4d0c-84af-3668b92739ca" (UID: "62162859-ec3c-4d0c-84af-3668b92739ca"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 10:48:35.345746 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.345725    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62162859-ec3c-4d0c-84af-3668b92739ca-web-config" (OuterVolumeSpecName: "web-config") pod "62162859-ec3c-4d0c-84af-3668b92739ca" (UID: "62162859-ec3c-4d0c-84af-3668b92739ca"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 10:48:35.432586 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.432505    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62162859-ec3c-4d0c-84af-3668b92739ca-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:48:35.432586 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.432533    2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/62162859-ec3c-4d0c-84af-3668b92739ca-config-out\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:48:35.432586 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.432543    2565 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/62162859-ec3c-4d0c-84af-3668b92739ca-config-volume\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:48:35.432586 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.432553    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/62162859-ec3c-4d0c-84af-3668b92739ca-secret-alertmanager-main-tls\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:48:35.432586 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.432561    2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/62162859-ec3c-4d0c-84af-3668b92739ca-alertmanager-main-db\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:48:35.432586 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.432571    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62162859-ec3c-4d0c-84af-3668b92739ca-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:48:35.432586 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.432580    2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/62162859-ec3c-4d0c-84af-3668b92739ca-tls-assets\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:48:35.432586 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.432589    2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/62162859-ec3c-4d0c-84af-3668b92739ca-web-config\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:48:35.432930 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.432596    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvfhq\" (UniqueName: \"kubernetes.io/projected/62162859-ec3c-4d0c-84af-3668b92739ca-kube-api-access-fvfhq\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:48:35.432930 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.432604    2565 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/62162859-ec3c-4d0c-84af-3668b92739ca-cluster-tls-config\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:48:35.432930 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.432612    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/62162859-ec3c-4d0c-84af-3668b92739ca-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:48:35.907620 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.907584    2565 generic.go:356] "Generic (PLEG): container finished" podID="62162859-ec3c-4d0c-84af-3668b92739ca" containerID="efe5a4ede43b557d2fe7ad90da813adb72b62441dde8910044165f66c619c2de" exitCode=0
Jul 15 10:48:35.907620 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.907611    2565 generic.go:356] "Generic (PLEG): container finished" podID="62162859-ec3c-4d0c-84af-3668b92739ca" containerID="ffde0474f853453dd32cd8dca4ecf48df661927a0ddf86c43522c6ae831ab511" exitCode=0
Jul 15 10:48:35.907795 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.907635    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62162859-ec3c-4d0c-84af-3668b92739ca","Type":"ContainerDied","Data":"efe5a4ede43b557d2fe7ad90da813adb72b62441dde8910044165f66c619c2de"}
Jul 15 10:48:35.907795 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.907666    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:48:35.907795 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.907696    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62162859-ec3c-4d0c-84af-3668b92739ca","Type":"ContainerDied","Data":"ffde0474f853453dd32cd8dca4ecf48df661927a0ddf86c43522c6ae831ab511"}
Jul 15 10:48:35.907795 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.907726    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62162859-ec3c-4d0c-84af-3668b92739ca","Type":"ContainerDied","Data":"d00648242c8c79570a4a8650419b31458599aa465009b62f23427fc4dded865d"}
Jul 15 10:48:35.907795 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.907757    2565 scope.go:117] "RemoveContainer" containerID="0708322e65968b04ff8d220ee73a58c147acc4c67611e550d913368ad73c00c8"
Jul 15 10:48:35.916744 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.916723    2565 scope.go:117] "RemoveContainer" containerID="efe5a4ede43b557d2fe7ad90da813adb72b62441dde8910044165f66c619c2de"
Jul 15 10:48:35.926099 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.926075    2565 scope.go:117] "RemoveContainer" containerID="b738a44e9a92fa3c4a03b88f8b83b0e4757f91d6addd8362892c01bb5b01848a"
Jul 15 10:48:35.932956 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.932933    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 10:48:35.933967 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.933953    2565 scope.go:117] "RemoveContainer" containerID="ffde0474f853453dd32cd8dca4ecf48df661927a0ddf86c43522c6ae831ab511"
Jul 15 10:48:35.938131 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.938108    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 10:48:35.941454 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.941435    2565 scope.go:117] "RemoveContainer" containerID="b31d0ffe69b41276c696c25d2cdd06fd0a2a60dc836a2d334a230c546d6b0e78"
Jul 15 10:48:35.948379 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.948363    2565 scope.go:117] "RemoveContainer" containerID="bb9c1ab7e4760e65ab330138490a48cee3a230b2647df956b568abdcb2069a5c"
Jul 15 10:48:35.955831 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.955746    2565 scope.go:117] "RemoveContainer" containerID="3a6e35e2d145cf48997f91f634e91788a19bb9e06f73660025e7b02535f4bbfa"
Jul 15 10:48:35.962811 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.962780    2565 scope.go:117] "RemoveContainer" containerID="0708322e65968b04ff8d220ee73a58c147acc4c67611e550d913368ad73c00c8"
Jul 15 10:48:35.963085 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:48:35.963060    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0708322e65968b04ff8d220ee73a58c147acc4c67611e550d913368ad73c00c8\": container with ID starting with 0708322e65968b04ff8d220ee73a58c147acc4c67611e550d913368ad73c00c8 not found: ID does not exist" containerID="0708322e65968b04ff8d220ee73a58c147acc4c67611e550d913368ad73c00c8"
Jul 15 10:48:35.963210 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.963100    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0708322e65968b04ff8d220ee73a58c147acc4c67611e550d913368ad73c00c8"} err="failed to get container status \"0708322e65968b04ff8d220ee73a58c147acc4c67611e550d913368ad73c00c8\": rpc error: code = NotFound desc = could not find container \"0708322e65968b04ff8d220ee73a58c147acc4c67611e550d913368ad73c00c8\": container with ID starting with 0708322e65968b04ff8d220ee73a58c147acc4c67611e550d913368ad73c00c8 not found: ID does not exist"
Jul 15 10:48:35.963210 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.963120    2565 scope.go:117] "RemoveContainer" containerID="efe5a4ede43b557d2fe7ad90da813adb72b62441dde8910044165f66c619c2de"
Jul 15 10:48:35.963665 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:48:35.963560    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efe5a4ede43b557d2fe7ad90da813adb72b62441dde8910044165f66c619c2de\": container with ID starting with efe5a4ede43b557d2fe7ad90da813adb72b62441dde8910044165f66c619c2de not found: ID does not exist" containerID="efe5a4ede43b557d2fe7ad90da813adb72b62441dde8910044165f66c619c2de"
Jul 15 10:48:35.963665 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.963607    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efe5a4ede43b557d2fe7ad90da813adb72b62441dde8910044165f66c619c2de"} err="failed to get container status \"efe5a4ede43b557d2fe7ad90da813adb72b62441dde8910044165f66c619c2de\": rpc error: code = NotFound desc = could not find container \"efe5a4ede43b557d2fe7ad90da813adb72b62441dde8910044165f66c619c2de\": container with ID starting with efe5a4ede43b557d2fe7ad90da813adb72b62441dde8910044165f66c619c2de not found: ID does not exist"
Jul 15 10:48:35.963665 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.963633    2565 scope.go:117] "RemoveContainer" containerID="b738a44e9a92fa3c4a03b88f8b83b0e4757f91d6addd8362892c01bb5b01848a"
Jul 15 10:48:35.964080 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:48:35.964055    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b738a44e9a92fa3c4a03b88f8b83b0e4757f91d6addd8362892c01bb5b01848a\": container with ID starting with b738a44e9a92fa3c4a03b88f8b83b0e4757f91d6addd8362892c01bb5b01848a not found: ID does not exist" containerID="b738a44e9a92fa3c4a03b88f8b83b0e4757f91d6addd8362892c01bb5b01848a"
Jul 15 10:48:35.964154 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.964089    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b738a44e9a92fa3c4a03b88f8b83b0e4757f91d6addd8362892c01bb5b01848a"} err="failed to get container status \"b738a44e9a92fa3c4a03b88f8b83b0e4757f91d6addd8362892c01bb5b01848a\": rpc error: code = NotFound desc = could not find container \"b738a44e9a92fa3c4a03b88f8b83b0e4757f91d6addd8362892c01bb5b01848a\": container with ID starting with b738a44e9a92fa3c4a03b88f8b83b0e4757f91d6addd8362892c01bb5b01848a not found: ID does not exist"
Jul 15 10:48:35.964154 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.964110    2565 scope.go:117] "RemoveContainer" containerID="ffde0474f853453dd32cd8dca4ecf48df661927a0ddf86c43522c6ae831ab511"
Jul 15 10:48:35.964700 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:48:35.964667    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffde0474f853453dd32cd8dca4ecf48df661927a0ddf86c43522c6ae831ab511\": container with ID starting with ffde0474f853453dd32cd8dca4ecf48df661927a0ddf86c43522c6ae831ab511 not found: ID does not exist" containerID="ffde0474f853453dd32cd8dca4ecf48df661927a0ddf86c43522c6ae831ab511"
Jul 15 10:48:35.964774 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.964708    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffde0474f853453dd32cd8dca4ecf48df661927a0ddf86c43522c6ae831ab511"} err="failed to get container status \"ffde0474f853453dd32cd8dca4ecf48df661927a0ddf86c43522c6ae831ab511\": rpc error: code = NotFound desc = could not find container \"ffde0474f853453dd32cd8dca4ecf48df661927a0ddf86c43522c6ae831ab511\": container with ID starting with ffde0474f853453dd32cd8dca4ecf48df661927a0ddf86c43522c6ae831ab511 not found: ID does not exist"
Jul 15 10:48:35.964774 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.964730    2565 scope.go:117] "RemoveContainer" containerID="b31d0ffe69b41276c696c25d2cdd06fd0a2a60dc836a2d334a230c546d6b0e78"
Jul 15 10:48:35.965006 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:48:35.964988    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b31d0ffe69b41276c696c25d2cdd06fd0a2a60dc836a2d334a230c546d6b0e78\": container with ID starting with b31d0ffe69b41276c696c25d2cdd06fd0a2a60dc836a2d334a230c546d6b0e78 not found: ID does not exist" containerID="b31d0ffe69b41276c696c25d2cdd06fd0a2a60dc836a2d334a230c546d6b0e78"
Jul 15 10:48:35.965047 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.965012    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b31d0ffe69b41276c696c25d2cdd06fd0a2a60dc836a2d334a230c546d6b0e78"} err="failed to get container status \"b31d0ffe69b41276c696c25d2cdd06fd0a2a60dc836a2d334a230c546d6b0e78\": rpc error: code = NotFound desc = could not find container \"b31d0ffe69b41276c696c25d2cdd06fd0a2a60dc836a2d334a230c546d6b0e78\": container with ID starting with b31d0ffe69b41276c696c25d2cdd06fd0a2a60dc836a2d334a230c546d6b0e78 not found: ID does not exist"
Jul 15 10:48:35.965047 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.965027    2565 scope.go:117] "RemoveContainer" containerID="bb9c1ab7e4760e65ab330138490a48cee3a230b2647df956b568abdcb2069a5c"
Jul 15 10:48:35.965263 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:48:35.965243    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb9c1ab7e4760e65ab330138490a48cee3a230b2647df956b568abdcb2069a5c\": container with ID starting with bb9c1ab7e4760e65ab330138490a48cee3a230b2647df956b568abdcb2069a5c not found: ID does not exist" containerID="bb9c1ab7e4760e65ab330138490a48cee3a230b2647df956b568abdcb2069a5c"
Jul 15 10:48:35.965360 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.965270    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb9c1ab7e4760e65ab330138490a48cee3a230b2647df956b568abdcb2069a5c"} err="failed to get container status \"bb9c1ab7e4760e65ab330138490a48cee3a230b2647df956b568abdcb2069a5c\": rpc error: code = NotFound desc = could not find container \"bb9c1ab7e4760e65ab330138490a48cee3a230b2647df956b568abdcb2069a5c\": container with ID starting with bb9c1ab7e4760e65ab330138490a48cee3a230b2647df956b568abdcb2069a5c not found: ID does not exist"
Jul 15 10:48:35.965360 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.965290    2565 scope.go:117] "RemoveContainer" containerID="3a6e35e2d145cf48997f91f634e91788a19bb9e06f73660025e7b02535f4bbfa"
Jul 15 10:48:35.965531 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:48:35.965510    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a6e35e2d145cf48997f91f634e91788a19bb9e06f73660025e7b02535f4bbfa\": container with ID starting with 3a6e35e2d145cf48997f91f634e91788a19bb9e06f73660025e7b02535f4bbfa not found: ID does not exist" containerID="3a6e35e2d145cf48997f91f634e91788a19bb9e06f73660025e7b02535f4bbfa"
Jul 15 10:48:35.965578 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.965536    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a6e35e2d145cf48997f91f634e91788a19bb9e06f73660025e7b02535f4bbfa"} err="failed to get container status \"3a6e35e2d145cf48997f91f634e91788a19bb9e06f73660025e7b02535f4bbfa\": rpc error: code = NotFound desc = could not find container \"3a6e35e2d145cf48997f91f634e91788a19bb9e06f73660025e7b02535f4bbfa\": container with ID starting with 3a6e35e2d145cf48997f91f634e91788a19bb9e06f73660025e7b02535f4bbfa not found: ID does not exist"
Jul 15 10:48:35.965578 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.965554    2565 scope.go:117] "RemoveContainer" containerID="0708322e65968b04ff8d220ee73a58c147acc4c67611e550d913368ad73c00c8"
Jul 15 10:48:35.965831 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.965809    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0708322e65968b04ff8d220ee73a58c147acc4c67611e550d913368ad73c00c8"} err="failed to get container status \"0708322e65968b04ff8d220ee73a58c147acc4c67611e550d913368ad73c00c8\": rpc error: code = NotFound desc = could not find container \"0708322e65968b04ff8d220ee73a58c147acc4c67611e550d913368ad73c00c8\": container with ID starting with 0708322e65968b04ff8d220ee73a58c147acc4c67611e550d913368ad73c00c8 not found: ID does not exist"
Jul 15 10:48:35.965831 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.965831    2565 scope.go:117] "RemoveContainer" containerID="efe5a4ede43b557d2fe7ad90da813adb72b62441dde8910044165f66c619c2de"
Jul 15 10:48:35.966095 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.966072    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efe5a4ede43b557d2fe7ad90da813adb72b62441dde8910044165f66c619c2de"} err="failed to get container status \"efe5a4ede43b557d2fe7ad90da813adb72b62441dde8910044165f66c619c2de\": rpc error: code = NotFound desc = could not find container \"efe5a4ede43b557d2fe7ad90da813adb72b62441dde8910044165f66c619c2de\": container with ID starting with efe5a4ede43b557d2fe7ad90da813adb72b62441dde8910044165f66c619c2de not found: ID does not exist"
Jul 15 10:48:35.966095 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.966094    2565 scope.go:117] "RemoveContainer" containerID="b738a44e9a92fa3c4a03b88f8b83b0e4757f91d6addd8362892c01bb5b01848a"
Jul 15 10:48:35.966316 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.966293    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b738a44e9a92fa3c4a03b88f8b83b0e4757f91d6addd8362892c01bb5b01848a"} err="failed to get container status \"b738a44e9a92fa3c4a03b88f8b83b0e4757f91d6addd8362892c01bb5b01848a\": rpc error: code = NotFound desc = could not find container \"b738a44e9a92fa3c4a03b88f8b83b0e4757f91d6addd8362892c01bb5b01848a\": container with ID starting with b738a44e9a92fa3c4a03b88f8b83b0e4757f91d6addd8362892c01bb5b01848a not found: ID does not exist"
Jul 15 10:48:35.966316 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.966318    2565 scope.go:117] "RemoveContainer" containerID="ffde0474f853453dd32cd8dca4ecf48df661927a0ddf86c43522c6ae831ab511"
Jul 15 10:48:35.966316 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.966319    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 10:48:35.966539 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.966525    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffde0474f853453dd32cd8dca4ecf48df661927a0ddf86c43522c6ae831ab511"} err="failed to get container status \"ffde0474f853453dd32cd8dca4ecf48df661927a0ddf86c43522c6ae831ab511\": rpc error: code = NotFound desc = could not find container \"ffde0474f853453dd32cd8dca4ecf48df661927a0ddf86c43522c6ae831ab511\": container with ID starting with ffde0474f853453dd32cd8dca4ecf48df661927a0ddf86c43522c6ae831ab511 not found: ID does not exist"
Jul 15 10:48:35.966581 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.966542    2565 scope.go:117] "RemoveContainer" containerID="b31d0ffe69b41276c696c25d2cdd06fd0a2a60dc836a2d334a230c546d6b0e78"
Jul 15 10:48:35.966668 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.966653    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62162859-ec3c-4d0c-84af-3668b92739ca" containerName="config-reloader"
Jul 15 10:48:35.966717 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.966670    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="62162859-ec3c-4d0c-84af-3668b92739ca" containerName="config-reloader"
Jul 15 10:48:35.966717 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.966681    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62162859-ec3c-4d0c-84af-3668b92739ca" containerName="prom-label-proxy"
Jul 15 10:48:35.966717 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.966691    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="62162859-ec3c-4d0c-84af-3668b92739ca" containerName="prom-label-proxy"
Jul 15 10:48:35.966717 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.966713    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62162859-ec3c-4d0c-84af-3668b92739ca" containerName="kube-rbac-proxy-web"
Jul 15 10:48:35.966890 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.966721    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="62162859-ec3c-4d0c-84af-3668b92739ca" containerName="kube-rbac-proxy-web"
Jul 15 10:48:35.966890 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.966731    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62162859-ec3c-4d0c-84af-3668b92739ca" containerName="alertmanager"
Jul 15 10:48:35.966890 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.966737    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="62162859-ec3c-4d0c-84af-3668b92739ca" containerName="alertmanager"
Jul 15 10:48:35.966890 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.966744    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62162859-ec3c-4d0c-84af-3668b92739ca" containerName="kube-rbac-proxy-metric"
Jul 15 10:48:35.966890 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.966751    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="62162859-ec3c-4d0c-84af-3668b92739ca" containerName="kube-rbac-proxy-metric"
Jul 15 10:48:35.966890 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.966760    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62162859-ec3c-4d0c-84af-3668b92739ca" containerName="kube-rbac-proxy"
Jul 15 10:48:35.966890 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.966765    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="62162859-ec3c-4d0c-84af-3668b92739ca" containerName="kube-rbac-proxy"
Jul 15 10:48:35.966890 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.966771    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb687929-8af4-470e-8679-26c69f00ca68" containerName="registry"
Jul 15 10:48:35.966890 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.966776    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb687929-8af4-470e-8679-26c69f00ca68" containerName="registry"
Jul 15 10:48:35.966890 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.966783    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e" containerName="console"
Jul 15 10:48:35.966890 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.966793    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e" containerName="console"
Jul 15 10:48:35.966890 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.966809    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62162859-ec3c-4d0c-84af-3668b92739ca" containerName="init-config-reloader"
Jul 15 10:48:35.966890 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.966814    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="62162859-ec3c-4d0c-84af-3668b92739ca" containerName="init-config-reloader"
Jul 15 10:48:35.966890 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.966740    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b31d0ffe69b41276c696c25d2cdd06fd0a2a60dc836a2d334a230c546d6b0e78"} err="failed to get container status \"b31d0ffe69b41276c696c25d2cdd06fd0a2a60dc836a2d334a230c546d6b0e78\": rpc error: code = NotFound desc = could not find container \"b31d0ffe69b41276c696c25d2cdd06fd0a2a60dc836a2d334a230c546d6b0e78\": container with ID starting with b31d0ffe69b41276c696c25d2cdd06fd0a2a60dc836a2d334a230c546d6b0e78 not found: ID does not exist"
Jul 15 10:48:35.966890 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.966837    2565 scope.go:117] "RemoveContainer" containerID="bb9c1ab7e4760e65ab330138490a48cee3a230b2647df956b568abdcb2069a5c"
Jul 15 10:48:35.966890 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.966873    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb687929-8af4-470e-8679-26c69f00ca68" containerName="registry"
Jul 15 10:48:35.966890 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.966883    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="62162859-ec3c-4d0c-84af-3668b92739ca" containerName="kube-rbac-proxy-web"
Jul 15 10:48:35.966890 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.966893    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="62162859-ec3c-4d0c-84af-3668b92739ca" containerName="kube-rbac-proxy"
Jul 15 10:48:35.966890 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.966901    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="62162859-ec3c-4d0c-84af-3668b92739ca" containerName="kube-rbac-proxy-metric"
Jul 15 10:48:35.967643 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.966912    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8eaa6b23-c5b0-405a-b4a5-002c96ab1f0e" containerName="console"
Jul 15 10:48:35.967643 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.966920    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="62162859-ec3c-4d0c-84af-3668b92739ca" containerName="prom-label-proxy"
Jul 15 10:48:35.967643 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.966930    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="62162859-ec3c-4d0c-84af-3668b92739ca" containerName="alertmanager"
Jul 15 10:48:35.967643 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.966942    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="62162859-ec3c-4d0c-84af-3668b92739ca" containerName="config-reloader"
Jul 15 10:48:35.967643 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.967105    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb9c1ab7e4760e65ab330138490a48cee3a230b2647df956b568abdcb2069a5c"} err="failed to get container status \"bb9c1ab7e4760e65ab330138490a48cee3a230b2647df956b568abdcb2069a5c\": rpc error: code = NotFound desc = could not find container \"bb9c1ab7e4760e65ab330138490a48cee3a230b2647df956b568abdcb2069a5c\": container with ID starting with bb9c1ab7e4760e65ab330138490a48cee3a230b2647df956b568abdcb2069a5c not found: ID does not exist"
Jul 15 10:48:35.967643 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.967127    2565 scope.go:117] "RemoveContainer" containerID="3a6e35e2d145cf48997f91f634e91788a19bb9e06f73660025e7b02535f4bbfa"
Jul 15 10:48:35.967643 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.967366    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a6e35e2d145cf48997f91f634e91788a19bb9e06f73660025e7b02535f4bbfa"} err="failed to get container status \"3a6e35e2d145cf48997f91f634e91788a19bb9e06f73660025e7b02535f4bbfa\": rpc error: code = NotFound desc = could not find container \"3a6e35e2d145cf48997f91f634e91788a19bb9e06f73660025e7b02535f4bbfa\": container with ID starting with 3a6e35e2d145cf48997f91f634e91788a19bb9e06f73660025e7b02535f4bbfa not found: ID does not exist"
Jul 15 10:48:35.971745 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.971729    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:48:35.977536 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.977515    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 15 10:48:35.977765 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.977746    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 15 10:48:35.977865 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.977750    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 15 10:48:35.978328 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.978309    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rtmpq\""
Jul 15 10:48:35.978328 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.978326    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 15 10:48:35.980109 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.980092    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 15 10:48:35.984701 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.984685    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 15 10:48:35.985022 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.984990    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 15 10:48:35.985412 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.985399    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 15 10:48:35.995025 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.995000    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 15 10:48:35.995419 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:35.995398    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 10:48:36.038022 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:36.037995    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b305a75f-5df4-4e51-936d-b7fe26b8273e-config-volume\") pod \"alertmanager-main-0\" (UID: \"b305a75f-5df4-4e51-936d-b7fe26b8273e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:48:36.038130 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:36.038025    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b305a75f-5df4-4e51-936d-b7fe26b8273e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b305a75f-5df4-4e51-936d-b7fe26b8273e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:48:36.038130 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:36.038044    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b305a75f-5df4-4e51-936d-b7fe26b8273e-web-config\") pod \"alertmanager-main-0\" (UID: \"b305a75f-5df4-4e51-936d-b7fe26b8273e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:48:36.038130 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:36.038064    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b305a75f-5df4-4e51-936d-b7fe26b8273e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b305a75f-5df4-4e51-936d-b7fe26b8273e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:48:36.038224 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:36.038155    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b305a75f-5df4-4e51-936d-b7fe26b8273e-config-out\") pod \"alertmanager-main-0\" (UID: \"b305a75f-5df4-4e51-936d-b7fe26b8273e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:48:36.038254 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:36.038217    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b305a75f-5df4-4e51-936d-b7fe26b8273e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b305a75f-5df4-4e51-936d-b7fe26b8273e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:48:36.038254 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:36.038248    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b305a75f-5df4-4e51-936d-b7fe26b8273e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b305a75f-5df4-4e51-936d-b7fe26b8273e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:48:36.038315 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:36.038275    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b305a75f-5df4-4e51-936d-b7fe26b8273e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b305a75f-5df4-4e51-936d-b7fe26b8273e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:48:36.038372 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:36.038320    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b305a75f-5df4-4e51-936d-b7fe26b8273e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b305a75f-5df4-4e51-936d-b7fe26b8273e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:48:36.038411 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:36.038368    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b305a75f-5df4-4e51-936d-b7fe26b8273e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b305a75f-5df4-4e51-936d-b7fe26b8273e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:48:36.038411 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:36.038395    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b305a75f-5df4-4e51-936d-b7fe26b8273e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b305a75f-5df4-4e51-936d-b7fe26b8273e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:48:36.038540 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:36.038516    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsj62\" (UniqueName: \"kubernetes.io/projected/b305a75f-5df4-4e51-936d-b7fe26b8273e-kube-api-access-rsj62\") pod \"alertmanager-main-0\" (UID: \"b305a75f-5df4-4e51-936d-b7fe26b8273e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:48:36.038621 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:36.038601    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b305a75f-5df4-4e51-936d-b7fe26b8273e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b305a75f-5df4-4e51-936d-b7fe26b8273e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:48:36.139266 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:36.139230    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b305a75f-5df4-4e51-936d-b7fe26b8273e-config-volume\") pod \"alertmanager-main-0\" (UID: \"b305a75f-5df4-4e51-936d-b7fe26b8273e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:48:36.139266 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:36.139271    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b305a75f-5df4-4e51-936d-b7fe26b8273e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b305a75f-5df4-4e51-936d-b7fe26b8273e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:48:36.139569 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:36.139289    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b305a75f-5df4-4e51-936d-b7fe26b8273e-web-config\") pod \"alertmanager-main-0\" (UID: \"b305a75f-5df4-4e51-936d-b7fe26b8273e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:48:36.139569 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:36.139311    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b305a75f-5df4-4e51-936d-b7fe26b8273e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b305a75f-5df4-4e51-936d-b7fe26b8273e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:48:36.139569 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:36.139361    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b305a75f-5df4-4e51-936d-b7fe26b8273e-config-out\") pod \"alertmanager-main-0\" (UID: \"b305a75f-5df4-4e51-936d-b7fe26b8273e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:48:36.139569 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:36.139407    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b305a75f-5df4-4e51-936d-b7fe26b8273e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b305a75f-5df4-4e51-936d-b7fe26b8273e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:48:36.139569 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:36.139431    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b305a75f-5df4-4e51-936d-b7fe26b8273e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b305a75f-5df4-4e51-936d-b7fe26b8273e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:48:36.139569 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:36.139456    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b305a75f-5df4-4e51-936d-b7fe26b8273e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b305a75f-5df4-4e51-936d-b7fe26b8273e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:48:36.139569 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:36.139489    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b305a75f-5df4-4e51-936d-b7fe26b8273e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b305a75f-5df4-4e51-936d-b7fe26b8273e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:48:36.139906 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:36.139868    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b305a75f-5df4-4e51-936d-b7fe26b8273e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b305a75f-5df4-4e51-936d-b7fe26b8273e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:48:36.139957 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:36.139930    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b305a75f-5df4-4e51-936d-b7fe26b8273e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b305a75f-5df4-4e51-936d-b7fe26b8273e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:48:36.140009 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:36.139963    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b305a75f-5df4-4e51-936d-b7fe26b8273e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b305a75f-5df4-4e51-936d-b7fe26b8273e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:48:36.140122 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:36.140035    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsj62\" (UniqueName: \"kubernetes.io/projected/b305a75f-5df4-4e51-936d-b7fe26b8273e-kube-api-access-rsj62\") pod \"alertmanager-main-0\" (UID: \"b305a75f-5df4-4e51-936d-b7fe26b8273e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:48:36.140122 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:36.140099    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b305a75f-5df4-4e51-936d-b7fe26b8273e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b305a75f-5df4-4e51-936d-b7fe26b8273e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:48:36.140411 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:36.140385    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b305a75f-5df4-4e51-936d-b7fe26b8273e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b305a75f-5df4-4e51-936d-b7fe26b8273e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:48:36.142017 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:36.141605    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b305a75f-5df4-4e51-936d-b7fe26b8273e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b305a75f-5df4-4e51-936d-b7fe26b8273e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:48:36.142767 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:36.142742    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b305a75f-5df4-4e51-936d-b7fe26b8273e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b305a75f-5df4-4e51-936d-b7fe26b8273e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:48:36.142925 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:36.142827    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b305a75f-5df4-4e51-936d-b7fe26b8273e-config-volume\") pod \"alertmanager-main-0\" (UID: \"b305a75f-5df4-4e51-936d-b7fe26b8273e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:48:36.143146 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:36.143115    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b305a75f-5df4-4e51-936d-b7fe26b8273e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b305a75f-5df4-4e51-936d-b7fe26b8273e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:48:36.143266 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:36.143244    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b305a75f-5df4-4e51-936d-b7fe26b8273e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b305a75f-5df4-4e51-936d-b7fe26b8273e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:48:36.143389 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:36.143293    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b305a75f-5df4-4e51-936d-b7fe26b8273e-config-out\") pod \"alertmanager-main-0\" (UID: \"b305a75f-5df4-4e51-936d-b7fe26b8273e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:48:36.143458 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:36.143438    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b305a75f-5df4-4e51-936d-b7fe26b8273e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b305a75f-5df4-4e51-936d-b7fe26b8273e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:48:36.144021 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:36.144001    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b305a75f-5df4-4e51-936d-b7fe26b8273e-web-config\") pod \"alertmanager-main-0\" (UID: \"b305a75f-5df4-4e51-936d-b7fe26b8273e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:48:36.144132 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:36.144113    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b305a75f-5df4-4e51-936d-b7fe26b8273e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b305a75f-5df4-4e51-936d-b7fe26b8273e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:48:36.144311 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:36.144293    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b305a75f-5df4-4e51-936d-b7fe26b8273e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b305a75f-5df4-4e51-936d-b7fe26b8273e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:48:36.150352 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:36.150316    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsj62\" (UniqueName: \"kubernetes.io/projected/b305a75f-5df4-4e51-936d-b7fe26b8273e-kube-api-access-rsj62\") pod \"alertmanager-main-0\" (UID: \"b305a75f-5df4-4e51-936d-b7fe26b8273e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:48:36.281111 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:36.281079    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 10:48:36.429152 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:36.429123    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 10:48:36.430802 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:48:36.430776    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb305a75f_5df4_4e51_936d_b7fe26b8273e.slice/crio-ccc260445e2c6a5fdabd291cc2f9cbeb0b16bf77e3d1144ae3cc63716339e25a WatchSource:0}: Error finding container ccc260445e2c6a5fdabd291cc2f9cbeb0b16bf77e3d1144ae3cc63716339e25a: Status 404 returned error can't find the container with id ccc260445e2c6a5fdabd291cc2f9cbeb0b16bf77e3d1144ae3cc63716339e25a
Jul 15 10:48:36.912864 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:36.912832    2565 generic.go:356] "Generic (PLEG): container finished" podID="b305a75f-5df4-4e51-936d-b7fe26b8273e" containerID="04b59874964d28f5ca235bf0b2e0752b482f8acbc306690fd94d45265e4d8505" exitCode=0
Jul 15 10:48:36.913050 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:36.912917    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b305a75f-5df4-4e51-936d-b7fe26b8273e","Type":"ContainerDied","Data":"04b59874964d28f5ca235bf0b2e0752b482f8acbc306690fd94d45265e4d8505"}
Jul 15 10:48:36.913050 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:36.912988    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b305a75f-5df4-4e51-936d-b7fe26b8273e","Type":"ContainerStarted","Data":"ccc260445e2c6a5fdabd291cc2f9cbeb0b16bf77e3d1144ae3cc63716339e25a"}
Jul 15 10:48:36.923913 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:36.923891    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62162859-ec3c-4d0c-84af-3668b92739ca" path="/var/lib/kubelet/pods/62162859-ec3c-4d0c-84af-3668b92739ca/volumes"
Jul 15 10:48:37.921401 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:37.921369    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b305a75f-5df4-4e51-936d-b7fe26b8273e","Type":"ContainerStarted","Data":"3e0579c4a1b0030a859572ecbac05642383f7ae1b13552e9e9e1d7549dc1197f"}
Jul 15 10:48:37.921855 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:37.921455    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b305a75f-5df4-4e51-936d-b7fe26b8273e","Type":"ContainerStarted","Data":"d1dd2e4311c7d896f27f2cdaa4d8a379d1c53e060ada2d05dc6469f028ba4904"}
Jul 15 10:48:37.921855 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:37.921480    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b305a75f-5df4-4e51-936d-b7fe26b8273e","Type":"ContainerStarted","Data":"a428a4dcfab6110ba4e1b3e9e703ccdbb4133e74a559b1255a0b900a6c7608d3"}
Jul 15 10:48:37.921855 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:37.921504    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b305a75f-5df4-4e51-936d-b7fe26b8273e","Type":"ContainerStarted","Data":"9a944cfe03ce02aed91043711eb2dfc61df66313a8111f9e8c6cfafbd6a2a1f9"}
Jul 15 10:48:37.921855 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:37.921534    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b305a75f-5df4-4e51-936d-b7fe26b8273e","Type":"ContainerStarted","Data":"e16fdbd550073a0270579ff7d8999fb53bc1116d2845b9a85ace376956efc0f2"}
Jul 15 10:48:37.921855 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:37.921558    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b305a75f-5df4-4e51-936d-b7fe26b8273e","Type":"ContainerStarted","Data":"e28f9d4ac1d33920c34dca8a2f1250b80ce1a700eb28bc0f2749299781c4e7a2"}
Jul 15 10:48:37.954015 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:37.953955    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.939970087 podStartE2EDuration="2.953915562s" totalImagesPullingTime="0s" totalInitContainerRuntime="13.945475ms" isStatefulPod=false podCreationTimestamp="2026-07-15 10:48:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:48:37.951072124 +0000 UTC m=+215.559608146" watchObservedRunningTime="2026-07-15 10:48:37.953915562 +0000 UTC m=+215.562451583"
Jul 15 10:48:41.645457 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:41.645415    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:48:41.723768 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:41.723731    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:48:45.735091 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:45.735055    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:48:50.716973 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:50.716935    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56d965464-bz8f2"]
Jul 15 10:48:50.721795 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:50.721773    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56d965464-bz8f2"
Jul 15 10:48:50.735145 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:50.735120    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56d965464-bz8f2"]
Jul 15 10:48:50.770002 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:50.769964    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:48:50.830920 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:50.830884    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:48:50.858025 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:50.857980    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed3f1b31-6dd2-4b69-a34f-e636ca00c290-service-ca\") pod \"console-56d965464-bz8f2\" (UID: \"ed3f1b31-6dd2-4b69-a34f-e636ca00c290\") " pod="openshift-console/console-56d965464-bz8f2"
Jul 15 10:48:50.858155 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:50.858034    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed3f1b31-6dd2-4b69-a34f-e636ca00c290-console-serving-cert\") pod \"console-56d965464-bz8f2\" (UID: \"ed3f1b31-6dd2-4b69-a34f-e636ca00c290\") " pod="openshift-console/console-56d965464-bz8f2"
Jul 15 10:48:50.858155 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:50.858068    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed3f1b31-6dd2-4b69-a34f-e636ca00c290-oauth-serving-cert\") pod \"console-56d965464-bz8f2\" (UID: \"ed3f1b31-6dd2-4b69-a34f-e636ca00c290\") " pod="openshift-console/console-56d965464-bz8f2"
Jul 15 10:48:50.858155 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:50.858116    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed3f1b31-6dd2-4b69-a34f-e636ca00c290-trusted-ca-bundle\") pod \"console-56d965464-bz8f2\" (UID: \"ed3f1b31-6dd2-4b69-a34f-e636ca00c290\") " pod="openshift-console/console-56d965464-bz8f2"
Jul 15 10:48:50.858155 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:50.858139    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed3f1b31-6dd2-4b69-a34f-e636ca00c290-console-config\") pod \"console-56d965464-bz8f2\" (UID: \"ed3f1b31-6dd2-4b69-a34f-e636ca00c290\") " pod="openshift-console/console-56d965464-bz8f2"
Jul 15 10:48:50.858288 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:50.858195    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed3f1b31-6dd2-4b69-a34f-e636ca00c290-console-oauth-config\") pod \"console-56d965464-bz8f2\" (UID: \"ed3f1b31-6dd2-4b69-a34f-e636ca00c290\") " pod="openshift-console/console-56d965464-bz8f2"
Jul 15 10:48:50.858288 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:50.858215    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6nx4\" (UniqueName: \"kubernetes.io/projected/ed3f1b31-6dd2-4b69-a34f-e636ca00c290-kube-api-access-w6nx4\") pod \"console-56d965464-bz8f2\" (UID: \"ed3f1b31-6dd2-4b69-a34f-e636ca00c290\") " pod="openshift-console/console-56d965464-bz8f2"
Jul 15 10:48:50.959154 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:50.959126    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed3f1b31-6dd2-4b69-a34f-e636ca00c290-console-serving-cert\") pod \"console-56d965464-bz8f2\" (UID: \"ed3f1b31-6dd2-4b69-a34f-e636ca00c290\") " pod="openshift-console/console-56d965464-bz8f2"
Jul 15 10:48:50.959154 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:50.959162    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed3f1b31-6dd2-4b69-a34f-e636ca00c290-oauth-serving-cert\") pod \"console-56d965464-bz8f2\" (UID: \"ed3f1b31-6dd2-4b69-a34f-e636ca00c290\") " pod="openshift-console/console-56d965464-bz8f2"
Jul 15 10:48:50.959408 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:50.959206    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed3f1b31-6dd2-4b69-a34f-e636ca00c290-trusted-ca-bundle\") pod \"console-56d965464-bz8f2\" (UID: \"ed3f1b31-6dd2-4b69-a34f-e636ca00c290\") " pod="openshift-console/console-56d965464-bz8f2"
Jul 15 10:48:50.959408 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:50.959223    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed3f1b31-6dd2-4b69-a34f-e636ca00c290-console-config\") pod \"console-56d965464-bz8f2\" (UID: \"ed3f1b31-6dd2-4b69-a34f-e636ca00c290\") " pod="openshift-console/console-56d965464-bz8f2"
Jul 15 10:48:50.959408 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:50.959248    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed3f1b31-6dd2-4b69-a34f-e636ca00c290-console-oauth-config\") pod \"console-56d965464-bz8f2\" (UID: \"ed3f1b31-6dd2-4b69-a34f-e636ca00c290\") " pod="openshift-console/console-56d965464-bz8f2"
Jul 15 10:48:50.959408 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:50.959273    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6nx4\" (UniqueName: \"kubernetes.io/projected/ed3f1b31-6dd2-4b69-a34f-e636ca00c290-kube-api-access-w6nx4\") pod \"console-56d965464-bz8f2\" (UID: \"ed3f1b31-6dd2-4b69-a34f-e636ca00c290\") " pod="openshift-console/console-56d965464-bz8f2"
Jul 15 10:48:50.959408 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:50.959352    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed3f1b31-6dd2-4b69-a34f-e636ca00c290-service-ca\") pod \"console-56d965464-bz8f2\" (UID: \"ed3f1b31-6dd2-4b69-a34f-e636ca00c290\") " pod="openshift-console/console-56d965464-bz8f2"
Jul 15 10:48:50.960147 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:50.960116    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed3f1b31-6dd2-4b69-a34f-e636ca00c290-oauth-serving-cert\") pod \"console-56d965464-bz8f2\" (UID: \"ed3f1b31-6dd2-4b69-a34f-e636ca00c290\") " pod="openshift-console/console-56d965464-bz8f2"
Jul 15 10:48:50.960247 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:50.960174    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed3f1b31-6dd2-4b69-a34f-e636ca00c290-service-ca\") pod \"console-56d965464-bz8f2\" (UID: \"ed3f1b31-6dd2-4b69-a34f-e636ca00c290\") " pod="openshift-console/console-56d965464-bz8f2"
Jul 15 10:48:50.960295 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:50.960248    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed3f1b31-6dd2-4b69-a34f-e636ca00c290-console-config\") pod \"console-56d965464-bz8f2\" (UID: \"ed3f1b31-6dd2-4b69-a34f-e636ca00c290\") " pod="openshift-console/console-56d965464-bz8f2"
Jul 15 10:48:50.960675 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:50.960653    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed3f1b31-6dd2-4b69-a34f-e636ca00c290-trusted-ca-bundle\") pod \"console-56d965464-bz8f2\" (UID: \"ed3f1b31-6dd2-4b69-a34f-e636ca00c290\") " pod="openshift-console/console-56d965464-bz8f2"
Jul 15 10:48:50.961847 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:50.961826    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed3f1b31-6dd2-4b69-a34f-e636ca00c290-console-oauth-config\") pod \"console-56d965464-bz8f2\" (UID: \"ed3f1b31-6dd2-4b69-a34f-e636ca00c290\") " pod="openshift-console/console-56d965464-bz8f2"
Jul 15 10:48:50.962080 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:50.962057    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed3f1b31-6dd2-4b69-a34f-e636ca00c290-console-serving-cert\") pod \"console-56d965464-bz8f2\" (UID: \"ed3f1b31-6dd2-4b69-a34f-e636ca00c290\") " pod="openshift-console/console-56d965464-bz8f2"
Jul 15 10:48:50.968269 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:50.968212    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6nx4\" (UniqueName: \"kubernetes.io/projected/ed3f1b31-6dd2-4b69-a34f-e636ca00c290-kube-api-access-w6nx4\") pod \"console-56d965464-bz8f2\" (UID: \"ed3f1b31-6dd2-4b69-a34f-e636ca00c290\") " pod="openshift-console/console-56d965464-bz8f2"
Jul 15 10:48:51.031927 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:51.031893    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56d965464-bz8f2"
Jul 15 10:48:51.167571 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:51.167547    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56d965464-bz8f2"]
Jul 15 10:48:51.170059 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:48:51.170015    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded3f1b31_6dd2_4b69_a34f_e636ca00c290.slice/crio-7b364788c120428707d8e3cc5a950e4af1304d389d1e92e275e04f02e343a941 WatchSource:0}: Error finding container 7b364788c120428707d8e3cc5a950e4af1304d389d1e92e275e04f02e343a941: Status 404 returned error can't find the container with id 7b364788c120428707d8e3cc5a950e4af1304d389d1e92e275e04f02e343a941
Jul 15 10:48:51.927055 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:51.927017    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:48:51.978228 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:51.978191    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56d965464-bz8f2" event={"ID":"ed3f1b31-6dd2-4b69-a34f-e636ca00c290","Type":"ContainerStarted","Data":"027207dc876cfdf942ff75bffbfb3b5a3d58506e8d6a3318ea4b207c88b728b8"}
Jul 15 10:48:51.978396 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:51.978249    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56d965464-bz8f2" event={"ID":"ed3f1b31-6dd2-4b69-a34f-e636ca00c290","Type":"ContainerStarted","Data":"7b364788c120428707d8e3cc5a950e4af1304d389d1e92e275e04f02e343a941"}
Jul 15 10:48:51.997978 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:51.997929    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56d965464-bz8f2" podStartSLOduration=1.9979125199999999 podStartE2EDuration="1.99791252s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:48:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:48:51.996767788 +0000 UTC m=+229.605303811" watchObservedRunningTime="2026-07-15 10:48:51.99791252 +0000 UTC m=+229.606448542"
Jul 15 10:48:52.000655 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:52.000629    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:48:55.119139 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:55.119104    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:48:55.218953 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:55.218910    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:48:55.324373 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:48:55.324319    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:49:01.032053 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:49:01.032011    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56d965464-bz8f2"
Jul 15 10:49:01.032565 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:49:01.032321    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56d965464-bz8f2"
Jul 15 10:49:01.036924 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:49:01.036903    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56d965464-bz8f2"
Jul 15 10:49:02.021882 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:49:02.021854    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56d965464-bz8f2"
Jul 15 10:49:02.074556 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:49:02.074518    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-dc75cc457-6vdb9"]
Jul 15 10:49:02.190344 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:49:02.190306    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:49:02.291364 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:49:02.291317    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:49:02.356667 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:49:02.356620    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:49:27.097779 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:49:27.097718    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-dc75cc457-6vdb9" podUID="8cd3dcc1-5f67-4e80-a47b-9b87a534ea98" containerName="console" containerID="cri-o://516ad879f1d17636d5328947b194e72ab41e30e9d7f227a1d0849b534a7ba3ed" gracePeriod=15
Jul 15 10:49:27.343390 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:49:27.343360    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dc75cc457-6vdb9"
Jul 15 10:49:27.464202 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:49:27.464106    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cd3dcc1-5f67-4e80-a47b-9b87a534ea98-trusted-ca-bundle\") pod \"8cd3dcc1-5f67-4e80-a47b-9b87a534ea98\" (UID: \"8cd3dcc1-5f67-4e80-a47b-9b87a534ea98\") "
Jul 15 10:49:27.464202 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:49:27.464139    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8cd3dcc1-5f67-4e80-a47b-9b87a534ea98-oauth-serving-cert\") pod \"8cd3dcc1-5f67-4e80-a47b-9b87a534ea98\" (UID: \"8cd3dcc1-5f67-4e80-a47b-9b87a534ea98\") "
Jul 15 10:49:27.464202 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:49:27.464158    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8cd3dcc1-5f67-4e80-a47b-9b87a534ea98-console-config\") pod \"8cd3dcc1-5f67-4e80-a47b-9b87a534ea98\" (UID: \"8cd3dcc1-5f67-4e80-a47b-9b87a534ea98\") "
Jul 15 10:49:27.464202 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:49:27.464191    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htdj9\" (UniqueName: \"kubernetes.io/projected/8cd3dcc1-5f67-4e80-a47b-9b87a534ea98-kube-api-access-htdj9\") pod \"8cd3dcc1-5f67-4e80-a47b-9b87a534ea98\" (UID: \"8cd3dcc1-5f67-4e80-a47b-9b87a534ea98\") "
Jul 15 10:49:27.464577 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:49:27.464216    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8cd3dcc1-5f67-4e80-a47b-9b87a534ea98-console-serving-cert\") pod \"8cd3dcc1-5f67-4e80-a47b-9b87a534ea98\" (UID: \"8cd3dcc1-5f67-4e80-a47b-9b87a534ea98\") "
Jul 15 10:49:27.464577 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:49:27.464292    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8cd3dcc1-5f67-4e80-a47b-9b87a534ea98-service-ca\") pod \"8cd3dcc1-5f67-4e80-a47b-9b87a534ea98\" (UID: \"8cd3dcc1-5f67-4e80-a47b-9b87a534ea98\") "
Jul 15 10:49:27.464577 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:49:27.464430    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8cd3dcc1-5f67-4e80-a47b-9b87a534ea98-console-oauth-config\") pod \"8cd3dcc1-5f67-4e80-a47b-9b87a534ea98\" (UID: \"8cd3dcc1-5f67-4e80-a47b-9b87a534ea98\") "
Jul 15 10:49:27.464751 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:49:27.464617    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cd3dcc1-5f67-4e80-a47b-9b87a534ea98-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8cd3dcc1-5f67-4e80-a47b-9b87a534ea98" (UID: "8cd3dcc1-5f67-4e80-a47b-9b87a534ea98"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:49:27.464751 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:49:27.464639    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cd3dcc1-5f67-4e80-a47b-9b87a534ea98-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8cd3dcc1-5f67-4e80-a47b-9b87a534ea98" (UID: "8cd3dcc1-5f67-4e80-a47b-9b87a534ea98"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:49:27.464751 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:49:27.464658    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cd3dcc1-5f67-4e80-a47b-9b87a534ea98-console-config" (OuterVolumeSpecName: "console-config") pod "8cd3dcc1-5f67-4e80-a47b-9b87a534ea98" (UID: "8cd3dcc1-5f67-4e80-a47b-9b87a534ea98"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:49:27.464751 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:49:27.464701    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cd3dcc1-5f67-4e80-a47b-9b87a534ea98-trusted-ca-bundle\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:49:27.464945 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:49:27.464894    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cd3dcc1-5f67-4e80-a47b-9b87a534ea98-service-ca" (OuterVolumeSpecName: "service-ca") pod "8cd3dcc1-5f67-4e80-a47b-9b87a534ea98" (UID: "8cd3dcc1-5f67-4e80-a47b-9b87a534ea98"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:49:27.466612 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:49:27.466585    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cd3dcc1-5f67-4e80-a47b-9b87a534ea98-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8cd3dcc1-5f67-4e80-a47b-9b87a534ea98" (UID: "8cd3dcc1-5f67-4e80-a47b-9b87a534ea98"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 10:49:27.466612 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:49:27.466606    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cd3dcc1-5f67-4e80-a47b-9b87a534ea98-kube-api-access-htdj9" (OuterVolumeSpecName: "kube-api-access-htdj9") pod "8cd3dcc1-5f67-4e80-a47b-9b87a534ea98" (UID: "8cd3dcc1-5f67-4e80-a47b-9b87a534ea98"). InnerVolumeSpecName "kube-api-access-htdj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 10:49:27.466755 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:49:27.466671    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cd3dcc1-5f67-4e80-a47b-9b87a534ea98-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8cd3dcc1-5f67-4e80-a47b-9b87a534ea98" (UID: "8cd3dcc1-5f67-4e80-a47b-9b87a534ea98"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 10:49:27.565239 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:49:27.565201    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8cd3dcc1-5f67-4e80-a47b-9b87a534ea98-oauth-serving-cert\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:49:27.565239 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:49:27.565234    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8cd3dcc1-5f67-4e80-a47b-9b87a534ea98-console-config\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:49:27.565239 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:49:27.565244    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htdj9\" (UniqueName: \"kubernetes.io/projected/8cd3dcc1-5f67-4e80-a47b-9b87a534ea98-kube-api-access-htdj9\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:49:27.565502 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:49:27.565254    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8cd3dcc1-5f67-4e80-a47b-9b87a534ea98-console-serving-cert\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:49:27.565502 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:49:27.565263    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8cd3dcc1-5f67-4e80-a47b-9b87a534ea98-service-ca\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:49:27.565502 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:49:27.565271    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8cd3dcc1-5f67-4e80-a47b-9b87a534ea98-console-oauth-config\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:49:28.124592 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:49:28.124555    2565 generic.go:356] "Generic (PLEG): container finished" podID="8cd3dcc1-5f67-4e80-a47b-9b87a534ea98" containerID="516ad879f1d17636d5328947b194e72ab41e30e9d7f227a1d0849b534a7ba3ed" exitCode=0
Jul 15 10:49:28.124997 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:49:28.124602    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dc75cc457-6vdb9"
Jul 15 10:49:28.124997 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:49:28.124643    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dc75cc457-6vdb9" event={"ID":"8cd3dcc1-5f67-4e80-a47b-9b87a534ea98","Type":"ContainerDied","Data":"516ad879f1d17636d5328947b194e72ab41e30e9d7f227a1d0849b534a7ba3ed"}
Jul 15 10:49:28.124997 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:49:28.124699    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dc75cc457-6vdb9" event={"ID":"8cd3dcc1-5f67-4e80-a47b-9b87a534ea98","Type":"ContainerDied","Data":"f0b7fd40e44404ed6bc09720f197328dc30e3243782c3d5752582f3922690f9c"}
Jul 15 10:49:28.124997 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:49:28.124729    2565 scope.go:117] "RemoveContainer" containerID="516ad879f1d17636d5328947b194e72ab41e30e9d7f227a1d0849b534a7ba3ed"
Jul 15 10:49:28.133283 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:49:28.133264    2565 scope.go:117] "RemoveContainer" containerID="516ad879f1d17636d5328947b194e72ab41e30e9d7f227a1d0849b534a7ba3ed"
Jul 15 10:49:28.133593 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:49:28.133572    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"516ad879f1d17636d5328947b194e72ab41e30e9d7f227a1d0849b534a7ba3ed\": container with ID starting with 516ad879f1d17636d5328947b194e72ab41e30e9d7f227a1d0849b534a7ba3ed not found: ID does not exist" containerID="516ad879f1d17636d5328947b194e72ab41e30e9d7f227a1d0849b534a7ba3ed"
Jul 15 10:49:28.133642 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:49:28.133601    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"516ad879f1d17636d5328947b194e72ab41e30e9d7f227a1d0849b534a7ba3ed"} err="failed to get container status \"516ad879f1d17636d5328947b194e72ab41e30e9d7f227a1d0849b534a7ba3ed\": rpc error: code = NotFound desc = could not find container \"516ad879f1d17636d5328947b194e72ab41e30e9d7f227a1d0849b534a7ba3ed\": container with ID starting with 516ad879f1d17636d5328947b194e72ab41e30e9d7f227a1d0849b534a7ba3ed not found: ID does not exist"
Jul 15 10:49:28.145679 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:49:28.145653    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-dc75cc457-6vdb9"]
Jul 15 10:49:28.149148 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:49:28.149125    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-dc75cc457-6vdb9"]
Jul 15 10:49:28.923841 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:49:28.923807    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cd3dcc1-5f67-4e80-a47b-9b87a534ea98" path="/var/lib/kubelet/pods/8cd3dcc1-5f67-4e80-a47b-9b87a534ea98/volumes"
Jul 15 10:50:02.822925 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:02.822883    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8dcjj_8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9/console-operator/1.log"
Jul 15 10:50:02.823458 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:02.823265    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8dcjj_8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9/console-operator/1.log"
Jul 15 10:50:02.827674 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:02.827647    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qsch8_f3b175c1-34f8-4e74-bce6-f866e4bd25b0/ovn-acl-logging/0.log"
Jul 15 10:50:02.828149 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:02.828126    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qsch8_f3b175c1-34f8-4e74-bce6-f866e4bd25b0/ovn-acl-logging/0.log"
Jul 15 10:50:02.835038 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:02.835021    2565 kubelet.go:1648] "Image garbage collection succeeded"
Jul 15 10:50:30.010681 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:30.010643    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:50:31.322192 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:31.322159    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b52m4mp"]
Jul 15 10:50:31.322587 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:31.322482    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cd3dcc1-5f67-4e80-a47b-9b87a534ea98" containerName="console"
Jul 15 10:50:31.322587 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:31.322493    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cd3dcc1-5f67-4e80-a47b-9b87a534ea98" containerName="console"
Jul 15 10:50:31.322587 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:31.322556    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cd3dcc1-5f67-4e80-a47b-9b87a534ea98" containerName="console"
Jul 15 10:50:31.325555 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:31.325537    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b52m4mp"
Jul 15 10:50:31.328205 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:31.328183    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 15 10:50:31.328325 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:31.328184    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2pxqp\""
Jul 15 10:50:31.329198 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:31.329182    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 15 10:50:31.335995 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:31.335974    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b52m4mp"]
Jul 15 10:50:31.400999 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:31.400968    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b52m4mp\" (UID: \"12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b52m4mp"
Jul 15 10:50:31.401163 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:31.401036    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b52m4mp\" (UID: \"12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b52m4mp"
Jul 15 10:50:31.401163 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:31.401097    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzqzk\" (UniqueName: \"kubernetes.io/projected/12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3-kube-api-access-dzqzk\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b52m4mp\" (UID: \"12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b52m4mp"
Jul 15 10:50:31.501608 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:31.501568    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b52m4mp\" (UID: \"12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b52m4mp"
Jul 15 10:50:31.501778 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:31.501674    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b52m4mp\" (UID: \"12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b52m4mp"
Jul 15 10:50:31.501778 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:31.501717    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzqzk\" (UniqueName: \"kubernetes.io/projected/12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3-kube-api-access-dzqzk\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b52m4mp\" (UID: \"12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b52m4mp"
Jul 15 10:50:31.502053 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:31.502032    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b52m4mp\" (UID: \"12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b52m4mp"
Jul 15 10:50:31.502090 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:31.502039    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b52m4mp\" (UID: \"12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b52m4mp"
Jul 15 10:50:31.511275 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:31.511242    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzqzk\" (UniqueName: \"kubernetes.io/projected/12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3-kube-api-access-dzqzk\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b52m4mp\" (UID: \"12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b52m4mp"
Jul 15 10:50:31.576740 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:31.576646    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:50:31.634411 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:31.634382    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b52m4mp"
Jul 15 10:50:31.790410 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:31.790391    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b52m4mp"]
Jul 15 10:50:31.792873 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:50:31.792848    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12b1d7aa_3a9f_4191_a6e2_cd4b89f49fe3.slice/crio-de97daaa408901183de27d1799d280a712508bd6a1f151ee6b235f37e4dc9114 WatchSource:0}: Error finding container de97daaa408901183de27d1799d280a712508bd6a1f151ee6b235f37e4dc9114: Status 404 returned error can't find the container with id de97daaa408901183de27d1799d280a712508bd6a1f151ee6b235f37e4dc9114
Jul 15 10:50:31.795125 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:31.795106    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 10:50:32.376380 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:32.376316    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b52m4mp" event={"ID":"12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3","Type":"ContainerStarted","Data":"de97daaa408901183de27d1799d280a712508bd6a1f151ee6b235f37e4dc9114"}
Jul 15 10:50:33.271479 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:33.271410    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:50:33.360780 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:33.360729    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:50:38.404585 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:38.404551    2565 generic.go:356] "Generic (PLEG): container finished" podID="12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3" containerID="22bc5481ea4ac9f8d6d0c96371f6cb7688168a6486b12ee0a5668fa6e8fdc313" exitCode=0
Jul 15 10:50:38.404991 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:38.404609    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b52m4mp" event={"ID":"12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3","Type":"ContainerDied","Data":"22bc5481ea4ac9f8d6d0c96371f6cb7688168a6486b12ee0a5668fa6e8fdc313"}
Jul 15 10:50:41.419498 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:41.419459    2565 generic.go:356] "Generic (PLEG): container finished" podID="12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3" containerID="04eeb53fb37954c3168f8273beb5af197f8eb59272cc45cd756b57fa94263310" exitCode=0
Jul 15 10:50:41.419911 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:41.419535    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b52m4mp" event={"ID":"12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3","Type":"ContainerDied","Data":"04eeb53fb37954c3168f8273beb5af197f8eb59272cc45cd756b57fa94263310"}
Jul 15 10:50:48.451597 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:48.451511    2565 generic.go:356] "Generic (PLEG): container finished" podID="12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3" containerID="ecbcb1c2517d5fdd545d73042378a99b02365959ca33690ead082a5459d6c293" exitCode=0
Jul 15 10:50:48.451597 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:48.451576    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b52m4mp" event={"ID":"12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3","Type":"ContainerDied","Data":"ecbcb1c2517d5fdd545d73042378a99b02365959ca33690ead082a5459d6c293"}
Jul 15 10:50:49.579068 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:49.579041    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b52m4mp"
Jul 15 10:50:49.658813 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:49.658778    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3-bundle\") pod \"12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3\" (UID: \"12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3\") "
Jul 15 10:50:49.658813 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:49.658814    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzqzk\" (UniqueName: \"kubernetes.io/projected/12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3-kube-api-access-dzqzk\") pod \"12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3\" (UID: \"12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3\") "
Jul 15 10:50:49.659071 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:49.658863    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3-util\") pod \"12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3\" (UID: \"12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3\") "
Jul 15 10:50:49.659459 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:49.659434    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3-bundle" (OuterVolumeSpecName: "bundle") pod "12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3" (UID: "12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:50:49.661221 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:49.661200    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3-kube-api-access-dzqzk" (OuterVolumeSpecName: "kube-api-access-dzqzk") pod "12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3" (UID: "12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3"). InnerVolumeSpecName "kube-api-access-dzqzk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 10:50:49.664061 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:49.664037    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3-util" (OuterVolumeSpecName: "util") pod "12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3" (UID: "12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:50:49.759688 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:49.759621    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3-bundle\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:50:49.759688 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:49.759647    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzqzk\" (UniqueName: \"kubernetes.io/projected/12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3-kube-api-access-dzqzk\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:50:49.759688 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:49.759658    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3-util\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:50:50.461393 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:50.461364    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b52m4mp"
Jul 15 10:50:50.461557 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:50.461363    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b52m4mp" event={"ID":"12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3","Type":"ContainerDied","Data":"de97daaa408901183de27d1799d280a712508bd6a1f151ee6b235f37e4dc9114"}
Jul 15 10:50:50.461557 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:50.461489    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="de97daaa408901183de27d1799d280a712508bd6a1f151ee6b235f37e4dc9114"
Jul 15 10:50:52.616884 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:52.616851    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:50:52.713235 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:52.713203    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:50:54.264516 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:54.264433    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-v4flz"]
Jul 15 10:50:54.264906 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:54.264767    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3" containerName="extract"
Jul 15 10:50:54.264906 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:54.264791    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3" containerName="extract"
Jul 15 10:50:54.264906 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:54.264800    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3" containerName="pull"
Jul 15 10:50:54.264906 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:54.264806    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3" containerName="pull"
Jul 15 10:50:54.264906 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:54.264824    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3" containerName="util"
Jul 15 10:50:54.264906 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:54.264829    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3" containerName="util"
Jul 15 10:50:54.264906 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:54.264877    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="12b1d7aa-3a9f-4191-a6e2-cd4b89f49fe3" containerName="extract"
Jul 15 10:50:54.267749 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:54.267728    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-v4flz"
Jul 15 10:50:54.270809 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:54.270793    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
Jul 15 10:50:54.271410 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:54.271395    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\""
Jul 15 10:50:54.272458 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:54.272439    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
Jul 15 10:50:54.277587 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:54.277568    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-fflnq\""
Jul 15 10:50:54.293573 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:54.293546    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/70058638-b404-4704-8d41-94283c66892c-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-v4flz\" (UID: \"70058638-b404-4704-8d41-94283c66892c\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-v4flz"
Jul 15 10:50:54.293685 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:54.293591    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56xvq\" (UniqueName: \"kubernetes.io/projected/70058638-b404-4704-8d41-94283c66892c-kube-api-access-56xvq\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-v4flz\" (UID: \"70058638-b404-4704-8d41-94283c66892c\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-v4flz"
Jul 15 10:50:54.298357 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:54.298316    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-v4flz"]
Jul 15 10:50:54.394859 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:54.394820    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/70058638-b404-4704-8d41-94283c66892c-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-v4flz\" (UID: \"70058638-b404-4704-8d41-94283c66892c\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-v4flz"
Jul 15 10:50:54.395028 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:54.394906    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56xvq\" (UniqueName: \"kubernetes.io/projected/70058638-b404-4704-8d41-94283c66892c-kube-api-access-56xvq\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-v4flz\" (UID: \"70058638-b404-4704-8d41-94283c66892c\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-v4flz"
Jul 15 10:50:54.397246 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:54.397223    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/70058638-b404-4704-8d41-94283c66892c-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-v4flz\" (UID: \"70058638-b404-4704-8d41-94283c66892c\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-v4flz"
Jul 15 10:50:54.404212 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:54.404189    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56xvq\" (UniqueName: \"kubernetes.io/projected/70058638-b404-4704-8d41-94283c66892c-kube-api-access-56xvq\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-v4flz\" (UID: \"70058638-b404-4704-8d41-94283c66892c\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-v4flz"
Jul 15 10:50:54.577160 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:54.577126    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-v4flz"
Jul 15 10:50:54.707978 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:54.707955    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-v4flz"]
Jul 15 10:50:54.710419 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:50:54.710389    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70058638_b404_4704_8d41_94283c66892c.slice/crio-f30cd2e8794800388dd8d00ec7833678ffaf1892a9a3ffd1d1279db73d8a0226 WatchSource:0}: Error finding container f30cd2e8794800388dd8d00ec7833678ffaf1892a9a3ffd1d1279db73d8a0226: Status 404 returned error can't find the container with id f30cd2e8794800388dd8d00ec7833678ffaf1892a9a3ffd1d1279db73d8a0226
Jul 15 10:50:55.482516 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:55.482482    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-v4flz" event={"ID":"70058638-b404-4704-8d41-94283c66892c","Type":"ContainerStarted","Data":"f30cd2e8794800388dd8d00ec7833678ffaf1892a9a3ffd1d1279db73d8a0226"}
Jul 15 10:50:57.958871 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:57.958832    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:50:58.222501 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:58.222421    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:50:58.231109 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:58.231085    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-77f648d694-qm2xx"]
Jul 15 10:50:58.234387 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:58.234368    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-qm2xx"
Jul 15 10:50:58.237178 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:58.237161    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\""
Jul 15 10:50:58.237298 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:58.237190    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-8dgqk\""
Jul 15 10:50:58.237298 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:58.237160    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
Jul 15 10:50:58.244254 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:58.244232    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-qm2xx"]
Jul 15 10:50:58.335835 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:58.335801    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/04a9f9f1-5021-48ef-ac26-a4fb0f130059-certificates\") pod \"keda-operator-77f648d694-qm2xx\" (UID: \"04a9f9f1-5021-48ef-ac26-a4fb0f130059\") " pod="openshift-keda/keda-operator-77f648d694-qm2xx"
Jul 15 10:50:58.335835 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:58.335838    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/04a9f9f1-5021-48ef-ac26-a4fb0f130059-cabundle0\") pod \"keda-operator-77f648d694-qm2xx\" (UID: \"04a9f9f1-5021-48ef-ac26-a4fb0f130059\") " pod="openshift-keda/keda-operator-77f648d694-qm2xx"
Jul 15 10:50:58.336052 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:58.335907    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5lbm\" (UniqueName: \"kubernetes.io/projected/04a9f9f1-5021-48ef-ac26-a4fb0f130059-kube-api-access-q5lbm\") pod \"keda-operator-77f648d694-qm2xx\" (UID: \"04a9f9f1-5021-48ef-ac26-a4fb0f130059\") " pod="openshift-keda/keda-operator-77f648d694-qm2xx"
Jul 15 10:50:58.437198 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:58.437162    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/04a9f9f1-5021-48ef-ac26-a4fb0f130059-certificates\") pod \"keda-operator-77f648d694-qm2xx\" (UID: \"04a9f9f1-5021-48ef-ac26-a4fb0f130059\") " pod="openshift-keda/keda-operator-77f648d694-qm2xx"
Jul 15 10:50:58.437198 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:58.437203    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/04a9f9f1-5021-48ef-ac26-a4fb0f130059-cabundle0\") pod \"keda-operator-77f648d694-qm2xx\" (UID: \"04a9f9f1-5021-48ef-ac26-a4fb0f130059\") " pod="openshift-keda/keda-operator-77f648d694-qm2xx"
Jul 15 10:50:58.437415 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:58.437239    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5lbm\" (UniqueName: \"kubernetes.io/projected/04a9f9f1-5021-48ef-ac26-a4fb0f130059-kube-api-access-q5lbm\") pod \"keda-operator-77f648d694-qm2xx\" (UID: \"04a9f9f1-5021-48ef-ac26-a4fb0f130059\") " pod="openshift-keda/keda-operator-77f648d694-qm2xx"
Jul 15 10:50:58.437415 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:50:58.437318    2565 projected.go:266] Couldn't get secret openshift-keda/keda-operator-certs: secret "keda-operator-certs" not found
Jul 15 10:50:58.437415 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:50:58.437365    2565 secret.go:281] references non-existent secret key: ca.crt
Jul 15 10:50:58.437415 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:50:58.437380    2565 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
Jul 15 10:50:58.437415 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:50:58.437395    2565 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-77f648d694-qm2xx: [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt]
Jul 15 10:50:58.437567 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:50:58.437449    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04a9f9f1-5021-48ef-ac26-a4fb0f130059-certificates podName:04a9f9f1-5021-48ef-ac26-a4fb0f130059 nodeName:}" failed. No retries permitted until 2026-07-15 10:50:58.937434594 +0000 UTC m=+356.545970594 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/04a9f9f1-5021-48ef-ac26-a4fb0f130059-certificates") pod "keda-operator-77f648d694-qm2xx" (UID: "04a9f9f1-5021-48ef-ac26-a4fb0f130059") : [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt]
Jul 15 10:50:58.437906 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:58.437885    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/04a9f9f1-5021-48ef-ac26-a4fb0f130059-cabundle0\") pod \"keda-operator-77f648d694-qm2xx\" (UID: \"04a9f9f1-5021-48ef-ac26-a4fb0f130059\") " pod="openshift-keda/keda-operator-77f648d694-qm2xx"
Jul 15 10:50:58.450831 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:58.450803    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:50:58.452502 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:58.452483    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5lbm\" (UniqueName: \"kubernetes.io/projected/04a9f9f1-5021-48ef-ac26-a4fb0f130059-kube-api-access-q5lbm\") pod \"keda-operator-77f648d694-qm2xx\" (UID: \"04a9f9f1-5021-48ef-ac26-a4fb0f130059\") " pod="openshift-keda/keda-operator-77f648d694-qm2xx"
Jul 15 10:50:58.486757 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:58.486697    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-tbh45"]
Jul 15 10:50:58.490044 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:58.490028    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-tbh45"
Jul 15 10:50:58.493415 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:58.493389    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\""
Jul 15 10:50:58.499005 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:58.498620    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-v4flz" event={"ID":"70058638-b404-4704-8d41-94283c66892c","Type":"ContainerStarted","Data":"b5757fed9ae23bee8edd547fcbf83f74001794969e75f8faeb736db8101218d9"}
Jul 15 10:50:58.499005 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:58.498751    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-v4flz"
Jul 15 10:50:58.514947 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:58.514922    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-tbh45"]
Jul 15 10:50:58.528687 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:58.528638    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:50:58.537754 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:58.537731    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/29d352cc-0d04-46ea-823c-5a1d30bce286-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-tbh45\" (UID: \"29d352cc-0d04-46ea-823c-5a1d30bce286\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-tbh45"
Jul 15 10:50:58.537881 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:58.537767    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66mw4\" (UniqueName: \"kubernetes.io/projected/29d352cc-0d04-46ea-823c-5a1d30bce286-kube-api-access-66mw4\") pod \"keda-metrics-apiserver-55557df8c-tbh45\" (UID: \"29d352cc-0d04-46ea-823c-5a1d30bce286\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-tbh45"
Jul 15 10:50:58.537881 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:58.537862    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/29d352cc-0d04-46ea-823c-5a1d30bce286-certificates\") pod \"keda-metrics-apiserver-55557df8c-tbh45\" (UID: \"29d352cc-0d04-46ea-823c-5a1d30bce286\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-tbh45"
Jul 15 10:50:58.544888 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:58.544844    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-v4flz" podStartSLOduration=1.759735167 podStartE2EDuration="4.54482866s" totalImagesPullingTime="2.785093493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:50:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:50:58.544058103 +0000 UTC m=+356.152594139" watchObservedRunningTime="2026-07-15 10:50:58.54482866 +0000 UTC m=+356.153364682"
Jul 15 10:50:58.638526 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:58.638490    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/29d352cc-0d04-46ea-823c-5a1d30bce286-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-tbh45\" (UID: \"29d352cc-0d04-46ea-823c-5a1d30bce286\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-tbh45"
Jul 15 10:50:58.638689 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:58.638536    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66mw4\" (UniqueName: \"kubernetes.io/projected/29d352cc-0d04-46ea-823c-5a1d30bce286-kube-api-access-66mw4\") pod \"keda-metrics-apiserver-55557df8c-tbh45\" (UID: \"29d352cc-0d04-46ea-823c-5a1d30bce286\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-tbh45"
Jul 15 10:50:58.638689 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:58.638571    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/29d352cc-0d04-46ea-823c-5a1d30bce286-certificates\") pod \"keda-metrics-apiserver-55557df8c-tbh45\" (UID: \"29d352cc-0d04-46ea-823c-5a1d30bce286\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-tbh45"
Jul 15 10:50:58.638813 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:50:58.638691    2565 secret.go:281] references non-existent secret key: tls.crt
Jul 15 10:50:58.638813 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:50:58.638703    2565 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt
Jul 15 10:50:58.638813 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:50:58.638717    2565 projected.go:266] Couldn't get secret openshift-keda/keda-metrics-apiserver-certs: secret "keda-metrics-apiserver-certs" not found
Jul 15 10:50:58.638813 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:50:58.638732    2565 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-55557df8c-tbh45: [references non-existent secret key: tls.crt, secret "keda-metrics-apiserver-certs" not found]
Jul 15 10:50:58.638813 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:50:58.638787    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29d352cc-0d04-46ea-823c-5a1d30bce286-certificates podName:29d352cc-0d04-46ea-823c-5a1d30bce286 nodeName:}" failed. No retries permitted until 2026-07-15 10:50:59.138774084 +0000 UTC m=+356.747310084 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/29d352cc-0d04-46ea-823c-5a1d30bce286-certificates") pod "keda-metrics-apiserver-55557df8c-tbh45" (UID: "29d352cc-0d04-46ea-823c-5a1d30bce286") : [references non-existent secret key: tls.crt, secret "keda-metrics-apiserver-certs" not found]
Jul 15 10:50:58.639035 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:58.638930    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/29d352cc-0d04-46ea-823c-5a1d30bce286-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-tbh45\" (UID: \"29d352cc-0d04-46ea-823c-5a1d30bce286\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-tbh45"
Jul 15 10:50:58.660567 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:58.660543    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66mw4\" (UniqueName: \"kubernetes.io/projected/29d352cc-0d04-46ea-823c-5a1d30bce286-kube-api-access-66mw4\") pod \"keda-metrics-apiserver-55557df8c-tbh45\" (UID: \"29d352cc-0d04-46ea-823c-5a1d30bce286\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-tbh45"
Jul 15 10:50:58.714988 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:58.714948    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:50:58.940121 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:58.940084    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/04a9f9f1-5021-48ef-ac26-a4fb0f130059-certificates\") pod \"keda-operator-77f648d694-qm2xx\" (UID: \"04a9f9f1-5021-48ef-ac26-a4fb0f130059\") " pod="openshift-keda/keda-operator-77f648d694-qm2xx"
Jul 15 10:50:58.940301 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:50:58.940243    2565 secret.go:281] references non-existent secret key: ca.crt
Jul 15 10:50:58.940301 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:50:58.940259    2565 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
Jul 15 10:50:58.940301 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:50:58.940267    2565 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-77f648d694-qm2xx: references non-existent secret key: ca.crt
Jul 15 10:50:58.940423 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:50:58.940351    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04a9f9f1-5021-48ef-ac26-a4fb0f130059-certificates podName:04a9f9f1-5021-48ef-ac26-a4fb0f130059 nodeName:}" failed. No retries permitted until 2026-07-15 10:50:59.940317713 +0000 UTC m=+357.548853736 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/04a9f9f1-5021-48ef-ac26-a4fb0f130059-certificates") pod "keda-operator-77f648d694-qm2xx" (UID: "04a9f9f1-5021-48ef-ac26-a4fb0f130059") : references non-existent secret key: ca.crt
Jul 15 10:50:59.120595 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:59.120559    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:50:59.142629 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:59.142602    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/29d352cc-0d04-46ea-823c-5a1d30bce286-certificates\") pod \"keda-metrics-apiserver-55557df8c-tbh45\" (UID: \"29d352cc-0d04-46ea-823c-5a1d30bce286\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-tbh45"
Jul 15 10:50:59.142766 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:50:59.142751    2565 secret.go:281] references non-existent secret key: tls.crt
Jul 15 10:50:59.142809 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:50:59.142770    2565 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt
Jul 15 10:50:59.142809 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:50:59.142788    2565 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-55557df8c-tbh45: references non-existent secret key: tls.crt
Jul 15 10:50:59.142871 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:50:59.142854    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29d352cc-0d04-46ea-823c-5a1d30bce286-certificates podName:29d352cc-0d04-46ea-823c-5a1d30bce286 nodeName:}" failed. No retries permitted until 2026-07-15 10:51:00.142839261 +0000 UTC m=+357.751375261 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/29d352cc-0d04-46ea-823c-5a1d30bce286-certificates") pod "keda-metrics-apiserver-55557df8c-tbh45" (UID: "29d352cc-0d04-46ea-823c-5a1d30bce286") : references non-existent secret key: tls.crt
Jul 15 10:50:59.220385 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:59.220278    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-dz5kj"]
Jul 15 10:50:59.223842 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:59.223823    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-dz5kj"
Jul 15 10:50:59.226553 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:59.226528    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\""
Jul 15 10:50:59.237018 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:59.236995    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-dz5kj"]
Jul 15 10:50:59.344063 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:59.344034    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/da6ae0e8-40ad-4bbe-9382-dfdba75e7494-certificates\") pod \"keda-admission-56f9798bb4-dz5kj\" (UID: \"da6ae0e8-40ad-4bbe-9382-dfdba75e7494\") " pod="openshift-keda/keda-admission-56f9798bb4-dz5kj"
Jul 15 10:50:59.344235 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:59.344087    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcd7g\" (UniqueName: \"kubernetes.io/projected/da6ae0e8-40ad-4bbe-9382-dfdba75e7494-kube-api-access-lcd7g\") pod \"keda-admission-56f9798bb4-dz5kj\" (UID: \"da6ae0e8-40ad-4bbe-9382-dfdba75e7494\") " pod="openshift-keda/keda-admission-56f9798bb4-dz5kj"
Jul 15 10:50:59.397854 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:59.397819    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:50:59.444975 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:59.444942    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcd7g\" (UniqueName: \"kubernetes.io/projected/da6ae0e8-40ad-4bbe-9382-dfdba75e7494-kube-api-access-lcd7g\") pod \"keda-admission-56f9798bb4-dz5kj\" (UID: \"da6ae0e8-40ad-4bbe-9382-dfdba75e7494\") " pod="openshift-keda/keda-admission-56f9798bb4-dz5kj"
Jul 15 10:50:59.445110 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:59.445051    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/da6ae0e8-40ad-4bbe-9382-dfdba75e7494-certificates\") pod \"keda-admission-56f9798bb4-dz5kj\" (UID: \"da6ae0e8-40ad-4bbe-9382-dfdba75e7494\") " pod="openshift-keda/keda-admission-56f9798bb4-dz5kj"
Jul 15 10:50:59.447578 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:59.447555    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/da6ae0e8-40ad-4bbe-9382-dfdba75e7494-certificates\") pod \"keda-admission-56f9798bb4-dz5kj\" (UID: \"da6ae0e8-40ad-4bbe-9382-dfdba75e7494\") " pod="openshift-keda/keda-admission-56f9798bb4-dz5kj"
Jul 15 10:50:59.459256 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:59.459233    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcd7g\" (UniqueName: \"kubernetes.io/projected/da6ae0e8-40ad-4bbe-9382-dfdba75e7494-kube-api-access-lcd7g\") pod \"keda-admission-56f9798bb4-dz5kj\" (UID: \"da6ae0e8-40ad-4bbe-9382-dfdba75e7494\") " pod="openshift-keda/keda-admission-56f9798bb4-dz5kj"
Jul 15 10:50:59.493299 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:59.493233    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:50:59.534889 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:59.534859    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-dz5kj"
Jul 15 10:50:59.673126 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:59.673096    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-dz5kj"]
Jul 15 10:50:59.675204 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:50:59.675182    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda6ae0e8_40ad_4bbe_9382_dfdba75e7494.slice/crio-64476023a2db5cec56774c3695d0d12a738eaf2fadd476205a23e80d941f7995 WatchSource:0}: Error finding container 64476023a2db5cec56774c3695d0d12a738eaf2fadd476205a23e80d941f7995: Status 404 returned error can't find the container with id 64476023a2db5cec56774c3695d0d12a738eaf2fadd476205a23e80d941f7995
Jul 15 10:50:59.747434 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:59.747328    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:50:59.950208 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:59.950174    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/04a9f9f1-5021-48ef-ac26-a4fb0f130059-certificates\") pod \"keda-operator-77f648d694-qm2xx\" (UID: \"04a9f9f1-5021-48ef-ac26-a4fb0f130059\") " pod="openshift-keda/keda-operator-77f648d694-qm2xx"
Jul 15 10:50:59.952745 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:50:59.952720    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/04a9f9f1-5021-48ef-ac26-a4fb0f130059-certificates\") pod \"keda-operator-77f648d694-qm2xx\" (UID: \"04a9f9f1-5021-48ef-ac26-a4fb0f130059\") " pod="openshift-keda/keda-operator-77f648d694-qm2xx"
Jul 15 10:51:00.046010 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:51:00.045965    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-qm2xx"
Jul 15 10:51:00.072871 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:51:00.072840    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:51:00.153287 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:51:00.153250    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/29d352cc-0d04-46ea-823c-5a1d30bce286-certificates\") pod \"keda-metrics-apiserver-55557df8c-tbh45\" (UID: \"29d352cc-0d04-46ea-823c-5a1d30bce286\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-tbh45"
Jul 15 10:51:00.157208 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:51:00.157155    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/29d352cc-0d04-46ea-823c-5a1d30bce286-certificates\") pod \"keda-metrics-apiserver-55557df8c-tbh45\" (UID: \"29d352cc-0d04-46ea-823c-5a1d30bce286\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-tbh45"
Jul 15 10:51:00.171385 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:51:00.171328    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:51:00.185733 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:51:00.185714    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-qm2xx"]
Jul 15 10:51:00.187802 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:51:00.187778    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04a9f9f1_5021_48ef_ac26_a4fb0f130059.slice/crio-f40bcd52e145e6f75600b7f83303d2ea6eca5ae237c20b1e287ba724bbb27422 WatchSource:0}: Error finding container f40bcd52e145e6f75600b7f83303d2ea6eca5ae237c20b1e287ba724bbb27422: Status 404 returned error can't find the container with id f40bcd52e145e6f75600b7f83303d2ea6eca5ae237c20b1e287ba724bbb27422
Jul 15 10:51:00.268974 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:51:00.268944    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:51:00.304032 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:51:00.303953    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-tbh45"
Jul 15 10:51:00.458935 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:51:00.458901    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-tbh45"]
Jul 15 10:51:00.461562 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:51:00.461535    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29d352cc_0d04_46ea_823c_5a1d30bce286.slice/crio-6a5e9b694ae440b5ae8a2b21e872088fd3de8f2ff009be9b9c9fb9b01ce0c987 WatchSource:0}: Error finding container 6a5e9b694ae440b5ae8a2b21e872088fd3de8f2ff009be9b9c9fb9b01ce0c987: Status 404 returned error can't find the container with id 6a5e9b694ae440b5ae8a2b21e872088fd3de8f2ff009be9b9c9fb9b01ce0c987
Jul 15 10:51:00.509299 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:51:00.509263    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-qm2xx" event={"ID":"04a9f9f1-5021-48ef-ac26-a4fb0f130059","Type":"ContainerStarted","Data":"f40bcd52e145e6f75600b7f83303d2ea6eca5ae237c20b1e287ba724bbb27422"}
Jul 15 10:51:00.510666 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:51:00.510642    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-tbh45" event={"ID":"29d352cc-0d04-46ea-823c-5a1d30bce286","Type":"ContainerStarted","Data":"6a5e9b694ae440b5ae8a2b21e872088fd3de8f2ff009be9b9c9fb9b01ce0c987"}
Jul 15 10:51:00.511958 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:51:00.511923    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-dz5kj" event={"ID":"da6ae0e8-40ad-4bbe-9382-dfdba75e7494","Type":"ContainerStarted","Data":"64476023a2db5cec56774c3695d0d12a738eaf2fadd476205a23e80d941f7995"}
Jul 15 10:51:01.520598 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:51:01.520512    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-dz5kj" event={"ID":"da6ae0e8-40ad-4bbe-9382-dfdba75e7494","Type":"ContainerStarted","Data":"4e9ebad5b8bfdcad29b3a9080bffb1319b65a2b5e4fe09e4faff9f5f552de7a2"}
Jul 15 10:51:01.521073 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:51:01.520749    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-56f9798bb4-dz5kj"
Jul 15 10:51:01.542855 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:51:01.542174    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-56f9798bb4-dz5kj" podStartSLOduration=1.11417256 podStartE2EDuration="2.542151376s" totalImagesPullingTime="1.427978816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:50:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:51:01.540456441 +0000 UTC m=+359.148992464" watchObservedRunningTime="2026-07-15 10:51:01.542151376 +0000 UTC m=+359.150687397"
Jul 15 10:51:04.539775 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:51:04.539740    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-qm2xx" event={"ID":"04a9f9f1-5021-48ef-ac26-a4fb0f130059","Type":"ContainerStarted","Data":"9d64d3e52b52e0b4e7fa366d8aba333cf05a4c7a576831106c3d62cdfd3f3033"}
Jul 15 10:51:04.540237 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:51:04.539869    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-77f648d694-qm2xx"
Jul 15 10:51:04.541505 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:51:04.541485    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-tbh45" event={"ID":"29d352cc-0d04-46ea-823c-5a1d30bce286","Type":"ContainerStarted","Data":"43931176b64afb0bd458f003ce61bcffa60a9eac0a0fa75edc16cd7c45ca2217"}
Jul 15 10:51:04.541617 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:51:04.541603    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-tbh45"
Jul 15 10:51:04.560665 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:51:04.560612    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-77f648d694-qm2xx" podStartSLOduration=2.517319701 podStartE2EDuration="6.560599661s" totalImagesPullingTime="4.04327996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:50:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:51:04.559107576 +0000 UTC m=+362.167643598" watchObservedRunningTime="2026-07-15 10:51:04.560599661 +0000 UTC m=+362.169135683"
Jul 15 10:51:04.580777 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:51:04.580732    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-55557df8c-tbh45" podStartSLOduration=2.817512687 podStartE2EDuration="6.580713224s" totalImagesPullingTime="3.763200537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:50:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:51:04.578219564 +0000 UTC m=+362.186755587" watchObservedRunningTime="2026-07-15 10:51:04.580713224 +0000 UTC m=+362.189249249"
Jul 15 10:51:05.841167 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:51:05.841128    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:51:05.941323 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:51:05.941278    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:51:15.550434 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:51:15.550405    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-tbh45"
Jul 15 10:51:19.505971 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:51:19.505942    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-v4flz"
Jul 15 10:51:22.529479 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:51:22.529451    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-56f9798bb4-dz5kj"
Jul 15 10:51:25.548030 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:51:25.547992    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-77f648d694-qm2xx"
Jul 15 10:52:07.380542 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:07.380501    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:52:07.453021 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:07.452964    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:52:07.501148 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:07.501113    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-2k72z"]
Jul 15 10:52:07.504506 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:07.504490    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-2k72z"
Jul 15 10:52:07.507341 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:07.507313    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
Jul 15 10:52:07.507480 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:07.507313    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-6w842\""
Jul 15 10:52:07.507480 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:07.507392    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Jul 15 10:52:07.508474 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:07.508456    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Jul 15 10:52:07.518276 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:07.518256    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-2k72z"]
Jul 15 10:52:07.568811 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:07.568775    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:52:07.625783 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:07.625752    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n6bv\" (UniqueName: \"kubernetes.io/projected/086acc9e-3cf4-4d6d-a796-016489dfb974-kube-api-access-9n6bv\") pod \"seaweedfs-64568bcd49-2k72z\" (UID: \"086acc9e-3cf4-4d6d-a796-016489dfb974\") " pod="kserve/seaweedfs-64568bcd49-2k72z"
Jul 15 10:52:07.625783 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:07.625787    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/086acc9e-3cf4-4d6d-a796-016489dfb974-data\") pod \"seaweedfs-64568bcd49-2k72z\" (UID: \"086acc9e-3cf4-4d6d-a796-016489dfb974\") " pod="kserve/seaweedfs-64568bcd49-2k72z"
Jul 15 10:52:07.677146 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:07.677057    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:52:07.727242 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:07.727209    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n6bv\" (UniqueName: \"kubernetes.io/projected/086acc9e-3cf4-4d6d-a796-016489dfb974-kube-api-access-9n6bv\") pod \"seaweedfs-64568bcd49-2k72z\" (UID: \"086acc9e-3cf4-4d6d-a796-016489dfb974\") " pod="kserve/seaweedfs-64568bcd49-2k72z"
Jul 15 10:52:07.727425 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:07.727246    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/086acc9e-3cf4-4d6d-a796-016489dfb974-data\") pod \"seaweedfs-64568bcd49-2k72z\" (UID: \"086acc9e-3cf4-4d6d-a796-016489dfb974\") " pod="kserve/seaweedfs-64568bcd49-2k72z"
Jul 15 10:52:07.727633 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:07.727616    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/086acc9e-3cf4-4d6d-a796-016489dfb974-data\") pod \"seaweedfs-64568bcd49-2k72z\" (UID: \"086acc9e-3cf4-4d6d-a796-016489dfb974\") " pod="kserve/seaweedfs-64568bcd49-2k72z"
Jul 15 10:52:07.737483 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:07.737458    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n6bv\" (UniqueName: \"kubernetes.io/projected/086acc9e-3cf4-4d6d-a796-016489dfb974-kube-api-access-9n6bv\") pod \"seaweedfs-64568bcd49-2k72z\" (UID: \"086acc9e-3cf4-4d6d-a796-016489dfb974\") " pod="kserve/seaweedfs-64568bcd49-2k72z"
Jul 15 10:52:07.814326 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:07.814297    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-2k72z"
Jul 15 10:52:07.815879 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:07.815848    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:52:07.952188 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:07.952163    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-2k72z"]
Jul 15 10:52:07.953404 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:52:07.953379    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod086acc9e_3cf4_4d6d_a796_016489dfb974.slice/crio-4c33572e8b88615d2732852904ac1748b3f51c498a2f839b8aae17f8ac55ba79 WatchSource:0}: Error finding container 4c33572e8b88615d2732852904ac1748b3f51c498a2f839b8aae17f8ac55ba79: Status 404 returned error can't find the container with id 4c33572e8b88615d2732852904ac1748b3f51c498a2f839b8aae17f8ac55ba79
Jul 15 10:52:08.574040 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:08.574003    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:52:08.673764 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:08.673724    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:52:08.830251 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:08.830168    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-2k72z" event={"ID":"086acc9e-3cf4-4d6d-a796-016489dfb974","Type":"ContainerStarted","Data":"4c33572e8b88615d2732852904ac1748b3f51c498a2f839b8aae17f8ac55ba79"}
Jul 15 10:52:11.845716 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:11.845685    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-2k72z" event={"ID":"086acc9e-3cf4-4d6d-a796-016489dfb974","Type":"ContainerStarted","Data":"7e8f50a8f4fabbbbacad5d45e6a4aee2a6bc75164c758b768b27e81893d68d02"}
Jul 15 10:52:11.846136 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:11.845814    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-2k72z"
Jul 15 10:52:11.864161 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:11.864106    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-2k72z" podStartSLOduration=2.021097546 podStartE2EDuration="4.86409068s" totalImagesPullingTime="2.842993134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:52:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:52:11.863114529 +0000 UTC m=+429.471650551" watchObservedRunningTime="2026-07-15 10:52:11.86409068 +0000 UTC m=+429.472626703"
Jul 15 10:52:17.852409 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:17.852378    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-2k72z"
Jul 15 10:52:28.703830 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:28.703791    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5594f684f6-lnhnh"]
Jul 15 10:52:28.707407 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:28.707385    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5594f684f6-lnhnh"
Jul 15 10:52:28.721225 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:28.721204    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5594f684f6-lnhnh"]
Jul 15 10:52:28.755388 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:28.755329    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:52:28.805627 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:28.805598    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/503bc61a-f1b7-496f-a42b-2959eb478d1b-console-serving-cert\") pod \"console-5594f684f6-lnhnh\" (UID: \"503bc61a-f1b7-496f-a42b-2959eb478d1b\") " pod="openshift-console/console-5594f684f6-lnhnh"
Jul 15 10:52:28.805758 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:28.805638    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/503bc61a-f1b7-496f-a42b-2959eb478d1b-trusted-ca-bundle\") pod \"console-5594f684f6-lnhnh\" (UID: \"503bc61a-f1b7-496f-a42b-2959eb478d1b\") " pod="openshift-console/console-5594f684f6-lnhnh"
Jul 15 10:52:28.805758 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:28.805659    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/503bc61a-f1b7-496f-a42b-2959eb478d1b-oauth-serving-cert\") pod \"console-5594f684f6-lnhnh\" (UID: \"503bc61a-f1b7-496f-a42b-2959eb478d1b\") " pod="openshift-console/console-5594f684f6-lnhnh"
Jul 15 10:52:28.805758 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:28.805701    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqv5b\" (UniqueName: \"kubernetes.io/projected/503bc61a-f1b7-496f-a42b-2959eb478d1b-kube-api-access-hqv5b\") pod \"console-5594f684f6-lnhnh\" (UID: \"503bc61a-f1b7-496f-a42b-2959eb478d1b\") " pod="openshift-console/console-5594f684f6-lnhnh"
Jul 15 10:52:28.805866 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:28.805757    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/503bc61a-f1b7-496f-a42b-2959eb478d1b-console-oauth-config\") pod \"console-5594f684f6-lnhnh\" (UID: \"503bc61a-f1b7-496f-a42b-2959eb478d1b\") " pod="openshift-console/console-5594f684f6-lnhnh"
Jul 15 10:52:28.805866 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:28.805799    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/503bc61a-f1b7-496f-a42b-2959eb478d1b-console-config\") pod \"console-5594f684f6-lnhnh\" (UID: \"503bc61a-f1b7-496f-a42b-2959eb478d1b\") " pod="openshift-console/console-5594f684f6-lnhnh"
Jul 15 10:52:28.805866 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:28.805839    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/503bc61a-f1b7-496f-a42b-2959eb478d1b-service-ca\") pod \"console-5594f684f6-lnhnh\" (UID: \"503bc61a-f1b7-496f-a42b-2959eb478d1b\") " pod="openshift-console/console-5594f684f6-lnhnh"
Jul 15 10:52:28.906637 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:28.906603    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/503bc61a-f1b7-496f-a42b-2959eb478d1b-console-config\") pod \"console-5594f684f6-lnhnh\" (UID: \"503bc61a-f1b7-496f-a42b-2959eb478d1b\") " pod="openshift-console/console-5594f684f6-lnhnh"
Jul 15 10:52:28.906792 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:28.906648    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/503bc61a-f1b7-496f-a42b-2959eb478d1b-service-ca\") pod \"console-5594f684f6-lnhnh\" (UID: \"503bc61a-f1b7-496f-a42b-2959eb478d1b\") " pod="openshift-console/console-5594f684f6-lnhnh"
Jul 15 10:52:28.906792 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:28.906674    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/503bc61a-f1b7-496f-a42b-2959eb478d1b-console-serving-cert\") pod \"console-5594f684f6-lnhnh\" (UID: \"503bc61a-f1b7-496f-a42b-2959eb478d1b\") " pod="openshift-console/console-5594f684f6-lnhnh"
Jul 15 10:52:28.906792 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:28.906710    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/503bc61a-f1b7-496f-a42b-2959eb478d1b-trusted-ca-bundle\") pod \"console-5594f684f6-lnhnh\" (UID: \"503bc61a-f1b7-496f-a42b-2959eb478d1b\") " pod="openshift-console/console-5594f684f6-lnhnh"
Jul 15 10:52:28.906792 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:28.906728    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/503bc61a-f1b7-496f-a42b-2959eb478d1b-oauth-serving-cert\") pod \"console-5594f684f6-lnhnh\" (UID: \"503bc61a-f1b7-496f-a42b-2959eb478d1b\") " pod="openshift-console/console-5594f684f6-lnhnh"
Jul 15 10:52:28.906792 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:28.906744    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqv5b\" (UniqueName: \"kubernetes.io/projected/503bc61a-f1b7-496f-a42b-2959eb478d1b-kube-api-access-hqv5b\") pod \"console-5594f684f6-lnhnh\" (UID: \"503bc61a-f1b7-496f-a42b-2959eb478d1b\") " pod="openshift-console/console-5594f684f6-lnhnh"
Jul 15 10:52:28.906792 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:28.906776    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/503bc61a-f1b7-496f-a42b-2959eb478d1b-console-oauth-config\") pod \"console-5594f684f6-lnhnh\" (UID: \"503bc61a-f1b7-496f-a42b-2959eb478d1b\") " pod="openshift-console/console-5594f684f6-lnhnh"
Jul 15 10:52:28.907489 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:28.907461    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/503bc61a-f1b7-496f-a42b-2959eb478d1b-console-config\") pod \"console-5594f684f6-lnhnh\" (UID: \"503bc61a-f1b7-496f-a42b-2959eb478d1b\") " pod="openshift-console/console-5594f684f6-lnhnh"
Jul 15 10:52:28.907596 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:28.907461    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/503bc61a-f1b7-496f-a42b-2959eb478d1b-service-ca\") pod \"console-5594f684f6-lnhnh\" (UID: \"503bc61a-f1b7-496f-a42b-2959eb478d1b\") " pod="openshift-console/console-5594f684f6-lnhnh"
Jul 15 10:52:28.907596 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:28.907529    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/503bc61a-f1b7-496f-a42b-2959eb478d1b-oauth-serving-cert\") pod \"console-5594f684f6-lnhnh\" (UID: \"503bc61a-f1b7-496f-a42b-2959eb478d1b\") " pod="openshift-console/console-5594f684f6-lnhnh"
Jul 15 10:52:28.907806 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:28.907784    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/503bc61a-f1b7-496f-a42b-2959eb478d1b-trusted-ca-bundle\") pod \"console-5594f684f6-lnhnh\" (UID: \"503bc61a-f1b7-496f-a42b-2959eb478d1b\") " pod="openshift-console/console-5594f684f6-lnhnh"
Jul 15 10:52:28.909303 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:28.909283    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/503bc61a-f1b7-496f-a42b-2959eb478d1b-console-oauth-config\") pod \"console-5594f684f6-lnhnh\" (UID: \"503bc61a-f1b7-496f-a42b-2959eb478d1b\") " pod="openshift-console/console-5594f684f6-lnhnh"
Jul 15 10:52:28.909442 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:28.909411    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/503bc61a-f1b7-496f-a42b-2959eb478d1b-console-serving-cert\") pod \"console-5594f684f6-lnhnh\" (UID: \"503bc61a-f1b7-496f-a42b-2959eb478d1b\") " pod="openshift-console/console-5594f684f6-lnhnh"
Jul 15 10:52:28.915806 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:28.915783    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqv5b\" (UniqueName: \"kubernetes.io/projected/503bc61a-f1b7-496f-a42b-2959eb478d1b-kube-api-access-hqv5b\") pod \"console-5594f684f6-lnhnh\" (UID: \"503bc61a-f1b7-496f-a42b-2959eb478d1b\") " pod="openshift-console/console-5594f684f6-lnhnh"
Jul 15 10:52:29.016397 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:29.016315    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5594f684f6-lnhnh"
Jul 15 10:52:29.156014 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:29.155987    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5594f684f6-lnhnh"]
Jul 15 10:52:29.158074 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:52:29.158050    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod503bc61a_f1b7_496f_a42b_2959eb478d1b.slice/crio-ae007152106ffdfe06e08909a70d981ae60b8ec5f43b5f6ed938a3fdd9289605 WatchSource:0}: Error finding container ae007152106ffdfe06e08909a70d981ae60b8ec5f43b5f6ed938a3fdd9289605: Status 404 returned error can't find the container with id ae007152106ffdfe06e08909a70d981ae60b8ec5f43b5f6ed938a3fdd9289605
Jul 15 10:52:29.925457 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:29.925426    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5594f684f6-lnhnh" event={"ID":"503bc61a-f1b7-496f-a42b-2959eb478d1b","Type":"ContainerStarted","Data":"77296eadb0516a04036b1ad321f8526707d0f088076e7a8623be7d5c27f2bbbb"}
Jul 15 10:52:29.925850 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:29.925473    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5594f684f6-lnhnh" event={"ID":"503bc61a-f1b7-496f-a42b-2959eb478d1b","Type":"ContainerStarted","Data":"ae007152106ffdfe06e08909a70d981ae60b8ec5f43b5f6ed938a3fdd9289605"}
Jul 15 10:52:29.948997 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:29.948942    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5594f684f6-lnhnh" podStartSLOduration=1.9489250980000001 podStartE2EDuration="1.948925098s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:52:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:52:29.947063419 +0000 UTC m=+447.555599455" watchObservedRunningTime="2026-07-15 10:52:29.948925098 +0000 UTC m=+447.557461119"
Jul 15 10:52:35.405714 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:35.405683    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:52:35.506774 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:35.506740    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:52:39.017468 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:39.017412    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5594f684f6-lnhnh"
Jul 15 10:52:39.017968 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:39.017502    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5594f684f6-lnhnh"
Jul 15 10:52:39.022299 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:39.022276    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5594f684f6-lnhnh"
Jul 15 10:52:39.975025 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:39.974996    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5594f684f6-lnhnh"
Jul 15 10:52:40.034188 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:40.034143    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56d965464-bz8f2"]
Jul 15 10:52:40.147744 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:40.147707    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:52:40.248379 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:40.248275    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:52:40.309850 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:52:40.309816    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:53:05.057726 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:05.057674    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-56d965464-bz8f2" podUID="ed3f1b31-6dd2-4b69-a34f-e636ca00c290" containerName="console" containerID="cri-o://027207dc876cfdf942ff75bffbfb3b5a3d58506e8d6a3318ea4b207c88b728b8" gracePeriod=15
Jul 15 10:53:05.313576 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:05.313519    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56d965464-bz8f2"
Jul 15 10:53:05.417944 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:05.417907    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6nx4\" (UniqueName: \"kubernetes.io/projected/ed3f1b31-6dd2-4b69-a34f-e636ca00c290-kube-api-access-w6nx4\") pod \"ed3f1b31-6dd2-4b69-a34f-e636ca00c290\" (UID: \"ed3f1b31-6dd2-4b69-a34f-e636ca00c290\") "
Jul 15 10:53:05.418126 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:05.417958    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed3f1b31-6dd2-4b69-a34f-e636ca00c290-oauth-serving-cert\") pod \"ed3f1b31-6dd2-4b69-a34f-e636ca00c290\" (UID: \"ed3f1b31-6dd2-4b69-a34f-e636ca00c290\") "
Jul 15 10:53:05.418126 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:05.417999    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed3f1b31-6dd2-4b69-a34f-e636ca00c290-service-ca\") pod \"ed3f1b31-6dd2-4b69-a34f-e636ca00c290\" (UID: \"ed3f1b31-6dd2-4b69-a34f-e636ca00c290\") "
Jul 15 10:53:05.418126 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:05.418033    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed3f1b31-6dd2-4b69-a34f-e636ca00c290-trusted-ca-bundle\") pod \"ed3f1b31-6dd2-4b69-a34f-e636ca00c290\" (UID: \"ed3f1b31-6dd2-4b69-a34f-e636ca00c290\") "
Jul 15 10:53:05.418126 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:05.418060    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed3f1b31-6dd2-4b69-a34f-e636ca00c290-console-serving-cert\") pod \"ed3f1b31-6dd2-4b69-a34f-e636ca00c290\" (UID: \"ed3f1b31-6dd2-4b69-a34f-e636ca00c290\") "
Jul 15 10:53:05.418126 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:05.418097    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed3f1b31-6dd2-4b69-a34f-e636ca00c290-console-oauth-config\") pod \"ed3f1b31-6dd2-4b69-a34f-e636ca00c290\" (UID: \"ed3f1b31-6dd2-4b69-a34f-e636ca00c290\") "
Jul 15 10:53:05.418417 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:05.418147    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed3f1b31-6dd2-4b69-a34f-e636ca00c290-console-config\") pod \"ed3f1b31-6dd2-4b69-a34f-e636ca00c290\" (UID: \"ed3f1b31-6dd2-4b69-a34f-e636ca00c290\") "
Jul 15 10:53:05.418476 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:05.418403    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed3f1b31-6dd2-4b69-a34f-e636ca00c290-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ed3f1b31-6dd2-4b69-a34f-e636ca00c290" (UID: "ed3f1b31-6dd2-4b69-a34f-e636ca00c290"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:53:05.418536 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:05.418465    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed3f1b31-6dd2-4b69-a34f-e636ca00c290-service-ca" (OuterVolumeSpecName: "service-ca") pod "ed3f1b31-6dd2-4b69-a34f-e636ca00c290" (UID: "ed3f1b31-6dd2-4b69-a34f-e636ca00c290"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:53:05.418536 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:05.418495    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed3f1b31-6dd2-4b69-a34f-e636ca00c290-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ed3f1b31-6dd2-4b69-a34f-e636ca00c290" (UID: "ed3f1b31-6dd2-4b69-a34f-e636ca00c290"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:53:05.418755 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:05.418733    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed3f1b31-6dd2-4b69-a34f-e636ca00c290-console-config" (OuterVolumeSpecName: "console-config") pod "ed3f1b31-6dd2-4b69-a34f-e636ca00c290" (UID: "ed3f1b31-6dd2-4b69-a34f-e636ca00c290"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:53:05.420373 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:05.420325    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed3f1b31-6dd2-4b69-a34f-e636ca00c290-kube-api-access-w6nx4" (OuterVolumeSpecName: "kube-api-access-w6nx4") pod "ed3f1b31-6dd2-4b69-a34f-e636ca00c290" (UID: "ed3f1b31-6dd2-4b69-a34f-e636ca00c290"). InnerVolumeSpecName "kube-api-access-w6nx4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 10:53:05.420544 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:05.420523    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed3f1b31-6dd2-4b69-a34f-e636ca00c290-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ed3f1b31-6dd2-4b69-a34f-e636ca00c290" (UID: "ed3f1b31-6dd2-4b69-a34f-e636ca00c290"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 10:53:05.420661 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:05.420638    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed3f1b31-6dd2-4b69-a34f-e636ca00c290-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ed3f1b31-6dd2-4b69-a34f-e636ca00c290" (UID: "ed3f1b31-6dd2-4b69-a34f-e636ca00c290"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 10:53:05.519473 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:05.519437    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed3f1b31-6dd2-4b69-a34f-e636ca00c290-console-oauth-config\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:53:05.519473 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:05.519465    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed3f1b31-6dd2-4b69-a34f-e636ca00c290-console-config\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:53:05.519473 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:05.519475    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6nx4\" (UniqueName: \"kubernetes.io/projected/ed3f1b31-6dd2-4b69-a34f-e636ca00c290-kube-api-access-w6nx4\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:53:05.519473 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:05.519484    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed3f1b31-6dd2-4b69-a34f-e636ca00c290-oauth-serving-cert\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:53:05.519747 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:05.519494    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed3f1b31-6dd2-4b69-a34f-e636ca00c290-service-ca\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:53:05.519747 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:05.519503    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed3f1b31-6dd2-4b69-a34f-e636ca00c290-trusted-ca-bundle\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:53:05.519747 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:05.519511    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed3f1b31-6dd2-4b69-a34f-e636ca00c290-console-serving-cert\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:53:06.089486 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:06.089442    2565 generic.go:356] "Generic (PLEG): container finished" podID="ed3f1b31-6dd2-4b69-a34f-e636ca00c290" containerID="027207dc876cfdf942ff75bffbfb3b5a3d58506e8d6a3318ea4b207c88b728b8" exitCode=0
Jul 15 10:53:06.089486 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:06.089489    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56d965464-bz8f2"
Jul 15 10:53:06.090019 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:06.089508    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56d965464-bz8f2" event={"ID":"ed3f1b31-6dd2-4b69-a34f-e636ca00c290","Type":"ContainerDied","Data":"027207dc876cfdf942ff75bffbfb3b5a3d58506e8d6a3318ea4b207c88b728b8"}
Jul 15 10:53:06.090019 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:06.089555    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56d965464-bz8f2" event={"ID":"ed3f1b31-6dd2-4b69-a34f-e636ca00c290","Type":"ContainerDied","Data":"7b364788c120428707d8e3cc5a950e4af1304d389d1e92e275e04f02e343a941"}
Jul 15 10:53:06.090019 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:06.089578    2565 scope.go:117] "RemoveContainer" containerID="027207dc876cfdf942ff75bffbfb3b5a3d58506e8d6a3318ea4b207c88b728b8"
Jul 15 10:53:06.098907 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:06.098889    2565 scope.go:117] "RemoveContainer" containerID="027207dc876cfdf942ff75bffbfb3b5a3d58506e8d6a3318ea4b207c88b728b8"
Jul 15 10:53:06.099166 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:53:06.099147    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"027207dc876cfdf942ff75bffbfb3b5a3d58506e8d6a3318ea4b207c88b728b8\": container with ID starting with 027207dc876cfdf942ff75bffbfb3b5a3d58506e8d6a3318ea4b207c88b728b8 not found: ID does not exist" containerID="027207dc876cfdf942ff75bffbfb3b5a3d58506e8d6a3318ea4b207c88b728b8"
Jul 15 10:53:06.099208 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:06.099175    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"027207dc876cfdf942ff75bffbfb3b5a3d58506e8d6a3318ea4b207c88b728b8"} err="failed to get container status \"027207dc876cfdf942ff75bffbfb3b5a3d58506e8d6a3318ea4b207c88b728b8\": rpc error: code = NotFound desc = could not find container \"027207dc876cfdf942ff75bffbfb3b5a3d58506e8d6a3318ea4b207c88b728b8\": container with ID starting with 027207dc876cfdf942ff75bffbfb3b5a3d58506e8d6a3318ea4b207c88b728b8 not found: ID does not exist"
Jul 15 10:53:06.113879 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:06.113856    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56d965464-bz8f2"]
Jul 15 10:53:06.118878 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:06.118858    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56d965464-bz8f2"]
Jul 15 10:53:06.924978 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:06.924941    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed3f1b31-6dd2-4b69-a34f-e636ca00c290" path="/var/lib/kubelet/pods/ed3f1b31-6dd2-4b69-a34f-e636ca00c290/volumes"
Jul 15 10:53:26.469066 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:26.469029    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:53:26.517075 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:26.516990    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-fd65d7d6-xd64c"]
Jul 15 10:53:26.517390 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:26.517372    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed3f1b31-6dd2-4b69-a34f-e636ca00c290" containerName="console"
Jul 15 10:53:26.517448 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:26.517391    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed3f1b31-6dd2-4b69-a34f-e636ca00c290" containerName="console"
Jul 15 10:53:26.517502 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:26.517482    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed3f1b31-6dd2-4b69-a34f-e636ca00c290" containerName="console"
Jul 15 10:53:26.520521 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:26.520502    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-xd64c"
Jul 15 10:53:26.524994 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:26.524979    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\""
Jul 15 10:53:26.525096 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:26.525078    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-pzbtb\""
Jul 15 10:53:26.533946 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:26.533921    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-xd64c"]
Jul 15 10:53:26.564138 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:26.564100    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:53:26.592951 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:26.592919    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73849c75-1bbb-40f9-aa81-48cbccc58a47-tls-certs\") pod \"model-serving-api-fd65d7d6-xd64c\" (UID: \"73849c75-1bbb-40f9-aa81-48cbccc58a47\") " pod="kserve/model-serving-api-fd65d7d6-xd64c"
Jul 15 10:53:26.593060 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:26.592962    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd7fj\" (UniqueName: \"kubernetes.io/projected/73849c75-1bbb-40f9-aa81-48cbccc58a47-kube-api-access-jd7fj\") pod \"model-serving-api-fd65d7d6-xd64c\" (UID: \"73849c75-1bbb-40f9-aa81-48cbccc58a47\") " pod="kserve/model-serving-api-fd65d7d6-xd64c"
Jul 15 10:53:26.675398 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:26.675362    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:53:26.693467 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:26.693439    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73849c75-1bbb-40f9-aa81-48cbccc58a47-tls-certs\") pod \"model-serving-api-fd65d7d6-xd64c\" (UID: \"73849c75-1bbb-40f9-aa81-48cbccc58a47\") " pod="kserve/model-serving-api-fd65d7d6-xd64c"
Jul 15 10:53:26.693665 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:26.693485    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd7fj\" (UniqueName: \"kubernetes.io/projected/73849c75-1bbb-40f9-aa81-48cbccc58a47-kube-api-access-jd7fj\") pod \"model-serving-api-fd65d7d6-xd64c\" (UID: \"73849c75-1bbb-40f9-aa81-48cbccc58a47\") " pod="kserve/model-serving-api-fd65d7d6-xd64c"
Jul 15 10:53:26.695983 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:26.695954    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73849c75-1bbb-40f9-aa81-48cbccc58a47-tls-certs\") pod \"model-serving-api-fd65d7d6-xd64c\" (UID: \"73849c75-1bbb-40f9-aa81-48cbccc58a47\") " pod="kserve/model-serving-api-fd65d7d6-xd64c"
Jul 15 10:53:26.703221 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:26.703197    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd7fj\" (UniqueName: \"kubernetes.io/projected/73849c75-1bbb-40f9-aa81-48cbccc58a47-kube-api-access-jd7fj\") pod \"model-serving-api-fd65d7d6-xd64c\" (UID: \"73849c75-1bbb-40f9-aa81-48cbccc58a47\") " pod="kserve/model-serving-api-fd65d7d6-xd64c"
Jul 15 10:53:26.831189 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:26.831150    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-xd64c"
Jul 15 10:53:26.966707 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:26.966682    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-xd64c"]
Jul 15 10:53:26.968433 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:53:26.968399    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73849c75_1bbb_40f9_aa81_48cbccc58a47.slice/crio-96f4b9b0c3b39a71c4eb0c9a1548e7aa9890e8c27fa0b3331d0ab2aa90e929d8 WatchSource:0}: Error finding container 96f4b9b0c3b39a71c4eb0c9a1548e7aa9890e8c27fa0b3331d0ab2aa90e929d8: Status 404 returned error can't find the container with id 96f4b9b0c3b39a71c4eb0c9a1548e7aa9890e8c27fa0b3331d0ab2aa90e929d8
Jul 15 10:53:27.088189 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:27.088083    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:53:27.190040 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:27.190008    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-xd64c" event={"ID":"73849c75-1bbb-40f9-aa81-48cbccc58a47","Type":"ContainerStarted","Data":"96f4b9b0c3b39a71c4eb0c9a1548e7aa9890e8c27fa0b3331d0ab2aa90e929d8"}
Jul 15 10:53:27.205030 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:27.204995    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:53:27.271723 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:27.271678    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:53:30.209586 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:30.209556    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-xd64c" event={"ID":"73849c75-1bbb-40f9-aa81-48cbccc58a47","Type":"ContainerStarted","Data":"76adbd2f5c8b6c420fb45de35c5d9a30bfd8df2eba3fa8b2d76461b8970d4b0f"}
Jul 15 10:53:30.209989 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:30.209694    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-fd65d7d6-xd64c"
Jul 15 10:53:30.229326 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:30.229280    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-fd65d7d6-xd64c" podStartSLOduration=1.9978618099999998 podStartE2EDuration="4.229266927s" totalImagesPullingTime="2.231405117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:53:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:53:30.228039902 +0000 UTC m=+507.836575924" watchObservedRunningTime="2026-07-15 10:53:30.229266927 +0000 UTC m=+507.837802949"
Jul 15 10:53:41.218472 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:53:41.218443    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-fd65d7d6-xd64c"
Jul 15 10:54:00.508746 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:54:00.508641    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:54:00.569046 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:54:00.569008    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:54:13.064967 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:54:13.064930    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:54:13.187370 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:54:13.187321    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:54:13.763480 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:54:13.763445    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:55:00.704100 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:00.704059    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:55:01.613060 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:01.613022    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:55:02.854752 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:02.854723    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8dcjj_8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9/console-operator/1.log"
Jul 15 10:55:02.855768 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:02.855750    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8dcjj_8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9/console-operator/1.log"
Jul 15 10:55:02.859043 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:02.859016    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qsch8_f3b175c1-34f8-4e74-bce6-f866e4bd25b0/ovn-acl-logging/0.log"
Jul 15 10:55:02.860083 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:02.860066    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qsch8_f3b175c1-34f8-4e74-bce6-f866e4bd25b0/ovn-acl-logging/0.log"
Jul 15 10:55:09.979006 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:09.978969    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-custom-8b44d767d-xdznt"]
Jul 15 10:55:09.982282 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:09.982265    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-8b44d767d-xdznt"
Jul 15 10:55:09.985147 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:09.985121    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\""
Jul 15 10:55:09.985147 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:09.985131    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom\""
Jul 15 10:55:09.991977 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:09.991955    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-8b44d767d-xdznt"]
Jul 15 10:55:10.087587 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:10.087548    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/df83f298-00e3-494d-b2f9-3d099356ea46-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-8b44d767d-xdznt\" (UID: \"df83f298-00e3-494d-b2f9-3d099356ea46\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-xdznt"
Jul 15 10:55:10.087775 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:10.087614    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/df83f298-00e3-494d-b2f9-3d099356ea46-data\") pod \"seaweedfs-tls-custom-8b44d767d-xdznt\" (UID: \"df83f298-00e3-494d-b2f9-3d099356ea46\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-xdznt"
Jul 15 10:55:10.087836 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:10.087775    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqpnc\" (UniqueName: \"kubernetes.io/projected/df83f298-00e3-494d-b2f9-3d099356ea46-kube-api-access-tqpnc\") pod \"seaweedfs-tls-custom-8b44d767d-xdznt\" (UID: \"df83f298-00e3-494d-b2f9-3d099356ea46\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-xdznt"
Jul 15 10:55:10.188305 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:10.188258    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/df83f298-00e3-494d-b2f9-3d099356ea46-data\") pod \"seaweedfs-tls-custom-8b44d767d-xdznt\" (UID: \"df83f298-00e3-494d-b2f9-3d099356ea46\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-xdznt"
Jul 15 10:55:10.188527 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:10.188384    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqpnc\" (UniqueName: \"kubernetes.io/projected/df83f298-00e3-494d-b2f9-3d099356ea46-kube-api-access-tqpnc\") pod \"seaweedfs-tls-custom-8b44d767d-xdznt\" (UID: \"df83f298-00e3-494d-b2f9-3d099356ea46\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-xdznt"
Jul 15 10:55:10.188527 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:10.188423    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/df83f298-00e3-494d-b2f9-3d099356ea46-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-8b44d767d-xdznt\" (UID: \"df83f298-00e3-494d-b2f9-3d099356ea46\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-xdznt"
Jul 15 10:55:10.188677 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:10.188654    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/df83f298-00e3-494d-b2f9-3d099356ea46-data\") pod \"seaweedfs-tls-custom-8b44d767d-xdznt\" (UID: \"df83f298-00e3-494d-b2f9-3d099356ea46\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-xdznt"
Jul 15 10:55:10.191025 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:10.190999    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/df83f298-00e3-494d-b2f9-3d099356ea46-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-8b44d767d-xdznt\" (UID: \"df83f298-00e3-494d-b2f9-3d099356ea46\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-xdznt"
Jul 15 10:55:10.197360 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:10.197322    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqpnc\" (UniqueName: \"kubernetes.io/projected/df83f298-00e3-494d-b2f9-3d099356ea46-kube-api-access-tqpnc\") pod \"seaweedfs-tls-custom-8b44d767d-xdznt\" (UID: \"df83f298-00e3-494d-b2f9-3d099356ea46\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-xdznt"
Jul 15 10:55:10.292507 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:10.292480    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-8b44d767d-xdznt"
Jul 15 10:55:10.428589 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:10.428561    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-8b44d767d-xdznt"]
Jul 15 10:55:10.431106 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:55:10.431072    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf83f298_00e3_494d_b2f9_3d099356ea46.slice/crio-499157267ea3018b603d209f95043f301a87c68a69bdedc34fc9c302e88ba386 WatchSource:0}: Error finding container 499157267ea3018b603d209f95043f301a87c68a69bdedc34fc9c302e88ba386: Status 404 returned error can't find the container with id 499157267ea3018b603d209f95043f301a87c68a69bdedc34fc9c302e88ba386
Jul 15 10:55:10.664611 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:10.664521    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-8b44d767d-xdznt" event={"ID":"df83f298-00e3-494d-b2f9-3d099356ea46","Type":"ContainerStarted","Data":"499157267ea3018b603d209f95043f301a87c68a69bdedc34fc9c302e88ba386"}
Jul 15 10:55:11.670546 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:11.670509    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-8b44d767d-xdznt" event={"ID":"df83f298-00e3-494d-b2f9-3d099356ea46","Type":"ContainerStarted","Data":"5466c82f7fa215c7d34df3ac13a5d2c4b3529ec279900d6fa6142404d522058e"}
Jul 15 10:55:11.689397 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:11.689311    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-tls-custom-8b44d767d-xdznt" podStartSLOduration=2.417524678 podStartE2EDuration="2.689290696s" totalImagesPullingTime="271.766018ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:55:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:55:11.68843415 +0000 UTC m=+609.296970173" watchObservedRunningTime="2026-07-15 10:55:11.689290696 +0000 UTC m=+609.297826717"
Jul 15 10:55:22.588005 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:22.587970    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:55:22.588484 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:22.588404    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-s2tkh"]
Jul 15 10:55:22.593229 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:22.593212    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-serving-67b7477c6d-s2tkh"
Jul 15 10:55:22.595763 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:22.595739    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving\""
Jul 15 10:55:22.595909 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:22.595893    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving-artifact\""
Jul 15 10:55:22.601954 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:22.601933    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-s2tkh"]
Jul 15 10:55:22.691132 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:22.691099    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzbt6\" (UniqueName: \"kubernetes.io/projected/c1edc632-eee9-4cae-8bd7-3b5d5706fdcf-kube-api-access-gzbt6\") pod \"seaweedfs-tls-serving-67b7477c6d-s2tkh\" (UID: \"c1edc632-eee9-4cae-8bd7-3b5d5706fdcf\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-s2tkh"
Jul 15 10:55:22.691299 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:22.691138    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/c1edc632-eee9-4cae-8bd7-3b5d5706fdcf-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-s2tkh\" (UID: \"c1edc632-eee9-4cae-8bd7-3b5d5706fdcf\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-s2tkh"
Jul 15 10:55:22.691299 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:22.691163    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c1edc632-eee9-4cae-8bd7-3b5d5706fdcf-data\") pod \"seaweedfs-tls-serving-67b7477c6d-s2tkh\" (UID: \"c1edc632-eee9-4cae-8bd7-3b5d5706fdcf\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-s2tkh"
Jul 15 10:55:22.791833 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:22.791802    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzbt6\" (UniqueName: \"kubernetes.io/projected/c1edc632-eee9-4cae-8bd7-3b5d5706fdcf-kube-api-access-gzbt6\") pod \"seaweedfs-tls-serving-67b7477c6d-s2tkh\" (UID: \"c1edc632-eee9-4cae-8bd7-3b5d5706fdcf\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-s2tkh"
Jul 15 10:55:22.792007 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:22.791844    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/c1edc632-eee9-4cae-8bd7-3b5d5706fdcf-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-s2tkh\" (UID: \"c1edc632-eee9-4cae-8bd7-3b5d5706fdcf\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-s2tkh"
Jul 15 10:55:22.792007 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:22.791896    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c1edc632-eee9-4cae-8bd7-3b5d5706fdcf-data\") pod \"seaweedfs-tls-serving-67b7477c6d-s2tkh\" (UID: \"c1edc632-eee9-4cae-8bd7-3b5d5706fdcf\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-s2tkh"
Jul 15 10:55:22.792186 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:55:22.792163    2565 projected.go:266] Couldn't get secret kserve/seaweedfs-tls-serving: secret "seaweedfs-tls-serving" not found
Jul 15 10:55:22.792235 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:55:22.792191    2565 projected.go:196] Error preparing data for projected volume seaweedfs-tls-serving for pod kserve/seaweedfs-tls-serving-67b7477c6d-s2tkh: secret "seaweedfs-tls-serving" not found
Jul 15 10:55:22.792270 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:55:22.792254    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1edc632-eee9-4cae-8bd7-3b5d5706fdcf-seaweedfs-tls-serving podName:c1edc632-eee9-4cae-8bd7-3b5d5706fdcf nodeName:}" failed. No retries permitted until 2026-07-15 10:55:23.292235065 +0000 UTC m=+620.900771067 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "seaweedfs-tls-serving" (UniqueName: "kubernetes.io/projected/c1edc632-eee9-4cae-8bd7-3b5d5706fdcf-seaweedfs-tls-serving") pod "seaweedfs-tls-serving-67b7477c6d-s2tkh" (UID: "c1edc632-eee9-4cae-8bd7-3b5d5706fdcf") : secret "seaweedfs-tls-serving" not found
Jul 15 10:55:22.792510 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:22.792283    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c1edc632-eee9-4cae-8bd7-3b5d5706fdcf-data\") pod \"seaweedfs-tls-serving-67b7477c6d-s2tkh\" (UID: \"c1edc632-eee9-4cae-8bd7-3b5d5706fdcf\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-s2tkh"
Jul 15 10:55:22.808974 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:22.808945    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzbt6\" (UniqueName: \"kubernetes.io/projected/c1edc632-eee9-4cae-8bd7-3b5d5706fdcf-kube-api-access-gzbt6\") pod \"seaweedfs-tls-serving-67b7477c6d-s2tkh\" (UID: \"c1edc632-eee9-4cae-8bd7-3b5d5706fdcf\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-s2tkh"
Jul 15 10:55:23.194068 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:23.194027    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:55:23.296979 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:23.296944    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/c1edc632-eee9-4cae-8bd7-3b5d5706fdcf-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-s2tkh\" (UID: \"c1edc632-eee9-4cae-8bd7-3b5d5706fdcf\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-s2tkh"
Jul 15 10:55:23.299567 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:23.299534    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/c1edc632-eee9-4cae-8bd7-3b5d5706fdcf-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-s2tkh\" (UID: \"c1edc632-eee9-4cae-8bd7-3b5d5706fdcf\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-s2tkh"
Jul 15 10:55:23.504167 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:23.504087    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-serving-67b7477c6d-s2tkh"
Jul 15 10:55:23.645536 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:23.645512    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-s2tkh"]
Jul 15 10:55:23.648020 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:55:23.647995    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1edc632_eee9_4cae_8bd7_3b5d5706fdcf.slice/crio-94f50d9344705b2111b99059158fbdb915a0302c8c8914e08142322dae8521f1 WatchSource:0}: Error finding container 94f50d9344705b2111b99059158fbdb915a0302c8c8914e08142322dae8521f1: Status 404 returned error can't find the container with id 94f50d9344705b2111b99059158fbdb915a0302c8c8914e08142322dae8521f1
Jul 15 10:55:23.731445 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:23.731407    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-serving-67b7477c6d-s2tkh" event={"ID":"c1edc632-eee9-4cae-8bd7-3b5d5706fdcf","Type":"ContainerStarted","Data":"94f50d9344705b2111b99059158fbdb915a0302c8c8914e08142322dae8521f1"}
Jul 15 10:55:24.736866 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:24.736830    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-serving-67b7477c6d-s2tkh" event={"ID":"c1edc632-eee9-4cae-8bd7-3b5d5706fdcf","Type":"ContainerStarted","Data":"f3f37abb44141ae3ed0fd5da0422c1ebe4b8ab13dd5d515d1e149b98627d01fc"}
Jul 15 10:55:24.757772 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:24.757722    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-tls-serving-67b7477c6d-s2tkh" podStartSLOduration=2.511523734 podStartE2EDuration="2.757706866s" totalImagesPullingTime="246.183132ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:55:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:55:24.756706433 +0000 UTC m=+622.365242455" watchObservedRunningTime="2026-07-15 10:55:24.757706866 +0000 UTC m=+622.366242887"
Jul 15 10:55:36.376012 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:36.375982    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:55:37.900354 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:37.900290    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:55:48.312032 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:48.311987    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:55:48.508955 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:48.508920    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn"]
Jul 15 10:55:48.512487 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:48.512469    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn"
Jul 15 10:55:48.515559 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:48.515534    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-55dm9\""
Jul 15 10:55:48.515689 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:48.515589    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 15 10:55:48.516386 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:48.516360    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 15 10:55:48.516386 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:48.516362    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-batcher-kube-rbac-proxy-sar-config\""
Jul 15 10:55:48.516557 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:48.516456    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-batcher-predictor-serving-cert\""
Jul 15 10:55:48.516630 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:48.516618    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 15 10:55:48.517117 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:48.517099    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 15 10:55:48.573475 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:48.573395    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn"]
Jul 15 10:55:48.626948 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:48.626913    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3cd05416-44af-454c-b1a0-ed819dbcae2d-proxy-tls\") pod \"isvc-sklearn-batcher-predictor-75c6848b55-pwbpn\" (UID: \"3cd05416-44af-454c-b1a0-ed819dbcae2d\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn"
Jul 15 10:55:48.627141 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:48.626959    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3cd05416-44af-454c-b1a0-ed819dbcae2d-kserve-provision-location\") pod \"isvc-sklearn-batcher-predictor-75c6848b55-pwbpn\" (UID: \"3cd05416-44af-454c-b1a0-ed819dbcae2d\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn"
Jul 15 10:55:48.627141 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:48.627089    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/3cd05416-44af-454c-b1a0-ed819dbcae2d-cabundle-cert\") pod \"isvc-sklearn-batcher-predictor-75c6848b55-pwbpn\" (UID: \"3cd05416-44af-454c-b1a0-ed819dbcae2d\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn"
Jul 15 10:55:48.627260 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:48.627142    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3cd05416-44af-454c-b1a0-ed819dbcae2d-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-batcher-predictor-75c6848b55-pwbpn\" (UID: \"3cd05416-44af-454c-b1a0-ed819dbcae2d\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn"
Jul 15 10:55:48.627260 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:48.627210    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52795\" (UniqueName: \"kubernetes.io/projected/3cd05416-44af-454c-b1a0-ed819dbcae2d-kube-api-access-52795\") pod \"isvc-sklearn-batcher-predictor-75c6848b55-pwbpn\" (UID: \"3cd05416-44af-454c-b1a0-ed819dbcae2d\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn"
Jul 15 10:55:48.728306 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:48.728268    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3cd05416-44af-454c-b1a0-ed819dbcae2d-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-batcher-predictor-75c6848b55-pwbpn\" (UID: \"3cd05416-44af-454c-b1a0-ed819dbcae2d\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn"
Jul 15 10:55:48.728552 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:48.728326    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52795\" (UniqueName: \"kubernetes.io/projected/3cd05416-44af-454c-b1a0-ed819dbcae2d-kube-api-access-52795\") pod \"isvc-sklearn-batcher-predictor-75c6848b55-pwbpn\" (UID: \"3cd05416-44af-454c-b1a0-ed819dbcae2d\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn"
Jul 15 10:55:48.728552 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:48.728375    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3cd05416-44af-454c-b1a0-ed819dbcae2d-proxy-tls\") pod \"isvc-sklearn-batcher-predictor-75c6848b55-pwbpn\" (UID: \"3cd05416-44af-454c-b1a0-ed819dbcae2d\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn"
Jul 15 10:55:48.728552 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:48.728407    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3cd05416-44af-454c-b1a0-ed819dbcae2d-kserve-provision-location\") pod \"isvc-sklearn-batcher-predictor-75c6848b55-pwbpn\" (UID: \"3cd05416-44af-454c-b1a0-ed819dbcae2d\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn"
Jul 15 10:55:48.728552 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:48.728468    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/3cd05416-44af-454c-b1a0-ed819dbcae2d-cabundle-cert\") pod \"isvc-sklearn-batcher-predictor-75c6848b55-pwbpn\" (UID: \"3cd05416-44af-454c-b1a0-ed819dbcae2d\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn"
Jul 15 10:55:48.728790 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:55:48.728578    2565 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-serving-cert: secret "isvc-sklearn-batcher-predictor-serving-cert" not found
Jul 15 10:55:48.728790 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:55:48.728637    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cd05416-44af-454c-b1a0-ed819dbcae2d-proxy-tls podName:3cd05416-44af-454c-b1a0-ed819dbcae2d nodeName:}" failed. No retries permitted until 2026-07-15 10:55:49.228621679 +0000 UTC m=+646.837157683 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/3cd05416-44af-454c-b1a0-ed819dbcae2d-proxy-tls") pod "isvc-sklearn-batcher-predictor-75c6848b55-pwbpn" (UID: "3cd05416-44af-454c-b1a0-ed819dbcae2d") : secret "isvc-sklearn-batcher-predictor-serving-cert" not found
Jul 15 10:55:48.728992 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:48.728965    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3cd05416-44af-454c-b1a0-ed819dbcae2d-kserve-provision-location\") pod \"isvc-sklearn-batcher-predictor-75c6848b55-pwbpn\" (UID: \"3cd05416-44af-454c-b1a0-ed819dbcae2d\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn"
Jul 15 10:55:48.729216 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:48.729194    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3cd05416-44af-454c-b1a0-ed819dbcae2d-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-batcher-predictor-75c6848b55-pwbpn\" (UID: \"3cd05416-44af-454c-b1a0-ed819dbcae2d\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn"
Jul 15 10:55:48.729287 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:48.729198    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/3cd05416-44af-454c-b1a0-ed819dbcae2d-cabundle-cert\") pod \"isvc-sklearn-batcher-predictor-75c6848b55-pwbpn\" (UID: \"3cd05416-44af-454c-b1a0-ed819dbcae2d\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn"
Jul 15 10:55:48.742991 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:48.742968    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52795\" (UniqueName: \"kubernetes.io/projected/3cd05416-44af-454c-b1a0-ed819dbcae2d-kube-api-access-52795\") pod \"isvc-sklearn-batcher-predictor-75c6848b55-pwbpn\" (UID: \"3cd05416-44af-454c-b1a0-ed819dbcae2d\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn"
Jul 15 10:55:48.999450 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:48.999355    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:55:49.233072 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:49.233037    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3cd05416-44af-454c-b1a0-ed819dbcae2d-proxy-tls\") pod \"isvc-sklearn-batcher-predictor-75c6848b55-pwbpn\" (UID: \"3cd05416-44af-454c-b1a0-ed819dbcae2d\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn"
Jul 15 10:55:49.235664 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:49.235632    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3cd05416-44af-454c-b1a0-ed819dbcae2d-proxy-tls\") pod \"isvc-sklearn-batcher-predictor-75c6848b55-pwbpn\" (UID: \"3cd05416-44af-454c-b1a0-ed819dbcae2d\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn"
Jul 15 10:55:49.423681 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:49.423643    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn"
Jul 15 10:55:49.566849 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:49.566812    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn"]
Jul 15 10:55:49.569313 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:55:49.569287    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cd05416_44af_454c_b1a0_ed819dbcae2d.slice/crio-80f319e19e95b46c3b0243389e44ae147fffa6232dbf8bfe92828a88991edab0 WatchSource:0}: Error finding container 80f319e19e95b46c3b0243389e44ae147fffa6232dbf8bfe92828a88991edab0: Status 404 returned error can't find the container with id 80f319e19e95b46c3b0243389e44ae147fffa6232dbf8bfe92828a88991edab0
Jul 15 10:55:49.571271 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:49.571252    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 10:55:49.857419 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:49.857375    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn" event={"ID":"3cd05416-44af-454c-b1a0-ed819dbcae2d","Type":"ContainerStarted","Data":"80f319e19e95b46c3b0243389e44ae147fffa6232dbf8bfe92828a88991edab0"}
Jul 15 10:55:53.881803 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:53.881765    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn" event={"ID":"3cd05416-44af-454c-b1a0-ed819dbcae2d","Type":"ContainerStarted","Data":"52286a59427c7f3ba6d5732568d4f8e0ca0ee583aed9cd35b1c4fefa3c7e6d33"}
Jul 15 10:55:57.902428 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:57.902390    2565 generic.go:356] "Generic (PLEG): container finished" podID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerID="52286a59427c7f3ba6d5732568d4f8e0ca0ee583aed9cd35b1c4fefa3c7e6d33" exitCode=0
Jul 15 10:55:57.902811 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:55:57.902467    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn" event={"ID":"3cd05416-44af-454c-b1a0-ed819dbcae2d","Type":"ContainerDied","Data":"52286a59427c7f3ba6d5732568d4f8e0ca0ee583aed9cd35b1c4fefa3c7e6d33"}
Jul 15 10:56:11.986927 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:56:11.986827    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn" event={"ID":"3cd05416-44af-454c-b1a0-ed819dbcae2d","Type":"ContainerStarted","Data":"f40a91d6d46e0551ccc754e7d75eacfbef7f96cfe3e8e11e384d19df18660dce"}
Jul 15 10:56:13.999995 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:56:13.999962    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn" event={"ID":"3cd05416-44af-454c-b1a0-ed819dbcae2d","Type":"ContainerStarted","Data":"e07fd3c099816865472b5c17fd599d3307ec7ba82949f5c8045f2909c1bca560"}
Jul 15 10:56:17.025328 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:56:17.025292    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn" event={"ID":"3cd05416-44af-454c-b1a0-ed819dbcae2d","Type":"ContainerStarted","Data":"7be67022f54eccb50ab7786c2dafef20327b2633e035f9ebaef8a585ef55a8a8"}
Jul 15 10:56:17.025845 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:56:17.025577    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn"
Jul 15 10:56:17.025845 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:56:17.025641    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn"
Jul 15 10:56:17.025845 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:56:17.025672    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn"
Jul 15 10:56:17.027066 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:56:17.027029    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn" podUID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Jul 15 10:56:17.027802 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:56:17.027781    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn" podUID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 10:56:17.059064 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:56:17.059014    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn" podStartSLOduration=3.728989816 podStartE2EDuration="29.05900083s" totalImagesPullingTime="21.580063283s" totalInitContainerRuntime="3.749947731s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:55:48 +0000 UTC" imagePullSessionsCount=4 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:56:17.054963432 +0000 UTC m=+674.663499454" watchObservedRunningTime="2026-07-15 10:56:17.05900083 +0000 UTC m=+674.667536852"
Jul 15 10:56:18.030092 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:56:18.030046    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn" podUID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Jul 15 10:56:18.030600 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:56:18.030380    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn" podUID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 10:56:18.034058 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:56:18.034037    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn"
Jul 15 10:56:19.034745 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:56:19.034705    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn" podUID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Jul 15 10:56:19.035130 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:56:19.034935    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn" podUID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 10:56:29.035167 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:56:29.035122    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn" podUID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Jul 15 10:56:29.035809 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:56:29.035778    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn" podUID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 10:56:39.035609 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:56:39.035559    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn" podUID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Jul 15 10:56:39.036118 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:56:39.036051    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn" podUID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 10:56:49.035397 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:56:49.035325    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn" podUID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Jul 15 10:56:49.035982 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:56:49.035907    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn" podUID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 10:56:59.034866 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:56:59.034758    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn" podUID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Jul 15 10:56:59.035586 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:56:59.035276    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn" podUID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 10:57:09.035209 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:09.035156    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn" podUID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Jul 15 10:57:09.035734 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:09.035594    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn" podUID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 10:57:19.034698 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:19.034655    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn" podUID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Jul 15 10:57:19.035315 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:19.035012    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn" podUID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 10:57:29.035620 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:29.035585    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn"
Jul 15 10:57:29.036178 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:29.036136    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn"
Jul 15 10:57:43.480466 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:43.480430    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn"]
Jul 15 10:57:43.480915 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:43.480713    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn" podUID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerName="kserve-container" containerID="cri-o://f40a91d6d46e0551ccc754e7d75eacfbef7f96cfe3e8e11e384d19df18660dce" gracePeriod=30
Jul 15 10:57:43.480915 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:43.480752    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn" podUID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerName="kube-rbac-proxy" containerID="cri-o://e07fd3c099816865472b5c17fd599d3307ec7ba82949f5c8045f2909c1bca560" gracePeriod=30
Jul 15 10:57:43.480915 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:43.480777    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn" podUID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerName="agent" containerID="cri-o://7be67022f54eccb50ab7786c2dafef20327b2633e035f9ebaef8a585ef55a8a8" gracePeriod=30
Jul 15 10:57:43.531488 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:43.531454    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:57:43.602376 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:43.602306    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:57:43.607753 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:43.607727    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs"]
Jul 15 10:57:43.611728 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:43.611709    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs"
Jul 15 10:57:43.614408 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:43.614383    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-batcher-custom-predictor-serving-cert\""
Jul 15 10:57:43.614698 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:43.614678    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-batcher-custom-kube-rbac-proxy-sar-config\""
Jul 15 10:57:43.631517 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:43.631492    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs"]
Jul 15 10:57:43.688831 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:43.688797    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd29r\" (UniqueName: \"kubernetes.io/projected/43c8bafa-9ac8-45e7-8356-f92c39bb1d64-kube-api-access-gd29r\") pod \"isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs\" (UID: \"43c8bafa-9ac8-45e7-8356-f92c39bb1d64\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs"
Jul 15 10:57:43.689008 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:43.688849    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/43c8bafa-9ac8-45e7-8356-f92c39bb1d64-proxy-tls\") pod \"isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs\" (UID: \"43c8bafa-9ac8-45e7-8356-f92c39bb1d64\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs"
Jul 15 10:57:43.689008 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:43.688902    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/43c8bafa-9ac8-45e7-8356-f92c39bb1d64-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs\" (UID: \"43c8bafa-9ac8-45e7-8356-f92c39bb1d64\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs"
Jul 15 10:57:43.689008 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:43.688984    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/43c8bafa-9ac8-45e7-8356-f92c39bb1d64-kserve-provision-location\") pod \"isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs\" (UID: \"43c8bafa-9ac8-45e7-8356-f92c39bb1d64\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs"
Jul 15 10:57:43.689120 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:43.689027    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/43c8bafa-9ac8-45e7-8356-f92c39bb1d64-cabundle-cert\") pod \"isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs\" (UID: \"43c8bafa-9ac8-45e7-8356-f92c39bb1d64\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs"
Jul 15 10:57:43.790477 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:43.790441    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/43c8bafa-9ac8-45e7-8356-f92c39bb1d64-proxy-tls\") pod \"isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs\" (UID: \"43c8bafa-9ac8-45e7-8356-f92c39bb1d64\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs"
Jul 15 10:57:43.790656 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:43.790491    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/43c8bafa-9ac8-45e7-8356-f92c39bb1d64-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs\" (UID: \"43c8bafa-9ac8-45e7-8356-f92c39bb1d64\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs"
Jul 15 10:57:43.790656 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:43.790512    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/43c8bafa-9ac8-45e7-8356-f92c39bb1d64-kserve-provision-location\") pod \"isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs\" (UID: \"43c8bafa-9ac8-45e7-8356-f92c39bb1d64\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs"
Jul 15 10:57:43.790656 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:43.790528    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/43c8bafa-9ac8-45e7-8356-f92c39bb1d64-cabundle-cert\") pod \"isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs\" (UID: \"43c8bafa-9ac8-45e7-8356-f92c39bb1d64\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs"
Jul 15 10:57:43.790656 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:43.790590    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd29r\" (UniqueName: \"kubernetes.io/projected/43c8bafa-9ac8-45e7-8356-f92c39bb1d64-kube-api-access-gd29r\") pod \"isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs\" (UID: \"43c8bafa-9ac8-45e7-8356-f92c39bb1d64\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs"
Jul 15 10:57:43.790656 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:57:43.790627    2565 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-serving-cert: secret "isvc-sklearn-batcher-custom-predictor-serving-cert" not found
Jul 15 10:57:43.790980 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:57:43.790717    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43c8bafa-9ac8-45e7-8356-f92c39bb1d64-proxy-tls podName:43c8bafa-9ac8-45e7-8356-f92c39bb1d64 nodeName:}" failed. No retries permitted until 2026-07-15 10:57:44.290696582 +0000 UTC m=+761.899232605 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/43c8bafa-9ac8-45e7-8356-f92c39bb1d64-proxy-tls") pod "isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" (UID: "43c8bafa-9ac8-45e7-8356-f92c39bb1d64") : secret "isvc-sklearn-batcher-custom-predictor-serving-cert" not found
Jul 15 10:57:43.791073 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:43.791025    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/43c8bafa-9ac8-45e7-8356-f92c39bb1d64-kserve-provision-location\") pod \"isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs\" (UID: \"43c8bafa-9ac8-45e7-8356-f92c39bb1d64\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs"
Jul 15 10:57:43.791244 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:43.791224    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/43c8bafa-9ac8-45e7-8356-f92c39bb1d64-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs\" (UID: \"43c8bafa-9ac8-45e7-8356-f92c39bb1d64\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs"
Jul 15 10:57:43.791297 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:43.791236    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/43c8bafa-9ac8-45e7-8356-f92c39bb1d64-cabundle-cert\") pod \"isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs\" (UID: \"43c8bafa-9ac8-45e7-8356-f92c39bb1d64\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs"
Jul 15 10:57:43.800004 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:43.799967    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd29r\" (UniqueName: \"kubernetes.io/projected/43c8bafa-9ac8-45e7-8356-f92c39bb1d64-kube-api-access-gd29r\") pod \"isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs\" (UID: \"43c8bafa-9ac8-45e7-8356-f92c39bb1d64\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs"
Jul 15 10:57:43.950101 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:43.950070    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:57:44.296950 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:44.296912    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/43c8bafa-9ac8-45e7-8356-f92c39bb1d64-proxy-tls\") pod \"isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs\" (UID: \"43c8bafa-9ac8-45e7-8356-f92c39bb1d64\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs"
Jul 15 10:57:44.299584 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:44.299560    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/43c8bafa-9ac8-45e7-8356-f92c39bb1d64-proxy-tls\") pod \"isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs\" (UID: \"43c8bafa-9ac8-45e7-8356-f92c39bb1d64\") " pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs"
Jul 15 10:57:44.441135 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:44.441099    2565 generic.go:356] "Generic (PLEG): container finished" podID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerID="e07fd3c099816865472b5c17fd599d3307ec7ba82949f5c8045f2909c1bca560" exitCode=2
Jul 15 10:57:44.441314 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:44.441170    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn" event={"ID":"3cd05416-44af-454c-b1a0-ed819dbcae2d","Type":"ContainerDied","Data":"e07fd3c099816865472b5c17fd599d3307ec7ba82949f5c8045f2909c1bca560"}
Jul 15 10:57:44.521795 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:44.521758    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs"
Jul 15 10:57:44.661447 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:44.661416    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs"]
Jul 15 10:57:44.665042 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:57:44.665012    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43c8bafa_9ac8_45e7_8356_f92c39bb1d64.slice/crio-71a568009f9ae7431b75545c22cce789404e6581cd41ee3fd9cf8a247f5ef119 WatchSource:0}: Error finding container 71a568009f9ae7431b75545c22cce789404e6581cd41ee3fd9cf8a247f5ef119: Status 404 returned error can't find the container with id 71a568009f9ae7431b75545c22cce789404e6581cd41ee3fd9cf8a247f5ef119
Jul 15 10:57:45.447617 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:45.447581    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" event={"ID":"43c8bafa-9ac8-45e7-8356-f92c39bb1d64","Type":"ContainerStarted","Data":"af92ca3fa64e238391d41e8ee9b3d0edb195f5e7fc97d22498123349e717ac6d"}
Jul 15 10:57:45.447796 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:45.447647    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" event={"ID":"43c8bafa-9ac8-45e7-8356-f92c39bb1d64","Type":"ContainerStarted","Data":"71a568009f9ae7431b75545c22cce789404e6581cd41ee3fd9cf8a247f5ef119"}
Jul 15 10:57:48.031170 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:48.031132    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn" podUID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.35:8643/healthz\": dial tcp 10.132.0.35:8643: connect: connection refused"
Jul 15 10:57:48.463769 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:48.463733    2565 generic.go:356] "Generic (PLEG): container finished" podID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerID="f40a91d6d46e0551ccc754e7d75eacfbef7f96cfe3e8e11e384d19df18660dce" exitCode=0
Jul 15 10:57:48.463946 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:48.463812    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn" event={"ID":"3cd05416-44af-454c-b1a0-ed819dbcae2d","Type":"ContainerDied","Data":"f40a91d6d46e0551ccc754e7d75eacfbef7f96cfe3e8e11e384d19df18660dce"}
Jul 15 10:57:48.465437 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:48.465414    2565 generic.go:356] "Generic (PLEG): container finished" podID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerID="af92ca3fa64e238391d41e8ee9b3d0edb195f5e7fc97d22498123349e717ac6d" exitCode=0
Jul 15 10:57:48.465764 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:48.465461    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" event={"ID":"43c8bafa-9ac8-45e7-8356-f92c39bb1d64","Type":"ContainerDied","Data":"af92ca3fa64e238391d41e8ee9b3d0edb195f5e7fc97d22498123349e717ac6d"}
Jul 15 10:57:49.035516 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:49.035479    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn" podUID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 10:57:49.036751 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:49.036722    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn" podUID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Jul 15 10:57:49.472880 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:49.472800    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" event={"ID":"43c8bafa-9ac8-45e7-8356-f92c39bb1d64","Type":"ContainerStarted","Data":"e15cf79486d38fc71d0fa6c7c1e02ff8af742577d187c6881d4c7c5d7c1a4515"}
Jul 15 10:57:49.472880 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:49.472868    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" event={"ID":"43c8bafa-9ac8-45e7-8356-f92c39bb1d64","Type":"ContainerStarted","Data":"cf203589c9266916dfb66668194b109da8da59330c59d78aa7fd0f2969b567bb"}
Jul 15 10:57:49.473065 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:49.472892    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" event={"ID":"43c8bafa-9ac8-45e7-8356-f92c39bb1d64","Type":"ContainerStarted","Data":"ffbdcbb3017cfe9291cb9ad81004e8d40631255aff0af30bb16a01c1f65d5a14"}
Jul 15 10:57:49.473199 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:49.473179    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs"
Jul 15 10:57:49.473278 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:49.473234    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs"
Jul 15 10:57:49.474825 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:49.474796    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:5000: connect: connection refused"
Jul 15 10:57:49.497709 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:49.497658    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" podStartSLOduration=2.948791396 podStartE2EDuration="6.497641134s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.548849738s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:57:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:57:49.496622979 +0000 UTC m=+767.105159011" watchObservedRunningTime="2026-07-15 10:57:49.497641134 +0000 UTC m=+767.106177155"
Jul 15 10:57:50.478207 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:50.478166    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs"
Jul 15 10:57:50.478628 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:50.478357    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:5000: connect: connection refused"
Jul 15 10:57:50.479593 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:50.479566    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 10:57:51.483165 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:51.483121    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:5000: connect: connection refused"
Jul 15 10:57:51.483647 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:51.483626    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 10:57:53.030588 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:53.030538    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn" podUID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.35:8643/healthz\": dial tcp 10.132.0.35:8643: connect: connection refused"
Jul 15 10:57:56.487882 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:56.487845    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs"
Jul 15 10:57:56.488614 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:56.488583    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:5000: connect: connection refused"
Jul 15 10:57:56.488964 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:56.488942    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 10:57:58.030594 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:58.030553    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn" podUID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.35:8643/healthz\": dial tcp 10.132.0.35:8643: connect: connection refused"
Jul 15 10:57:58.031044 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:58.030677    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn"
Jul 15 10:57:59.034927 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:59.034878    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn" podUID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 10:57:59.036695 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:57:59.036651    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn" podUID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Jul 15 10:58:03.030825 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:03.030766    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn" podUID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.35:8643/healthz\": dial tcp 10.132.0.35:8643: connect: connection refused"
Jul 15 10:58:04.827897 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:04.827861    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:58:06.488633 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:06.488590    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:5000: connect: connection refused"
Jul 15 10:58:06.489053 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:06.488989    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 10:58:08.030723 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:08.030675    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn" podUID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.35:8643/healthz\": dial tcp 10.132.0.35:8643: connect: connection refused"
Jul 15 10:58:09.035162 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:09.035123    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn" podUID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 10:58:09.035594 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:09.035248    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn"
Jul 15 10:58:09.036294 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:09.036271    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn" podUID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Jul 15 10:58:09.036407 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:09.036392    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn"
Jul 15 10:58:13.030512 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:13.030468    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn" podUID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.35:8643/healthz\": dial tcp 10.132.0.35:8643: connect: connection refused"
Jul 15 10:58:13.590272 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:13.590237    2565 generic.go:356] "Generic (PLEG): container finished" podID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerID="7be67022f54eccb50ab7786c2dafef20327b2633e035f9ebaef8a585ef55a8a8" exitCode=0
Jul 15 10:58:13.590272 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:13.590276    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn" event={"ID":"3cd05416-44af-454c-b1a0-ed819dbcae2d","Type":"ContainerDied","Data":"7be67022f54eccb50ab7786c2dafef20327b2633e035f9ebaef8a585ef55a8a8"}
Jul 15 10:58:13.634593 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:13.634568    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn"
Jul 15 10:58:13.755014 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:13.754932    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52795\" (UniqueName: \"kubernetes.io/projected/3cd05416-44af-454c-b1a0-ed819dbcae2d-kube-api-access-52795\") pod \"3cd05416-44af-454c-b1a0-ed819dbcae2d\" (UID: \"3cd05416-44af-454c-b1a0-ed819dbcae2d\") "
Jul 15 10:58:13.755014 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:13.754977    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3cd05416-44af-454c-b1a0-ed819dbcae2d-kserve-provision-location\") pod \"3cd05416-44af-454c-b1a0-ed819dbcae2d\" (UID: \"3cd05416-44af-454c-b1a0-ed819dbcae2d\") "
Jul 15 10:58:13.755014 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:13.755007    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3cd05416-44af-454c-b1a0-ed819dbcae2d-proxy-tls\") pod \"3cd05416-44af-454c-b1a0-ed819dbcae2d\" (UID: \"3cd05416-44af-454c-b1a0-ed819dbcae2d\") "
Jul 15 10:58:13.755322 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:13.755027    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/3cd05416-44af-454c-b1a0-ed819dbcae2d-cabundle-cert\") pod \"3cd05416-44af-454c-b1a0-ed819dbcae2d\" (UID: \"3cd05416-44af-454c-b1a0-ed819dbcae2d\") "
Jul 15 10:58:13.755322 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:13.755048    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3cd05416-44af-454c-b1a0-ed819dbcae2d-kube-rbac-proxy-sar-config\") pod \"3cd05416-44af-454c-b1a0-ed819dbcae2d\" (UID: \"3cd05416-44af-454c-b1a0-ed819dbcae2d\") "
Jul 15 10:58:13.755571 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:13.755461    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cd05416-44af-454c-b1a0-ed819dbcae2d-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "3cd05416-44af-454c-b1a0-ed819dbcae2d" (UID: "3cd05416-44af-454c-b1a0-ed819dbcae2d"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:58:13.755571 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:13.755561    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cd05416-44af-454c-b1a0-ed819dbcae2d-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "3cd05416-44af-454c-b1a0-ed819dbcae2d" (UID: "3cd05416-44af-454c-b1a0-ed819dbcae2d"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:58:13.755713 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:13.755551    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cd05416-44af-454c-b1a0-ed819dbcae2d-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "3cd05416-44af-454c-b1a0-ed819dbcae2d" (UID: "3cd05416-44af-454c-b1a0-ed819dbcae2d"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:58:13.757474 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:13.757454    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cd05416-44af-454c-b1a0-ed819dbcae2d-kube-api-access-52795" (OuterVolumeSpecName: "kube-api-access-52795") pod "3cd05416-44af-454c-b1a0-ed819dbcae2d" (UID: "3cd05416-44af-454c-b1a0-ed819dbcae2d"). InnerVolumeSpecName "kube-api-access-52795". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 10:58:13.757697 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:13.757673    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cd05416-44af-454c-b1a0-ed819dbcae2d-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "3cd05416-44af-454c-b1a0-ed819dbcae2d" (UID: "3cd05416-44af-454c-b1a0-ed819dbcae2d"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 10:58:13.856784 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:13.856745    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52795\" (UniqueName: \"kubernetes.io/projected/3cd05416-44af-454c-b1a0-ed819dbcae2d-kube-api-access-52795\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:58:13.856784 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:13.856778    2565 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3cd05416-44af-454c-b1a0-ed819dbcae2d-kserve-provision-location\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:58:13.856984 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:13.856808    2565 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3cd05416-44af-454c-b1a0-ed819dbcae2d-proxy-tls\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:58:13.856984 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:13.856817    2565 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/3cd05416-44af-454c-b1a0-ed819dbcae2d-cabundle-cert\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:58:13.856984 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:13.856826    2565 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3cd05416-44af-454c-b1a0-ed819dbcae2d-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:58:14.597880 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:14.597840    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn" event={"ID":"3cd05416-44af-454c-b1a0-ed819dbcae2d","Type":"ContainerDied","Data":"80f319e19e95b46c3b0243389e44ae147fffa6232dbf8bfe92828a88991edab0"}
Jul 15 10:58:14.597880 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:14.597866    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn"
Jul 15 10:58:14.598390 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:14.597922    2565 scope.go:117] "RemoveContainer" containerID="7be67022f54eccb50ab7786c2dafef20327b2633e035f9ebaef8a585ef55a8a8"
Jul 15 10:58:14.609626 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:14.609603    2565 scope.go:117] "RemoveContainer" containerID="e07fd3c099816865472b5c17fd599d3307ec7ba82949f5c8045f2909c1bca560"
Jul 15 10:58:14.617942 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:14.617922    2565 scope.go:117] "RemoveContainer" containerID="f40a91d6d46e0551ccc754e7d75eacfbef7f96cfe3e8e11e384d19df18660dce"
Jul 15 10:58:14.621705 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:14.621683    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn"]
Jul 15 10:58:14.626348 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:14.626315    2565 scope.go:117] "RemoveContainer" containerID="52286a59427c7f3ba6d5732568d4f8e0ca0ee583aed9cd35b1c4fefa3c7e6d33"
Jul 15 10:58:14.628625 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:14.628602    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-predictor-75c6848b55-pwbpn"]
Jul 15 10:58:14.925493 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:14.925411    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cd05416-44af-454c-b1a0-ed819dbcae2d" path="/var/lib/kubelet/pods/3cd05416-44af-454c-b1a0-ed819dbcae2d/volumes"
Jul 15 10:58:16.488895 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:16.488850    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:5000: connect: connection refused"
Jul 15 10:58:16.489361 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:16.489314    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 10:58:26.489180 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:26.489134    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:5000: connect: connection refused"
Jul 15 10:58:26.489661 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:26.489636    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 10:58:30.250260 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:30.250227    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:58:36.489354 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:36.489297    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:5000: connect: connection refused"
Jul 15 10:58:36.489810 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:36.489785    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 10:58:46.489353 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:46.489300    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:5000: connect: connection refused"
Jul 15 10:58:46.489895 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:46.489870    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 10:58:56.488990 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:56.488949    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:5000: connect: connection refused"
Jul 15 10:58:56.489566 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:56.489388    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 10:58:59.919612 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:59.919567    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:5000: connect: connection refused"
Jul 15 10:58:59.920032 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:58:59.919911    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 10:59:09.920155 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:09.920115    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs"
Jul 15 10:59:09.920655 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:09.920633    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs"
Jul 15 10:59:18.756354 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:18.756304    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs"]
Jul 15 10:59:18.756858 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:18.756720    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="kserve-container" containerID="cri-o://ffbdcbb3017cfe9291cb9ad81004e8d40631255aff0af30bb16a01c1f65d5a14" gracePeriod=30
Jul 15 10:59:18.757160 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:18.757132    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="agent" containerID="cri-o://e15cf79486d38fc71d0fa6c7c1e02ff8af742577d187c6881d4c7c5d7c1a4515" gracePeriod=30
Jul 15 10:59:18.757443 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:18.757377    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="kube-rbac-proxy" containerID="cri-o://cf203589c9266916dfb66668194b109da8da59330c59d78aa7fd0f2969b567bb" gracePeriod=30
Jul 15 10:59:18.792276 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:18.792247    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:59:18.874255 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:18.874219    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:59:18.874699 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:18.874679    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-8lpzg"]
Jul 15 10:59:18.875057 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:18.875045    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerName="kserve-container"
Jul 15 10:59:18.875107 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:18.875058    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerName="kserve-container"
Jul 15 10:59:18.875107 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:18.875067    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerName="storage-initializer"
Jul 15 10:59:18.875107 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:18.875073    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerName="storage-initializer"
Jul 15 10:59:18.875107 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:18.875089    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerName="agent"
Jul 15 10:59:18.875107 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:18.875094    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerName="agent"
Jul 15 10:59:18.875266 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:18.875110    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerName="kube-rbac-proxy"
Jul 15 10:59:18.875266 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:18.875116    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerName="kube-rbac-proxy"
Jul 15 10:59:18.875266 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:18.875205    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerName="kserve-container"
Jul 15 10:59:18.875266 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:18.875220    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerName="kube-rbac-proxy"
Jul 15 10:59:18.875266 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:18.875229    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cd05416-44af-454c-b1a0-ed819dbcae2d" containerName="agent"
Jul 15 10:59:18.879596 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:18.879579    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-8lpzg"
Jul 15 10:59:18.882512 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:18.882493    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"message-dumper-predictor-serving-cert\""
Jul 15 10:59:18.882987 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:18.882968    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"message-dumper-kube-rbac-proxy-sar-config\""
Jul 15 10:59:18.896145 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:18.896121    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-8lpzg"]
Jul 15 10:59:18.912893 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:18.912725    2565 generic.go:356] "Generic (PLEG): container finished" podID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerID="cf203589c9266916dfb66668194b109da8da59330c59d78aa7fd0f2969b567bb" exitCode=2
Jul 15 10:59:18.912893 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:18.912771    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" event={"ID":"43c8bafa-9ac8-45e7-8356-f92c39bb1d64","Type":"ContainerDied","Data":"cf203589c9266916dfb66668194b109da8da59330c59d78aa7fd0f2969b567bb"}
Jul 15 10:59:18.945960 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:18.945919    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6jt2\" (UniqueName: \"kubernetes.io/projected/13001d9d-7abc-49d9-8ba1-adcc44de095e-kube-api-access-g6jt2\") pod \"message-dumper-predictor-6575bcfdfd-8lpzg\" (UID: \"13001d9d-7abc-49d9-8ba1-adcc44de095e\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-8lpzg"
Jul 15 10:59:18.946130 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:18.946004    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/13001d9d-7abc-49d9-8ba1-adcc44de095e-kube-rbac-proxy-sar-config\") pod \"message-dumper-predictor-6575bcfdfd-8lpzg\" (UID: \"13001d9d-7abc-49d9-8ba1-adcc44de095e\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-8lpzg"
Jul 15 10:59:18.946130 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:18.946055    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/13001d9d-7abc-49d9-8ba1-adcc44de095e-proxy-tls\") pod \"message-dumper-predictor-6575bcfdfd-8lpzg\" (UID: \"13001d9d-7abc-49d9-8ba1-adcc44de095e\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-8lpzg"
Jul 15 10:59:19.047423 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:19.047384    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/13001d9d-7abc-49d9-8ba1-adcc44de095e-kube-rbac-proxy-sar-config\") pod \"message-dumper-predictor-6575bcfdfd-8lpzg\" (UID: \"13001d9d-7abc-49d9-8ba1-adcc44de095e\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-8lpzg"
Jul 15 10:59:19.047600 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:19.047474    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/13001d9d-7abc-49d9-8ba1-adcc44de095e-proxy-tls\") pod \"message-dumper-predictor-6575bcfdfd-8lpzg\" (UID: \"13001d9d-7abc-49d9-8ba1-adcc44de095e\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-8lpzg"
Jul 15 10:59:19.047600 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:19.047525    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6jt2\" (UniqueName: \"kubernetes.io/projected/13001d9d-7abc-49d9-8ba1-adcc44de095e-kube-api-access-g6jt2\") pod \"message-dumper-predictor-6575bcfdfd-8lpzg\" (UID: \"13001d9d-7abc-49d9-8ba1-adcc44de095e\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-8lpzg"
Jul 15 10:59:19.047699 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:59:19.047652    2565 secret.go:189] Couldn't get secret kserve-ci-e2e-test/message-dumper-predictor-serving-cert: secret "message-dumper-predictor-serving-cert" not found
Jul 15 10:59:19.047740 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:59:19.047721    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13001d9d-7abc-49d9-8ba1-adcc44de095e-proxy-tls podName:13001d9d-7abc-49d9-8ba1-adcc44de095e nodeName:}" failed. No retries permitted until 2026-07-15 10:59:19.547704077 +0000 UTC m=+857.156240076 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/13001d9d-7abc-49d9-8ba1-adcc44de095e-proxy-tls") pod "message-dumper-predictor-6575bcfdfd-8lpzg" (UID: "13001d9d-7abc-49d9-8ba1-adcc44de095e") : secret "message-dumper-predictor-serving-cert" not found
Jul 15 10:59:19.048097 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:19.048078    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/13001d9d-7abc-49d9-8ba1-adcc44de095e-kube-rbac-proxy-sar-config\") pod \"message-dumper-predictor-6575bcfdfd-8lpzg\" (UID: \"13001d9d-7abc-49d9-8ba1-adcc44de095e\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-8lpzg"
Jul 15 10:59:19.057328 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:19.057292    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6jt2\" (UniqueName: \"kubernetes.io/projected/13001d9d-7abc-49d9-8ba1-adcc44de095e-kube-api-access-g6jt2\") pod \"message-dumper-predictor-6575bcfdfd-8lpzg\" (UID: \"13001d9d-7abc-49d9-8ba1-adcc44de095e\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-8lpzg"
Jul 15 10:59:19.330647 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:19.330542    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:59:19.551292 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:19.551247    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/13001d9d-7abc-49d9-8ba1-adcc44de095e-proxy-tls\") pod \"message-dumper-predictor-6575bcfdfd-8lpzg\" (UID: \"13001d9d-7abc-49d9-8ba1-adcc44de095e\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-8lpzg"
Jul 15 10:59:19.553981 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:19.553947    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/13001d9d-7abc-49d9-8ba1-adcc44de095e-proxy-tls\") pod \"message-dumper-predictor-6575bcfdfd-8lpzg\" (UID: \"13001d9d-7abc-49d9-8ba1-adcc44de095e\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-8lpzg"
Jul 15 10:59:19.790215 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:19.790170    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-8lpzg"
Jul 15 10:59:19.920372 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:19.920297    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 10:59:19.920759 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:19.920734    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:5000: connect: connection refused"
Jul 15 10:59:19.935184 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:19.935158    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-8lpzg"]
Jul 15 10:59:19.937215 ip-10-0-134-216 kubenswrapper[2565]: W0715 10:59:19.937193    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13001d9d_7abc_49d9_8ba1_adcc44de095e.slice/crio-cfe58a4da366e0306f3066b71a7afc5630f4a62f8c4603e8c8330dd91e5bf664 WatchSource:0}: Error finding container cfe58a4da366e0306f3066b71a7afc5630f4a62f8c4603e8c8330dd91e5bf664: Status 404 returned error can't find the container with id cfe58a4da366e0306f3066b71a7afc5630f4a62f8c4603e8c8330dd91e5bf664
Jul 15 10:59:20.926529 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:20.926496    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-8lpzg" event={"ID":"13001d9d-7abc-49d9-8ba1-adcc44de095e","Type":"ContainerStarted","Data":"cfe58a4da366e0306f3066b71a7afc5630f4a62f8c4603e8c8330dd91e5bf664"}
Jul 15 10:59:21.483978 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:21.483929    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.36:8643/healthz\": dial tcp 10.132.0.36:8643: connect: connection refused"
Jul 15 10:59:21.931129 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:21.931093    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-8lpzg" event={"ID":"13001d9d-7abc-49d9-8ba1-adcc44de095e","Type":"ContainerStarted","Data":"484db1fda4e4921b03090b4bc0c57851b95bf727ea948ff5a0bca77215fffbdf"}
Jul 15 10:59:21.931593 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:21.931190    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-8lpzg" event={"ID":"13001d9d-7abc-49d9-8ba1-adcc44de095e","Type":"ContainerStarted","Data":"ee9a52080da174811b212939e33e1572e9d482d9c35753a52952dc48829a4f0d"}
Jul 15 10:59:21.931593 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:21.931226    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-8lpzg"
Jul 15 10:59:21.931593 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:21.931256    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-8lpzg"
Jul 15 10:59:21.933168 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:21.933148    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-8lpzg"
Jul 15 10:59:21.950276 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:21.950230    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-8lpzg" podStartSLOduration=2.563715097 podStartE2EDuration="3.950217812s" totalImagesPullingTime="1.386502715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:59:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:59:21.949502188 +0000 UTC m=+859.558038232" watchObservedRunningTime="2026-07-15 10:59:21.950217812 +0000 UTC m=+859.558753899"
Jul 15 10:59:23.941992 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:23.941907    2565 generic.go:356] "Generic (PLEG): container finished" podID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerID="ffbdcbb3017cfe9291cb9ad81004e8d40631255aff0af30bb16a01c1f65d5a14" exitCode=0
Jul 15 10:59:23.941992 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:23.941976    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" event={"ID":"43c8bafa-9ac8-45e7-8356-f92c39bb1d64","Type":"ContainerDied","Data":"ffbdcbb3017cfe9291cb9ad81004e8d40631255aff0af30bb16a01c1f65d5a14"}
Jul 15 10:59:26.484263 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:26.484223    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.36:8643/healthz\": dial tcp 10.132.0.36:8643: connect: connection refused"
Jul 15 10:59:28.704595 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:28.704555    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:59:28.763350 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:28.763312    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:59:28.946828 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:28.946798    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-8lpzg"
Jul 15 10:59:29.920018 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:29.919979    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 10:59:29.921213 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:29.921188    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:5000: connect: connection refused"
Jul 15 10:59:31.483801 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:31.483757    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.36:8643/healthz\": dial tcp 10.132.0.36:8643: connect: connection refused"
Jul 15 10:59:31.484208 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:31.483886    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs"
Jul 15 10:59:36.483540 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:36.483491    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.36:8643/healthz\": dial tcp 10.132.0.36:8643: connect: connection refused"
Jul 15 10:59:38.881768 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:38.881726    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:59:39.050364 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:39.050315    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x"]
Jul 15 10:59:39.054397 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:39.054375    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x"
Jul 15 10:59:39.057567 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:39.057545    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-logger-predictor-serving-cert\""
Jul 15 10:59:39.061696 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:39.061673    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-logger-kube-rbac-proxy-sar-config\""
Jul 15 10:59:39.199844 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:39.199755    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x"]
Jul 15 10:59:39.237383 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:39.237320    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/29a707b7-1ddd-4c34-bf90-327ad588aa83-kserve-provision-location\") pod \"isvc-logger-predictor-65cffbc4cb-5s84x\" (UID: \"29a707b7-1ddd-4c34-bf90-327ad588aa83\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x"
Jul 15 10:59:39.237580 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:39.237407    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcw2g\" (UniqueName: \"kubernetes.io/projected/29a707b7-1ddd-4c34-bf90-327ad588aa83-kube-api-access-kcw2g\") pod \"isvc-logger-predictor-65cffbc4cb-5s84x\" (UID: \"29a707b7-1ddd-4c34-bf90-327ad588aa83\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x"
Jul 15 10:59:39.237580 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:39.237428    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/29a707b7-1ddd-4c34-bf90-327ad588aa83-cabundle-cert\") pod \"isvc-logger-predictor-65cffbc4cb-5s84x\" (UID: \"29a707b7-1ddd-4c34-bf90-327ad588aa83\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x"
Jul 15 10:59:39.237580 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:39.237546    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/29a707b7-1ddd-4c34-bf90-327ad588aa83-kube-rbac-proxy-sar-config\") pod \"isvc-logger-predictor-65cffbc4cb-5s84x\" (UID: \"29a707b7-1ddd-4c34-bf90-327ad588aa83\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x"
Jul 15 10:59:39.237691 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:39.237583    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/29a707b7-1ddd-4c34-bf90-327ad588aa83-proxy-tls\") pod \"isvc-logger-predictor-65cffbc4cb-5s84x\" (UID: \"29a707b7-1ddd-4c34-bf90-327ad588aa83\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x"
Jul 15 10:59:39.338306 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:39.338267    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/29a707b7-1ddd-4c34-bf90-327ad588aa83-kube-rbac-proxy-sar-config\") pod \"isvc-logger-predictor-65cffbc4cb-5s84x\" (UID: \"29a707b7-1ddd-4c34-bf90-327ad588aa83\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x"
Jul 15 10:59:39.338306 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:39.338312    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/29a707b7-1ddd-4c34-bf90-327ad588aa83-proxy-tls\") pod \"isvc-logger-predictor-65cffbc4cb-5s84x\" (UID: \"29a707b7-1ddd-4c34-bf90-327ad588aa83\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x"
Jul 15 10:59:39.338588 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:39.338393    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/29a707b7-1ddd-4c34-bf90-327ad588aa83-kserve-provision-location\") pod \"isvc-logger-predictor-65cffbc4cb-5s84x\" (UID: \"29a707b7-1ddd-4c34-bf90-327ad588aa83\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x"
Jul 15 10:59:39.338588 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:39.338435    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcw2g\" (UniqueName: \"kubernetes.io/projected/29a707b7-1ddd-4c34-bf90-327ad588aa83-kube-api-access-kcw2g\") pod \"isvc-logger-predictor-65cffbc4cb-5s84x\" (UID: \"29a707b7-1ddd-4c34-bf90-327ad588aa83\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x"
Jul 15 10:59:39.338588 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:39.338454    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/29a707b7-1ddd-4c34-bf90-327ad588aa83-cabundle-cert\") pod \"isvc-logger-predictor-65cffbc4cb-5s84x\" (UID: \"29a707b7-1ddd-4c34-bf90-327ad588aa83\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x"
Jul 15 10:59:39.338863 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:39.338835    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/29a707b7-1ddd-4c34-bf90-327ad588aa83-kserve-provision-location\") pod \"isvc-logger-predictor-65cffbc4cb-5s84x\" (UID: \"29a707b7-1ddd-4c34-bf90-327ad588aa83\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x"
Jul 15 10:59:39.339072 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:39.339052    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/29a707b7-1ddd-4c34-bf90-327ad588aa83-kube-rbac-proxy-sar-config\") pod \"isvc-logger-predictor-65cffbc4cb-5s84x\" (UID: \"29a707b7-1ddd-4c34-bf90-327ad588aa83\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x"
Jul 15 10:59:39.339202 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:39.339182    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/29a707b7-1ddd-4c34-bf90-327ad588aa83-cabundle-cert\") pod \"isvc-logger-predictor-65cffbc4cb-5s84x\" (UID: \"29a707b7-1ddd-4c34-bf90-327ad588aa83\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x"
Jul 15 10:59:39.341228 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:39.341208    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/29a707b7-1ddd-4c34-bf90-327ad588aa83-proxy-tls\") pod \"isvc-logger-predictor-65cffbc4cb-5s84x\" (UID: \"29a707b7-1ddd-4c34-bf90-327ad588aa83\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x"
Jul 15 10:59:39.348858 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:39.348833    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 10:59:39.351263 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:39.351233    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcw2g\" (UniqueName: \"kubernetes.io/projected/29a707b7-1ddd-4c34-bf90-327ad588aa83-kube-api-access-kcw2g\") pod \"isvc-logger-predictor-65cffbc4cb-5s84x\" (UID: \"29a707b7-1ddd-4c34-bf90-327ad588aa83\") " pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x"
Jul 15 10:59:39.365473 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:39.365439    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x"
Jul 15 10:59:39.518108 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:39.515095    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x"]
Jul 15 10:59:39.919863 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:39.919821    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 10:59:39.920289 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:39.919954    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs"
Jul 15 10:59:39.921000 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:39.920978    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:5000: connect: connection refused"
Jul 15 10:59:39.921103 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:39.921088    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs"
Jul 15 10:59:40.019994 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:40.019958    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x" event={"ID":"29a707b7-1ddd-4c34-bf90-327ad588aa83","Type":"ContainerStarted","Data":"6d13c9e10f392a901d0fdfce915dff492e8822a49a4b9272f37d438054bfbbbf"}
Jul 15 10:59:40.020176 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:40.020024    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x" event={"ID":"29a707b7-1ddd-4c34-bf90-327ad588aa83","Type":"ContainerStarted","Data":"10190895df6da12010083caf677e9c8ea42bcfea49303969ad74f2f16b145fdc"}
Jul 15 10:59:41.484088 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:41.484040    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.36:8643/healthz\": dial tcp 10.132.0.36:8643: connect: connection refused"
Jul 15 10:59:44.040272 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:44.040238    2565 generic.go:356] "Generic (PLEG): container finished" podID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerID="6d13c9e10f392a901d0fdfce915dff492e8822a49a4b9272f37d438054bfbbbf" exitCode=0
Jul 15 10:59:44.040697 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:44.040311    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x" event={"ID":"29a707b7-1ddd-4c34-bf90-327ad588aa83","Type":"ContainerDied","Data":"6d13c9e10f392a901d0fdfce915dff492e8822a49a4b9272f37d438054bfbbbf"}
Jul 15 10:59:45.047627 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:45.047590    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x" event={"ID":"29a707b7-1ddd-4c34-bf90-327ad588aa83","Type":"ContainerStarted","Data":"d7207f61f67c1090799bb3bc9fdc0597f7c7fff20174471aae1e7c01ca70e7d8"}
Jul 15 10:59:45.048003 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:45.047688    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x" event={"ID":"29a707b7-1ddd-4c34-bf90-327ad588aa83","Type":"ContainerStarted","Data":"0106f8199d3e0b9472c728c31b6202f94509631ff1d5fbe29c8606312317a33e"}
Jul 15 10:59:45.048003 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:45.047716    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x" event={"ID":"29a707b7-1ddd-4c34-bf90-327ad588aa83","Type":"ContainerStarted","Data":"2782b4ecfbd5ee965d06ed5fdf3c31e113e81bfa8870dcb535e1875c1cae309d"}
Jul 15 10:59:45.048077 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:45.048042    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x"
Jul 15 10:59:45.048123 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:45.048107    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x"
Jul 15 10:59:45.049279 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:45.049253    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x" podUID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Jul 15 10:59:45.079598 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:45.079543    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x" podStartSLOduration=2.224190896 podStartE2EDuration="6.079527236s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.85533634s" isStatefulPod=false podCreationTimestamp="2026-07-15 10:59:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 10:59:45.077083705 +0000 UTC m=+882.685619727" watchObservedRunningTime="2026-07-15 10:59:45.079527236 +0000 UTC m=+882.688063258"
Jul 15 10:59:46.052515 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:46.052489    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x"
Jul 15 10:59:46.052945 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:46.052539    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x" podUID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Jul 15 10:59:46.053777 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:46.053748    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x" podUID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 10:59:46.484118 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:46.484026    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.36:8643/healthz\": dial tcp 10.132.0.36:8643: connect: connection refused"
Jul 15 10:59:47.058809 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:47.058772    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x" podUID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Jul 15 10:59:47.059285 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:47.059257    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x" podUID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 10:59:48.921218 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:48.921194    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs"
Jul 15 10:59:49.027574 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:49.027543    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/43c8bafa-9ac8-45e7-8356-f92c39bb1d64-cabundle-cert\") pod \"43c8bafa-9ac8-45e7-8356-f92c39bb1d64\" (UID: \"43c8bafa-9ac8-45e7-8356-f92c39bb1d64\") "
Jul 15 10:59:49.027722 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:49.027594    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/43c8bafa-9ac8-45e7-8356-f92c39bb1d64-kserve-provision-location\") pod \"43c8bafa-9ac8-45e7-8356-f92c39bb1d64\" (UID: \"43c8bafa-9ac8-45e7-8356-f92c39bb1d64\") "
Jul 15 10:59:49.027722 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:49.027614    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gd29r\" (UniqueName: \"kubernetes.io/projected/43c8bafa-9ac8-45e7-8356-f92c39bb1d64-kube-api-access-gd29r\") pod \"43c8bafa-9ac8-45e7-8356-f92c39bb1d64\" (UID: \"43c8bafa-9ac8-45e7-8356-f92c39bb1d64\") "
Jul 15 10:59:49.027722 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:49.027672    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/43c8bafa-9ac8-45e7-8356-f92c39bb1d64-proxy-tls\") pod \"43c8bafa-9ac8-45e7-8356-f92c39bb1d64\" (UID: \"43c8bafa-9ac8-45e7-8356-f92c39bb1d64\") "
Jul 15 10:59:49.027857 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:49.027731    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/43c8bafa-9ac8-45e7-8356-f92c39bb1d64-kube-rbac-proxy-sar-config\") pod \"43c8bafa-9ac8-45e7-8356-f92c39bb1d64\" (UID: \"43c8bafa-9ac8-45e7-8356-f92c39bb1d64\") "
Jul 15 10:59:49.027998 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:49.027947    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43c8bafa-9ac8-45e7-8356-f92c39bb1d64-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "43c8bafa-9ac8-45e7-8356-f92c39bb1d64" (UID: "43c8bafa-9ac8-45e7-8356-f92c39bb1d64"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 10:59:49.027998 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:49.027972    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43c8bafa-9ac8-45e7-8356-f92c39bb1d64-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "43c8bafa-9ac8-45e7-8356-f92c39bb1d64" (UID: "43c8bafa-9ac8-45e7-8356-f92c39bb1d64"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:59:49.028312 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:49.028140    2565 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/43c8bafa-9ac8-45e7-8356-f92c39bb1d64-kserve-provision-location\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:59:49.028312 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:49.028173    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43c8bafa-9ac8-45e7-8356-f92c39bb1d64-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "43c8bafa-9ac8-45e7-8356-f92c39bb1d64" (UID: "43c8bafa-9ac8-45e7-8356-f92c39bb1d64"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 10:59:49.029977 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:49.029952    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43c8bafa-9ac8-45e7-8356-f92c39bb1d64-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "43c8bafa-9ac8-45e7-8356-f92c39bb1d64" (UID: "43c8bafa-9ac8-45e7-8356-f92c39bb1d64"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 10:59:49.030063 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:49.030035    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43c8bafa-9ac8-45e7-8356-f92c39bb1d64-kube-api-access-gd29r" (OuterVolumeSpecName: "kube-api-access-gd29r") pod "43c8bafa-9ac8-45e7-8356-f92c39bb1d64" (UID: "43c8bafa-9ac8-45e7-8356-f92c39bb1d64"). InnerVolumeSpecName "kube-api-access-gd29r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 10:59:49.070763 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:49.070726    2565 generic.go:356] "Generic (PLEG): container finished" podID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerID="e15cf79486d38fc71d0fa6c7c1e02ff8af742577d187c6881d4c7c5d7c1a4515" exitCode=0
Jul 15 10:59:49.070904 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:49.070774    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" event={"ID":"43c8bafa-9ac8-45e7-8356-f92c39bb1d64","Type":"ContainerDied","Data":"e15cf79486d38fc71d0fa6c7c1e02ff8af742577d187c6881d4c7c5d7c1a4515"}
Jul 15 10:59:49.070904 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:49.070787    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs"
Jul 15 10:59:49.070904 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:49.070839    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs" event={"ID":"43c8bafa-9ac8-45e7-8356-f92c39bb1d64","Type":"ContainerDied","Data":"71a568009f9ae7431b75545c22cce789404e6581cd41ee3fd9cf8a247f5ef119"}
Jul 15 10:59:49.070904 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:49.070883    2565 scope.go:117] "RemoveContainer" containerID="e15cf79486d38fc71d0fa6c7c1e02ff8af742577d187c6881d4c7c5d7c1a4515"
Jul 15 10:59:49.080051 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:49.080031    2565 scope.go:117] "RemoveContainer" containerID="cf203589c9266916dfb66668194b109da8da59330c59d78aa7fd0f2969b567bb"
Jul 15 10:59:49.087875 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:49.087856    2565 scope.go:117] "RemoveContainer" containerID="ffbdcbb3017cfe9291cb9ad81004e8d40631255aff0af30bb16a01c1f65d5a14"
Jul 15 10:59:49.095768 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:49.095742    2565 scope.go:117] "RemoveContainer" containerID="af92ca3fa64e238391d41e8ee9b3d0edb195f5e7fc97d22498123349e717ac6d"
Jul 15 10:59:49.103264 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:49.103243    2565 scope.go:117] "RemoveContainer" containerID="e15cf79486d38fc71d0fa6c7c1e02ff8af742577d187c6881d4c7c5d7c1a4515"
Jul 15 10:59:49.103584 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:59:49.103563    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e15cf79486d38fc71d0fa6c7c1e02ff8af742577d187c6881d4c7c5d7c1a4515\": container with ID starting with e15cf79486d38fc71d0fa6c7c1e02ff8af742577d187c6881d4c7c5d7c1a4515 not found: ID does not exist" containerID="e15cf79486d38fc71d0fa6c7c1e02ff8af742577d187c6881d4c7c5d7c1a4515"
Jul 15 10:59:49.103667 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:49.103597    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e15cf79486d38fc71d0fa6c7c1e02ff8af742577d187c6881d4c7c5d7c1a4515"} err="failed to get container status \"e15cf79486d38fc71d0fa6c7c1e02ff8af742577d187c6881d4c7c5d7c1a4515\": rpc error: code = NotFound desc = could not find container \"e15cf79486d38fc71d0fa6c7c1e02ff8af742577d187c6881d4c7c5d7c1a4515\": container with ID starting with e15cf79486d38fc71d0fa6c7c1e02ff8af742577d187c6881d4c7c5d7c1a4515 not found: ID does not exist"
Jul 15 10:59:49.103667 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:49.103623    2565 scope.go:117] "RemoveContainer" containerID="cf203589c9266916dfb66668194b109da8da59330c59d78aa7fd0f2969b567bb"
Jul 15 10:59:49.103922 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:59:49.103900    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf203589c9266916dfb66668194b109da8da59330c59d78aa7fd0f2969b567bb\": container with ID starting with cf203589c9266916dfb66668194b109da8da59330c59d78aa7fd0f2969b567bb not found: ID does not exist" containerID="cf203589c9266916dfb66668194b109da8da59330c59d78aa7fd0f2969b567bb"
Jul 15 10:59:49.103960 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:49.103928    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf203589c9266916dfb66668194b109da8da59330c59d78aa7fd0f2969b567bb"} err="failed to get container status \"cf203589c9266916dfb66668194b109da8da59330c59d78aa7fd0f2969b567bb\": rpc error: code = NotFound desc = could not find container \"cf203589c9266916dfb66668194b109da8da59330c59d78aa7fd0f2969b567bb\": container with ID starting with cf203589c9266916dfb66668194b109da8da59330c59d78aa7fd0f2969b567bb not found: ID does not exist"
Jul 15 10:59:49.103960 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:49.103944    2565 scope.go:117] "RemoveContainer" containerID="ffbdcbb3017cfe9291cb9ad81004e8d40631255aff0af30bb16a01c1f65d5a14"
Jul 15 10:59:49.104185 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:59:49.104166    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffbdcbb3017cfe9291cb9ad81004e8d40631255aff0af30bb16a01c1f65d5a14\": container with ID starting with ffbdcbb3017cfe9291cb9ad81004e8d40631255aff0af30bb16a01c1f65d5a14 not found: ID does not exist" containerID="ffbdcbb3017cfe9291cb9ad81004e8d40631255aff0af30bb16a01c1f65d5a14"
Jul 15 10:59:49.104224 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:49.104191    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffbdcbb3017cfe9291cb9ad81004e8d40631255aff0af30bb16a01c1f65d5a14"} err="failed to get container status \"ffbdcbb3017cfe9291cb9ad81004e8d40631255aff0af30bb16a01c1f65d5a14\": rpc error: code = NotFound desc = could not find container \"ffbdcbb3017cfe9291cb9ad81004e8d40631255aff0af30bb16a01c1f65d5a14\": container with ID starting with ffbdcbb3017cfe9291cb9ad81004e8d40631255aff0af30bb16a01c1f65d5a14 not found: ID does not exist"
Jul 15 10:59:49.104224 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:49.104206    2565 scope.go:117] "RemoveContainer" containerID="af92ca3fa64e238391d41e8ee9b3d0edb195f5e7fc97d22498123349e717ac6d"
Jul 15 10:59:49.104468 ip-10-0-134-216 kubenswrapper[2565]: E0715 10:59:49.104439    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af92ca3fa64e238391d41e8ee9b3d0edb195f5e7fc97d22498123349e717ac6d\": container with ID starting with af92ca3fa64e238391d41e8ee9b3d0edb195f5e7fc97d22498123349e717ac6d not found: ID does not exist" containerID="af92ca3fa64e238391d41e8ee9b3d0edb195f5e7fc97d22498123349e717ac6d"
Jul 15 10:59:49.104560 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:49.104474    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af92ca3fa64e238391d41e8ee9b3d0edb195f5e7fc97d22498123349e717ac6d"} err="failed to get container status \"af92ca3fa64e238391d41e8ee9b3d0edb195f5e7fc97d22498123349e717ac6d\": rpc error: code = NotFound desc = could not find container \"af92ca3fa64e238391d41e8ee9b3d0edb195f5e7fc97d22498123349e717ac6d\": container with ID starting with af92ca3fa64e238391d41e8ee9b3d0edb195f5e7fc97d22498123349e717ac6d not found: ID does not exist"
Jul 15 10:59:49.124047 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:49.124021    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs"]
Jul 15 10:59:49.129215 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:49.129197    2565 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/43c8bafa-9ac8-45e7-8356-f92c39bb1d64-cabundle-cert\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:59:49.129275 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:49.129221    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gd29r\" (UniqueName: \"kubernetes.io/projected/43c8bafa-9ac8-45e7-8356-f92c39bb1d64-kube-api-access-gd29r\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:59:49.129275 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:49.129233    2565 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/43c8bafa-9ac8-45e7-8356-f92c39bb1d64-proxy-tls\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:59:49.129275 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:49.129242    2565 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/43c8bafa-9ac8-45e7-8356-f92c39bb1d64-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 10:59:49.147615 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:49.147585    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-batcher-custom-predictor-554989df4b-cn2qs"]
Jul 15 10:59:50.925553 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:50.925507    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" path="/var/lib/kubelet/pods/43c8bafa-9ac8-45e7-8356-f92c39bb1d64/volumes"
Jul 15 10:59:52.064008 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:52.063969    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x"
Jul 15 10:59:52.064747 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:52.064714    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x" podUID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Jul 15 10:59:52.065016 ip-10-0-134-216 kubenswrapper[2565]: I0715 10:59:52.064992    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x" podUID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 11:00:02.065242 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:00:02.065129    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x" podUID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Jul 15 11:00:02.065813 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:00:02.065705    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x" podUID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 11:00:02.888487 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:00:02.888458    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8dcjj_8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9/console-operator/1.log"
Jul 15 11:00:02.889577 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:00:02.889543    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8dcjj_8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9/console-operator/1.log"
Jul 15 11:00:02.892709 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:00:02.892687    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qsch8_f3b175c1-34f8-4e74-bce6-f866e4bd25b0/ovn-acl-logging/0.log"
Jul 15 11:00:02.893756 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:00:02.893738    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qsch8_f3b175c1-34f8-4e74-bce6-f866e4bd25b0/ovn-acl-logging/0.log"
Jul 15 11:00:12.065351 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:00:12.065295    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x" podUID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Jul 15 11:00:12.065914 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:00:12.065831    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x" podUID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 11:00:22.065168 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:00:22.065125    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x" podUID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Jul 15 11:00:22.065706 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:00:22.065559    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x" podUID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 11:00:32.064860 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:00:32.064812    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x" podUID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Jul 15 11:00:32.065325 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:00:32.065302    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x" podUID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 11:00:42.064761 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:00:42.064713    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x" podUID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Jul 15 11:00:42.065250 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:00:42.065223    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x" podUID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 11:00:52.064680 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:00:52.064633    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x" podUID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Jul 15 11:00:52.065166 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:00:52.065089    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x" podUID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 11:01:02.065571 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:02.065537    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x"
Jul 15 11:01:02.066079 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:02.065685    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x"
Jul 15 11:01:13.899391 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:13.899359    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-6575bcfdfd-8lpzg_13001d9d-7abc-49d9-8ba1-adcc44de095e/kserve-container/0.log"
Jul 15 11:01:14.200000 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.199927    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x"]
Jul 15 11:01:14.200253 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.200222    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x" podUID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerName="kserve-container" containerID="cri-o://2782b4ecfbd5ee965d06ed5fdf3c31e113e81bfa8870dcb535e1875c1cae309d" gracePeriod=30
Jul 15 11:01:14.200406 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.200283    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x" podUID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerName="kube-rbac-proxy" containerID="cri-o://0106f8199d3e0b9472c728c31b6202f94509631ff1d5fbe29c8606312317a33e" gracePeriod=30
Jul 15 11:01:14.200493 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.200260    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x" podUID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerName="agent" containerID="cri-o://d7207f61f67c1090799bb3bc9fdc0597f7c7fff20174471aae1e7c01ca70e7d8" gracePeriod=30
Jul 15 11:01:14.217301 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.217276    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 11:01:14.294831 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.294800    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g"]
Jul 15 11:01:14.295244 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.295227    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="agent"
Jul 15 11:01:14.295347 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.295246    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="agent"
Jul 15 11:01:14.295347 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.295274    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="kserve-container"
Jul 15 11:01:14.295347 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.295283    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="kserve-container"
Jul 15 11:01:14.295347 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.295306    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="storage-initializer"
Jul 15 11:01:14.295347 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.295316    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="storage-initializer"
Jul 15 11:01:14.295609 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.295350    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="kube-rbac-proxy"
Jul 15 11:01:14.295609 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.295359    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="kube-rbac-proxy"
Jul 15 11:01:14.295609 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.295449    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="agent"
Jul 15 11:01:14.295609 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.295463    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="kserve-container"
Jul 15 11:01:14.295609 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.295473    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="43c8bafa-9ac8-45e7-8356-f92c39bb1d64" containerName="kube-rbac-proxy"
Jul 15 11:01:14.298966 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.298947    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g"
Jul 15 11:01:14.302386 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.302363    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-autogluon-v1-kube-rbac-proxy-sar-config\""
Jul 15 11:01:14.302509 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.302365    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-autogluon-v1-predictor-serving-cert\""
Jul 15 11:01:14.312290 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.312264    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g"]
Jul 15 11:01:14.345625 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.345593    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-8lpzg"]
Jul 15 11:01:14.345819 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.345798    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-8lpzg" podUID="13001d9d-7abc-49d9-8ba1-adcc44de095e" containerName="kserve-container" containerID="cri-o://ee9a52080da174811b212939e33e1572e9d482d9c35753a52952dc48829a4f0d" gracePeriod=30
Jul 15 11:01:14.345892 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.345827    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-8lpzg" podUID="13001d9d-7abc-49d9-8ba1-adcc44de095e" containerName="kube-rbac-proxy" containerID="cri-o://484db1fda4e4921b03090b4bc0c57851b95bf727ea948ff5a0bca77215fffbdf" gracePeriod=30
Jul 15 11:01:14.415433 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.415404    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g\" (UID: \"6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g"
Jul 15 11:01:14.415593 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.415452    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6gzx\" (UniqueName: \"kubernetes.io/projected/6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc-kube-api-access-z6gzx\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g\" (UID: \"6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g"
Jul 15 11:01:14.415593 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.415509    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc-cabundle-cert\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g\" (UID: \"6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g"
Jul 15 11:01:14.415593 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.415558    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc-proxy-tls\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g\" (UID: \"6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g"
Jul 15 11:01:14.415593 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.415581    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc-kserve-provision-location\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g\" (UID: \"6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g"
Jul 15 11:01:14.484641 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.484600    2565 generic.go:356] "Generic (PLEG): container finished" podID="13001d9d-7abc-49d9-8ba1-adcc44de095e" containerID="484db1fda4e4921b03090b4bc0c57851b95bf727ea948ff5a0bca77215fffbdf" exitCode=2
Jul 15 11:01:14.484641 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.484626    2565 generic.go:356] "Generic (PLEG): container finished" podID="13001d9d-7abc-49d9-8ba1-adcc44de095e" containerID="ee9a52080da174811b212939e33e1572e9d482d9c35753a52952dc48829a4f0d" exitCode=2
Jul 15 11:01:14.484921 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.484678    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-8lpzg" event={"ID":"13001d9d-7abc-49d9-8ba1-adcc44de095e","Type":"ContainerDied","Data":"484db1fda4e4921b03090b4bc0c57851b95bf727ea948ff5a0bca77215fffbdf"}
Jul 15 11:01:14.484921 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.484752    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-8lpzg" event={"ID":"13001d9d-7abc-49d9-8ba1-adcc44de095e","Type":"ContainerDied","Data":"ee9a52080da174811b212939e33e1572e9d482d9c35753a52952dc48829a4f0d"}
Jul 15 11:01:14.495148 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.495110    2565 generic.go:356] "Generic (PLEG): container finished" podID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerID="0106f8199d3e0b9472c728c31b6202f94509631ff1d5fbe29c8606312317a33e" exitCode=2
Jul 15 11:01:14.495293 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.495187    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x" event={"ID":"29a707b7-1ddd-4c34-bf90-327ad588aa83","Type":"ContainerDied","Data":"0106f8199d3e0b9472c728c31b6202f94509631ff1d5fbe29c8606312317a33e"}
Jul 15 11:01:14.516198 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.516158    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g\" (UID: \"6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g"
Jul 15 11:01:14.516372 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.516214    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6gzx\" (UniqueName: \"kubernetes.io/projected/6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc-kube-api-access-z6gzx\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g\" (UID: \"6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g"
Jul 15 11:01:14.516372 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.516253    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc-cabundle-cert\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g\" (UID: \"6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g"
Jul 15 11:01:14.516372 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.516275    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc-proxy-tls\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g\" (UID: \"6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g"
Jul 15 11:01:14.516372 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.516292    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc-kserve-provision-location\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g\" (UID: \"6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g"
Jul 15 11:01:14.516593 ip-10-0-134-216 kubenswrapper[2565]: E0715 11:01:14.516466    2565 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-autogluon-v1-predictor-serving-cert: secret "isvc-autogluon-v1-predictor-serving-cert" not found
Jul 15 11:01:14.516593 ip-10-0-134-216 kubenswrapper[2565]: E0715 11:01:14.516538    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc-proxy-tls podName:6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc nodeName:}" failed. No retries permitted until 2026-07-15 11:01:15.016516575 +0000 UTC m=+972.625052575 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc-proxy-tls") pod "isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g" (UID: "6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc") : secret "isvc-autogluon-v1-predictor-serving-cert" not found
Jul 15 11:01:14.516799 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.516778    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc-kserve-provision-location\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g\" (UID: \"6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g"
Jul 15 11:01:14.516986 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.516970    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc-cabundle-cert\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g\" (UID: \"6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g"
Jul 15 11:01:14.517024 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.516989    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g\" (UID: \"6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g"
Jul 15 11:01:14.528709 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.528675    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6gzx\" (UniqueName: \"kubernetes.io/projected/6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc-kube-api-access-z6gzx\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g\" (UID: \"6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g"
Jul 15 11:01:14.600634 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.600611    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-8lpzg"
Jul 15 11:01:14.718127 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.718034    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6jt2\" (UniqueName: \"kubernetes.io/projected/13001d9d-7abc-49d9-8ba1-adcc44de095e-kube-api-access-g6jt2\") pod \"13001d9d-7abc-49d9-8ba1-adcc44de095e\" (UID: \"13001d9d-7abc-49d9-8ba1-adcc44de095e\") "
Jul 15 11:01:14.718277 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.718194    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/13001d9d-7abc-49d9-8ba1-adcc44de095e-kube-rbac-proxy-sar-config\") pod \"13001d9d-7abc-49d9-8ba1-adcc44de095e\" (UID: \"13001d9d-7abc-49d9-8ba1-adcc44de095e\") "
Jul 15 11:01:14.718277 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.718249    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/13001d9d-7abc-49d9-8ba1-adcc44de095e-proxy-tls\") pod \"13001d9d-7abc-49d9-8ba1-adcc44de095e\" (UID: \"13001d9d-7abc-49d9-8ba1-adcc44de095e\") "
Jul 15 11:01:14.718521 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.718498    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13001d9d-7abc-49d9-8ba1-adcc44de095e-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "13001d9d-7abc-49d9-8ba1-adcc44de095e" (UID: "13001d9d-7abc-49d9-8ba1-adcc44de095e"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 11:01:14.718687 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.718660    2565 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/13001d9d-7abc-49d9-8ba1-adcc44de095e-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 11:01:14.720425 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.720402    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13001d9d-7abc-49d9-8ba1-adcc44de095e-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "13001d9d-7abc-49d9-8ba1-adcc44de095e" (UID: "13001d9d-7abc-49d9-8ba1-adcc44de095e"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 11:01:14.720425 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.720403    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13001d9d-7abc-49d9-8ba1-adcc44de095e-kube-api-access-g6jt2" (OuterVolumeSpecName: "kube-api-access-g6jt2") pod "13001d9d-7abc-49d9-8ba1-adcc44de095e" (UID: "13001d9d-7abc-49d9-8ba1-adcc44de095e"). InnerVolumeSpecName "kube-api-access-g6jt2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 11:01:14.819748 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.819719    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6jt2\" (UniqueName: \"kubernetes.io/projected/13001d9d-7abc-49d9-8ba1-adcc44de095e-kube-api-access-g6jt2\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 11:01:14.819748 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:14.819745    2565 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/13001d9d-7abc-49d9-8ba1-adcc44de095e-proxy-tls\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 11:01:15.021176 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:15.021084    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc-proxy-tls\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g\" (UID: \"6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g"
Jul 15 11:01:15.023758 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:15.023732    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc-proxy-tls\") pod \"isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g\" (UID: \"6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc\") " pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g"
Jul 15 11:01:15.211866 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:15.211834    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g"
Jul 15 11:01:15.364028 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:15.364002    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g"]
Jul 15 11:01:15.366599 ip-10-0-134-216 kubenswrapper[2565]: W0715 11:01:15.366573    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fbb545e_9e5e_4bf9_9304_0c23e7adf7fc.slice/crio-090fe42168e3525be8810951a9fe51be3adf93d607c8bbb8798677a1e4338519 WatchSource:0}: Error finding container 090fe42168e3525be8810951a9fe51be3adf93d607c8bbb8798677a1e4338519: Status 404 returned error can't find the container with id 090fe42168e3525be8810951a9fe51be3adf93d607c8bbb8798677a1e4338519
Jul 15 11:01:15.504977 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:15.504937    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g" event={"ID":"6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc","Type":"ContainerStarted","Data":"a66e2e2a8b97eed3222101c193ed3bbfeeb1b0f4c1616356de89112b9f389085"}
Jul 15 11:01:15.505190 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:15.505017    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g" event={"ID":"6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc","Type":"ContainerStarted","Data":"090fe42168e3525be8810951a9fe51be3adf93d607c8bbb8798677a1e4338519"}
Jul 15 11:01:15.506842 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:15.506818    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-8lpzg" event={"ID":"13001d9d-7abc-49d9-8ba1-adcc44de095e","Type":"ContainerDied","Data":"cfe58a4da366e0306f3066b71a7afc5630f4a62f8c4603e8c8330dd91e5bf664"}
Jul 15 11:01:15.506957 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:15.506866    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-8lpzg"
Jul 15 11:01:15.506957 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:15.506883    2565 scope.go:117] "RemoveContainer" containerID="484db1fda4e4921b03090b4bc0c57851b95bf727ea948ff5a0bca77215fffbdf"
Jul 15 11:01:15.516488 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:15.516472    2565 scope.go:117] "RemoveContainer" containerID="ee9a52080da174811b212939e33e1572e9d482d9c35753a52952dc48829a4f0d"
Jul 15 11:01:15.544201 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:15.544172    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-8lpzg"]
Jul 15 11:01:15.548520 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:15.548457    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-8lpzg"]
Jul 15 11:01:16.357556 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:16.357499    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 11:01:16.924718 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:16.924677    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13001d9d-7abc-49d9-8ba1-adcc44de095e" path="/var/lib/kubelet/pods/13001d9d-7abc-49d9-8ba1-adcc44de095e/volumes"
Jul 15 11:01:17.059669 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:17.059626    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x" podUID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.38:8643/healthz\": dial tcp 10.132.0.38:8643: connect: connection refused"
Jul 15 11:01:19.535137 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:19.535085    2565 generic.go:356] "Generic (PLEG): container finished" podID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerID="2782b4ecfbd5ee965d06ed5fdf3c31e113e81bfa8870dcb535e1875c1cae309d" exitCode=0
Jul 15 11:01:19.535546 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:19.535164    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x" event={"ID":"29a707b7-1ddd-4c34-bf90-327ad588aa83","Type":"ContainerDied","Data":"2782b4ecfbd5ee965d06ed5fdf3c31e113e81bfa8870dcb535e1875c1cae309d"}
Jul 15 11:01:22.059299 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:22.059256    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x" podUID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.38:8643/healthz\": dial tcp 10.132.0.38:8643: connect: connection refused"
Jul 15 11:01:22.064650 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:22.064620    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x" podUID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Jul 15 11:01:22.065037 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:22.065013    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x" podUID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 11:01:27.058966 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:27.058917    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x" podUID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.38:8643/healthz\": dial tcp 10.132.0.38:8643: connect: connection refused"
Jul 15 11:01:27.059427 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:27.059056    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x"
Jul 15 11:01:32.059396 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:32.059354    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x" podUID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.38:8643/healthz\": dial tcp 10.132.0.38:8643: connect: connection refused"
Jul 15 11:01:32.064793 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:32.064758    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x" podUID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Jul 15 11:01:32.065148 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:32.065119    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x" podUID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 11:01:37.059393 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:37.059325    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x" podUID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.38:8643/healthz\": dial tcp 10.132.0.38:8643: connect: connection refused"
Jul 15 11:01:42.059037 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:42.058993    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x" podUID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.38:8643/healthz\": dial tcp 10.132.0.38:8643: connect: connection refused"
Jul 15 11:01:42.064607 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:42.064566    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x" podUID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Jul 15 11:01:42.064742 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:42.064705    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x"
Jul 15 11:01:42.064852 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:42.064834    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x" podUID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 11:01:42.064935 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:42.064925    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x"
Jul 15 11:01:44.357478 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:44.357450    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x"
Jul 15 11:01:44.481760 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:44.481660    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/29a707b7-1ddd-4c34-bf90-327ad588aa83-kube-rbac-proxy-sar-config\") pod \"29a707b7-1ddd-4c34-bf90-327ad588aa83\" (UID: \"29a707b7-1ddd-4c34-bf90-327ad588aa83\") "
Jul 15 11:01:44.481760 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:44.481712    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kcw2g\" (UniqueName: \"kubernetes.io/projected/29a707b7-1ddd-4c34-bf90-327ad588aa83-kube-api-access-kcw2g\") pod \"29a707b7-1ddd-4c34-bf90-327ad588aa83\" (UID: \"29a707b7-1ddd-4c34-bf90-327ad588aa83\") "
Jul 15 11:01:44.481760 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:44.481743    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/29a707b7-1ddd-4c34-bf90-327ad588aa83-proxy-tls\") pod \"29a707b7-1ddd-4c34-bf90-327ad588aa83\" (UID: \"29a707b7-1ddd-4c34-bf90-327ad588aa83\") "
Jul 15 11:01:44.482047 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:44.481773    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/29a707b7-1ddd-4c34-bf90-327ad588aa83-cabundle-cert\") pod \"29a707b7-1ddd-4c34-bf90-327ad588aa83\" (UID: \"29a707b7-1ddd-4c34-bf90-327ad588aa83\") "
Jul 15 11:01:44.482047 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:44.481808    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/29a707b7-1ddd-4c34-bf90-327ad588aa83-kserve-provision-location\") pod \"29a707b7-1ddd-4c34-bf90-327ad588aa83\" (UID: \"29a707b7-1ddd-4c34-bf90-327ad588aa83\") "
Jul 15 11:01:44.482174 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:44.482143    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29a707b7-1ddd-4c34-bf90-327ad588aa83-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "29a707b7-1ddd-4c34-bf90-327ad588aa83" (UID: "29a707b7-1ddd-4c34-bf90-327ad588aa83"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 11:01:44.482236 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:44.482191    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29a707b7-1ddd-4c34-bf90-327ad588aa83-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "29a707b7-1ddd-4c34-bf90-327ad588aa83" (UID: "29a707b7-1ddd-4c34-bf90-327ad588aa83"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 11:01:44.482236 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:44.482207    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29a707b7-1ddd-4c34-bf90-327ad588aa83-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "29a707b7-1ddd-4c34-bf90-327ad588aa83" (UID: "29a707b7-1ddd-4c34-bf90-327ad588aa83"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 11:01:44.484166 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:44.484136    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29a707b7-1ddd-4c34-bf90-327ad588aa83-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "29a707b7-1ddd-4c34-bf90-327ad588aa83" (UID: "29a707b7-1ddd-4c34-bf90-327ad588aa83"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 11:01:44.484283 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:44.484168    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29a707b7-1ddd-4c34-bf90-327ad588aa83-kube-api-access-kcw2g" (OuterVolumeSpecName: "kube-api-access-kcw2g") pod "29a707b7-1ddd-4c34-bf90-327ad588aa83" (UID: "29a707b7-1ddd-4c34-bf90-327ad588aa83"). InnerVolumeSpecName "kube-api-access-kcw2g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 11:01:44.583222 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:44.583189    2565 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/29a707b7-1ddd-4c34-bf90-327ad588aa83-kserve-provision-location\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 11:01:44.583222 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:44.583220    2565 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/29a707b7-1ddd-4c34-bf90-327ad588aa83-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 11:01:44.583442 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:44.583230    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kcw2g\" (UniqueName: \"kubernetes.io/projected/29a707b7-1ddd-4c34-bf90-327ad588aa83-kube-api-access-kcw2g\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 11:01:44.583442 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:44.583240    2565 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/29a707b7-1ddd-4c34-bf90-327ad588aa83-proxy-tls\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 11:01:44.583442 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:44.583249    2565 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/29a707b7-1ddd-4c34-bf90-327ad588aa83-cabundle-cert\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 11:01:44.658986 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:44.658951    2565 generic.go:356] "Generic (PLEG): container finished" podID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerID="d7207f61f67c1090799bb3bc9fdc0597f7c7fff20174471aae1e7c01ca70e7d8" exitCode=0
Jul 15 11:01:44.659175 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:44.659039    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x"
Jul 15 11:01:44.659175 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:44.659072    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x" event={"ID":"29a707b7-1ddd-4c34-bf90-327ad588aa83","Type":"ContainerDied","Data":"d7207f61f67c1090799bb3bc9fdc0597f7c7fff20174471aae1e7c01ca70e7d8"}
Jul 15 11:01:44.659302 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:44.659181    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x" event={"ID":"29a707b7-1ddd-4c34-bf90-327ad588aa83","Type":"ContainerDied","Data":"10190895df6da12010083caf677e9c8ea42bcfea49303969ad74f2f16b145fdc"}
Jul 15 11:01:44.659302 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:44.659220    2565 scope.go:117] "RemoveContainer" containerID="d7207f61f67c1090799bb3bc9fdc0597f7c7fff20174471aae1e7c01ca70e7d8"
Jul 15 11:01:44.660818 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:44.660794    2565 generic.go:356] "Generic (PLEG): container finished" podID="6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc" containerID="a66e2e2a8b97eed3222101c193ed3bbfeeb1b0f4c1616356de89112b9f389085" exitCode=0
Jul 15 11:01:44.660944 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:44.660836    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g" event={"ID":"6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc","Type":"ContainerDied","Data":"a66e2e2a8b97eed3222101c193ed3bbfeeb1b0f4c1616356de89112b9f389085"}
Jul 15 11:01:44.662265 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:44.662246    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 11:01:44.668863 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:44.668847    2565 scope.go:117] "RemoveContainer" containerID="0106f8199d3e0b9472c728c31b6202f94509631ff1d5fbe29c8606312317a33e"
Jul 15 11:01:44.676571 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:44.676550    2565 scope.go:117] "RemoveContainer" containerID="2782b4ecfbd5ee965d06ed5fdf3c31e113e81bfa8870dcb535e1875c1cae309d"
Jul 15 11:01:44.684074 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:44.684057    2565 scope.go:117] "RemoveContainer" containerID="6d13c9e10f392a901d0fdfce915dff492e8822a49a4b9272f37d438054bfbbbf"
Jul 15 11:01:44.693214 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:44.692641    2565 scope.go:117] "RemoveContainer" containerID="d7207f61f67c1090799bb3bc9fdc0597f7c7fff20174471aae1e7c01ca70e7d8"
Jul 15 11:01:44.694388 ip-10-0-134-216 kubenswrapper[2565]: E0715 11:01:44.694366    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7207f61f67c1090799bb3bc9fdc0597f7c7fff20174471aae1e7c01ca70e7d8\": container with ID starting with d7207f61f67c1090799bb3bc9fdc0597f7c7fff20174471aae1e7c01ca70e7d8 not found: ID does not exist" containerID="d7207f61f67c1090799bb3bc9fdc0597f7c7fff20174471aae1e7c01ca70e7d8"
Jul 15 11:01:44.694491 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:44.694402    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7207f61f67c1090799bb3bc9fdc0597f7c7fff20174471aae1e7c01ca70e7d8"} err="failed to get container status \"d7207f61f67c1090799bb3bc9fdc0597f7c7fff20174471aae1e7c01ca70e7d8\": rpc error: code = NotFound desc = could not find container \"d7207f61f67c1090799bb3bc9fdc0597f7c7fff20174471aae1e7c01ca70e7d8\": container with ID starting with d7207f61f67c1090799bb3bc9fdc0597f7c7fff20174471aae1e7c01ca70e7d8 not found: ID does not exist"
Jul 15 11:01:44.694491 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:44.694425    2565 scope.go:117] "RemoveContainer" containerID="0106f8199d3e0b9472c728c31b6202f94509631ff1d5fbe29c8606312317a33e"
Jul 15 11:01:44.694709 ip-10-0-134-216 kubenswrapper[2565]: E0715 11:01:44.694691    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0106f8199d3e0b9472c728c31b6202f94509631ff1d5fbe29c8606312317a33e\": container with ID starting with 0106f8199d3e0b9472c728c31b6202f94509631ff1d5fbe29c8606312317a33e not found: ID does not exist" containerID="0106f8199d3e0b9472c728c31b6202f94509631ff1d5fbe29c8606312317a33e"
Jul 15 11:01:44.694757 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:44.694717    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0106f8199d3e0b9472c728c31b6202f94509631ff1d5fbe29c8606312317a33e"} err="failed to get container status \"0106f8199d3e0b9472c728c31b6202f94509631ff1d5fbe29c8606312317a33e\": rpc error: code = NotFound desc = could not find container \"0106f8199d3e0b9472c728c31b6202f94509631ff1d5fbe29c8606312317a33e\": container with ID starting with 0106f8199d3e0b9472c728c31b6202f94509631ff1d5fbe29c8606312317a33e not found: ID does not exist"
Jul 15 11:01:44.694757 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:44.694733    2565 scope.go:117] "RemoveContainer" containerID="2782b4ecfbd5ee965d06ed5fdf3c31e113e81bfa8870dcb535e1875c1cae309d"
Jul 15 11:01:44.694994 ip-10-0-134-216 kubenswrapper[2565]: E0715 11:01:44.694976    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2782b4ecfbd5ee965d06ed5fdf3c31e113e81bfa8870dcb535e1875c1cae309d\": container with ID starting with 2782b4ecfbd5ee965d06ed5fdf3c31e113e81bfa8870dcb535e1875c1cae309d not found: ID does not exist" containerID="2782b4ecfbd5ee965d06ed5fdf3c31e113e81bfa8870dcb535e1875c1cae309d"
Jul 15 11:01:44.695136 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:44.694998    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2782b4ecfbd5ee965d06ed5fdf3c31e113e81bfa8870dcb535e1875c1cae309d"} err="failed to get container status \"2782b4ecfbd5ee965d06ed5fdf3c31e113e81bfa8870dcb535e1875c1cae309d\": rpc error: code = NotFound desc = could not find container \"2782b4ecfbd5ee965d06ed5fdf3c31e113e81bfa8870dcb535e1875c1cae309d\": container with ID starting with 2782b4ecfbd5ee965d06ed5fdf3c31e113e81bfa8870dcb535e1875c1cae309d not found: ID does not exist"
Jul 15 11:01:44.695136 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:44.695019    2565 scope.go:117] "RemoveContainer" containerID="6d13c9e10f392a901d0fdfce915dff492e8822a49a4b9272f37d438054bfbbbf"
Jul 15 11:01:44.695327 ip-10-0-134-216 kubenswrapper[2565]: E0715 11:01:44.695304    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d13c9e10f392a901d0fdfce915dff492e8822a49a4b9272f37d438054bfbbbf\": container with ID starting with 6d13c9e10f392a901d0fdfce915dff492e8822a49a4b9272f37d438054bfbbbf not found: ID does not exist" containerID="6d13c9e10f392a901d0fdfce915dff492e8822a49a4b9272f37d438054bfbbbf"
Jul 15 11:01:44.695434 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:44.695351    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d13c9e10f392a901d0fdfce915dff492e8822a49a4b9272f37d438054bfbbbf"} err="failed to get container status \"6d13c9e10f392a901d0fdfce915dff492e8822a49a4b9272f37d438054bfbbbf\": rpc error: code = NotFound desc = could not find container \"6d13c9e10f392a901d0fdfce915dff492e8822a49a4b9272f37d438054bfbbbf\": container with ID starting with 6d13c9e10f392a901d0fdfce915dff492e8822a49a4b9272f37d438054bfbbbf not found: ID does not exist"
Jul 15 11:01:44.698255 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:44.698235    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x"]
Jul 15 11:01:44.701230 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:44.701210    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-logger-predictor-65cffbc4cb-5s84x"]
Jul 15 11:01:44.925608 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:01:44.925574    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29a707b7-1ddd-4c34-bf90-327ad588aa83" path="/var/lib/kubelet/pods/29a707b7-1ddd-4c34-bf90-327ad588aa83/volumes"
Jul 15 11:02:20.547059 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:02:20.547013    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 11:03:57.365254 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:03:57.365210    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g" event={"ID":"6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc","Type":"ContainerStarted","Data":"a6ce0e043e526e7a218b158f01c65f8e59c37620af33fffe094e0589bbe7cc1a"}
Jul 15 11:03:57.365765 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:03:57.365297    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g" event={"ID":"6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc","Type":"ContainerStarted","Data":"b5d57cb74bf4771033b0aca28239473b20566c78bd1996af1a2e7cc106fab21d"}
Jul 15 11:03:57.365765 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:03:57.365368    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g"
Jul 15 11:03:57.398996 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:03:57.398935    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g" podStartSLOduration=2.395341793 podStartE2EDuration="2m43.398917951s" totalImagesPullingTime="2m11.943236794s" totalInitContainerRuntime="29.060339364s" isStatefulPod=false podCreationTimestamp="2026-07-15 11:01:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 11:03:57.397664234 +0000 UTC m=+1135.006200295" watchObservedRunningTime="2026-07-15 11:03:57.398917951 +0000 UTC m=+1135.007453972"
Jul 15 11:03:58.370060 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:03:58.370022    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g"
Jul 15 11:03:58.371658 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:03:58.371631    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g" podUID="6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Jul 15 11:03:59.374852 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:03:59.374810    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g" podUID="6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Jul 15 11:04:04.379072 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:04.379039    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g"
Jul 15 11:04:04.379626 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:04.379529    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g" podUID="6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.39:8080: connect: connection refused"
Jul 15 11:04:14.380753 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:14.380722    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g"
Jul 15 11:04:24.427126 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:24.427091    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g"]
Jul 15 11:04:24.427622 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:24.427365    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g" podUID="6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc" containerName="kserve-container" containerID="cri-o://b5d57cb74bf4771033b0aca28239473b20566c78bd1996af1a2e7cc106fab21d" gracePeriod=30
Jul 15 11:04:24.427903 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:24.427866    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g" podUID="6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc" containerName="kube-rbac-proxy" containerID="cri-o://a6ce0e043e526e7a218b158f01c65f8e59c37620af33fffe094e0589bbe7cc1a" gracePeriod=30
Jul 15 11:04:24.490699 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:24.490664    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 11:04:25.410677 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:25.410645    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g"
Jul 15 11:04:25.476934 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:25.476901    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc-kserve-provision-location\") pod \"6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc\" (UID: \"6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc\") "
Jul 15 11:04:25.476934 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:25.476934    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc-proxy-tls\") pod \"6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc\" (UID: \"6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc\") "
Jul 15 11:04:25.477466 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:25.476972    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc-kube-rbac-proxy-sar-config\") pod \"6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc\" (UID: \"6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc\") "
Jul 15 11:04:25.477466 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:25.476996    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc-cabundle-cert\") pod \"6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc\" (UID: \"6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc\") "
Jul 15 11:04:25.477466 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:25.477049    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6gzx\" (UniqueName: \"kubernetes.io/projected/6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc-kube-api-access-z6gzx\") pod \"6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc\" (UID: \"6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc\") "
Jul 15 11:04:25.477466 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:25.477391    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc" (UID: "6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 11:04:25.477466 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:25.477436    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc" (UID: "6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 11:04:25.479227 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:25.479193    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc" (UID: "6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 11:04:25.479359 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:25.479242    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc-kube-api-access-z6gzx" (OuterVolumeSpecName: "kube-api-access-z6gzx") pod "6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc" (UID: "6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc"). InnerVolumeSpecName "kube-api-access-z6gzx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 11:04:25.481757 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:25.481734    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc" (UID: "6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 11:04:25.501532 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:25.501499    2565 generic.go:356] "Generic (PLEG): container finished" podID="6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc" containerID="a6ce0e043e526e7a218b158f01c65f8e59c37620af33fffe094e0589bbe7cc1a" exitCode=2
Jul 15 11:04:25.501532 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:25.501530    2565 generic.go:356] "Generic (PLEG): container finished" podID="6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc" containerID="b5d57cb74bf4771033b0aca28239473b20566c78bd1996af1a2e7cc106fab21d" exitCode=0
Jul 15 11:04:25.501712 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:25.501555    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g" event={"ID":"6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc","Type":"ContainerDied","Data":"a6ce0e043e526e7a218b158f01c65f8e59c37620af33fffe094e0589bbe7cc1a"}
Jul 15 11:04:25.501712 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:25.501563    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g"
Jul 15 11:04:25.501712 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:25.501620    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g" event={"ID":"6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc","Type":"ContainerDied","Data":"b5d57cb74bf4771033b0aca28239473b20566c78bd1996af1a2e7cc106fab21d"}
Jul 15 11:04:25.501712 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:25.501653    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g" event={"ID":"6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc","Type":"ContainerDied","Data":"090fe42168e3525be8810951a9fe51be3adf93d607c8bbb8798677a1e4338519"}
Jul 15 11:04:25.512583 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:25.501693    2565 scope.go:117] "RemoveContainer" containerID="a6ce0e043e526e7a218b158f01c65f8e59c37620af33fffe094e0589bbe7cc1a"
Jul 15 11:04:25.521035 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:25.521005    2565 scope.go:117] "RemoveContainer" containerID="b5d57cb74bf4771033b0aca28239473b20566c78bd1996af1a2e7cc106fab21d"
Jul 15 11:04:25.527476 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:25.527452    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g"]
Jul 15 11:04:25.529196 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:25.529180    2565 scope.go:117] "RemoveContainer" containerID="a66e2e2a8b97eed3222101c193ed3bbfeeb1b0f4c1616356de89112b9f389085"
Jul 15 11:04:25.537752 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:25.537732    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v1-predictor-7bbbbd79cd-hfw2g"]
Jul 15 11:04:25.541571 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:25.541556    2565 scope.go:117] "RemoveContainer" containerID="a6ce0e043e526e7a218b158f01c65f8e59c37620af33fffe094e0589bbe7cc1a"
Jul 15 11:04:25.541813 ip-10-0-134-216 kubenswrapper[2565]: E0715 11:04:25.541798    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6ce0e043e526e7a218b158f01c65f8e59c37620af33fffe094e0589bbe7cc1a\": container with ID starting with a6ce0e043e526e7a218b158f01c65f8e59c37620af33fffe094e0589bbe7cc1a not found: ID does not exist" containerID="a6ce0e043e526e7a218b158f01c65f8e59c37620af33fffe094e0589bbe7cc1a"
Jul 15 11:04:25.541865 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:25.541831    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6ce0e043e526e7a218b158f01c65f8e59c37620af33fffe094e0589bbe7cc1a"} err="failed to get container status \"a6ce0e043e526e7a218b158f01c65f8e59c37620af33fffe094e0589bbe7cc1a\": rpc error: code = NotFound desc = could not find container \"a6ce0e043e526e7a218b158f01c65f8e59c37620af33fffe094e0589bbe7cc1a\": container with ID starting with a6ce0e043e526e7a218b158f01c65f8e59c37620af33fffe094e0589bbe7cc1a not found: ID does not exist"
Jul 15 11:04:25.541865 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:25.541849    2565 scope.go:117] "RemoveContainer" containerID="b5d57cb74bf4771033b0aca28239473b20566c78bd1996af1a2e7cc106fab21d"
Jul 15 11:04:25.542018 ip-10-0-134-216 kubenswrapper[2565]: E0715 11:04:25.542003    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5d57cb74bf4771033b0aca28239473b20566c78bd1996af1a2e7cc106fab21d\": container with ID starting with b5d57cb74bf4771033b0aca28239473b20566c78bd1996af1a2e7cc106fab21d not found: ID does not exist" containerID="b5d57cb74bf4771033b0aca28239473b20566c78bd1996af1a2e7cc106fab21d"
Jul 15 11:04:25.542059 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:25.542020    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5d57cb74bf4771033b0aca28239473b20566c78bd1996af1a2e7cc106fab21d"} err="failed to get container status \"b5d57cb74bf4771033b0aca28239473b20566c78bd1996af1a2e7cc106fab21d\": rpc error: code = NotFound desc = could not find container \"b5d57cb74bf4771033b0aca28239473b20566c78bd1996af1a2e7cc106fab21d\": container with ID starting with b5d57cb74bf4771033b0aca28239473b20566c78bd1996af1a2e7cc106fab21d not found: ID does not exist"
Jul 15 11:04:25.542059 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:25.542031    2565 scope.go:117] "RemoveContainer" containerID="a66e2e2a8b97eed3222101c193ed3bbfeeb1b0f4c1616356de89112b9f389085"
Jul 15 11:04:25.542204 ip-10-0-134-216 kubenswrapper[2565]: E0715 11:04:25.542184    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a66e2e2a8b97eed3222101c193ed3bbfeeb1b0f4c1616356de89112b9f389085\": container with ID starting with a66e2e2a8b97eed3222101c193ed3bbfeeb1b0f4c1616356de89112b9f389085 not found: ID does not exist" containerID="a66e2e2a8b97eed3222101c193ed3bbfeeb1b0f4c1616356de89112b9f389085"
Jul 15 11:04:25.542309 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:25.542203    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a66e2e2a8b97eed3222101c193ed3bbfeeb1b0f4c1616356de89112b9f389085"} err="failed to get container status \"a66e2e2a8b97eed3222101c193ed3bbfeeb1b0f4c1616356de89112b9f389085\": rpc error: code = NotFound desc = could not find container \"a66e2e2a8b97eed3222101c193ed3bbfeeb1b0f4c1616356de89112b9f389085\": container with ID starting with a66e2e2a8b97eed3222101c193ed3bbfeeb1b0f4c1616356de89112b9f389085 not found: ID does not exist"
Jul 15 11:04:25.542309 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:25.542214    2565 scope.go:117] "RemoveContainer" containerID="a6ce0e043e526e7a218b158f01c65f8e59c37620af33fffe094e0589bbe7cc1a"
Jul 15 11:04:25.542454 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:25.542439    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6ce0e043e526e7a218b158f01c65f8e59c37620af33fffe094e0589bbe7cc1a"} err="failed to get container status \"a6ce0e043e526e7a218b158f01c65f8e59c37620af33fffe094e0589bbe7cc1a\": rpc error: code = NotFound desc = could not find container \"a6ce0e043e526e7a218b158f01c65f8e59c37620af33fffe094e0589bbe7cc1a\": container with ID starting with a6ce0e043e526e7a218b158f01c65f8e59c37620af33fffe094e0589bbe7cc1a not found: ID does not exist"
Jul 15 11:04:25.542454 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:25.542453    2565 scope.go:117] "RemoveContainer" containerID="b5d57cb74bf4771033b0aca28239473b20566c78bd1996af1a2e7cc106fab21d"
Jul 15 11:04:25.542658 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:25.542643    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5d57cb74bf4771033b0aca28239473b20566c78bd1996af1a2e7cc106fab21d"} err="failed to get container status \"b5d57cb74bf4771033b0aca28239473b20566c78bd1996af1a2e7cc106fab21d\": rpc error: code = NotFound desc = could not find container \"b5d57cb74bf4771033b0aca28239473b20566c78bd1996af1a2e7cc106fab21d\": container with ID starting with b5d57cb74bf4771033b0aca28239473b20566c78bd1996af1a2e7cc106fab21d not found: ID does not exist"
Jul 15 11:04:25.542709 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:25.542659    2565 scope.go:117] "RemoveContainer" containerID="a66e2e2a8b97eed3222101c193ed3bbfeeb1b0f4c1616356de89112b9f389085"
Jul 15 11:04:25.542853 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:25.542838    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a66e2e2a8b97eed3222101c193ed3bbfeeb1b0f4c1616356de89112b9f389085"} err="failed to get container status \"a66e2e2a8b97eed3222101c193ed3bbfeeb1b0f4c1616356de89112b9f389085\": rpc error: code = NotFound desc = could not find container \"a66e2e2a8b97eed3222101c193ed3bbfeeb1b0f4c1616356de89112b9f389085\": container with ID starting with a66e2e2a8b97eed3222101c193ed3bbfeeb1b0f4c1616356de89112b9f389085 not found: ID does not exist"
Jul 15 11:04:25.578054 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:25.577978    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6gzx\" (UniqueName: \"kubernetes.io/projected/6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc-kube-api-access-z6gzx\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 11:04:25.578054 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:25.578004    2565 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc-kserve-provision-location\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 11:04:25.578054 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:25.578019    2565 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc-proxy-tls\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 11:04:25.578054 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:25.578032    2565 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 11:04:25.578054 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:25.578043    2565 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc-cabundle-cert\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 11:04:26.924846 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:26.924814    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc" path="/var/lib/kubelet/pods/6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc/volumes"
Jul 15 11:04:29.747065 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:29.747034    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 11:04:29.842864 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:29.842831    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-bltll"]
Jul 15 11:04:29.843201 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:29.843187    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerName="storage-initializer"
Jul 15 11:04:29.843247 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:29.843203    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerName="storage-initializer"
Jul 15 11:04:29.843247 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:29.843212    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerName="kube-rbac-proxy"
Jul 15 11:04:29.843247 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:29.843218    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerName="kube-rbac-proxy"
Jul 15 11:04:29.843247 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:29.843227    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13001d9d-7abc-49d9-8ba1-adcc44de095e" containerName="kserve-container"
Jul 15 11:04:29.843247 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:29.843233    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="13001d9d-7abc-49d9-8ba1-adcc44de095e" containerName="kserve-container"
Jul 15 11:04:29.843247 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:29.843242    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc" containerName="kserve-container"
Jul 15 11:04:29.843247 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:29.843248    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc" containerName="kserve-container"
Jul 15 11:04:29.843475 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:29.843255    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc" containerName="kube-rbac-proxy"
Jul 15 11:04:29.843475 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:29.843260    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc" containerName="kube-rbac-proxy"
Jul 15 11:04:29.843475 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:29.843268    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerName="agent"
Jul 15 11:04:29.843475 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:29.843273    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerName="agent"
Jul 15 11:04:29.843475 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:29.843282    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13001d9d-7abc-49d9-8ba1-adcc44de095e" containerName="kube-rbac-proxy"
Jul 15 11:04:29.843475 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:29.843287    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="13001d9d-7abc-49d9-8ba1-adcc44de095e" containerName="kube-rbac-proxy"
Jul 15 11:04:29.843475 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:29.843298    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerName="kserve-container"
Jul 15 11:04:29.843475 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:29.843303    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerName="kserve-container"
Jul 15 11:04:29.843475 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:29.843311    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc" containerName="storage-initializer"
Jul 15 11:04:29.843475 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:29.843316    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc" containerName="storage-initializer"
Jul 15 11:04:29.843475 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:29.843390    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerName="kube-rbac-proxy"
Jul 15 11:04:29.843475 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:29.843400    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc" containerName="kserve-container"
Jul 15 11:04:29.843475 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:29.843407    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerName="kserve-container"
Jul 15 11:04:29.843475 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:29.843413    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fbb545e-9e5e-4bf9-9304-0c23e7adf7fc" containerName="kube-rbac-proxy"
Jul 15 11:04:29.843475 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:29.843420    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="13001d9d-7abc-49d9-8ba1-adcc44de095e" containerName="kserve-container"
Jul 15 11:04:29.843475 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:29.843425    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="13001d9d-7abc-49d9-8ba1-adcc44de095e" containerName="kube-rbac-proxy"
Jul 15 11:04:29.843475 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:29.843431    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="29a707b7-1ddd-4c34-bf90-327ad588aa83" containerName="agent"
Jul 15 11:04:29.853822 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:29.853792    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 11:04:29.875356 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:29.875302    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-bltll"]
Jul 15 11:04:29.875503 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:29.875435    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-bltll"
Jul 15 11:04:29.879055 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:29.879034    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 15 11:04:29.880236 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:29.880221    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 15 11:04:29.881094 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:29.881000    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-55dm9\""
Jul 15 11:04:29.881094 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:29.881030    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-autogluon-v2-predictor-serving-cert\""
Jul 15 11:04:29.881265 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:29.881117    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 15 11:04:29.881265 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:29.881131    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 15 11:04:29.881265 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:29.881224    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-autogluon-v2-kube-rbac-proxy-sar-config\""
Jul 15 11:04:30.016122 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:30.016012    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f4388ed1-5612-4eb2-bc19-1c00ae9ed83a-cabundle-cert\") pod \"isvc-autogluon-v2-predictor-67b849d456-bltll\" (UID: \"f4388ed1-5612-4eb2-bc19-1c00ae9ed83a\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-bltll"
Jul 15 11:04:30.016122 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:30.016094    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f4388ed1-5612-4eb2-bc19-1c00ae9ed83a-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v2-predictor-67b849d456-bltll\" (UID: \"f4388ed1-5612-4eb2-bc19-1c00ae9ed83a\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-bltll"
Jul 15 11:04:30.016366 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:30.016150    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5qxx\" (UniqueName: \"kubernetes.io/projected/f4388ed1-5612-4eb2-bc19-1c00ae9ed83a-kube-api-access-l5qxx\") pod \"isvc-autogluon-v2-predictor-67b849d456-bltll\" (UID: \"f4388ed1-5612-4eb2-bc19-1c00ae9ed83a\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-bltll"
Jul 15 11:04:30.016366 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:30.016238    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f4388ed1-5612-4eb2-bc19-1c00ae9ed83a-kserve-provision-location\") pod \"isvc-autogluon-v2-predictor-67b849d456-bltll\" (UID: \"f4388ed1-5612-4eb2-bc19-1c00ae9ed83a\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-bltll"
Jul 15 11:04:30.016366 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:30.016297    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f4388ed1-5612-4eb2-bc19-1c00ae9ed83a-proxy-tls\") pod \"isvc-autogluon-v2-predictor-67b849d456-bltll\" (UID: \"f4388ed1-5612-4eb2-bc19-1c00ae9ed83a\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-bltll"
Jul 15 11:04:30.116870 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:30.116832    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f4388ed1-5612-4eb2-bc19-1c00ae9ed83a-proxy-tls\") pod \"isvc-autogluon-v2-predictor-67b849d456-bltll\" (UID: \"f4388ed1-5612-4eb2-bc19-1c00ae9ed83a\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-bltll"
Jul 15 11:04:30.116870 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:30.116873    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f4388ed1-5612-4eb2-bc19-1c00ae9ed83a-cabundle-cert\") pod \"isvc-autogluon-v2-predictor-67b849d456-bltll\" (UID: \"f4388ed1-5612-4eb2-bc19-1c00ae9ed83a\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-bltll"
Jul 15 11:04:30.117118 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:30.116908    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f4388ed1-5612-4eb2-bc19-1c00ae9ed83a-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v2-predictor-67b849d456-bltll\" (UID: \"f4388ed1-5612-4eb2-bc19-1c00ae9ed83a\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-bltll"
Jul 15 11:04:30.117118 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:30.116940    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5qxx\" (UniqueName: \"kubernetes.io/projected/f4388ed1-5612-4eb2-bc19-1c00ae9ed83a-kube-api-access-l5qxx\") pod \"isvc-autogluon-v2-predictor-67b849d456-bltll\" (UID: \"f4388ed1-5612-4eb2-bc19-1c00ae9ed83a\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-bltll"
Jul 15 11:04:30.117118 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:30.116972    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f4388ed1-5612-4eb2-bc19-1c00ae9ed83a-kserve-provision-location\") pod \"isvc-autogluon-v2-predictor-67b849d456-bltll\" (UID: \"f4388ed1-5612-4eb2-bc19-1c00ae9ed83a\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-bltll"
Jul 15 11:04:30.117439 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:30.117419    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f4388ed1-5612-4eb2-bc19-1c00ae9ed83a-kserve-provision-location\") pod \"isvc-autogluon-v2-predictor-67b849d456-bltll\" (UID: \"f4388ed1-5612-4eb2-bc19-1c00ae9ed83a\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-bltll"
Jul 15 11:04:30.117644 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:30.117622    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f4388ed1-5612-4eb2-bc19-1c00ae9ed83a-cabundle-cert\") pod \"isvc-autogluon-v2-predictor-67b849d456-bltll\" (UID: \"f4388ed1-5612-4eb2-bc19-1c00ae9ed83a\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-bltll"
Jul 15 11:04:30.117717 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:30.117660    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f4388ed1-5612-4eb2-bc19-1c00ae9ed83a-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v2-predictor-67b849d456-bltll\" (UID: \"f4388ed1-5612-4eb2-bc19-1c00ae9ed83a\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-bltll"
Jul 15 11:04:30.119487 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:30.119468    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f4388ed1-5612-4eb2-bc19-1c00ae9ed83a-proxy-tls\") pod \"isvc-autogluon-v2-predictor-67b849d456-bltll\" (UID: \"f4388ed1-5612-4eb2-bc19-1c00ae9ed83a\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-bltll"
Jul 15 11:04:30.126079 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:30.126057    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5qxx\" (UniqueName: \"kubernetes.io/projected/f4388ed1-5612-4eb2-bc19-1c00ae9ed83a-kube-api-access-l5qxx\") pod \"isvc-autogluon-v2-predictor-67b849d456-bltll\" (UID: \"f4388ed1-5612-4eb2-bc19-1c00ae9ed83a\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-bltll"
Jul 15 11:04:30.191618 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:30.191582    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-bltll"
Jul 15 11:04:30.347096 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:30.347066    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-bltll"]
Jul 15 11:04:30.350415 ip-10-0-134-216 kubenswrapper[2565]: W0715 11:04:30.350378    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4388ed1_5612_4eb2_bc19_1c00ae9ed83a.slice/crio-3849ccbc46b1db42e510e5e737c96813c33298ed4ab247d5a93d59b530453eda WatchSource:0}: Error finding container 3849ccbc46b1db42e510e5e737c96813c33298ed4ab247d5a93d59b530453eda: Status 404 returned error can't find the container with id 3849ccbc46b1db42e510e5e737c96813c33298ed4ab247d5a93d59b530453eda
Jul 15 11:04:30.528887 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:30.528848    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-bltll" event={"ID":"f4388ed1-5612-4eb2-bc19-1c00ae9ed83a","Type":"ContainerStarted","Data":"f0cb39642ec308b65c929322b952c7a414c47762ff26b2a57b2f7259c2cc193f"}
Jul 15 11:04:30.529130 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:30.528920    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-bltll" event={"ID":"f4388ed1-5612-4eb2-bc19-1c00ae9ed83a","Type":"ContainerStarted","Data":"3849ccbc46b1db42e510e5e737c96813c33298ed4ab247d5a93d59b530453eda"}
Jul 15 11:04:51.628029 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:51.627995    2565 generic.go:356] "Generic (PLEG): container finished" podID="f4388ed1-5612-4eb2-bc19-1c00ae9ed83a" containerID="f0cb39642ec308b65c929322b952c7a414c47762ff26b2a57b2f7259c2cc193f" exitCode=0
Jul 15 11:04:51.628482 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:51.628074    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-bltll" event={"ID":"f4388ed1-5612-4eb2-bc19-1c00ae9ed83a","Type":"ContainerDied","Data":"f0cb39642ec308b65c929322b952c7a414c47762ff26b2a57b2f7259c2cc193f"}
Jul 15 11:04:52.636074 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:52.636037    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-bltll" event={"ID":"f4388ed1-5612-4eb2-bc19-1c00ae9ed83a","Type":"ContainerStarted","Data":"f8287f724c4ee51a7cbb6a29b180ef5f1a0c4721f827f15fc4069f263a5dff7d"}
Jul 15 11:04:52.636493 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:52.636100    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-bltll" event={"ID":"f4388ed1-5612-4eb2-bc19-1c00ae9ed83a","Type":"ContainerStarted","Data":"bb6ff29bfc33595c78346d91a2b788652198077d8ebdeffc23531dd7fff0d66b"}
Jul 15 11:04:52.636493 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:52.636281    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-bltll"
Jul 15 11:04:52.655790 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:52.655741    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-bltll" podStartSLOduration=3.460072539 podStartE2EDuration="23.655720955s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.195648416s" isStatefulPod=false podCreationTimestamp="2026-07-15 11:04:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 11:04:52.655290329 +0000 UTC m=+1190.263826354" watchObservedRunningTime="2026-07-15 11:04:52.655720955 +0000 UTC m=+1190.264256977"
Jul 15 11:04:53.641872 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:53.641837    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-bltll"
Jul 15 11:04:59.651266 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:04:59.651236    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-bltll"
Jul 15 11:05:02.920537 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:05:02.920509    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8dcjj_8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9/console-operator/1.log"
Jul 15 11:05:02.924229 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:05:02.924205    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8dcjj_8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9/console-operator/1.log"
Jul 15 11:05:02.925913 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:05:02.925888    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qsch8_f3b175c1-34f8-4e74-bce6-f866e4bd25b0/ovn-acl-logging/0.log"
Jul 15 11:05:02.928851 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:05:02.928831    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qsch8_f3b175c1-34f8-4e74-bce6-f866e4bd25b0/ovn-acl-logging/0.log"
Jul 15 11:06:26.925287 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:26.925260    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-bltll"
Jul 15 11:06:29.983425 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:29.983391    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-bltll"]
Jul 15 11:06:29.983902 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:29.983660    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-bltll" podUID="f4388ed1-5612-4eb2-bc19-1c00ae9ed83a" containerName="kserve-container" containerID="cri-o://bb6ff29bfc33595c78346d91a2b788652198077d8ebdeffc23531dd7fff0d66b" gracePeriod=30
Jul 15 11:06:29.983902 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:29.983721    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-bltll" podUID="f4388ed1-5612-4eb2-bc19-1c00ae9ed83a" containerName="kube-rbac-proxy" containerID="cri-o://f8287f724c4ee51a7cbb6a29b180ef5f1a0c4721f827f15fc4069f263a5dff7d" gracePeriod=30
Jul 15 11:06:30.025266 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:30.025229    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 11:06:30.934920 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:30.934891    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-bltll"
Jul 15 11:06:31.084444 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:31.084414    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f4388ed1-5612-4eb2-bc19-1c00ae9ed83a-kube-rbac-proxy-sar-config\") pod \"f4388ed1-5612-4eb2-bc19-1c00ae9ed83a\" (UID: \"f4388ed1-5612-4eb2-bc19-1c00ae9ed83a\") "
Jul 15 11:06:31.084942 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:31.084457    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f4388ed1-5612-4eb2-bc19-1c00ae9ed83a-kserve-provision-location\") pod \"f4388ed1-5612-4eb2-bc19-1c00ae9ed83a\" (UID: \"f4388ed1-5612-4eb2-bc19-1c00ae9ed83a\") "
Jul 15 11:06:31.084942 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:31.084524    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f4388ed1-5612-4eb2-bc19-1c00ae9ed83a-cabundle-cert\") pod \"f4388ed1-5612-4eb2-bc19-1c00ae9ed83a\" (UID: \"f4388ed1-5612-4eb2-bc19-1c00ae9ed83a\") "
Jul 15 11:06:31.084942 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:31.084544    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5qxx\" (UniqueName: \"kubernetes.io/projected/f4388ed1-5612-4eb2-bc19-1c00ae9ed83a-kube-api-access-l5qxx\") pod \"f4388ed1-5612-4eb2-bc19-1c00ae9ed83a\" (UID: \"f4388ed1-5612-4eb2-bc19-1c00ae9ed83a\") "
Jul 15 11:06:31.084942 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:31.084580    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f4388ed1-5612-4eb2-bc19-1c00ae9ed83a-proxy-tls\") pod \"f4388ed1-5612-4eb2-bc19-1c00ae9ed83a\" (UID: \"f4388ed1-5612-4eb2-bc19-1c00ae9ed83a\") "
Jul 15 11:06:31.084942 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:31.084922    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4388ed1-5612-4eb2-bc19-1c00ae9ed83a-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "f4388ed1-5612-4eb2-bc19-1c00ae9ed83a" (UID: "f4388ed1-5612-4eb2-bc19-1c00ae9ed83a"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 11:06:31.085219 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:31.084985    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4388ed1-5612-4eb2-bc19-1c00ae9ed83a-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "f4388ed1-5612-4eb2-bc19-1c00ae9ed83a" (UID: "f4388ed1-5612-4eb2-bc19-1c00ae9ed83a"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 11:06:31.086897 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:31.086869    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4388ed1-5612-4eb2-bc19-1c00ae9ed83a-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "f4388ed1-5612-4eb2-bc19-1c00ae9ed83a" (UID: "f4388ed1-5612-4eb2-bc19-1c00ae9ed83a"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 11:06:31.087015 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:31.086996    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4388ed1-5612-4eb2-bc19-1c00ae9ed83a-kube-api-access-l5qxx" (OuterVolumeSpecName: "kube-api-access-l5qxx") pod "f4388ed1-5612-4eb2-bc19-1c00ae9ed83a" (UID: "f4388ed1-5612-4eb2-bc19-1c00ae9ed83a"). InnerVolumeSpecName "kube-api-access-l5qxx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 11:06:31.089549 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:31.089524    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4388ed1-5612-4eb2-bc19-1c00ae9ed83a-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "f4388ed1-5612-4eb2-bc19-1c00ae9ed83a" (UID: "f4388ed1-5612-4eb2-bc19-1c00ae9ed83a"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 11:06:31.098747 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:31.098721    2565 generic.go:356] "Generic (PLEG): container finished" podID="f4388ed1-5612-4eb2-bc19-1c00ae9ed83a" containerID="f8287f724c4ee51a7cbb6a29b180ef5f1a0c4721f827f15fc4069f263a5dff7d" exitCode=2
Jul 15 11:06:31.098869 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:31.098751    2565 generic.go:356] "Generic (PLEG): container finished" podID="f4388ed1-5612-4eb2-bc19-1c00ae9ed83a" containerID="bb6ff29bfc33595c78346d91a2b788652198077d8ebdeffc23531dd7fff0d66b" exitCode=0
Jul 15 11:06:31.098869 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:31.098802    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-bltll"
Jul 15 11:06:31.098869 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:31.098804    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-bltll" event={"ID":"f4388ed1-5612-4eb2-bc19-1c00ae9ed83a","Type":"ContainerDied","Data":"f8287f724c4ee51a7cbb6a29b180ef5f1a0c4721f827f15fc4069f263a5dff7d"}
Jul 15 11:06:31.099013 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:31.098883    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-bltll" event={"ID":"f4388ed1-5612-4eb2-bc19-1c00ae9ed83a","Type":"ContainerDied","Data":"bb6ff29bfc33595c78346d91a2b788652198077d8ebdeffc23531dd7fff0d66b"}
Jul 15 11:06:31.099013 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:31.098915    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-bltll" event={"ID":"f4388ed1-5612-4eb2-bc19-1c00ae9ed83a","Type":"ContainerDied","Data":"3849ccbc46b1db42e510e5e737c96813c33298ed4ab247d5a93d59b530453eda"}
Jul 15 11:06:31.099013 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:31.098960    2565 scope.go:117] "RemoveContainer" containerID="f8287f724c4ee51a7cbb6a29b180ef5f1a0c4721f827f15fc4069f263a5dff7d"
Jul 15 11:06:31.109205 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:31.109187    2565 scope.go:117] "RemoveContainer" containerID="bb6ff29bfc33595c78346d91a2b788652198077d8ebdeffc23531dd7fff0d66b"
Jul 15 11:06:31.117293 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:31.117268    2565 scope.go:117] "RemoveContainer" containerID="f0cb39642ec308b65c929322b952c7a414c47762ff26b2a57b2f7259c2cc193f"
Jul 15 11:06:31.124150 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:31.124125    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-bltll"]
Jul 15 11:06:31.125622 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:31.125609    2565 scope.go:117] "RemoveContainer" containerID="f8287f724c4ee51a7cbb6a29b180ef5f1a0c4721f827f15fc4069f263a5dff7d"
Jul 15 11:06:31.125870 ip-10-0-134-216 kubenswrapper[2565]: E0715 11:06:31.125851    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8287f724c4ee51a7cbb6a29b180ef5f1a0c4721f827f15fc4069f263a5dff7d\": container with ID starting with f8287f724c4ee51a7cbb6a29b180ef5f1a0c4721f827f15fc4069f263a5dff7d not found: ID does not exist" containerID="f8287f724c4ee51a7cbb6a29b180ef5f1a0c4721f827f15fc4069f263a5dff7d"
Jul 15 11:06:31.125912 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:31.125880    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8287f724c4ee51a7cbb6a29b180ef5f1a0c4721f827f15fc4069f263a5dff7d"} err="failed to get container status \"f8287f724c4ee51a7cbb6a29b180ef5f1a0c4721f827f15fc4069f263a5dff7d\": rpc error: code = NotFound desc = could not find container \"f8287f724c4ee51a7cbb6a29b180ef5f1a0c4721f827f15fc4069f263a5dff7d\": container with ID starting with f8287f724c4ee51a7cbb6a29b180ef5f1a0c4721f827f15fc4069f263a5dff7d not found: ID does not exist"
Jul 15 11:06:31.125912 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:31.125903    2565 scope.go:117] "RemoveContainer" containerID="bb6ff29bfc33595c78346d91a2b788652198077d8ebdeffc23531dd7fff0d66b"
Jul 15 11:06:31.126173 ip-10-0-134-216 kubenswrapper[2565]: E0715 11:06:31.126157    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb6ff29bfc33595c78346d91a2b788652198077d8ebdeffc23531dd7fff0d66b\": container with ID starting with bb6ff29bfc33595c78346d91a2b788652198077d8ebdeffc23531dd7fff0d66b not found: ID does not exist" containerID="bb6ff29bfc33595c78346d91a2b788652198077d8ebdeffc23531dd7fff0d66b"
Jul 15 11:06:31.126225 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:31.126179    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb6ff29bfc33595c78346d91a2b788652198077d8ebdeffc23531dd7fff0d66b"} err="failed to get container status \"bb6ff29bfc33595c78346d91a2b788652198077d8ebdeffc23531dd7fff0d66b\": rpc error: code = NotFound desc = could not find container \"bb6ff29bfc33595c78346d91a2b788652198077d8ebdeffc23531dd7fff0d66b\": container with ID starting with bb6ff29bfc33595c78346d91a2b788652198077d8ebdeffc23531dd7fff0d66b not found: ID does not exist"
Jul 15 11:06:31.126225 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:31.126194    2565 scope.go:117] "RemoveContainer" containerID="f0cb39642ec308b65c929322b952c7a414c47762ff26b2a57b2f7259c2cc193f"
Jul 15 11:06:31.126459 ip-10-0-134-216 kubenswrapper[2565]: E0715 11:06:31.126441    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0cb39642ec308b65c929322b952c7a414c47762ff26b2a57b2f7259c2cc193f\": container with ID starting with f0cb39642ec308b65c929322b952c7a414c47762ff26b2a57b2f7259c2cc193f not found: ID does not exist" containerID="f0cb39642ec308b65c929322b952c7a414c47762ff26b2a57b2f7259c2cc193f"
Jul 15 11:06:31.126531 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:31.126468    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0cb39642ec308b65c929322b952c7a414c47762ff26b2a57b2f7259c2cc193f"} err="failed to get container status \"f0cb39642ec308b65c929322b952c7a414c47762ff26b2a57b2f7259c2cc193f\": rpc error: code = NotFound desc = could not find container \"f0cb39642ec308b65c929322b952c7a414c47762ff26b2a57b2f7259c2cc193f\": container with ID starting with f0cb39642ec308b65c929322b952c7a414c47762ff26b2a57b2f7259c2cc193f not found: ID does not exist"
Jul 15 11:06:31.126531 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:31.126490    2565 scope.go:117] "RemoveContainer" containerID="f8287f724c4ee51a7cbb6a29b180ef5f1a0c4721f827f15fc4069f263a5dff7d"
Jul 15 11:06:31.126753 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:31.126733    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8287f724c4ee51a7cbb6a29b180ef5f1a0c4721f827f15fc4069f263a5dff7d"} err="failed to get container status \"f8287f724c4ee51a7cbb6a29b180ef5f1a0c4721f827f15fc4069f263a5dff7d\": rpc error: code = NotFound desc = could not find container \"f8287f724c4ee51a7cbb6a29b180ef5f1a0c4721f827f15fc4069f263a5dff7d\": container with ID starting with f8287f724c4ee51a7cbb6a29b180ef5f1a0c4721f827f15fc4069f263a5dff7d not found: ID does not exist"
Jul 15 11:06:31.126802 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:31.126755    2565 scope.go:117] "RemoveContainer" containerID="bb6ff29bfc33595c78346d91a2b788652198077d8ebdeffc23531dd7fff0d66b"
Jul 15 11:06:31.126988 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:31.126972    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb6ff29bfc33595c78346d91a2b788652198077d8ebdeffc23531dd7fff0d66b"} err="failed to get container status \"bb6ff29bfc33595c78346d91a2b788652198077d8ebdeffc23531dd7fff0d66b\": rpc error: code = NotFound desc = could not find container \"bb6ff29bfc33595c78346d91a2b788652198077d8ebdeffc23531dd7fff0d66b\": container with ID starting with bb6ff29bfc33595c78346d91a2b788652198077d8ebdeffc23531dd7fff0d66b not found: ID does not exist"
Jul 15 11:06:31.127035 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:31.126989    2565 scope.go:117] "RemoveContainer" containerID="f0cb39642ec308b65c929322b952c7a414c47762ff26b2a57b2f7259c2cc193f"
Jul 15 11:06:31.127196 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:31.127178    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0cb39642ec308b65c929322b952c7a414c47762ff26b2a57b2f7259c2cc193f"} err="failed to get container status \"f0cb39642ec308b65c929322b952c7a414c47762ff26b2a57b2f7259c2cc193f\": rpc error: code = NotFound desc = could not find container \"f0cb39642ec308b65c929322b952c7a414c47762ff26b2a57b2f7259c2cc193f\": container with ID starting with f0cb39642ec308b65c929322b952c7a414c47762ff26b2a57b2f7259c2cc193f not found: ID does not exist"
Jul 15 11:06:31.130588 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:31.130569    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-predictor-67b849d456-bltll"]
Jul 15 11:06:31.186243 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:31.186213    2565 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f4388ed1-5612-4eb2-bc19-1c00ae9ed83a-cabundle-cert\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 11:06:31.186243 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:31.186238    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5qxx\" (UniqueName: \"kubernetes.io/projected/f4388ed1-5612-4eb2-bc19-1c00ae9ed83a-kube-api-access-l5qxx\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 11:06:31.186243 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:31.186249    2565 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f4388ed1-5612-4eb2-bc19-1c00ae9ed83a-proxy-tls\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 11:06:31.186469 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:31.186258    2565 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f4388ed1-5612-4eb2-bc19-1c00ae9ed83a-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 11:06:31.186469 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:31.186268    2565 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f4388ed1-5612-4eb2-bc19-1c00ae9ed83a-kserve-provision-location\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 11:06:32.924616 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:32.924572    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4388ed1-5612-4eb2-bc19-1c00ae9ed83a" path="/var/lib/kubelet/pods/f4388ed1-5612-4eb2-bc19-1c00ae9ed83a/volumes"
Jul 15 11:06:35.091550 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:35.091512    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 11:06:35.155419 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:35.155383    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m"]
Jul 15 11:06:35.155737 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:35.155725    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4388ed1-5612-4eb2-bc19-1c00ae9ed83a" containerName="kube-rbac-proxy"
Jul 15 11:06:35.155782 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:35.155739    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4388ed1-5612-4eb2-bc19-1c00ae9ed83a" containerName="kube-rbac-proxy"
Jul 15 11:06:35.155782 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:35.155755    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4388ed1-5612-4eb2-bc19-1c00ae9ed83a" containerName="storage-initializer"
Jul 15 11:06:35.155782 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:35.155760    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4388ed1-5612-4eb2-bc19-1c00ae9ed83a" containerName="storage-initializer"
Jul 15 11:06:35.155782 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:35.155769    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4388ed1-5612-4eb2-bc19-1c00ae9ed83a" containerName="kserve-container"
Jul 15 11:06:35.155782 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:35.155774    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4388ed1-5612-4eb2-bc19-1c00ae9ed83a" containerName="kserve-container"
Jul 15 11:06:35.155937 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:35.155836    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4388ed1-5612-4eb2-bc19-1c00ae9ed83a" containerName="kserve-container"
Jul 15 11:06:35.155937 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:35.155843    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4388ed1-5612-4eb2-bc19-1c00ae9ed83a" containerName="kube-rbac-proxy"
Jul 15 11:06:35.160754 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:35.160733    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m"
Jul 15 11:06:35.163653 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:35.163632    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 15 11:06:35.163779 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:35.163631    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-autogluon-v2-variants-predictor-serving-cert\""
Jul 15 11:06:35.163779 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:35.163725    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 15 11:06:35.163960 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:35.163945    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 15 11:06:35.164016 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:35.163982    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 15 11:06:35.164123 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:35.164106    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-55dm9\""
Jul 15 11:06:35.164536 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:35.164521    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-autogluon-v2-variants-kube-rbac-proxy-sar-config\""
Jul 15 11:06:35.172211 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:35.172189    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m"]
Jul 15 11:06:35.321751 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:35.321710    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4723d8cd-adea-4650-bcad-73b36ef0e429-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m\" (UID: \"4723d8cd-adea-4650-bcad-73b36ef0e429\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m"
Jul 15 11:06:35.321931 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:35.321780    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4723d8cd-adea-4650-bcad-73b36ef0e429-proxy-tls\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m\" (UID: \"4723d8cd-adea-4650-bcad-73b36ef0e429\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m"
Jul 15 11:06:35.321931 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:35.321812    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4mvl\" (UniqueName: \"kubernetes.io/projected/4723d8cd-adea-4650-bcad-73b36ef0e429-kube-api-access-h4mvl\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m\" (UID: \"4723d8cd-adea-4650-bcad-73b36ef0e429\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m"
Jul 15 11:06:35.321931 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:35.321835    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/4723d8cd-adea-4650-bcad-73b36ef0e429-cabundle-cert\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m\" (UID: \"4723d8cd-adea-4650-bcad-73b36ef0e429\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m"
Jul 15 11:06:35.321931 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:35.321885    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4723d8cd-adea-4650-bcad-73b36ef0e429-kserve-provision-location\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m\" (UID: \"4723d8cd-adea-4650-bcad-73b36ef0e429\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m"
Jul 15 11:06:35.384207 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:35.384121    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 11:06:35.423100 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:35.423071    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4723d8cd-adea-4650-bcad-73b36ef0e429-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m\" (UID: \"4723d8cd-adea-4650-bcad-73b36ef0e429\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m"
Jul 15 11:06:35.423285 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:35.423122    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4723d8cd-adea-4650-bcad-73b36ef0e429-proxy-tls\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m\" (UID: \"4723d8cd-adea-4650-bcad-73b36ef0e429\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m"
Jul 15 11:06:35.423285 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:35.423149    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4mvl\" (UniqueName: \"kubernetes.io/projected/4723d8cd-adea-4650-bcad-73b36ef0e429-kube-api-access-h4mvl\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m\" (UID: \"4723d8cd-adea-4650-bcad-73b36ef0e429\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m"
Jul 15 11:06:35.423285 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:35.423242    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/4723d8cd-adea-4650-bcad-73b36ef0e429-cabundle-cert\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m\" (UID: \"4723d8cd-adea-4650-bcad-73b36ef0e429\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m"
Jul 15 11:06:35.423481 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:35.423291    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4723d8cd-adea-4650-bcad-73b36ef0e429-kserve-provision-location\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m\" (UID: \"4723d8cd-adea-4650-bcad-73b36ef0e429\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m"
Jul 15 11:06:35.423688 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:35.423665    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4723d8cd-adea-4650-bcad-73b36ef0e429-kserve-provision-location\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m\" (UID: \"4723d8cd-adea-4650-bcad-73b36ef0e429\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m"
Jul 15 11:06:35.423816 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:35.423797    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4723d8cd-adea-4650-bcad-73b36ef0e429-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m\" (UID: \"4723d8cd-adea-4650-bcad-73b36ef0e429\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m"
Jul 15 11:06:35.423933 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:35.423912    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/4723d8cd-adea-4650-bcad-73b36ef0e429-cabundle-cert\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m\" (UID: \"4723d8cd-adea-4650-bcad-73b36ef0e429\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m"
Jul 15 11:06:35.425792 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:35.425774    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4723d8cd-adea-4650-bcad-73b36ef0e429-proxy-tls\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m\" (UID: \"4723d8cd-adea-4650-bcad-73b36ef0e429\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m"
Jul 15 11:06:35.433930 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:35.433907    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4mvl\" (UniqueName: \"kubernetes.io/projected/4723d8cd-adea-4650-bcad-73b36ef0e429-kube-api-access-h4mvl\") pod \"isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m\" (UID: \"4723d8cd-adea-4650-bcad-73b36ef0e429\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m"
Jul 15 11:06:35.471948 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:35.471910    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m"
Jul 15 11:06:35.608502 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:35.608478    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m"]
Jul 15 11:06:35.610704 ip-10-0-134-216 kubenswrapper[2565]: W0715 11:06:35.610680    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4723d8cd_adea_4650_bcad_73b36ef0e429.slice/crio-277daa85add7ff5641c3c229c60b63e4cf3bb9b254b98b0722d71ddf8a51508c WatchSource:0}: Error finding container 277daa85add7ff5641c3c229c60b63e4cf3bb9b254b98b0722d71ddf8a51508c: Status 404 returned error can't find the container with id 277daa85add7ff5641c3c229c60b63e4cf3bb9b254b98b0722d71ddf8a51508c
Jul 15 11:06:36.125054 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:36.125015    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m" event={"ID":"4723d8cd-adea-4650-bcad-73b36ef0e429","Type":"ContainerStarted","Data":"73d05f27645dfdb9b50df6b543666e111bd757a70ff8cd51736563c580305e85"}
Jul 15 11:06:36.125455 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:36.125092    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m" event={"ID":"4723d8cd-adea-4650-bcad-73b36ef0e429","Type":"ContainerStarted","Data":"277daa85add7ff5641c3c229c60b63e4cf3bb9b254b98b0722d71ddf8a51508c"}
Jul 15 11:06:41.150184 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:41.150130    2565 generic.go:356] "Generic (PLEG): container finished" podID="4723d8cd-adea-4650-bcad-73b36ef0e429" containerID="73d05f27645dfdb9b50df6b543666e111bd757a70ff8cd51736563c580305e85" exitCode=0
Jul 15 11:06:41.150612 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:41.150209    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m" event={"ID":"4723d8cd-adea-4650-bcad-73b36ef0e429","Type":"ContainerDied","Data":"73d05f27645dfdb9b50df6b543666e111bd757a70ff8cd51736563c580305e85"}
Jul 15 11:06:42.159208 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:42.159171    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m" event={"ID":"4723d8cd-adea-4650-bcad-73b36ef0e429","Type":"ContainerStarted","Data":"f2fe9e84b5a7d84fa9b54c344794a7cc009a3bc4b757c45a885fcf28537845ed"}
Jul 15 11:06:42.159787 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:42.159232    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m" event={"ID":"4723d8cd-adea-4650-bcad-73b36ef0e429","Type":"ContainerStarted","Data":"37f247cdb039ffed2e66ab85651d8686e6101d852b534a5d4f709888018c20cb"}
Jul 15 11:06:42.159787 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:42.159438    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m"
Jul 15 11:06:42.180483 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:42.180431    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m" podStartSLOduration=2.505343699 podStartE2EDuration="7.180410174s" totalImagesPullingTime="0s" totalInitContainerRuntime="4.675066475s" isStatefulPod=false podCreationTimestamp="2026-07-15 11:06:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 11:06:42.17970646 +0000 UTC m=+1299.788242485" watchObservedRunningTime="2026-07-15 11:06:42.180410174 +0000 UTC m=+1299.788946198"
Jul 15 11:06:43.164976 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:43.164942    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m"
Jul 15 11:06:49.177023 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:49.176994    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m"
Jul 15 11:06:51.689840 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:06:51.689787    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 11:08:14.924341 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:14.924316    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m"
Jul 15 11:08:25.285799 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:25.285765    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m"]
Jul 15 11:08:25.286289 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:25.285991    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m" podUID="4723d8cd-adea-4650-bcad-73b36ef0e429" containerName="kserve-container" containerID="cri-o://37f247cdb039ffed2e66ab85651d8686e6101d852b534a5d4f709888018c20cb" gracePeriod=30
Jul 15 11:08:25.286289 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:25.286041    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m" podUID="4723d8cd-adea-4650-bcad-73b36ef0e429" containerName="kube-rbac-proxy" containerID="cri-o://f2fe9e84b5a7d84fa9b54c344794a7cc009a3bc4b757c45a885fcf28537845ed" gracePeriod=30
Jul 15 11:08:25.342510 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:25.342475    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 11:08:25.636199 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:25.636104    2565 generic.go:356] "Generic (PLEG): container finished" podID="4723d8cd-adea-4650-bcad-73b36ef0e429" containerID="f2fe9e84b5a7d84fa9b54c344794a7cc009a3bc4b757c45a885fcf28537845ed" exitCode=2
Jul 15 11:08:25.636199 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:25.636145    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m" event={"ID":"4723d8cd-adea-4650-bcad-73b36ef0e429","Type":"ContainerDied","Data":"f2fe9e84b5a7d84fa9b54c344794a7cc009a3bc4b757c45a885fcf28537845ed"}
Jul 15 11:08:26.138018 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:26.137990    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m"
Jul 15 11:08:26.206957 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:26.206871    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4723d8cd-adea-4650-bcad-73b36ef0e429-kube-rbac-proxy-sar-config\") pod \"4723d8cd-adea-4650-bcad-73b36ef0e429\" (UID: \"4723d8cd-adea-4650-bcad-73b36ef0e429\") "
Jul 15 11:08:26.206957 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:26.206937    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4723d8cd-adea-4650-bcad-73b36ef0e429-proxy-tls\") pod \"4723d8cd-adea-4650-bcad-73b36ef0e429\" (UID: \"4723d8cd-adea-4650-bcad-73b36ef0e429\") "
Jul 15 11:08:26.207176 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:26.206976    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/4723d8cd-adea-4650-bcad-73b36ef0e429-cabundle-cert\") pod \"4723d8cd-adea-4650-bcad-73b36ef0e429\" (UID: \"4723d8cd-adea-4650-bcad-73b36ef0e429\") "
Jul 15 11:08:26.207176 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:26.207000    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4723d8cd-adea-4650-bcad-73b36ef0e429-kserve-provision-location\") pod \"4723d8cd-adea-4650-bcad-73b36ef0e429\" (UID: \"4723d8cd-adea-4650-bcad-73b36ef0e429\") "
Jul 15 11:08:26.207176 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:26.207029    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4mvl\" (UniqueName: \"kubernetes.io/projected/4723d8cd-adea-4650-bcad-73b36ef0e429-kube-api-access-h4mvl\") pod \"4723d8cd-adea-4650-bcad-73b36ef0e429\" (UID: \"4723d8cd-adea-4650-bcad-73b36ef0e429\") "
Jul 15 11:08:26.207360 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:26.207312    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4723d8cd-adea-4650-bcad-73b36ef0e429-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "4723d8cd-adea-4650-bcad-73b36ef0e429" (UID: "4723d8cd-adea-4650-bcad-73b36ef0e429"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 11:08:26.207798 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:26.207764    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4723d8cd-adea-4650-bcad-73b36ef0e429-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "4723d8cd-adea-4650-bcad-73b36ef0e429" (UID: "4723d8cd-adea-4650-bcad-73b36ef0e429"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 11:08:26.209415 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:26.209381    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4723d8cd-adea-4650-bcad-73b36ef0e429-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "4723d8cd-adea-4650-bcad-73b36ef0e429" (UID: "4723d8cd-adea-4650-bcad-73b36ef0e429"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 11:08:26.209757 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:26.209731    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4723d8cd-adea-4650-bcad-73b36ef0e429-kube-api-access-h4mvl" (OuterVolumeSpecName: "kube-api-access-h4mvl") pod "4723d8cd-adea-4650-bcad-73b36ef0e429" (UID: "4723d8cd-adea-4650-bcad-73b36ef0e429"). InnerVolumeSpecName "kube-api-access-h4mvl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 11:08:26.212292 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:26.212267    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4723d8cd-adea-4650-bcad-73b36ef0e429-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "4723d8cd-adea-4650-bcad-73b36ef0e429" (UID: "4723d8cd-adea-4650-bcad-73b36ef0e429"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 11:08:26.308467 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:26.308434    2565 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4723d8cd-adea-4650-bcad-73b36ef0e429-proxy-tls\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 11:08:26.308467 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:26.308460    2565 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/4723d8cd-adea-4650-bcad-73b36ef0e429-cabundle-cert\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 11:08:26.308467 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:26.308471    2565 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4723d8cd-adea-4650-bcad-73b36ef0e429-kserve-provision-location\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 11:08:26.308889 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:26.308480    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4mvl\" (UniqueName: \"kubernetes.io/projected/4723d8cd-adea-4650-bcad-73b36ef0e429-kube-api-access-h4mvl\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 11:08:26.308889 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:26.308489    2565 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4723d8cd-adea-4650-bcad-73b36ef0e429-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 11:08:26.643033 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:26.643001    2565 generic.go:356] "Generic (PLEG): container finished" podID="4723d8cd-adea-4650-bcad-73b36ef0e429" containerID="37f247cdb039ffed2e66ab85651d8686e6101d852b534a5d4f709888018c20cb" exitCode=0
Jul 15 11:08:26.643247 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:26.643070    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m"
Jul 15 11:08:26.643247 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:26.643094    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m" event={"ID":"4723d8cd-adea-4650-bcad-73b36ef0e429","Type":"ContainerDied","Data":"37f247cdb039ffed2e66ab85651d8686e6101d852b534a5d4f709888018c20cb"}
Jul 15 11:08:26.643247 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:26.643208    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m" event={"ID":"4723d8cd-adea-4650-bcad-73b36ef0e429","Type":"ContainerDied","Data":"277daa85add7ff5641c3c229c60b63e4cf3bb9b254b98b0722d71ddf8a51508c"}
Jul 15 11:08:26.643451 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:26.643250    2565 scope.go:117] "RemoveContainer" containerID="f2fe9e84b5a7d84fa9b54c344794a7cc009a3bc4b757c45a885fcf28537845ed"
Jul 15 11:08:26.652549 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:26.652533    2565 scope.go:117] "RemoveContainer" containerID="37f247cdb039ffed2e66ab85651d8686e6101d852b534a5d4f709888018c20cb"
Jul 15 11:08:26.660797 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:26.660778    2565 scope.go:117] "RemoveContainer" containerID="73d05f27645dfdb9b50df6b543666e111bd757a70ff8cd51736563c580305e85"
Jul 15 11:08:26.668226 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:26.668166    2565 scope.go:117] "RemoveContainer" containerID="f2fe9e84b5a7d84fa9b54c344794a7cc009a3bc4b757c45a885fcf28537845ed"
Jul 15 11:08:26.668589 ip-10-0-134-216 kubenswrapper[2565]: E0715 11:08:26.668561    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2fe9e84b5a7d84fa9b54c344794a7cc009a3bc4b757c45a885fcf28537845ed\": container with ID starting with f2fe9e84b5a7d84fa9b54c344794a7cc009a3bc4b757c45a885fcf28537845ed not found: ID does not exist" containerID="f2fe9e84b5a7d84fa9b54c344794a7cc009a3bc4b757c45a885fcf28537845ed"
Jul 15 11:08:26.668719 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:26.668599    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2fe9e84b5a7d84fa9b54c344794a7cc009a3bc4b757c45a885fcf28537845ed"} err="failed to get container status \"f2fe9e84b5a7d84fa9b54c344794a7cc009a3bc4b757c45a885fcf28537845ed\": rpc error: code = NotFound desc = could not find container \"f2fe9e84b5a7d84fa9b54c344794a7cc009a3bc4b757c45a885fcf28537845ed\": container with ID starting with f2fe9e84b5a7d84fa9b54c344794a7cc009a3bc4b757c45a885fcf28537845ed not found: ID does not exist"
Jul 15 11:08:26.668719 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:26.668622    2565 scope.go:117] "RemoveContainer" containerID="37f247cdb039ffed2e66ab85651d8686e6101d852b534a5d4f709888018c20cb"
Jul 15 11:08:26.668929 ip-10-0-134-216 kubenswrapper[2565]: E0715 11:08:26.668909    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37f247cdb039ffed2e66ab85651d8686e6101d852b534a5d4f709888018c20cb\": container with ID starting with 37f247cdb039ffed2e66ab85651d8686e6101d852b534a5d4f709888018c20cb not found: ID does not exist" containerID="37f247cdb039ffed2e66ab85651d8686e6101d852b534a5d4f709888018c20cb"
Jul 15 11:08:26.668988 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:26.668936    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37f247cdb039ffed2e66ab85651d8686e6101d852b534a5d4f709888018c20cb"} err="failed to get container status \"37f247cdb039ffed2e66ab85651d8686e6101d852b534a5d4f709888018c20cb\": rpc error: code = NotFound desc = could not find container \"37f247cdb039ffed2e66ab85651d8686e6101d852b534a5d4f709888018c20cb\": container with ID starting with 37f247cdb039ffed2e66ab85651d8686e6101d852b534a5d4f709888018c20cb not found: ID does not exist"
Jul 15 11:08:26.668988 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:26.668961    2565 scope.go:117] "RemoveContainer" containerID="73d05f27645dfdb9b50df6b543666e111bd757a70ff8cd51736563c580305e85"
Jul 15 11:08:26.669402 ip-10-0-134-216 kubenswrapper[2565]: E0715 11:08:26.669312    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73d05f27645dfdb9b50df6b543666e111bd757a70ff8cd51736563c580305e85\": container with ID starting with 73d05f27645dfdb9b50df6b543666e111bd757a70ff8cd51736563c580305e85 not found: ID does not exist" containerID="73d05f27645dfdb9b50df6b543666e111bd757a70ff8cd51736563c580305e85"
Jul 15 11:08:26.669402 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:26.669358    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73d05f27645dfdb9b50df6b543666e111bd757a70ff8cd51736563c580305e85"} err="failed to get container status \"73d05f27645dfdb9b50df6b543666e111bd757a70ff8cd51736563c580305e85\": rpc error: code = NotFound desc = could not find container \"73d05f27645dfdb9b50df6b543666e111bd757a70ff8cd51736563c580305e85\": container with ID starting with 73d05f27645dfdb9b50df6b543666e111bd757a70ff8cd51736563c580305e85 not found: ID does not exist"
Jul 15 11:08:26.671752 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:26.671735    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m"]
Jul 15 11:08:26.675514 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:26.675496    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-variants-predictor-c6767c94c-2xb2m"]
Jul 15 11:08:26.924734 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:26.924656    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4723d8cd-adea-4650-bcad-73b36ef0e429" path="/var/lib/kubelet/pods/4723d8cd-adea-4650-bcad-73b36ef0e429/volumes"
Jul 15 11:08:30.408176 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:30.408144    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 11:08:30.477697 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:30.477664    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd"]
Jul 15 11:08:30.478065 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:30.478051    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4723d8cd-adea-4650-bcad-73b36ef0e429" containerName="kserve-container"
Jul 15 11:08:30.478109 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:30.478066    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4723d8cd-adea-4650-bcad-73b36ef0e429" containerName="kserve-container"
Jul 15 11:08:30.478109 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:30.478087    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4723d8cd-adea-4650-bcad-73b36ef0e429" containerName="kube-rbac-proxy"
Jul 15 11:08:30.478109 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:30.478093    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4723d8cd-adea-4650-bcad-73b36ef0e429" containerName="kube-rbac-proxy"
Jul 15 11:08:30.478204 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:30.478115    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4723d8cd-adea-4650-bcad-73b36ef0e429" containerName="storage-initializer"
Jul 15 11:08:30.478204 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:30.478121    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4723d8cd-adea-4650-bcad-73b36ef0e429" containerName="storage-initializer"
Jul 15 11:08:30.478204 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:30.478177    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4723d8cd-adea-4650-bcad-73b36ef0e429" containerName="kube-rbac-proxy"
Jul 15 11:08:30.478204 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:30.478194    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4723d8cd-adea-4650-bcad-73b36ef0e429" containerName="kserve-container"
Jul 15 11:08:30.483016 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:30.482998    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd"
Jul 15 11:08:30.485357 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:30.485322    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-autogluon-v2-noslash-kube-rbac-proxy-sar-config\""
Jul 15 11:08:30.485595 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:30.485567    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-autogluon-v2-noslash-predictor-serving-cert\""
Jul 15 11:08:30.485595 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:30.485578    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 15 11:08:30.485780 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:30.485581    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 15 11:08:30.485780 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:30.485666    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 15 11:08:30.485780 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:30.485676    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 15 11:08:30.486744 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:30.486728    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-55dm9\""
Jul 15 11:08:30.492315 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:30.492294    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd"]
Jul 15 11:08:30.539488 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:30.539457    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/555f404d-c69f-402b-9c4b-94b98cf9cef7-cabundle-cert\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd\" (UID: \"555f404d-c69f-402b-9c4b-94b98cf9cef7\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd"
Jul 15 11:08:30.539645 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:30.539496    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/555f404d-c69f-402b-9c4b-94b98cf9cef7-proxy-tls\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd\" (UID: \"555f404d-c69f-402b-9c4b-94b98cf9cef7\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd"
Jul 15 11:08:30.539645 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:30.539517    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/555f404d-c69f-402b-9c4b-94b98cf9cef7-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd\" (UID: \"555f404d-c69f-402b-9c4b-94b98cf9cef7\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd"
Jul 15 11:08:30.539645 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:30.539534    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/555f404d-c69f-402b-9c4b-94b98cf9cef7-kserve-provision-location\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd\" (UID: \"555f404d-c69f-402b-9c4b-94b98cf9cef7\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd"
Jul 15 11:08:30.539760 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:30.539675    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zppwt\" (UniqueName: \"kubernetes.io/projected/555f404d-c69f-402b-9c4b-94b98cf9cef7-kube-api-access-zppwt\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd\" (UID: \"555f404d-c69f-402b-9c4b-94b98cf9cef7\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd"
Jul 15 11:08:30.640886 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:30.640831    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zppwt\" (UniqueName: \"kubernetes.io/projected/555f404d-c69f-402b-9c4b-94b98cf9cef7-kube-api-access-zppwt\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd\" (UID: \"555f404d-c69f-402b-9c4b-94b98cf9cef7\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd"
Jul 15 11:08:30.640886 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:30.640894    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/555f404d-c69f-402b-9c4b-94b98cf9cef7-cabundle-cert\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd\" (UID: \"555f404d-c69f-402b-9c4b-94b98cf9cef7\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd"
Jul 15 11:08:30.641167 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:30.640924    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/555f404d-c69f-402b-9c4b-94b98cf9cef7-proxy-tls\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd\" (UID: \"555f404d-c69f-402b-9c4b-94b98cf9cef7\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd"
Jul 15 11:08:30.641167 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:30.640945    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/555f404d-c69f-402b-9c4b-94b98cf9cef7-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd\" (UID: \"555f404d-c69f-402b-9c4b-94b98cf9cef7\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd"
Jul 15 11:08:30.641167 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:30.640961    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/555f404d-c69f-402b-9c4b-94b98cf9cef7-kserve-provision-location\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd\" (UID: \"555f404d-c69f-402b-9c4b-94b98cf9cef7\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd"
Jul 15 11:08:30.641167 ip-10-0-134-216 kubenswrapper[2565]: E0715 11:08:30.641089    2565 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-serving-cert: secret "isvc-autogluon-v2-noslash-predictor-serving-cert" not found
Jul 15 11:08:30.641167 ip-10-0-134-216 kubenswrapper[2565]: E0715 11:08:30.641163    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/555f404d-c69f-402b-9c4b-94b98cf9cef7-proxy-tls podName:555f404d-c69f-402b-9c4b-94b98cf9cef7 nodeName:}" failed. No retries permitted until 2026-07-15 11:08:31.141141968 +0000 UTC m=+1408.749677971 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/555f404d-c69f-402b-9c4b-94b98cf9cef7-proxy-tls") pod "isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd" (UID: "555f404d-c69f-402b-9c4b-94b98cf9cef7") : secret "isvc-autogluon-v2-noslash-predictor-serving-cert" not found
Jul 15 11:08:30.641481 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:30.641453    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/555f404d-c69f-402b-9c4b-94b98cf9cef7-kserve-provision-location\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd\" (UID: \"555f404d-c69f-402b-9c4b-94b98cf9cef7\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd"
Jul 15 11:08:30.641622 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:30.641604    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/555f404d-c69f-402b-9c4b-94b98cf9cef7-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd\" (UID: \"555f404d-c69f-402b-9c4b-94b98cf9cef7\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd"
Jul 15 11:08:30.641660 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:30.641620    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/555f404d-c69f-402b-9c4b-94b98cf9cef7-cabundle-cert\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd\" (UID: \"555f404d-c69f-402b-9c4b-94b98cf9cef7\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd"
Jul 15 11:08:30.650463 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:30.650444    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zppwt\" (UniqueName: \"kubernetes.io/projected/555f404d-c69f-402b-9c4b-94b98cf9cef7-kube-api-access-zppwt\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd\" (UID: \"555f404d-c69f-402b-9c4b-94b98cf9cef7\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd"
Jul 15 11:08:30.725749 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:30.725656    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 11:08:31.145930 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:31.145871    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/555f404d-c69f-402b-9c4b-94b98cf9cef7-proxy-tls\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd\" (UID: \"555f404d-c69f-402b-9c4b-94b98cf9cef7\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd"
Jul 15 11:08:31.148446 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:31.148414    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/555f404d-c69f-402b-9c4b-94b98cf9cef7-proxy-tls\") pod \"isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd\" (UID: \"555f404d-c69f-402b-9c4b-94b98cf9cef7\") " pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd"
Jul 15 11:08:31.394437 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:31.394304    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd"
Jul 15 11:08:31.530212 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:31.530186    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd"]
Jul 15 11:08:31.535306 ip-10-0-134-216 kubenswrapper[2565]: W0715 11:08:31.533439    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod555f404d_c69f_402b_9c4b_94b98cf9cef7.slice/crio-71c3ce9ee50dcfbb09192b64107015929e686af383d0e0cfd22e658eb1eca1f5 WatchSource:0}: Error finding container 71c3ce9ee50dcfbb09192b64107015929e686af383d0e0cfd22e658eb1eca1f5: Status 404 returned error can't find the container with id 71c3ce9ee50dcfbb09192b64107015929e686af383d0e0cfd22e658eb1eca1f5
Jul 15 11:08:31.667763 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:31.667683    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd" event={"ID":"555f404d-c69f-402b-9c4b-94b98cf9cef7","Type":"ContainerStarted","Data":"c4568514dd05d31d317f2ec6ec1a6a32fc4cb14ed43ae89fd54a685f1ab59ba5"}
Jul 15 11:08:31.667906 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:31.667769    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd" event={"ID":"555f404d-c69f-402b-9c4b-94b98cf9cef7","Type":"ContainerStarted","Data":"71c3ce9ee50dcfbb09192b64107015929e686af383d0e0cfd22e658eb1eca1f5"}
Jul 15 11:08:51.766164 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:51.766129    2565 generic.go:356] "Generic (PLEG): container finished" podID="555f404d-c69f-402b-9c4b-94b98cf9cef7" containerID="c4568514dd05d31d317f2ec6ec1a6a32fc4cb14ed43ae89fd54a685f1ab59ba5" exitCode=0
Jul 15 11:08:51.766689 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:51.766174    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd" event={"ID":"555f404d-c69f-402b-9c4b-94b98cf9cef7","Type":"ContainerDied","Data":"c4568514dd05d31d317f2ec6ec1a6a32fc4cb14ed43ae89fd54a685f1ab59ba5"}
Jul 15 11:08:52.776087 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:52.776051    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd" event={"ID":"555f404d-c69f-402b-9c4b-94b98cf9cef7","Type":"ContainerStarted","Data":"ef99e4fc9313157cac3c7799f2545e2c926fd30838fd242399c48256c50f2030"}
Jul 15 11:08:52.776500 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:52.776115    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd" event={"ID":"555f404d-c69f-402b-9c4b-94b98cf9cef7","Type":"ContainerStarted","Data":"a208d2ce735069bfd4fd9820f6b713fa29dcdc1bda2bde216557bcf334b8900d"}
Jul 15 11:08:52.776500 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:52.776348    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd"
Jul 15 11:08:52.776500 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:52.776404    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd"
Jul 15 11:08:52.798297 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:52.798248    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd" podStartSLOduration=2.736090797 podStartE2EDuration="22.798233752s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.062142955s" isStatefulPod=false podCreationTimestamp="2026-07-15 11:08:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 11:08:52.797539241 +0000 UTC m=+1430.406075263" watchObservedRunningTime="2026-07-15 11:08:52.798233752 +0000 UTC m=+1430.406769774"
Jul 15 11:08:58.787020 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:08:58.786939    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd"
Jul 15 11:10:02.951587 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:02.951558    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8dcjj_8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9/console-operator/1.log"
Jul 15 11:10:02.955729 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:02.955708    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qsch8_f3b175c1-34f8-4e74-bce6-f866e4bd25b0/ovn-acl-logging/0.log"
Jul 15 11:10:02.956281 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:02.956258    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8dcjj_8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9/console-operator/1.log"
Jul 15 11:10:02.960203 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:02.960183    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qsch8_f3b175c1-34f8-4e74-bce6-f866e4bd25b0/ovn-acl-logging/0.log"
Jul 15 11:10:22.927400 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:22.927366    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd"
Jul 15 11:10:30.617652 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:30.617616    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd"]
Jul 15 11:10:30.618057 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:30.618022    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd" podUID="555f404d-c69f-402b-9c4b-94b98cf9cef7" containerName="kserve-container" containerID="cri-o://a208d2ce735069bfd4fd9820f6b713fa29dcdc1bda2bde216557bcf334b8900d" gracePeriod=30
Jul 15 11:10:30.618125 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:30.618026    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd" podUID="555f404d-c69f-402b-9c4b-94b98cf9cef7" containerName="kube-rbac-proxy" containerID="cri-o://ef99e4fc9313157cac3c7799f2545e2c926fd30838fd242399c48256c50f2030" gracePeriod=30
Jul 15 11:10:31.233692 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:31.233659    2565 generic.go:356] "Generic (PLEG): container finished" podID="555f404d-c69f-402b-9c4b-94b98cf9cef7" containerID="ef99e4fc9313157cac3c7799f2545e2c926fd30838fd242399c48256c50f2030" exitCode=2
Jul 15 11:10:31.233874 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:31.233744    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd" event={"ID":"555f404d-c69f-402b-9c4b-94b98cf9cef7","Type":"ContainerDied","Data":"ef99e4fc9313157cac3c7799f2545e2c926fd30838fd242399c48256c50f2030"}
Jul 15 11:10:31.476520 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:31.476498    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd"
Jul 15 11:10:31.652963 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:31.652928    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/555f404d-c69f-402b-9c4b-94b98cf9cef7-kserve-provision-location\") pod \"555f404d-c69f-402b-9c4b-94b98cf9cef7\" (UID: \"555f404d-c69f-402b-9c4b-94b98cf9cef7\") "
Jul 15 11:10:31.652963 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:31.652965    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/555f404d-c69f-402b-9c4b-94b98cf9cef7-proxy-tls\") pod \"555f404d-c69f-402b-9c4b-94b98cf9cef7\" (UID: \"555f404d-c69f-402b-9c4b-94b98cf9cef7\") "
Jul 15 11:10:31.653510 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:31.653029    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/555f404d-c69f-402b-9c4b-94b98cf9cef7-cabundle-cert\") pod \"555f404d-c69f-402b-9c4b-94b98cf9cef7\" (UID: \"555f404d-c69f-402b-9c4b-94b98cf9cef7\") "
Jul 15 11:10:31.653510 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:31.653054    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zppwt\" (UniqueName: \"kubernetes.io/projected/555f404d-c69f-402b-9c4b-94b98cf9cef7-kube-api-access-zppwt\") pod \"555f404d-c69f-402b-9c4b-94b98cf9cef7\" (UID: \"555f404d-c69f-402b-9c4b-94b98cf9cef7\") "
Jul 15 11:10:31.653510 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:31.653080    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/555f404d-c69f-402b-9c4b-94b98cf9cef7-kube-rbac-proxy-sar-config\") pod \"555f404d-c69f-402b-9c4b-94b98cf9cef7\" (UID: \"555f404d-c69f-402b-9c4b-94b98cf9cef7\") "
Jul 15 11:10:31.653510 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:31.653441    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/555f404d-c69f-402b-9c4b-94b98cf9cef7-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "555f404d-c69f-402b-9c4b-94b98cf9cef7" (UID: "555f404d-c69f-402b-9c4b-94b98cf9cef7"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 11:10:31.653689 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:31.653550    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/555f404d-c69f-402b-9c4b-94b98cf9cef7-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "555f404d-c69f-402b-9c4b-94b98cf9cef7" (UID: "555f404d-c69f-402b-9c4b-94b98cf9cef7"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 11:10:31.655367 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:31.655320    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/555f404d-c69f-402b-9c4b-94b98cf9cef7-kube-api-access-zppwt" (OuterVolumeSpecName: "kube-api-access-zppwt") pod "555f404d-c69f-402b-9c4b-94b98cf9cef7" (UID: "555f404d-c69f-402b-9c4b-94b98cf9cef7"). InnerVolumeSpecName "kube-api-access-zppwt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 11:10:31.655522 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:31.655503    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/555f404d-c69f-402b-9c4b-94b98cf9cef7-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "555f404d-c69f-402b-9c4b-94b98cf9cef7" (UID: "555f404d-c69f-402b-9c4b-94b98cf9cef7"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 11:10:31.657927 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:31.657905    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/555f404d-c69f-402b-9c4b-94b98cf9cef7-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "555f404d-c69f-402b-9c4b-94b98cf9cef7" (UID: "555f404d-c69f-402b-9c4b-94b98cf9cef7"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 11:10:31.754367 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:31.754317    2565 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/555f404d-c69f-402b-9c4b-94b98cf9cef7-cabundle-cert\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 11:10:31.754367 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:31.754361    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zppwt\" (UniqueName: \"kubernetes.io/projected/555f404d-c69f-402b-9c4b-94b98cf9cef7-kube-api-access-zppwt\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 11:10:31.754567 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:31.754376    2565 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/555f404d-c69f-402b-9c4b-94b98cf9cef7-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 11:10:31.754567 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:31.754385    2565 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/555f404d-c69f-402b-9c4b-94b98cf9cef7-kserve-provision-location\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 11:10:31.754567 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:31.754394    2565 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/555f404d-c69f-402b-9c4b-94b98cf9cef7-proxy-tls\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 11:10:32.204118 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:32.204084    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 11:10:32.241054 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:32.241021    2565 generic.go:356] "Generic (PLEG): container finished" podID="555f404d-c69f-402b-9c4b-94b98cf9cef7" containerID="a208d2ce735069bfd4fd9820f6b713fa29dcdc1bda2bde216557bcf334b8900d" exitCode=0
Jul 15 11:10:32.241199 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:32.241080    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd"
Jul 15 11:10:32.241199 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:32.241096    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd" event={"ID":"555f404d-c69f-402b-9c4b-94b98cf9cef7","Type":"ContainerDied","Data":"a208d2ce735069bfd4fd9820f6b713fa29dcdc1bda2bde216557bcf334b8900d"}
Jul 15 11:10:32.241199 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:32.241153    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd" event={"ID":"555f404d-c69f-402b-9c4b-94b98cf9cef7","Type":"ContainerDied","Data":"71c3ce9ee50dcfbb09192b64107015929e686af383d0e0cfd22e658eb1eca1f5"}
Jul 15 11:10:32.241199 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:32.241180    2565 scope.go:117] "RemoveContainer" containerID="ef99e4fc9313157cac3c7799f2545e2c926fd30838fd242399c48256c50f2030"
Jul 15 11:10:32.249982 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:32.249962    2565 scope.go:117] "RemoveContainer" containerID="a208d2ce735069bfd4fd9820f6b713fa29dcdc1bda2bde216557bcf334b8900d"
Jul 15 11:10:32.257625 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:32.257605    2565 scope.go:117] "RemoveContainer" containerID="c4568514dd05d31d317f2ec6ec1a6a32fc4cb14ed43ae89fd54a685f1ab59ba5"
Jul 15 11:10:32.263187 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:32.263133    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd"]
Jul 15 11:10:32.268231 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:32.268203    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-v2-noslash-predictor-9dcfbbb84-9tdjd"]
Jul 15 11:10:32.268840 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:32.268819    2565 scope.go:117] "RemoveContainer" containerID="ef99e4fc9313157cac3c7799f2545e2c926fd30838fd242399c48256c50f2030"
Jul 15 11:10:32.269123 ip-10-0-134-216 kubenswrapper[2565]: E0715 11:10:32.269106    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef99e4fc9313157cac3c7799f2545e2c926fd30838fd242399c48256c50f2030\": container with ID starting with ef99e4fc9313157cac3c7799f2545e2c926fd30838fd242399c48256c50f2030 not found: ID does not exist" containerID="ef99e4fc9313157cac3c7799f2545e2c926fd30838fd242399c48256c50f2030"
Jul 15 11:10:32.269192 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:32.269131    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef99e4fc9313157cac3c7799f2545e2c926fd30838fd242399c48256c50f2030"} err="failed to get container status \"ef99e4fc9313157cac3c7799f2545e2c926fd30838fd242399c48256c50f2030\": rpc error: code = NotFound desc = could not find container \"ef99e4fc9313157cac3c7799f2545e2c926fd30838fd242399c48256c50f2030\": container with ID starting with ef99e4fc9313157cac3c7799f2545e2c926fd30838fd242399c48256c50f2030 not found: ID does not exist"
Jul 15 11:10:32.269192 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:32.269148    2565 scope.go:117] "RemoveContainer" containerID="a208d2ce735069bfd4fd9820f6b713fa29dcdc1bda2bde216557bcf334b8900d"
Jul 15 11:10:32.269410 ip-10-0-134-216 kubenswrapper[2565]: E0715 11:10:32.269390    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a208d2ce735069bfd4fd9820f6b713fa29dcdc1bda2bde216557bcf334b8900d\": container with ID starting with a208d2ce735069bfd4fd9820f6b713fa29dcdc1bda2bde216557bcf334b8900d not found: ID does not exist" containerID="a208d2ce735069bfd4fd9820f6b713fa29dcdc1bda2bde216557bcf334b8900d"
Jul 15 11:10:32.269455 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:32.269417    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a208d2ce735069bfd4fd9820f6b713fa29dcdc1bda2bde216557bcf334b8900d"} err="failed to get container status \"a208d2ce735069bfd4fd9820f6b713fa29dcdc1bda2bde216557bcf334b8900d\": rpc error: code = NotFound desc = could not find container \"a208d2ce735069bfd4fd9820f6b713fa29dcdc1bda2bde216557bcf334b8900d\": container with ID starting with a208d2ce735069bfd4fd9820f6b713fa29dcdc1bda2bde216557bcf334b8900d not found: ID does not exist"
Jul 15 11:10:32.269455 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:32.269437    2565 scope.go:117] "RemoveContainer" containerID="c4568514dd05d31d317f2ec6ec1a6a32fc4cb14ed43ae89fd54a685f1ab59ba5"
Jul 15 11:10:32.269669 ip-10-0-134-216 kubenswrapper[2565]: E0715 11:10:32.269650    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4568514dd05d31d317f2ec6ec1a6a32fc4cb14ed43ae89fd54a685f1ab59ba5\": container with ID starting with c4568514dd05d31d317f2ec6ec1a6a32fc4cb14ed43ae89fd54a685f1ab59ba5 not found: ID does not exist" containerID="c4568514dd05d31d317f2ec6ec1a6a32fc4cb14ed43ae89fd54a685f1ab59ba5"
Jul 15 11:10:32.269712 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:32.269673    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4568514dd05d31d317f2ec6ec1a6a32fc4cb14ed43ae89fd54a685f1ab59ba5"} err="failed to get container status \"c4568514dd05d31d317f2ec6ec1a6a32fc4cb14ed43ae89fd54a685f1ab59ba5\": rpc error: code = NotFound desc = could not find container \"c4568514dd05d31d317f2ec6ec1a6a32fc4cb14ed43ae89fd54a685f1ab59ba5\": container with ID starting with c4568514dd05d31d317f2ec6ec1a6a32fc4cb14ed43ae89fd54a685f1ab59ba5 not found: ID does not exist"
Jul 15 11:10:32.931131 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:32.931095    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="555f404d-c69f-402b-9c4b-94b98cf9cef7" path="/var/lib/kubelet/pods/555f404d-c69f-402b-9c4b-94b98cf9cef7/volumes"
Jul 15 11:10:35.745296 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:35.745263    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 11:10:35.809417 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:35.809385    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw"]
Jul 15 11:10:35.809743 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:35.809731    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="555f404d-c69f-402b-9c4b-94b98cf9cef7" containerName="storage-initializer"
Jul 15 11:10:35.809791 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:35.809745    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="555f404d-c69f-402b-9c4b-94b98cf9cef7" containerName="storage-initializer"
Jul 15 11:10:35.809791 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:35.809753    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="555f404d-c69f-402b-9c4b-94b98cf9cef7" containerName="kube-rbac-proxy"
Jul 15 11:10:35.809791 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:35.809760    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="555f404d-c69f-402b-9c4b-94b98cf9cef7" containerName="kube-rbac-proxy"
Jul 15 11:10:35.809791 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:35.809774    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="555f404d-c69f-402b-9c4b-94b98cf9cef7" containerName="kserve-container"
Jul 15 11:10:35.809791 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:35.809779    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="555f404d-c69f-402b-9c4b-94b98cf9cef7" containerName="kserve-container"
Jul 15 11:10:35.809943 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:35.809835    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="555f404d-c69f-402b-9c4b-94b98cf9cef7" containerName="kserve-container"
Jul 15 11:10:35.809943 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:35.809845    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="555f404d-c69f-402b-9c4b-94b98cf9cef7" containerName="kube-rbac-proxy"
Jul 15 11:10:35.812935 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:35.812919    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw"
Jul 15 11:10:35.815683 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:35.815655    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-autogluon-ts-v1-predictor-serving-cert\""
Jul 15 11:10:35.815683 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:35.815671    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-55dm9\""
Jul 15 11:10:35.815885 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:35.815668    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 15 11:10:35.815885 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:35.815722    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 15 11:10:35.815885 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:35.815668    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-autogluon-ts-v1-kube-rbac-proxy-sar-config\""
Jul 15 11:10:35.815885 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:35.815831    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 15 11:10:35.816441 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:35.816426    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 15 11:10:35.825189 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:35.825167    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw"]
Jul 15 11:10:35.991492 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:35.991452    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d17c0002-e2de-431d-aabb-535dba8a5b48-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw\" (UID: \"d17c0002-e2de-431d-aabb-535dba8a5b48\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw"
Jul 15 11:10:35.991492 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:35.991491    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d17c0002-e2de-431d-aabb-535dba8a5b48-cabundle-cert\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw\" (UID: \"d17c0002-e2de-431d-aabb-535dba8a5b48\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw"
Jul 15 11:10:35.991737 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:35.991564    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d17c0002-e2de-431d-aabb-535dba8a5b48-proxy-tls\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw\" (UID: \"d17c0002-e2de-431d-aabb-535dba8a5b48\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw"
Jul 15 11:10:35.991737 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:35.991631    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d17c0002-e2de-431d-aabb-535dba8a5b48-kserve-provision-location\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw\" (UID: \"d17c0002-e2de-431d-aabb-535dba8a5b48\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw"
Jul 15 11:10:35.991737 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:35.991698    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mm5v\" (UniqueName: \"kubernetes.io/projected/d17c0002-e2de-431d-aabb-535dba8a5b48-kube-api-access-7mm5v\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw\" (UID: \"d17c0002-e2de-431d-aabb-535dba8a5b48\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw"
Jul 15 11:10:36.092374 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:36.092309    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d17c0002-e2de-431d-aabb-535dba8a5b48-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw\" (UID: \"d17c0002-e2de-431d-aabb-535dba8a5b48\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw"
Jul 15 11:10:36.092583 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:36.092382    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d17c0002-e2de-431d-aabb-535dba8a5b48-cabundle-cert\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw\" (UID: \"d17c0002-e2de-431d-aabb-535dba8a5b48\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw"
Jul 15 11:10:36.092583 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:36.092436    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d17c0002-e2de-431d-aabb-535dba8a5b48-proxy-tls\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw\" (UID: \"d17c0002-e2de-431d-aabb-535dba8a5b48\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw"
Jul 15 11:10:36.092583 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:36.092501    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d17c0002-e2de-431d-aabb-535dba8a5b48-kserve-provision-location\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw\" (UID: \"d17c0002-e2de-431d-aabb-535dba8a5b48\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw"
Jul 15 11:10:36.092583 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:36.092543    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mm5v\" (UniqueName: \"kubernetes.io/projected/d17c0002-e2de-431d-aabb-535dba8a5b48-kube-api-access-7mm5v\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw\" (UID: \"d17c0002-e2de-431d-aabb-535dba8a5b48\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw"
Jul 15 11:10:36.092818 ip-10-0-134-216 kubenswrapper[2565]: E0715 11:10:36.092616    2565 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-serving-cert: secret "isvc-autogluon-ts-v1-predictor-serving-cert" not found
Jul 15 11:10:36.092818 ip-10-0-134-216 kubenswrapper[2565]: E0715 11:10:36.092699    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d17c0002-e2de-431d-aabb-535dba8a5b48-proxy-tls podName:d17c0002-e2de-431d-aabb-535dba8a5b48 nodeName:}" failed. No retries permitted until 2026-07-15 11:10:36.592676702 +0000 UTC m=+1534.201212715 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/d17c0002-e2de-431d-aabb-535dba8a5b48-proxy-tls") pod "isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw" (UID: "d17c0002-e2de-431d-aabb-535dba8a5b48") : secret "isvc-autogluon-ts-v1-predictor-serving-cert" not found
Jul 15 11:10:36.092939 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:36.092886    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d17c0002-e2de-431d-aabb-535dba8a5b48-kserve-provision-location\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw\" (UID: \"d17c0002-e2de-431d-aabb-535dba8a5b48\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw"
Jul 15 11:10:36.093141 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:36.093117    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d17c0002-e2de-431d-aabb-535dba8a5b48-kube-rbac-proxy-sar-config\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw\" (UID: \"d17c0002-e2de-431d-aabb-535dba8a5b48\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw"
Jul 15 11:10:36.093202 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:36.093125    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d17c0002-e2de-431d-aabb-535dba8a5b48-cabundle-cert\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw\" (UID: \"d17c0002-e2de-431d-aabb-535dba8a5b48\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw"
Jul 15 11:10:36.102038 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:36.102018    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mm5v\" (UniqueName: \"kubernetes.io/projected/d17c0002-e2de-431d-aabb-535dba8a5b48-kube-api-access-7mm5v\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw\" (UID: \"d17c0002-e2de-431d-aabb-535dba8a5b48\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw"
Jul 15 11:10:36.322618 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:36.322585    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 11:10:36.597281 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:36.597247    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d17c0002-e2de-431d-aabb-535dba8a5b48-proxy-tls\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw\" (UID: \"d17c0002-e2de-431d-aabb-535dba8a5b48\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw"
Jul 15 11:10:36.599838 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:36.599811    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d17c0002-e2de-431d-aabb-535dba8a5b48-proxy-tls\") pod \"isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw\" (UID: \"d17c0002-e2de-431d-aabb-535dba8a5b48\") " pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw"
Jul 15 11:10:36.723106 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:36.723071    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw"
Jul 15 11:10:36.862917 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:36.862894    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw"]
Jul 15 11:10:36.865116 ip-10-0-134-216 kubenswrapper[2565]: W0715 11:10:36.865088    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd17c0002_e2de_431d_aabb_535dba8a5b48.slice/crio-6cd52f55dd039f6199a05cab42e0dd620bbdb3ec05b71b9594101be65055d44d WatchSource:0}: Error finding container 6cd52f55dd039f6199a05cab42e0dd620bbdb3ec05b71b9594101be65055d44d: Status 404 returned error can't find the container with id 6cd52f55dd039f6199a05cab42e0dd620bbdb3ec05b71b9594101be65055d44d
Jul 15 11:10:37.267655 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:37.267563    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw" event={"ID":"d17c0002-e2de-431d-aabb-535dba8a5b48","Type":"ContainerStarted","Data":"a868206f8a07f4a7dbfa8fa8484269639ea6c35386cb62eff85e2314b68b3a86"}
Jul 15 11:10:37.267655 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:37.267642    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw" event={"ID":"d17c0002-e2de-431d-aabb-535dba8a5b48","Type":"ContainerStarted","Data":"6cd52f55dd039f6199a05cab42e0dd620bbdb3ec05b71b9594101be65055d44d"}
Jul 15 11:10:46.308935 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:46.308901    2565 generic.go:356] "Generic (PLEG): container finished" podID="d17c0002-e2de-431d-aabb-535dba8a5b48" containerID="a868206f8a07f4a7dbfa8fa8484269639ea6c35386cb62eff85e2314b68b3a86" exitCode=0
Jul 15 11:10:46.309352 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:46.308960    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw" event={"ID":"d17c0002-e2de-431d-aabb-535dba8a5b48","Type":"ContainerDied","Data":"a868206f8a07f4a7dbfa8fa8484269639ea6c35386cb62eff85e2314b68b3a86"}
Jul 15 11:10:47.316218 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:47.316178    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw" event={"ID":"d17c0002-e2de-431d-aabb-535dba8a5b48","Type":"ContainerStarted","Data":"c877bedf46687144e1bf013f06990b07985ad4b4893d846818ce45e7b04bc8fd"}
Jul 15 11:10:47.316747 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:47.316241    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw" event={"ID":"d17c0002-e2de-431d-aabb-535dba8a5b48","Type":"ContainerStarted","Data":"4df64111fae02738dce27a9439300a795e48975a8f5d157b4972bb237b03657c"}
Jul 15 11:10:47.316747 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:47.316441    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw"
Jul 15 11:10:47.339707 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:47.339644    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw" podStartSLOduration=3.392986796 podStartE2EDuration="12.339628113s" totalImagesPullingTime="0s" totalInitContainerRuntime="8.946641317s" isStatefulPod=false podCreationTimestamp="2026-07-15 11:10:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 11:10:47.33860831 +0000 UTC m=+1544.947144331" watchObservedRunningTime="2026-07-15 11:10:47.339628113 +0000 UTC m=+1544.948164134"
Jul 15 11:10:48.321031 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:48.321000    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw"
Jul 15 11:10:48.322517 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:48.322490    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw" podUID="d17c0002-e2de-431d-aabb-535dba8a5b48" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.43:8080: connect: connection refused"
Jul 15 11:10:49.326051 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:49.326005    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw" podUID="d17c0002-e2de-431d-aabb-535dba8a5b48" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.43:8080: connect: connection refused"
Jul 15 11:10:54.330543 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:54.330510    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw"
Jul 15 11:10:54.331075 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:10:54.331040    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw" podUID="d17c0002-e2de-431d-aabb-535dba8a5b48" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.43:8080: connect: connection refused"
Jul 15 11:11:04.331947 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:04.331912    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw"
Jul 15 11:11:05.904311 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:05.904280    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw"]
Jul 15 11:11:05.904773 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:05.904525    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw" podUID="d17c0002-e2de-431d-aabb-535dba8a5b48" containerName="kserve-container" containerID="cri-o://4df64111fae02738dce27a9439300a795e48975a8f5d157b4972bb237b03657c" gracePeriod=30
Jul 15 11:11:05.904773 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:05.904578    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw" podUID="d17c0002-e2de-431d-aabb-535dba8a5b48" containerName="kube-rbac-proxy" containerID="cri-o://c877bedf46687144e1bf013f06990b07985ad4b4893d846818ce45e7b04bc8fd" gracePeriod=30
Jul 15 11:11:05.931977 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:05.931952    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 11:11:06.409984 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:06.409945    2565 generic.go:356] "Generic (PLEG): container finished" podID="d17c0002-e2de-431d-aabb-535dba8a5b48" containerID="c877bedf46687144e1bf013f06990b07985ad4b4893d846818ce45e7b04bc8fd" exitCode=2
Jul 15 11:11:06.410173 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:06.410016    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw" event={"ID":"d17c0002-e2de-431d-aabb-535dba8a5b48","Type":"ContainerDied","Data":"c877bedf46687144e1bf013f06990b07985ad4b4893d846818ce45e7b04bc8fd"}
Jul 15 11:11:06.861784 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:06.861758    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw"
Jul 15 11:11:06.942840 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:06.942807    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d17c0002-e2de-431d-aabb-535dba8a5b48-cabundle-cert\") pod \"d17c0002-e2de-431d-aabb-535dba8a5b48\" (UID: \"d17c0002-e2de-431d-aabb-535dba8a5b48\") "
Jul 15 11:11:06.943288 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:06.942856    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mm5v\" (UniqueName: \"kubernetes.io/projected/d17c0002-e2de-431d-aabb-535dba8a5b48-kube-api-access-7mm5v\") pod \"d17c0002-e2de-431d-aabb-535dba8a5b48\" (UID: \"d17c0002-e2de-431d-aabb-535dba8a5b48\") "
Jul 15 11:11:06.943288 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:06.942884    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d17c0002-e2de-431d-aabb-535dba8a5b48-kube-rbac-proxy-sar-config\") pod \"d17c0002-e2de-431d-aabb-535dba8a5b48\" (UID: \"d17c0002-e2de-431d-aabb-535dba8a5b48\") "
Jul 15 11:11:06.943288 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:06.943006    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d17c0002-e2de-431d-aabb-535dba8a5b48-proxy-tls\") pod \"d17c0002-e2de-431d-aabb-535dba8a5b48\" (UID: \"d17c0002-e2de-431d-aabb-535dba8a5b48\") "
Jul 15 11:11:06.943288 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:06.943047    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d17c0002-e2de-431d-aabb-535dba8a5b48-kserve-provision-location\") pod \"d17c0002-e2de-431d-aabb-535dba8a5b48\" (UID: \"d17c0002-e2de-431d-aabb-535dba8a5b48\") "
Jul 15 11:11:06.943288 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:06.943198    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d17c0002-e2de-431d-aabb-535dba8a5b48-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "d17c0002-e2de-431d-aabb-535dba8a5b48" (UID: "d17c0002-e2de-431d-aabb-535dba8a5b48"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 11:11:06.943288 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:06.943215    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d17c0002-e2de-431d-aabb-535dba8a5b48-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "d17c0002-e2de-431d-aabb-535dba8a5b48" (UID: "d17c0002-e2de-431d-aabb-535dba8a5b48"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 11:11:06.943660 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:06.943492    2565 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d17c0002-e2de-431d-aabb-535dba8a5b48-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 11:11:06.943660 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:06.943509    2565 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d17c0002-e2de-431d-aabb-535dba8a5b48-cabundle-cert\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 11:11:06.944078 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:06.944055    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d17c0002-e2de-431d-aabb-535dba8a5b48-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "d17c0002-e2de-431d-aabb-535dba8a5b48" (UID: "d17c0002-e2de-431d-aabb-535dba8a5b48"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 11:11:06.945115 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:06.945089    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d17c0002-e2de-431d-aabb-535dba8a5b48-kube-api-access-7mm5v" (OuterVolumeSpecName: "kube-api-access-7mm5v") pod "d17c0002-e2de-431d-aabb-535dba8a5b48" (UID: "d17c0002-e2de-431d-aabb-535dba8a5b48"). InnerVolumeSpecName "kube-api-access-7mm5v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 11:11:06.945257 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:06.945232    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d17c0002-e2de-431d-aabb-535dba8a5b48-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "d17c0002-e2de-431d-aabb-535dba8a5b48" (UID: "d17c0002-e2de-431d-aabb-535dba8a5b48"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 11:11:07.044062 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:07.044030    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mm5v\" (UniqueName: \"kubernetes.io/projected/d17c0002-e2de-431d-aabb-535dba8a5b48-kube-api-access-7mm5v\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 11:11:07.044062 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:07.044057    2565 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d17c0002-e2de-431d-aabb-535dba8a5b48-proxy-tls\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 11:11:07.044325 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:07.044073    2565 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d17c0002-e2de-431d-aabb-535dba8a5b48-kserve-provision-location\") on node \"ip-10-0-134-216.ec2.internal\" DevicePath \"\""
Jul 15 11:11:07.416856 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:07.416762    2565 generic.go:356] "Generic (PLEG): container finished" podID="d17c0002-e2de-431d-aabb-535dba8a5b48" containerID="4df64111fae02738dce27a9439300a795e48975a8f5d157b4972bb237b03657c" exitCode=0
Jul 15 11:11:07.416856 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:07.416816    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw"
Jul 15 11:11:07.417094 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:07.416843    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw" event={"ID":"d17c0002-e2de-431d-aabb-535dba8a5b48","Type":"ContainerDied","Data":"4df64111fae02738dce27a9439300a795e48975a8f5d157b4972bb237b03657c"}
Jul 15 11:11:07.417094 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:07.416920    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw" event={"ID":"d17c0002-e2de-431d-aabb-535dba8a5b48","Type":"ContainerDied","Data":"6cd52f55dd039f6199a05cab42e0dd620bbdb3ec05b71b9594101be65055d44d"}
Jul 15 11:11:07.417094 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:07.416961    2565 scope.go:117] "RemoveContainer" containerID="c877bedf46687144e1bf013f06990b07985ad4b4893d846818ce45e7b04bc8fd"
Jul 15 11:11:07.426238 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:07.426221    2565 scope.go:117] "RemoveContainer" containerID="4df64111fae02738dce27a9439300a795e48975a8f5d157b4972bb237b03657c"
Jul 15 11:11:07.433889 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:07.433869    2565 scope.go:117] "RemoveContainer" containerID="a868206f8a07f4a7dbfa8fa8484269639ea6c35386cb62eff85e2314b68b3a86"
Jul 15 11:11:07.439745 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:07.439722    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw"]
Jul 15 11:11:07.442458 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:07.442437    2565 scope.go:117] "RemoveContainer" containerID="c877bedf46687144e1bf013f06990b07985ad4b4893d846818ce45e7b04bc8fd"
Jul 15 11:11:07.442760 ip-10-0-134-216 kubenswrapper[2565]: E0715 11:11:07.442737    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c877bedf46687144e1bf013f06990b07985ad4b4893d846818ce45e7b04bc8fd\": container with ID starting with c877bedf46687144e1bf013f06990b07985ad4b4893d846818ce45e7b04bc8fd not found: ID does not exist" containerID="c877bedf46687144e1bf013f06990b07985ad4b4893d846818ce45e7b04bc8fd"
Jul 15 11:11:07.442853 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:07.442768    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c877bedf46687144e1bf013f06990b07985ad4b4893d846818ce45e7b04bc8fd"} err="failed to get container status \"c877bedf46687144e1bf013f06990b07985ad4b4893d846818ce45e7b04bc8fd\": rpc error: code = NotFound desc = could not find container \"c877bedf46687144e1bf013f06990b07985ad4b4893d846818ce45e7b04bc8fd\": container with ID starting with c877bedf46687144e1bf013f06990b07985ad4b4893d846818ce45e7b04bc8fd not found: ID does not exist"
Jul 15 11:11:07.442853 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:07.442787    2565 scope.go:117] "RemoveContainer" containerID="4df64111fae02738dce27a9439300a795e48975a8f5d157b4972bb237b03657c"
Jul 15 11:11:07.443054 ip-10-0-134-216 kubenswrapper[2565]: E0715 11:11:07.443038    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4df64111fae02738dce27a9439300a795e48975a8f5d157b4972bb237b03657c\": container with ID starting with 4df64111fae02738dce27a9439300a795e48975a8f5d157b4972bb237b03657c not found: ID does not exist" containerID="4df64111fae02738dce27a9439300a795e48975a8f5d157b4972bb237b03657c"
Jul 15 11:11:07.443103 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:07.443059    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4df64111fae02738dce27a9439300a795e48975a8f5d157b4972bb237b03657c"} err="failed to get container status \"4df64111fae02738dce27a9439300a795e48975a8f5d157b4972bb237b03657c\": rpc error: code = NotFound desc = could not find container \"4df64111fae02738dce27a9439300a795e48975a8f5d157b4972bb237b03657c\": container with ID starting with 4df64111fae02738dce27a9439300a795e48975a8f5d157b4972bb237b03657c not found: ID does not exist"
Jul 15 11:11:07.443103 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:07.443074    2565 scope.go:117] "RemoveContainer" containerID="a868206f8a07f4a7dbfa8fa8484269639ea6c35386cb62eff85e2314b68b3a86"
Jul 15 11:11:07.443372 ip-10-0-134-216 kubenswrapper[2565]: E0715 11:11:07.443327    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a868206f8a07f4a7dbfa8fa8484269639ea6c35386cb62eff85e2314b68b3a86\": container with ID starting with a868206f8a07f4a7dbfa8fa8484269639ea6c35386cb62eff85e2314b68b3a86 not found: ID does not exist" containerID="a868206f8a07f4a7dbfa8fa8484269639ea6c35386cb62eff85e2314b68b3a86"
Jul 15 11:11:07.443419 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:07.443377    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a868206f8a07f4a7dbfa8fa8484269639ea6c35386cb62eff85e2314b68b3a86"} err="failed to get container status \"a868206f8a07f4a7dbfa8fa8484269639ea6c35386cb62eff85e2314b68b3a86\": rpc error: code = NotFound desc = could not find container \"a868206f8a07f4a7dbfa8fa8484269639ea6c35386cb62eff85e2314b68b3a86\": container with ID starting with a868206f8a07f4a7dbfa8fa8484269639ea6c35386cb62eff85e2314b68b3a86 not found: ID does not exist"
Jul 15 11:11:07.443616 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:07.443599    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-autogluon-ts-v1-predictor-89d67dbf7-j6tdw"]
Jul 15 11:11:08.924778 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:08.924749    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d17c0002-e2de-431d-aabb-535dba8a5b48" path="/var/lib/kubelet/pods/d17c0002-e2de-431d-aabb-535dba8a5b48/volumes"
Jul 15 11:11:12.124683 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:12.124642    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 11:11:12.191126 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:12.191097    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 11:11:40.017344 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:40.017299    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 11:11:41.409467 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:41.409408    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 11:11:43.315570 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:43.315541    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zrr95_82f6960e-f41d-4ad3-83c4-c515ff206787/global-pull-secret-syncer/0.log"
Jul 15 11:11:43.372316 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:43.372292    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log"
Jul 15 11:11:43.458956 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:43.458922    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-216.ec2.internal_555b18a426b488b1398d4227fda6ee59/haproxy/0.log"
Jul 15 11:11:45.667443 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:45.667409    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 11:11:45.724900 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:45.724867    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qbkwp_1f06a99c-0c14-4fde-abcc-0b6cdf8bc447/konnectivity-agent/0.log" limit=1024
Jul 15 11:11:47.682317 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:47.682268    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b305a75f-5df4-4e51-936d-b7fe26b8273e/alertmanager/0.log"
Jul 15 11:11:47.713295 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:47.713273    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b305a75f-5df4-4e51-936d-b7fe26b8273e/config-reloader/0.log"
Jul 15 11:11:47.742149 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:47.742122    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b305a75f-5df4-4e51-936d-b7fe26b8273e/kube-rbac-proxy-web/0.log"
Jul 15 11:11:47.772688 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:47.772665    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b305a75f-5df4-4e51-936d-b7fe26b8273e/kube-rbac-proxy/0.log"
Jul 15 11:11:47.798128 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:47.798104    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b305a75f-5df4-4e51-936d-b7fe26b8273e/kube-rbac-proxy-metric/0.log"
Jul 15 11:11:47.826219 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:47.826195    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b305a75f-5df4-4e51-936d-b7fe26b8273e/prom-label-proxy/0.log"
Jul 15 11:11:47.854935 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:47.854916    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b305a75f-5df4-4e51-936d-b7fe26b8273e/init-config-reloader/0.log"
Jul 15 11:11:47.899461 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:47.899389    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-2x6fl_5bce2734-6aa0-48ce-b9e0-bf29dcd3ac3e/cluster-monitoring-operator/0.log"
Jul 15 11:11:47.932757 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:47.932730    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-zch97_2781bf89-0c22-473c-baf4-8a2b47cbe05f/kube-state-metrics/0.log"
Jul 15 11:11:47.957813 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:47.957787    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-zch97_2781bf89-0c22-473c-baf4-8a2b47cbe05f/kube-rbac-proxy-main/0.log"
Jul 15 11:11:47.984626 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:47.984594    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-zch97_2781bf89-0c22-473c-baf4-8a2b47cbe05f/kube-rbac-proxy-self/0.log"
Jul 15 11:11:48.021053 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:48.021028    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-584d8d9b95-kktf5_0fdd648a-0c7b-4aac-8980-2c7fb46e9b51/metrics-server/0.log"
Jul 15 11:11:48.088590 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:48.088564    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cqmh9_b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2/node-exporter/0.log"
Jul 15 11:11:48.114146 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:48.114119    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cqmh9_b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2/kube-rbac-proxy/0.log"
Jul 15 11:11:48.136234 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:48.136207    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cqmh9_b1fe65e3-3d9a-4f86-b2e0-8e4d24c96fe2/init-textfile/0.log"
Jul 15 11:11:48.390996 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:48.390966    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-g5jpg_a71211d6-6eb8-4a68-867d-8b3e21192d9c/kube-rbac-proxy-main/0.log"
Jul 15 11:11:48.420646 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:48.420620    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-g5jpg_a71211d6-6eb8-4a68-867d-8b3e21192d9c/kube-rbac-proxy-self/0.log"
Jul 15 11:11:48.446865 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:48.446838    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-g5jpg_a71211d6-6eb8-4a68-867d-8b3e21192d9c/openshift-state-metrics/0.log"
Jul 15 11:11:50.965455 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:50.965425    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8dcjj_8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9/console-operator/1.log"
Jul 15 11:11:50.969790 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:50.969760    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8dcjj_8e2cd50c-0fd4-4fbf-a0cf-38616f8207c9/console-operator/2.log"
Jul 15 11:11:51.466626 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:51.466594    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5594f684f6-lnhnh_503bc61a-f1b7-496f-a42b-2959eb478d1b/console/0.log"
Jul 15 11:11:51.506913 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:51.506881    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hxg7m/perf-node-gather-daemonset-c9jnv"]
Jul 15 11:11:51.507247 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:51.507235    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d17c0002-e2de-431d-aabb-535dba8a5b48" containerName="kube-rbac-proxy"
Jul 15 11:11:51.507293 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:51.507248    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d17c0002-e2de-431d-aabb-535dba8a5b48" containerName="kube-rbac-proxy"
Jul 15 11:11:51.507293 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:51.507266    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d17c0002-e2de-431d-aabb-535dba8a5b48" containerName="kserve-container"
Jul 15 11:11:51.507293 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:51.507272    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d17c0002-e2de-431d-aabb-535dba8a5b48" containerName="kserve-container"
Jul 15 11:11:51.507293 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:51.507284    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d17c0002-e2de-431d-aabb-535dba8a5b48" containerName="storage-initializer"
Jul 15 11:11:51.507293 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:51.507290    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d17c0002-e2de-431d-aabb-535dba8a5b48" containerName="storage-initializer"
Jul 15 11:11:51.507501 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:51.507358    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d17c0002-e2de-431d-aabb-535dba8a5b48" containerName="kserve-container"
Jul 15 11:11:51.507501 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:51.507366    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d17c0002-e2de-431d-aabb-535dba8a5b48" containerName="kube-rbac-proxy"
Jul 15 11:11:51.510440 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:51.510423    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hxg7m/perf-node-gather-daemonset-c9jnv"
Jul 15 11:11:51.513161 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:51.513140    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hxg7m\"/\"kube-root-ca.crt\""
Jul 15 11:11:51.513934 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:51.513918    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hxg7m\"/\"default-dockercfg-rkmnt\""
Jul 15 11:11:51.515350 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:51.515319    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hxg7m\"/\"openshift-service-ca.crt\""
Jul 15 11:11:51.523595 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:51.523531    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hxg7m/perf-node-gather-daemonset-c9jnv"]
Jul 15 11:11:51.620550 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:51.620514    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2597d65a-9ce2-48fa-a482-631e1125989a-sys\") pod \"perf-node-gather-daemonset-c9jnv\" (UID: \"2597d65a-9ce2-48fa-a482-631e1125989a\") " pod="openshift-must-gather-hxg7m/perf-node-gather-daemonset-c9jnv"
Jul 15 11:11:51.620740 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:51.620559    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2597d65a-9ce2-48fa-a482-631e1125989a-lib-modules\") pod \"perf-node-gather-daemonset-c9jnv\" (UID: \"2597d65a-9ce2-48fa-a482-631e1125989a\") " pod="openshift-must-gather-hxg7m/perf-node-gather-daemonset-c9jnv"
Jul 15 11:11:51.620740 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:51.620661    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2597d65a-9ce2-48fa-a482-631e1125989a-proc\") pod \"perf-node-gather-daemonset-c9jnv\" (UID: \"2597d65a-9ce2-48fa-a482-631e1125989a\") " pod="openshift-must-gather-hxg7m/perf-node-gather-daemonset-c9jnv"
Jul 15 11:11:51.620740 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:51.620694    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2597d65a-9ce2-48fa-a482-631e1125989a-podres\") pod \"perf-node-gather-daemonset-c9jnv\" (UID: \"2597d65a-9ce2-48fa-a482-631e1125989a\") " pod="openshift-must-gather-hxg7m/perf-node-gather-daemonset-c9jnv"
Jul 15 11:11:51.620850 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:51.620768    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v7mt\" (UniqueName: \"kubernetes.io/projected/2597d65a-9ce2-48fa-a482-631e1125989a-kube-api-access-8v7mt\") pod \"perf-node-gather-daemonset-c9jnv\" (UID: \"2597d65a-9ce2-48fa-a482-631e1125989a\") " pod="openshift-must-gather-hxg7m/perf-node-gather-daemonset-c9jnv"
Jul 15 11:11:51.721904 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:51.721812    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v7mt\" (UniqueName: \"kubernetes.io/projected/2597d65a-9ce2-48fa-a482-631e1125989a-kube-api-access-8v7mt\") pod \"perf-node-gather-daemonset-c9jnv\" (UID: \"2597d65a-9ce2-48fa-a482-631e1125989a\") " pod="openshift-must-gather-hxg7m/perf-node-gather-daemonset-c9jnv"
Jul 15 11:11:51.721904 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:51.721857    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2597d65a-9ce2-48fa-a482-631e1125989a-sys\") pod \"perf-node-gather-daemonset-c9jnv\" (UID: \"2597d65a-9ce2-48fa-a482-631e1125989a\") " pod="openshift-must-gather-hxg7m/perf-node-gather-daemonset-c9jnv"
Jul 15 11:11:51.721904 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:51.721876    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2597d65a-9ce2-48fa-a482-631e1125989a-lib-modules\") pod \"perf-node-gather-daemonset-c9jnv\" (UID: \"2597d65a-9ce2-48fa-a482-631e1125989a\") " pod="openshift-must-gather-hxg7m/perf-node-gather-daemonset-c9jnv"
Jul 15 11:11:51.722128 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:51.721931    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2597d65a-9ce2-48fa-a482-631e1125989a-proc\") pod \"perf-node-gather-daemonset-c9jnv\" (UID: \"2597d65a-9ce2-48fa-a482-631e1125989a\") " pod="openshift-must-gather-hxg7m/perf-node-gather-daemonset-c9jnv"
Jul 15 11:11:51.722128 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:51.721948    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2597d65a-9ce2-48fa-a482-631e1125989a-podres\") pod \"perf-node-gather-daemonset-c9jnv\" (UID: \"2597d65a-9ce2-48fa-a482-631e1125989a\") " pod="openshift-must-gather-hxg7m/perf-node-gather-daemonset-c9jnv"
Jul 15 11:11:51.722128 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:51.721952    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2597d65a-9ce2-48fa-a482-631e1125989a-sys\") pod \"perf-node-gather-daemonset-c9jnv\" (UID: \"2597d65a-9ce2-48fa-a482-631e1125989a\") " pod="openshift-must-gather-hxg7m/perf-node-gather-daemonset-c9jnv"
Jul 15 11:11:51.722128 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:51.722018    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2597d65a-9ce2-48fa-a482-631e1125989a-proc\") pod \"perf-node-gather-daemonset-c9jnv\" (UID: \"2597d65a-9ce2-48fa-a482-631e1125989a\") " pod="openshift-must-gather-hxg7m/perf-node-gather-daemonset-c9jnv"
Jul 15 11:11:51.722128 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:51.722077    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2597d65a-9ce2-48fa-a482-631e1125989a-podres\") pod \"perf-node-gather-daemonset-c9jnv\" (UID: \"2597d65a-9ce2-48fa-a482-631e1125989a\") " pod="openshift-must-gather-hxg7m/perf-node-gather-daemonset-c9jnv"
Jul 15 11:11:51.722128 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:51.722076    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2597d65a-9ce2-48fa-a482-631e1125989a-lib-modules\") pod \"perf-node-gather-daemonset-c9jnv\" (UID: \"2597d65a-9ce2-48fa-a482-631e1125989a\") " pod="openshift-must-gather-hxg7m/perf-node-gather-daemonset-c9jnv"
Jul 15 11:11:51.732369 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:51.732323    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v7mt\" (UniqueName: \"kubernetes.io/projected/2597d65a-9ce2-48fa-a482-631e1125989a-kube-api-access-8v7mt\") pod \"perf-node-gather-daemonset-c9jnv\" (UID: \"2597d65a-9ce2-48fa-a482-631e1125989a\") " pod="openshift-must-gather-hxg7m/perf-node-gather-daemonset-c9jnv"
Jul 15 11:11:51.821018 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:51.820982    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hxg7m/perf-node-gather-daemonset-c9jnv"
Jul 15 11:11:51.958205 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:51.958175    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hxg7m/perf-node-gather-daemonset-c9jnv"]
Jul 15 11:11:51.960404 ip-10-0-134-216 kubenswrapper[2565]: W0715 11:11:51.960372    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2597d65a_9ce2_48fa_a482_631e1125989a.slice/crio-88f5ae498ef06e08c2374d2efdcc3d468ff4d2ad202c0ec9f51d7ee7c2393410 WatchSource:0}: Error finding container 88f5ae498ef06e08c2374d2efdcc3d468ff4d2ad202c0ec9f51d7ee7c2393410: Status 404 returned error can't find the container with id 88f5ae498ef06e08c2374d2efdcc3d468ff4d2ad202c0ec9f51d7ee7c2393410
Jul 15 11:11:52.100854 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:52.100831    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-49ndh_987f29db-b67d-4cbc-84c6-9e407aa031bc/volume-data-source-validator/0.log"
Jul 15 11:11:52.632167 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:52.632131    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hxg7m/perf-node-gather-daemonset-c9jnv" event={"ID":"2597d65a-9ce2-48fa-a482-631e1125989a","Type":"ContainerStarted","Data":"d7c3f115ca738eb7784d773b5713230c95077f9232618ca970e2d115e93a3647"}
Jul 15 11:11:52.632378 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:52.632185    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hxg7m/perf-node-gather-daemonset-c9jnv" event={"ID":"2597d65a-9ce2-48fa-a482-631e1125989a","Type":"ContainerStarted","Data":"88f5ae498ef06e08c2374d2efdcc3d468ff4d2ad202c0ec9f51d7ee7c2393410"}
Jul 15 11:11:52.632378 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:52.632205    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hxg7m/perf-node-gather-daemonset-c9jnv"
Jul 15 11:11:52.654152 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:52.654097    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hxg7m/perf-node-gather-daemonset-c9jnv" podStartSLOduration=1.654080241 podStartE2EDuration="1.654080241s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 11:11:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 11:11:52.651481995 +0000 UTC m=+1610.260018016" watchObservedRunningTime="2026-07-15 11:11:52.654080241 +0000 UTC m=+1610.262616262"
Jul 15 11:11:52.985963 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:52.985888    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5xbp6_cfc5835e-29ae-4048-bf6f-d1685d6ec89c/dns/0.log"
Jul 15 11:11:53.009450 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:53.009427    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5xbp6_cfc5835e-29ae-4048-bf6f-d1685d6ec89c/kube-rbac-proxy/0.log"
Jul 15 11:11:53.182203 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:53.182179    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ww2zd_94259076-1de7-4312-a19a-5760311ec791/dns-node-resolver/0.log"
Jul 15 11:11:53.669946 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:53.669918    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fqz5r_e512c0b0-fbba-491f-8024-0243b8f12f54/node-ca/0.log"
Jul 15 11:11:54.564868 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:54.564836    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-9984c7d94-5kjkb_725cfee7-4a3b-424f-9412-ff710b7218e3/router/0.log"
Jul 15 11:11:54.934023 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:54.933943    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-htj8h_55c9eec3-1148-4ea6-8e77-1e1dcb085d3f/serve-healthcheck-canary/0.log"
Jul 15 11:11:55.314183 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:55.314148    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-g9swl_63270ef2-9f47-4772-9807-6c7fb426005b/insights-operator/0.log"
Jul 15 11:11:55.314755 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:55.314739    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-g9swl_63270ef2-9f47-4772-9807-6c7fb426005b/insights-operator/1.log"
Jul 15 11:11:55.482995 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:55.482967    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bqw5l_da96848b-337e-4448-9275-3ea664ebdec8/kube-rbac-proxy/0.log"
Jul 15 11:11:55.504174 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:55.504150    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bqw5l_da96848b-337e-4448-9275-3ea664ebdec8/exporter/0.log"
Jul 15 11:11:55.525783 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:55.525762    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bqw5l_da96848b-337e-4448-9275-3ea664ebdec8/extractor/0.log"
Jul 15 11:11:57.619186 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:57.619159    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-fd65d7d6-xd64c_73849c75-1bbb-40f9-aa81-48cbccc58a47/server/0.log"
Jul 15 11:11:57.880208 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:57.880134    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-2k72z_086acc9e-3cf4-4d6d-a796-016489dfb974/seaweedfs/0.log"
Jul 15 11:11:57.902081 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:57.902054    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-tls-custom-8b44d767d-xdznt_df83f298-00e3-494d-b2f9-3d099356ea46/seaweedfs-tls-custom/0.log"
Jul 15 11:11:57.922829 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:57.922807    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-tls-serving-67b7477c6d-s2tkh_c1edc632-eee9-4cae-8bd7-3b5d5706fdcf/seaweedfs-tls-serving/0.log"
Jul 15 11:11:58.647232 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:11:58.647206    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hxg7m/perf-node-gather-daemonset-c9jnv"
Jul 15 11:12:02.356612 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:12:02.356571    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-n7jtx_7dcd6c11-9e60-45e9-9d89-dae4e2594c7f/kube-storage-version-migrator-operator/1.log"
Jul 15 11:12:02.357800 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:12:02.357772    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-n7jtx_7dcd6c11-9e60-45e9-9d89-dae4e2594c7f/kube-storage-version-migrator-operator/0.log"
Jul 15 11:12:03.803194 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:12:03.803163    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tktcw_6334daaf-6478-49ab-a989-ce254cc9a0d0/kube-multus-additional-cni-plugins/0.log"
Jul 15 11:12:03.828792 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:12:03.828765    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tktcw_6334daaf-6478-49ab-a989-ce254cc9a0d0/egress-router-binary-copy/0.log"
Jul 15 11:12:03.854536 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:12:03.854492    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tktcw_6334daaf-6478-49ab-a989-ce254cc9a0d0/cni-plugins/0.log"
Jul 15 11:12:03.882644 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:12:03.882614    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tktcw_6334daaf-6478-49ab-a989-ce254cc9a0d0/bond-cni-plugin/0.log"
Jul 15 11:12:03.905696 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:12:03.905671    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tktcw_6334daaf-6478-49ab-a989-ce254cc9a0d0/routeoverride-cni/0.log"
Jul 15 11:12:03.931962 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:12:03.931929    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tktcw_6334daaf-6478-49ab-a989-ce254cc9a0d0/whereabouts-cni-bincopy/0.log"
Jul 15 11:12:03.955975 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:12:03.955943    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tktcw_6334daaf-6478-49ab-a989-ce254cc9a0d0/whereabouts-cni/0.log"
Jul 15 11:12:04.078352 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:12:04.078244    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v9wb9_12698506-aebe-4df1-aecc-e7d7d7aef8ec/kube-multus/0.log"
Jul 15 11:12:04.150541 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:12:04.150497    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-c4bht_f16a7597-8022-437b-a82b-ab187296ecdf/network-metrics-daemon/0.log"
Jul 15 11:12:04.173924 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:12:04.173876    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-c4bht_f16a7597-8022-437b-a82b-ab187296ecdf/kube-rbac-proxy/0.log"
Jul 15 11:12:05.401238 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:12:05.401188    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qsch8_f3b175c1-34f8-4e74-bce6-f866e4bd25b0/ovn-controller/0.log"
Jul 15 11:12:05.425108 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:12:05.425081    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qsch8_f3b175c1-34f8-4e74-bce6-f866e4bd25b0/ovn-acl-logging/0.log"
Jul 15 11:12:05.425108 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:12:05.425102    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qsch8_f3b175c1-34f8-4e74-bce6-f866e4bd25b0/ovn-acl-logging/1.log"
Jul 15 11:12:05.444639 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:12:05.444601    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qsch8_f3b175c1-34f8-4e74-bce6-f866e4bd25b0/kube-rbac-proxy-node/0.log"
Jul 15 11:12:05.465856 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:12:05.465832    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qsch8_f3b175c1-34f8-4e74-bce6-f866e4bd25b0/kube-rbac-proxy-ovn-metrics/0.log"
Jul 15 11:12:05.489801 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:12:05.489770    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qsch8_f3b175c1-34f8-4e74-bce6-f866e4bd25b0/northd/0.log"
Jul 15 11:12:05.513230 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:12:05.513194    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qsch8_f3b175c1-34f8-4e74-bce6-f866e4bd25b0/nbdb/0.log"
Jul 15 11:12:05.535610 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:12:05.535573    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qsch8_f3b175c1-34f8-4e74-bce6-f866e4bd25b0/sbdb/0.log"
Jul 15 11:12:05.579972 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:12:05.579926    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qsch8_f3b175c1-34f8-4e74-bce6-f866e4bd25b0/ovnkube-controller/0.log"
Jul 15 11:12:06.625626 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:12:06.625603    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-5zwx4_e2a51efd-e7a8-4db0-8ded-c90e680619c8/network-check-target-container/0.log"
Jul 15 11:12:07.620859 ip-10-0-134-216 kubenswrapper[2565]: I0715 11:12:07.620829    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-776nq_66820680-27f1-431d-aa6e-d2d0e4a10f15/iptables-alerter/0.log"