Jul 06 02:39:06.232289 ip-10-0-131-238 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 02:39:07.029326 ip-10-0-131-238 kubenswrapper[2570]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 02:39:07.029326 ip-10-0-131-238 kubenswrapper[2570]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 02:39:07.029326 ip-10-0-131-238 kubenswrapper[2570]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 02:39:07.029830 ip-10-0-131-238 kubenswrapper[2570]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 02:39:07.029830 ip-10-0-131-238 kubenswrapper[2570]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 02:39:07.030186 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.030076    2570 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 02:39:07.035297 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035282    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 02:39:07.035297 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035297    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 02:39:07.035355 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035301    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 02:39:07.035355 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035304    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 02:39:07.035355 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035307    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 02:39:07.035355 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035310    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 02:39:07.035355 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035313    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 02:39:07.035355 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035316    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 02:39:07.035355 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035325    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 02:39:07.035355 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035328    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 02:39:07.035355 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035331    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 02:39:07.035355 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035334    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 02:39:07.035355 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035336    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 02:39:07.035355 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035339    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 02:39:07.035355 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035343    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 02:39:07.035355 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035346    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 02:39:07.035355 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035349    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 02:39:07.035355 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035351    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 02:39:07.035355 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035354    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 02:39:07.035355 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035357    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 02:39:07.035355 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035360    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 02:39:07.035355 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035363    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 02:39:07.035806 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035366    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 02:39:07.035806 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035369    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 02:39:07.035806 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035372    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 02:39:07.035806 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035374    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 02:39:07.035806 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035376    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 02:39:07.035806 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035379    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 02:39:07.035806 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035381    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 02:39:07.035806 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035384    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 02:39:07.035806 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035386    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 02:39:07.035806 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035389    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 02:39:07.035806 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035393    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 02:39:07.035806 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035397    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 02:39:07.035806 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035400    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 02:39:07.035806 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035402    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 02:39:07.035806 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035405    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 02:39:07.035806 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035408    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 02:39:07.035806 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035410    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 02:39:07.035806 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035413    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 02:39:07.035806 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035415    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 02:39:07.036311 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035417    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 02:39:07.036311 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035420    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 02:39:07.036311 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035422    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 02:39:07.036311 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035425    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 02:39:07.036311 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035427    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 02:39:07.036311 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035430    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 02:39:07.036311 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035432    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 02:39:07.036311 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035434    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 02:39:07.036311 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035437    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 02:39:07.036311 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035439    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 02:39:07.036311 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035442    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 02:39:07.036311 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035453    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 02:39:07.036311 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035456    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 02:39:07.036311 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035458    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 02:39:07.036311 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035462    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 02:39:07.036311 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035465    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 02:39:07.036311 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035467    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 02:39:07.036311 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035470    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 02:39:07.036311 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035473    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 02:39:07.036311 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035475    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 02:39:07.036776 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035478    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 02:39:07.036776 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035480    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 02:39:07.036776 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035483    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 02:39:07.036776 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035486    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 02:39:07.036776 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035488    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 02:39:07.036776 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035490    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 02:39:07.036776 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035493    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 02:39:07.036776 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035496    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 02:39:07.036776 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035498    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 02:39:07.036776 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035501    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 02:39:07.036776 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035504    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 02:39:07.036776 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035506    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 02:39:07.036776 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035509    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 02:39:07.036776 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035511    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 02:39:07.036776 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035513    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 02:39:07.036776 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035516    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 02:39:07.036776 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035518    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 02:39:07.036776 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035521    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 02:39:07.036776 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035523    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 02:39:07.036776 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035526    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 02:39:07.037261 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035529    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 02:39:07.037261 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035531    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 02:39:07.037261 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035533    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 02:39:07.037261 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035536    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 02:39:07.037261 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035540    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 02:39:07.037261 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035543    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 02:39:07.037261 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035547    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 02:39:07.037261 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035550    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 02:39:07.037261 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035553    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 02:39:07.037261 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035558    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 02:39:07.037261 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035561    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 02:39:07.037261 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035564    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 02:39:07.037261 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035567    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 02:39:07.037261 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035570    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 02:39:07.037261 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035573    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 02:39:07.037261 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035575    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 02:39:07.037261 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035578    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 02:39:07.037261 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.035581    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 02:39:07.037261 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036302    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 02:39:07.037698 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036309    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 02:39:07.037698 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036312    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 02:39:07.037698 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036315    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 02:39:07.037698 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036318    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 02:39:07.037698 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036322    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 02:39:07.037698 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036325    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 02:39:07.037698 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036328    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 02:39:07.037698 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036331    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 02:39:07.037698 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036333    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 02:39:07.037698 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036336    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 02:39:07.037698 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036338    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 02:39:07.037698 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036341    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 02:39:07.037698 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036343    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 02:39:07.037698 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036346    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 02:39:07.037698 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036348    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 02:39:07.037698 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036351    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 02:39:07.037698 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036353    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 02:39:07.037698 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036356    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 02:39:07.037698 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036359    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 02:39:07.037698 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036363    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 02:39:07.038203 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036366    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 02:39:07.038203 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036369    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 02:39:07.038203 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036372    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 02:39:07.038203 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036374    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 02:39:07.038203 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036377    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 02:39:07.038203 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036380    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 02:39:07.038203 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036382    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 02:39:07.038203 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036385    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 02:39:07.038203 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036387    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 02:39:07.038203 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036390    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 02:39:07.038203 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036392    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 02:39:07.038203 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036396    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 02:39:07.038203 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036400    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 02:39:07.038203 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036403    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 02:39:07.038203 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036405    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 02:39:07.038203 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036408    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 02:39:07.038203 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036411    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 02:39:07.038203 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036414    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 02:39:07.038203 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036417    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 02:39:07.038646 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036419    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 02:39:07.038646 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036422    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 02:39:07.038646 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036425    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 02:39:07.038646 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036427    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 02:39:07.038646 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036430    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 02:39:07.038646 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036432    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 02:39:07.038646 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036435    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 02:39:07.038646 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036438    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 02:39:07.038646 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036441    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 02:39:07.038646 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036444    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 02:39:07.038646 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036446    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 02:39:07.038646 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036449    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 02:39:07.038646 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036453    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 02:39:07.038646 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036457    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 02:39:07.038646 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036460    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 02:39:07.038646 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036463    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 02:39:07.038646 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036465    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 02:39:07.038646 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036468    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 02:39:07.038646 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036470    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 02:39:07.039104 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036473    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 02:39:07.039104 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036476    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 02:39:07.039104 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036478    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 02:39:07.039104 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036480    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 02:39:07.039104 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036483    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 02:39:07.039104 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036486    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 02:39:07.039104 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036488    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 02:39:07.039104 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036490    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 02:39:07.039104 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036493    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 02:39:07.039104 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036495    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 02:39:07.039104 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036498    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 02:39:07.039104 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036501    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 02:39:07.039104 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036505    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 02:39:07.039104 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036509    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 02:39:07.039104 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036512    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 02:39:07.039104 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036515    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 02:39:07.039104 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036518    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 02:39:07.039104 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036520    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 02:39:07.039104 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036523    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 02:39:07.039551 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036525    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 02:39:07.039551 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036528    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 02:39:07.039551 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036532    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 02:39:07.039551 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036534    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 02:39:07.039551 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036537    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 02:39:07.039551 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036540    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 02:39:07.039551 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036542    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 02:39:07.039551 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036545    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 02:39:07.039551 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036547    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 02:39:07.039551 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036550    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 02:39:07.039551 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036553    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 02:39:07.039551 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036555    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 02:39:07.039551 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036558    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 02:39:07.039551 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036561    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 02:39:07.039551 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036563    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 02:39:07.039551 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036565    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 02:39:07.039551 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036568    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 02:39:07.039551 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036570    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 02:39:07.039551 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036573    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 02:39:07.039551 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036575    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 02:39:07.040031 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036578    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 02:39:07.040031 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036936    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 02:39:07.040031 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036940    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 02:39:07.040031 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036944    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 02:39:07.040031 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036949    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 02:39:07.040031 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036952    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 02:39:07.040031 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036955    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 02:39:07.040031 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036957    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 02:39:07.040031 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036960    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 02:39:07.040031 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036963    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 02:39:07.040031 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036969    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 02:39:07.040031 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036972    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 02:39:07.040031 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036974    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 02:39:07.040031 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036977    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 02:39:07.040031 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036994    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 02:39:07.040031 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.036997    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 02:39:07.040031 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037000    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 02:39:07.040031 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037003    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 02:39:07.040031 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037005    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 02:39:07.040483 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037008    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 02:39:07.040483 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037012    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 02:39:07.040483 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037016    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 02:39:07.040483 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037019    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 02:39:07.040483 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037021    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 02:39:07.040483 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037025    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 02:39:07.040483 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037027    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 02:39:07.040483 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037030    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 02:39:07.040483 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037033    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 02:39:07.040483 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037036    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 02:39:07.040483 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037039    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 02:39:07.040483 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037042    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 02:39:07.040483 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037044    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 02:39:07.040483 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037047    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 02:39:07.040483 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037050    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 02:39:07.040483 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037052    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 02:39:07.040483 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037055    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 02:39:07.040483 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037057    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 02:39:07.040483 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037060    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 02:39:07.040964 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037064    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 02:39:07.040964 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037067    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 02:39:07.040964 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037070    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 02:39:07.040964 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037072    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 02:39:07.040964 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037077    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 02:39:07.040964 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037081    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 02:39:07.040964 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037084    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 02:39:07.040964 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037087    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 02:39:07.040964 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037089    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 02:39:07.040964 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037092    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 02:39:07.040964 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037095    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 02:39:07.040964 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037098    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 02:39:07.040964 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037100    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 02:39:07.040964 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037103    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 02:39:07.040964 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037105    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 02:39:07.040964 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037108    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 02:39:07.040964 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037110    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 02:39:07.040964 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037113    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 02:39:07.040964 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037115    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 02:39:07.040964 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037117    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 02:39:07.041449 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037119    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 02:39:07.041449 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037122    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 02:39:07.041449 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037124    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 02:39:07.041449 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037127    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 02:39:07.041449 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037129    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 02:39:07.041449 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037132    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 02:39:07.041449 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037134    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 02:39:07.041449 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037137    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 02:39:07.041449 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037140    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 02:39:07.041449 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037142    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 02:39:07.041449 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037145    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 02:39:07.041449 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037147    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 02:39:07.041449 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037152    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 02:39:07.041449 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037155    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 02:39:07.041449 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037157    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 02:39:07.041449 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037159    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 02:39:07.041449 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037164    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 02:39:07.041449 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037167    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 02:39:07.041449 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037170    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 02:39:07.041449 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037172    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 02:39:07.041917 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037174    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 02:39:07.041917 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037177    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 02:39:07.041917 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037179    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 02:39:07.041917 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037182    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 02:39:07.041917 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037184    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 02:39:07.041917 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037187    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 02:39:07.041917 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037189    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 02:39:07.041917 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037192    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 02:39:07.041917 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037194    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 02:39:07.041917 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037197    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 02:39:07.041917 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037200    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 02:39:07.041917 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037202    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 02:39:07.041917 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037204    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 02:39:07.041917 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037207    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 02:39:07.041917 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037209    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 02:39:07.041917 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037212    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 02:39:07.041917 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037214    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 02:39:07.041917 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037216    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 02:39:07.041917 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037219    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 02:39:07.041917 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037221    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 02:39:07.042418 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037224    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 02:39:07.042418 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037226    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 02:39:07.042418 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037297    2570 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 02:39:07.042418 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037304    2570 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 02:39:07.042418 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037312    2570 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 02:39:07.042418 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037318    2570 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 02:39:07.042418 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037322    2570 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 02:39:07.042418 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037325    2570 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 02:39:07.042418 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037330    2570 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 02:39:07.042418 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037334    2570 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 02:39:07.042418 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037337    2570 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 02:39:07.042418 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037341    2570 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 02:39:07.042418 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037344    2570 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 02:39:07.042418 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037347    2570 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 02:39:07.042418 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037350    2570 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 02:39:07.042418 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037353    2570 flags.go:64] FLAG: --cgroup-root=""
Jul 06 02:39:07.042418 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037356    2570 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 02:39:07.042418 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037359    2570 flags.go:64] FLAG: --client-ca-file=""
Jul 06 02:39:07.042418 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037362    2570 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 02:39:07.042418 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037364    2570 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 02:39:07.042418 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037368    2570 flags.go:64] FLAG: --cluster-domain=""
Jul 06 02:39:07.042418 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037371    2570 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 02:39:07.042418 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037374    2570 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 02:39:07.042418 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037377    2570 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 02:39:07.042975 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037380    2570 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 02:39:07.042975 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037384    2570 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 02:39:07.042975 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037387    2570 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 02:39:07.042975 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037390    2570 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 02:39:07.042975 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037393    2570 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 02:39:07.042975 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037396    2570 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 02:39:07.042975 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037399    2570 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 02:39:07.042975 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037401    2570 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 02:39:07.042975 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037405    2570 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 02:39:07.042975 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037407    2570 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 02:39:07.042975 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037412    2570 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 02:39:07.042975 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037415    2570 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 02:39:07.042975 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037419    2570 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 02:39:07.042975 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037422    2570 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 02:39:07.042975 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037426    2570 flags.go:64] FLAG: --enable-server="true"
Jul 06 02:39:07.042975 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037429    2570 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 02:39:07.042975 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037434    2570 flags.go:64] FLAG: --event-burst="100"
Jul 06 02:39:07.042975 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037438    2570 flags.go:64] FLAG: --event-qps="50"
Jul 06 02:39:07.042975 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037441    2570 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 02:39:07.042975 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037444    2570 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 02:39:07.042975 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037447    2570 flags.go:64] FLAG: --eviction-hard=""
Jul 06 02:39:07.042975 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037450    2570 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 02:39:07.042975 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037453    2570 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 02:39:07.042975 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037456    2570 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 02:39:07.042975 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037459    2570 flags.go:64] FLAG: --eviction-soft=""
Jul 06 02:39:07.043549 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037462    2570 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 02:39:07.043549 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037464    2570 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 02:39:07.043549 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037467    2570 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 02:39:07.043549 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037470    2570 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 02:39:07.043549 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037473    2570 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 02:39:07.043549 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037476    2570 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 02:39:07.043549 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037478    2570 flags.go:64] FLAG: --feature-gates=""
Jul 06 02:39:07.043549 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037485    2570 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 02:39:07.043549 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037488    2570 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 02:39:07.043549 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037491    2570 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 02:39:07.043549 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037494    2570 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 02:39:07.043549 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037497    2570 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 02:39:07.043549 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037499    2570 flags.go:64] FLAG: --help="false"
Jul 06 02:39:07.043549 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037502    2570 flags.go:64] FLAG: --hostname-override="ip-10-0-131-238.ec2.internal"
Jul 06 02:39:07.043549 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037505    2570 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 02:39:07.043549 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037508    2570 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 02:39:07.043549 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037511    2570 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 02:39:07.043549 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037514    2570 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 02:39:07.043549 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037518    2570 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 02:39:07.043549 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037522    2570 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 02:39:07.043549 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037525    2570 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 02:39:07.043549 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037528    2570 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 02:39:07.043549 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037531    2570 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 02:39:07.044159 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037535    2570 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 02:39:07.044159 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037538    2570 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 02:39:07.044159 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037541    2570 flags.go:64] FLAG: --kube-reserved=""
Jul 06 02:39:07.044159 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037544    2570 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 02:39:07.044159 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037547    2570 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 02:39:07.044159 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037550    2570 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 02:39:07.044159 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037552    2570 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 02:39:07.044159 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037555    2570 flags.go:64] FLAG: --lock-file=""
Jul 06 02:39:07.044159 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037558    2570 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 02:39:07.044159 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037561    2570 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 02:39:07.044159 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037564    2570 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 02:39:07.044159 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037569    2570 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 02:39:07.044159 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037571    2570 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 02:39:07.044159 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037574    2570 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 02:39:07.044159 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037577    2570 flags.go:64] FLAG: --logging-format="text"
Jul 06 02:39:07.044159 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037580    2570 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 02:39:07.044159 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037583    2570 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 02:39:07.044159 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037586    2570 flags.go:64] FLAG: --manifest-url=""
Jul 06 02:39:07.044159 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037589    2570 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 02:39:07.044159 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037593    2570 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 02:39:07.044159 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037596    2570 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 02:39:07.044159 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037600    2570 flags.go:64] FLAG: --max-pods="110"
Jul 06 02:39:07.044159 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037603    2570 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 02:39:07.044159 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037606    2570 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 02:39:07.044159 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037609    2570 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 02:39:07.044875 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037611    2570 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 02:39:07.044875 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037614    2570 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 02:39:07.044875 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037617    2570 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 02:39:07.044875 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037621    2570 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 02:39:07.044875 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037628    2570 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 02:39:07.044875 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037631    2570 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 02:39:07.044875 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037634    2570 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 02:39:07.044875 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037639    2570 flags.go:64] FLAG: --pod-cidr=""
Jul 06 02:39:07.044875 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037642    2570 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 02:39:07.044875 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037648    2570 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 02:39:07.044875 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037650    2570 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 02:39:07.044875 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037654    2570 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 02:39:07.044875 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037657    2570 flags.go:64] FLAG: --port="10250"
Jul 06 02:39:07.044875 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037659    2570 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 02:39:07.044875 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037662    2570 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00f65548d7e934c0d"
Jul 06 02:39:07.044875 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037665    2570 flags.go:64] FLAG: --qos-reserved=""
Jul 06 02:39:07.044875 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037668    2570 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 02:39:07.044875 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037671    2570 flags.go:64] FLAG: --register-node="true"
Jul 06 02:39:07.044875 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037673    2570 flags.go:64] FLAG: --register-with-taints=""
Jul 06 02:39:07.044875 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037677    2570 flags.go:64] FLAG: --registry-burst="10"
Jul 06 02:39:07.044875 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037680    2570 flags.go:64] FLAG: --registry-qps="5"
Jul 06 02:39:07.044875 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037682    2570 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 02:39:07.044875 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037685    2570 flags.go:64] FLAG: --reserved-memory=""
Jul 06 02:39:07.044875 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037688    2570 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 02:39:07.044875 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037691    2570 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 02:39:07.045892 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037694    2570 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 02:39:07.045892 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037697    2570 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 02:39:07.045892 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037699    2570 flags.go:64] FLAG: --runonce="false"
Jul 06 02:39:07.045892 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037702    2570 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 02:39:07.045892 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037705    2570 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 02:39:07.045892 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037708    2570 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 02:39:07.045892 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037711    2570 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 02:39:07.045892 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037714    2570 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 02:39:07.045892 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037717    2570 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 02:39:07.045892 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037720    2570 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 02:39:07.045892 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037724    2570 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 02:39:07.045892 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037727    2570 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 02:39:07.045892 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037730    2570 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 02:39:07.045892 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037733    2570 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 02:39:07.045892 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037735    2570 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 02:39:07.045892 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037741    2570 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 02:39:07.045892 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037744    2570 flags.go:64] FLAG: --system-cgroups=""
Jul 06 02:39:07.045892 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037747    2570 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 02:39:07.045892 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037752    2570 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 02:39:07.045892 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037755    2570 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 02:39:07.045892 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037758    2570 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 02:39:07.045892 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037762    2570 flags.go:64] FLAG: --tls-min-version=""
Jul 06 02:39:07.045892 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037764    2570 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 02:39:07.045892 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037767    2570 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 02:39:07.045892 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037770    2570 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 02:39:07.046971 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037773    2570 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 02:39:07.046971 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037776    2570 flags.go:64] FLAG: --v="2"
Jul 06 02:39:07.046971 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037780    2570 flags.go:64] FLAG: --version="false"
Jul 06 02:39:07.046971 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037784    2570 flags.go:64] FLAG: --vmodule=""
Jul 06 02:39:07.046971 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037788    2570 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 02:39:07.046971 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.037791    2570 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 02:39:07.046971 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037919    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 02:39:07.046971 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037925    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 02:39:07.046971 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037928    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 02:39:07.046971 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037930    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 02:39:07.046971 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037933    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 02:39:07.046971 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037935    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 02:39:07.046971 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037938    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 02:39:07.046971 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037941    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 02:39:07.046971 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037944    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 02:39:07.046971 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037946    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 02:39:07.046971 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037949    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 02:39:07.046971 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037953    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 02:39:07.046971 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037956    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 02:39:07.046971 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037959    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 02:39:07.046971 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037961    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 02:39:07.047546 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037964    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 02:39:07.047546 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037968    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 02:39:07.047546 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037976    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 02:39:07.047546 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037992    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 02:39:07.047546 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037995    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 02:39:07.047546 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.037997    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 02:39:07.047546 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038000    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 02:39:07.047546 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038002    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 02:39:07.047546 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038006    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 02:39:07.047546 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038008    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 02:39:07.047546 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038011    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 02:39:07.047546 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038013    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 02:39:07.047546 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038016    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 02:39:07.047546 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038018    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 02:39:07.047546 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038021    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 02:39:07.047546 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038023    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 02:39:07.047546 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038026    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 02:39:07.047546 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038029    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 02:39:07.047546 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038031    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 02:39:07.047546 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038034    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 02:39:07.048084 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038036    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 02:39:07.048084 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038039    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 02:39:07.048084 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038041    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 02:39:07.048084 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038046    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 02:39:07.048084 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038050    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 02:39:07.048084 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038053    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 02:39:07.048084 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038055    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 02:39:07.048084 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038058    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 02:39:07.048084 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038062    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 02:39:07.048084 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038065    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 02:39:07.048084 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038068    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 02:39:07.048084 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038070    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 02:39:07.048084 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038073    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 02:39:07.048084 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038077    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 02:39:07.048084 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038080    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 02:39:07.048084 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038088    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 02:39:07.048084 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038090    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 02:39:07.048084 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038094    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 02:39:07.048084 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038097    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 02:39:07.048084 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038101    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 02:39:07.048604 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038104    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 02:39:07.048604 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038107    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 02:39:07.048604 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038109    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 02:39:07.048604 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038112    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 02:39:07.048604 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038114    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 02:39:07.048604 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038117    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 02:39:07.048604 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038120    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 02:39:07.048604 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038122    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 02:39:07.048604 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038125    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 02:39:07.048604 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038127    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 02:39:07.048604 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038130    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 02:39:07.048604 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038133    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 02:39:07.048604 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038135    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 02:39:07.048604 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038138    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 02:39:07.048604 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038140    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 02:39:07.048604 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038143    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 02:39:07.048604 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038145    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 02:39:07.048604 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038148    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 02:39:07.048604 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038150    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 02:39:07.049150 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038153    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 02:39:07.049150 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038157    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 02:39:07.049150 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038160    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 02:39:07.049150 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038163    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 02:39:07.049150 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038167    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 02:39:07.049150 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038170    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 02:39:07.049150 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038174    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 02:39:07.049150 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038176    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 02:39:07.049150 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038179    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 02:39:07.049150 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038187    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 02:39:07.049150 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038190    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 02:39:07.049150 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038192    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 02:39:07.049150 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038195    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 02:39:07.049150 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038197    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 02:39:07.049150 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038200    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 02:39:07.049150 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038202    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 02:39:07.049150 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038205    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 02:39:07.049150 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038208    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 02:39:07.049150 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038211    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 02:39:07.049150 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038214    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 02:39:07.049655 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038216    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 02:39:07.049655 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038219    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 02:39:07.049655 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038222    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 02:39:07.049655 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038224    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 02:39:07.049655 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.038227    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 02:39:07.049655 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.038232    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 02:39:07.049655 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.046860    2570 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 02:39:07.049655 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.046876    2570 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 02:39:07.049655 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.047668    2570 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 02:39:07.049655 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.047677    2570 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 02:39:07.049655 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047740    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 02:39:07.049655 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047746    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 02:39:07.049655 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047749    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 02:39:07.049655 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047753    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 02:39:07.049655 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047756    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 02:39:07.050116 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047759    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 02:39:07.050116 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047763    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 02:39:07.050116 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047766    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 02:39:07.050116 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047769    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 02:39:07.050116 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047772    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 02:39:07.050116 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047775    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 02:39:07.050116 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047778    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 02:39:07.050116 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047781    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 02:39:07.050116 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047784    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 02:39:07.050116 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047786    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 02:39:07.050116 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047789    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 02:39:07.050116 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047792    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 02:39:07.050116 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047795    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 02:39:07.050116 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047798    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 02:39:07.050116 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047801    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 02:39:07.050116 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047804    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 02:39:07.050116 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047807    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 02:39:07.050116 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047809    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 02:39:07.050116 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047813    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 02:39:07.050116 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047816    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 02:39:07.050638 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047819    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 02:39:07.050638 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047824    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 02:39:07.050638 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047828    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 02:39:07.050638 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047832    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 02:39:07.050638 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047836    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 02:39:07.050638 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047839    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 02:39:07.050638 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047843    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 02:39:07.050638 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047846    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 02:39:07.050638 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047850    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 02:39:07.050638 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047852    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 02:39:07.050638 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047855    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 02:39:07.050638 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047858    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 02:39:07.050638 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047861    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 02:39:07.050638 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047864    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 02:39:07.050638 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047867    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 02:39:07.050638 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047869    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 02:39:07.050638 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047873    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 02:39:07.050638 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047875    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 02:39:07.050638 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047878    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 02:39:07.051187 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047881    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 02:39:07.051187 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047884    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 02:39:07.051187 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047887    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 02:39:07.051187 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047891    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 02:39:07.051187 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047894    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 02:39:07.051187 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047896    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 02:39:07.051187 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047899    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 02:39:07.051187 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047902    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 02:39:07.051187 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047905    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 02:39:07.051187 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047907    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 02:39:07.051187 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047912    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 02:39:07.051187 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047915    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 02:39:07.051187 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047918    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 02:39:07.051187 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047921    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 02:39:07.051187 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047924    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 02:39:07.051187 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047927    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 02:39:07.051187 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047930    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 02:39:07.051187 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047934    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 02:39:07.051187 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047937    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 02:39:07.051187 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047941    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 02:39:07.051712 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047944    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 02:39:07.051712 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047949    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 02:39:07.051712 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047952    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 02:39:07.051712 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047955    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 02:39:07.051712 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047958    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 02:39:07.051712 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047961    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 02:39:07.051712 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047965    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 02:39:07.051712 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047968    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 02:39:07.051712 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047971    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 02:39:07.051712 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047974    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 02:39:07.051712 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047977    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 02:39:07.051712 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047980    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 02:39:07.051712 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047983    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 02:39:07.051712 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047986    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 02:39:07.051712 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047989    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 02:39:07.051712 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047993    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 02:39:07.051712 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047996    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 02:39:07.051712 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.047999    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 02:39:07.051712 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048002    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 02:39:07.052227 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048005    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 02:39:07.052227 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048019    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 02:39:07.052227 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048022    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 02:39:07.052227 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048025    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 02:39:07.052227 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048028    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 02:39:07.052227 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048030    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 02:39:07.052227 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048033    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 02:39:07.052227 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048036    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 02:39:07.052227 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048039    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 02:39:07.052227 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048041    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 02:39:07.052227 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048044    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 02:39:07.052227 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048047    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 02:39:07.052227 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048050    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 02:39:07.052227 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048053    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 02:39:07.052227 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048056    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 02:39:07.052227 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048061    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 02:39:07.052653 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.048070    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 02:39:07.052653 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048195    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 02:39:07.052653 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048200    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 02:39:07.052653 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048204    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 02:39:07.052653 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048207    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 02:39:07.052653 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048210    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 02:39:07.052653 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048213    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 02:39:07.052653 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048217    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 02:39:07.052653 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048220    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 02:39:07.052653 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048223    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 02:39:07.052653 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048225    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 02:39:07.052653 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048228    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 02:39:07.052653 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048231    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 02:39:07.052653 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048234    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 02:39:07.052653 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048237    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 02:39:07.052653 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048240    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 02:39:07.053099 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048243    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 02:39:07.053099 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048246    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 02:39:07.053099 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048248    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 02:39:07.053099 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048251    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 02:39:07.053099 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048254    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 02:39:07.053099 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048257    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 02:39:07.053099 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048260    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 02:39:07.053099 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048264    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 02:39:07.053099 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048269    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 02:39:07.053099 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048272    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 02:39:07.053099 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048275    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 02:39:07.053099 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048278    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 02:39:07.053099 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048281    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 02:39:07.053099 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048285    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 02:39:07.053099 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048289    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 02:39:07.053099 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048292    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 02:39:07.053099 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048295    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 02:39:07.053099 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048298    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 02:39:07.053099 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048300    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 02:39:07.053605 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048303    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 02:39:07.053605 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048306    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 02:39:07.053605 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048308    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 02:39:07.053605 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048311    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 02:39:07.053605 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048314    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 02:39:07.053605 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048317    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 02:39:07.053605 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048320    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 02:39:07.053605 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048322    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 02:39:07.053605 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048325    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 02:39:07.053605 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048328    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 02:39:07.053605 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048330    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 02:39:07.053605 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048333    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 02:39:07.053605 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048336    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 02:39:07.053605 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048339    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 02:39:07.053605 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048342    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 02:39:07.053605 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048344    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 02:39:07.053605 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048347    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 02:39:07.053605 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048350    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 02:39:07.053605 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048352    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 02:39:07.053605 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048356    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 02:39:07.054280 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048358    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 02:39:07.054280 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048361    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 02:39:07.054280 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048372    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 02:39:07.054280 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048375    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 02:39:07.054280 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048378    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 02:39:07.054280 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048380    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 02:39:07.054280 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048383    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 02:39:07.054280 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048386    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 02:39:07.054280 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048388    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 02:39:07.054280 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048391    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 02:39:07.054280 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048394    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 02:39:07.054280 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048397    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 02:39:07.054280 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048399    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 02:39:07.054280 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048402    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 02:39:07.054280 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048405    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 02:39:07.054280 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048408    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 02:39:07.054280 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048410    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 02:39:07.054280 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048413    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 02:39:07.054280 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048416    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 02:39:07.054280 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048418    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 02:39:07.054845 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048422    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 02:39:07.054845 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048426    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 02:39:07.054845 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048429    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 02:39:07.054845 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048432    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 02:39:07.054845 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048436    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 02:39:07.054845 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048439    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 02:39:07.054845 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048442    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 02:39:07.054845 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048444    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 02:39:07.054845 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048447    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 02:39:07.054845 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048450    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 02:39:07.054845 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048453    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 02:39:07.054845 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048456    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 02:39:07.054845 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048459    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 02:39:07.054845 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048461    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 02:39:07.054845 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048464    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 02:39:07.054845 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048467    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 02:39:07.054845 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048470    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 02:39:07.054845 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048472    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 02:39:07.054845 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048475    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 02:39:07.055363 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048477    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 02:39:07.055363 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048480    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 02:39:07.055363 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048483    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 02:39:07.055363 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048485    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 02:39:07.055363 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048488    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 02:39:07.055363 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:07.048490    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 02:39:07.055363 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.048496    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 02:39:07.055363 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.048605    2570 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 02:39:07.055363 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.050792    2570 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 02:39:07.055363 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.052361    2570 server.go:1019] "Starting client certificate rotation"
Jul 06 02:39:07.055363 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.052472    2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 02:39:07.055363 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.052511    2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 02:39:07.055746 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.055731    2570 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 02:39:07.057820 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.057799    2570 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 02:39:07.071808 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.071784    2570 log.go:25] "Validated CRI v1 runtime API"
Jul 06 02:39:07.076330 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.076314    2570 log.go:25] "Validated CRI v1 image API"
Jul 06 02:39:07.077211 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.077192    2570 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 02:39:07.079725 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.079698    2570 fs.go:135] Filesystem UUIDs: map[2b76ba42-1e85-40e1-a22d-5fe97e1c06d9:/dev/nvme0n1p4 2e6b414a-ad82-4358-886e-63ff1ad45ac0:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 06 02:39:07.079780 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.079726    2570 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 02:39:07.086467 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.086347    2570 manager.go:216] Machine: {Timestamp:2026-07-06 02:39:07.085283788 +0000 UTC m=+0.742293445 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103961 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27fbda3aee0de47d4c638822a5b26e SystemUUID:ec27fbda-3aee-0de4-7d4c-638822a5b26e BootID:a88dc037-a89b-4202-9398-f359ca7e76c6 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:60:7d:15:4b:a7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:60:7d:15:4b:a7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:7f:29:eb:ce:37 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 02:39:07.086467 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.086454    2570 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 02:39:07.086616 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.086539    2570 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 02:39:07.087696 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.087672    2570 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 02:39:07.087839 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.087698    2570 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-238.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 02:39:07.089322 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.089309    2570 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 02:39:07.089358 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.089325    2570 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 02:39:07.089358 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.089333    2570 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 02:39:07.091020 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.091009    2570 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 02:39:07.091331 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.091313    2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 02:39:07.091864 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.091851    2570 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 02:39:07.094777 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.094765    2570 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 02:39:07.094929 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.094919    2570 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 02:39:07.094969 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.094954    2570 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 02:39:07.095001 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.094974    2570 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 02:39:07.095001 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.094985    2570 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 02:39:07.095001 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.094995    2570 kubelet.go:398] "Adding apiserver pod source"
Jul 06 02:39:07.095127 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.095003    2570 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 02:39:07.095540 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.095528    2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 02:39:07.095579 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.095557    2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 02:39:07.097708 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.097692    2570 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 02:39:07.099415 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.099400    2570 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 02:39:07.099462 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.099452    2570 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 02:39:07.101414 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.101388    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 02:39:07.101414 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.101416    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 02:39:07.101596 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.101428    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 02:39:07.101596 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.101440    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 02:39:07.101596 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.101455    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 02:39:07.101596 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.101464    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 02:39:07.101596 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.101479    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 02:39:07.101596 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.101487    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 02:39:07.101596 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.101496    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 02:39:07.101596 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.101505    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 02:39:07.101596 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.101519    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 02:39:07.101596 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.101530    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 02:39:07.102455 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.102442    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 02:39:07.102532 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.102458    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 02:39:07.105948 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.105911    2570 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-238.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 06 02:39:07.106046 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:07.106010    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-238.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 02:39:07.106142 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:07.106111    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 02:39:07.106178 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.106172    2570 server.go:1268] "Started kubelet"
Jul 06 02:39:07.106330 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.106306    2570 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 02:39:07.106426 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.106293    2570 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 02:39:07.106426 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.106384    2570 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 02:39:07.107109 ip-10-0-131-238 systemd[1]: Started Kubernetes Kubelet.
Jul 06 02:39:07.108251 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.108232    2570 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 02:39:07.108460 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.108447    2570 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 02:39:07.111918 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:07.111883    2570 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 02:39:07.114390 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.114366    2570 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 02:39:07.114390 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.114381    2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 02:39:07.115153 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:07.114655    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-238.ec2.internal\" not found"
Jul 06 02:39:07.115507 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.115486    2570 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 02:39:07.115635 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.115615    2570 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 02:39:07.115707 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.115640    2570 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 02:39:07.115805 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.115784    2570 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 02:39:07.115805 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.115803    2570 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 02:39:07.116271 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.116253    2570 factory.go:55] Registering systemd factory
Jul 06 02:39:07.116271 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.116271    2570 factory.go:223] Registration of the systemd container factory successfully
Jul 06 02:39:07.118041 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.117865    2570 factory.go:153] Registering CRI-O factory
Jul 06 02:39:07.118041 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.117883    2570 factory.go:223] Registration of the crio container factory successfully
Jul 06 02:39:07.118041 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.117937    2570 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 02:39:07.118041 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.117962    2570 factory.go:103] Registering Raw factory
Jul 06 02:39:07.118041 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.118006    2570 manager.go:1196] Started watching for new ooms in manager
Jul 06 02:39:07.118922 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:07.118899    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 06 02:39:07.119019 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.118952    2570 manager.go:349] Starting recovery of all containers
Jul 06 02:39:07.119169 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:07.119145    2570 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-238.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 06 02:39:07.122856 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:07.118998    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-238.ec2.internal.18bf92f25d3ed1a2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-238.ec2.internal,UID:ip-10-0-131-238.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-238.ec2.internal,},FirstTimestamp:2026-07-06 02:39:07.106144674 +0000 UTC m=+0.763154331,LastTimestamp:2026-07-06 02:39:07.106144674 +0000 UTC m=+0.763154331,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-238.ec2.internal,}"
Jul 06 02:39:07.131862 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.131748    2570 manager.go:354] Recovery completed
Jul 06 02:39:07.136094 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.136079    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 02:39:07.138511 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.138495    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-238.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 02:39:07.138569 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.138523    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-238.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 02:39:07.138569 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.138534    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-238.ec2.internal" event="NodeHasSufficientPID"
Jul 06 02:39:07.139109 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.139095    2570 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 02:39:07.139176 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.139110    2570 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 02:39:07.139176 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.139101    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 02:39:07.139176 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.139131    2570 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 02:39:07.140268 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.140252    2570 policy_none.go:49] "None policy: Start"
Jul 06 02:39:07.140335 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.140274    2570 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 02:39:07.140335 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.140287    2570 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 02:39:07.140420 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.140342    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-238.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 02:39:07.140420 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.140369    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-238.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 02:39:07.140420 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.140385    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-238.ec2.internal" event="NodeHasSufficientPID"
Jul 06 02:39:07.140679 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:07.140611    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-238.ec2.internal.18bf92f25f2caf00  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-238.ec2.internal,UID:ip-10-0-131-238.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-238.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-238.ec2.internal,},FirstTimestamp:2026-07-06 02:39:07.138510592 +0000 UTC m=+0.795520249,LastTimestamp:2026-07-06 02:39:07.138510592 +0000 UTC m=+0.795520249,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-238.ec2.internal,}"
Jul 06 02:39:07.141199 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.141188    2570 policy_none.go:47] "Start"
Jul 06 02:39:07.141526 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.141509    2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jk29w"
Jul 06 02:39:07.152854 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:07.152785    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-238.ec2.internal.18bf92f25f2cf411  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-238.ec2.internal,UID:ip-10-0-131-238.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-131-238.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-131-238.ec2.internal,},FirstTimestamp:2026-07-06 02:39:07.138528273 +0000 UTC m=+0.795537930,LastTimestamp:2026-07-06 02:39:07.138528273 +0000 UTC m=+0.795537930,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-238.ec2.internal,}"
Jul 06 02:39:07.153463 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.153441    2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jk29w"
Jul 06 02:39:07.178645 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.178627    2570 manager.go:337] "Starting Device Plugin manager"
Jul 06 02:39:07.178726 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:07.178655    2570 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 02:39:07.178726 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.178664    2570 server.go:87] "Starting device plugin registration server"
Jul 06 02:39:07.178933 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.178920    2570 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 02:39:07.179003 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.178935    2570 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 02:39:07.179107 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.179091    2570 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 02:39:07.179234 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.179220    2570 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 02:39:07.179234 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.179234    2570 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 02:39:07.179722 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:07.179706    2570 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 02:39:07.179784 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:07.179747    2570 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-238.ec2.internal\" not found"
Jul 06 02:39:07.224974 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.224953    2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 02:39:07.226351 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.226334    2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 02:39:07.226416 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.226392    2570 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 02:39:07.226465 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.226416    2570 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 02:39:07.226520 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:07.226466    2570 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 06 02:39:07.228747 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.228719    2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 02:39:07.283401 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.283349    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 02:39:07.284271 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.284247    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-238.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 02:39:07.284327 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.284285    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-238.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 02:39:07.284327 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.284296    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-238.ec2.internal" event="NodeHasSufficientPID"
Jul 06 02:39:07.284327 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.284317    2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-238.ec2.internal"
Jul 06 02:39:07.293622 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.293607    2570 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-238.ec2.internal"
Jul 06 02:39:07.293669 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:07.293630    2570 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-238.ec2.internal\": node \"ip-10-0-131-238.ec2.internal\" not found"
Jul 06 02:39:07.319137 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:07.319111    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-238.ec2.internal\" not found"
Jul 06 02:39:07.327288 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.326643    2570 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-238.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-238.ec2.internal"]
Jul 06 02:39:07.327341 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.327328    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 02:39:07.328180 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.328151    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-238.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 02:39:07.328267 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.328189    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-238.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 02:39:07.328267 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.328200    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-238.ec2.internal" event="NodeHasSufficientPID"
Jul 06 02:39:07.329363 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.329348    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 02:39:07.329477 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.329462    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-238.ec2.internal"
Jul 06 02:39:07.329520 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.329493    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 02:39:07.330116 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.330100    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-238.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 02:39:07.330203 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.330127    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-238.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 02:39:07.330203 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.330137    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-238.ec2.internal" event="NodeHasSufficientPID"
Jul 06 02:39:07.330795 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.330777    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-238.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 02:39:07.330864 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.330810    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-238.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 02:39:07.330864 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.330824    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-238.ec2.internal" event="NodeHasSufficientPID"
Jul 06 02:39:07.331900 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.331885    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-238.ec2.internal"
Jul 06 02:39:07.331950 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.331912    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 02:39:07.332654 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.332638    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-238.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 02:39:07.332717 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.332669    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-238.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 02:39:07.332717 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.332681    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-238.ec2.internal" event="NodeHasSufficientPID"
Jul 06 02:39:07.347633 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:07.347614    2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-238.ec2.internal\" not found" node="ip-10-0-131-238.ec2.internal"
Jul 06 02:39:07.352532 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:07.352516    2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-238.ec2.internal\" not found" node="ip-10-0-131-238.ec2.internal"
Jul 06 02:39:07.416885 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.416863    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/263b51a64d46288ad8e8eb7e42c5d584-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-238.ec2.internal\" (UID: \"263b51a64d46288ad8e8eb7e42c5d584\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-238.ec2.internal"
Jul 06 02:39:07.416952 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.416898    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/263b51a64d46288ad8e8eb7e42c5d584-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-238.ec2.internal\" (UID: \"263b51a64d46288ad8e8eb7e42c5d584\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-238.ec2.internal"
Jul 06 02:39:07.416952 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.416929    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cf1e3a4f17d935523c08b1265303c61f-config\") pod \"kube-apiserver-proxy-ip-10-0-131-238.ec2.internal\" (UID: \"cf1e3a4f17d935523c08b1265303c61f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-238.ec2.internal"
Jul 06 02:39:07.420193 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:07.420179    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-238.ec2.internal\" not found"
Jul 06 02:39:07.518175 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.518135    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/263b51a64d46288ad8e8eb7e42c5d584-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-238.ec2.internal\" (UID: \"263b51a64d46288ad8e8eb7e42c5d584\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-238.ec2.internal"
Jul 06 02:39:07.518285 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.518192    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/263b51a64d46288ad8e8eb7e42c5d584-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-238.ec2.internal\" (UID: \"263b51a64d46288ad8e8eb7e42c5d584\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-238.ec2.internal"
Jul 06 02:39:07.518285 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.518212    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/263b51a64d46288ad8e8eb7e42c5d584-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-238.ec2.internal\" (UID: \"263b51a64d46288ad8e8eb7e42c5d584\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-238.ec2.internal"
Jul 06 02:39:07.518285 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.518220    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cf1e3a4f17d935523c08b1265303c61f-config\") pod \"kube-apiserver-proxy-ip-10-0-131-238.ec2.internal\" (UID: \"cf1e3a4f17d935523c08b1265303c61f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-238.ec2.internal"
Jul 06 02:39:07.518285 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.518273    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cf1e3a4f17d935523c08b1265303c61f-config\") pod \"kube-apiserver-proxy-ip-10-0-131-238.ec2.internal\" (UID: \"cf1e3a4f17d935523c08b1265303c61f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-238.ec2.internal"
Jul 06 02:39:07.518423 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.518289    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/263b51a64d46288ad8e8eb7e42c5d584-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-238.ec2.internal\" (UID: \"263b51a64d46288ad8e8eb7e42c5d584\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-238.ec2.internal"
Jul 06 02:39:07.520567 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:07.520553    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-238.ec2.internal\" not found"
Jul 06 02:39:07.620698 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:07.620651    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-238.ec2.internal\" not found"
Jul 06 02:39:07.650709 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.650683    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-238.ec2.internal"
Jul 06 02:39:07.655260 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:07.655247    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-238.ec2.internal"
Jul 06 02:39:07.721626 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:07.721589    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-238.ec2.internal\" not found"
Jul 06 02:39:07.822138 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:07.822106    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-238.ec2.internal\" not found"
Jul 06 02:39:07.922608 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:07.922545    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-238.ec2.internal\" not found"
Jul 06 02:39:08.023320 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:08.023282    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-238.ec2.internal\" not found"
Jul 06 02:39:08.051661 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:08.051635    2570 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 02:39:08.052375 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:08.051870    2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 02:39:08.124045 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:08.124017    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-238.ec2.internal\" not found"
Jul 06 02:39:08.144229 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:08.144195    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod263b51a64d46288ad8e8eb7e42c5d584.slice/crio-cf5d227dd82afc6505caaa05464c95f27c3955766b9a1344bcc3a75fb686a240 WatchSource:0}: Error finding container cf5d227dd82afc6505caaa05464c95f27c3955766b9a1344bcc3a75fb686a240: Status 404 returned error can't find the container with id cf5d227dd82afc6505caaa05464c95f27c3955766b9a1344bcc3a75fb686a240
Jul 06 02:39:08.149264 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:08.149240    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf1e3a4f17d935523c08b1265303c61f.slice/crio-07c0f94b2acc790acf6c82e6d6eb936ec3bee606c35db67b136e02f6c075f870 WatchSource:0}: Error finding container 07c0f94b2acc790acf6c82e6d6eb936ec3bee606c35db67b136e02f6c075f870: Status 404 returned error can't find the container with id 07c0f94b2acc790acf6c82e6d6eb936ec3bee606c35db67b136e02f6c075f870
Jul 06 02:39:08.149355 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:08.149273    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 02:39:08.158116 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:08.158080    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 02:34:07 +0000 UTC" deadline="2028-01-15 22:29:30.356506347 +0000 UTC"
Jul 06 02:39:08.158116 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:08.158114    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13411h50m22.198395682s"
Jul 06 02:39:08.224411 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:08.224361    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 02:39:08.224487 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:08.224361    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-238.ec2.internal\" not found"
Jul 06 02:39:08.225442 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:08.225418    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-238.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 02:39:08.225517 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:08.225449    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-238.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 02:39:08.225517 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:08.225459    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-238.ec2.internal" event="NodeHasSufficientPID"
Jul 06 02:39:08.229657 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:08.229609    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-238.ec2.internal" event={"ID":"cf1e3a4f17d935523c08b1265303c61f","Type":"ContainerStarted","Data":"07c0f94b2acc790acf6c82e6d6eb936ec3bee606c35db67b136e02f6c075f870"}
Jul 06 02:39:08.230669 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:08.230650    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-238.ec2.internal" event={"ID":"263b51a64d46288ad8e8eb7e42c5d584","Type":"ContainerStarted","Data":"cf5d227dd82afc6505caaa05464c95f27c3955766b9a1344bcc3a75fb686a240"}
Jul 06 02:39:08.324588 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:08.324568    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-238.ec2.internal\" not found"
Jul 06 02:39:08.325226 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:08.325211    2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 02:39:08.330184 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:08.330168    2570 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 02:39:08.414943 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:08.414919    2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-238.ec2.internal"
Jul 06 02:39:08.428404 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:08.428383    2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 02:39:08.429930 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:08.429917    2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-238.ec2.internal"
Jul 06 02:39:08.438989 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:08.438967    2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 02:39:08.704509 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:08.704484    2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 02:39:09.097101 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.097061    2570 apiserver.go:52] "Watching apiserver"
Jul 06 02:39:09.104175 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.103793    2570 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 02:39:09.105334 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.105255    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-fmv2g","openshift-ovn-kubernetes/ovnkube-node-vfxlc","kube-system/global-pull-secret-syncer-lkl9q","kube-system/kube-apiserver-proxy-ip-10-0-131-238.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxkw","openshift-dns/node-resolver-v6b8r","openshift-image-registry/node-ca-drltx","openshift-multus/multus-additional-cni-plugins-lvbvz","openshift-multus/network-metrics-daemon-j4xxx","openshift-network-diagnostics/network-check-target-2l4wn","kube-system/konnectivity-agent-mlsf8","openshift-cluster-node-tuning-operator/tuned-5whj9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-238.ec2.internal","openshift-multus/multus-4ljj8"]
Jul 06 02:39:09.106816 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.106793    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l4wn"
Jul 06 02:39:09.106915 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:09.106889    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l4wn" podUID="977ea5f1-cac4-48ed-8d62-bc90e5866877"
Jul 06 02:39:09.108110 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.108089    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mlsf8"
Jul 06 02:39:09.111139 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.110961    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkl9q"
Jul 06 02:39:09.111139 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:09.111088    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkl9q" podUID="152ac564-1081-4f4e-bf7c-fce7f2bc64a7"
Jul 06 02:39:09.115385 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.112911    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-k78gp\""
Jul 06 02:39:09.115385 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.113295    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 02:39:09.115385 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.113553    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 02:39:09.116178 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.116039    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.118897 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.117682    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxkw"
Jul 06 02:39:09.118897 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.117901    2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 02:39:09.119103 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.119086    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 02:39:09.120483 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.119434    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-x8rxk\""
Jul 06 02:39:09.120483 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.119755    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 02:39:09.120483 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.119949    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v6b8r"
Jul 06 02:39:09.120483 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.120149    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 02:39:09.120483 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.120162    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 02:39:09.120851 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.120542    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 02:39:09.120851 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.120623    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 02:39:09.121013 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.120873    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4xxx"
Jul 06 02:39:09.121367 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.121348    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4s8pz\""
Jul 06 02:39:09.121841 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.121823    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 02:39:09.122521 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.122497    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 02:39:09.122701 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.122679    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ht6cl\""
Jul 06 02:39:09.122955 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.122555    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 02:39:09.123185 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.122946    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.123312 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:09.123005    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4xxx" podUID="35f61f76-1038-43ca-a749-71412ea26859"
Jul 06 02:39:09.123312 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.123235    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lvbvz"
Jul 06 02:39:09.126381 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.126360    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 02:39:09.126498 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.126363    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 02:39:09.126570 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.126520    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 02:39:09.126641 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.126569    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 02:39:09.127758 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.127735    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fmv2g"
Jul 06 02:39:09.128396 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.128375    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2xstb\""
Jul 06 02:39:09.128487 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.128424    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 02:39:09.128637 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.128586    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a8e34855-89c9-415e-9513-596bb1ae12ae-multus-socket-dir-parent\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.128637 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.128609    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xq2dl\""
Jul 06 02:39:09.128637 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.128617    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35f61f76-1038-43ca-a749-71412ea26859-metrics-certs\") pod \"network-metrics-daemon-j4xxx\" (UID: \"35f61f76-1038-43ca-a749-71412ea26859\") " pod="openshift-multus/network-metrics-daemon-j4xxx"
Jul 06 02:39:09.128814 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.128646    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/988da6f0-e2d4-416f-bbfc-3812c7ae2f6a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lvbvz\" (UID: \"988da6f0-e2d4-416f-bbfc-3812c7ae2f6a\") " pod="openshift-multus/multus-additional-cni-plugins-lvbvz"
Jul 06 02:39:09.128814 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.128674    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/988da6f0-e2d4-416f-bbfc-3812c7ae2f6a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lvbvz\" (UID: \"988da6f0-e2d4-416f-bbfc-3812c7ae2f6a\") " pod="openshift-multus/multus-additional-cni-plugins-lvbvz"
Jul 06 02:39:09.128814 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.128701    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a8e34855-89c9-415e-9513-596bb1ae12ae-os-release\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.128814 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.128725    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a8e34855-89c9-415e-9513-596bb1ae12ae-multus-daemon-config\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.128814 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.128766    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a8e34855-89c9-415e-9513-596bb1ae12ae-host-run-multus-certs\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.128814 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.128790    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5dea5b0e-3e8c-4ca2-9939-57e6bc1c2c80-hosts-file\") pod \"node-resolver-v6b8r\" (UID: \"5dea5b0e-3e8c-4ca2-9939-57e6bc1c2c80\") " pod="openshift-dns/node-resolver-v6b8r"
Jul 06 02:39:09.129145 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.128816    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/152ac564-1081-4f4e-bf7c-fce7f2bc64a7-original-pull-secret\") pod \"global-pull-secret-syncer-lkl9q\" (UID: \"152ac564-1081-4f4e-bf7c-fce7f2bc64a7\") " pod="kube-system/global-pull-secret-syncer-lkl9q"
Jul 06 02:39:09.129145 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.128840    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/988da6f0-e2d4-416f-bbfc-3812c7ae2f6a-system-cni-dir\") pod \"multus-additional-cni-plugins-lvbvz\" (UID: \"988da6f0-e2d4-416f-bbfc-3812c7ae2f6a\") " pod="openshift-multus/multus-additional-cni-plugins-lvbvz"
Jul 06 02:39:09.129145 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.128865    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/988da6f0-e2d4-416f-bbfc-3812c7ae2f6a-cnibin\") pod \"multus-additional-cni-plugins-lvbvz\" (UID: \"988da6f0-e2d4-416f-bbfc-3812c7ae2f6a\") " pod="openshift-multus/multus-additional-cni-plugins-lvbvz"
Jul 06 02:39:09.129145 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.128908    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghtsn\" (UniqueName: \"kubernetes.io/projected/977ea5f1-cac4-48ed-8d62-bc90e5866877-kube-api-access-ghtsn\") pod \"network-check-target-2l4wn\" (UID: \"977ea5f1-cac4-48ed-8d62-bc90e5866877\") " pod="openshift-network-diagnostics/network-check-target-2l4wn"
Jul 06 02:39:09.129145 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.128934    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e9bc32ae-ec69-4043-8b50-f2f60aef2325-sys-fs\") pod \"aws-ebs-csi-driver-node-khxkw\" (UID: \"e9bc32ae-ec69-4043-8b50-f2f60aef2325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxkw"
Jul 06 02:39:09.129145 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.128966    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f8506b55-5900-4c57-bd12-9fda440b337a-agent-certs\") pod \"konnectivity-agent-mlsf8\" (UID: \"f8506b55-5900-4c57-bd12-9fda440b337a\") " pod="kube-system/konnectivity-agent-mlsf8"
Jul 06 02:39:09.129145 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.129010    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8e34855-89c9-415e-9513-596bb1ae12ae-etc-kubernetes\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.129145 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.129047    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dea5b0e-3e8c-4ca2-9939-57e6bc1c2c80-tmp-dir\") pod \"node-resolver-v6b8r\" (UID: \"5dea5b0e-3e8c-4ca2-9939-57e6bc1c2c80\") " pod="openshift-dns/node-resolver-v6b8r"
Jul 06 02:39:09.129145 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.129091    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a8e34855-89c9-415e-9513-596bb1ae12ae-cnibin\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.129145 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.129126    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8e34855-89c9-415e-9513-596bb1ae12ae-host-var-lib-kubelet\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.129690 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.129166    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e9bc32ae-ec69-4043-8b50-f2f60aef2325-etc-selinux\") pod \"aws-ebs-csi-driver-node-khxkw\" (UID: \"e9bc32ae-ec69-4043-8b50-f2f60aef2325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxkw"
Jul 06 02:39:09.129690 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.129189    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrh9r\" (UniqueName: \"kubernetes.io/projected/5dea5b0e-3e8c-4ca2-9939-57e6bc1c2c80-kube-api-access-mrh9r\") pod \"node-resolver-v6b8r\" (UID: \"5dea5b0e-3e8c-4ca2-9939-57e6bc1c2c80\") " pod="openshift-dns/node-resolver-v6b8r"
Jul 06 02:39:09.129690 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.129230    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/988da6f0-e2d4-416f-bbfc-3812c7ae2f6a-os-release\") pod \"multus-additional-cni-plugins-lvbvz\" (UID: \"988da6f0-e2d4-416f-bbfc-3812c7ae2f6a\") " pod="openshift-multus/multus-additional-cni-plugins-lvbvz"
Jul 06 02:39:09.129690 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.129254    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2tvh\" (UniqueName: \"kubernetes.io/projected/988da6f0-e2d4-416f-bbfc-3812c7ae2f6a-kube-api-access-l2tvh\") pod \"multus-additional-cni-plugins-lvbvz\" (UID: \"988da6f0-e2d4-416f-bbfc-3812c7ae2f6a\") " pod="openshift-multus/multus-additional-cni-plugins-lvbvz"
Jul 06 02:39:09.129690 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.129280    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a8e34855-89c9-415e-9513-596bb1ae12ae-cni-binary-copy\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.129690 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.129313    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e9bc32ae-ec69-4043-8b50-f2f60aef2325-registration-dir\") pod \"aws-ebs-csi-driver-node-khxkw\" (UID: \"e9bc32ae-ec69-4043-8b50-f2f60aef2325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxkw"
Jul 06 02:39:09.129690 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.129363    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e9bc32ae-ec69-4043-8b50-f2f60aef2325-device-dir\") pod \"aws-ebs-csi-driver-node-khxkw\" (UID: \"e9bc32ae-ec69-4043-8b50-f2f60aef2325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxkw"
Jul 06 02:39:09.129690 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.129396    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a8e34855-89c9-415e-9513-596bb1ae12ae-host-run-k8s-cni-cncf-io\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.129690 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.129429    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e9bc32ae-ec69-4043-8b50-f2f60aef2325-kubelet-dir\") pod \"aws-ebs-csi-driver-node-khxkw\" (UID: \"e9bc32ae-ec69-4043-8b50-f2f60aef2325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxkw"
Jul 06 02:39:09.129690 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.129469    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8e34855-89c9-415e-9513-596bb1ae12ae-system-cni-dir\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.129690 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.129524    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a8e34855-89c9-415e-9513-596bb1ae12ae-host-var-lib-cni-bin\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.129690 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.129560    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a8e34855-89c9-415e-9513-596bb1ae12ae-host-var-lib-cni-multus\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.129690 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.129586    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a8e34855-89c9-415e-9513-596bb1ae12ae-multus-conf-dir\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.129690 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.129612    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7txld\" (UniqueName: \"kubernetes.io/projected/a8e34855-89c9-415e-9513-596bb1ae12ae-kube-api-access-7txld\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.129690 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.129661    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxr2p\" (UniqueName: \"kubernetes.io/projected/e9bc32ae-ec69-4043-8b50-f2f60aef2325-kube-api-access-cxr2p\") pod \"aws-ebs-csi-driver-node-khxkw\" (UID: \"e9bc32ae-ec69-4043-8b50-f2f60aef2325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxkw"
Jul 06 02:39:09.129690 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.129697    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/152ac564-1081-4f4e-bf7c-fce7f2bc64a7-dbus\") pod \"global-pull-secret-syncer-lkl9q\" (UID: \"152ac564-1081-4f4e-bf7c-fce7f2bc64a7\") " pod="kube-system/global-pull-secret-syncer-lkl9q"
Jul 06 02:39:09.130497 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.129723    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v5nl\" (UniqueName: \"kubernetes.io/projected/35f61f76-1038-43ca-a749-71412ea26859-kube-api-access-4v5nl\") pod \"network-metrics-daemon-j4xxx\" (UID: \"35f61f76-1038-43ca-a749-71412ea26859\") " pod="openshift-multus/network-metrics-daemon-j4xxx"
Jul 06 02:39:09.130497 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.129753    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8e34855-89c9-415e-9513-596bb1ae12ae-multus-cni-dir\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.130497 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.129785    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a8e34855-89c9-415e-9513-596bb1ae12ae-host-run-netns\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.130497 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.129811    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a8e34855-89c9-415e-9513-596bb1ae12ae-hostroot\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.130497 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.129837    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e9bc32ae-ec69-4043-8b50-f2f60aef2325-socket-dir\") pod \"aws-ebs-csi-driver-node-khxkw\" (UID: \"e9bc32ae-ec69-4043-8b50-f2f60aef2325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxkw"
Jul 06 02:39:09.130497 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.129905    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/152ac564-1081-4f4e-bf7c-fce7f2bc64a7-kubelet-config\") pod \"global-pull-secret-syncer-lkl9q\" (UID: \"152ac564-1081-4f4e-bf7c-fce7f2bc64a7\") " pod="kube-system/global-pull-secret-syncer-lkl9q"
Jul 06 02:39:09.130497 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.129932    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/988da6f0-e2d4-416f-bbfc-3812c7ae2f6a-cni-binary-copy\") pod \"multus-additional-cni-plugins-lvbvz\" (UID: \"988da6f0-e2d4-416f-bbfc-3812c7ae2f6a\") " pod="openshift-multus/multus-additional-cni-plugins-lvbvz"
Jul 06 02:39:09.130497 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.129958    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/988da6f0-e2d4-416f-bbfc-3812c7ae2f6a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lvbvz\" (UID: \"988da6f0-e2d4-416f-bbfc-3812c7ae2f6a\") " pod="openshift-multus/multus-additional-cni-plugins-lvbvz"
Jul 06 02:39:09.130497 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.129989    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f8506b55-5900-4c57-bd12-9fda440b337a-konnectivity-ca\") pod \"konnectivity-agent-mlsf8\" (UID: \"f8506b55-5900-4c57-bd12-9fda440b337a\") " pod="kube-system/konnectivity-agent-mlsf8"
Jul 06 02:39:09.130497 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.130143    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-drltx"
Jul 06 02:39:09.130987 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.130854    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 02:39:09.131147 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.131115    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 02:39:09.131218 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.131149    2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 02:39:09.131274 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.131235    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5whj9"
Jul 06 02:39:09.131655 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.131635    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 02:39:09.132202 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.131709    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-g77bq\""
Jul 06 02:39:09.132202 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.131731    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 02:39:09.132202 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.131852    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 02:39:09.132202 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.132008    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 02:39:09.132463 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.132350    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 02:39:09.132463 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.132353    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 02:39:09.132791 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.132735    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2dwl6\""
Jul 06 02:39:09.132901 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.132743    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 02:39:09.133612 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.133593    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 02:39:09.133949 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.133926    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 02:39:09.134113 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.134092    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2b5fx\""
Jul 06 02:39:09.150899 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.150882    2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9rlzf"
Jul 06 02:39:09.158601 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.158584    2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9rlzf"
Jul 06 02:39:09.217208 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.217187    2570 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 02:39:09.232423 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.231210    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5dea5b0e-3e8c-4ca2-9939-57e6bc1c2c80-hosts-file\") pod \"node-resolver-v6b8r\" (UID: \"5dea5b0e-3e8c-4ca2-9939-57e6bc1c2c80\") " pod="openshift-dns/node-resolver-v6b8r"
Jul 06 02:39:09.232423 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.231259    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/152ac564-1081-4f4e-bf7c-fce7f2bc64a7-original-pull-secret\") pod \"global-pull-secret-syncer-lkl9q\" (UID: \"152ac564-1081-4f4e-bf7c-fce7f2bc64a7\") " pod="kube-system/global-pull-secret-syncer-lkl9q"
Jul 06 02:39:09.232423 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.231292    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a77fd9ea-8544-4939-8ce0-82d039a56226-etc-sysconfig\") pod \"tuned-5whj9\" (UID: \"a77fd9ea-8544-4939-8ce0-82d039a56226\") " pod="openshift-cluster-node-tuning-operator/tuned-5whj9"
Jul 06 02:39:09.232423 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.231326    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b2861d04-c87b-43b1-9bff-2b2199a136a3-host-slash\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.232423 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.231360    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8e34855-89c9-415e-9513-596bb1ae12ae-etc-kubernetes\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.232423 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.231391    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d6e0698e-7d78-4805-9704-03a57ae7ccce-host\") pod \"node-ca-drltx\" (UID: \"d6e0698e-7d78-4805-9704-03a57ae7ccce\") " pod="openshift-image-registry/node-ca-drltx"
Jul 06 02:39:09.232423 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.231424    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a77fd9ea-8544-4939-8ce0-82d039a56226-host\") pod \"tuned-5whj9\" (UID: \"a77fd9ea-8544-4939-8ce0-82d039a56226\") " pod="openshift-cluster-node-tuning-operator/tuned-5whj9"
Jul 06 02:39:09.232423 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.231454    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2861d04-c87b-43b1-9bff-2b2199a136a3-var-lib-openvswitch\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.232423 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.231508    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8e34855-89c9-415e-9513-596bb1ae12ae-host-var-lib-kubelet\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.232423 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.231540    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrh9r\" (UniqueName: \"kubernetes.io/projected/5dea5b0e-3e8c-4ca2-9939-57e6bc1c2c80-kube-api-access-mrh9r\") pod \"node-resolver-v6b8r\" (UID: \"5dea5b0e-3e8c-4ca2-9939-57e6bc1c2c80\") " pod="openshift-dns/node-resolver-v6b8r"
Jul 06 02:39:09.232423 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.231572    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b2861d04-c87b-43b1-9bff-2b2199a136a3-host-run-netns\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.232423 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.231601    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2861d04-c87b-43b1-9bff-2b2199a136a3-etc-openvswitch\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.232423 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.231635    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2861d04-c87b-43b1-9bff-2b2199a136a3-run-openvswitch\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.232423 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.231668    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e9bc32ae-ec69-4043-8b50-f2f60aef2325-registration-dir\") pod \"aws-ebs-csi-driver-node-khxkw\" (UID: \"e9bc32ae-ec69-4043-8b50-f2f60aef2325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxkw"
Jul 06 02:39:09.232423 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.231701    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a77fd9ea-8544-4939-8ce0-82d039a56226-run\") pod \"tuned-5whj9\" (UID: \"a77fd9ea-8544-4939-8ce0-82d039a56226\") " pod="openshift-cluster-node-tuning-operator/tuned-5whj9"
Jul 06 02:39:09.232423 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.231733    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjnnh\" (UniqueName: \"kubernetes.io/projected/ed4531c4-65eb-4d08-9cae-ce9ca7f19fa1-kube-api-access-vjnnh\") pod \"iptables-alerter-fmv2g\" (UID: \"ed4531c4-65eb-4d08-9cae-ce9ca7f19fa1\") " pod="openshift-network-operator/iptables-alerter-fmv2g"
Jul 06 02:39:09.232423 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.231761    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b2861d04-c87b-43b1-9bff-2b2199a136a3-ovnkube-config\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.233402 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.231795    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e9bc32ae-ec69-4043-8b50-f2f60aef2325-kubelet-dir\") pod \"aws-ebs-csi-driver-node-khxkw\" (UID: \"e9bc32ae-ec69-4043-8b50-f2f60aef2325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxkw"
Jul 06 02:39:09.233402 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.231828    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbc2g\" (UniqueName: \"kubernetes.io/projected/d6e0698e-7d78-4805-9704-03a57ae7ccce-kube-api-access-fbc2g\") pod \"node-ca-drltx\" (UID: \"d6e0698e-7d78-4805-9704-03a57ae7ccce\") " pod="openshift-image-registry/node-ca-drltx"
Jul 06 02:39:09.233402 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.231859    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a77fd9ea-8544-4939-8ce0-82d039a56226-etc-modprobe-d\") pod \"tuned-5whj9\" (UID: \"a77fd9ea-8544-4939-8ce0-82d039a56226\") " pod="openshift-cluster-node-tuning-operator/tuned-5whj9"
Jul 06 02:39:09.233402 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.231892    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a77fd9ea-8544-4939-8ce0-82d039a56226-etc-tuned\") pod \"tuned-5whj9\" (UID: \"a77fd9ea-8544-4939-8ce0-82d039a56226\") " pod="openshift-cluster-node-tuning-operator/tuned-5whj9"
Jul 06 02:39:09.233402 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.231917    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a77fd9ea-8544-4939-8ce0-82d039a56226-tmp\") pod \"tuned-5whj9\" (UID: \"a77fd9ea-8544-4939-8ce0-82d039a56226\") " pod="openshift-cluster-node-tuning-operator/tuned-5whj9"
Jul 06 02:39:09.233402 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.231947    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b2861d04-c87b-43b1-9bff-2b2199a136a3-env-overrides\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.233402 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.231984    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b2861d04-c87b-43b1-9bff-2b2199a136a3-ovn-node-metrics-cert\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.233402 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.232017    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a8e34855-89c9-415e-9513-596bb1ae12ae-multus-conf-dir\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.233402 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.232045    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxr2p\" (UniqueName: \"kubernetes.io/projected/e9bc32ae-ec69-4043-8b50-f2f60aef2325-kube-api-access-cxr2p\") pod \"aws-ebs-csi-driver-node-khxkw\" (UID: \"e9bc32ae-ec69-4043-8b50-f2f60aef2325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxkw"
Jul 06 02:39:09.233402 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.232101    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8e34855-89c9-415e-9513-596bb1ae12ae-multus-cni-dir\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.233402 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.232135    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e9bc32ae-ec69-4043-8b50-f2f60aef2325-socket-dir\") pod \"aws-ebs-csi-driver-node-khxkw\" (UID: \"e9bc32ae-ec69-4043-8b50-f2f60aef2325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxkw"
Jul 06 02:39:09.233402 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.232170    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/152ac564-1081-4f4e-bf7c-fce7f2bc64a7-kubelet-config\") pod \"global-pull-secret-syncer-lkl9q\" (UID: \"152ac564-1081-4f4e-bf7c-fce7f2bc64a7\") " pod="kube-system/global-pull-secret-syncer-lkl9q"
Jul 06 02:39:09.233402 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.232207    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/988da6f0-e2d4-416f-bbfc-3812c7ae2f6a-cni-binary-copy\") pod \"multus-additional-cni-plugins-lvbvz\" (UID: \"988da6f0-e2d4-416f-bbfc-3812c7ae2f6a\") " pod="openshift-multus/multus-additional-cni-plugins-lvbvz"
Jul 06 02:39:09.233402 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.232236    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/988da6f0-e2d4-416f-bbfc-3812c7ae2f6a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lvbvz\" (UID: \"988da6f0-e2d4-416f-bbfc-3812c7ae2f6a\") " pod="openshift-multus/multus-additional-cni-plugins-lvbvz"
Jul 06 02:39:09.233402 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.232270    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2861d04-c87b-43b1-9bff-2b2199a136a3-host-run-ovn-kubernetes\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.233402 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.232302    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2861d04-c87b-43b1-9bff-2b2199a136a3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.234238 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.232338    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f8506b55-5900-4c57-bd12-9fda440b337a-konnectivity-ca\") pod \"konnectivity-agent-mlsf8\" (UID: \"f8506b55-5900-4c57-bd12-9fda440b337a\") " pod="kube-system/konnectivity-agent-mlsf8"
Jul 06 02:39:09.234238 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.232383    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a8e34855-89c9-415e-9513-596bb1ae12ae-multus-socket-dir-parent\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.234348 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.234316    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35f61f76-1038-43ca-a749-71412ea26859-metrics-certs\") pod \"network-metrics-daemon-j4xxx\" (UID: \"35f61f76-1038-43ca-a749-71412ea26859\") " pod="openshift-multus/network-metrics-daemon-j4xxx"
Jul 06 02:39:09.234409 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.234376    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a77fd9ea-8544-4939-8ce0-82d039a56226-var-lib-kubelet\") pod \"tuned-5whj9\" (UID: \"a77fd9ea-8544-4939-8ce0-82d039a56226\") " pod="openshift-cluster-node-tuning-operator/tuned-5whj9"
Jul 06 02:39:09.234468 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.234417    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a8e34855-89c9-415e-9513-596bb1ae12ae-os-release\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.234468 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.234426    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8e34855-89c9-415e-9513-596bb1ae12ae-etc-kubernetes\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.234468 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.234461    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a8e34855-89c9-415e-9513-596bb1ae12ae-multus-daemon-config\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.234623 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.234484    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8e34855-89c9-415e-9513-596bb1ae12ae-host-var-lib-kubelet\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.234623 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.234502    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/988da6f0-e2d4-416f-bbfc-3812c7ae2f6a-system-cni-dir\") pod \"multus-additional-cni-plugins-lvbvz\" (UID: \"988da6f0-e2d4-416f-bbfc-3812c7ae2f6a\") " pod="openshift-multus/multus-additional-cni-plugins-lvbvz"
Jul 06 02:39:09.234623 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.234547    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/988da6f0-e2d4-416f-bbfc-3812c7ae2f6a-cnibin\") pod \"multus-additional-cni-plugins-lvbvz\" (UID: \"988da6f0-e2d4-416f-bbfc-3812c7ae2f6a\") " pod="openshift-multus/multus-additional-cni-plugins-lvbvz"
Jul 06 02:39:09.234623 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.234586    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a77fd9ea-8544-4939-8ce0-82d039a56226-etc-systemd\") pod \"tuned-5whj9\" (UID: \"a77fd9ea-8544-4939-8ce0-82d039a56226\") " pod="openshift-cluster-node-tuning-operator/tuned-5whj9"
Jul 06 02:39:09.234623 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.234616    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a77fd9ea-8544-4939-8ce0-82d039a56226-sys\") pod \"tuned-5whj9\" (UID: \"a77fd9ea-8544-4939-8ce0-82d039a56226\") " pod="openshift-cluster-node-tuning-operator/tuned-5whj9"
Jul 06 02:39:09.234885 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.234653    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e9bc32ae-ec69-4043-8b50-f2f60aef2325-sys-fs\") pod \"aws-ebs-csi-driver-node-khxkw\" (UID: \"e9bc32ae-ec69-4043-8b50-f2f60aef2325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxkw"
Jul 06 02:39:09.234885 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.234701    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f8506b55-5900-4c57-bd12-9fda440b337a-agent-certs\") pod \"konnectivity-agent-mlsf8\" (UID: \"f8506b55-5900-4c57-bd12-9fda440b337a\") " pod="kube-system/konnectivity-agent-mlsf8"
Jul 06 02:39:09.234885 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.234737    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dea5b0e-3e8c-4ca2-9939-57e6bc1c2c80-tmp-dir\") pod \"node-resolver-v6b8r\" (UID: \"5dea5b0e-3e8c-4ca2-9939-57e6bc1c2c80\") " pod="openshift-dns/node-resolver-v6b8r"
Jul 06 02:39:09.234885 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.234822    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5dea5b0e-3e8c-4ca2-9939-57e6bc1c2c80-hosts-file\") pod \"node-resolver-v6b8r\" (UID: \"5dea5b0e-3e8c-4ca2-9939-57e6bc1c2c80\") " pod="openshift-dns/node-resolver-v6b8r"
Jul 06 02:39:09.234885 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.234835    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a8e34855-89c9-415e-9513-596bb1ae12ae-multus-conf-dir\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.234885 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:09.234862    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 02:39:09.234885 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.234873    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d6e0698e-7d78-4805-9704-03a57ae7ccce-serviceca\") pod \"node-ca-drltx\" (UID: \"d6e0698e-7d78-4805-9704-03a57ae7ccce\") " pod="openshift-image-registry/node-ca-drltx"
Jul 06 02:39:09.235276 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:09.234902    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 02:39:09.235276 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.234908    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a77fd9ea-8544-4939-8ce0-82d039a56226-etc-sysctl-conf\") pod \"tuned-5whj9\" (UID: \"a77fd9ea-8544-4939-8ce0-82d039a56226\") " pod="openshift-cluster-node-tuning-operator/tuned-5whj9"
Jul 06 02:39:09.235276 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:09.234943    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/152ac564-1081-4f4e-bf7c-fce7f2bc64a7-original-pull-secret podName:152ac564-1081-4f4e-bf7c-fce7f2bc64a7 nodeName:}" failed. No retries permitted until 2026-07-06 02:39:09.734920334 +0000 UTC m=+3.391929995 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/152ac564-1081-4f4e-bf7c-fce7f2bc64a7-original-pull-secret") pod "global-pull-secret-syncer-lkl9q" (UID: "152ac564-1081-4f4e-bf7c-fce7f2bc64a7") : object "kube-system"/"original-pull-secret" not registered
Jul 06 02:39:09.235276 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.234378    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a8e34855-89c9-415e-9513-596bb1ae12ae-multus-socket-dir-parent\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.235276 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.235080    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a8e34855-89c9-415e-9513-596bb1ae12ae-os-release\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.235276 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.235192    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/988da6f0-e2d4-416f-bbfc-3812c7ae2f6a-system-cni-dir\") pod \"multus-additional-cni-plugins-lvbvz\" (UID: \"988da6f0-e2d4-416f-bbfc-3812c7ae2f6a\") " pod="openshift-multus/multus-additional-cni-plugins-lvbvz"
Jul 06 02:39:09.235276 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:09.235217    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35f61f76-1038-43ca-a749-71412ea26859-metrics-certs podName:35f61f76-1038-43ca-a749-71412ea26859 nodeName:}" failed. No retries permitted until 2026-07-06 02:39:09.734954827 +0000 UTC m=+3.391964472 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35f61f76-1038-43ca-a749-71412ea26859-metrics-certs") pod "network-metrics-daemon-j4xxx" (UID: "35f61f76-1038-43ca-a749-71412ea26859") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 02:39:09.235276 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.235258    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/988da6f0-e2d4-416f-bbfc-3812c7ae2f6a-cnibin\") pod \"multus-additional-cni-plugins-lvbvz\" (UID: \"988da6f0-e2d4-416f-bbfc-3812c7ae2f6a\") " pod="openshift-multus/multus-additional-cni-plugins-lvbvz"
Jul 06 02:39:09.235702 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.235348    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e9bc32ae-ec69-4043-8b50-f2f60aef2325-sys-fs\") pod \"aws-ebs-csi-driver-node-khxkw\" (UID: \"e9bc32ae-ec69-4043-8b50-f2f60aef2325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxkw"
Jul 06 02:39:09.235702 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.235525    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/988da6f0-e2d4-416f-bbfc-3812c7ae2f6a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lvbvz\" (UID: \"988da6f0-e2d4-416f-bbfc-3812c7ae2f6a\") " pod="openshift-multus/multus-additional-cni-plugins-lvbvz"
Jul 06 02:39:09.235702 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.235533    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b2861d04-c87b-43b1-9bff-2b2199a136a3-host-cni-bin\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.235702 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.235572    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b2861d04-c87b-43b1-9bff-2b2199a136a3-ovnkube-script-lib\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.235702 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.235619    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8e34855-89c9-415e-9513-596bb1ae12ae-multus-cni-dir\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.235702 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.235635    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a8e34855-89c9-415e-9513-596bb1ae12ae-cnibin\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.235702 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.235299    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dea5b0e-3e8c-4ca2-9939-57e6bc1c2c80-tmp-dir\") pod \"node-resolver-v6b8r\" (UID: \"5dea5b0e-3e8c-4ca2-9939-57e6bc1c2c80\") " pod="openshift-dns/node-resolver-v6b8r"
Jul 06 02:39:09.236035 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.235699    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e9bc32ae-ec69-4043-8b50-f2f60aef2325-kubelet-dir\") pod \"aws-ebs-csi-driver-node-khxkw\" (UID: \"e9bc32ae-ec69-4043-8b50-f2f60aef2325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxkw"
Jul 06 02:39:09.236035 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.235730    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e9bc32ae-ec69-4043-8b50-f2f60aef2325-socket-dir\") pod \"aws-ebs-csi-driver-node-khxkw\" (UID: \"e9bc32ae-ec69-4043-8b50-f2f60aef2325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxkw"
Jul 06 02:39:09.236035 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.235757    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a8e34855-89c9-415e-9513-596bb1ae12ae-cnibin\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.236035 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.235771    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e9bc32ae-ec69-4043-8b50-f2f60aef2325-etc-selinux\") pod \"aws-ebs-csi-driver-node-khxkw\" (UID: \"e9bc32ae-ec69-4043-8b50-f2f60aef2325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxkw"
Jul 06 02:39:09.236035 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.235810    2570 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 02:39:09.236035 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.235826    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e9bc32ae-ec69-4043-8b50-f2f60aef2325-registration-dir\") pod \"aws-ebs-csi-driver-node-khxkw\" (UID: \"e9bc32ae-ec69-4043-8b50-f2f60aef2325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxkw"
Jul 06 02:39:09.236035 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.235884    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e9bc32ae-ec69-4043-8b50-f2f60aef2325-etc-selinux\") pod \"aws-ebs-csi-driver-node-khxkw\" (UID: \"e9bc32ae-ec69-4043-8b50-f2f60aef2325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxkw"
Jul 06 02:39:09.236035 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.235922    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a8e34855-89c9-415e-9513-596bb1ae12ae-multus-daemon-config\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.236035 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.235985    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/152ac564-1081-4f4e-bf7c-fce7f2bc64a7-kubelet-config\") pod \"global-pull-secret-syncer-lkl9q\" (UID: \"152ac564-1081-4f4e-bf7c-fce7f2bc64a7\") " pod="kube-system/global-pull-secret-syncer-lkl9q"
Jul 06 02:39:09.236526 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.236133    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/988da6f0-e2d4-416f-bbfc-3812c7ae2f6a-os-release\") pod \"multus-additional-cni-plugins-lvbvz\" (UID: \"988da6f0-e2d4-416f-bbfc-3812c7ae2f6a\") " pod="openshift-multus/multus-additional-cni-plugins-lvbvz"
Jul 06 02:39:09.236526 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.236212    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2tvh\" (UniqueName: \"kubernetes.io/projected/988da6f0-e2d4-416f-bbfc-3812c7ae2f6a-kube-api-access-l2tvh\") pod \"multus-additional-cni-plugins-lvbvz\" (UID: \"988da6f0-e2d4-416f-bbfc-3812c7ae2f6a\") " pod="openshift-multus/multus-additional-cni-plugins-lvbvz"
Jul 06 02:39:09.236526 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.236282    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb9zl\" (UniqueName: \"kubernetes.io/projected/a77fd9ea-8544-4939-8ce0-82d039a56226-kube-api-access-xb9zl\") pod \"tuned-5whj9\" (UID: \"a77fd9ea-8544-4939-8ce0-82d039a56226\") " pod="openshift-cluster-node-tuning-operator/tuned-5whj9"
Jul 06 02:39:09.236526 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.236293    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/988da6f0-e2d4-416f-bbfc-3812c7ae2f6a-os-release\") pod \"multus-additional-cni-plugins-lvbvz\" (UID: \"988da6f0-e2d4-416f-bbfc-3812c7ae2f6a\") " pod="openshift-multus/multus-additional-cni-plugins-lvbvz"
Jul 06 02:39:09.236526 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.236377    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/988da6f0-e2d4-416f-bbfc-3812c7ae2f6a-cni-binary-copy\") pod \"multus-additional-cni-plugins-lvbvz\" (UID: \"988da6f0-e2d4-416f-bbfc-3812c7ae2f6a\") " pod="openshift-multus/multus-additional-cni-plugins-lvbvz"
Jul 06 02:39:09.236526 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.236418    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2861d04-c87b-43b1-9bff-2b2199a136a3-host-kubelet\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.236526 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.236513    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b2861d04-c87b-43b1-9bff-2b2199a136a3-run-systemd\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.236833 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.236518    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f8506b55-5900-4c57-bd12-9fda440b337a-konnectivity-ca\") pod \"konnectivity-agent-mlsf8\" (UID: \"f8506b55-5900-4c57-bd12-9fda440b337a\") " pod="kube-system/konnectivity-agent-mlsf8"
Jul 06 02:39:09.236833 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.236568    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a8e34855-89c9-415e-9513-596bb1ae12ae-cni-binary-copy\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.236833 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.236663    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e9bc32ae-ec69-4043-8b50-f2f60aef2325-device-dir\") pod \"aws-ebs-csi-driver-node-khxkw\" (UID: \"e9bc32ae-ec69-4043-8b50-f2f60aef2325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxkw"
Jul 06 02:39:09.236833 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.236729    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b2861d04-c87b-43b1-9bff-2b2199a136a3-log-socket\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.236833 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.236793    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e9bc32ae-ec69-4043-8b50-f2f60aef2325-device-dir\") pod \"aws-ebs-csi-driver-node-khxkw\" (UID: \"e9bc32ae-ec69-4043-8b50-f2f60aef2325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxkw"
Jul 06 02:39:09.237073 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.236836    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b2861d04-c87b-43b1-9bff-2b2199a136a3-host-cni-netd\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.237073 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.236864    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a8e34855-89c9-415e-9513-596bb1ae12ae-host-run-k8s-cni-cncf-io\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.237073 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.236926    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a8e34855-89c9-415e-9513-596bb1ae12ae-host-run-k8s-cni-cncf-io\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.237073 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.236941    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ed4531c4-65eb-4d08-9cae-ce9ca7f19fa1-host-slash\") pod \"iptables-alerter-fmv2g\" (UID: \"ed4531c4-65eb-4d08-9cae-ce9ca7f19fa1\") " pod="openshift-network-operator/iptables-alerter-fmv2g"
Jul 06 02:39:09.237073 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.236977    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b2861d04-c87b-43b1-9bff-2b2199a136a3-systemd-units\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.237073 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.237046    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghtsn\" (UniqueName: \"kubernetes.io/projected/977ea5f1-cac4-48ed-8d62-bc90e5866877-kube-api-access-ghtsn\") pod \"network-check-target-2l4wn\" (UID: \"977ea5f1-cac4-48ed-8d62-bc90e5866877\") " pod="openshift-network-diagnostics/network-check-target-2l4wn"
Jul 06 02:39:09.237338 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.237065    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a8e34855-89c9-415e-9513-596bb1ae12ae-cni-binary-copy\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.237338 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.237096    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a77fd9ea-8544-4939-8ce0-82d039a56226-etc-sysctl-d\") pod \"tuned-5whj9\" (UID: \"a77fd9ea-8544-4939-8ce0-82d039a56226\") " pod="openshift-cluster-node-tuning-operator/tuned-5whj9"
Jul 06 02:39:09.237338 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.237154    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8e34855-89c9-415e-9513-596bb1ae12ae-system-cni-dir\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.237338 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.237223    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a8e34855-89c9-415e-9513-596bb1ae12ae-host-var-lib-cni-bin\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.237338 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.237260    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a8e34855-89c9-415e-9513-596bb1ae12ae-host-var-lib-cni-multus\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.237338 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.237261    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8e34855-89c9-415e-9513-596bb1ae12ae-system-cni-dir\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.237338 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.237329    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a8e34855-89c9-415e-9513-596bb1ae12ae-host-var-lib-cni-multus\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.237694 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.237371    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7txld\" (UniqueName: \"kubernetes.io/projected/a8e34855-89c9-415e-9513-596bb1ae12ae-kube-api-access-7txld\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.237694 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.237419    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/152ac564-1081-4f4e-bf7c-fce7f2bc64a7-dbus\") pod \"global-pull-secret-syncer-lkl9q\" (UID: \"152ac564-1081-4f4e-bf7c-fce7f2bc64a7\") " pod="kube-system/global-pull-secret-syncer-lkl9q"
Jul 06 02:39:09.237694 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.237426    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a8e34855-89c9-415e-9513-596bb1ae12ae-host-var-lib-cni-bin\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.237694 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.237475    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/152ac564-1081-4f4e-bf7c-fce7f2bc64a7-dbus\") pod \"global-pull-secret-syncer-lkl9q\" (UID: \"152ac564-1081-4f4e-bf7c-fce7f2bc64a7\") " pod="kube-system/global-pull-secret-syncer-lkl9q"
Jul 06 02:39:09.237694 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.237517    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v5nl\" (UniqueName: \"kubernetes.io/projected/35f61f76-1038-43ca-a749-71412ea26859-kube-api-access-4v5nl\") pod \"network-metrics-daemon-j4xxx\" (UID: \"35f61f76-1038-43ca-a749-71412ea26859\") " pod="openshift-multus/network-metrics-daemon-j4xxx"
Jul 06 02:39:09.237694 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.237558    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a8e34855-89c9-415e-9513-596bb1ae12ae-host-run-netns\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.237694 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.237578    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a8e34855-89c9-415e-9513-596bb1ae12ae-hostroot\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.238109 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.237823    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a8e34855-89c9-415e-9513-596bb1ae12ae-host-run-netns\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.238109 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.237881    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a8e34855-89c9-415e-9513-596bb1ae12ae-hostroot\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.239425 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.239399    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/988da6f0-e2d4-416f-bbfc-3812c7ae2f6a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lvbvz\" (UID: \"988da6f0-e2d4-416f-bbfc-3812c7ae2f6a\") " pod="openshift-multus/multus-additional-cni-plugins-lvbvz"
Jul 06 02:39:09.239535 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.239443    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/988da6f0-e2d4-416f-bbfc-3812c7ae2f6a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lvbvz\" (UID: \"988da6f0-e2d4-416f-bbfc-3812c7ae2f6a\") " pod="openshift-multus/multus-additional-cni-plugins-lvbvz"
Jul 06 02:39:09.239535 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.239472    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a77fd9ea-8544-4939-8ce0-82d039a56226-etc-kubernetes\") pod \"tuned-5whj9\" (UID: \"a77fd9ea-8544-4939-8ce0-82d039a56226\") " pod="openshift-cluster-node-tuning-operator/tuned-5whj9"
Jul 06 02:39:09.239535 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.239496    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a77fd9ea-8544-4939-8ce0-82d039a56226-lib-modules\") pod \"tuned-5whj9\" (UID: \"a77fd9ea-8544-4939-8ce0-82d039a56226\") " pod="openshift-cluster-node-tuning-operator/tuned-5whj9"
Jul 06 02:39:09.239535 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.239519    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b2861d04-c87b-43b1-9bff-2b2199a136a3-run-ovn\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.239798 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.239605    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpdjs\" (UniqueName: \"kubernetes.io/projected/b2861d04-c87b-43b1-9bff-2b2199a136a3-kube-api-access-xpdjs\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.239798 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.239636    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ed4531c4-65eb-4d08-9cae-ce9ca7f19fa1-iptables-alerter-script\") pod \"iptables-alerter-fmv2g\" (UID: \"ed4531c4-65eb-4d08-9cae-ce9ca7f19fa1\") " pod="openshift-network-operator/iptables-alerter-fmv2g"
Jul 06 02:39:09.239798 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.239659    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b2861d04-c87b-43b1-9bff-2b2199a136a3-node-log\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.239798 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.239667    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/988da6f0-e2d4-416f-bbfc-3812c7ae2f6a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lvbvz\" (UID: \"988da6f0-e2d4-416f-bbfc-3812c7ae2f6a\") " pod="openshift-multus/multus-additional-cni-plugins-lvbvz"
Jul 06 02:39:09.239798 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.239686    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a8e34855-89c9-415e-9513-596bb1ae12ae-host-run-multus-certs\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.239798 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.239732    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a8e34855-89c9-415e-9513-596bb1ae12ae-host-run-multus-certs\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.240334 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.240311    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/988da6f0-e2d4-416f-bbfc-3812c7ae2f6a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lvbvz\" (UID: \"988da6f0-e2d4-416f-bbfc-3812c7ae2f6a\") " pod="openshift-multus/multus-additional-cni-plugins-lvbvz"
Jul 06 02:39:09.243770 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:09.243269    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 02:39:09.243770 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:09.243295    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 02:39:09.243770 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:09.243309    2570 projected.go:196] Error preparing data for projected volume kube-api-access-ghtsn for pod openshift-network-diagnostics/network-check-target-2l4wn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 02:39:09.243770 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:09.243364    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/977ea5f1-cac4-48ed-8d62-bc90e5866877-kube-api-access-ghtsn podName:977ea5f1-cac4-48ed-8d62-bc90e5866877 nodeName:}" failed. No retries permitted until 2026-07-06 02:39:09.743347836 +0000 UTC m=+3.400357494 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ghtsn" (UniqueName: "kubernetes.io/projected/977ea5f1-cac4-48ed-8d62-bc90e5866877-kube-api-access-ghtsn") pod "network-check-target-2l4wn" (UID: "977ea5f1-cac4-48ed-8d62-bc90e5866877") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 02:39:09.244211 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.243917    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f8506b55-5900-4c57-bd12-9fda440b337a-agent-certs\") pod \"konnectivity-agent-mlsf8\" (UID: \"f8506b55-5900-4c57-bd12-9fda440b337a\") " pod="kube-system/konnectivity-agent-mlsf8"
Jul 06 02:39:09.246555 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.246495    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrh9r\" (UniqueName: \"kubernetes.io/projected/5dea5b0e-3e8c-4ca2-9939-57e6bc1c2c80-kube-api-access-mrh9r\") pod \"node-resolver-v6b8r\" (UID: \"5dea5b0e-3e8c-4ca2-9939-57e6bc1c2c80\") " pod="openshift-dns/node-resolver-v6b8r"
Jul 06 02:39:09.248306 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.248281    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7txld\" (UniqueName: \"kubernetes.io/projected/a8e34855-89c9-415e-9513-596bb1ae12ae-kube-api-access-7txld\") pod \"multus-4ljj8\" (UID: \"a8e34855-89c9-415e-9513-596bb1ae12ae\") " pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.248937 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.248887    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxr2p\" (UniqueName: \"kubernetes.io/projected/e9bc32ae-ec69-4043-8b50-f2f60aef2325-kube-api-access-cxr2p\") pod \"aws-ebs-csi-driver-node-khxkw\" (UID: \"e9bc32ae-ec69-4043-8b50-f2f60aef2325\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxkw"
Jul 06 02:39:09.249256 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.249213    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v5nl\" (UniqueName: \"kubernetes.io/projected/35f61f76-1038-43ca-a749-71412ea26859-kube-api-access-4v5nl\") pod \"network-metrics-daemon-j4xxx\" (UID: \"35f61f76-1038-43ca-a749-71412ea26859\") " pod="openshift-multus/network-metrics-daemon-j4xxx"
Jul 06 02:39:09.250464 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.250440    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2tvh\" (UniqueName: \"kubernetes.io/projected/988da6f0-e2d4-416f-bbfc-3812c7ae2f6a-kube-api-access-l2tvh\") pod \"multus-additional-cni-plugins-lvbvz\" (UID: \"988da6f0-e2d4-416f-bbfc-3812c7ae2f6a\") " pod="openshift-multus/multus-additional-cni-plugins-lvbvz"
Jul 06 02:39:09.340035 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.339986    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2861d04-c87b-43b1-9bff-2b2199a136a3-host-run-ovn-kubernetes\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.340192 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.340046    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2861d04-c87b-43b1-9bff-2b2199a136a3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.340192 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.340059    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2861d04-c87b-43b1-9bff-2b2199a136a3-host-run-ovn-kubernetes\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.340192 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.340087    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a77fd9ea-8544-4939-8ce0-82d039a56226-var-lib-kubelet\") pod \"tuned-5whj9\" (UID: \"a77fd9ea-8544-4939-8ce0-82d039a56226\") " pod="openshift-cluster-node-tuning-operator/tuned-5whj9"
Jul 06 02:39:09.340192 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.340112    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a77fd9ea-8544-4939-8ce0-82d039a56226-etc-systemd\") pod \"tuned-5whj9\" (UID: \"a77fd9ea-8544-4939-8ce0-82d039a56226\") " pod="openshift-cluster-node-tuning-operator/tuned-5whj9"
Jul 06 02:39:09.340192 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.340136    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a77fd9ea-8544-4939-8ce0-82d039a56226-sys\") pod \"tuned-5whj9\" (UID: \"a77fd9ea-8544-4939-8ce0-82d039a56226\") " pod="openshift-cluster-node-tuning-operator/tuned-5whj9"
Jul 06 02:39:09.340192 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.340137    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a77fd9ea-8544-4939-8ce0-82d039a56226-var-lib-kubelet\") pod \"tuned-5whj9\" (UID: \"a77fd9ea-8544-4939-8ce0-82d039a56226\") " pod="openshift-cluster-node-tuning-operator/tuned-5whj9"
Jul 06 02:39:09.340192 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.340146    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2861d04-c87b-43b1-9bff-2b2199a136a3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.340192 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.340163    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d6e0698e-7d78-4805-9704-03a57ae7ccce-serviceca\") pod \"node-ca-drltx\" (UID: \"d6e0698e-7d78-4805-9704-03a57ae7ccce\") " pod="openshift-image-registry/node-ca-drltx"
Jul 06 02:39:09.340192 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.340182    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a77fd9ea-8544-4939-8ce0-82d039a56226-etc-systemd\") pod \"tuned-5whj9\" (UID: \"a77fd9ea-8544-4939-8ce0-82d039a56226\") " pod="openshift-cluster-node-tuning-operator/tuned-5whj9"
Jul 06 02:39:09.340662 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.340200    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a77fd9ea-8544-4939-8ce0-82d039a56226-etc-sysctl-conf\") pod \"tuned-5whj9\" (UID: \"a77fd9ea-8544-4939-8ce0-82d039a56226\") " pod="openshift-cluster-node-tuning-operator/tuned-5whj9"
Jul 06 02:39:09.340662 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.340217    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a77fd9ea-8544-4939-8ce0-82d039a56226-sys\") pod \"tuned-5whj9\" (UID: \"a77fd9ea-8544-4939-8ce0-82d039a56226\") " pod="openshift-cluster-node-tuning-operator/tuned-5whj9"
Jul 06 02:39:09.340662 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.340303    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b2861d04-c87b-43b1-9bff-2b2199a136a3-host-cni-bin\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.340662 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.340330    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b2861d04-c87b-43b1-9bff-2b2199a136a3-ovnkube-script-lib\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.340662 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.340341    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a77fd9ea-8544-4939-8ce0-82d039a56226-etc-sysctl-conf\") pod \"tuned-5whj9\" (UID: \"a77fd9ea-8544-4939-8ce0-82d039a56226\") " pod="openshift-cluster-node-tuning-operator/tuned-5whj9"
Jul 06 02:39:09.340662 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.340361    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb9zl\" (UniqueName: \"kubernetes.io/projected/a77fd9ea-8544-4939-8ce0-82d039a56226-kube-api-access-xb9zl\") pod \"tuned-5whj9\" (UID: \"a77fd9ea-8544-4939-8ce0-82d039a56226\") " pod="openshift-cluster-node-tuning-operator/tuned-5whj9"
Jul 06 02:39:09.340662 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.340386    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2861d04-c87b-43b1-9bff-2b2199a136a3-host-kubelet\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.340662 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.340410    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b2861d04-c87b-43b1-9bff-2b2199a136a3-run-systemd\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.340662 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.340413    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b2861d04-c87b-43b1-9bff-2b2199a136a3-host-cni-bin\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.340662 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.340441    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b2861d04-c87b-43b1-9bff-2b2199a136a3-log-socket\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.340662 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.340467    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b2861d04-c87b-43b1-9bff-2b2199a136a3-host-cni-netd\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.340662 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.340472    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b2861d04-c87b-43b1-9bff-2b2199a136a3-run-systemd\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.340662 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.340495    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ed4531c4-65eb-4d08-9cae-ce9ca7f19fa1-host-slash\") pod \"iptables-alerter-fmv2g\" (UID: \"ed4531c4-65eb-4d08-9cae-ce9ca7f19fa1\") " pod="openshift-network-operator/iptables-alerter-fmv2g"
Jul 06 02:39:09.340662 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.340519    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2861d04-c87b-43b1-9bff-2b2199a136a3-host-kubelet\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.340662 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.340520    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b2861d04-c87b-43b1-9bff-2b2199a136a3-systemd-units\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.340662 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.340557    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b2861d04-c87b-43b1-9bff-2b2199a136a3-systemd-units\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.340662 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.340578    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a77fd9ea-8544-4939-8ce0-82d039a56226-etc-sysctl-d\") pod \"tuned-5whj9\" (UID: \"a77fd9ea-8544-4939-8ce0-82d039a56226\") " pod="openshift-cluster-node-tuning-operator/tuned-5whj9"
Jul 06 02:39:09.340662 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.340603    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a77fd9ea-8544-4939-8ce0-82d039a56226-etc-kubernetes\") pod \"tuned-5whj9\" (UID: \"a77fd9ea-8544-4939-8ce0-82d039a56226\") " pod="openshift-cluster-node-tuning-operator/tuned-5whj9"
Jul 06 02:39:09.341639 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.340608    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b2861d04-c87b-43b1-9bff-2b2199a136a3-log-socket\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.341639 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.340647    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d6e0698e-7d78-4805-9704-03a57ae7ccce-serviceca\") pod \"node-ca-drltx\" (UID: \"d6e0698e-7d78-4805-9704-03a57ae7ccce\") " pod="openshift-image-registry/node-ca-drltx"
Jul 06 02:39:09.341639 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.340659    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a77fd9ea-8544-4939-8ce0-82d039a56226-etc-kubernetes\") pod \"tuned-5whj9\" (UID: \"a77fd9ea-8544-4939-8ce0-82d039a56226\") " pod="openshift-cluster-node-tuning-operator/tuned-5whj9"
Jul 06 02:39:09.341639 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.340679    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a77fd9ea-8544-4939-8ce0-82d039a56226-lib-modules\") pod \"tuned-5whj9\" (UID: \"a77fd9ea-8544-4939-8ce0-82d039a56226\") " pod="openshift-cluster-node-tuning-operator/tuned-5whj9"
Jul 06 02:39:09.341639 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.340707    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b2861d04-c87b-43b1-9bff-2b2199a136a3-run-ovn\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.341639 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.340720    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b2861d04-c87b-43b1-9bff-2b2199a136a3-host-cni-netd\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.341639 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.340729    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpdjs\" (UniqueName: \"kubernetes.io/projected/b2861d04-c87b-43b1-9bff-2b2199a136a3-kube-api-access-xpdjs\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.341639 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.340749    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a77fd9ea-8544-4939-8ce0-82d039a56226-etc-sysctl-d\") pod \"tuned-5whj9\" (UID: \"a77fd9ea-8544-4939-8ce0-82d039a56226\") " pod="openshift-cluster-node-tuning-operator/tuned-5whj9"
Jul 06 02:39:09.341639 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.340755    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ed4531c4-65eb-4d08-9cae-ce9ca7f19fa1-iptables-alerter-script\") pod \"iptables-alerter-fmv2g\" (UID: \"ed4531c4-65eb-4d08-9cae-ce9ca7f19fa1\") " pod="openshift-network-operator/iptables-alerter-fmv2g"
Jul 06 02:39:09.341639 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.340787    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a77fd9ea-8544-4939-8ce0-82d039a56226-lib-modules\") pod \"tuned-5whj9\" (UID: \"a77fd9ea-8544-4939-8ce0-82d039a56226\") " pod="openshift-cluster-node-tuning-operator/tuned-5whj9"
Jul 06 02:39:09.341639 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.340786    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ed4531c4-65eb-4d08-9cae-ce9ca7f19fa1-host-slash\") pod \"iptables-alerter-fmv2g\" (UID: \"ed4531c4-65eb-4d08-9cae-ce9ca7f19fa1\") " pod="openshift-network-operator/iptables-alerter-fmv2g"
Jul 06 02:39:09.341639 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.340804    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b2861d04-c87b-43b1-9bff-2b2199a136a3-node-log\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.341639 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.340823    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b2861d04-c87b-43b1-9bff-2b2199a136a3-run-ovn\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.341639 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.340863    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a77fd9ea-8544-4939-8ce0-82d039a56226-etc-sysconfig\") pod \"tuned-5whj9\" (UID: \"a77fd9ea-8544-4939-8ce0-82d039a56226\") " pod="openshift-cluster-node-tuning-operator/tuned-5whj9"
Jul 06 02:39:09.341639 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.340870    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b2861d04-c87b-43b1-9bff-2b2199a136a3-node-log\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.341639 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.340922    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a77fd9ea-8544-4939-8ce0-82d039a56226-etc-sysconfig\") pod \"tuned-5whj9\" (UID: \"a77fd9ea-8544-4939-8ce0-82d039a56226\") " pod="openshift-cluster-node-tuning-operator/tuned-5whj9"
Jul 06 02:39:09.341639 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.340951    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b2861d04-c87b-43b1-9bff-2b2199a136a3-host-slash\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.341639 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.340966    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b2861d04-c87b-43b1-9bff-2b2199a136a3-ovnkube-script-lib\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.342560 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.340977    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d6e0698e-7d78-4805-9704-03a57ae7ccce-host\") pod \"node-ca-drltx\" (UID: \"d6e0698e-7d78-4805-9704-03a57ae7ccce\") " pod="openshift-image-registry/node-ca-drltx"
Jul 06 02:39:09.342560 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.341011    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d6e0698e-7d78-4805-9704-03a57ae7ccce-host\") pod \"node-ca-drltx\" (UID: \"d6e0698e-7d78-4805-9704-03a57ae7ccce\") " pod="openshift-image-registry/node-ca-drltx"
Jul 06 02:39:09.342560 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.341012    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a77fd9ea-8544-4939-8ce0-82d039a56226-host\") pod \"tuned-5whj9\" (UID: \"a77fd9ea-8544-4939-8ce0-82d039a56226\") " pod="openshift-cluster-node-tuning-operator/tuned-5whj9"
Jul 06 02:39:09.342560 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.341032    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b2861d04-c87b-43b1-9bff-2b2199a136a3-host-slash\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.342560 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.341072    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2861d04-c87b-43b1-9bff-2b2199a136a3-var-lib-openvswitch\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.342560 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.341102    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b2861d04-c87b-43b1-9bff-2b2199a136a3-host-run-netns\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.342560 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.341111    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2861d04-c87b-43b1-9bff-2b2199a136a3-var-lib-openvswitch\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.342560 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.341131    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2861d04-c87b-43b1-9bff-2b2199a136a3-etc-openvswitch\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.342560 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.341075    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a77fd9ea-8544-4939-8ce0-82d039a56226-host\") pod \"tuned-5whj9\" (UID: \"a77fd9ea-8544-4939-8ce0-82d039a56226\") " pod="openshift-cluster-node-tuning-operator/tuned-5whj9"
Jul 06 02:39:09.342560 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.341157    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2861d04-c87b-43b1-9bff-2b2199a136a3-run-openvswitch\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.342560 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.341173    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b2861d04-c87b-43b1-9bff-2b2199a136a3-host-run-netns\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.342560 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.341184    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a77fd9ea-8544-4939-8ce0-82d039a56226-run\") pod \"tuned-5whj9\" (UID: \"a77fd9ea-8544-4939-8ce0-82d039a56226\") " pod="openshift-cluster-node-tuning-operator/tuned-5whj9"
Jul 06 02:39:09.342560 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.341208    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2861d04-c87b-43b1-9bff-2b2199a136a3-etc-openvswitch\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.342560 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.341210    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjnnh\" (UniqueName: \"kubernetes.io/projected/ed4531c4-65eb-4d08-9cae-ce9ca7f19fa1-kube-api-access-vjnnh\") pod \"iptables-alerter-fmv2g\" (UID: \"ed4531c4-65eb-4d08-9cae-ce9ca7f19fa1\") " pod="openshift-network-operator/iptables-alerter-fmv2g"
Jul 06 02:39:09.342560 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.341247    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2861d04-c87b-43b1-9bff-2b2199a136a3-run-openvswitch\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.342560 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.341273    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b2861d04-c87b-43b1-9bff-2b2199a136a3-ovnkube-config\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.342560 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.341300    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbc2g\" (UniqueName: \"kubernetes.io/projected/d6e0698e-7d78-4805-9704-03a57ae7ccce-kube-api-access-fbc2g\") pod \"node-ca-drltx\" (UID: \"d6e0698e-7d78-4805-9704-03a57ae7ccce\") " pod="openshift-image-registry/node-ca-drltx"
Jul 06 02:39:09.342560 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.341302    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ed4531c4-65eb-4d08-9cae-ce9ca7f19fa1-iptables-alerter-script\") pod \"iptables-alerter-fmv2g\" (UID: \"ed4531c4-65eb-4d08-9cae-ce9ca7f19fa1\") " pod="openshift-network-operator/iptables-alerter-fmv2g"
Jul 06 02:39:09.343531 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.341325    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a77fd9ea-8544-4939-8ce0-82d039a56226-etc-modprobe-d\") pod \"tuned-5whj9\" (UID: \"a77fd9ea-8544-4939-8ce0-82d039a56226\") " pod="openshift-cluster-node-tuning-operator/tuned-5whj9"
Jul 06 02:39:09.343531 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.341361    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a77fd9ea-8544-4939-8ce0-82d039a56226-etc-tuned\") pod \"tuned-5whj9\" (UID: \"a77fd9ea-8544-4939-8ce0-82d039a56226\") " pod="openshift-cluster-node-tuning-operator/tuned-5whj9"
Jul 06 02:39:09.343531 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.341392    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a77fd9ea-8544-4939-8ce0-82d039a56226-tmp\") pod \"tuned-5whj9\" (UID: \"a77fd9ea-8544-4939-8ce0-82d039a56226\") " pod="openshift-cluster-node-tuning-operator/tuned-5whj9"
Jul 06 02:39:09.343531 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.341406    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a77fd9ea-8544-4939-8ce0-82d039a56226-etc-modprobe-d\") pod \"tuned-5whj9\" (UID: \"a77fd9ea-8544-4939-8ce0-82d039a56226\") " pod="openshift-cluster-node-tuning-operator/tuned-5whj9"
Jul 06 02:39:09.343531 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.341430    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b2861d04-c87b-43b1-9bff-2b2199a136a3-env-overrides\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.343531 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.341442    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a77fd9ea-8544-4939-8ce0-82d039a56226-run\") pod \"tuned-5whj9\" (UID: \"a77fd9ea-8544-4939-8ce0-82d039a56226\") " pod="openshift-cluster-node-tuning-operator/tuned-5whj9"
Jul 06 02:39:09.343531 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.341460    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b2861d04-c87b-43b1-9bff-2b2199a136a3-ovn-node-metrics-cert\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.343531 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.341865    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b2861d04-c87b-43b1-9bff-2b2199a136a3-ovnkube-config\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.343531 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.342139    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b2861d04-c87b-43b1-9bff-2b2199a136a3-env-overrides\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.344228 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.344204    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b2861d04-c87b-43b1-9bff-2b2199a136a3-ovn-node-metrics-cert\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.344806 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.344774    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a77fd9ea-8544-4939-8ce0-82d039a56226-tmp\") pod \"tuned-5whj9\" (UID: \"a77fd9ea-8544-4939-8ce0-82d039a56226\") " pod="openshift-cluster-node-tuning-operator/tuned-5whj9"
Jul 06 02:39:09.344899 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.344809    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a77fd9ea-8544-4939-8ce0-82d039a56226-etc-tuned\") pod \"tuned-5whj9\" (UID: \"a77fd9ea-8544-4939-8ce0-82d039a56226\") " pod="openshift-cluster-node-tuning-operator/tuned-5whj9"
Jul 06 02:39:09.352279 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.352209    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpdjs\" (UniqueName: \"kubernetes.io/projected/b2861d04-c87b-43b1-9bff-2b2199a136a3-kube-api-access-xpdjs\") pod \"ovnkube-node-vfxlc\" (UID: \"b2861d04-c87b-43b1-9bff-2b2199a136a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.352982 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.352958    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb9zl\" (UniqueName: \"kubernetes.io/projected/a77fd9ea-8544-4939-8ce0-82d039a56226-kube-api-access-xb9zl\") pod \"tuned-5whj9\" (UID: \"a77fd9ea-8544-4939-8ce0-82d039a56226\") " pod="openshift-cluster-node-tuning-operator/tuned-5whj9"
Jul 06 02:39:09.353436 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.353418    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjnnh\" (UniqueName: \"kubernetes.io/projected/ed4531c4-65eb-4d08-9cae-ce9ca7f19fa1-kube-api-access-vjnnh\") pod \"iptables-alerter-fmv2g\" (UID: \"ed4531c4-65eb-4d08-9cae-ce9ca7f19fa1\") " pod="openshift-network-operator/iptables-alerter-fmv2g"
Jul 06 02:39:09.353504 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.353483    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbc2g\" (UniqueName: \"kubernetes.io/projected/d6e0698e-7d78-4805-9704-03a57ae7ccce-kube-api-access-fbc2g\") pod \"node-ca-drltx\" (UID: \"d6e0698e-7d78-4805-9704-03a57ae7ccce\") " pod="openshift-image-registry/node-ca-drltx"
Jul 06 02:39:09.429655 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.429619    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mlsf8"
Jul 06 02:39:09.440582 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.440554    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4ljj8"
Jul 06 02:39:09.451266 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.451228    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxkw"
Jul 06 02:39:09.459151 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.459130    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v6b8r"
Jul 06 02:39:09.467792 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.467772    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:09.476580 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.476557    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lvbvz"
Jul 06 02:39:09.484143 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.484120    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fmv2g"
Jul 06 02:39:09.493826 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.493804    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-drltx"
Jul 06 02:39:09.501352 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.501334    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5whj9"
Jul 06 02:39:09.510908 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.510888    2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 02:39:09.744518 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.744425    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/152ac564-1081-4f4e-bf7c-fce7f2bc64a7-original-pull-secret\") pod \"global-pull-secret-syncer-lkl9q\" (UID: \"152ac564-1081-4f4e-bf7c-fce7f2bc64a7\") " pod="kube-system/global-pull-secret-syncer-lkl9q"
Jul 06 02:39:09.744653 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.744528    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35f61f76-1038-43ca-a749-71412ea26859-metrics-certs\") pod \"network-metrics-daemon-j4xxx\" (UID: \"35f61f76-1038-43ca-a749-71412ea26859\") " pod="openshift-multus/network-metrics-daemon-j4xxx"
Jul 06 02:39:09.744653 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:09.744583    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghtsn\" (UniqueName: \"kubernetes.io/projected/977ea5f1-cac4-48ed-8d62-bc90e5866877-kube-api-access-ghtsn\") pod \"network-check-target-2l4wn\" (UID: \"977ea5f1-cac4-48ed-8d62-bc90e5866877\") " pod="openshift-network-diagnostics/network-check-target-2l4wn"
Jul 06 02:39:09.744653 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:09.744589    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 02:39:09.744653 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:09.744650    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 02:39:09.744791 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:09.744670    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/152ac564-1081-4f4e-bf7c-fce7f2bc64a7-original-pull-secret podName:152ac564-1081-4f4e-bf7c-fce7f2bc64a7 nodeName:}" failed. No retries permitted until 2026-07-06 02:39:10.744648293 +0000 UTC m=+4.401657940 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/152ac564-1081-4f4e-bf7c-fce7f2bc64a7-original-pull-secret") pod "global-pull-secret-syncer-lkl9q" (UID: "152ac564-1081-4f4e-bf7c-fce7f2bc64a7") : object "kube-system"/"original-pull-secret" not registered
Jul 06 02:39:09.744791 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:09.744703    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35f61f76-1038-43ca-a749-71412ea26859-metrics-certs podName:35f61f76-1038-43ca-a749-71412ea26859 nodeName:}" failed. No retries permitted until 2026-07-06 02:39:10.744692073 +0000 UTC m=+4.401701721 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35f61f76-1038-43ca-a749-71412ea26859-metrics-certs") pod "network-metrics-daemon-j4xxx" (UID: "35f61f76-1038-43ca-a749-71412ea26859") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 02:39:09.744791 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:09.744738    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 02:39:09.744791 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:09.744761    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 02:39:09.744791 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:09.744775    2570 projected.go:196] Error preparing data for projected volume kube-api-access-ghtsn for pod openshift-network-diagnostics/network-check-target-2l4wn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 02:39:09.744957 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:09.744839    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/977ea5f1-cac4-48ed-8d62-bc90e5866877-kube-api-access-ghtsn podName:977ea5f1-cac4-48ed-8d62-bc90e5866877 nodeName:}" failed. No retries permitted until 2026-07-06 02:39:10.744821758 +0000 UTC m=+4.401831420 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ghtsn" (UniqueName: "kubernetes.io/projected/977ea5f1-cac4-48ed-8d62-bc90e5866877-kube-api-access-ghtsn") pod "network-check-target-2l4wn" (UID: "977ea5f1-cac4-48ed-8d62-bc90e5866877") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 02:39:10.161721 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:10.161680    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 02:34:09 +0000 UTC" deadline="2028-02-12 12:08:09.723470878 +0000 UTC"
Jul 06 02:39:10.161721 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:10.161713    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14073h28m59.561763418s"
Jul 06 02:39:10.227435 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:10.227399    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkl9q"
Jul 06 02:39:10.227626 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:10.227540    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkl9q" podUID="152ac564-1081-4f4e-bf7c-fce7f2bc64a7"
Jul 06 02:39:10.443562 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:10.443515    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda77fd9ea_8544_4939_8ce0_82d039a56226.slice/crio-ed13b4e4af60cedda1c85fe2f4ad86dbef771ae3fca6a072bc14bfbcca846404 WatchSource:0}: Error finding container ed13b4e4af60cedda1c85fe2f4ad86dbef771ae3fca6a072bc14bfbcca846404: Status 404 returned error can't find the container with id ed13b4e4af60cedda1c85fe2f4ad86dbef771ae3fca6a072bc14bfbcca846404
Jul 06 02:39:10.447367 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:10.447157    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2861d04_c87b_43b1_9bff_2b2199a136a3.slice/crio-2118943fbdca5fba64890da5ce68b728f525b9ca3b906697018bc8cf6cf4ab0e WatchSource:0}: Error finding container 2118943fbdca5fba64890da5ce68b728f525b9ca3b906697018bc8cf6cf4ab0e: Status 404 returned error can't find the container with id 2118943fbdca5fba64890da5ce68b728f525b9ca3b906697018bc8cf6cf4ab0e
Jul 06 02:39:10.449175 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:10.449130    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8506b55_5900_4c57_bd12_9fda440b337a.slice/crio-9b451e6d4d156112bb366d2ec0c9ecbfc3a9bf10bbe49e567eaff216d82ee74d WatchSource:0}: Error finding container 9b451e6d4d156112bb366d2ec0c9ecbfc3a9bf10bbe49e567eaff216d82ee74d: Status 404 returned error can't find the container with id 9b451e6d4d156112bb366d2ec0c9ecbfc3a9bf10bbe49e567eaff216d82ee74d
Jul 06 02:39:10.450181 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:10.450155    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8e34855_89c9_415e_9513_596bb1ae12ae.slice/crio-ce3d81a578c68ea42fed84175ad36402b32dae7334341777eabdfbe179ef92d6 WatchSource:0}: Error finding container ce3d81a578c68ea42fed84175ad36402b32dae7334341777eabdfbe179ef92d6: Status 404 returned error can't find the container with id ce3d81a578c68ea42fed84175ad36402b32dae7334341777eabdfbe179ef92d6
Jul 06 02:39:10.452476 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:10.450850    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6e0698e_7d78_4805_9704_03a57ae7ccce.slice/crio-a713328d19e84bb43a1f3d8ad581a4c35eda200fb448f7b0882ddd4db0f06b49 WatchSource:0}: Error finding container a713328d19e84bb43a1f3d8ad581a4c35eda200fb448f7b0882ddd4db0f06b49: Status 404 returned error can't find the container with id a713328d19e84bb43a1f3d8ad581a4c35eda200fb448f7b0882ddd4db0f06b49
Jul 06 02:39:10.452986 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:10.452716    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9bc32ae_ec69_4043_8b50_f2f60aef2325.slice/crio-760dd259167ebc7d11400669dba21d0172072bae6c8a06f0f113548040490bcd WatchSource:0}: Error finding container 760dd259167ebc7d11400669dba21d0172072bae6c8a06f0f113548040490bcd: Status 404 returned error can't find the container with id 760dd259167ebc7d11400669dba21d0172072bae6c8a06f0f113548040490bcd
Jul 06 02:39:10.454682 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:10.454199    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dea5b0e_3e8c_4ca2_9939_57e6bc1c2c80.slice/crio-b931bb451c4ed2d02a8cd1bd2ef63102b0b7c38c91090b45370bb5fc7c9d0820 WatchSource:0}: Error finding container b931bb451c4ed2d02a8cd1bd2ef63102b0b7c38c91090b45370bb5fc7c9d0820: Status 404 returned error can't find the container with id b931bb451c4ed2d02a8cd1bd2ef63102b0b7c38c91090b45370bb5fc7c9d0820
Jul 06 02:39:10.754918 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:10.754893    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghtsn\" (UniqueName: \"kubernetes.io/projected/977ea5f1-cac4-48ed-8d62-bc90e5866877-kube-api-access-ghtsn\") pod \"network-check-target-2l4wn\" (UID: \"977ea5f1-cac4-48ed-8d62-bc90e5866877\") " pod="openshift-network-diagnostics/network-check-target-2l4wn"
Jul 06 02:39:10.755029 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:10.754936    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/152ac564-1081-4f4e-bf7c-fce7f2bc64a7-original-pull-secret\") pod \"global-pull-secret-syncer-lkl9q\" (UID: \"152ac564-1081-4f4e-bf7c-fce7f2bc64a7\") " pod="kube-system/global-pull-secret-syncer-lkl9q"
Jul 06 02:39:10.755029 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:10.754982    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35f61f76-1038-43ca-a749-71412ea26859-metrics-certs\") pod \"network-metrics-daemon-j4xxx\" (UID: \"35f61f76-1038-43ca-a749-71412ea26859\") " pod="openshift-multus/network-metrics-daemon-j4xxx"
Jul 06 02:39:10.755111 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:10.755088    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 02:39:10.755111 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:10.755096    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 02:39:10.755177 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:10.755111    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 02:39:10.755177 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:10.755123    2570 projected.go:196] Error preparing data for projected volume kube-api-access-ghtsn for pod openshift-network-diagnostics/network-check-target-2l4wn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 02:39:10.755177 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:10.755093    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 02:39:10.755177 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:10.755155    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/152ac564-1081-4f4e-bf7c-fce7f2bc64a7-original-pull-secret podName:152ac564-1081-4f4e-bf7c-fce7f2bc64a7 nodeName:}" failed. No retries permitted until 2026-07-06 02:39:12.75513874 +0000 UTC m=+6.412148383 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/152ac564-1081-4f4e-bf7c-fce7f2bc64a7-original-pull-secret") pod "global-pull-secret-syncer-lkl9q" (UID: "152ac564-1081-4f4e-bf7c-fce7f2bc64a7") : object "kube-system"/"original-pull-secret" not registered
Jul 06 02:39:10.755300 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:10.755185    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35f61f76-1038-43ca-a749-71412ea26859-metrics-certs podName:35f61f76-1038-43ca-a749-71412ea26859 nodeName:}" failed. No retries permitted until 2026-07-06 02:39:12.755166004 +0000 UTC m=+6.412175647 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35f61f76-1038-43ca-a749-71412ea26859-metrics-certs") pod "network-metrics-daemon-j4xxx" (UID: "35f61f76-1038-43ca-a749-71412ea26859") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 02:39:10.755300 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:10.755210    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/977ea5f1-cac4-48ed-8d62-bc90e5866877-kube-api-access-ghtsn podName:977ea5f1-cac4-48ed-8d62-bc90e5866877 nodeName:}" failed. No retries permitted until 2026-07-06 02:39:12.755199722 +0000 UTC m=+6.412209374 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ghtsn" (UniqueName: "kubernetes.io/projected/977ea5f1-cac4-48ed-8d62-bc90e5866877-kube-api-access-ghtsn") pod "network-check-target-2l4wn" (UID: "977ea5f1-cac4-48ed-8d62-bc90e5866877") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 02:39:11.162146 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:11.162029    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 02:34:09 +0000 UTC" deadline="2027-12-31 02:09:46.924731301 +0000 UTC"
Jul 06 02:39:11.162146 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:11.162111    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13031h30m35.762624868s"
Jul 06 02:39:11.229968 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:11.229231    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4xxx"
Jul 06 02:39:11.229968 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:11.229382    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4xxx" podUID="35f61f76-1038-43ca-a749-71412ea26859"
Jul 06 02:39:11.229968 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:11.229811    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l4wn"
Jul 06 02:39:11.229968 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:11.229910    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l4wn" podUID="977ea5f1-cac4-48ed-8d62-bc90e5866877"
Jul 06 02:39:11.241737 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:11.241104    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-238.ec2.internal" event={"ID":"cf1e3a4f17d935523c08b1265303c61f","Type":"ContainerStarted","Data":"56ec258dea866fa931c6b5a7540dbe7ce095469eef9fa1be21919c2ad3d00677"}
Jul 06 02:39:11.243922 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:11.243856    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lvbvz" event={"ID":"988da6f0-e2d4-416f-bbfc-3812c7ae2f6a","Type":"ContainerStarted","Data":"e3a92dcb7a84b6877c31c30f65d3e03108af4ca66f01f50105d59ed6ab1e62a1"}
Jul 06 02:39:11.248297 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:11.248266    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fmv2g" event={"ID":"ed4531c4-65eb-4d08-9cae-ce9ca7f19fa1","Type":"ContainerStarted","Data":"946e7a9a60fb0fc48848237f99b16200112f92d12764f6d6c466ff5ec9a5850c"}
Jul 06 02:39:11.252463 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:11.252391    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4ljj8" event={"ID":"a8e34855-89c9-415e-9513-596bb1ae12ae","Type":"ContainerStarted","Data":"ce3d81a578c68ea42fed84175ad36402b32dae7334341777eabdfbe179ef92d6"}
Jul 06 02:39:11.259597 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:11.259547    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5whj9" event={"ID":"a77fd9ea-8544-4939-8ce0-82d039a56226","Type":"ContainerStarted","Data":"ed13b4e4af60cedda1c85fe2f4ad86dbef771ae3fca6a072bc14bfbcca846404"}
Jul 06 02:39:11.267924 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:11.267183    2570 generic.go:356] "Generic (PLEG): container finished" podID="263b51a64d46288ad8e8eb7e42c5d584" containerID="fd654e954abadb984378d4874aef6fe918bbe614a52fd0d3cc2279fc15e7f163" exitCode=0
Jul 06 02:39:11.267924 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:11.267262    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-238.ec2.internal" event={"ID":"263b51a64d46288ad8e8eb7e42c5d584","Type":"ContainerDied","Data":"fd654e954abadb984378d4874aef6fe918bbe614a52fd0d3cc2279fc15e7f163"}
Jul 06 02:39:11.273931 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:11.273906    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v6b8r" event={"ID":"5dea5b0e-3e8c-4ca2-9939-57e6bc1c2c80","Type":"ContainerStarted","Data":"b931bb451c4ed2d02a8cd1bd2ef63102b0b7c38c91090b45370bb5fc7c9d0820"}
Jul 06 02:39:11.284437 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:11.284403    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxkw" event={"ID":"e9bc32ae-ec69-4043-8b50-f2f60aef2325","Type":"ContainerStarted","Data":"760dd259167ebc7d11400669dba21d0172072bae6c8a06f0f113548040490bcd"}
Jul 06 02:39:11.286648 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:11.285236    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-238.ec2.internal" podStartSLOduration=2.285217739 podStartE2EDuration="2.285217739s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 02:39:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:39:11.257563416 +0000 UTC m=+4.914573086" watchObservedRunningTime="2026-07-06 02:39:11.285217739 +0000 UTC m=+4.942227407"
Jul 06 02:39:11.304004 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:11.303971    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-drltx" event={"ID":"d6e0698e-7d78-4805-9704-03a57ae7ccce","Type":"ContainerStarted","Data":"a713328d19e84bb43a1f3d8ad581a4c35eda200fb448f7b0882ddd4db0f06b49"}
Jul 06 02:39:11.306846 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:11.306810    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mlsf8" event={"ID":"f8506b55-5900-4c57-bd12-9fda440b337a","Type":"ContainerStarted","Data":"9b451e6d4d156112bb366d2ec0c9ecbfc3a9bf10bbe49e567eaff216d82ee74d"}
Jul 06 02:39:11.314964 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:11.313665    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc" event={"ID":"b2861d04-c87b-43b1-9bff-2b2199a136a3","Type":"ContainerStarted","Data":"2118943fbdca5fba64890da5ce68b728f525b9ca3b906697018bc8cf6cf4ab0e"}
Jul 06 02:39:12.227049 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:12.227017    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkl9q"
Jul 06 02:39:12.227566 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:12.227245    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkl9q" podUID="152ac564-1081-4f4e-bf7c-fce7f2bc64a7"
Jul 06 02:39:12.331616 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:12.331538    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-238.ec2.internal" event={"ID":"263b51a64d46288ad8e8eb7e42c5d584","Type":"ContainerStarted","Data":"3334ecd69769d9df2af5e3e82937af8ab2990a0f4c5491845bee78cb85d691da"}
Jul 06 02:39:12.775406 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:12.775360    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghtsn\" (UniqueName: \"kubernetes.io/projected/977ea5f1-cac4-48ed-8d62-bc90e5866877-kube-api-access-ghtsn\") pod \"network-check-target-2l4wn\" (UID: \"977ea5f1-cac4-48ed-8d62-bc90e5866877\") " pod="openshift-network-diagnostics/network-check-target-2l4wn"
Jul 06 02:39:12.775606 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:12.775429    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/152ac564-1081-4f4e-bf7c-fce7f2bc64a7-original-pull-secret\") pod \"global-pull-secret-syncer-lkl9q\" (UID: \"152ac564-1081-4f4e-bf7c-fce7f2bc64a7\") " pod="kube-system/global-pull-secret-syncer-lkl9q"
Jul 06 02:39:12.775606 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:12.775476    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35f61f76-1038-43ca-a749-71412ea26859-metrics-certs\") pod \"network-metrics-daemon-j4xxx\" (UID: \"35f61f76-1038-43ca-a749-71412ea26859\") " pod="openshift-multus/network-metrics-daemon-j4xxx"
Jul 06 02:39:12.775715 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:12.775616    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 02:39:12.775715 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:12.775682    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35f61f76-1038-43ca-a749-71412ea26859-metrics-certs podName:35f61f76-1038-43ca-a749-71412ea26859 nodeName:}" failed. No retries permitted until 2026-07-06 02:39:16.77566158 +0000 UTC m=+10.432671229 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35f61f76-1038-43ca-a749-71412ea26859-metrics-certs") pod "network-metrics-daemon-j4xxx" (UID: "35f61f76-1038-43ca-a749-71412ea26859") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 02:39:12.776250 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:12.776228    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 02:39:12.776250 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:12.776254    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 02:39:12.776414 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:12.776268    2570 projected.go:196] Error preparing data for projected volume kube-api-access-ghtsn for pod openshift-network-diagnostics/network-check-target-2l4wn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 02:39:12.776414 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:12.776319    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/977ea5f1-cac4-48ed-8d62-bc90e5866877-kube-api-access-ghtsn podName:977ea5f1-cac4-48ed-8d62-bc90e5866877 nodeName:}" failed. No retries permitted until 2026-07-06 02:39:16.776302205 +0000 UTC m=+10.433311852 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ghtsn" (UniqueName: "kubernetes.io/projected/977ea5f1-cac4-48ed-8d62-bc90e5866877-kube-api-access-ghtsn") pod "network-check-target-2l4wn" (UID: "977ea5f1-cac4-48ed-8d62-bc90e5866877") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 02:39:12.776414 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:12.776380    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 02:39:12.776414 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:12.776412    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/152ac564-1081-4f4e-bf7c-fce7f2bc64a7-original-pull-secret podName:152ac564-1081-4f4e-bf7c-fce7f2bc64a7 nodeName:}" failed. No retries permitted until 2026-07-06 02:39:16.776401095 +0000 UTC m=+10.433410746 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/152ac564-1081-4f4e-bf7c-fce7f2bc64a7-original-pull-secret") pod "global-pull-secret-syncer-lkl9q" (UID: "152ac564-1081-4f4e-bf7c-fce7f2bc64a7") : object "kube-system"/"original-pull-secret" not registered
Jul 06 02:39:13.229579 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:13.229491    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4xxx"
Jul 06 02:39:13.230236 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:13.229663    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4xxx" podUID="35f61f76-1038-43ca-a749-71412ea26859"
Jul 06 02:39:13.230236 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:13.230098    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l4wn"
Jul 06 02:39:13.230236 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:13.230196    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l4wn" podUID="977ea5f1-cac4-48ed-8d62-bc90e5866877"
Jul 06 02:39:14.226878 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:14.226849    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkl9q"
Jul 06 02:39:14.227035 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:14.226957    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkl9q" podUID="152ac564-1081-4f4e-bf7c-fce7f2bc64a7"
Jul 06 02:39:15.227812 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:15.227659    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4xxx"
Jul 06 02:39:15.227812 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:15.227669    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l4wn"
Jul 06 02:39:15.228404 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:15.227815    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4xxx" podUID="35f61f76-1038-43ca-a749-71412ea26859"
Jul 06 02:39:15.228404 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:15.227874    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l4wn" podUID="977ea5f1-cac4-48ed-8d62-bc90e5866877"
Jul 06 02:39:16.227011 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:16.226626    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkl9q"
Jul 06 02:39:16.227011 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:16.226785    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkl9q" podUID="152ac564-1081-4f4e-bf7c-fce7f2bc64a7"
Jul 06 02:39:16.803998 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:16.803895    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/152ac564-1081-4f4e-bf7c-fce7f2bc64a7-original-pull-secret\") pod \"global-pull-secret-syncer-lkl9q\" (UID: \"152ac564-1081-4f4e-bf7c-fce7f2bc64a7\") " pod="kube-system/global-pull-secret-syncer-lkl9q"
Jul 06 02:39:16.803998 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:16.803967    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35f61f76-1038-43ca-a749-71412ea26859-metrics-certs\") pod \"network-metrics-daemon-j4xxx\" (UID: \"35f61f76-1038-43ca-a749-71412ea26859\") " pod="openshift-multus/network-metrics-daemon-j4xxx"
Jul 06 02:39:16.804486 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:16.804027    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghtsn\" (UniqueName: \"kubernetes.io/projected/977ea5f1-cac4-48ed-8d62-bc90e5866877-kube-api-access-ghtsn\") pod \"network-check-target-2l4wn\" (UID: \"977ea5f1-cac4-48ed-8d62-bc90e5866877\") " pod="openshift-network-diagnostics/network-check-target-2l4wn"
Jul 06 02:39:16.804486 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:16.804151    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 02:39:16.804486 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:16.804166    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 02:39:16.804486 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:16.804186    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 02:39:16.804486 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:16.804199    2570 projected.go:196] Error preparing data for projected volume kube-api-access-ghtsn for pod openshift-network-diagnostics/network-check-target-2l4wn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 02:39:16.804714 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:16.804585    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/152ac564-1081-4f4e-bf7c-fce7f2bc64a7-original-pull-secret podName:152ac564-1081-4f4e-bf7c-fce7f2bc64a7 nodeName:}" failed. No retries permitted until 2026-07-06 02:39:24.804206888 +0000 UTC m=+18.461216535 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/152ac564-1081-4f4e-bf7c-fce7f2bc64a7-original-pull-secret") pod "global-pull-secret-syncer-lkl9q" (UID: "152ac564-1081-4f4e-bf7c-fce7f2bc64a7") : object "kube-system"/"original-pull-secret" not registered
Jul 06 02:39:16.808769 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:16.806532    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/977ea5f1-cac4-48ed-8d62-bc90e5866877-kube-api-access-ghtsn podName:977ea5f1-cac4-48ed-8d62-bc90e5866877 nodeName:}" failed. No retries permitted until 2026-07-06 02:39:24.806505918 +0000 UTC m=+18.463515580 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ghtsn" (UniqueName: "kubernetes.io/projected/977ea5f1-cac4-48ed-8d62-bc90e5866877-kube-api-access-ghtsn") pod "network-check-target-2l4wn" (UID: "977ea5f1-cac4-48ed-8d62-bc90e5866877") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 02:39:16.808769 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:16.806667    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 02:39:16.808769 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:16.806733    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35f61f76-1038-43ca-a749-71412ea26859-metrics-certs podName:35f61f76-1038-43ca-a749-71412ea26859 nodeName:}" failed. No retries permitted until 2026-07-06 02:39:24.806708748 +0000 UTC m=+18.463718405 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35f61f76-1038-43ca-a749-71412ea26859-metrics-certs") pod "network-metrics-daemon-j4xxx" (UID: "35f61f76-1038-43ca-a749-71412ea26859") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 02:39:17.228670 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:17.228592    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l4wn"
Jul 06 02:39:17.228825 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:17.228707    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l4wn" podUID="977ea5f1-cac4-48ed-8d62-bc90e5866877"
Jul 06 02:39:17.228825 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:17.228763    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4xxx"
Jul 06 02:39:17.228933 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:17.228891    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4xxx" podUID="35f61f76-1038-43ca-a749-71412ea26859"
Jul 06 02:39:18.227441 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:18.227391    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkl9q"
Jul 06 02:39:18.227905 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:18.227531    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkl9q" podUID="152ac564-1081-4f4e-bf7c-fce7f2bc64a7"
Jul 06 02:39:19.227352 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:19.226788    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4xxx"
Jul 06 02:39:19.227352 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:19.226941    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4xxx" podUID="35f61f76-1038-43ca-a749-71412ea26859"
Jul 06 02:39:19.227352 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:19.227012    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l4wn"
Jul 06 02:39:19.227352 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:19.227117    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l4wn" podUID="977ea5f1-cac4-48ed-8d62-bc90e5866877"
Jul 06 02:39:20.227217 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:20.227183    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkl9q"
Jul 06 02:39:20.227353 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:20.227295    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkl9q" podUID="152ac564-1081-4f4e-bf7c-fce7f2bc64a7"
Jul 06 02:39:21.230644 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:21.230615    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l4wn"
Jul 06 02:39:21.231069 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:21.230624    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4xxx"
Jul 06 02:39:21.231069 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:21.230738    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l4wn" podUID="977ea5f1-cac4-48ed-8d62-bc90e5866877"
Jul 06 02:39:21.231069 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:21.230870    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4xxx" podUID="35f61f76-1038-43ca-a749-71412ea26859"
Jul 06 02:39:22.227233 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:22.227201    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkl9q"
Jul 06 02:39:22.227402 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:22.227310    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkl9q" podUID="152ac564-1081-4f4e-bf7c-fce7f2bc64a7"
Jul 06 02:39:23.227199 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:23.227166    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4xxx"
Jul 06 02:39:23.227639 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:23.227206    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l4wn"
Jul 06 02:39:23.227639 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:23.227299    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4xxx" podUID="35f61f76-1038-43ca-a749-71412ea26859"
Jul 06 02:39:23.227639 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:23.227431    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l4wn" podUID="977ea5f1-cac4-48ed-8d62-bc90e5866877"
Jul 06 02:39:24.227540 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:24.227505    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkl9q"
Jul 06 02:39:24.228010 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:24.227631    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkl9q" podUID="152ac564-1081-4f4e-bf7c-fce7f2bc64a7"
Jul 06 02:39:24.859218 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:24.859186    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghtsn\" (UniqueName: \"kubernetes.io/projected/977ea5f1-cac4-48ed-8d62-bc90e5866877-kube-api-access-ghtsn\") pod \"network-check-target-2l4wn\" (UID: \"977ea5f1-cac4-48ed-8d62-bc90e5866877\") " pod="openshift-network-diagnostics/network-check-target-2l4wn"
Jul 06 02:39:24.859383 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:24.859229    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/152ac564-1081-4f4e-bf7c-fce7f2bc64a7-original-pull-secret\") pod \"global-pull-secret-syncer-lkl9q\" (UID: \"152ac564-1081-4f4e-bf7c-fce7f2bc64a7\") " pod="kube-system/global-pull-secret-syncer-lkl9q"
Jul 06 02:39:24.859383 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:24.859269    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35f61f76-1038-43ca-a749-71412ea26859-metrics-certs\") pod \"network-metrics-daemon-j4xxx\" (UID: \"35f61f76-1038-43ca-a749-71412ea26859\") " pod="openshift-multus/network-metrics-daemon-j4xxx"
Jul 06 02:39:24.859383 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:24.859366    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 02:39:24.859483 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:24.859396    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 02:39:24.859483 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:24.859398    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 02:39:24.859483 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:24.859408    2570 projected.go:196] Error preparing data for projected volume kube-api-access-ghtsn for pod openshift-network-diagnostics/network-check-target-2l4wn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 02:39:24.859483 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:24.859460    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/152ac564-1081-4f4e-bf7c-fce7f2bc64a7-original-pull-secret podName:152ac564-1081-4f4e-bf7c-fce7f2bc64a7 nodeName:}" failed. No retries permitted until 2026-07-06 02:39:40.859444508 +0000 UTC m=+34.516454150 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/152ac564-1081-4f4e-bf7c-fce7f2bc64a7-original-pull-secret") pod "global-pull-secret-syncer-lkl9q" (UID: "152ac564-1081-4f4e-bf7c-fce7f2bc64a7") : object "kube-system"/"original-pull-secret" not registered
Jul 06 02:39:24.859616 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:24.859508    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/977ea5f1-cac4-48ed-8d62-bc90e5866877-kube-api-access-ghtsn podName:977ea5f1-cac4-48ed-8d62-bc90e5866877 nodeName:}" failed. No retries permitted until 2026-07-06 02:39:40.859494702 +0000 UTC m=+34.516504346 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ghtsn" (UniqueName: "kubernetes.io/projected/977ea5f1-cac4-48ed-8d62-bc90e5866877-kube-api-access-ghtsn") pod "network-check-target-2l4wn" (UID: "977ea5f1-cac4-48ed-8d62-bc90e5866877") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 02:39:24.859616 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:24.859369    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 02:39:24.859616 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:24.859547    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35f61f76-1038-43ca-a749-71412ea26859-metrics-certs podName:35f61f76-1038-43ca-a749-71412ea26859 nodeName:}" failed. No retries permitted until 2026-07-06 02:39:40.859537519 +0000 UTC m=+34.516547162 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35f61f76-1038-43ca-a749-71412ea26859-metrics-certs") pod "network-metrics-daemon-j4xxx" (UID: "35f61f76-1038-43ca-a749-71412ea26859") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 02:39:25.227159 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:25.227094    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l4wn"
Jul 06 02:39:25.227285 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:25.227099    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4xxx"
Jul 06 02:39:25.227285 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:25.227191    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l4wn" podUID="977ea5f1-cac4-48ed-8d62-bc90e5866877"
Jul 06 02:39:25.227346 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:25.227299    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4xxx" podUID="35f61f76-1038-43ca-a749-71412ea26859"
Jul 06 02:39:26.227347 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:26.227319    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkl9q"
Jul 06 02:39:26.227738 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:26.227436    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkl9q" podUID="152ac564-1081-4f4e-bf7c-fce7f2bc64a7"
Jul 06 02:39:27.227593 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:27.227560    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4xxx"
Jul 06 02:39:27.228003 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:27.227680    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4xxx" podUID="35f61f76-1038-43ca-a749-71412ea26859"
Jul 06 02:39:27.228003 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:27.227737    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l4wn"
Jul 06 02:39:27.228003 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:27.227854    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l4wn" podUID="977ea5f1-cac4-48ed-8d62-bc90e5866877"
Jul 06 02:39:28.227377 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:28.227348    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkl9q"
Jul 06 02:39:28.227553 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:28.227459    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkl9q" podUID="152ac564-1081-4f4e-bf7c-fce7f2bc64a7"
Jul 06 02:39:29.227292 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:29.227260    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4xxx"
Jul 06 02:39:29.227891 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:29.227386    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4xxx" podUID="35f61f76-1038-43ca-a749-71412ea26859"
Jul 06 02:39:29.227891 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:29.227422    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l4wn"
Jul 06 02:39:29.227891 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:29.227484    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l4wn" podUID="977ea5f1-cac4-48ed-8d62-bc90e5866877"
Jul 06 02:39:30.226835 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:30.226553    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkl9q"
Jul 06 02:39:30.226944 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:30.226915    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkl9q" podUID="152ac564-1081-4f4e-bf7c-fce7f2bc64a7"
Jul 06 02:39:30.373178 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:30.373143    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxkw" event={"ID":"e9bc32ae-ec69-4043-8b50-f2f60aef2325","Type":"ContainerStarted","Data":"7499a6f1776c1775945e0470e03239c5628e4e5c5e14c3a261d170cf1708a65c"}
Jul 06 02:39:30.374865 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:30.374834    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-drltx" event={"ID":"d6e0698e-7d78-4805-9704-03a57ae7ccce","Type":"ContainerStarted","Data":"ed1d9de3a70e0b67a3707ef571d0579c0ee33591c5c6992de08d1e9732f3d171"}
Jul 06 02:39:30.376424 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:30.376400    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mlsf8" event={"ID":"f8506b55-5900-4c57-bd12-9fda440b337a","Type":"ContainerStarted","Data":"27234274165b002fa0e2831c9ecf85e1f67039cecd3ce62bf6a9db7acf4843f0"}
Jul 06 02:39:30.379357 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:30.379341    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfxlc_b2861d04-c87b-43b1-9bff-2b2199a136a3/ovn-acl-logging/0.log"
Jul 06 02:39:30.379700 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:30.379677    2570 generic.go:356] "Generic (PLEG): container finished" podID="b2861d04-c87b-43b1-9bff-2b2199a136a3" containerID="14010829a6ccf11805e30e220e8d9114e8dfb1b8121099e049105828ae07a035" exitCode=1
Jul 06 02:39:30.379776 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:30.379757    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc" event={"ID":"b2861d04-c87b-43b1-9bff-2b2199a136a3","Type":"ContainerStarted","Data":"0d1051b97c89ca9b1003956e48596bab15dd32ca11d919e409ffa48f4cb16ab1"}
Jul 06 02:39:30.379864 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:30.379846    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc" event={"ID":"b2861d04-c87b-43b1-9bff-2b2199a136a3","Type":"ContainerStarted","Data":"35dd57c975a2ee7a355a41a638e91f965d8ac27ef1228df36909787ff741b4c4"}
Jul 06 02:39:30.379932 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:30.379898    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc" event={"ID":"b2861d04-c87b-43b1-9bff-2b2199a136a3","Type":"ContainerStarted","Data":"0605bceede64dc2a9da7f91d13e7ec04efb0c6242ea954d9f79ff56374910135"}
Jul 06 02:39:30.380000 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:30.379942    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc" event={"ID":"b2861d04-c87b-43b1-9bff-2b2199a136a3","Type":"ContainerStarted","Data":"583d45b864348fbd01c9c7e5a53e2cdca53b9469a1a45baa5cc728799915bc7a"}
Jul 06 02:39:30.380057 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:30.380008    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc" event={"ID":"b2861d04-c87b-43b1-9bff-2b2199a136a3","Type":"ContainerDied","Data":"14010829a6ccf11805e30e220e8d9114e8dfb1b8121099e049105828ae07a035"}
Jul 06 02:39:30.380099 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:30.380060    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc" event={"ID":"b2861d04-c87b-43b1-9bff-2b2199a136a3","Type":"ContainerStarted","Data":"74a150684281ff80c49c388061c001f0cc85a6eefcd65bb931739edbfa7f7d55"}
Jul 06 02:39:30.381504 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:30.381485    2570 generic.go:356] "Generic (PLEG): container finished" podID="988da6f0-e2d4-416f-bbfc-3812c7ae2f6a" containerID="9d6f57cd4c76ebace659c89b6fd837d931de50ee9b92232fd77c9edd4739efc0" exitCode=0
Jul 06 02:39:30.381614 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:30.381557    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lvbvz" event={"ID":"988da6f0-e2d4-416f-bbfc-3812c7ae2f6a","Type":"ContainerDied","Data":"9d6f57cd4c76ebace659c89b6fd837d931de50ee9b92232fd77c9edd4739efc0"}
Jul 06 02:39:30.383045 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:30.383033    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4ljj8" event={"ID":"a8e34855-89c9-415e-9513-596bb1ae12ae","Type":"ContainerStarted","Data":"7de83391fb19accba7a361c6af3f73797bc76717d8ee66949c5e81930425337d"}
Jul 06 02:39:30.384591 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:30.384573    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5whj9" event={"ID":"a77fd9ea-8544-4939-8ce0-82d039a56226","Type":"ContainerStarted","Data":"755e47aaac431dab055371750445d98ecc2169dc3b8b55fdbaa49ea128f638b7"}
Jul 06 02:39:30.385812 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:30.385794    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v6b8r" event={"ID":"5dea5b0e-3e8c-4ca2-9939-57e6bc1c2c80","Type":"ContainerStarted","Data":"488a4ac4423d8f44ca9130e347c38a2bf400c954b3fe492ba868f4b20fa8fa51"}
Jul 06 02:39:30.388636 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:30.388596    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-drltx" podStartSLOduration=3.3625072449999998 podStartE2EDuration="22.38857175s" totalImagesPullingTime="19.026064505s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 02:39:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:39:30.388262243 +0000 UTC m=+24.045271906" watchObservedRunningTime="2026-07-06 02:39:30.38857175 +0000 UTC m=+24.045581414"
Jul 06 02:39:30.388955 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:30.388918    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-238.ec2.internal" podStartSLOduration=21.388910421 podStartE2EDuration="21.388910421s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 02:39:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:39:12.346912032 +0000 UTC m=+6.003921702" watchObservedRunningTime="2026-07-06 02:39:30.388910421 +0000 UTC m=+24.045920087"
Jul 06 02:39:30.404206 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:30.404149    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4ljj8" podStartSLOduration=3.331573894 podStartE2EDuration="22.40413581s" totalImagesPullingTime="19.072561916s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 02:39:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:39:30.403787854 +0000 UTC m=+24.060797520" watchObservedRunningTime="2026-07-06 02:39:30.40413581 +0000 UTC m=+24.061145486"
Jul 06 02:39:30.419386 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:30.419348    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-v6b8r" podStartSLOduration=3.394772307 podStartE2EDuration="22.419332085s" totalImagesPullingTime="19.024559778s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 02:39:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:39:30.418697436 +0000 UTC m=+24.075707099" watchObservedRunningTime="2026-07-06 02:39:30.419332085 +0000 UTC m=+24.076341750"
Jul 06 02:39:30.431951 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:30.431908    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mlsf8" podStartSLOduration=8.007255179 podStartE2EDuration="22.431896612s" totalImagesPullingTime="14.424641433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:39:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:39:30.431761186 +0000 UTC m=+24.088770850" watchObservedRunningTime="2026-07-06 02:39:30.431896612 +0000 UTC m=+24.088906276"
Jul 06 02:39:30.475507 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:30.475451    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5whj9" podStartSLOduration=3.436074457 podStartE2EDuration="22.475436099s" totalImagesPullingTime="19.039361642s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 02:39:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:39:30.475211453 +0000 UTC m=+24.132221117" watchObservedRunningTime="2026-07-06 02:39:30.475436099 +0000 UTC m=+24.132445762"
Jul 06 02:39:31.105412 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:31.105385    2570 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 02:39:31.193168 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:31.193071    2570 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T02:39:31.105408848Z","UUID":"1f61c692-75c5-4886-b528-738346a9f8ed","Handler":null,"Name":"","Endpoint":""}
Jul 06 02:39:31.194439 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:31.194419    2570 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 02:39:31.194538 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:31.194454    2570 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 02:39:31.227021 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:31.226947    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4xxx"
Jul 06 02:39:31.227021 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:31.226947    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l4wn"
Jul 06 02:39:31.227134 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:31.227072    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4xxx" podUID="35f61f76-1038-43ca-a749-71412ea26859"
Jul 06 02:39:31.227201 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:31.227183    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l4wn" podUID="977ea5f1-cac4-48ed-8d62-bc90e5866877"
Jul 06 02:39:31.390861 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:31.390801    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxkw" event={"ID":"e9bc32ae-ec69-4043-8b50-f2f60aef2325","Type":"ContainerStarted","Data":"0be00b02c18c97dccc8a75a3f5c362376b97df64aaa6f6149a199b544bf5684d"}
Jul 06 02:39:31.392492 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:31.392453    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fmv2g" event={"ID":"ed4531c4-65eb-4d08-9cae-ce9ca7f19fa1","Type":"ContainerStarted","Data":"53d359a77f728ee21c858b04c8861493e8afc49e289632372c0676880b707e2c"}
Jul 06 02:39:31.407556 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:31.407493    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fmv2g" podStartSLOduration=4.381995205 podStartE2EDuration="23.4074752s" totalImagesPullingTime="19.025479995s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 02:39:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:39:31.407103243 +0000 UTC m=+25.064112908" watchObservedRunningTime="2026-07-06 02:39:31.4074752 +0000 UTC m=+25.064485058"
Jul 06 02:39:32.227303 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:32.227238    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkl9q"
Jul 06 02:39:32.227423 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:32.227353    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkl9q" podUID="152ac564-1081-4f4e-bf7c-fce7f2bc64a7"
Jul 06 02:39:32.398255 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:32.397968    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxkw" event={"ID":"e9bc32ae-ec69-4043-8b50-f2f60aef2325","Type":"ContainerStarted","Data":"82420a86577bda11ccfa4586279890db1ef4a64e456f926b7d221087162b91b1"}
Jul 06 02:39:32.401547 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:32.401525    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfxlc_b2861d04-c87b-43b1-9bff-2b2199a136a3/ovn-acl-logging/0.log"
Jul 06 02:39:32.402051 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:32.401941    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc" event={"ID":"b2861d04-c87b-43b1-9bff-2b2199a136a3","Type":"ContainerStarted","Data":"aa9db7a9da588cc12fa1150eba229dfee593288503d1e0492e097311dc60d2fa"}
Jul 06 02:39:32.419625 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:32.419586    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khxkw" podStartSLOduration=3.261064413 podStartE2EDuration="24.419571621s" totalImagesPullingTime="21.158507208s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 02:39:08 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:39:32.418912252 +0000 UTC m=+26.075921917" watchObservedRunningTime="2026-07-06 02:39:32.419571621 +0000 UTC m=+26.076581322"
Jul 06 02:39:33.226915 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:33.226884    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l4wn"
Jul 06 02:39:33.226915 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:33.226908    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4xxx"
Jul 06 02:39:33.227162 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:33.227028    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l4wn" podUID="977ea5f1-cac4-48ed-8d62-bc90e5866877"
Jul 06 02:39:33.227590 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:33.227550    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4xxx" podUID="35f61f76-1038-43ca-a749-71412ea26859"
Jul 06 02:39:33.357077 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:33.357042    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mlsf8"
Jul 06 02:39:34.227392 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:34.227367    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkl9q"
Jul 06 02:39:34.227964 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:34.227460    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkl9q" podUID="152ac564-1081-4f4e-bf7c-fce7f2bc64a7"
Jul 06 02:39:34.470058 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:34.470027    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mlsf8"
Jul 06 02:39:34.470683 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:34.470665    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mlsf8"
Jul 06 02:39:35.227178 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:35.226817    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4xxx"
Jul 06 02:39:35.227178 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:35.226876    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l4wn"
Jul 06 02:39:35.227461 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:35.227168    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4xxx" podUID="35f61f76-1038-43ca-a749-71412ea26859"
Jul 06 02:39:35.227461 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:35.227251    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l4wn" podUID="977ea5f1-cac4-48ed-8d62-bc90e5866877"
Jul 06 02:39:35.411551 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:35.411526    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfxlc_b2861d04-c87b-43b1-9bff-2b2199a136a3/ovn-acl-logging/0.log"
Jul 06 02:39:35.411998 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:35.411960    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc" event={"ID":"b2861d04-c87b-43b1-9bff-2b2199a136a3","Type":"ContainerStarted","Data":"587439a5061b996acb3c7bfdccf9e275c11614e85768cc28abd69e0e809e1b9b"}
Jul 06 02:39:35.412252 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:35.412233    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:35.412450 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:35.412433    2570 scope.go:117] "RemoveContainer" containerID="14010829a6ccf11805e30e220e8d9114e8dfb1b8121099e049105828ae07a035"
Jul 06 02:39:35.414066 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:35.414035    2570 generic.go:356] "Generic (PLEG): container finished" podID="988da6f0-e2d4-416f-bbfc-3812c7ae2f6a" containerID="00374ebe2232985f2d68961ec55bd12aba2b5abde0c0a9bf0db731e0d709cbd6" exitCode=0
Jul 06 02:39:35.414161 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:35.414076    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lvbvz" event={"ID":"988da6f0-e2d4-416f-bbfc-3812c7ae2f6a","Type":"ContainerDied","Data":"00374ebe2232985f2d68961ec55bd12aba2b5abde0c0a9bf0db731e0d709cbd6"}
Jul 06 02:39:35.414811 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:35.414744    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mlsf8"
Jul 06 02:39:35.427834 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:35.427813    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:36.227519 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:36.227482    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkl9q"
Jul 06 02:39:36.227941 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:36.227600    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkl9q" podUID="152ac564-1081-4f4e-bf7c-fce7f2bc64a7"
Jul 06 02:39:36.420389 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:36.420364    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfxlc_b2861d04-c87b-43b1-9bff-2b2199a136a3/ovn-acl-logging/0.log"
Jul 06 02:39:36.420953 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:36.420862    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc" event={"ID":"b2861d04-c87b-43b1-9bff-2b2199a136a3","Type":"ContainerStarted","Data":"5038d1839a3486a576dfdc5bd4f457e2891f65983c1b3982fc85280b7bf1da4f"}
Jul 06 02:39:36.421308 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:36.421171    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:36.421308 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:36.421251    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:36.423859 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:36.423776    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lvbvz" event={"ID":"988da6f0-e2d4-416f-bbfc-3812c7ae2f6a","Type":"ContainerStarted","Data":"e5d51a2d5aae5d5450f69ecf3620fe834544efccaa331ba33807d0092e80e0cb"}
Jul 06 02:39:36.440624 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:36.440537    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:39:36.450062 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:36.450010    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc" podStartSLOduration=9.136003634 podStartE2EDuration="28.449975438s" totalImagesPullingTime="19.313971804s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 02:39:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:39:36.448447547 +0000 UTC m=+30.105457212" watchObservedRunningTime="2026-07-06 02:39:36.449975438 +0000 UTC m=+30.106985102"
Jul 06 02:39:37.112482 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:37.112300    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lkl9q"]
Jul 06 02:39:37.112655 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:37.112551    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkl9q"
Jul 06 02:39:37.112655 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:37.112639    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkl9q" podUID="152ac564-1081-4f4e-bf7c-fce7f2bc64a7"
Jul 06 02:39:37.115786 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:37.115756    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-j4xxx"]
Jul 06 02:39:37.115921 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:37.115882    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4xxx"
Jul 06 02:39:37.116026 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:37.116006    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4xxx" podUID="35f61f76-1038-43ca-a749-71412ea26859"
Jul 06 02:39:37.119751 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:37.117381    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2l4wn"]
Jul 06 02:39:37.119751 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:37.117531    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l4wn"
Jul 06 02:39:37.119751 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:37.117653    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l4wn" podUID="977ea5f1-cac4-48ed-8d62-bc90e5866877"
Jul 06 02:39:37.427278 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:37.427197    2570 generic.go:356] "Generic (PLEG): container finished" podID="988da6f0-e2d4-416f-bbfc-3812c7ae2f6a" containerID="e5d51a2d5aae5d5450f69ecf3620fe834544efccaa331ba33807d0092e80e0cb" exitCode=0
Jul 06 02:39:37.427629 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:37.427278    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lvbvz" event={"ID":"988da6f0-e2d4-416f-bbfc-3812c7ae2f6a","Type":"ContainerDied","Data":"e5d51a2d5aae5d5450f69ecf3620fe834544efccaa331ba33807d0092e80e0cb"}
Jul 06 02:39:38.431680 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:38.431646    2570 generic.go:356] "Generic (PLEG): container finished" podID="988da6f0-e2d4-416f-bbfc-3812c7ae2f6a" containerID="c9a3ce42ac3de79e804dad11aa1e43189beaddce08e9954acf4f9c4e56a7692f" exitCode=0
Jul 06 02:39:38.432272 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:38.431738    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lvbvz" event={"ID":"988da6f0-e2d4-416f-bbfc-3812c7ae2f6a","Type":"ContainerDied","Data":"c9a3ce42ac3de79e804dad11aa1e43189beaddce08e9954acf4f9c4e56a7692f"}
Jul 06 02:39:39.227460 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:39.227431    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkl9q"
Jul 06 02:39:39.227578 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:39.227443    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4xxx"
Jul 06 02:39:39.227578 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:39.227544    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l4wn"
Jul 06 02:39:39.227578 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:39.227541    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkl9q" podUID="152ac564-1081-4f4e-bf7c-fce7f2bc64a7"
Jul 06 02:39:39.227679 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:39.227634    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4xxx" podUID="35f61f76-1038-43ca-a749-71412ea26859"
Jul 06 02:39:39.227737 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:39.227719    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l4wn" podUID="977ea5f1-cac4-48ed-8d62-bc90e5866877"
Jul 06 02:39:40.888568 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:40.888535    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghtsn\" (UniqueName: \"kubernetes.io/projected/977ea5f1-cac4-48ed-8d62-bc90e5866877-kube-api-access-ghtsn\") pod \"network-check-target-2l4wn\" (UID: \"977ea5f1-cac4-48ed-8d62-bc90e5866877\") " pod="openshift-network-diagnostics/network-check-target-2l4wn"
Jul 06 02:39:40.889365 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:40.888587    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/152ac564-1081-4f4e-bf7c-fce7f2bc64a7-original-pull-secret\") pod \"global-pull-secret-syncer-lkl9q\" (UID: \"152ac564-1081-4f4e-bf7c-fce7f2bc64a7\") " pod="kube-system/global-pull-secret-syncer-lkl9q"
Jul 06 02:39:40.889365 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:40.888700    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 02:39:40.889365 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:40.888726    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 02:39:40.889365 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:40.888740    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35f61f76-1038-43ca-a749-71412ea26859-metrics-certs\") pod \"network-metrics-daemon-j4xxx\" (UID: \"35f61f76-1038-43ca-a749-71412ea26859\") " pod="openshift-multus/network-metrics-daemon-j4xxx"
Jul 06 02:39:40.889365 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:40.888753    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/152ac564-1081-4f4e-bf7c-fce7f2bc64a7-original-pull-secret podName:152ac564-1081-4f4e-bf7c-fce7f2bc64a7 nodeName:}" failed. No retries permitted until 2026-07-06 02:40:12.88873625 +0000 UTC m=+66.545745906 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/152ac564-1081-4f4e-bf7c-fce7f2bc64a7-original-pull-secret") pod "global-pull-secret-syncer-lkl9q" (UID: "152ac564-1081-4f4e-bf7c-fce7f2bc64a7") : object "kube-system"/"original-pull-secret" not registered
Jul 06 02:39:40.889365 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:40.888754    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 02:39:40.889365 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:40.888809    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 02:39:40.889365 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:40.888812    2570 projected.go:196] Error preparing data for projected volume kube-api-access-ghtsn for pod openshift-network-diagnostics/network-check-target-2l4wn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 02:39:40.889365 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:40.888850    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35f61f76-1038-43ca-a749-71412ea26859-metrics-certs podName:35f61f76-1038-43ca-a749-71412ea26859 nodeName:}" failed. No retries permitted until 2026-07-06 02:40:12.888838013 +0000 UTC m=+66.545847655 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35f61f76-1038-43ca-a749-71412ea26859-metrics-certs") pod "network-metrics-daemon-j4xxx" (UID: "35f61f76-1038-43ca-a749-71412ea26859") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 02:39:40.889365 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:40.888870    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/977ea5f1-cac4-48ed-8d62-bc90e5866877-kube-api-access-ghtsn podName:977ea5f1-cac4-48ed-8d62-bc90e5866877 nodeName:}" failed. No retries permitted until 2026-07-06 02:40:12.888859014 +0000 UTC m=+66.545868661 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ghtsn" (UniqueName: "kubernetes.io/projected/977ea5f1-cac4-48ed-8d62-bc90e5866877-kube-api-access-ghtsn") pod "network-check-target-2l4wn" (UID: "977ea5f1-cac4-48ed-8d62-bc90e5866877") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 02:39:41.227316 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:41.227288    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l4wn"
Jul 06 02:39:41.227316 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:41.227311    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4xxx"
Jul 06 02:39:41.227513 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:41.227380    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l4wn" podUID="977ea5f1-cac4-48ed-8d62-bc90e5866877"
Jul 06 02:39:41.227513 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:41.227428    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4xxx" podUID="35f61f76-1038-43ca-a749-71412ea26859"
Jul 06 02:39:41.227513 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:41.227452    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkl9q"
Jul 06 02:39:41.227672 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:41.227523    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkl9q" podUID="152ac564-1081-4f4e-bf7c-fce7f2bc64a7"
Jul 06 02:39:43.227320 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.227155    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkl9q"
Jul 06 02:39:43.227638 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.227162    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4xxx"
Jul 06 02:39:43.227638 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.227226    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l4wn"
Jul 06 02:39:43.227752 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:43.227678    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lkl9q" podUID="152ac564-1081-4f4e-bf7c-fce7f2bc64a7"
Jul 06 02:39:43.230282 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:43.228131    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2l4wn" podUID="977ea5f1-cac4-48ed-8d62-bc90e5866877"
Jul 06 02:39:43.230282 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:43.228363    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j4xxx" podUID="35f61f76-1038-43ca-a749-71412ea26859"
Jul 06 02:39:43.640413 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.640387    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-238.ec2.internal" event="NodeReady"
Jul 06 02:39:43.640545 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.640531    2570 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 02:39:43.672309 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.672281    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-jfb42"]
Jul 06 02:39:43.695667 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.695642    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8578d6475c-nmhmd"]
Jul 06 02:39:43.695810 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.695790    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-jfb42"
Jul 06 02:39:43.698268 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.698211    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 06 02:39:43.698408 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.698389    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-gzhdc\""
Jul 06 02:39:43.698739 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.698652    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 06 02:39:43.717842 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.717819    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-jfb42"]
Jul 06 02:39:43.717969 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.717851    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lfk4b"]
Jul 06 02:39:43.717969 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.717951    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8578d6475c-nmhmd"
Jul 06 02:39:43.720336 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.720138    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 06 02:39:43.720336 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.720164    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 06 02:39:43.720336 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.720189    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 06 02:39:43.720612 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.720596    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-k6b24\""
Jul 06 02:39:43.724016 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.723996    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 06 02:39:43.735699 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.735674    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8578d6475c-nmhmd"]
Jul 06 02:39:43.735804 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.735718    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-775zk"]
Jul 06 02:39:43.735804 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.735797    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lfk4b"
Jul 06 02:39:43.738172 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.738153    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 02:39:43.738489 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.738410    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 02:39:43.738489 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.738451    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 02:39:43.738633 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.738571    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-sfslh\""
Jul 06 02:39:43.753653 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.753634    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lfk4b"]
Jul 06 02:39:43.753747 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.753672    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-775zk"]
Jul 06 02:39:43.753747 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.753740    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-775zk"
Jul 06 02:39:43.755972 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.755955    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lsrhl\""
Jul 06 02:39:43.755972 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.755970    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 02:39:43.756122 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.755992    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 02:39:43.810138 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.810117    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-ca-trust-extracted\") pod \"image-registry-8578d6475c-nmhmd\" (UID: \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\") " pod="openshift-image-registry/image-registry-8578d6475c-nmhmd"
Jul 06 02:39:43.810217 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.810144    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/072a4522-4dd2-440e-b0c0-d0b131322bca-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-jfb42\" (UID: \"072a4522-4dd2-440e-b0c0-d0b131322bca\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-jfb42"
Jul 06 02:39:43.810217 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.810165    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-installation-pull-secrets\") pod \"image-registry-8578d6475c-nmhmd\" (UID: \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\") " pod="openshift-image-registry/image-registry-8578d6475c-nmhmd"
Jul 06 02:39:43.810217 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.810183    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9522\" (UniqueName: \"kubernetes.io/projected/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-kube-api-access-n9522\") pod \"image-registry-8578d6475c-nmhmd\" (UID: \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\") " pod="openshift-image-registry/image-registry-8578d6475c-nmhmd"
Jul 06 02:39:43.810217 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.810198    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90203301-698e-4c93-abcc-211c1d8bdd51-cert\") pod \"ingress-canary-lfk4b\" (UID: \"90203301-698e-4c93-abcc-211c1d8bdd51\") " pod="openshift-ingress-canary/ingress-canary-lfk4b"
Jul 06 02:39:43.810217 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.810214    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vl4d\" (UniqueName: \"kubernetes.io/projected/90203301-698e-4c93-abcc-211c1d8bdd51-kube-api-access-9vl4d\") pod \"ingress-canary-lfk4b\" (UID: \"90203301-698e-4c93-abcc-211c1d8bdd51\") " pod="openshift-ingress-canary/ingress-canary-lfk4b"
Jul 06 02:39:43.810372 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.810287    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z6ff\" (UniqueName: \"kubernetes.io/projected/268b24ef-43c1-4813-b69e-0ba3f6cf44ad-kube-api-access-2z6ff\") pod \"dns-default-775zk\" (UID: \"268b24ef-43c1-4813-b69e-0ba3f6cf44ad\") " pod="openshift-dns/dns-default-775zk"
Jul 06 02:39:43.810372 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.810312    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/268b24ef-43c1-4813-b69e-0ba3f6cf44ad-config-volume\") pod \"dns-default-775zk\" (UID: \"268b24ef-43c1-4813-b69e-0ba3f6cf44ad\") " pod="openshift-dns/dns-default-775zk"
Jul 06 02:39:43.810372 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.810332    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-image-registry-private-configuration\") pod \"image-registry-8578d6475c-nmhmd\" (UID: \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\") " pod="openshift-image-registry/image-registry-8578d6475c-nmhmd"
Jul 06 02:39:43.810372 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.810347    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-bound-sa-token\") pod \"image-registry-8578d6475c-nmhmd\" (UID: \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\") " pod="openshift-image-registry/image-registry-8578d6475c-nmhmd"
Jul 06 02:39:43.810491 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.810387    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/268b24ef-43c1-4813-b69e-0ba3f6cf44ad-metrics-tls\") pod \"dns-default-775zk\" (UID: \"268b24ef-43c1-4813-b69e-0ba3f6cf44ad\") " pod="openshift-dns/dns-default-775zk"
Jul 06 02:39:43.810491 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.810413    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-registry-tls\") pod \"image-registry-8578d6475c-nmhmd\" (UID: \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\") " pod="openshift-image-registry/image-registry-8578d6475c-nmhmd"
Jul 06 02:39:43.810491 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.810430    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-registry-certificates\") pod \"image-registry-8578d6475c-nmhmd\" (UID: \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\") " pod="openshift-image-registry/image-registry-8578d6475c-nmhmd"
Jul 06 02:39:43.810491 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.810462    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/268b24ef-43c1-4813-b69e-0ba3f6cf44ad-tmp-dir\") pod \"dns-default-775zk\" (UID: \"268b24ef-43c1-4813-b69e-0ba3f6cf44ad\") " pod="openshift-dns/dns-default-775zk"
Jul 06 02:39:43.810604 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.810528    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/072a4522-4dd2-440e-b0c0-d0b131322bca-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-jfb42\" (UID: \"072a4522-4dd2-440e-b0c0-d0b131322bca\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-jfb42"
Jul 06 02:39:43.810604 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.810550    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-trusted-ca\") pod \"image-registry-8578d6475c-nmhmd\" (UID: \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\") " pod="openshift-image-registry/image-registry-8578d6475c-nmhmd"
Jul 06 02:39:43.826253 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.826230    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:39:43.910749 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.910726    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/268b24ef-43c1-4813-b69e-0ba3f6cf44ad-metrics-tls\") pod \"dns-default-775zk\" (UID: \"268b24ef-43c1-4813-b69e-0ba3f6cf44ad\") " pod="openshift-dns/dns-default-775zk"
Jul 06 02:39:43.910835 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.910753    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-registry-tls\") pod \"image-registry-8578d6475c-nmhmd\" (UID: \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\") " pod="openshift-image-registry/image-registry-8578d6475c-nmhmd"
Jul 06 02:39:43.910835 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.910770    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-registry-certificates\") pod \"image-registry-8578d6475c-nmhmd\" (UID: \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\") " pod="openshift-image-registry/image-registry-8578d6475c-nmhmd"
Jul 06 02:39:43.910835 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.910793    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/268b24ef-43c1-4813-b69e-0ba3f6cf44ad-tmp-dir\") pod \"dns-default-775zk\" (UID: \"268b24ef-43c1-4813-b69e-0ba3f6cf44ad\") " pod="openshift-dns/dns-default-775zk"
Jul 06 02:39:43.910835 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.910832    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/072a4522-4dd2-440e-b0c0-d0b131322bca-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-jfb42\" (UID: \"072a4522-4dd2-440e-b0c0-d0b131322bca\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-jfb42"
Jul 06 02:39:43.911068 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.910859    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-trusted-ca\") pod \"image-registry-8578d6475c-nmhmd\" (UID: \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\") " pod="openshift-image-registry/image-registry-8578d6475c-nmhmd"
Jul 06 02:39:43.911068 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:43.910867    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 02:39:43.911068 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:43.910878    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 02:39:43.911068 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:43.910894    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8578d6475c-nmhmd: secret "image-registry-tls" not found
Jul 06 02:39:43.911068 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.910894    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-ca-trust-extracted\") pod \"image-registry-8578d6475c-nmhmd\" (UID: \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\") " pod="openshift-image-registry/image-registry-8578d6475c-nmhmd"
Jul 06 02:39:43.911068 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:43.910921    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/268b24ef-43c1-4813-b69e-0ba3f6cf44ad-metrics-tls podName:268b24ef-43c1-4813-b69e-0ba3f6cf44ad nodeName:}" failed. No retries permitted until 2026-07-06 02:39:44.410902717 +0000 UTC m=+38.067912376 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/268b24ef-43c1-4813-b69e-0ba3f6cf44ad-metrics-tls") pod "dns-default-775zk" (UID: "268b24ef-43c1-4813-b69e-0ba3f6cf44ad") : secret "dns-default-metrics-tls" not found
Jul 06 02:39:43.911068 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:43.910950    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-registry-tls podName:aa4ac53c-39b9-4b21-a3d1-e3c16418c50e nodeName:}" failed. No retries permitted until 2026-07-06 02:39:44.410934548 +0000 UTC m=+38.067944192 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-registry-tls") pod "image-registry-8578d6475c-nmhmd" (UID: "aa4ac53c-39b9-4b21-a3d1-e3c16418c50e") : secret "image-registry-tls" not found
Jul 06 02:39:43.911068 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.911039    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/072a4522-4dd2-440e-b0c0-d0b131322bca-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-jfb42\" (UID: \"072a4522-4dd2-440e-b0c0-d0b131322bca\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-jfb42"
Jul 06 02:39:43.911449 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.911073    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-installation-pull-secrets\") pod \"image-registry-8578d6475c-nmhmd\" (UID: \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\") " pod="openshift-image-registry/image-registry-8578d6475c-nmhmd"
Jul 06 02:39:43.911449 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.911097    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9522\" (UniqueName: \"kubernetes.io/projected/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-kube-api-access-n9522\") pod \"image-registry-8578d6475c-nmhmd\" (UID: \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\") " pod="openshift-image-registry/image-registry-8578d6475c-nmhmd"
Jul 06 02:39:43.911449 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.911122    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90203301-698e-4c93-abcc-211c1d8bdd51-cert\") pod \"ingress-canary-lfk4b\" (UID: \"90203301-698e-4c93-abcc-211c1d8bdd51\") " pod="openshift-ingress-canary/ingress-canary-lfk4b"
Jul 06 02:39:43.911449 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.911148    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vl4d\" (UniqueName: \"kubernetes.io/projected/90203301-698e-4c93-abcc-211c1d8bdd51-kube-api-access-9vl4d\") pod \"ingress-canary-lfk4b\" (UID: \"90203301-698e-4c93-abcc-211c1d8bdd51\") " pod="openshift-ingress-canary/ingress-canary-lfk4b"
Jul 06 02:39:43.911449 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.911169    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/268b24ef-43c1-4813-b69e-0ba3f6cf44ad-tmp-dir\") pod \"dns-default-775zk\" (UID: \"268b24ef-43c1-4813-b69e-0ba3f6cf44ad\") " pod="openshift-dns/dns-default-775zk"
Jul 06 02:39:43.911449 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.911196    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z6ff\" (UniqueName: \"kubernetes.io/projected/268b24ef-43c1-4813-b69e-0ba3f6cf44ad-kube-api-access-2z6ff\") pod \"dns-default-775zk\" (UID: \"268b24ef-43c1-4813-b69e-0ba3f6cf44ad\") " pod="openshift-dns/dns-default-775zk"
Jul 06 02:39:43.911449 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.911234    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/268b24ef-43c1-4813-b69e-0ba3f6cf44ad-config-volume\") pod \"dns-default-775zk\" (UID: \"268b24ef-43c1-4813-b69e-0ba3f6cf44ad\") " pod="openshift-dns/dns-default-775zk"
Jul 06 02:39:43.911449 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:43.911252    2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 02:39:43.911449 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.911262    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-image-registry-private-configuration\") pod \"image-registry-8578d6475c-nmhmd\" (UID: \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\") " pod="openshift-image-registry/image-registry-8578d6475c-nmhmd"
Jul 06 02:39:43.911449 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.911288    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-bound-sa-token\") pod \"image-registry-8578d6475c-nmhmd\" (UID: \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\") " pod="openshift-image-registry/image-registry-8578d6475c-nmhmd"
Jul 06 02:39:43.911449 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.911292    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-ca-trust-extracted\") pod \"image-registry-8578d6475c-nmhmd\" (UID: \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\") " pod="openshift-image-registry/image-registry-8578d6475c-nmhmd"
Jul 06 02:39:43.911449 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:43.911304    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/072a4522-4dd2-440e-b0c0-d0b131322bca-networking-console-plugin-cert podName:072a4522-4dd2-440e-b0c0-d0b131322bca nodeName:}" failed. No retries permitted until 2026-07-06 02:39:44.411290396 +0000 UTC m=+38.068300053 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/072a4522-4dd2-440e-b0c0-d0b131322bca-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-jfb42" (UID: "072a4522-4dd2-440e-b0c0-d0b131322bca") : secret "networking-console-plugin-cert" not found
Jul 06 02:39:43.912072 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.911496    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-registry-certificates\") pod \"image-registry-8578d6475c-nmhmd\" (UID: \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\") " pod="openshift-image-registry/image-registry-8578d6475c-nmhmd"
Jul 06 02:39:43.912072 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.911759    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/072a4522-4dd2-440e-b0c0-d0b131322bca-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-jfb42\" (UID: \"072a4522-4dd2-440e-b0c0-d0b131322bca\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-jfb42"
Jul 06 02:39:43.912072 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.911863    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-trusted-ca\") pod \"image-registry-8578d6475c-nmhmd\" (UID: \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\") " pod="openshift-image-registry/image-registry-8578d6475c-nmhmd"
Jul 06 02:39:43.912072 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.912019    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/268b24ef-43c1-4813-b69e-0ba3f6cf44ad-config-volume\") pod \"dns-default-775zk\" (UID: \"268b24ef-43c1-4813-b69e-0ba3f6cf44ad\") " pod="openshift-dns/dns-default-775zk"
Jul 06 02:39:43.912851 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.912825    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:39:43.915402 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.915384    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-image-registry-private-configuration\") pod \"image-registry-8578d6475c-nmhmd\" (UID: \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\") " pod="openshift-image-registry/image-registry-8578d6475c-nmhmd"
Jul 06 02:39:43.915480 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.915435    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-installation-pull-secrets\") pod \"image-registry-8578d6475c-nmhmd\" (UID: \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\") " pod="openshift-image-registry/image-registry-8578d6475c-nmhmd"
Jul 06 02:39:43.915480 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.915442    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90203301-698e-4c93-abcc-211c1d8bdd51-cert\") pod \"ingress-canary-lfk4b\" (UID: \"90203301-698e-4c93-abcc-211c1d8bdd51\") " pod="openshift-ingress-canary/ingress-canary-lfk4b"
Jul 06 02:39:43.919142 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.919121    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vl4d\" (UniqueName: \"kubernetes.io/projected/90203301-698e-4c93-abcc-211c1d8bdd51-kube-api-access-9vl4d\") pod \"ingress-canary-lfk4b\" (UID: \"90203301-698e-4c93-abcc-211c1d8bdd51\") " pod="openshift-ingress-canary/ingress-canary-lfk4b"
Jul 06 02:39:43.919269 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.919251    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-bound-sa-token\") pod \"image-registry-8578d6475c-nmhmd\" (UID: \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\") " pod="openshift-image-registry/image-registry-8578d6475c-nmhmd"
Jul 06 02:39:43.919456 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.919438    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z6ff\" (UniqueName: \"kubernetes.io/projected/268b24ef-43c1-4813-b69e-0ba3f6cf44ad-kube-api-access-2z6ff\") pod \"dns-default-775zk\" (UID: \"268b24ef-43c1-4813-b69e-0ba3f6cf44ad\") " pod="openshift-dns/dns-default-775zk"
Jul 06 02:39:43.920426 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:43.920402    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9522\" (UniqueName: \"kubernetes.io/projected/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-kube-api-access-n9522\") pod \"image-registry-8578d6475c-nmhmd\" (UID: \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\") " pod="openshift-image-registry/image-registry-8578d6475c-nmhmd"
Jul 06 02:39:44.089997 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:44.089922    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lfk4b"
Jul 06 02:39:44.268740 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:44.268712    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:39:44.279978 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:44.279951    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lfk4b"]
Jul 06 02:39:44.284385 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:39:44.284352    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90203301_698e_4c93_abcc_211c1d8bdd51.slice/crio-25741b969336a925f68ab1218fdb3927565ca895596f91121db5a9124a368d26 WatchSource:0}: Error finding container 25741b969336a925f68ab1218fdb3927565ca895596f91121db5a9124a368d26: Status 404 returned error can't find the container with id 25741b969336a925f68ab1218fdb3927565ca895596f91121db5a9124a368d26
Jul 06 02:39:44.368834 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:44.368776    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:39:44.416144 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:44.416121    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/072a4522-4dd2-440e-b0c0-d0b131322bca-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-jfb42\" (UID: \"072a4522-4dd2-440e-b0c0-d0b131322bca\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-jfb42"
Jul 06 02:39:44.416211 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:44.416182    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/268b24ef-43c1-4813-b69e-0ba3f6cf44ad-metrics-tls\") pod \"dns-default-775zk\" (UID: \"268b24ef-43c1-4813-b69e-0ba3f6cf44ad\") " pod="openshift-dns/dns-default-775zk"
Jul 06 02:39:44.416264 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:44.416252    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 02:39:44.416303 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:44.416272    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-registry-tls\") pod \"image-registry-8578d6475c-nmhmd\" (UID: \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\") " pod="openshift-image-registry/image-registry-8578d6475c-nmhmd"
Jul 06 02:39:44.416303 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:44.416292    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/268b24ef-43c1-4813-b69e-0ba3f6cf44ad-metrics-tls podName:268b24ef-43c1-4813-b69e-0ba3f6cf44ad nodeName:}" failed. No retries permitted until 2026-07-06 02:39:45.416281462 +0000 UTC m=+39.073291105 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/268b24ef-43c1-4813-b69e-0ba3f6cf44ad-metrics-tls") pod "dns-default-775zk" (UID: "268b24ef-43c1-4813-b69e-0ba3f6cf44ad") : secret "dns-default-metrics-tls" not found
Jul 06 02:39:44.416379 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:44.416253    2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 02:39:44.416379 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:44.416319    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 02:39:44.416379 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:44.416327    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8578d6475c-nmhmd: secret "image-registry-tls" not found
Jul 06 02:39:44.416379 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:44.416370    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/072a4522-4dd2-440e-b0c0-d0b131322bca-networking-console-plugin-cert podName:072a4522-4dd2-440e-b0c0-d0b131322bca nodeName:}" failed. No retries permitted until 2026-07-06 02:39:45.416351498 +0000 UTC m=+39.073361361 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/072a4522-4dd2-440e-b0c0-d0b131322bca-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-jfb42" (UID: "072a4522-4dd2-440e-b0c0-d0b131322bca") : secret "networking-console-plugin-cert" not found
Jul 06 02:39:44.416503 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:44.416386    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-registry-tls podName:aa4ac53c-39b9-4b21-a3d1-e3c16418c50e nodeName:}" failed. No retries permitted until 2026-07-06 02:39:45.416379684 +0000 UTC m=+39.073389326 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-registry-tls") pod "image-registry-8578d6475c-nmhmd" (UID: "aa4ac53c-39b9-4b21-a3d1-e3c16418c50e") : secret "image-registry-tls" not found
Jul 06 02:39:44.449015 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:44.448975    2570 generic.go:356] "Generic (PLEG): container finished" podID="988da6f0-e2d4-416f-bbfc-3812c7ae2f6a" containerID="05c4bf4691c2ae084c5a79d05b1e82276ca111d8fdc0c042a196cbb32957e655" exitCode=0
Jul 06 02:39:44.449116 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:44.449020    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lvbvz" event={"ID":"988da6f0-e2d4-416f-bbfc-3812c7ae2f6a","Type":"ContainerDied","Data":"05c4bf4691c2ae084c5a79d05b1e82276ca111d8fdc0c042a196cbb32957e655"}
Jul 06 02:39:44.450229 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:44.450209    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lfk4b" event={"ID":"90203301-698e-4c93-abcc-211c1d8bdd51","Type":"ContainerStarted","Data":"25741b969336a925f68ab1218fdb3927565ca895596f91121db5a9124a368d26"}
Jul 06 02:39:45.227161 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:45.226966    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4xxx"
Jul 06 02:39:45.227349 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:45.226973    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkl9q"
Jul 06 02:39:45.227349 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:45.227038    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l4wn"
Jul 06 02:39:45.229673 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:45.229654    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 02:39:45.229673 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:45.229665    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 02:39:45.229867 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:45.229756    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-n2bvg\""
Jul 06 02:39:45.229867 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:45.229795    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 02:39:45.230588 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:45.230564    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-68hwf\""
Jul 06 02:39:45.230683 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:45.230661    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 02:39:45.423648 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:45.423599    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/072a4522-4dd2-440e-b0c0-d0b131322bca-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-jfb42\" (UID: \"072a4522-4dd2-440e-b0c0-d0b131322bca\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-jfb42"
Jul 06 02:39:45.424107 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:45.423700    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/268b24ef-43c1-4813-b69e-0ba3f6cf44ad-metrics-tls\") pod \"dns-default-775zk\" (UID: \"268b24ef-43c1-4813-b69e-0ba3f6cf44ad\") " pod="openshift-dns/dns-default-775zk"
Jul 06 02:39:45.424107 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:45.423732    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-registry-tls\") pod \"image-registry-8578d6475c-nmhmd\" (UID: \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\") " pod="openshift-image-registry/image-registry-8578d6475c-nmhmd"
Jul 06 02:39:45.424107 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:45.423779    2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 02:39:45.424107 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:45.423846    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 02:39:45.424107 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:45.423855    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/072a4522-4dd2-440e-b0c0-d0b131322bca-networking-console-plugin-cert podName:072a4522-4dd2-440e-b0c0-d0b131322bca nodeName:}" failed. No retries permitted until 2026-07-06 02:39:47.423835561 +0000 UTC m=+41.080845219 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/072a4522-4dd2-440e-b0c0-d0b131322bca-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-jfb42" (UID: "072a4522-4dd2-440e-b0c0-d0b131322bca") : secret "networking-console-plugin-cert" not found
Jul 06 02:39:45.424107 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:45.423856    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8578d6475c-nmhmd: secret "image-registry-tls" not found
Jul 06 02:39:45.424107 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:45.423896    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-registry-tls podName:aa4ac53c-39b9-4b21-a3d1-e3c16418c50e nodeName:}" failed. No retries permitted until 2026-07-06 02:39:47.423885885 +0000 UTC m=+41.080895533 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-registry-tls") pod "image-registry-8578d6475c-nmhmd" (UID: "aa4ac53c-39b9-4b21-a3d1-e3c16418c50e") : secret "image-registry-tls" not found
Jul 06 02:39:45.424107 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:45.423904    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 02:39:45.424107 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:45.423949    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/268b24ef-43c1-4813-b69e-0ba3f6cf44ad-metrics-tls podName:268b24ef-43c1-4813-b69e-0ba3f6cf44ad nodeName:}" failed. No retries permitted until 2026-07-06 02:39:47.423937659 +0000 UTC m=+41.080947319 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/268b24ef-43c1-4813-b69e-0ba3f6cf44ad-metrics-tls") pod "dns-default-775zk" (UID: "268b24ef-43c1-4813-b69e-0ba3f6cf44ad") : secret "dns-default-metrics-tls" not found
Jul 06 02:39:45.456616 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:45.456586    2570 generic.go:356] "Generic (PLEG): container finished" podID="988da6f0-e2d4-416f-bbfc-3812c7ae2f6a" containerID="9d58532d1210cf2e6f4d5903e67469d2125bd2a0862e637ba40c5761e4fae7f9" exitCode=0
Jul 06 02:39:45.456777 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:45.456648    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lvbvz" event={"ID":"988da6f0-e2d4-416f-bbfc-3812c7ae2f6a","Type":"ContainerDied","Data":"9d58532d1210cf2e6f4d5903e67469d2125bd2a0862e637ba40c5761e4fae7f9"}
Jul 06 02:39:46.462963 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:46.462926    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lvbvz" event={"ID":"988da6f0-e2d4-416f-bbfc-3812c7ae2f6a","Type":"ContainerStarted","Data":"7f48196bbfc371808bb46a71239f622fde8404016729ecc76781982d2075dee1"}
Jul 06 02:39:46.485905 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:46.485853    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lvbvz" podStartSLOduration=7.9996220430000005 podStartE2EDuration="38.485837873s" totalImagesPullingTime="30.48621583s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 02:39:08 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:39:46.484062807 +0000 UTC m=+40.141072473" watchObservedRunningTime="2026-07-06 02:39:46.485837873 +0000 UTC m=+40.142847536"
Jul 06 02:39:46.614131 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:46.614094    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:39:46.665759 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:46.665728    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:39:47.441260 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:47.441083    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/268b24ef-43c1-4813-b69e-0ba3f6cf44ad-metrics-tls\") pod \"dns-default-775zk\" (UID: \"268b24ef-43c1-4813-b69e-0ba3f6cf44ad\") " pod="openshift-dns/dns-default-775zk"
Jul 06 02:39:47.441411 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:47.441270    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-registry-tls\") pod \"image-registry-8578d6475c-nmhmd\" (UID: \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\") " pod="openshift-image-registry/image-registry-8578d6475c-nmhmd"
Jul 06 02:39:47.441411 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:47.441316    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/072a4522-4dd2-440e-b0c0-d0b131322bca-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-jfb42\" (UID: \"072a4522-4dd2-440e-b0c0-d0b131322bca\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-jfb42"
Jul 06 02:39:47.441411 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:47.441227    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 02:39:47.441411 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:47.441368    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 02:39:47.441411 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:47.441381    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8578d6475c-nmhmd: secret "image-registry-tls" not found
Jul 06 02:39:47.441411 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:47.441399    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/268b24ef-43c1-4813-b69e-0ba3f6cf44ad-metrics-tls podName:268b24ef-43c1-4813-b69e-0ba3f6cf44ad nodeName:}" failed. No retries permitted until 2026-07-06 02:39:51.441385559 +0000 UTC m=+45.098395206 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/268b24ef-43c1-4813-b69e-0ba3f6cf44ad-metrics-tls") pod "dns-default-775zk" (UID: "268b24ef-43c1-4813-b69e-0ba3f6cf44ad") : secret "dns-default-metrics-tls" not found
Jul 06 02:39:47.441411 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:47.441406    2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 02:39:47.441621 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:47.441423    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-registry-tls podName:aa4ac53c-39b9-4b21-a3d1-e3c16418c50e nodeName:}" failed. No retries permitted until 2026-07-06 02:39:51.441409355 +0000 UTC m=+45.098419014 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-registry-tls") pod "image-registry-8578d6475c-nmhmd" (UID: "aa4ac53c-39b9-4b21-a3d1-e3c16418c50e") : secret "image-registry-tls" not found
Jul 06 02:39:47.441621 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:47.441449    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/072a4522-4dd2-440e-b0c0-d0b131322bca-networking-console-plugin-cert podName:072a4522-4dd2-440e-b0c0-d0b131322bca nodeName:}" failed. No retries permitted until 2026-07-06 02:39:51.441437206 +0000 UTC m=+45.098446848 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/072a4522-4dd2-440e-b0c0-d0b131322bca-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-jfb42" (UID: "072a4522-4dd2-440e-b0c0-d0b131322bca") : secret "networking-console-plugin-cert" not found
Jul 06 02:39:47.466840 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:47.466815    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lfk4b" event={"ID":"90203301-698e-4c93-abcc-211c1d8bdd51","Type":"ContainerStarted","Data":"90b50601cfc98c8d27e2b93d890168cf61597214b81bd32d4b6218915cb0f956"}
Jul 06 02:39:47.911298 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:47.911263    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:39:48.011655 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:48.011626    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:39:48.582880 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:48.582844    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:39:48.641068 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:48.641039    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:39:48.692048 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:48.692022    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:39:49.629103 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:49.629063    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:39:49.684636 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:49.684609    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:39:51.468968 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:51.468927    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/072a4522-4dd2-440e-b0c0-d0b131322bca-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-jfb42\" (UID: \"072a4522-4dd2-440e-b0c0-d0b131322bca\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-jfb42"
Jul 06 02:39:51.469456 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:51.469034    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/268b24ef-43c1-4813-b69e-0ba3f6cf44ad-metrics-tls\") pod \"dns-default-775zk\" (UID: \"268b24ef-43c1-4813-b69e-0ba3f6cf44ad\") " pod="openshift-dns/dns-default-775zk"
Jul 06 02:39:51.469456 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:51.469059    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-registry-tls\") pod \"image-registry-8578d6475c-nmhmd\" (UID: \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\") " pod="openshift-image-registry/image-registry-8578d6475c-nmhmd"
Jul 06 02:39:51.469456 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:51.469106    2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 02:39:51.469456 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:51.469179    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 02:39:51.469456 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:51.469191    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/072a4522-4dd2-440e-b0c0-d0b131322bca-networking-console-plugin-cert podName:072a4522-4dd2-440e-b0c0-d0b131322bca nodeName:}" failed. No retries permitted until 2026-07-06 02:39:59.469170671 +0000 UTC m=+53.126180328 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/072a4522-4dd2-440e-b0c0-d0b131322bca-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-jfb42" (UID: "072a4522-4dd2-440e-b0c0-d0b131322bca") : secret "networking-console-plugin-cert" not found
Jul 06 02:39:51.469456 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:51.469231    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/268b24ef-43c1-4813-b69e-0ba3f6cf44ad-metrics-tls podName:268b24ef-43c1-4813-b69e-0ba3f6cf44ad nodeName:}" failed. No retries permitted until 2026-07-06 02:39:59.469219041 +0000 UTC m=+53.126228687 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/268b24ef-43c1-4813-b69e-0ba3f6cf44ad-metrics-tls") pod "dns-default-775zk" (UID: "268b24ef-43c1-4813-b69e-0ba3f6cf44ad") : secret "dns-default-metrics-tls" not found
Jul 06 02:39:51.469456 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:51.469183    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 02:39:51.469456 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:51.469255    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8578d6475c-nmhmd: secret "image-registry-tls" not found
Jul 06 02:39:51.469456 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:51.469297    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-registry-tls podName:aa4ac53c-39b9-4b21-a3d1-e3c16418c50e nodeName:}" failed. No retries permitted until 2026-07-06 02:39:59.469285765 +0000 UTC m=+53.126295423 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-registry-tls") pod "image-registry-8578d6475c-nmhmd" (UID: "aa4ac53c-39b9-4b21-a3d1-e3c16418c50e") : secret "image-registry-tls" not found
Jul 06 02:39:51.596151 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:51.596124    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:39:52.626636 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:52.626607    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:39:52.678799 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:52.678765    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:39:55.653614 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:55.653577    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:39:55.702392 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:55.702360    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:39:56.152943 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:56.152914    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:39:59.524873 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:59.524838    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/268b24ef-43c1-4813-b69e-0ba3f6cf44ad-metrics-tls\") pod \"dns-default-775zk\" (UID: \"268b24ef-43c1-4813-b69e-0ba3f6cf44ad\") " pod="openshift-dns/dns-default-775zk"
Jul 06 02:39:59.524873 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:59.524877    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-registry-tls\") pod \"image-registry-8578d6475c-nmhmd\" (UID: \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\") " pod="openshift-image-registry/image-registry-8578d6475c-nmhmd"
Jul 06 02:39:59.525392 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:39:59.524935    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/072a4522-4dd2-440e-b0c0-d0b131322bca-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-jfb42\" (UID: \"072a4522-4dd2-440e-b0c0-d0b131322bca\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-jfb42"
Jul 06 02:39:59.525392 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:59.525030    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 02:39:59.525392 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:59.525059    2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 02:39:59.525392 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:59.525091    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 02:39:59.525392 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:59.525113    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8578d6475c-nmhmd: secret "image-registry-tls" not found
Jul 06 02:39:59.525392 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:59.525097    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/268b24ef-43c1-4813-b69e-0ba3f6cf44ad-metrics-tls podName:268b24ef-43c1-4813-b69e-0ba3f6cf44ad nodeName:}" failed. No retries permitted until 2026-07-06 02:40:15.525077826 +0000 UTC m=+69.182087488 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/268b24ef-43c1-4813-b69e-0ba3f6cf44ad-metrics-tls") pod "dns-default-775zk" (UID: "268b24ef-43c1-4813-b69e-0ba3f6cf44ad") : secret "dns-default-metrics-tls" not found
Jul 06 02:39:59.525392 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:59.525174    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/072a4522-4dd2-440e-b0c0-d0b131322bca-networking-console-plugin-cert podName:072a4522-4dd2-440e-b0c0-d0b131322bca nodeName:}" failed. No retries permitted until 2026-07-06 02:40:15.525161396 +0000 UTC m=+69.182171045 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/072a4522-4dd2-440e-b0c0-d0b131322bca-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-jfb42" (UID: "072a4522-4dd2-440e-b0c0-d0b131322bca") : secret "networking-console-plugin-cert" not found
Jul 06 02:39:59.525392 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:39:59.525192    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-registry-tls podName:aa4ac53c-39b9-4b21-a3d1-e3c16418c50e nodeName:}" failed. No retries permitted until 2026-07-06 02:40:15.525179878 +0000 UTC m=+69.182189525 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-registry-tls") pod "image-registry-8578d6475c-nmhmd" (UID: "aa4ac53c-39b9-4b21-a3d1-e3c16418c50e") : secret "image-registry-tls" not found
Jul 06 02:40:00.561590 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:40:00.561556    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:40:00.612148 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:40:00.612111    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:40:04.686427 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:40:04.686380    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:40:04.740934 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:40:04.740903    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:40:05.895932 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:40:05.895901    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:40:05.996661 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:40:05.996630    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:40:08.443920 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:40:08.443893    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vfxlc"
Jul 06 02:40:08.468201 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:40:08.468162    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lfk4b" podStartSLOduration=22.905895008999998 podStartE2EDuration="25.468148427s" totalImagesPullingTime="2.562253418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:39:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:39:47.483081228 +0000 UTC m=+41.140090916" watchObservedRunningTime="2026-07-06 02:40:08.468148427 +0000 UTC m=+62.125158091"
Jul 06 02:40:08.591742 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:40:08.591710    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:40:08.647373 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:40:08.647343    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:40:12.922158 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:40:12.922112    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghtsn\" (UniqueName: \"kubernetes.io/projected/977ea5f1-cac4-48ed-8d62-bc90e5866877-kube-api-access-ghtsn\") pod \"network-check-target-2l4wn\" (UID: \"977ea5f1-cac4-48ed-8d62-bc90e5866877\") " pod="openshift-network-diagnostics/network-check-target-2l4wn"
Jul 06 02:40:12.922631 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:40:12.922179    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/152ac564-1081-4f4e-bf7c-fce7f2bc64a7-original-pull-secret\") pod \"global-pull-secret-syncer-lkl9q\" (UID: \"152ac564-1081-4f4e-bf7c-fce7f2bc64a7\") " pod="kube-system/global-pull-secret-syncer-lkl9q"
Jul 06 02:40:12.922631 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:40:12.922226    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35f61f76-1038-43ca-a749-71412ea26859-metrics-certs\") pod \"network-metrics-daemon-j4xxx\" (UID: \"35f61f76-1038-43ca-a749-71412ea26859\") " pod="openshift-multus/network-metrics-daemon-j4xxx"
Jul 06 02:40:12.924750 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:40:12.924725    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 02:40:12.924863 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:40:12.924772    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 02:40:12.924863 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:40:12.924781    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 02:40:12.932667 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:40:12.932648    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 06 02:40:12.932726 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:40:12.932715    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35f61f76-1038-43ca-a749-71412ea26859-metrics-certs podName:35f61f76-1038-43ca-a749-71412ea26859 nodeName:}" failed. No retries permitted until 2026-07-06 02:41:16.932700426 +0000 UTC m=+130.589710081 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35f61f76-1038-43ca-a749-71412ea26859-metrics-certs") pod "network-metrics-daemon-j4xxx" (UID: "35f61f76-1038-43ca-a749-71412ea26859") : secret "metrics-daemon-secret" not found
Jul 06 02:40:12.934424 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:40:12.934410    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 02:40:12.936228 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:40:12.936211    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/152ac564-1081-4f4e-bf7c-fce7f2bc64a7-original-pull-secret\") pod \"global-pull-secret-syncer-lkl9q\" (UID: \"152ac564-1081-4f4e-bf7c-fce7f2bc64a7\") " pod="kube-system/global-pull-secret-syncer-lkl9q"
Jul 06 02:40:12.945723 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:40:12.945696    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghtsn\" (UniqueName: \"kubernetes.io/projected/977ea5f1-cac4-48ed-8d62-bc90e5866877-kube-api-access-ghtsn\") pod \"network-check-target-2l4wn\" (UID: \"977ea5f1-cac4-48ed-8d62-bc90e5866877\") " pod="openshift-network-diagnostics/network-check-target-2l4wn"
Jul 06 02:40:13.147425 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:40:13.147394    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-68hwf\""
Jul 06 02:40:13.151313 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:40:13.151285    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lkl9q"
Jul 06 02:40:13.156187 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:40:13.156170    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2l4wn"
Jul 06 02:40:13.296524 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:40:13.296496    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lkl9q"]
Jul 06 02:40:13.299921 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:40:13.299897    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod152ac564_1081_4f4e_bf7c_fce7f2bc64a7.slice/crio-cde44c991313d69f1d3ff25e01779158dbd31a8570dc4722b59e07ace77412b5 WatchSource:0}: Error finding container cde44c991313d69f1d3ff25e01779158dbd31a8570dc4722b59e07ace77412b5: Status 404 returned error can't find the container with id cde44c991313d69f1d3ff25e01779158dbd31a8570dc4722b59e07ace77412b5
Jul 06 02:40:13.311514 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:40:13.311487    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2l4wn"]
Jul 06 02:40:13.314602 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:40:13.314581    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod977ea5f1_cac4_48ed_8d62_bc90e5866877.slice/crio-4b40a865d2adfa4f11b0843b9030696545e7b176f54f56751d55c5bf5c8234dc WatchSource:0}: Error finding container 4b40a865d2adfa4f11b0843b9030696545e7b176f54f56751d55c5bf5c8234dc: Status 404 returned error can't find the container with id 4b40a865d2adfa4f11b0843b9030696545e7b176f54f56751d55c5bf5c8234dc
Jul 06 02:40:13.530413 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:40:13.530389    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2l4wn" event={"ID":"977ea5f1-cac4-48ed-8d62-bc90e5866877","Type":"ContainerStarted","Data":"4b40a865d2adfa4f11b0843b9030696545e7b176f54f56751d55c5bf5c8234dc"}
Jul 06 02:40:13.531384 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:40:13.531366    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lkl9q" event={"ID":"152ac564-1081-4f4e-bf7c-fce7f2bc64a7","Type":"ContainerStarted","Data":"cde44c991313d69f1d3ff25e01779158dbd31a8570dc4722b59e07ace77412b5"}
Jul 06 02:40:15.545427 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:40:15.544680    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/268b24ef-43c1-4813-b69e-0ba3f6cf44ad-metrics-tls\") pod \"dns-default-775zk\" (UID: \"268b24ef-43c1-4813-b69e-0ba3f6cf44ad\") " pod="openshift-dns/dns-default-775zk"
Jul 06 02:40:15.545427 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:40:15.544741    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-registry-tls\") pod \"image-registry-8578d6475c-nmhmd\" (UID: \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\") " pod="openshift-image-registry/image-registry-8578d6475c-nmhmd"
Jul 06 02:40:15.545427 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:40:15.544823    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/072a4522-4dd2-440e-b0c0-d0b131322bca-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-jfb42\" (UID: \"072a4522-4dd2-440e-b0c0-d0b131322bca\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-jfb42"
Jul 06 02:40:15.545427 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:40:15.545035    2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 02:40:15.545427 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:40:15.545108    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/072a4522-4dd2-440e-b0c0-d0b131322bca-networking-console-plugin-cert podName:072a4522-4dd2-440e-b0c0-d0b131322bca nodeName:}" failed. No retries permitted until 2026-07-06 02:40:47.54508055 +0000 UTC m=+101.202090200 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/072a4522-4dd2-440e-b0c0-d0b131322bca-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-jfb42" (UID: "072a4522-4dd2-440e-b0c0-d0b131322bca") : secret "networking-console-plugin-cert" not found
Jul 06 02:40:15.546108 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:40:15.545615    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 02:40:15.546108 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:40:15.545717    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/268b24ef-43c1-4813-b69e-0ba3f6cf44ad-metrics-tls podName:268b24ef-43c1-4813-b69e-0ba3f6cf44ad nodeName:}" failed. No retries permitted until 2026-07-06 02:40:47.545658661 +0000 UTC m=+101.202668323 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/268b24ef-43c1-4813-b69e-0ba3f6cf44ad-metrics-tls") pod "dns-default-775zk" (UID: "268b24ef-43c1-4813-b69e-0ba3f6cf44ad") : secret "dns-default-metrics-tls" not found
Jul 06 02:40:15.546108 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:40:15.545802    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 02:40:15.546108 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:40:15.545814    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8578d6475c-nmhmd: secret "image-registry-tls" not found
Jul 06 02:40:15.546108 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:40:15.545857    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-registry-tls podName:aa4ac53c-39b9-4b21-a3d1-e3c16418c50e nodeName:}" failed. No retries permitted until 2026-07-06 02:40:47.545845537 +0000 UTC m=+101.202855187 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-registry-tls") pod "image-registry-8578d6475c-nmhmd" (UID: "aa4ac53c-39b9-4b21-a3d1-e3c16418c50e") : secret "image-registry-tls" not found
Jul 06 02:40:17.646202 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:40:17.646166    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:40:17.703011 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:40:17.702969    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:40:18.546016 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:40:18.545965    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2l4wn" event={"ID":"977ea5f1-cac4-48ed-8d62-bc90e5866877","Type":"ContainerStarted","Data":"85ed5ef34e03b0115e54da63e2642b3fce204c31811d8fbb3b4a1df7124a0091"}
Jul 06 02:40:18.546248 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:40:18.546222    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2l4wn"
Jul 06 02:40:18.547318 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:40:18.547299    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lkl9q" event={"ID":"152ac564-1081-4f4e-bf7c-fce7f2bc64a7","Type":"ContainerStarted","Data":"ab75ed9990fd7df66c3d97afee8eedec8bd374aad26b0f6022ee44becc752c89"}
Jul 06 02:40:18.559767 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:40:18.559706    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2l4wn" podStartSLOduration=65.748192326 podStartE2EDuration="1m10.559689575s" totalImagesPullingTime="4.811497249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:39:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:40:18.559309388 +0000 UTC m=+72.216319052" watchObservedRunningTime="2026-07-06 02:40:18.559689575 +0000 UTC m=+72.216699235"
Jul 06 02:40:18.571682 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:40:18.571643    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lkl9q" podStartSLOduration=65.743176155 podStartE2EDuration="1m10.571628971s" totalImagesPullingTime="4.828452816s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 02:39:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:40:18.5710962 +0000 UTC m=+72.228105876" watchObservedRunningTime="2026-07-06 02:40:18.571628971 +0000 UTC m=+72.228638635"
Jul 06 02:40:26.636287 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:40:26.636252    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:40:26.738685 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:40:26.738644    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:40:47.564196 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:40:47.564154    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/072a4522-4dd2-440e-b0c0-d0b131322bca-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-jfb42\" (UID: \"072a4522-4dd2-440e-b0c0-d0b131322bca\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-jfb42"
Jul 06 02:40:47.564657 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:40:47.564212    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/268b24ef-43c1-4813-b69e-0ba3f6cf44ad-metrics-tls\") pod \"dns-default-775zk\" (UID: \"268b24ef-43c1-4813-b69e-0ba3f6cf44ad\") " pod="openshift-dns/dns-default-775zk"
Jul 06 02:40:47.564657 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:40:47.564239    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-registry-tls\") pod \"image-registry-8578d6475c-nmhmd\" (UID: \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\") " pod="openshift-image-registry/image-registry-8578d6475c-nmhmd"
Jul 06 02:40:47.564657 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:40:47.564335    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 02:40:47.564657 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:40:47.564336    2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 02:40:47.564657 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:40:47.564364    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 02:40:47.564657 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:40:47.564352    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8578d6475c-nmhmd: secret "image-registry-tls" not found
Jul 06 02:40:47.564657 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:40:47.564428    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/268b24ef-43c1-4813-b69e-0ba3f6cf44ad-metrics-tls podName:268b24ef-43c1-4813-b69e-0ba3f6cf44ad nodeName:}" failed. No retries permitted until 2026-07-06 02:41:51.564412389 +0000 UTC m=+165.221422031 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/268b24ef-43c1-4813-b69e-0ba3f6cf44ad-metrics-tls") pod "dns-default-775zk" (UID: "268b24ef-43c1-4813-b69e-0ba3f6cf44ad") : secret "dns-default-metrics-tls" not found
Jul 06 02:40:47.564657 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:40:47.564447    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/072a4522-4dd2-440e-b0c0-d0b131322bca-networking-console-plugin-cert podName:072a4522-4dd2-440e-b0c0-d0b131322bca nodeName:}" failed. No retries permitted until 2026-07-06 02:41:51.564437906 +0000 UTC m=+165.221447549 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/072a4522-4dd2-440e-b0c0-d0b131322bca-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-jfb42" (UID: "072a4522-4dd2-440e-b0c0-d0b131322bca") : secret "networking-console-plugin-cert" not found
Jul 06 02:40:47.564657 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:40:47.564461    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-registry-tls podName:aa4ac53c-39b9-4b21-a3d1-e3c16418c50e nodeName:}" failed. No retries permitted until 2026-07-06 02:41:51.564453708 +0000 UTC m=+165.221463351 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-registry-tls") pod "image-registry-8578d6475c-nmhmd" (UID: "aa4ac53c-39b9-4b21-a3d1-e3c16418c50e") : secret "image-registry-tls" not found
Jul 06 02:40:49.552638 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:40:49.552607    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2l4wn"
Jul 06 02:41:16.971601 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:41:16.971547    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35f61f76-1038-43ca-a749-71412ea26859-metrics-certs\") pod \"network-metrics-daemon-j4xxx\" (UID: \"35f61f76-1038-43ca-a749-71412ea26859\") " pod="openshift-multus/network-metrics-daemon-j4xxx"
Jul 06 02:41:16.972140 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:41:16.971666    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 06 02:41:16.972140 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:41:16.971730    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35f61f76-1038-43ca-a749-71412ea26859-metrics-certs podName:35f61f76-1038-43ca-a749-71412ea26859 nodeName:}" failed. No retries permitted until 2026-07-06 02:43:18.971717081 +0000 UTC m=+252.628726723 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35f61f76-1038-43ca-a749-71412ea26859-metrics-certs") pod "network-metrics-daemon-j4xxx" (UID: "35f61f76-1038-43ca-a749-71412ea26859") : secret "metrics-daemon-secret" not found
Jul 06 02:41:46.706053 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:41:46.706016    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-jfb42" podUID="072a4522-4dd2-440e-b0c0-d0b131322bca"
Jul 06 02:41:46.728538 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:41:46.728516    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-8578d6475c-nmhmd" podUID="aa4ac53c-39b9-4b21-a3d1-e3c16418c50e"
Jul 06 02:41:46.758413 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:41:46.758385    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-jfb42"
Jul 06 02:41:46.758519 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:41:46.758425    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8578d6475c-nmhmd"
Jul 06 02:41:46.795164 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:41:46.795136    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-775zk" podUID="268b24ef-43c1-4813-b69e-0ba3f6cf44ad"
Jul 06 02:41:47.760606 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:41:47.760570    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-775zk"
Jul 06 02:41:48.238511 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:41:48.238473    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-j4xxx" podUID="35f61f76-1038-43ca-a749-71412ea26859"
Jul 06 02:41:51.602726 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:41:51.602681    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/268b24ef-43c1-4813-b69e-0ba3f6cf44ad-metrics-tls\") pod \"dns-default-775zk\" (UID: \"268b24ef-43c1-4813-b69e-0ba3f6cf44ad\") " pod="openshift-dns/dns-default-775zk"
Jul 06 02:41:51.602726 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:41:51.602732    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-registry-tls\") pod \"image-registry-8578d6475c-nmhmd\" (UID: \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\") " pod="openshift-image-registry/image-registry-8578d6475c-nmhmd"
Jul 06 02:41:51.603238 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:41:51.602792    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/072a4522-4dd2-440e-b0c0-d0b131322bca-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-jfb42\" (UID: \"072a4522-4dd2-440e-b0c0-d0b131322bca\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-jfb42"
Jul 06 02:41:51.603238 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:41:51.602818    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 02:41:51.603238 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:41:51.602882    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 02:41:51.603238 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:41:51.602891    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/268b24ef-43c1-4813-b69e-0ba3f6cf44ad-metrics-tls podName:268b24ef-43c1-4813-b69e-0ba3f6cf44ad nodeName:}" failed. No retries permitted until 2026-07-06 02:43:53.602874491 +0000 UTC m=+287.259884134 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/268b24ef-43c1-4813-b69e-0ba3f6cf44ad-metrics-tls") pod "dns-default-775zk" (UID: "268b24ef-43c1-4813-b69e-0ba3f6cf44ad") : secret "dns-default-metrics-tls" not found
Jul 06 02:41:51.603238 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:41:51.602898    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8578d6475c-nmhmd: secret "image-registry-tls" not found
Jul 06 02:41:51.603238 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:41:51.602916    2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 02:41:51.603238 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:41:51.602967    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/072a4522-4dd2-440e-b0c0-d0b131322bca-networking-console-plugin-cert podName:072a4522-4dd2-440e-b0c0-d0b131322bca nodeName:}" failed. No retries permitted until 2026-07-06 02:43:53.602950494 +0000 UTC m=+287.259960150 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/072a4522-4dd2-440e-b0c0-d0b131322bca-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-jfb42" (UID: "072a4522-4dd2-440e-b0c0-d0b131322bca") : secret "networking-console-plugin-cert" not found
Jul 06 02:41:51.603238 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:41:51.603008    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-registry-tls podName:aa4ac53c-39b9-4b21-a3d1-e3c16418c50e nodeName:}" failed. No retries permitted until 2026-07-06 02:43:53.60297624 +0000 UTC m=+287.259985882 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-registry-tls") pod "image-registry-8578d6475c-nmhmd" (UID: "aa4ac53c-39b9-4b21-a3d1-e3c16418c50e") : secret "image-registry-tls" not found
Jul 06 02:42:01.227243 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:42:01.227166    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4xxx"
Jul 06 02:42:52.698242 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:42:52.698199    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:18.443883 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.443852    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-j7prq"]
Jul 06 02:43:18.447660 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.447545    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-j7prq"
Jul 06 02:43:18.449469 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.449434    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5czw2"]
Jul 06 02:43:18.450546 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.450529    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-5czcz\""
Jul 06 02:43:18.452295 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.452272    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mj9sp"]
Jul 06 02:43:18.452423 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.452343    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5czw2"
Jul 06 02:43:18.455169 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.455143    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-kxvxp\""
Jul 06 02:43:18.455285 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.455170    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 06 02:43:18.455285 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.455174    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mj9sp"
Jul 06 02:43:18.455409 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.455363    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 06 02:43:18.455409 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.455379    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 06 02:43:18.455803 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.455785    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 06 02:43:18.457831 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.457813    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 06 02:43:18.457924 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.457899    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 06 02:43:18.458001 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.457958    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 06 02:43:18.458384 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.458368    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-9b56r\""
Jul 06 02:43:18.461339 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.461322    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-j7prq"]
Jul 06 02:43:18.464167 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.464113    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mj9sp"]
Jul 06 02:43:18.467032 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.467010    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5czw2"]
Jul 06 02:43:18.500893 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.500870    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/37c6a4d4-209c-44de-8217-26df1fec6e4d-config\") pod \"service-ca-operator-5d46d9ffd4-5czw2\" (UID: \"37c6a4d4-209c-44de-8217-26df1fec6e4d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5czw2"
Jul 06 02:43:18.501016 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.500900    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc2qs\" (UniqueName: \"kubernetes.io/projected/8448595b-2068-464c-8b03-e12d6ab1d6d7-kube-api-access-cc2qs\") pod \"network-check-source-989f8b8dc-j7prq\" (UID: \"8448595b-2068-464c-8b03-e12d6ab1d6d7\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-j7prq"
Jul 06 02:43:18.501016 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.500918    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6z9f\" (UniqueName: \"kubernetes.io/projected/37c6a4d4-209c-44de-8217-26df1fec6e4d-kube-api-access-q6z9f\") pod \"service-ca-operator-5d46d9ffd4-5czw2\" (UID: \"37c6a4d4-209c-44de-8217-26df1fec6e4d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5czw2"
Jul 06 02:43:18.501016 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.500937    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d8c6d860-781f-4225-981b-b12610156c02-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mj9sp\" (UID: \"d8c6d860-781f-4225-981b-b12610156c02\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mj9sp"
Jul 06 02:43:18.501180 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.501047    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/37c6a4d4-209c-44de-8217-26df1fec6e4d-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-5czw2\" (UID: \"37c6a4d4-209c-44de-8217-26df1fec6e4d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5czw2"
Jul 06 02:43:18.501180 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.501098    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcfss\" (UniqueName: \"kubernetes.io/projected/d8c6d860-781f-4225-981b-b12610156c02-kube-api-access-wcfss\") pod \"cluster-samples-operator-56fcf86bf-mj9sp\" (UID: \"d8c6d860-781f-4225-981b-b12610156c02\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mj9sp"
Jul 06 02:43:18.541544 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.541519    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x2lrc"]
Jul 06 02:43:18.544318 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.544298    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x2lrc"
Jul 06 02:43:18.545370 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.545350    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7444877bcc-p6fm2"]
Jul 06 02:43:18.546857 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.546810    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 06 02:43:18.546946 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.546894    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 02:43:18.547040 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.547028    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 02:43:18.547342 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.547330    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-qc74v\""
Jul 06 02:43:18.548013 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.547997    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-znzln"]
Jul 06 02:43:18.548083 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.548068    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7444877bcc-p6fm2"
Jul 06 02:43:18.548256 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.548235    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 06 02:43:18.550378 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.550359    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 06 02:43:18.550681 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.550649    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 06 02:43:18.550772 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.550649    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 06 02:43:18.550927 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.550909    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 06 02:43:18.551147 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.551083    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-znzln"
Jul 06 02:43:18.551293 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.551272    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 02:43:18.551365 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.551312    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 02:43:18.551694 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.551652    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-6wb49\""
Jul 06 02:43:18.554313 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.554296    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 06 02:43:18.554523 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.554509    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-f7qq7\""
Jul 06 02:43:18.554862 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.554848    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 06 02:43:18.554943 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.554882    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 06 02:43:18.555455 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.555437    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 06 02:43:18.557813 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.557791    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x2lrc"]
Jul 06 02:43:18.562852 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.562829    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-znzln"]
Jul 06 02:43:18.563522 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.563504    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7444877bcc-p6fm2"]
Jul 06 02:43:18.602017 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.601976    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c3246741-951c-41e7-a4f7-c7d3638e12e6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-x2lrc\" (UID: \"c3246741-951c-41e7-a4f7-c7d3638e12e6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x2lrc"
Jul 06 02:43:18.602148 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.602023    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z52j\" (UniqueName: \"kubernetes.io/projected/c3246741-951c-41e7-a4f7-c7d3638e12e6-kube-api-access-5z52j\") pod \"cluster-monitoring-operator-64786d9cbb-x2lrc\" (UID: \"c3246741-951c-41e7-a4f7-c7d3638e12e6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x2lrc"
Jul 06 02:43:18.602148 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.602107    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1c8a4c86-30a0-400f-866b-4606d5284ddf-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-znzln\" (UID: \"1c8a4c86-30a0-400f-866b-4606d5284ddf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-znzln"
Jul 06 02:43:18.602148 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.602139    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/37c6a4d4-209c-44de-8217-26df1fec6e4d-config\") pod \"service-ca-operator-5d46d9ffd4-5czw2\" (UID: \"37c6a4d4-209c-44de-8217-26df1fec6e4d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5czw2"
Jul 06 02:43:18.602252 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.602158    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6z9f\" (UniqueName: \"kubernetes.io/projected/37c6a4d4-209c-44de-8217-26df1fec6e4d-kube-api-access-q6z9f\") pod \"service-ca-operator-5d46d9ffd4-5czw2\" (UID: \"37c6a4d4-209c-44de-8217-26df1fec6e4d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5czw2"
Jul 06 02:43:18.602252 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.602180    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d8c6d860-781f-4225-981b-b12610156c02-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mj9sp\" (UID: \"d8c6d860-781f-4225-981b-b12610156c02\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mj9sp"
Jul 06 02:43:18.602252 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.602196    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a08183a-b8db-4b2c-94b3-357e745e785b-service-ca-bundle\") pod \"router-default-7444877bcc-p6fm2\" (UID: \"9a08183a-b8db-4b2c-94b3-357e745e785b\") " pod="openshift-ingress/router-default-7444877bcc-p6fm2"
Jul 06 02:43:18.602252 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.602211    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a08183a-b8db-4b2c-94b3-357e745e785b-metrics-certs\") pod \"router-default-7444877bcc-p6fm2\" (UID: \"9a08183a-b8db-4b2c-94b3-357e745e785b\") " pod="openshift-ingress/router-default-7444877bcc-p6fm2"
Jul 06 02:43:18.602410 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:18.602305    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 02:43:18.602410 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.602361    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c3246741-951c-41e7-a4f7-c7d3638e12e6-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-x2lrc\" (UID: \"c3246741-951c-41e7-a4f7-c7d3638e12e6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x2lrc"
Jul 06 02:43:18.602410 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:18.602382    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8c6d860-781f-4225-981b-b12610156c02-samples-operator-tls podName:d8c6d860-781f-4225-981b-b12610156c02 nodeName:}" failed. No retries permitted until 2026-07-06 02:43:19.102356914 +0000 UTC m=+252.759366559 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d8c6d860-781f-4225-981b-b12610156c02-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-mj9sp" (UID: "d8c6d860-781f-4225-981b-b12610156c02") : secret "samples-operator-tls" not found
Jul 06 02:43:18.602672 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.602435    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcfss\" (UniqueName: \"kubernetes.io/projected/d8c6d860-781f-4225-981b-b12610156c02-kube-api-access-wcfss\") pod \"cluster-samples-operator-56fcf86bf-mj9sp\" (UID: \"d8c6d860-781f-4225-981b-b12610156c02\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mj9sp"
Jul 06 02:43:18.602672 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.602459    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl6lq\" (UniqueName: \"kubernetes.io/projected/1c8a4c86-30a0-400f-866b-4606d5284ddf-kube-api-access-hl6lq\") pod \"kube-storage-version-migrator-operator-846bf668f7-znzln\" (UID: \"1c8a4c86-30a0-400f-866b-4606d5284ddf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-znzln"
Jul 06 02:43:18.602672 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.602489    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9a08183a-b8db-4b2c-94b3-357e745e785b-stats-auth\") pod \"router-default-7444877bcc-p6fm2\" (UID: \"9a08183a-b8db-4b2c-94b3-357e745e785b\") " pod="openshift-ingress/router-default-7444877bcc-p6fm2"
Jul 06 02:43:18.602672 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.602519    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92r49\" (UniqueName: \"kubernetes.io/projected/9a08183a-b8db-4b2c-94b3-357e745e785b-kube-api-access-92r49\") pod \"router-default-7444877bcc-p6fm2\" (UID: \"9a08183a-b8db-4b2c-94b3-357e745e785b\") " pod="openshift-ingress/router-default-7444877bcc-p6fm2"
Jul 06 02:43:18.602672 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.602569    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc2qs\" (UniqueName: \"kubernetes.io/projected/8448595b-2068-464c-8b03-e12d6ab1d6d7-kube-api-access-cc2qs\") pod \"network-check-source-989f8b8dc-j7prq\" (UID: \"8448595b-2068-464c-8b03-e12d6ab1d6d7\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-j7prq"
Jul 06 02:43:18.602672 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.602590    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9a08183a-b8db-4b2c-94b3-357e745e785b-default-certificate\") pod \"router-default-7444877bcc-p6fm2\" (UID: \"9a08183a-b8db-4b2c-94b3-357e745e785b\") " pod="openshift-ingress/router-default-7444877bcc-p6fm2"
Jul 06 02:43:18.602672 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.602612    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1c8a4c86-30a0-400f-866b-4606d5284ddf-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-znzln\" (UID: \"1c8a4c86-30a0-400f-866b-4606d5284ddf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-znzln"
Jul 06 02:43:18.602672 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.602656    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/37c6a4d4-209c-44de-8217-26df1fec6e4d-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-5czw2\" (UID: \"37c6a4d4-209c-44de-8217-26df1fec6e4d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5czw2"
Jul 06 02:43:18.602967 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.602660    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/37c6a4d4-209c-44de-8217-26df1fec6e4d-config\") pod \"service-ca-operator-5d46d9ffd4-5czw2\" (UID: \"37c6a4d4-209c-44de-8217-26df1fec6e4d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5czw2"
Jul 06 02:43:18.604944 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.604927    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/37c6a4d4-209c-44de-8217-26df1fec6e4d-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-5czw2\" (UID: \"37c6a4d4-209c-44de-8217-26df1fec6e4d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5czw2"
Jul 06 02:43:18.610422 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.610397    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6z9f\" (UniqueName: \"kubernetes.io/projected/37c6a4d4-209c-44de-8217-26df1fec6e4d-kube-api-access-q6z9f\") pod \"service-ca-operator-5d46d9ffd4-5czw2\" (UID: \"37c6a4d4-209c-44de-8217-26df1fec6e4d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5czw2"
Jul 06 02:43:18.611132 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.611115    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc2qs\" (UniqueName: \"kubernetes.io/projected/8448595b-2068-464c-8b03-e12d6ab1d6d7-kube-api-access-cc2qs\") pod \"network-check-source-989f8b8dc-j7prq\" (UID: \"8448595b-2068-464c-8b03-e12d6ab1d6d7\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-j7prq"
Jul 06 02:43:18.611207 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.611186    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcfss\" (UniqueName: \"kubernetes.io/projected/d8c6d860-781f-4225-981b-b12610156c02-kube-api-access-wcfss\") pod \"cluster-samples-operator-56fcf86bf-mj9sp\" (UID: \"d8c6d860-781f-4225-981b-b12610156c02\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mj9sp"
Jul 06 02:43:18.686462 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.686437    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:18.703563 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.703518    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a08183a-b8db-4b2c-94b3-357e745e785b-service-ca-bundle\") pod \"router-default-7444877bcc-p6fm2\" (UID: \"9a08183a-b8db-4b2c-94b3-357e745e785b\") " pod="openshift-ingress/router-default-7444877bcc-p6fm2"
Jul 06 02:43:18.703563 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.703542    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a08183a-b8db-4b2c-94b3-357e745e785b-metrics-certs\") pod \"router-default-7444877bcc-p6fm2\" (UID: \"9a08183a-b8db-4b2c-94b3-357e745e785b\") " pod="openshift-ingress/router-default-7444877bcc-p6fm2"
Jul 06 02:43:18.703663 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.703573    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c3246741-951c-41e7-a4f7-c7d3638e12e6-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-x2lrc\" (UID: \"c3246741-951c-41e7-a4f7-c7d3638e12e6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x2lrc"
Jul 06 02:43:18.703663 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.703592    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl6lq\" (UniqueName: \"kubernetes.io/projected/1c8a4c86-30a0-400f-866b-4606d5284ddf-kube-api-access-hl6lq\") pod \"kube-storage-version-migrator-operator-846bf668f7-znzln\" (UID: \"1c8a4c86-30a0-400f-866b-4606d5284ddf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-znzln"
Jul 06 02:43:18.703663 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:18.703622    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a08183a-b8db-4b2c-94b3-357e745e785b-service-ca-bundle podName:9a08183a-b8db-4b2c-94b3-357e745e785b nodeName:}" failed. No retries permitted until 2026-07-06 02:43:19.203608169 +0000 UTC m=+252.860617812 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9a08183a-b8db-4b2c-94b3-357e745e785b-service-ca-bundle") pod "router-default-7444877bcc-p6fm2" (UID: "9a08183a-b8db-4b2c-94b3-357e745e785b") : configmap references non-existent config key: service-ca.crt
Jul 06 02:43:18.703663 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.703650    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9a08183a-b8db-4b2c-94b3-357e745e785b-stats-auth\") pod \"router-default-7444877bcc-p6fm2\" (UID: \"9a08183a-b8db-4b2c-94b3-357e745e785b\") " pod="openshift-ingress/router-default-7444877bcc-p6fm2"
Jul 06 02:43:18.703826 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:18.703677    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 02:43:18.703826 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.703690    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92r49\" (UniqueName: \"kubernetes.io/projected/9a08183a-b8db-4b2c-94b3-357e745e785b-kube-api-access-92r49\") pod \"router-default-7444877bcc-p6fm2\" (UID: \"9a08183a-b8db-4b2c-94b3-357e745e785b\") " pod="openshift-ingress/router-default-7444877bcc-p6fm2"
Jul 06 02:43:18.703826 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:18.703721    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a08183a-b8db-4b2c-94b3-357e745e785b-metrics-certs podName:9a08183a-b8db-4b2c-94b3-357e745e785b nodeName:}" failed. No retries permitted until 2026-07-06 02:43:19.203706076 +0000 UTC m=+252.860715729 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a08183a-b8db-4b2c-94b3-357e745e785b-metrics-certs") pod "router-default-7444877bcc-p6fm2" (UID: "9a08183a-b8db-4b2c-94b3-357e745e785b") : secret "router-metrics-certs-default" not found
Jul 06 02:43:18.703826 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.703764    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9a08183a-b8db-4b2c-94b3-357e745e785b-default-certificate\") pod \"router-default-7444877bcc-p6fm2\" (UID: \"9a08183a-b8db-4b2c-94b3-357e745e785b\") " pod="openshift-ingress/router-default-7444877bcc-p6fm2"
Jul 06 02:43:18.703826 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.703791    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1c8a4c86-30a0-400f-866b-4606d5284ddf-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-znzln\" (UID: \"1c8a4c86-30a0-400f-866b-4606d5284ddf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-znzln"
Jul 06 02:43:18.704057 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.703831    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c3246741-951c-41e7-a4f7-c7d3638e12e6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-x2lrc\" (UID: \"c3246741-951c-41e7-a4f7-c7d3638e12e6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x2lrc"
Jul 06 02:43:18.704057 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.703850    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5z52j\" (UniqueName: \"kubernetes.io/projected/c3246741-951c-41e7-a4f7-c7d3638e12e6-kube-api-access-5z52j\") pod \"cluster-monitoring-operator-64786d9cbb-x2lrc\" (UID: \"c3246741-951c-41e7-a4f7-c7d3638e12e6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x2lrc"
Jul 06 02:43:18.704057 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.703887    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1c8a4c86-30a0-400f-866b-4606d5284ddf-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-znzln\" (UID: \"1c8a4c86-30a0-400f-866b-4606d5284ddf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-znzln"
Jul 06 02:43:18.704195 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:18.704059    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 02:43:18.704195 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:18.704137    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3246741-951c-41e7-a4f7-c7d3638e12e6-cluster-monitoring-operator-tls podName:c3246741-951c-41e7-a4f7-c7d3638e12e6 nodeName:}" failed. No retries permitted until 2026-07-06 02:43:19.204119814 +0000 UTC m=+252.861129458 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c3246741-951c-41e7-a4f7-c7d3638e12e6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-x2lrc" (UID: "c3246741-951c-41e7-a4f7-c7d3638e12e6") : secret "cluster-monitoring-operator-tls" not found
Jul 06 02:43:18.704443 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.704423    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c3246741-951c-41e7-a4f7-c7d3638e12e6-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-x2lrc\" (UID: \"c3246741-951c-41e7-a4f7-c7d3638e12e6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x2lrc"
Jul 06 02:43:18.704550 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.704530    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1c8a4c86-30a0-400f-866b-4606d5284ddf-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-znzln\" (UID: \"1c8a4c86-30a0-400f-866b-4606d5284ddf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-znzln"
Jul 06 02:43:18.705942 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.705922    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1c8a4c86-30a0-400f-866b-4606d5284ddf-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-znzln\" (UID: \"1c8a4c86-30a0-400f-866b-4606d5284ddf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-znzln"
Jul 06 02:43:18.706048 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.705943    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9a08183a-b8db-4b2c-94b3-357e745e785b-default-certificate\") pod \"router-default-7444877bcc-p6fm2\" (UID: \"9a08183a-b8db-4b2c-94b3-357e745e785b\") " pod="openshift-ingress/router-default-7444877bcc-p6fm2"
Jul 06 02:43:18.706048 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.706020    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9a08183a-b8db-4b2c-94b3-357e745e785b-stats-auth\") pod \"router-default-7444877bcc-p6fm2\" (UID: \"9a08183a-b8db-4b2c-94b3-357e745e785b\") " pod="openshift-ingress/router-default-7444877bcc-p6fm2"
Jul 06 02:43:18.713532 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.713514    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z52j\" (UniqueName: \"kubernetes.io/projected/c3246741-951c-41e7-a4f7-c7d3638e12e6-kube-api-access-5z52j\") pod \"cluster-monitoring-operator-64786d9cbb-x2lrc\" (UID: \"c3246741-951c-41e7-a4f7-c7d3638e12e6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x2lrc"
Jul 06 02:43:18.714103 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.714080    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl6lq\" (UniqueName: \"kubernetes.io/projected/1c8a4c86-30a0-400f-866b-4606d5284ddf-kube-api-access-hl6lq\") pod \"kube-storage-version-migrator-operator-846bf668f7-znzln\" (UID: \"1c8a4c86-30a0-400f-866b-4606d5284ddf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-znzln"
Jul 06 02:43:18.714206 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.714171    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92r49\" (UniqueName: \"kubernetes.io/projected/9a08183a-b8db-4b2c-94b3-357e745e785b-kube-api-access-92r49\") pod \"router-default-7444877bcc-p6fm2\" (UID: \"9a08183a-b8db-4b2c-94b3-357e745e785b\") " pod="openshift-ingress/router-default-7444877bcc-p6fm2"
Jul 06 02:43:18.758300 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.758281    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-j7prq"
Jul 06 02:43:18.766047 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.766031    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5czw2"
Jul 06 02:43:18.786906 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.786877    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:18.867651 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.867624    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-znzln"
Jul 06 02:43:18.882975 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.882949    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-j7prq"]
Jul 06 02:43:18.885826 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:43:18.885798    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8448595b_2068_464c_8b03_e12d6ab1d6d7.slice/crio-c598e5af09e230d968e1fba2e8a0ed6a27e4b48125c5ac01d937a9af8dc14073 WatchSource:0}: Error finding container c598e5af09e230d968e1fba2e8a0ed6a27e4b48125c5ac01d937a9af8dc14073: Status 404 returned error can't find the container with id c598e5af09e230d968e1fba2e8a0ed6a27e4b48125c5ac01d937a9af8dc14073
Jul 06 02:43:18.898063 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.898037    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5czw2"]
Jul 06 02:43:18.901816 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:43:18.901786    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37c6a4d4_209c_44de_8217_26df1fec6e4d.slice/crio-b1bc626200db7a2731514b2c412a4a949b853d9f8fb69449d7b911f6f0398b8e WatchSource:0}: Error finding container b1bc626200db7a2731514b2c412a4a949b853d9f8fb69449d7b911f6f0398b8e: Status 404 returned error can't find the container with id b1bc626200db7a2731514b2c412a4a949b853d9f8fb69449d7b911f6f0398b8e
Jul 06 02:43:18.968509 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.968444    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5czw2" event={"ID":"37c6a4d4-209c-44de-8217-26df1fec6e4d","Type":"ContainerStarted","Data":"b1bc626200db7a2731514b2c412a4a949b853d9f8fb69449d7b911f6f0398b8e"}
Jul 06 02:43:18.970158 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.970123    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-j7prq" event={"ID":"8448595b-2068-464c-8b03-e12d6ab1d6d7","Type":"ContainerStarted","Data":"10213755e9b1a8f685be56939f4a5b028478a135e841c15751f1489c4d6864e5"}
Jul 06 02:43:18.970243 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.970172    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-j7prq" event={"ID":"8448595b-2068-464c-8b03-e12d6ab1d6d7","Type":"ContainerStarted","Data":"c598e5af09e230d968e1fba2e8a0ed6a27e4b48125c5ac01d937a9af8dc14073"}
Jul 06 02:43:18.985011 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.984216    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-j7prq" podStartSLOduration=0.984199806 podStartE2EDuration="984.199806ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:43:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:43:18.983397362 +0000 UTC m=+252.640407026" watchObservedRunningTime="2026-07-06 02:43:18.984199806 +0000 UTC m=+252.641209472"
Jul 06 02:43:18.996114 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:18.996080    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-znzln"]
Jul 06 02:43:19.000767 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:43:19.000731    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c8a4c86_30a0_400f_866b_4606d5284ddf.slice/crio-987677c9cbc927af50f3ce67f307dae757351d2c8ea96a4fcb04db1d67b794b2 WatchSource:0}: Error finding container 987677c9cbc927af50f3ce67f307dae757351d2c8ea96a4fcb04db1d67b794b2: Status 404 returned error can't find the container with id 987677c9cbc927af50f3ce67f307dae757351d2c8ea96a4fcb04db1d67b794b2
Jul 06 02:43:19.006444 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:19.006421    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35f61f76-1038-43ca-a749-71412ea26859-metrics-certs\") pod \"network-metrics-daemon-j4xxx\" (UID: \"35f61f76-1038-43ca-a749-71412ea26859\") " pod="openshift-multus/network-metrics-daemon-j4xxx"
Jul 06 02:43:19.006593 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:19.006569    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 06 02:43:19.006674 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:19.006635    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35f61f76-1038-43ca-a749-71412ea26859-metrics-certs podName:35f61f76-1038-43ca-a749-71412ea26859 nodeName:}" failed. No retries permitted until 2026-07-06 02:45:21.006616276 +0000 UTC m=+374.663625939 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/35f61f76-1038-43ca-a749-71412ea26859-metrics-certs") pod "network-metrics-daemon-j4xxx" (UID: "35f61f76-1038-43ca-a749-71412ea26859") : secret "metrics-daemon-secret" not found
Jul 06 02:43:19.107483 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:19.107461    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d8c6d860-781f-4225-981b-b12610156c02-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mj9sp\" (UID: \"d8c6d860-781f-4225-981b-b12610156c02\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mj9sp"
Jul 06 02:43:19.107622 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:19.107605    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 02:43:19.107691 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:19.107669    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8c6d860-781f-4225-981b-b12610156c02-samples-operator-tls podName:d8c6d860-781f-4225-981b-b12610156c02 nodeName:}" failed. No retries permitted until 2026-07-06 02:43:20.107650293 +0000 UTC m=+253.764659957 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d8c6d860-781f-4225-981b-b12610156c02-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-mj9sp" (UID: "d8c6d860-781f-4225-981b-b12610156c02") : secret "samples-operator-tls" not found
Jul 06 02:43:19.208442 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:19.208412    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c3246741-951c-41e7-a4f7-c7d3638e12e6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-x2lrc\" (UID: \"c3246741-951c-41e7-a4f7-c7d3638e12e6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x2lrc"
Jul 06 02:43:19.208568 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:19.208480    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a08183a-b8db-4b2c-94b3-357e745e785b-service-ca-bundle\") pod \"router-default-7444877bcc-p6fm2\" (UID: \"9a08183a-b8db-4b2c-94b3-357e745e785b\") " pod="openshift-ingress/router-default-7444877bcc-p6fm2"
Jul 06 02:43:19.208568 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:19.208502    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a08183a-b8db-4b2c-94b3-357e745e785b-metrics-certs\") pod \"router-default-7444877bcc-p6fm2\" (UID: \"9a08183a-b8db-4b2c-94b3-357e745e785b\") " pod="openshift-ingress/router-default-7444877bcc-p6fm2"
Jul 06 02:43:19.208662 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:19.208567    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 02:43:19.208662 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:19.208619    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a08183a-b8db-4b2c-94b3-357e745e785b-service-ca-bundle podName:9a08183a-b8db-4b2c-94b3-357e745e785b nodeName:}" failed. No retries permitted until 2026-07-06 02:43:20.20860493 +0000 UTC m=+253.865614572 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9a08183a-b8db-4b2c-94b3-357e745e785b-service-ca-bundle") pod "router-default-7444877bcc-p6fm2" (UID: "9a08183a-b8db-4b2c-94b3-357e745e785b") : configmap references non-existent config key: service-ca.crt
Jul 06 02:43:19.208662 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:19.208638    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3246741-951c-41e7-a4f7-c7d3638e12e6-cluster-monitoring-operator-tls podName:c3246741-951c-41e7-a4f7-c7d3638e12e6 nodeName:}" failed. No retries permitted until 2026-07-06 02:43:20.208631457 +0000 UTC m=+253.865641100 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c3246741-951c-41e7-a4f7-c7d3638e12e6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-x2lrc" (UID: "c3246741-951c-41e7-a4f7-c7d3638e12e6") : secret "cluster-monitoring-operator-tls" not found
Jul 06 02:43:19.208662 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:19.208642    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 02:43:19.208814 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:19.208691    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a08183a-b8db-4b2c-94b3-357e745e785b-metrics-certs podName:9a08183a-b8db-4b2c-94b3-357e745e785b nodeName:}" failed. No retries permitted until 2026-07-06 02:43:20.208674659 +0000 UTC m=+253.865684315 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a08183a-b8db-4b2c-94b3-357e745e785b-metrics-certs") pod "router-default-7444877bcc-p6fm2" (UID: "9a08183a-b8db-4b2c-94b3-357e745e785b") : secret "router-metrics-certs-default" not found
Jul 06 02:43:19.975040 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:19.975000    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-znzln" event={"ID":"1c8a4c86-30a0-400f-866b-4606d5284ddf","Type":"ContainerStarted","Data":"987677c9cbc927af50f3ce67f307dae757351d2c8ea96a4fcb04db1d67b794b2"}
Jul 06 02:43:20.117444 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:20.117402    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d8c6d860-781f-4225-981b-b12610156c02-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mj9sp\" (UID: \"d8c6d860-781f-4225-981b-b12610156c02\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mj9sp"
Jul 06 02:43:20.117618 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:20.117586    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 02:43:20.117693 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:20.117676    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8c6d860-781f-4225-981b-b12610156c02-samples-operator-tls podName:d8c6d860-781f-4225-981b-b12610156c02 nodeName:}" failed. No retries permitted until 2026-07-06 02:43:22.117654476 +0000 UTC m=+255.774664131 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d8c6d860-781f-4225-981b-b12610156c02-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-mj9sp" (UID: "d8c6d860-781f-4225-981b-b12610156c02") : secret "samples-operator-tls" not found
Jul 06 02:43:20.218115 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:20.218054    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c3246741-951c-41e7-a4f7-c7d3638e12e6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-x2lrc\" (UID: \"c3246741-951c-41e7-a4f7-c7d3638e12e6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x2lrc"
Jul 06 02:43:20.218288 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:20.218160    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a08183a-b8db-4b2c-94b3-357e745e785b-service-ca-bundle\") pod \"router-default-7444877bcc-p6fm2\" (UID: \"9a08183a-b8db-4b2c-94b3-357e745e785b\") " pod="openshift-ingress/router-default-7444877bcc-p6fm2"
Jul 06 02:43:20.218288 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:20.218187    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 02:43:20.218288 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:20.218263    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3246741-951c-41e7-a4f7-c7d3638e12e6-cluster-monitoring-operator-tls podName:c3246741-951c-41e7-a4f7-c7d3638e12e6 nodeName:}" failed. No retries permitted until 2026-07-06 02:43:22.218243408 +0000 UTC m=+255.875253055 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c3246741-951c-41e7-a4f7-c7d3638e12e6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-x2lrc" (UID: "c3246741-951c-41e7-a4f7-c7d3638e12e6") : secret "cluster-monitoring-operator-tls" not found
Jul 06 02:43:20.218288 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:20.218267    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 02:43:20.218521 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:20.218189    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a08183a-b8db-4b2c-94b3-357e745e785b-metrics-certs\") pod \"router-default-7444877bcc-p6fm2\" (UID: \"9a08183a-b8db-4b2c-94b3-357e745e785b\") " pod="openshift-ingress/router-default-7444877bcc-p6fm2"
Jul 06 02:43:20.218521 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:20.218319    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a08183a-b8db-4b2c-94b3-357e745e785b-metrics-certs podName:9a08183a-b8db-4b2c-94b3-357e745e785b nodeName:}" failed. No retries permitted until 2026-07-06 02:43:22.218303648 +0000 UTC m=+255.875313303 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a08183a-b8db-4b2c-94b3-357e745e785b-metrics-certs") pod "router-default-7444877bcc-p6fm2" (UID: "9a08183a-b8db-4b2c-94b3-357e745e785b") : secret "router-metrics-certs-default" not found
Jul 06 02:43:20.218521 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:20.218341    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a08183a-b8db-4b2c-94b3-357e745e785b-service-ca-bundle podName:9a08183a-b8db-4b2c-94b3-357e745e785b nodeName:}" failed. No retries permitted until 2026-07-06 02:43:22.218331264 +0000 UTC m=+255.875340908 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9a08183a-b8db-4b2c-94b3-357e745e785b-service-ca-bundle") pod "router-default-7444877bcc-p6fm2" (UID: "9a08183a-b8db-4b2c-94b3-357e745e785b") : configmap references non-existent config key: service-ca.crt
Jul 06 02:43:21.119851 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:21.119810    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:21.982563 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:21.982529    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5czw2" event={"ID":"37c6a4d4-209c-44de-8217-26df1fec6e4d","Type":"ContainerStarted","Data":"e0fc3b641ed7cd2d11c4b066bb9fcac3fc22aeb40285ef3912a012ea40ba3850"}
Jul 06 02:43:21.984005 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:21.983963    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-znzln" event={"ID":"1c8a4c86-30a0-400f-866b-4606d5284ddf","Type":"ContainerStarted","Data":"be2ba2738c3d5b732df900f372b16975a0e66af4d9b36e7b2ce9b27c42c1d636"}
Jul 06 02:43:21.997812 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:21.997773    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5czw2" podStartSLOduration=1.410598121 podStartE2EDuration="3.997760399s" totalImagesPullingTime="2.587162278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:43:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:43:21.996691557 +0000 UTC m=+255.653701223" watchObservedRunningTime="2026-07-06 02:43:21.997760399 +0000 UTC m=+255.654770063"
Jul 06 02:43:22.011566 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:22.011522    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-znzln" podStartSLOduration=1.5201904659999999 podStartE2EDuration="4.011504361s" totalImagesPullingTime="2.491313895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:43:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:43:22.010655968 +0000 UTC m=+255.667665629" watchObservedRunningTime="2026-07-06 02:43:22.011504361 +0000 UTC m=+255.668514028"
Jul 06 02:43:22.131217 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:22.131180    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d8c6d860-781f-4225-981b-b12610156c02-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mj9sp\" (UID: \"d8c6d860-781f-4225-981b-b12610156c02\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mj9sp"
Jul 06 02:43:22.131648 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:22.131374    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 02:43:22.131648 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:22.131469    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8c6d860-781f-4225-981b-b12610156c02-samples-operator-tls podName:d8c6d860-781f-4225-981b-b12610156c02 nodeName:}" failed. No retries permitted until 2026-07-06 02:43:26.131448426 +0000 UTC m=+259.788458072 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d8c6d860-781f-4225-981b-b12610156c02-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-mj9sp" (UID: "d8c6d860-781f-4225-981b-b12610156c02") : secret "samples-operator-tls" not found
Jul 06 02:43:22.231905 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:22.231872    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a08183a-b8db-4b2c-94b3-357e745e785b-service-ca-bundle\") pod \"router-default-7444877bcc-p6fm2\" (UID: \"9a08183a-b8db-4b2c-94b3-357e745e785b\") " pod="openshift-ingress/router-default-7444877bcc-p6fm2"
Jul 06 02:43:22.231905 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:22.231904    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a08183a-b8db-4b2c-94b3-357e745e785b-metrics-certs\") pod \"router-default-7444877bcc-p6fm2\" (UID: \"9a08183a-b8db-4b2c-94b3-357e745e785b\") " pod="openshift-ingress/router-default-7444877bcc-p6fm2"
Jul 06 02:43:22.232154 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:22.232027    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 02:43:22.232154 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:22.232078    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c3246741-951c-41e7-a4f7-c7d3638e12e6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-x2lrc\" (UID: \"c3246741-951c-41e7-a4f7-c7d3638e12e6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x2lrc"
Jul 06 02:43:22.232154 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:22.232084    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a08183a-b8db-4b2c-94b3-357e745e785b-metrics-certs podName:9a08183a-b8db-4b2c-94b3-357e745e785b nodeName:}" failed. No retries permitted until 2026-07-06 02:43:26.232064752 +0000 UTC m=+259.889074395 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a08183a-b8db-4b2c-94b3-357e745e785b-metrics-certs") pod "router-default-7444877bcc-p6fm2" (UID: "9a08183a-b8db-4b2c-94b3-357e745e785b") : secret "router-metrics-certs-default" not found
Jul 06 02:43:22.232154 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:22.232123    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a08183a-b8db-4b2c-94b3-357e745e785b-service-ca-bundle podName:9a08183a-b8db-4b2c-94b3-357e745e785b nodeName:}" failed. No retries permitted until 2026-07-06 02:43:26.232106881 +0000 UTC m=+259.889116537 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9a08183a-b8db-4b2c-94b3-357e745e785b-service-ca-bundle") pod "router-default-7444877bcc-p6fm2" (UID: "9a08183a-b8db-4b2c-94b3-357e745e785b") : configmap references non-existent config key: service-ca.crt
Jul 06 02:43:22.232332 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:22.232171    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 02:43:22.232332 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:22.232222    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3246741-951c-41e7-a4f7-c7d3638e12e6-cluster-monitoring-operator-tls podName:c3246741-951c-41e7-a4f7-c7d3638e12e6 nodeName:}" failed. No retries permitted until 2026-07-06 02:43:26.232209264 +0000 UTC m=+259.889218920 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c3246741-951c-41e7-a4f7-c7d3638e12e6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-x2lrc" (UID: "c3246741-951c-41e7-a4f7-c7d3638e12e6") : secret "cluster-monitoring-operator-tls" not found
Jul 06 02:43:23.208081 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:23.208044    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-m5lr8"]
Jul 06 02:43:23.211239 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:23.211223    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m5lr8"
Jul 06 02:43:23.213917 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:23.213886    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zj59f\""
Jul 06 02:43:23.214075 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:23.213923    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 02:43:23.214075 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:23.213966    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 02:43:23.214759 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:23.214742    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 02:43:23.214865 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:23.214765    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 02:43:23.220968 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:23.220943    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:23.223878 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:23.223859    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m5lr8"]
Jul 06 02:43:23.240203 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:23.240183    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/66eae218-7faa-4efc-84dd-7e019ed36e88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m5lr8\" (UID: \"66eae218-7faa-4efc-84dd-7e019ed36e88\") " pod="openshift-insights/insights-runtime-extractor-m5lr8"
Jul 06 02:43:23.240292 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:23.240226    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz69z\" (UniqueName: \"kubernetes.io/projected/66eae218-7faa-4efc-84dd-7e019ed36e88-kube-api-access-wz69z\") pod \"insights-runtime-extractor-m5lr8\" (UID: \"66eae218-7faa-4efc-84dd-7e019ed36e88\") " pod="openshift-insights/insights-runtime-extractor-m5lr8"
Jul 06 02:43:23.240292 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:23.240266    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/66eae218-7faa-4efc-84dd-7e019ed36e88-crio-socket\") pod \"insights-runtime-extractor-m5lr8\" (UID: \"66eae218-7faa-4efc-84dd-7e019ed36e88\") " pod="openshift-insights/insights-runtime-extractor-m5lr8"
Jul 06 02:43:23.240292 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:23.240281    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/66eae218-7faa-4efc-84dd-7e019ed36e88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m5lr8\" (UID: \"66eae218-7faa-4efc-84dd-7e019ed36e88\") " pod="openshift-insights/insights-runtime-extractor-m5lr8"
Jul 06 02:43:23.240414 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:23.240305    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/66eae218-7faa-4efc-84dd-7e019ed36e88-data-volume\") pod \"insights-runtime-extractor-m5lr8\" (UID: \"66eae218-7faa-4efc-84dd-7e019ed36e88\") " pod="openshift-insights/insights-runtime-extractor-m5lr8"
Jul 06 02:43:23.283451 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:23.283425    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:23.341632 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:23.341615    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/66eae218-7faa-4efc-84dd-7e019ed36e88-data-volume\") pod \"insights-runtime-extractor-m5lr8\" (UID: \"66eae218-7faa-4efc-84dd-7e019ed36e88\") " pod="openshift-insights/insights-runtime-extractor-m5lr8"
Jul 06 02:43:23.341718 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:23.341687    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/66eae218-7faa-4efc-84dd-7e019ed36e88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m5lr8\" (UID: \"66eae218-7faa-4efc-84dd-7e019ed36e88\") " pod="openshift-insights/insights-runtime-extractor-m5lr8"
Jul 06 02:43:23.341780 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:23.341737    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz69z\" (UniqueName: \"kubernetes.io/projected/66eae218-7faa-4efc-84dd-7e019ed36e88-kube-api-access-wz69z\") pod \"insights-runtime-extractor-m5lr8\" (UID: \"66eae218-7faa-4efc-84dd-7e019ed36e88\") " pod="openshift-insights/insights-runtime-extractor-m5lr8"
Jul 06 02:43:23.341780 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:23.341775    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 02:43:23.341850 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:23.341787    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/66eae218-7faa-4efc-84dd-7e019ed36e88-crio-socket\") pod \"insights-runtime-extractor-m5lr8\" (UID: \"66eae218-7faa-4efc-84dd-7e019ed36e88\") " pod="openshift-insights/insights-runtime-extractor-m5lr8"
Jul 06 02:43:23.341850 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:23.341812    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/66eae218-7faa-4efc-84dd-7e019ed36e88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m5lr8\" (UID: \"66eae218-7faa-4efc-84dd-7e019ed36e88\") " pod="openshift-insights/insights-runtime-extractor-m5lr8"
Jul 06 02:43:23.341850 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:23.341831    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66eae218-7faa-4efc-84dd-7e019ed36e88-insights-runtime-extractor-tls podName:66eae218-7faa-4efc-84dd-7e019ed36e88 nodeName:}" failed. No retries permitted until 2026-07-06 02:43:23.841814221 +0000 UTC m=+257.498823882 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/66eae218-7faa-4efc-84dd-7e019ed36e88-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m5lr8" (UID: "66eae218-7faa-4efc-84dd-7e019ed36e88") : secret "insights-runtime-extractor-tls" not found
Jul 06 02:43:23.341966 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:23.341871    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 02:43:23.341966 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:23.341906    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/66eae218-7faa-4efc-84dd-7e019ed36e88-kube-rbac-proxy-cm podName:66eae218-7faa-4efc-84dd-7e019ed36e88 nodeName:}" failed. No retries permitted until 2026-07-06 02:43:23.841894675 +0000 UTC m=+257.498904317 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/66eae218-7faa-4efc-84dd-7e019ed36e88-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m5lr8" (UID: "66eae218-7faa-4efc-84dd-7e019ed36e88") : configmap "kube-rbac-proxy" not found
Jul 06 02:43:23.341966 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:23.341913    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/66eae218-7faa-4efc-84dd-7e019ed36e88-crio-socket\") pod \"insights-runtime-extractor-m5lr8\" (UID: \"66eae218-7faa-4efc-84dd-7e019ed36e88\") " pod="openshift-insights/insights-runtime-extractor-m5lr8"
Jul 06 02:43:23.341966 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:23.341950    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/66eae218-7faa-4efc-84dd-7e019ed36e88-data-volume\") pod \"insights-runtime-extractor-m5lr8\" (UID: \"66eae218-7faa-4efc-84dd-7e019ed36e88\") " pod="openshift-insights/insights-runtime-extractor-m5lr8"
Jul 06 02:43:23.349934 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:23.349914    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz69z\" (UniqueName: \"kubernetes.io/projected/66eae218-7faa-4efc-84dd-7e019ed36e88-kube-api-access-wz69z\") pod \"insights-runtime-extractor-m5lr8\" (UID: \"66eae218-7faa-4efc-84dd-7e019ed36e88\") " pod="openshift-insights/insights-runtime-extractor-m5lr8"
Jul 06 02:43:23.647797 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:23.647750    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:23.656246 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:23.656217    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-v9d95"]
Jul 06 02:43:23.658934 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:23.658919    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-v9d95"
Jul 06 02:43:23.661273 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:23.661253    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 06 02:43:23.661364 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:23.661286    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-tlfx2\""
Jul 06 02:43:23.661364 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:23.661301    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 06 02:43:23.667351 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:23.667328    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-v9d95"]
Jul 06 02:43:23.741732 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:23.741704    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:23.744555 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:23.744535    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk5t8\" (UniqueName: \"kubernetes.io/projected/6c4c14f0-d61d-433a-9264-7449f715925b-kube-api-access-qk5t8\") pod \"migrator-d57d58cc9-v9d95\" (UID: \"6c4c14f0-d61d-433a-9264-7449f715925b\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-v9d95"
Jul 06 02:43:23.842423 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:23.842389    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:23.845406 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:23.845390    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/66eae218-7faa-4efc-84dd-7e019ed36e88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m5lr8\" (UID: \"66eae218-7faa-4efc-84dd-7e019ed36e88\") " pod="openshift-insights/insights-runtime-extractor-m5lr8"
Jul 06 02:43:23.845472 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:23.845447    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qk5t8\" (UniqueName: \"kubernetes.io/projected/6c4c14f0-d61d-433a-9264-7449f715925b-kube-api-access-qk5t8\") pod \"migrator-d57d58cc9-v9d95\" (UID: \"6c4c14f0-d61d-433a-9264-7449f715925b\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-v9d95"
Jul 06 02:43:23.845510 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:23.845492    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/66eae218-7faa-4efc-84dd-7e019ed36e88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m5lr8\" (UID: \"66eae218-7faa-4efc-84dd-7e019ed36e88\") " pod="openshift-insights/insights-runtime-extractor-m5lr8"
Jul 06 02:43:23.845553 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:23.845505    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 02:43:23.845588 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:23.845568    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/66eae218-7faa-4efc-84dd-7e019ed36e88-kube-rbac-proxy-cm podName:66eae218-7faa-4efc-84dd-7e019ed36e88 nodeName:}" failed. No retries permitted until 2026-07-06 02:43:24.845551925 +0000 UTC m=+258.502561567 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/66eae218-7faa-4efc-84dd-7e019ed36e88-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m5lr8" (UID: "66eae218-7faa-4efc-84dd-7e019ed36e88") : configmap "kube-rbac-proxy" not found
Jul 06 02:43:23.845639 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:23.845595    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 02:43:23.845673 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:23.845647    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66eae218-7faa-4efc-84dd-7e019ed36e88-insights-runtime-extractor-tls podName:66eae218-7faa-4efc-84dd-7e019ed36e88 nodeName:}" failed. No retries permitted until 2026-07-06 02:43:24.845632792 +0000 UTC m=+258.502642439 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/66eae218-7faa-4efc-84dd-7e019ed36e88-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m5lr8" (UID: "66eae218-7faa-4efc-84dd-7e019ed36e88") : secret "insights-runtime-extractor-tls" not found
Jul 06 02:43:23.853328 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:23.853305    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk5t8\" (UniqueName: \"kubernetes.io/projected/6c4c14f0-d61d-433a-9264-7449f715925b-kube-api-access-qk5t8\") pod \"migrator-d57d58cc9-v9d95\" (UID: \"6c4c14f0-d61d-433a-9264-7449f715925b\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-v9d95"
Jul 06 02:43:23.942132 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:23.942061    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:23.968412 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:23.968389    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-v9d95"
Jul 06 02:43:24.043263 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:24.043235    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:24.087143 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:24.087120    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-v9d95"]
Jul 06 02:43:24.090034 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:43:24.090007    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c4c14f0_d61d_433a_9264_7449f715925b.slice/crio-e717fb053142b0dcfe5cdb58a38a205d52d1bcb571331c5b04ce19295741edea WatchSource:0}: Error finding container e717fb053142b0dcfe5cdb58a38a205d52d1bcb571331c5b04ce19295741edea: Status 404 returned error can't find the container with id e717fb053142b0dcfe5cdb58a38a205d52d1bcb571331c5b04ce19295741edea
Jul 06 02:43:24.852233 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:24.852192    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/66eae218-7faa-4efc-84dd-7e019ed36e88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m5lr8\" (UID: \"66eae218-7faa-4efc-84dd-7e019ed36e88\") " pod="openshift-insights/insights-runtime-extractor-m5lr8"
Jul 06 02:43:24.852668 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:24.852363    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 02:43:24.852668 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:24.852392    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/66eae218-7faa-4efc-84dd-7e019ed36e88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m5lr8\" (UID: \"66eae218-7faa-4efc-84dd-7e019ed36e88\") " pod="openshift-insights/insights-runtime-extractor-m5lr8"
Jul 06 02:43:24.852668 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:24.852435    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66eae218-7faa-4efc-84dd-7e019ed36e88-insights-runtime-extractor-tls podName:66eae218-7faa-4efc-84dd-7e019ed36e88 nodeName:}" failed. No retries permitted until 2026-07-06 02:43:26.852414957 +0000 UTC m=+260.509424619 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/66eae218-7faa-4efc-84dd-7e019ed36e88-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m5lr8" (UID: "66eae218-7faa-4efc-84dd-7e019ed36e88") : secret "insights-runtime-extractor-tls" not found
Jul 06 02:43:24.852668 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:24.852508    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 02:43:24.852668 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:24.852568    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/66eae218-7faa-4efc-84dd-7e019ed36e88-kube-rbac-proxy-cm podName:66eae218-7faa-4efc-84dd-7e019ed36e88 nodeName:}" failed. No retries permitted until 2026-07-06 02:43:26.852551848 +0000 UTC m=+260.509561504 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/66eae218-7faa-4efc-84dd-7e019ed36e88-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m5lr8" (UID: "66eae218-7faa-4efc-84dd-7e019ed36e88") : configmap "kube-rbac-proxy" not found
Jul 06 02:43:24.995347 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:24.995304    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-v9d95" event={"ID":"6c4c14f0-d61d-433a-9264-7449f715925b","Type":"ContainerStarted","Data":"e717fb053142b0dcfe5cdb58a38a205d52d1bcb571331c5b04ce19295741edea"}
Jul 06 02:43:25.405232 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:25.405184    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v6b8r_5dea5b0e-3e8c-4ca2-9939-57e6bc1c2c80/dns-node-resolver/0.log"
Jul 06 02:43:25.535706 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:25.535672    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:25.589890 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:25.589860    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:26.000163 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:26.000127    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-v9d95" event={"ID":"6c4c14f0-d61d-433a-9264-7449f715925b","Type":"ContainerStarted","Data":"98cfc1b3193661da25b008d00f02bc48e4edac3c9e7fdca1969a6fa256253524"}
Jul 06 02:43:26.000548 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:26.000185    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-v9d95" event={"ID":"6c4c14f0-d61d-433a-9264-7449f715925b","Type":"ContainerStarted","Data":"a7fd01a62f97ce50db673d8b8c37841fae6d4bc00ff58f516d6d9bacfc9c41f5"}
Jul 06 02:43:26.017478 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:26.017436    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-v9d95" podStartSLOduration=1.635619545 podStartE2EDuration="3.017422443s" totalImagesPullingTime="1.381802898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:43:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:43:26.016831172 +0000 UTC m=+259.673840837" watchObservedRunningTime="2026-07-06 02:43:26.017422443 +0000 UTC m=+259.674432107"
Jul 06 02:43:26.165973 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:26.165940    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d8c6d860-781f-4225-981b-b12610156c02-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mj9sp\" (UID: \"d8c6d860-781f-4225-981b-b12610156c02\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mj9sp"
Jul 06 02:43:26.166150 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:26.166083    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 02:43:26.166150 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:26.166143    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8c6d860-781f-4225-981b-b12610156c02-samples-operator-tls podName:d8c6d860-781f-4225-981b-b12610156c02 nodeName:}" failed. No retries permitted until 2026-07-06 02:43:34.166127799 +0000 UTC m=+267.823137442 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d8c6d860-781f-4225-981b-b12610156c02-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-mj9sp" (UID: "d8c6d860-781f-4225-981b-b12610156c02") : secret "samples-operator-tls" not found
Jul 06 02:43:26.206251 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:26.206227    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-drltx_d6e0698e-7d78-4805-9704-03a57ae7ccce/node-ca/0.log"
Jul 06 02:43:26.266867 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:26.266805    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c3246741-951c-41e7-a4f7-c7d3638e12e6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-x2lrc\" (UID: \"c3246741-951c-41e7-a4f7-c7d3638e12e6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x2lrc"
Jul 06 02:43:26.267016 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:26.266930    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 02:43:26.267016 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:26.266972    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a08183a-b8db-4b2c-94b3-357e745e785b-service-ca-bundle\") pod \"router-default-7444877bcc-p6fm2\" (UID: \"9a08183a-b8db-4b2c-94b3-357e745e785b\") " pod="openshift-ingress/router-default-7444877bcc-p6fm2"
Jul 06 02:43:26.267016 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:26.267013    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3246741-951c-41e7-a4f7-c7d3638e12e6-cluster-monitoring-operator-tls podName:c3246741-951c-41e7-a4f7-c7d3638e12e6 nodeName:}" failed. No retries permitted until 2026-07-06 02:43:34.26697522 +0000 UTC m=+267.923984879 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c3246741-951c-41e7-a4f7-c7d3638e12e6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-x2lrc" (UID: "c3246741-951c-41e7-a4f7-c7d3638e12e6") : secret "cluster-monitoring-operator-tls" not found
Jul 06 02:43:26.267193 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:26.267051    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a08183a-b8db-4b2c-94b3-357e745e785b-metrics-certs\") pod \"router-default-7444877bcc-p6fm2\" (UID: \"9a08183a-b8db-4b2c-94b3-357e745e785b\") " pod="openshift-ingress/router-default-7444877bcc-p6fm2"
Jul 06 02:43:26.267193 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:26.267091    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a08183a-b8db-4b2c-94b3-357e745e785b-service-ca-bundle podName:9a08183a-b8db-4b2c-94b3-357e745e785b nodeName:}" failed. No retries permitted until 2026-07-06 02:43:34.267073209 +0000 UTC m=+267.924082868 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9a08183a-b8db-4b2c-94b3-357e745e785b-service-ca-bundle") pod "router-default-7444877bcc-p6fm2" (UID: "9a08183a-b8db-4b2c-94b3-357e745e785b") : configmap references non-existent config key: service-ca.crt
Jul 06 02:43:26.267193 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:26.267134    2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 02:43:26.267193 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:26.267178    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a08183a-b8db-4b2c-94b3-357e745e785b-metrics-certs podName:9a08183a-b8db-4b2c-94b3-357e745e785b nodeName:}" failed. No retries permitted until 2026-07-06 02:43:34.267167437 +0000 UTC m=+267.924177079 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a08183a-b8db-4b2c-94b3-357e745e785b-metrics-certs") pod "router-default-7444877bcc-p6fm2" (UID: "9a08183a-b8db-4b2c-94b3-357e745e785b") : secret "router-metrics-certs-default" not found
Jul 06 02:43:26.357442 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:26.357417    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:26.870823 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:26.870786    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/66eae218-7faa-4efc-84dd-7e019ed36e88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m5lr8\" (UID: \"66eae218-7faa-4efc-84dd-7e019ed36e88\") " pod="openshift-insights/insights-runtime-extractor-m5lr8"
Jul 06 02:43:26.871041 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:26.870884    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/66eae218-7faa-4efc-84dd-7e019ed36e88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m5lr8\" (UID: \"66eae218-7faa-4efc-84dd-7e019ed36e88\") " pod="openshift-insights/insights-runtime-extractor-m5lr8"
Jul 06 02:43:26.871041 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:26.870910    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 02:43:26.871041 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:26.870977    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/66eae218-7faa-4efc-84dd-7e019ed36e88-kube-rbac-proxy-cm podName:66eae218-7faa-4efc-84dd-7e019ed36e88 nodeName:}" failed. No retries permitted until 2026-07-06 02:43:30.870962616 +0000 UTC m=+264.527972262 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/66eae218-7faa-4efc-84dd-7e019ed36e88-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m5lr8" (UID: "66eae218-7faa-4efc-84dd-7e019ed36e88") : configmap "kube-rbac-proxy" not found
Jul 06 02:43:26.871041 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:26.871017    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 02:43:26.871214 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:26.871055    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66eae218-7faa-4efc-84dd-7e019ed36e88-insights-runtime-extractor-tls podName:66eae218-7faa-4efc-84dd-7e019ed36e88 nodeName:}" failed. No retries permitted until 2026-07-06 02:43:30.871044432 +0000 UTC m=+264.528054090 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/66eae218-7faa-4efc-84dd-7e019ed36e88-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m5lr8" (UID: "66eae218-7faa-4efc-84dd-7e019ed36e88") : secret "insights-runtime-extractor-tls" not found
Jul 06 02:43:27.004859 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:27.004821    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lfk4b_90203301-698e-4c93-abcc-211c1d8bdd51/serve-healthcheck-canary/0.log"
Jul 06 02:43:28.737467 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:28.737380    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:28.893470 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:28.893396    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:29.105635 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:29.105600    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:29.205925 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:29.205897    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:29.319809 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:29.319772    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:29.420639 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:29.420566    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:29.599289 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:29.599263    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:30.393805 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:30.393766    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:30.905284 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:30.905227    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/66eae218-7faa-4efc-84dd-7e019ed36e88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m5lr8\" (UID: \"66eae218-7faa-4efc-84dd-7e019ed36e88\") " pod="openshift-insights/insights-runtime-extractor-m5lr8"
Jul 06 02:43:30.905468 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:30.905371    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 02:43:30.905468 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:30.905380    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/66eae218-7faa-4efc-84dd-7e019ed36e88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m5lr8\" (UID: \"66eae218-7faa-4efc-84dd-7e019ed36e88\") " pod="openshift-insights/insights-runtime-extractor-m5lr8"
Jul 06 02:43:30.905468 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:30.905449    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/66eae218-7faa-4efc-84dd-7e019ed36e88-kube-rbac-proxy-cm podName:66eae218-7faa-4efc-84dd-7e019ed36e88 nodeName:}" failed. No retries permitted until 2026-07-06 02:43:38.905431259 +0000 UTC m=+272.562440918 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/66eae218-7faa-4efc-84dd-7e019ed36e88-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m5lr8" (UID: "66eae218-7faa-4efc-84dd-7e019ed36e88") : configmap "kube-rbac-proxy" not found
Jul 06 02:43:30.905580 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:30.905485    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 02:43:30.905580 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:30.905522    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66eae218-7faa-4efc-84dd-7e019ed36e88-insights-runtime-extractor-tls podName:66eae218-7faa-4efc-84dd-7e019ed36e88 nodeName:}" failed. No retries permitted until 2026-07-06 02:43:38.905510408 +0000 UTC m=+272.562520049 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/66eae218-7faa-4efc-84dd-7e019ed36e88-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m5lr8" (UID: "66eae218-7faa-4efc-84dd-7e019ed36e88") : secret "insights-runtime-extractor-tls" not found
Jul 06 02:43:30.991955 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:30.991923    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:31.189167 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:31.189066    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:31.596331 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:31.596280    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:31.790512 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:31.790477    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:32.390840 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:32.390809    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:32.703651 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:32.703557    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:32.804199 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:32.804167    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:32.857388 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:32.857353    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:33.198809 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:33.198783    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:33.250504 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:33.250471    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:33.594679 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:33.594644    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:33.993226 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:33.993111    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:34.232430 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:34.232394    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d8c6d860-781f-4225-981b-b12610156c02-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mj9sp\" (UID: \"d8c6d860-781f-4225-981b-b12610156c02\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mj9sp"
Jul 06 02:43:34.234760 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:34.234730    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d8c6d860-781f-4225-981b-b12610156c02-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mj9sp\" (UID: \"d8c6d860-781f-4225-981b-b12610156c02\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mj9sp"
Jul 06 02:43:34.333439 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:34.333411    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a08183a-b8db-4b2c-94b3-357e745e785b-service-ca-bundle\") pod \"router-default-7444877bcc-p6fm2\" (UID: \"9a08183a-b8db-4b2c-94b3-357e745e785b\") " pod="openshift-ingress/router-default-7444877bcc-p6fm2"
Jul 06 02:43:34.333555 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:34.333445    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a08183a-b8db-4b2c-94b3-357e745e785b-metrics-certs\") pod \"router-default-7444877bcc-p6fm2\" (UID: \"9a08183a-b8db-4b2c-94b3-357e745e785b\") " pod="openshift-ingress/router-default-7444877bcc-p6fm2"
Jul 06 02:43:34.333610 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:34.333552    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a08183a-b8db-4b2c-94b3-357e745e785b-service-ca-bundle podName:9a08183a-b8db-4b2c-94b3-357e745e785b nodeName:}" failed. No retries permitted until 2026-07-06 02:43:50.333534896 +0000 UTC m=+283.990544551 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9a08183a-b8db-4b2c-94b3-357e745e785b-service-ca-bundle") pod "router-default-7444877bcc-p6fm2" (UID: "9a08183a-b8db-4b2c-94b3-357e745e785b") : configmap references non-existent config key: service-ca.crt
Jul 06 02:43:34.333610 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:34.333577    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c3246741-951c-41e7-a4f7-c7d3638e12e6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-x2lrc\" (UID: \"c3246741-951c-41e7-a4f7-c7d3638e12e6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x2lrc"
Jul 06 02:43:34.333716 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:34.333665    2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 02:43:34.333716 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:34.333706    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3246741-951c-41e7-a4f7-c7d3638e12e6-cluster-monitoring-operator-tls podName:c3246741-951c-41e7-a4f7-c7d3638e12e6 nodeName:}" failed. No retries permitted until 2026-07-06 02:43:50.333695314 +0000 UTC m=+283.990704965 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c3246741-951c-41e7-a4f7-c7d3638e12e6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-x2lrc" (UID: "c3246741-951c-41e7-a4f7-c7d3638e12e6") : secret "cluster-monitoring-operator-tls" not found
Jul 06 02:43:34.335604 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:34.335578    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a08183a-b8db-4b2c-94b3-357e745e785b-metrics-certs\") pod \"router-default-7444877bcc-p6fm2\" (UID: \"9a08183a-b8db-4b2c-94b3-357e745e785b\") " pod="openshift-ingress/router-default-7444877bcc-p6fm2"
Jul 06 02:43:34.371337 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:34.371310    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mj9sp"
Jul 06 02:43:34.388354 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:34.388331    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:34.502699 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:34.502671    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mj9sp"]
Jul 06 02:43:34.592493 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:34.592437    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:34.989860 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:34.989767    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:35.027841 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:35.027800    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mj9sp" event={"ID":"d8c6d860-781f-4225-981b-b12610156c02","Type":"ContainerStarted","Data":"020ee304b6bb5c21c9406e346904c566546b66035e5740442ab7aa297bea22cd"}
Jul 06 02:43:35.375294 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:35.375261    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:35.792194 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:35.792158    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:36.264574 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:36.264540    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:36.388380 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:36.388308    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:36.489179 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:36.489147    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:37.035110 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:37.035075    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mj9sp" event={"ID":"d8c6d860-781f-4225-981b-b12610156c02","Type":"ContainerStarted","Data":"21ae9ed7d68fd5ca9e92542c8dbf5863268ccfd38cde063e7e498c0df6c3b5e6"}
Jul 06 02:43:37.035255 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:37.035129    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mj9sp" event={"ID":"d8c6d860-781f-4225-981b-b12610156c02","Type":"ContainerStarted","Data":"9e404bea7c2973e274d65d209176132aa5d0453cf887905e9754a04fee001f98"}
Jul 06 02:43:37.052244 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:37.052196    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mj9sp" podStartSLOduration=17.588559722 podStartE2EDuration="19.052180526s" totalImagesPullingTime="1.463620804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:43:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:43:37.050504296 +0000 UTC m=+270.707513971" watchObservedRunningTime="2026-07-06 02:43:37.052180526 +0000 UTC m=+270.709190190"
Jul 06 02:43:37.504761 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:37.504670    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:37.803093 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:37.803062    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:38.191455 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:38.191368    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:38.389810 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:38.389768    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:38.590720 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:38.590676    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:38.970466 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:38.970389    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/66eae218-7faa-4efc-84dd-7e019ed36e88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m5lr8\" (UID: \"66eae218-7faa-4efc-84dd-7e019ed36e88\") " pod="openshift-insights/insights-runtime-extractor-m5lr8"
Jul 06 02:43:38.970602 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:38.970480    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/66eae218-7faa-4efc-84dd-7e019ed36e88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m5lr8\" (UID: \"66eae218-7faa-4efc-84dd-7e019ed36e88\") " pod="openshift-insights/insights-runtime-extractor-m5lr8"
Jul 06 02:43:38.970602 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:38.970582    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 02:43:38.970669 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:38.970640    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66eae218-7faa-4efc-84dd-7e019ed36e88-insights-runtime-extractor-tls podName:66eae218-7faa-4efc-84dd-7e019ed36e88 nodeName:}" failed. No retries permitted until 2026-07-06 02:43:54.970624164 +0000 UTC m=+288.627633813 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/66eae218-7faa-4efc-84dd-7e019ed36e88-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m5lr8" (UID: "66eae218-7faa-4efc-84dd-7e019ed36e88") : secret "insights-runtime-extractor-tls" not found
Jul 06 02:43:38.970901 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:38.970884    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/66eae218-7faa-4efc-84dd-7e019ed36e88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m5lr8\" (UID: \"66eae218-7faa-4efc-84dd-7e019ed36e88\") " pod="openshift-insights/insights-runtime-extractor-m5lr8"
Jul 06 02:43:38.988024 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:38.987999    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:39.391851 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:39.391823    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:39.594323 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:39.594293    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:41.976852 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:41.976818    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:42.077445 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:42.077410    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:42.129839 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:42.129810    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:42.277097 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:42.277020    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:42.452661 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:42.452630    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:42.506334 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:42.506310    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:42.887682 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:42.887654    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:42.938850 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:42.938822    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:43.059287 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:43.059259    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:43.479240 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:43.479203    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:43.538429 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:43.538402    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:43.669296 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:43.669271    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:43.866873 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:43.866848    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:44.018026 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:44.017998    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:44.267147 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:44.267072    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:44.318782 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:44.318758    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:45.033119 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:45.033080    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:45.127793 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:45.127752    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:45.227772 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:45.227724    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:45.682613 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:45.682581    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:45.738756 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:45.738726    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:49.759294 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:49.759254    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-8578d6475c-nmhmd" podUID="aa4ac53c-39b9-4b21-a3d1-e3c16418c50e"
Jul 06 02:43:49.759294 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:49.759275    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-jfb42" podUID="072a4522-4dd2-440e-b0c0-d0b131322bca"
Jul 06 02:43:50.071149 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:50.071124    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-jfb42"
Jul 06 02:43:50.071286 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:50.071124    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8578d6475c-nmhmd"
Jul 06 02:43:50.355052 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:50.354945    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a08183a-b8db-4b2c-94b3-357e745e785b-service-ca-bundle\") pod \"router-default-7444877bcc-p6fm2\" (UID: \"9a08183a-b8db-4b2c-94b3-357e745e785b\") " pod="openshift-ingress/router-default-7444877bcc-p6fm2"
Jul 06 02:43:50.355233 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:50.355126    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c3246741-951c-41e7-a4f7-c7d3638e12e6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-x2lrc\" (UID: \"c3246741-951c-41e7-a4f7-c7d3638e12e6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x2lrc"
Jul 06 02:43:50.355636 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:50.355610    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a08183a-b8db-4b2c-94b3-357e745e785b-service-ca-bundle\") pod \"router-default-7444877bcc-p6fm2\" (UID: \"9a08183a-b8db-4b2c-94b3-357e745e785b\") " pod="openshift-ingress/router-default-7444877bcc-p6fm2"
Jul 06 02:43:50.357501 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:50.357477    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c3246741-951c-41e7-a4f7-c7d3638e12e6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-x2lrc\" (UID: \"c3246741-951c-41e7-a4f7-c7d3638e12e6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x2lrc"
Jul 06 02:43:50.360342 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:50.360316    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7444877bcc-p6fm2"
Jul 06 02:43:50.486843 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:50.486811    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7444877bcc-p6fm2"]
Jul 06 02:43:50.489593 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:43:50.489563    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a08183a_b8db_4b2c_94b3_357e745e785b.slice/crio-ac588db85f894ca2dc57795fb89806bb8a0056c3ea37fa8899407e6f112d9f35 WatchSource:0}: Error finding container ac588db85f894ca2dc57795fb89806bb8a0056c3ea37fa8899407e6f112d9f35: Status 404 returned error can't find the container with id ac588db85f894ca2dc57795fb89806bb8a0056c3ea37fa8899407e6f112d9f35
Jul 06 02:43:50.654358 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:50.654288    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x2lrc"
Jul 06 02:43:50.761266 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:43:50.761232    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-775zk" podUID="268b24ef-43c1-4813-b69e-0ba3f6cf44ad"
Jul 06 02:43:50.774635 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:50.774604    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x2lrc"]
Jul 06 02:43:50.777873 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:43:50.777850    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3246741_951c_41e7_a4f7_c7d3638e12e6.slice/crio-4d1161e64198891d03e22d2248be5d4614e27f547bc93d999101cfed370d015b WatchSource:0}: Error finding container 4d1161e64198891d03e22d2248be5d4614e27f547bc93d999101cfed370d015b: Status 404 returned error can't find the container with id 4d1161e64198891d03e22d2248be5d4614e27f547bc93d999101cfed370d015b
Jul 06 02:43:51.077809 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:51.077774    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7444877bcc-p6fm2" event={"ID":"9a08183a-b8db-4b2c-94b3-357e745e785b","Type":"ContainerStarted","Data":"ee21bf9c3f9d3325b2a151bfdae32338278c32194bf25454c46efec8c84ba911"}
Jul 06 02:43:51.077968 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:51.077822    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7444877bcc-p6fm2" event={"ID":"9a08183a-b8db-4b2c-94b3-357e745e785b","Type":"ContainerStarted","Data":"ac588db85f894ca2dc57795fb89806bb8a0056c3ea37fa8899407e6f112d9f35"}
Jul 06 02:43:51.078828 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:51.078806    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-775zk"
Jul 06 02:43:51.078828 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:51.078813    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x2lrc" event={"ID":"c3246741-951c-41e7-a4f7-c7d3638e12e6","Type":"ContainerStarted","Data":"4d1161e64198891d03e22d2248be5d4614e27f547bc93d999101cfed370d015b"}
Jul 06 02:43:51.096629 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:51.096584    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7444877bcc-p6fm2" podStartSLOduration=33.096568508 podStartE2EDuration="33.096568508s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:43:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:43:51.094670449 +0000 UTC m=+284.751680112" watchObservedRunningTime="2026-07-06 02:43:51.096568508 +0000 UTC m=+284.753578150"
Jul 06 02:43:51.360887 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:51.360816    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7444877bcc-p6fm2"
Jul 06 02:43:51.364724 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:51.364665    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7444877bcc-p6fm2"
Jul 06 02:43:52.082028 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:52.082002    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7444877bcc-p6fm2"
Jul 06 02:43:52.083290 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:52.083271    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7444877bcc-p6fm2"
Jul 06 02:43:52.869341 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:52.869255    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:53.034457 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:53.034411    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:53.086498 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:53.086468    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x2lrc" event={"ID":"c3246741-951c-41e7-a4f7-c7d3638e12e6","Type":"ContainerStarted","Data":"e15fce189e2a728846d298b8ab577efb1303257b6424e12e93e210cb0693fc40"}
Jul 06 02:43:53.102125 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:53.102075    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-x2lrc" podStartSLOduration=33.313508637 podStartE2EDuration="35.102056543s" totalImagesPullingTime="1.788547906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:43:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:43:53.10180654 +0000 UTC m=+286.758816217" watchObservedRunningTime="2026-07-06 02:43:53.102056543 +0000 UTC m=+286.759066208"
Jul 06 02:43:53.166650 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:53.166578    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:53.682402 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:53.682351    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-registry-tls\") pod \"image-registry-8578d6475c-nmhmd\" (UID: \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\") " pod="openshift-image-registry/image-registry-8578d6475c-nmhmd"
Jul 06 02:43:53.682402 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:53.682406    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/072a4522-4dd2-440e-b0c0-d0b131322bca-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-jfb42\" (UID: \"072a4522-4dd2-440e-b0c0-d0b131322bca\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-jfb42"
Jul 06 02:43:53.682641 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:53.682443    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/268b24ef-43c1-4813-b69e-0ba3f6cf44ad-metrics-tls\") pod \"dns-default-775zk\" (UID: \"268b24ef-43c1-4813-b69e-0ba3f6cf44ad\") " pod="openshift-dns/dns-default-775zk"
Jul 06 02:43:53.684753 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:53.684723    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/268b24ef-43c1-4813-b69e-0ba3f6cf44ad-metrics-tls\") pod \"dns-default-775zk\" (UID: \"268b24ef-43c1-4813-b69e-0ba3f6cf44ad\") " pod="openshift-dns/dns-default-775zk"
Jul 06 02:43:53.684882 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:53.684725    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-registry-tls\") pod \"image-registry-8578d6475c-nmhmd\" (UID: \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\") " pod="openshift-image-registry/image-registry-8578d6475c-nmhmd"
Jul 06 02:43:53.684882 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:53.684798    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/072a4522-4dd2-440e-b0c0-d0b131322bca-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-jfb42\" (UID: \"072a4522-4dd2-440e-b0c0-d0b131322bca\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-jfb42"
Jul 06 02:43:53.781505 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:53.781479    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lsrhl\""
Jul 06 02:43:53.789242 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:53.789209    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-775zk"
Jul 06 02:43:53.909632 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:53.909602    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-775zk"]
Jul 06 02:43:53.913155 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:43:53.913123    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod268b24ef_43c1_4813_b69e_0ba3f6cf44ad.slice/crio-31b85744de118348c6048c873469e9b5cc9c329034834282e805b93da287dc78 WatchSource:0}: Error finding container 31b85744de118348c6048c873469e9b5cc9c329034834282e805b93da287dc78: Status 404 returned error can't find the container with id 31b85744de118348c6048c873469e9b5cc9c329034834282e805b93da287dc78
Jul 06 02:43:53.975281 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:53.975201    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-gzhdc\""
Jul 06 02:43:53.975416 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:53.975289    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-k6b24\""
Jul 06 02:43:53.983125 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:53.983101    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-jfb42"
Jul 06 02:43:53.983229 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:53.983125    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8578d6475c-nmhmd"
Jul 06 02:43:54.090514 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:54.090483    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-775zk" event={"ID":"268b24ef-43c1-4813-b69e-0ba3f6cf44ad","Type":"ContainerStarted","Data":"31b85744de118348c6048c873469e9b5cc9c329034834282e805b93da287dc78"}
Jul 06 02:43:54.144962 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:54.144934    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8578d6475c-nmhmd"]
Jul 06 02:43:54.147843 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:43:54.147815    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa4ac53c_39b9_4b21_a3d1_e3c16418c50e.slice/crio-73a564db36553e888e5fec43e5340741e7eaffba9103db6129d007822e31d88b WatchSource:0}: Error finding container 73a564db36553e888e5fec43e5340741e7eaffba9103db6129d007822e31d88b: Status 404 returned error can't find the container with id 73a564db36553e888e5fec43e5340741e7eaffba9103db6129d007822e31d88b
Jul 06 02:43:54.158102 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:54.158077    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-jfb42"]
Jul 06 02:43:54.162178 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:43:54.162155    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod072a4522_4dd2_440e_b0c0_d0b131322bca.slice/crio-e1bd9a5b1238e98077278761d917cafd20bed06e916a806a5c178e9c3c0a2f60 WatchSource:0}: Error finding container e1bd9a5b1238e98077278761d917cafd20bed06e916a806a5c178e9c3c0a2f60: Status 404 returned error can't find the container with id e1bd9a5b1238e98077278761d917cafd20bed06e916a806a5c178e9c3c0a2f60
Jul 06 02:43:54.992894 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:54.992861    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/66eae218-7faa-4efc-84dd-7e019ed36e88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m5lr8\" (UID: \"66eae218-7faa-4efc-84dd-7e019ed36e88\") " pod="openshift-insights/insights-runtime-extractor-m5lr8"
Jul 06 02:43:54.995085 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:54.995060    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/66eae218-7faa-4efc-84dd-7e019ed36e88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m5lr8\" (UID: \"66eae218-7faa-4efc-84dd-7e019ed36e88\") " pod="openshift-insights/insights-runtime-extractor-m5lr8"
Jul 06 02:43:55.024995 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:55.024917    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m5lr8"
Jul 06 02:43:55.097818 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:55.097782    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8578d6475c-nmhmd" event={"ID":"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e","Type":"ContainerStarted","Data":"a32d523f2e30d976c8d9ded31dfa9e3dc07b172aac41384cd6e04ac3e57ca71e"}
Jul 06 02:43:55.098274 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:55.097843    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8578d6475c-nmhmd" event={"ID":"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e","Type":"ContainerStarted","Data":"73a564db36553e888e5fec43e5340741e7eaffba9103db6129d007822e31d88b"}
Jul 06 02:43:55.098274 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:55.098033    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8578d6475c-nmhmd"
Jul 06 02:43:55.099447 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:55.099415    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-jfb42" event={"ID":"072a4522-4dd2-440e-b0c0-d0b131322bca","Type":"ContainerStarted","Data":"e1bd9a5b1238e98077278761d917cafd20bed06e916a806a5c178e9c3c0a2f60"}
Jul 06 02:43:55.120076 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:55.120030    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8578d6475c-nmhmd" podStartSLOduration=287.120014389 podStartE2EDuration="4m47.120014389s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:39:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:43:55.118688383 +0000 UTC m=+288.775698043" watchObservedRunningTime="2026-07-06 02:43:55.120014389 +0000 UTC m=+288.777024053"
Jul 06 02:43:55.427935 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:55.427904    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m5lr8"]
Jul 06 02:43:55.809627 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:43:55.809587    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66eae218_7faa_4efc_84dd_7e019ed36e88.slice/crio-14a5ea7886c2f7c7e912b74f45e025f3baccbc35390c8fbdbe23234cbcc5f954 WatchSource:0}: Error finding container 14a5ea7886c2f7c7e912b74f45e025f3baccbc35390c8fbdbe23234cbcc5f954: Status 404 returned error can't find the container with id 14a5ea7886c2f7c7e912b74f45e025f3baccbc35390c8fbdbe23234cbcc5f954
Jul 06 02:43:56.067462 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:56.067384    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:56.098939 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:56.098904    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65d74fbc8c-tw8rz"]
Jul 06 02:43:56.102141 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:56.102123    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65d74fbc8c-tw8rz"
Jul 06 02:43:56.104490 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:56.104453    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 06 02:43:56.104490 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:56.104467    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 06 02:43:56.104674 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:56.104510    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 06 02:43:56.104674 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:56.104533    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-775zk" event={"ID":"268b24ef-43c1-4813-b69e-0ba3f6cf44ad","Type":"ContainerStarted","Data":"e8049fb914c330122872b00ff88235b12f090be5083550800eff8595d99e9207"}
Jul 06 02:43:56.104674 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:56.104582    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-775zk" event={"ID":"268b24ef-43c1-4813-b69e-0ba3f6cf44ad","Type":"ContainerStarted","Data":"a9d8174ffdf4987b9088c049ff0d23abd1bb893a420c77597aa768f14bb2d9d7"}
Jul 06 02:43:56.104674 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:56.104629    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-775zk"
Jul 06 02:43:56.105461 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:56.105444    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 06 02:43:56.105573 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:56.105482    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 06 02:43:56.105573 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:56.105551    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-ffz2r\""
Jul 06 02:43:56.105692 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:56.105584    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 06 02:43:56.105692 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:56.105594    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 06 02:43:56.106459 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:56.106440    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-jfb42" event={"ID":"072a4522-4dd2-440e-b0c0-d0b131322bca","Type":"ContainerStarted","Data":"cfceaa3608711d2a75ad230cbfef623e52042f15cead095aba2988618524a728"}
Jul 06 02:43:56.107770 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:56.107721    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m5lr8" event={"ID":"66eae218-7faa-4efc-84dd-7e019ed36e88","Type":"ContainerStarted","Data":"14a5ea7886c2f7c7e912b74f45e025f3baccbc35390c8fbdbe23234cbcc5f954"}
Jul 06 02:43:56.112294 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:56.112274    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65d74fbc8c-tw8rz"]
Jul 06 02:43:56.146011 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:56.145948    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-775zk" podStartSLOduration=251.200989672 podStartE2EDuration="4m13.145926308s" totalImagesPullingTime="1.944936636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:39:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:43:56.144826332 +0000 UTC m=+289.801835997" watchObservedRunningTime="2026-07-06 02:43:56.145926308 +0000 UTC m=+289.802935973"
Jul 06 02:43:56.146493 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:56.146463    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:56.158917 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:56.158869    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-jfb42" podStartSLOduration=278.975351832 podStartE2EDuration="4m40.158849346s" totalImagesPullingTime="1.183497514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:39:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:43:56.158424675 +0000 UTC m=+289.815434341" watchObservedRunningTime="2026-07-06 02:43:56.158849346 +0000 UTC m=+289.815859011"
Jul 06 02:43:56.206668 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:56.203999    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7928095d-e025-43fa-bd34-1a87375adae6-console-config\") pod \"console-65d74fbc8c-tw8rz\" (UID: \"7928095d-e025-43fa-bd34-1a87375adae6\") " pod="openshift-console/console-65d74fbc8c-tw8rz"
Jul 06 02:43:56.206668 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:56.204050    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr86j\" (UniqueName: \"kubernetes.io/projected/7928095d-e025-43fa-bd34-1a87375adae6-kube-api-access-lr86j\") pod \"console-65d74fbc8c-tw8rz\" (UID: \"7928095d-e025-43fa-bd34-1a87375adae6\") " pod="openshift-console/console-65d74fbc8c-tw8rz"
Jul 06 02:43:56.206668 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:56.204084    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7928095d-e025-43fa-bd34-1a87375adae6-console-serving-cert\") pod \"console-65d74fbc8c-tw8rz\" (UID: \"7928095d-e025-43fa-bd34-1a87375adae6\") " pod="openshift-console/console-65d74fbc8c-tw8rz"
Jul 06 02:43:56.206668 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:56.204127    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7928095d-e025-43fa-bd34-1a87375adae6-oauth-serving-cert\") pod \"console-65d74fbc8c-tw8rz\" (UID: \"7928095d-e025-43fa-bd34-1a87375adae6\") " pod="openshift-console/console-65d74fbc8c-tw8rz"
Jul 06 02:43:56.206668 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:56.204257    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7928095d-e025-43fa-bd34-1a87375adae6-console-oauth-config\") pod \"console-65d74fbc8c-tw8rz\" (UID: \"7928095d-e025-43fa-bd34-1a87375adae6\") " pod="openshift-console/console-65d74fbc8c-tw8rz"
Jul 06 02:43:56.206668 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:56.204305    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7928095d-e025-43fa-bd34-1a87375adae6-service-ca\") pod \"console-65d74fbc8c-tw8rz\" (UID: \"7928095d-e025-43fa-bd34-1a87375adae6\") " pod="openshift-console/console-65d74fbc8c-tw8rz"
Jul 06 02:43:56.248227 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:56.248125    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:56.305022 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:56.304891    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7928095d-e025-43fa-bd34-1a87375adae6-console-serving-cert\") pod \"console-65d74fbc8c-tw8rz\" (UID: \"7928095d-e025-43fa-bd34-1a87375adae6\") " pod="openshift-console/console-65d74fbc8c-tw8rz"
Jul 06 02:43:56.305022 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:56.305006    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7928095d-e025-43fa-bd34-1a87375adae6-oauth-serving-cert\") pod \"console-65d74fbc8c-tw8rz\" (UID: \"7928095d-e025-43fa-bd34-1a87375adae6\") " pod="openshift-console/console-65d74fbc8c-tw8rz"
Jul 06 02:43:56.305255 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:56.305094    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7928095d-e025-43fa-bd34-1a87375adae6-console-oauth-config\") pod \"console-65d74fbc8c-tw8rz\" (UID: \"7928095d-e025-43fa-bd34-1a87375adae6\") " pod="openshift-console/console-65d74fbc8c-tw8rz"
Jul 06 02:43:56.305255 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:56.305128    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7928095d-e025-43fa-bd34-1a87375adae6-service-ca\") pod \"console-65d74fbc8c-tw8rz\" (UID: \"7928095d-e025-43fa-bd34-1a87375adae6\") " pod="openshift-console/console-65d74fbc8c-tw8rz"
Jul 06 02:43:56.305255 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:56.305207    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7928095d-e025-43fa-bd34-1a87375adae6-console-config\") pod \"console-65d74fbc8c-tw8rz\" (UID: \"7928095d-e025-43fa-bd34-1a87375adae6\") " pod="openshift-console/console-65d74fbc8c-tw8rz"
Jul 06 02:43:56.305255 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:56.305249    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr86j\" (UniqueName: \"kubernetes.io/projected/7928095d-e025-43fa-bd34-1a87375adae6-kube-api-access-lr86j\") pod \"console-65d74fbc8c-tw8rz\" (UID: \"7928095d-e025-43fa-bd34-1a87375adae6\") " pod="openshift-console/console-65d74fbc8c-tw8rz"
Jul 06 02:43:56.306418 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:56.306343    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7928095d-e025-43fa-bd34-1a87375adae6-service-ca\") pod \"console-65d74fbc8c-tw8rz\" (UID: \"7928095d-e025-43fa-bd34-1a87375adae6\") " pod="openshift-console/console-65d74fbc8c-tw8rz"
Jul 06 02:43:56.306593 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:56.306571    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7928095d-e025-43fa-bd34-1a87375adae6-console-config\") pod \"console-65d74fbc8c-tw8rz\" (UID: \"7928095d-e025-43fa-bd34-1a87375adae6\") " pod="openshift-console/console-65d74fbc8c-tw8rz"
Jul 06 02:43:56.307840 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:56.307801    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7928095d-e025-43fa-bd34-1a87375adae6-oauth-serving-cert\") pod \"console-65d74fbc8c-tw8rz\" (UID: \"7928095d-e025-43fa-bd34-1a87375adae6\") " pod="openshift-console/console-65d74fbc8c-tw8rz"
Jul 06 02:43:56.308643 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:56.308520    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:56.310102 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:56.310080    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7928095d-e025-43fa-bd34-1a87375adae6-console-oauth-config\") pod \"console-65d74fbc8c-tw8rz\" (UID: \"7928095d-e025-43fa-bd34-1a87375adae6\") " pod="openshift-console/console-65d74fbc8c-tw8rz"
Jul 06 02:43:56.311752 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:56.311644    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7928095d-e025-43fa-bd34-1a87375adae6-console-serving-cert\") pod \"console-65d74fbc8c-tw8rz\" (UID: \"7928095d-e025-43fa-bd34-1a87375adae6\") " pod="openshift-console/console-65d74fbc8c-tw8rz"
Jul 06 02:43:56.322048 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:56.321935    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr86j\" (UniqueName: \"kubernetes.io/projected/7928095d-e025-43fa-bd34-1a87375adae6-kube-api-access-lr86j\") pod \"console-65d74fbc8c-tw8rz\" (UID: \"7928095d-e025-43fa-bd34-1a87375adae6\") " pod="openshift-console/console-65d74fbc8c-tw8rz"
Jul 06 02:43:56.413299 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:56.413256    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65d74fbc8c-tw8rz"
Jul 06 02:43:56.551772 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:56.551696    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:56.589340 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:56.589192    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65d74fbc8c-tw8rz"]
Jul 06 02:43:56.592790 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:43:56.592756    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7928095d_e025_43fa_bd34_1a87375adae6.slice/crio-d541beb1852e3239b7e617e0c052bc04e24d5eafb156264470dd6ebafe1342d0 WatchSource:0}: Error finding container d541beb1852e3239b7e617e0c052bc04e24d5eafb156264470dd6ebafe1342d0: Status 404 returned error can't find the container with id d541beb1852e3239b7e617e0c052bc04e24d5eafb156264470dd6ebafe1342d0
Jul 06 02:43:57.112975 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:57.112934    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65d74fbc8c-tw8rz" event={"ID":"7928095d-e025-43fa-bd34-1a87375adae6","Type":"ContainerStarted","Data":"d541beb1852e3239b7e617e0c052bc04e24d5eafb156264470dd6ebafe1342d0"}
Jul 06 02:43:58.295604 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:58.295443    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:58.395628 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:58.395586    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:59.269782 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:59.269748    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:43:59.323369 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:43:59.323306    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:01.128906 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:01.128872    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m5lr8" event={"ID":"66eae218-7faa-4efc-84dd-7e019ed36e88","Type":"ContainerStarted","Data":"76d962153212cc16508b6139c0ca7d17f2ddcb05963db84ceb1bca76eabe875e"}
Jul 06 02:44:01.130298 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:01.130276    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65d74fbc8c-tw8rz" event={"ID":"7928095d-e025-43fa-bd34-1a87375adae6","Type":"ContainerStarted","Data":"c09127959c9b76eee3557a2efdd57d481480169be8e2363dcfc765929667bc91"}
Jul 06 02:44:01.147602 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:01.147556    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65d74fbc8c-tw8rz" podStartSLOduration=1.07094792 podStartE2EDuration="5.147537532s" totalImagesPullingTime="4.076589612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:43:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:44:01.146633571 +0000 UTC m=+294.803643238" watchObservedRunningTime="2026-07-06 02:44:01.147537532 +0000 UTC m=+294.804547196"
Jul 06 02:44:02.136340 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:02.136303    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m5lr8" event={"ID":"66eae218-7faa-4efc-84dd-7e019ed36e88","Type":"ContainerStarted","Data":"7b2f02841321b1dacef220f5f66c0d4ddf1e3c7c36cdfe226d39d6e8605fb355"}
Jul 06 02:44:02.501154 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:02.501063    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:02.550215 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:02.550177    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:04.145813 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:04.145718    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m5lr8" event={"ID":"66eae218-7faa-4efc-84dd-7e019ed36e88","Type":"ContainerStarted","Data":"29f5dce2c3fa789b109109d604791a3fb981968d9dd09a5f2d13238bafd846b8"}
Jul 06 02:44:04.162562 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:04.162517    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-m5lr8" podStartSLOduration=33.294178642 podStartE2EDuration="41.1625027s" totalImagesPullingTime="7.868324058s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 02:43:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:44:04.161794478 +0000 UTC m=+297.818804154" watchObservedRunningTime="2026-07-06 02:44:04.1625027 +0000 UTC m=+297.819512363"
Jul 06 02:44:04.228517 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:44:04.228483    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-j4xxx" podUID="35f61f76-1038-43ca-a749-71412ea26859"
Jul 06 02:44:06.089124 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:06.089085    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:06.116106 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:06.116083    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-775zk"
Jul 06 02:44:06.414250 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:06.414172    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65d74fbc8c-tw8rz"
Jul 06 02:44:06.414250 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:06.414228    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65d74fbc8c-tw8rz"
Jul 06 02:44:06.415333 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:06.415303    2570 patch_prober.go:28] interesting pod/console-65d74fbc8c-tw8rz container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.18:8443/health\": dial tcp 10.132.0.18:8443: connect: connection refused" start-of-body=
Jul 06 02:44:06.415409 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:06.415353    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-65d74fbc8c-tw8rz" podUID="7928095d-e025-43fa-bd34-1a87375adae6" containerName="console" probeResult="failure" output="Get \"https://10.132.0.18:8443/health\": dial tcp 10.132.0.18:8443: connect: connection refused"
Jul 06 02:44:06.440507 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:06.440483    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:06.542560 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:06.542524    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:06.596392 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:06.596361    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:07.135867 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:07.135840    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfxlc_b2861d04-c87b-43b1-9bff-2b2199a136a3/ovn-acl-logging/0.log"
Jul 06 02:44:07.136632 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:07.136579    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfxlc_b2861d04-c87b-43b1-9bff-2b2199a136a3/ovn-acl-logging/0.log"
Jul 06 02:44:07.138835 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:07.138819    2570 kubelet.go:1648] "Image garbage collection succeeded"
Jul 06 02:44:07.193856 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:07.193828    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8578d6475c-nmhmd"]
Jul 06 02:44:07.268042 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:07.267863    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:07.369343 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:07.369309    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:07.422726 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:07.422646    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:07.562971 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:07.562941    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:07.694817 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:07.694733    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:09.318566 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:09.318534    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65d74fbc8c-tw8rz"]
Jul 06 02:44:10.212450 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:10.212415    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:10.426925 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:10.426895    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:10.467056 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:10.466973    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jgp4t"]
Jul 06 02:44:10.470232 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:10.470214    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jgp4t"
Jul 06 02:44:10.472495 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:10.472467    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 02:44:10.472740 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:10.472722    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 02:44:10.472740 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:10.472738    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6wxmd\""
Jul 06 02:44:10.472843 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:10.472789    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 02:44:10.473511 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:10.473495    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 02:44:10.505364 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:10.505338    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:10.573086 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:10.573055    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:10.620655 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:10.620626    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3029180d-d7dc-43fb-bf63-fe20abb9a93e-node-exporter-textfile\") pod \"node-exporter-jgp4t\" (UID: \"3029180d-d7dc-43fb-bf63-fe20abb9a93e\") " pod="openshift-monitoring/node-exporter-jgp4t"
Jul 06 02:44:10.620791 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:10.620679    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3029180d-d7dc-43fb-bf63-fe20abb9a93e-node-exporter-wtmp\") pod \"node-exporter-jgp4t\" (UID: \"3029180d-d7dc-43fb-bf63-fe20abb9a93e\") " pod="openshift-monitoring/node-exporter-jgp4t"
Jul 06 02:44:10.620791 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:10.620709    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3029180d-d7dc-43fb-bf63-fe20abb9a93e-metrics-client-ca\") pod \"node-exporter-jgp4t\" (UID: \"3029180d-d7dc-43fb-bf63-fe20abb9a93e\") " pod="openshift-monitoring/node-exporter-jgp4t"
Jul 06 02:44:10.620791 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:10.620735    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3029180d-d7dc-43fb-bf63-fe20abb9a93e-root\") pod \"node-exporter-jgp4t\" (UID: \"3029180d-d7dc-43fb-bf63-fe20abb9a93e\") " pod="openshift-monitoring/node-exporter-jgp4t"
Jul 06 02:44:10.620791 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:10.620770    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3029180d-d7dc-43fb-bf63-fe20abb9a93e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jgp4t\" (UID: \"3029180d-d7dc-43fb-bf63-fe20abb9a93e\") " pod="openshift-monitoring/node-exporter-jgp4t"
Jul 06 02:44:10.620959 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:10.620792    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3029180d-d7dc-43fb-bf63-fe20abb9a93e-sys\") pod \"node-exporter-jgp4t\" (UID: \"3029180d-d7dc-43fb-bf63-fe20abb9a93e\") " pod="openshift-monitoring/node-exporter-jgp4t"
Jul 06 02:44:10.620959 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:10.620854    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfj68\" (UniqueName: \"kubernetes.io/projected/3029180d-d7dc-43fb-bf63-fe20abb9a93e-kube-api-access-tfj68\") pod \"node-exporter-jgp4t\" (UID: \"3029180d-d7dc-43fb-bf63-fe20abb9a93e\") " pod="openshift-monitoring/node-exporter-jgp4t"
Jul 06 02:44:10.620959 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:10.620884    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3029180d-d7dc-43fb-bf63-fe20abb9a93e-node-exporter-tls\") pod \"node-exporter-jgp4t\" (UID: \"3029180d-d7dc-43fb-bf63-fe20abb9a93e\") " pod="openshift-monitoring/node-exporter-jgp4t"
Jul 06 02:44:10.620959 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:10.620913    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3029180d-d7dc-43fb-bf63-fe20abb9a93e-node-exporter-accelerators-collector-config\") pod \"node-exporter-jgp4t\" (UID: \"3029180d-d7dc-43fb-bf63-fe20abb9a93e\") " pod="openshift-monitoring/node-exporter-jgp4t"
Jul 06 02:44:10.721835 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:10.721764    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3029180d-d7dc-43fb-bf63-fe20abb9a93e-node-exporter-accelerators-collector-config\") pod \"node-exporter-jgp4t\" (UID: \"3029180d-d7dc-43fb-bf63-fe20abb9a93e\") " pod="openshift-monitoring/node-exporter-jgp4t"
Jul 06 02:44:10.721835 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:10.721806    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3029180d-d7dc-43fb-bf63-fe20abb9a93e-node-exporter-textfile\") pod \"node-exporter-jgp4t\" (UID: \"3029180d-d7dc-43fb-bf63-fe20abb9a93e\") " pod="openshift-monitoring/node-exporter-jgp4t"
Jul 06 02:44:10.722057 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:10.721838    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3029180d-d7dc-43fb-bf63-fe20abb9a93e-node-exporter-wtmp\") pod \"node-exporter-jgp4t\" (UID: \"3029180d-d7dc-43fb-bf63-fe20abb9a93e\") " pod="openshift-monitoring/node-exporter-jgp4t"
Jul 06 02:44:10.722057 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:10.721856    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3029180d-d7dc-43fb-bf63-fe20abb9a93e-metrics-client-ca\") pod \"node-exporter-jgp4t\" (UID: \"3029180d-d7dc-43fb-bf63-fe20abb9a93e\") " pod="openshift-monitoring/node-exporter-jgp4t"
Jul 06 02:44:10.722057 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:10.721873    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3029180d-d7dc-43fb-bf63-fe20abb9a93e-root\") pod \"node-exporter-jgp4t\" (UID: \"3029180d-d7dc-43fb-bf63-fe20abb9a93e\") " pod="openshift-monitoring/node-exporter-jgp4t"
Jul 06 02:44:10.722057 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:10.721893    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3029180d-d7dc-43fb-bf63-fe20abb9a93e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jgp4t\" (UID: \"3029180d-d7dc-43fb-bf63-fe20abb9a93e\") " pod="openshift-monitoring/node-exporter-jgp4t"
Jul 06 02:44:10.722057 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:10.721917    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3029180d-d7dc-43fb-bf63-fe20abb9a93e-sys\") pod \"node-exporter-jgp4t\" (UID: \"3029180d-d7dc-43fb-bf63-fe20abb9a93e\") " pod="openshift-monitoring/node-exporter-jgp4t"
Jul 06 02:44:10.722057 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:10.721976    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3029180d-d7dc-43fb-bf63-fe20abb9a93e-sys\") pod \"node-exporter-jgp4t\" (UID: \"3029180d-d7dc-43fb-bf63-fe20abb9a93e\") " pod="openshift-monitoring/node-exporter-jgp4t"
Jul 06 02:44:10.722057 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:10.722031    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3029180d-d7dc-43fb-bf63-fe20abb9a93e-node-exporter-wtmp\") pod \"node-exporter-jgp4t\" (UID: \"3029180d-d7dc-43fb-bf63-fe20abb9a93e\") " pod="openshift-monitoring/node-exporter-jgp4t"
Jul 06 02:44:10.722057 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:10.722045    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfj68\" (UniqueName: \"kubernetes.io/projected/3029180d-d7dc-43fb-bf63-fe20abb9a93e-kube-api-access-tfj68\") pod \"node-exporter-jgp4t\" (UID: \"3029180d-d7dc-43fb-bf63-fe20abb9a93e\") " pod="openshift-monitoring/node-exporter-jgp4t"
Jul 06 02:44:10.722451 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:10.722062    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3029180d-d7dc-43fb-bf63-fe20abb9a93e-root\") pod \"node-exporter-jgp4t\" (UID: \"3029180d-d7dc-43fb-bf63-fe20abb9a93e\") " pod="openshift-monitoring/node-exporter-jgp4t"
Jul 06 02:44:10.722451 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:10.722088    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3029180d-d7dc-43fb-bf63-fe20abb9a93e-node-exporter-tls\") pod \"node-exporter-jgp4t\" (UID: \"3029180d-d7dc-43fb-bf63-fe20abb9a93e\") " pod="openshift-monitoring/node-exporter-jgp4t"
Jul 06 02:44:10.722451 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:10.722268    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3029180d-d7dc-43fb-bf63-fe20abb9a93e-node-exporter-textfile\") pod \"node-exporter-jgp4t\" (UID: \"3029180d-d7dc-43fb-bf63-fe20abb9a93e\") " pod="openshift-monitoring/node-exporter-jgp4t"
Jul 06 02:44:10.722584 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:10.722495    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3029180d-d7dc-43fb-bf63-fe20abb9a93e-node-exporter-accelerators-collector-config\") pod \"node-exporter-jgp4t\" (UID: \"3029180d-d7dc-43fb-bf63-fe20abb9a93e\") " pod="openshift-monitoring/node-exporter-jgp4t"
Jul 06 02:44:10.722584 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:10.722531    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3029180d-d7dc-43fb-bf63-fe20abb9a93e-metrics-client-ca\") pod \"node-exporter-jgp4t\" (UID: \"3029180d-d7dc-43fb-bf63-fe20abb9a93e\") " pod="openshift-monitoring/node-exporter-jgp4t"
Jul 06 02:44:10.724422 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:10.724385    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3029180d-d7dc-43fb-bf63-fe20abb9a93e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jgp4t\" (UID: \"3029180d-d7dc-43fb-bf63-fe20abb9a93e\") " pod="openshift-monitoring/node-exporter-jgp4t"
Jul 06 02:44:10.724520 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:10.724468    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3029180d-d7dc-43fb-bf63-fe20abb9a93e-node-exporter-tls\") pod \"node-exporter-jgp4t\" (UID: \"3029180d-d7dc-43fb-bf63-fe20abb9a93e\") " pod="openshift-monitoring/node-exporter-jgp4t"
Jul 06 02:44:10.728878 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:10.728852    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfj68\" (UniqueName: \"kubernetes.io/projected/3029180d-d7dc-43fb-bf63-fe20abb9a93e-kube-api-access-tfj68\") pod \"node-exporter-jgp4t\" (UID: \"3029180d-d7dc-43fb-bf63-fe20abb9a93e\") " pod="openshift-monitoring/node-exporter-jgp4t"
Jul 06 02:44:10.736975 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:10.736949    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:10.779884 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:10.779864    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jgp4t"
Jul 06 02:44:10.792908 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:44:10.792887    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3029180d_d7dc_43fb_bf63_fe20abb9a93e.slice/crio-6e0774c908176f539af45e155ca7deb1c0e0057fb7e84723d3f5c871f1b3e9de WatchSource:0}: Error finding container 6e0774c908176f539af45e155ca7deb1c0e0057fb7e84723d3f5c871f1b3e9de: Status 404 returned error can't find the container with id 6e0774c908176f539af45e155ca7deb1c0e0057fb7e84723d3f5c871f1b3e9de
Jul 06 02:44:10.794831 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:10.794811    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 02:44:10.835610 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:10.835583    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:10.935613 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:10.935588    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:11.169053 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:11.169013    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:11.169902 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:11.169873    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jgp4t" event={"ID":"3029180d-d7dc-43fb-bf63-fe20abb9a93e","Type":"ContainerStarted","Data":"6e0774c908176f539af45e155ca7deb1c0e0057fb7e84723d3f5c871f1b3e9de"}
Jul 06 02:44:11.359760 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:11.359724    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:11.461030 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:11.460938    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:11.524374 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:11.524329    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:11.761912 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:11.761817    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:12.175303 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:12.175266    2570 generic.go:356] "Generic (PLEG): container finished" podID="3029180d-d7dc-43fb-bf63-fe20abb9a93e" containerID="f8c353e74a19c1ff72afa42ad48833c5d61dd758ade7ae13d5f26646f8c41371" exitCode=0
Jul 06 02:44:12.175303 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:12.175304    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jgp4t" event={"ID":"3029180d-d7dc-43fb-bf63-fe20abb9a93e","Type":"ContainerDied","Data":"f8c353e74a19c1ff72afa42ad48833c5d61dd758ade7ae13d5f26646f8c41371"}
Jul 06 02:44:12.299668 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:12.299644    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:12.393938 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:12.393905    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:12.720919 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:12.720887    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:13.184877 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:13.184837    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jgp4t" event={"ID":"3029180d-d7dc-43fb-bf63-fe20abb9a93e","Type":"ContainerStarted","Data":"6771b048814c27cd82752766cc58dbe84b11b39691e4c6b360738acd34c74d87"}
Jul 06 02:44:13.185071 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:13.184906    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jgp4t" event={"ID":"3029180d-d7dc-43fb-bf63-fe20abb9a93e","Type":"ContainerStarted","Data":"46f0fd81322efaef9eb945b06f4cfa008e29fa5abfa79fd677f1a2514732134e"}
Jul 06 02:44:13.202038 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:13.201995    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jgp4t" podStartSLOduration=2.075955644 podStartE2EDuration="3.201966814s" totalImagesPullingTime="1.062642932s" totalInitContainerRuntime="63.368238ms" isStatefulPod=true podCreationTimestamp="2026-07-06 02:44:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:44:13.200807749 +0000 UTC m=+306.857817413" watchObservedRunningTime="2026-07-06 02:44:13.201966814 +0000 UTC m=+306.858976478"
Jul 06 02:44:13.406424 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:13.406391    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:13.458321 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:13.458253    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:13.627741 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:13.627716    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:13.728479 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:13.728408    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:15.256198 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.256165    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-lsk29"]
Jul 06 02:44:15.256745 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.256385    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:15.259541 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.259522    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c656f4fd9-ffsh2"]
Jul 06 02:44:15.259681 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.259661    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lsk29"
Jul 06 02:44:15.261778 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.261757    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 06 02:44:15.261893 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.261791    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-mksd4\""
Jul 06 02:44:15.262327 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.262312    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c656f4fd9-ffsh2"
Jul 06 02:44:15.266531 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.266506    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-lsk29"]
Jul 06 02:44:15.270086 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.270065    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c656f4fd9-ffsh2"]
Jul 06 02:44:15.270941 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.270923    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 06 02:44:15.327244 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.327215    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:15.355549 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.355527    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f82a7536-b357-4e37-b35f-49b0587a07f3-console-oauth-config\") pod \"console-c656f4fd9-ffsh2\" (UID: \"f82a7536-b357-4e37-b35f-49b0587a07f3\") " pod="openshift-console/console-c656f4fd9-ffsh2"
Jul 06 02:44:15.355770 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.355560    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp5mm\" (UniqueName: \"kubernetes.io/projected/0cd8bc7b-dfb4-42f2-ba1c-8b03f8157c40-kube-api-access-qp5mm\") pod \"monitoring-plugin-d5dcff7cf-lsk29\" (UID: \"0cd8bc7b-dfb4-42f2-ba1c-8b03f8157c40\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lsk29"
Jul 06 02:44:15.355770 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.355580    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f82a7536-b357-4e37-b35f-49b0587a07f3-trusted-ca-bundle\") pod \"console-c656f4fd9-ffsh2\" (UID: \"f82a7536-b357-4e37-b35f-49b0587a07f3\") " pod="openshift-console/console-c656f4fd9-ffsh2"
Jul 06 02:44:15.355770 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.355620    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f82a7536-b357-4e37-b35f-49b0587a07f3-console-serving-cert\") pod \"console-c656f4fd9-ffsh2\" (UID: \"f82a7536-b357-4e37-b35f-49b0587a07f3\") " pod="openshift-console/console-c656f4fd9-ffsh2"
Jul 06 02:44:15.355770 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.355643    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f82a7536-b357-4e37-b35f-49b0587a07f3-console-config\") pod \"console-c656f4fd9-ffsh2\" (UID: \"f82a7536-b357-4e37-b35f-49b0587a07f3\") " pod="openshift-console/console-c656f4fd9-ffsh2"
Jul 06 02:44:15.355770 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.355701    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f82a7536-b357-4e37-b35f-49b0587a07f3-service-ca\") pod \"console-c656f4fd9-ffsh2\" (UID: \"f82a7536-b357-4e37-b35f-49b0587a07f3\") " pod="openshift-console/console-c656f4fd9-ffsh2"
Jul 06 02:44:15.355770 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.355752    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbdp4\" (UniqueName: \"kubernetes.io/projected/f82a7536-b357-4e37-b35f-49b0587a07f3-kube-api-access-rbdp4\") pod \"console-c656f4fd9-ffsh2\" (UID: \"f82a7536-b357-4e37-b35f-49b0587a07f3\") " pod="openshift-console/console-c656f4fd9-ffsh2"
Jul 06 02:44:15.355968 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.355776    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f82a7536-b357-4e37-b35f-49b0587a07f3-oauth-serving-cert\") pod \"console-c656f4fd9-ffsh2\" (UID: \"f82a7536-b357-4e37-b35f-49b0587a07f3\") " pod="openshift-console/console-c656f4fd9-ffsh2"
Jul 06 02:44:15.355968 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.355793    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0cd8bc7b-dfb4-42f2-ba1c-8b03f8157c40-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-lsk29\" (UID: \"0cd8bc7b-dfb4-42f2-ba1c-8b03f8157c40\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lsk29"
Jul 06 02:44:15.456390 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.456358    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f82a7536-b357-4e37-b35f-49b0587a07f3-console-oauth-config\") pod \"console-c656f4fd9-ffsh2\" (UID: \"f82a7536-b357-4e37-b35f-49b0587a07f3\") " pod="openshift-console/console-c656f4fd9-ffsh2"
Jul 06 02:44:15.456498 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.456410    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp5mm\" (UniqueName: \"kubernetes.io/projected/0cd8bc7b-dfb4-42f2-ba1c-8b03f8157c40-kube-api-access-qp5mm\") pod \"monitoring-plugin-d5dcff7cf-lsk29\" (UID: \"0cd8bc7b-dfb4-42f2-ba1c-8b03f8157c40\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lsk29"
Jul 06 02:44:15.456498 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.456440    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f82a7536-b357-4e37-b35f-49b0587a07f3-trusted-ca-bundle\") pod \"console-c656f4fd9-ffsh2\" (UID: \"f82a7536-b357-4e37-b35f-49b0587a07f3\") " pod="openshift-console/console-c656f4fd9-ffsh2"
Jul 06 02:44:15.456498 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.456462    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f82a7536-b357-4e37-b35f-49b0587a07f3-console-serving-cert\") pod \"console-c656f4fd9-ffsh2\" (UID: \"f82a7536-b357-4e37-b35f-49b0587a07f3\") " pod="openshift-console/console-c656f4fd9-ffsh2"
Jul 06 02:44:15.456498 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.456476    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f82a7536-b357-4e37-b35f-49b0587a07f3-console-config\") pod \"console-c656f4fd9-ffsh2\" (UID: \"f82a7536-b357-4e37-b35f-49b0587a07f3\") " pod="openshift-console/console-c656f4fd9-ffsh2"
Jul 06 02:44:15.456690 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.456625    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f82a7536-b357-4e37-b35f-49b0587a07f3-service-ca\") pod \"console-c656f4fd9-ffsh2\" (UID: \"f82a7536-b357-4e37-b35f-49b0587a07f3\") " pod="openshift-console/console-c656f4fd9-ffsh2"
Jul 06 02:44:15.456690 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.456682    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbdp4\" (UniqueName: \"kubernetes.io/projected/f82a7536-b357-4e37-b35f-49b0587a07f3-kube-api-access-rbdp4\") pod \"console-c656f4fd9-ffsh2\" (UID: \"f82a7536-b357-4e37-b35f-49b0587a07f3\") " pod="openshift-console/console-c656f4fd9-ffsh2"
Jul 06 02:44:15.456794 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.456712    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f82a7536-b357-4e37-b35f-49b0587a07f3-oauth-serving-cert\") pod \"console-c656f4fd9-ffsh2\" (UID: \"f82a7536-b357-4e37-b35f-49b0587a07f3\") " pod="openshift-console/console-c656f4fd9-ffsh2"
Jul 06 02:44:15.456794 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.456741    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0cd8bc7b-dfb4-42f2-ba1c-8b03f8157c40-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-lsk29\" (UID: \"0cd8bc7b-dfb4-42f2-ba1c-8b03f8157c40\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lsk29"
Jul 06 02:44:15.456900 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.456861    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:15.457396 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.457362    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f82a7536-b357-4e37-b35f-49b0587a07f3-service-ca\") pod \"console-c656f4fd9-ffsh2\" (UID: \"f82a7536-b357-4e37-b35f-49b0587a07f3\") " pod="openshift-console/console-c656f4fd9-ffsh2"
Jul 06 02:44:15.457396 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.457416    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f82a7536-b357-4e37-b35f-49b0587a07f3-trusted-ca-bundle\") pod \"console-c656f4fd9-ffsh2\" (UID: \"f82a7536-b357-4e37-b35f-49b0587a07f3\") " pod="openshift-console/console-c656f4fd9-ffsh2"
Jul 06 02:44:15.457614 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.457572    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f82a7536-b357-4e37-b35f-49b0587a07f3-oauth-serving-cert\") pod \"console-c656f4fd9-ffsh2\" (UID: \"f82a7536-b357-4e37-b35f-49b0587a07f3\") " pod="openshift-console/console-c656f4fd9-ffsh2"
Jul 06 02:44:15.457804 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.457783    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f82a7536-b357-4e37-b35f-49b0587a07f3-console-config\") pod \"console-c656f4fd9-ffsh2\" (UID: \"f82a7536-b357-4e37-b35f-49b0587a07f3\") " pod="openshift-console/console-c656f4fd9-ffsh2"
Jul 06 02:44:15.458926 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.458908    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f82a7536-b357-4e37-b35f-49b0587a07f3-console-serving-cert\") pod \"console-c656f4fd9-ffsh2\" (UID: \"f82a7536-b357-4e37-b35f-49b0587a07f3\") " pod="openshift-console/console-c656f4fd9-ffsh2"
Jul 06 02:44:15.459161 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.459144    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0cd8bc7b-dfb4-42f2-ba1c-8b03f8157c40-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-lsk29\" (UID: \"0cd8bc7b-dfb4-42f2-ba1c-8b03f8157c40\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lsk29"
Jul 06 02:44:15.459303 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.459286    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f82a7536-b357-4e37-b35f-49b0587a07f3-console-oauth-config\") pod \"console-c656f4fd9-ffsh2\" (UID: \"f82a7536-b357-4e37-b35f-49b0587a07f3\") " pod="openshift-console/console-c656f4fd9-ffsh2"
Jul 06 02:44:15.464251 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.464228    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbdp4\" (UniqueName: \"kubernetes.io/projected/f82a7536-b357-4e37-b35f-49b0587a07f3-kube-api-access-rbdp4\") pod \"console-c656f4fd9-ffsh2\" (UID: \"f82a7536-b357-4e37-b35f-49b0587a07f3\") " pod="openshift-console/console-c656f4fd9-ffsh2"
Jul 06 02:44:15.464416 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.464395    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp5mm\" (UniqueName: \"kubernetes.io/projected/0cd8bc7b-dfb4-42f2-ba1c-8b03f8157c40-kube-api-access-qp5mm\") pod \"monitoring-plugin-d5dcff7cf-lsk29\" (UID: \"0cd8bc7b-dfb4-42f2-ba1c-8b03f8157c40\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lsk29"
Jul 06 02:44:15.572472 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.572449    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lsk29"
Jul 06 02:44:15.577043 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.576622    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c656f4fd9-ffsh2"
Jul 06 02:44:15.637824 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.637789    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5bdd969686-d72dn"]
Jul 06 02:44:15.644423 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.643039    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5bdd969686-d72dn"
Jul 06 02:44:15.647525 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.647277    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 06 02:44:15.648466 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.647507    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 06 02:44:15.649896 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.648756    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 06 02:44:15.649896 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.648892    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 06 02:44:15.649896 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.649137    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-zcrgh\""
Jul 06 02:44:15.649896 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.649247    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 06 02:44:15.655044 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.655019    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 06 02:44:15.657023 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.656970    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5bdd969686-d72dn"]
Jul 06 02:44:15.658550 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.658523    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5bc64425-90ca-49ac-bfb9-56ae4edade5a-federate-client-tls\") pod \"telemeter-client-5bdd969686-d72dn\" (UID: \"5bc64425-90ca-49ac-bfb9-56ae4edade5a\") " pod="openshift-monitoring/telemeter-client-5bdd969686-d72dn"
Jul 06 02:44:15.658741 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.658632    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5bc64425-90ca-49ac-bfb9-56ae4edade5a-telemeter-client-tls\") pod \"telemeter-client-5bdd969686-d72dn\" (UID: \"5bc64425-90ca-49ac-bfb9-56ae4edade5a\") " pod="openshift-monitoring/telemeter-client-5bdd969686-d72dn"
Jul 06 02:44:15.658741 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.658685    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bc64425-90ca-49ac-bfb9-56ae4edade5a-serving-certs-ca-bundle\") pod \"telemeter-client-5bdd969686-d72dn\" (UID: \"5bc64425-90ca-49ac-bfb9-56ae4edade5a\") " pod="openshift-monitoring/telemeter-client-5bdd969686-d72dn"
Jul 06 02:44:15.658741 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.658726    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bc64425-90ca-49ac-bfb9-56ae4edade5a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5bdd969686-d72dn\" (UID: \"5bc64425-90ca-49ac-bfb9-56ae4edade5a\") " pod="openshift-monitoring/telemeter-client-5bdd969686-d72dn"
Jul 06 02:44:15.659026 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.658767    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5bc64425-90ca-49ac-bfb9-56ae4edade5a-metrics-client-ca\") pod \"telemeter-client-5bdd969686-d72dn\" (UID: \"5bc64425-90ca-49ac-bfb9-56ae4edade5a\") " pod="openshift-monitoring/telemeter-client-5bdd969686-d72dn"
Jul 06 02:44:15.659026 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.658943    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5bc64425-90ca-49ac-bfb9-56ae4edade5a-secret-telemeter-client\") pod \"telemeter-client-5bdd969686-d72dn\" (UID: \"5bc64425-90ca-49ac-bfb9-56ae4edade5a\") " pod="openshift-monitoring/telemeter-client-5bdd969686-d72dn"
Jul 06 02:44:15.659026 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.658975    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5bc64425-90ca-49ac-bfb9-56ae4edade5a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5bdd969686-d72dn\" (UID: \"5bc64425-90ca-49ac-bfb9-56ae4edade5a\") " pod="openshift-monitoring/telemeter-client-5bdd969686-d72dn"
Jul 06 02:44:15.659210 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.659025    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxf92\" (UniqueName: \"kubernetes.io/projected/5bc64425-90ca-49ac-bfb9-56ae4edade5a-kube-api-access-lxf92\") pod \"telemeter-client-5bdd969686-d72dn\" (UID: \"5bc64425-90ca-49ac-bfb9-56ae4edade5a\") " pod="openshift-monitoring/telemeter-client-5bdd969686-d72dn"
Jul 06 02:44:15.715114 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.715085    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-lsk29"]
Jul 06 02:44:15.718300 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:44:15.718274    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cd8bc7b_dfb4_42f2_ba1c_8b03f8157c40.slice/crio-cf17392f9737b0a2bffbb0f2547b019cc2af0c09828c65274ed9fcefdc1376ba WatchSource:0}: Error finding container cf17392f9737b0a2bffbb0f2547b019cc2af0c09828c65274ed9fcefdc1376ba: Status 404 returned error can't find the container with id cf17392f9737b0a2bffbb0f2547b019cc2af0c09828c65274ed9fcefdc1376ba
Jul 06 02:44:15.733374 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.733349    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c656f4fd9-ffsh2"]
Jul 06 02:44:15.736276 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:44:15.736255    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf82a7536_b357_4e37_b35f_49b0587a07f3.slice/crio-e0120b1188d308a7f3ff2eb74c629cc3948e35143a8319470025c4df13a6ea71 WatchSource:0}: Error finding container e0120b1188d308a7f3ff2eb74c629cc3948e35143a8319470025c4df13a6ea71: Status 404 returned error can't find the container with id e0120b1188d308a7f3ff2eb74c629cc3948e35143a8319470025c4df13a6ea71
Jul 06 02:44:15.759562 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.759535    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5bc64425-90ca-49ac-bfb9-56ae4edade5a-secret-telemeter-client\") pod \"telemeter-client-5bdd969686-d72dn\" (UID: \"5bc64425-90ca-49ac-bfb9-56ae4edade5a\") " pod="openshift-monitoring/telemeter-client-5bdd969686-d72dn"
Jul 06 02:44:15.759647 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.759564    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5bc64425-90ca-49ac-bfb9-56ae4edade5a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5bdd969686-d72dn\" (UID: \"5bc64425-90ca-49ac-bfb9-56ae4edade5a\") " pod="openshift-monitoring/telemeter-client-5bdd969686-d72dn"
Jul 06 02:44:15.759647 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.759584    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxf92\" (UniqueName: \"kubernetes.io/projected/5bc64425-90ca-49ac-bfb9-56ae4edade5a-kube-api-access-lxf92\") pod \"telemeter-client-5bdd969686-d72dn\" (UID: \"5bc64425-90ca-49ac-bfb9-56ae4edade5a\") " pod="openshift-monitoring/telemeter-client-5bdd969686-d72dn"
Jul 06 02:44:15.759647 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.759613    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5bc64425-90ca-49ac-bfb9-56ae4edade5a-federate-client-tls\") pod \"telemeter-client-5bdd969686-d72dn\" (UID: \"5bc64425-90ca-49ac-bfb9-56ae4edade5a\") " pod="openshift-monitoring/telemeter-client-5bdd969686-d72dn"
Jul 06 02:44:15.759647 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.759646    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5bc64425-90ca-49ac-bfb9-56ae4edade5a-telemeter-client-tls\") pod \"telemeter-client-5bdd969686-d72dn\" (UID: \"5bc64425-90ca-49ac-bfb9-56ae4edade5a\") " pod="openshift-monitoring/telemeter-client-5bdd969686-d72dn"
Jul 06 02:44:15.759825 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.759667    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bc64425-90ca-49ac-bfb9-56ae4edade5a-serving-certs-ca-bundle\") pod \"telemeter-client-5bdd969686-d72dn\" (UID: \"5bc64425-90ca-49ac-bfb9-56ae4edade5a\") " pod="openshift-monitoring/telemeter-client-5bdd969686-d72dn"
Jul 06 02:44:15.759825 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.759688    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bc64425-90ca-49ac-bfb9-56ae4edade5a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5bdd969686-d72dn\" (UID: \"5bc64425-90ca-49ac-bfb9-56ae4edade5a\") " pod="openshift-monitoring/telemeter-client-5bdd969686-d72dn"
Jul 06 02:44:15.759825 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.759720    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5bc64425-90ca-49ac-bfb9-56ae4edade5a-metrics-client-ca\") pod \"telemeter-client-5bdd969686-d72dn\" (UID: \"5bc64425-90ca-49ac-bfb9-56ae4edade5a\") " pod="openshift-monitoring/telemeter-client-5bdd969686-d72dn"
Jul 06 02:44:15.760891 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.760858    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bc64425-90ca-49ac-bfb9-56ae4edade5a-serving-certs-ca-bundle\") pod \"telemeter-client-5bdd969686-d72dn\" (UID: \"5bc64425-90ca-49ac-bfb9-56ae4edade5a\") " pod="openshift-monitoring/telemeter-client-5bdd969686-d72dn"
Jul 06 02:44:15.761043 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.760951    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bc64425-90ca-49ac-bfb9-56ae4edade5a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5bdd969686-d72dn\" (UID: \"5bc64425-90ca-49ac-bfb9-56ae4edade5a\") " pod="openshift-monitoring/telemeter-client-5bdd969686-d72dn"
Jul 06 02:44:15.762467 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.761513    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5bc64425-90ca-49ac-bfb9-56ae4edade5a-metrics-client-ca\") pod \"telemeter-client-5bdd969686-d72dn\" (UID: \"5bc64425-90ca-49ac-bfb9-56ae4edade5a\") " pod="openshift-monitoring/telemeter-client-5bdd969686-d72dn"
Jul 06 02:44:15.762847 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.762819    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5bc64425-90ca-49ac-bfb9-56ae4edade5a-secret-telemeter-client\") pod \"telemeter-client-5bdd969686-d72dn\" (UID: \"5bc64425-90ca-49ac-bfb9-56ae4edade5a\") " pod="openshift-monitoring/telemeter-client-5bdd969686-d72dn"
Jul 06 02:44:15.762925 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.762834    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5bc64425-90ca-49ac-bfb9-56ae4edade5a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5bdd969686-d72dn\" (UID: \"5bc64425-90ca-49ac-bfb9-56ae4edade5a\") " pod="openshift-monitoring/telemeter-client-5bdd969686-d72dn"
Jul 06 02:44:15.762925 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.762915    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5bc64425-90ca-49ac-bfb9-56ae4edade5a-telemeter-client-tls\") pod \"telemeter-client-5bdd969686-d72dn\" (UID: \"5bc64425-90ca-49ac-bfb9-56ae4edade5a\") " pod="openshift-monitoring/telemeter-client-5bdd969686-d72dn"
Jul 06 02:44:15.766298 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.766040    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5bc64425-90ca-49ac-bfb9-56ae4edade5a-federate-client-tls\") pod \"telemeter-client-5bdd969686-d72dn\" (UID: \"5bc64425-90ca-49ac-bfb9-56ae4edade5a\") " pod="openshift-monitoring/telemeter-client-5bdd969686-d72dn"
Jul 06 02:44:15.767510 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.767489    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxf92\" (UniqueName: \"kubernetes.io/projected/5bc64425-90ca-49ac-bfb9-56ae4edade5a-kube-api-access-lxf92\") pod \"telemeter-client-5bdd969686-d72dn\" (UID: \"5bc64425-90ca-49ac-bfb9-56ae4edade5a\") " pod="openshift-monitoring/telemeter-client-5bdd969686-d72dn"
Jul 06 02:44:15.958976 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:15.958901    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5bdd969686-d72dn"
Jul 06 02:44:16.085087 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:16.085002    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5bdd969686-d72dn"]
Jul 06 02:44:16.086921 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:44:16.086897    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bc64425_90ca_49ac_bfb9_56ae4edade5a.slice/crio-c9400c8949914b1dae63db69ce757a91387e3d0fade368e5322acf8bb498b124 WatchSource:0}: Error finding container c9400c8949914b1dae63db69ce757a91387e3d0fade368e5322acf8bb498b124: Status 404 returned error can't find the container with id c9400c8949914b1dae63db69ce757a91387e3d0fade368e5322acf8bb498b124
Jul 06 02:44:16.196755 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:16.196723    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lsk29" event={"ID":"0cd8bc7b-dfb4-42f2-ba1c-8b03f8157c40","Type":"ContainerStarted","Data":"cf17392f9737b0a2bffbb0f2547b019cc2af0c09828c65274ed9fcefdc1376ba"}
Jul 06 02:44:16.198254 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:16.198227    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c656f4fd9-ffsh2" event={"ID":"f82a7536-b357-4e37-b35f-49b0587a07f3","Type":"ContainerStarted","Data":"0d071acba571840c131c446a53e09794f9d2bca158763a943c908c41e13727b4"}
Jul 06 02:44:16.198375 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:16.198266    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c656f4fd9-ffsh2" event={"ID":"f82a7536-b357-4e37-b35f-49b0587a07f3","Type":"ContainerStarted","Data":"e0120b1188d308a7f3ff2eb74c629cc3948e35143a8319470025c4df13a6ea71"}
Jul 06 02:44:16.199335 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:16.199314    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5bdd969686-d72dn" event={"ID":"5bc64425-90ca-49ac-bfb9-56ae4edade5a","Type":"ContainerStarted","Data":"c9400c8949914b1dae63db69ce757a91387e3d0fade368e5322acf8bb498b124"}
Jul 06 02:44:16.215092 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:16.215021    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c656f4fd9-ffsh2" podStartSLOduration=1.215007077 podStartE2EDuration="1.215007077s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:44:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:44:16.214125099 +0000 UTC m=+309.871134759" watchObservedRunningTime="2026-07-06 02:44:16.215007077 +0000 UTC m=+309.872016740"
Jul 06 02:44:16.227280 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:16.227260    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4xxx"
Jul 06 02:44:16.284796 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:16.284772    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:16.361160 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:16.361121    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:16.689187 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:16.689065    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:17.200633 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:17.200611    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8578d6475c-nmhmd"
Jul 06 02:44:18.208414 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:18.208324    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lsk29" event={"ID":"0cd8bc7b-dfb4-42f2-ba1c-8b03f8157c40","Type":"ContainerStarted","Data":"764496e7c19de29587ce8fff4de66f7582eac15c3afe219611963cc61567a0bf"}
Jul 06 02:44:18.208414 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:18.208388    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lsk29"
Jul 06 02:44:18.209917 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:18.209893    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5bdd969686-d72dn" event={"ID":"5bc64425-90ca-49ac-bfb9-56ae4edade5a","Type":"ContainerStarted","Data":"80f2e3e342c1aecc4128f7302fa0ca09d0fc8a3dc86d39efeb636cfb147bdb36"}
Jul 06 02:44:18.213726 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:18.213704    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lsk29"
Jul 06 02:44:18.223737 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:18.223696    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lsk29" podStartSLOduration=1.798602786 podStartE2EDuration="3.223682874s" totalImagesPullingTime="1.425080088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:44:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:44:18.222958999 +0000 UTC m=+311.879968665" watchObservedRunningTime="2026-07-06 02:44:18.223682874 +0000 UTC m=+311.880692548"
Jul 06 02:44:19.216726 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:19.216634    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5bdd969686-d72dn" event={"ID":"5bc64425-90ca-49ac-bfb9-56ae4edade5a","Type":"ContainerStarted","Data":"9843f8c9b775a5b5efbe6fe88b8d41336fdbe7f5ba2e224d723f9ef75322961c"}
Jul 06 02:44:19.217155 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:19.216725    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5bdd969686-d72dn" event={"ID":"5bc64425-90ca-49ac-bfb9-56ae4edade5a","Type":"ContainerStarted","Data":"ba6a70d0bc3221d3f7dac872600cc68bce88e1c81f51027419c89d1a4d5b578b"}
Jul 06 02:44:19.240307 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:19.240262    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5bdd969686-d72dn" podStartSLOduration=1.476449772 podStartE2EDuration="4.240247576s" totalImagesPullingTime="2.763797804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:44:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:44:19.238067231 +0000 UTC m=+312.895076900" watchObservedRunningTime="2026-07-06 02:44:19.240247576 +0000 UTC m=+312.897257274"
Jul 06 02:44:19.367568 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:19.367539    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:19.425457 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:19.425412    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:20.222051 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:20.222021    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c656f4fd9-ffsh2"]
Jul 06 02:44:20.247905 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:20.247872    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8576d5dbb4-jh96z"]
Jul 06 02:44:20.251127 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:20.251108    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8576d5dbb4-jh96z"
Jul 06 02:44:20.259442 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:20.259416    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8576d5dbb4-jh96z"]
Jul 06 02:44:20.294355 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:20.294329    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff-console-oauth-config\") pod \"console-8576d5dbb4-jh96z\" (UID: \"32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff\") " pod="openshift-console/console-8576d5dbb4-jh96z"
Jul 06 02:44:20.294485 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:20.294384    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff-console-serving-cert\") pod \"console-8576d5dbb4-jh96z\" (UID: \"32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff\") " pod="openshift-console/console-8576d5dbb4-jh96z"
Jul 06 02:44:20.294485 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:20.294449    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7clr\" (UniqueName: \"kubernetes.io/projected/32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff-kube-api-access-v7clr\") pod \"console-8576d5dbb4-jh96z\" (UID: \"32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff\") " pod="openshift-console/console-8576d5dbb4-jh96z"
Jul 06 02:44:20.294485 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:20.294471    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff-oauth-serving-cert\") pod \"console-8576d5dbb4-jh96z\" (UID: \"32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff\") " pod="openshift-console/console-8576d5dbb4-jh96z"
Jul 06 02:44:20.294651 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:20.294596    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff-trusted-ca-bundle\") pod \"console-8576d5dbb4-jh96z\" (UID: \"32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff\") " pod="openshift-console/console-8576d5dbb4-jh96z"
Jul 06 02:44:20.294706 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:20.294681    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff-service-ca\") pod \"console-8576d5dbb4-jh96z\" (UID: \"32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff\") " pod="openshift-console/console-8576d5dbb4-jh96z"
Jul 06 02:44:20.294874 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:20.294853    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff-console-config\") pod \"console-8576d5dbb4-jh96z\" (UID: \"32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff\") " pod="openshift-console/console-8576d5dbb4-jh96z"
Jul 06 02:44:20.296034 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:20.296014    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:20.395461 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:20.395427    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff-service-ca\") pod \"console-8576d5dbb4-jh96z\" (UID: \"32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff\") " pod="openshift-console/console-8576d5dbb4-jh96z"
Jul 06 02:44:20.395591 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:20.395467    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff-console-config\") pod \"console-8576d5dbb4-jh96z\" (UID: \"32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff\") " pod="openshift-console/console-8576d5dbb4-jh96z"
Jul 06 02:44:20.395591 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:20.395490    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff-console-oauth-config\") pod \"console-8576d5dbb4-jh96z\" (UID: \"32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff\") " pod="openshift-console/console-8576d5dbb4-jh96z"
Jul 06 02:44:20.395591 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:20.395528    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff-console-serving-cert\") pod \"console-8576d5dbb4-jh96z\" (UID: \"32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff\") " pod="openshift-console/console-8576d5dbb4-jh96z"
Jul 06 02:44:20.395591 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:20.395553    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7clr\" (UniqueName: \"kubernetes.io/projected/32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff-kube-api-access-v7clr\") pod \"console-8576d5dbb4-jh96z\" (UID: \"32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff\") " pod="openshift-console/console-8576d5dbb4-jh96z"
Jul 06 02:44:20.395591 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:20.395572    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff-oauth-serving-cert\") pod \"console-8576d5dbb4-jh96z\" (UID: \"32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff\") " pod="openshift-console/console-8576d5dbb4-jh96z"
Jul 06 02:44:20.396316 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:20.396263    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff-service-ca\") pod \"console-8576d5dbb4-jh96z\" (UID: \"32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff\") " pod="openshift-console/console-8576d5dbb4-jh96z"
Jul 06 02:44:20.396453 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:20.396333    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff-console-config\") pod \"console-8576d5dbb4-jh96z\" (UID: \"32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff\") " pod="openshift-console/console-8576d5dbb4-jh96z"
Jul 06 02:44:20.396453 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:20.396387    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff-oauth-serving-cert\") pod \"console-8576d5dbb4-jh96z\" (UID: \"32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff\") " pod="openshift-console/console-8576d5dbb4-jh96z"
Jul 06 02:44:20.396453 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:20.396402    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff-trusted-ca-bundle\") pod \"console-8576d5dbb4-jh96z\" (UID: \"32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff\") " pod="openshift-console/console-8576d5dbb4-jh96z"
Jul 06 02:44:20.397233 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:20.397204    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:20.397369 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:20.397343    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff-trusted-ca-bundle\") pod \"console-8576d5dbb4-jh96z\" (UID: \"32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff\") " pod="openshift-console/console-8576d5dbb4-jh96z"
Jul 06 02:44:20.398166 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:20.398146    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff-console-oauth-config\") pod \"console-8576d5dbb4-jh96z\" (UID: \"32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff\") " pod="openshift-console/console-8576d5dbb4-jh96z"
Jul 06 02:44:20.398330 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:20.398312    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff-console-serving-cert\") pod \"console-8576d5dbb4-jh96z\" (UID: \"32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff\") " pod="openshift-console/console-8576d5dbb4-jh96z"
Jul 06 02:44:20.402324 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:20.402308    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7clr\" (UniqueName: \"kubernetes.io/projected/32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff-kube-api-access-v7clr\") pod \"console-8576d5dbb4-jh96z\" (UID: \"32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff\") " pod="openshift-console/console-8576d5dbb4-jh96z"
Jul 06 02:44:20.560369 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:20.560340    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8576d5dbb4-jh96z"
Jul 06 02:44:20.684440 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:20.684415    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8576d5dbb4-jh96z"]
Jul 06 02:44:20.687059 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:44:20.687036    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32dca9a1_71e1_4b1e_aa0d_5f73e609e6ff.slice/crio-5390e11f36df2c445a89efd585af31e66ac7058d714c8f2a22e4212bce234229 WatchSource:0}: Error finding container 5390e11f36df2c445a89efd585af31e66ac7058d714c8f2a22e4212bce234229: Status 404 returned error can't find the container with id 5390e11f36df2c445a89efd585af31e66ac7058d714c8f2a22e4212bce234229
Jul 06 02:44:21.226144 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:21.226112    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8576d5dbb4-jh96z" event={"ID":"32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff","Type":"ContainerStarted","Data":"82d699bda6870fff24213a7e266282efe244d8fcc0bead675817366888f47649"}
Jul 06 02:44:21.226480 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:21.226157    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8576d5dbb4-jh96z" event={"ID":"32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff","Type":"ContainerStarted","Data":"5390e11f36df2c445a89efd585af31e66ac7058d714c8f2a22e4212bce234229"}
Jul 06 02:44:21.244196 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:21.244155    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8576d5dbb4-jh96z" podStartSLOduration=1.244141344 podStartE2EDuration="1.244141344s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:44:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:44:21.242344011 +0000 UTC m=+314.899353666" watchObservedRunningTime="2026-07-06 02:44:21.244141344 +0000 UTC m=+314.901151008"
Jul 06 02:44:22.110391 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:22.110351    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:22.161972 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:22.161944    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:23.604575 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:23.604540    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:24.383001 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:24.382952    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:25.577100 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:25.577066    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c656f4fd9-ffsh2"
Jul 06 02:44:28.251999 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:28.251943    2570 generic.go:356] "Generic (PLEG): container finished" podID="37c6a4d4-209c-44de-8217-26df1fec6e4d" containerID="e0fc3b641ed7cd2d11c4b066bb9fcac3fc22aeb40285ef3912a012ea40ba3850" exitCode=0
Jul 06 02:44:28.252434 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:28.251975    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5czw2" event={"ID":"37c6a4d4-209c-44de-8217-26df1fec6e4d","Type":"ContainerDied","Data":"e0fc3b641ed7cd2d11c4b066bb9fcac3fc22aeb40285ef3912a012ea40ba3850"}
Jul 06 02:44:28.252434 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:28.252329    2570 scope.go:117] "RemoveContainer" containerID="e0fc3b641ed7cd2d11c4b066bb9fcac3fc22aeb40285ef3912a012ea40ba3850"
Jul 06 02:44:28.482783 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:28.482750    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:28.536246 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:28.536208    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:29.257403 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:29.257372    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-5czw2" event={"ID":"37c6a4d4-209c-44de-8217-26df1fec6e4d","Type":"ContainerStarted","Data":"8c322f73fff83c0b5f2e61ad9c7070ebfbb81cc94157bbdc5bd12eb17f85b6c0"}
Jul 06 02:44:29.274745 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:29.274718    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:29.374710 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:29.374666    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:30.560856 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:30.560824    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8576d5dbb4-jh96z"
Jul 06 02:44:30.561313 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:30.560876    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8576d5dbb4-jh96z"
Jul 06 02:44:30.565893 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:30.565870    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8576d5dbb4-jh96z"
Jul 06 02:44:31.270964 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:31.270930    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8576d5dbb4-jh96z"
Jul 06 02:44:31.420472 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:31.420434    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:31.477663 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:31.477621    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:32.214017 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:32.213968    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-8578d6475c-nmhmd" podUID="aa4ac53c-39b9-4b21-a3d1-e3c16418c50e" containerName="registry" containerID="cri-o://a32d523f2e30d976c8d9ded31dfa9e3dc07b172aac41384cd6e04ac3e57ca71e" gracePeriod=30
Jul 06 02:44:32.502430 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:32.502405    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8578d6475c-nmhmd"
Jul 06 02:44:32.594624 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:32.594589    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-installation-pull-secrets\") pod \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\" (UID: \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\") "
Jul 06 02:44:32.594792 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:32.594634    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-trusted-ca\") pod \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\" (UID: \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\") "
Jul 06 02:44:32.594792 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:32.594671    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-registry-tls\") pod \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\" (UID: \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\") "
Jul 06 02:44:32.594792 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:32.594696    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n9522\" (UniqueName: \"kubernetes.io/projected/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-kube-api-access-n9522\") pod \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\" (UID: \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\") "
Jul 06 02:44:32.594792 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:32.594718    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-image-registry-private-configuration\") pod \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\" (UID: \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\") "
Jul 06 02:44:32.594792 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:32.594747    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-registry-certificates\") pod \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\" (UID: \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\") "
Jul 06 02:44:32.595049 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:32.594809    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-bound-sa-token\") pod \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\" (UID: \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\") "
Jul 06 02:44:32.595049 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:32.594844    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-ca-trust-extracted\") pod \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\" (UID: \"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e\") "
Jul 06 02:44:32.595644 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:32.595584    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "aa4ac53c-39b9-4b21-a3d1-e3c16418c50e" (UID: "aa4ac53c-39b9-4b21-a3d1-e3c16418c50e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 02:44:32.597141 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:32.596159    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "aa4ac53c-39b9-4b21-a3d1-e3c16418c50e" (UID: "aa4ac53c-39b9-4b21-a3d1-e3c16418c50e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 02:44:32.598219 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:32.597726    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "aa4ac53c-39b9-4b21-a3d1-e3c16418c50e" (UID: "aa4ac53c-39b9-4b21-a3d1-e3c16418c50e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 02:44:32.599771 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:32.599488    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "aa4ac53c-39b9-4b21-a3d1-e3c16418c50e" (UID: "aa4ac53c-39b9-4b21-a3d1-e3c16418c50e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 02:44:32.599771 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:32.599741    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-kube-api-access-n9522" (OuterVolumeSpecName: "kube-api-access-n9522") pod "aa4ac53c-39b9-4b21-a3d1-e3c16418c50e" (UID: "aa4ac53c-39b9-4b21-a3d1-e3c16418c50e"). InnerVolumeSpecName "kube-api-access-n9522". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 02:44:32.600194 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:32.600166    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "aa4ac53c-39b9-4b21-a3d1-e3c16418c50e" (UID: "aa4ac53c-39b9-4b21-a3d1-e3c16418c50e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 02:44:32.600311 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:32.600213    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "aa4ac53c-39b9-4b21-a3d1-e3c16418c50e" (UID: "aa4ac53c-39b9-4b21-a3d1-e3c16418c50e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 02:44:32.608035 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:32.608009    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "aa4ac53c-39b9-4b21-a3d1-e3c16418c50e" (UID: "aa4ac53c-39b9-4b21-a3d1-e3c16418c50e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 02:44:32.697035 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:32.696999    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-trusted-ca\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:44:32.697035 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:32.697031    2570 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-registry-tls\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:44:32.697035 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:32.697042    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9522\" (UniqueName: \"kubernetes.io/projected/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-kube-api-access-n9522\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:44:32.697275 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:32.697053    2570 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-image-registry-private-configuration\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:44:32.697275 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:32.697063    2570 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-registry-certificates\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:44:32.697275 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:32.697071    2570 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-bound-sa-token\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:44:32.697275 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:32.697079    2570 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-ca-trust-extracted\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:44:32.697275 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:32.697087    2570 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e-installation-pull-secrets\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:44:33.275164 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:33.275125    2570 generic.go:356] "Generic (PLEG): container finished" podID="aa4ac53c-39b9-4b21-a3d1-e3c16418c50e" containerID="a32d523f2e30d976c8d9ded31dfa9e3dc07b172aac41384cd6e04ac3e57ca71e" exitCode=0
Jul 06 02:44:33.275532 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:33.275169    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8578d6475c-nmhmd" event={"ID":"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e","Type":"ContainerDied","Data":"a32d523f2e30d976c8d9ded31dfa9e3dc07b172aac41384cd6e04ac3e57ca71e"}
Jul 06 02:44:33.275532 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:33.275189    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8578d6475c-nmhmd"
Jul 06 02:44:33.275532 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:33.275221    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8578d6475c-nmhmd" event={"ID":"aa4ac53c-39b9-4b21-a3d1-e3c16418c50e","Type":"ContainerDied","Data":"73a564db36553e888e5fec43e5340741e7eaffba9103db6129d007822e31d88b"}
Jul 06 02:44:33.275532 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:33.275240    2570 scope.go:117] "RemoveContainer" containerID="a32d523f2e30d976c8d9ded31dfa9e3dc07b172aac41384cd6e04ac3e57ca71e"
Jul 06 02:44:33.283613 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:33.283586    2570 scope.go:117] "RemoveContainer" containerID="a32d523f2e30d976c8d9ded31dfa9e3dc07b172aac41384cd6e04ac3e57ca71e"
Jul 06 02:44:33.283877 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:44:33.283858    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a32d523f2e30d976c8d9ded31dfa9e3dc07b172aac41384cd6e04ac3e57ca71e\": container with ID starting with a32d523f2e30d976c8d9ded31dfa9e3dc07b172aac41384cd6e04ac3e57ca71e not found: ID does not exist" containerID="a32d523f2e30d976c8d9ded31dfa9e3dc07b172aac41384cd6e04ac3e57ca71e"
Jul 06 02:44:33.283944 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:33.283888    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a32d523f2e30d976c8d9ded31dfa9e3dc07b172aac41384cd6e04ac3e57ca71e"} err="failed to get container status \"a32d523f2e30d976c8d9ded31dfa9e3dc07b172aac41384cd6e04ac3e57ca71e\": rpc error: code = NotFound desc = could not find container \"a32d523f2e30d976c8d9ded31dfa9e3dc07b172aac41384cd6e04ac3e57ca71e\": container with ID starting with a32d523f2e30d976c8d9ded31dfa9e3dc07b172aac41384cd6e04ac3e57ca71e not found: ID does not exist"
Jul 06 02:44:33.291008 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:33.290974    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8578d6475c-nmhmd"]
Jul 06 02:44:33.294786 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:33.294768    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8578d6475c-nmhmd"]
Jul 06 02:44:34.338137 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:34.338097    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-65d74fbc8c-tw8rz" podUID="7928095d-e025-43fa-bd34-1a87375adae6" containerName="console" containerID="cri-o://c09127959c9b76eee3557a2efdd57d481480169be8e2363dcfc765929667bc91" gracePeriod=15
Jul 06 02:44:34.423739 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:34.423707    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:34.473800 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:34.473760    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:34.568266 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:34.568244    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65d74fbc8c-tw8rz"
Jul 06 02:44:34.612534 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:34.612471    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7928095d-e025-43fa-bd34-1a87375adae6-console-oauth-config\") pod \"7928095d-e025-43fa-bd34-1a87375adae6\" (UID: \"7928095d-e025-43fa-bd34-1a87375adae6\") "
Jul 06 02:44:34.612534 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:34.612519    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7928095d-e025-43fa-bd34-1a87375adae6-oauth-serving-cert\") pod \"7928095d-e025-43fa-bd34-1a87375adae6\" (UID: \"7928095d-e025-43fa-bd34-1a87375adae6\") "
Jul 06 02:44:34.612682 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:34.612547    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7928095d-e025-43fa-bd34-1a87375adae6-console-serving-cert\") pod \"7928095d-e025-43fa-bd34-1a87375adae6\" (UID: \"7928095d-e025-43fa-bd34-1a87375adae6\") "
Jul 06 02:44:34.612682 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:34.612570    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7928095d-e025-43fa-bd34-1a87375adae6-console-config\") pod \"7928095d-e025-43fa-bd34-1a87375adae6\" (UID: \"7928095d-e025-43fa-bd34-1a87375adae6\") "
Jul 06 02:44:34.612682 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:34.612600    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lr86j\" (UniqueName: \"kubernetes.io/projected/7928095d-e025-43fa-bd34-1a87375adae6-kube-api-access-lr86j\") pod \"7928095d-e025-43fa-bd34-1a87375adae6\" (UID: \"7928095d-e025-43fa-bd34-1a87375adae6\") "
Jul 06 02:44:34.612682 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:34.612619    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7928095d-e025-43fa-bd34-1a87375adae6-service-ca\") pod \"7928095d-e025-43fa-bd34-1a87375adae6\" (UID: \"7928095d-e025-43fa-bd34-1a87375adae6\") "
Jul 06 02:44:34.613096 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:34.613059    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7928095d-e025-43fa-bd34-1a87375adae6-console-config" (OuterVolumeSpecName: "console-config") pod "7928095d-e025-43fa-bd34-1a87375adae6" (UID: "7928095d-e025-43fa-bd34-1a87375adae6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 02:44:34.613096 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:34.613064    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7928095d-e025-43fa-bd34-1a87375adae6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7928095d-e025-43fa-bd34-1a87375adae6" (UID: "7928095d-e025-43fa-bd34-1a87375adae6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 02:44:34.613296 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:34.613101    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7928095d-e025-43fa-bd34-1a87375adae6-service-ca" (OuterVolumeSpecName: "service-ca") pod "7928095d-e025-43fa-bd34-1a87375adae6" (UID: "7928095d-e025-43fa-bd34-1a87375adae6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 02:44:34.614811 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:34.614786    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7928095d-e025-43fa-bd34-1a87375adae6-kube-api-access-lr86j" (OuterVolumeSpecName: "kube-api-access-lr86j") pod "7928095d-e025-43fa-bd34-1a87375adae6" (UID: "7928095d-e025-43fa-bd34-1a87375adae6"). InnerVolumeSpecName "kube-api-access-lr86j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 02:44:34.614908 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:34.614816    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7928095d-e025-43fa-bd34-1a87375adae6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7928095d-e025-43fa-bd34-1a87375adae6" (UID: "7928095d-e025-43fa-bd34-1a87375adae6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 02:44:34.614908 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:34.614837    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7928095d-e025-43fa-bd34-1a87375adae6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7928095d-e025-43fa-bd34-1a87375adae6" (UID: "7928095d-e025-43fa-bd34-1a87375adae6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 02:44:34.713757 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:34.713734    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7928095d-e025-43fa-bd34-1a87375adae6-oauth-serving-cert\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:44:34.713757 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:34.713755    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7928095d-e025-43fa-bd34-1a87375adae6-console-serving-cert\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:44:34.713903 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:34.713764    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7928095d-e025-43fa-bd34-1a87375adae6-console-config\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:44:34.713903 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:34.713773    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lr86j\" (UniqueName: \"kubernetes.io/projected/7928095d-e025-43fa-bd34-1a87375adae6-kube-api-access-lr86j\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:44:34.713903 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:34.713782    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7928095d-e025-43fa-bd34-1a87375adae6-service-ca\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:44:34.713903 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:34.713790    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7928095d-e025-43fa-bd34-1a87375adae6-console-oauth-config\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:44:35.231746 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:35.231712    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa4ac53c-39b9-4b21-a3d1-e3c16418c50e" path="/var/lib/kubelet/pods/aa4ac53c-39b9-4b21-a3d1-e3c16418c50e/volumes"
Jul 06 02:44:35.284231 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:35.284202    2570 generic.go:356] "Generic (PLEG): container finished" podID="7928095d-e025-43fa-bd34-1a87375adae6" containerID="c09127959c9b76eee3557a2efdd57d481480169be8e2363dcfc765929667bc91" exitCode=0
Jul 06 02:44:35.284325 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:35.284242    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65d74fbc8c-tw8rz"
Jul 06 02:44:35.284325 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:35.284287    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65d74fbc8c-tw8rz" event={"ID":"7928095d-e025-43fa-bd34-1a87375adae6","Type":"ContainerDied","Data":"c09127959c9b76eee3557a2efdd57d481480169be8e2363dcfc765929667bc91"}
Jul 06 02:44:35.284412 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:35.284328    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65d74fbc8c-tw8rz" event={"ID":"7928095d-e025-43fa-bd34-1a87375adae6","Type":"ContainerDied","Data":"d541beb1852e3239b7e617e0c052bc04e24d5eafb156264470dd6ebafe1342d0"}
Jul 06 02:44:35.284412 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:35.284346    2570 scope.go:117] "RemoveContainer" containerID="c09127959c9b76eee3557a2efdd57d481480169be8e2363dcfc765929667bc91"
Jul 06 02:44:35.292035 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:35.292019    2570 scope.go:117] "RemoveContainer" containerID="c09127959c9b76eee3557a2efdd57d481480169be8e2363dcfc765929667bc91"
Jul 06 02:44:35.292279 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:44:35.292262    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c09127959c9b76eee3557a2efdd57d481480169be8e2363dcfc765929667bc91\": container with ID starting with c09127959c9b76eee3557a2efdd57d481480169be8e2363dcfc765929667bc91 not found: ID does not exist" containerID="c09127959c9b76eee3557a2efdd57d481480169be8e2363dcfc765929667bc91"
Jul 06 02:44:35.292337 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:35.292287    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c09127959c9b76eee3557a2efdd57d481480169be8e2363dcfc765929667bc91"} err="failed to get container status \"c09127959c9b76eee3557a2efdd57d481480169be8e2363dcfc765929667bc91\": rpc error: code = NotFound desc = could not find container \"c09127959c9b76eee3557a2efdd57d481480169be8e2363dcfc765929667bc91\": container with ID starting with c09127959c9b76eee3557a2efdd57d481480169be8e2363dcfc765929667bc91 not found: ID does not exist"
Jul 06 02:44:35.297869 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:35.297852    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65d74fbc8c-tw8rz"]
Jul 06 02:44:35.299925 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:35.299907    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65d74fbc8c-tw8rz"]
Jul 06 02:44:37.236305 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:37.233452    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7928095d-e025-43fa-bd34-1a87375adae6" path="/var/lib/kubelet/pods/7928095d-e025-43fa-bd34-1a87375adae6/volumes"
Jul 06 02:44:44.271928 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:44.271896    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:44.318312 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:44.318282    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:44:45.241084 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:45.241052    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-c656f4fd9-ffsh2" podUID="f82a7536-b357-4e37-b35f-49b0587a07f3" containerName="console" containerID="cri-o://0d071acba571840c131c446a53e09794f9d2bca158763a943c908c41e13727b4" gracePeriod=15
Jul 06 02:44:45.478695 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:45.478666    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c656f4fd9-ffsh2"
Jul 06 02:44:45.612408 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:45.612365    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f82a7536-b357-4e37-b35f-49b0587a07f3-console-config\") pod \"f82a7536-b357-4e37-b35f-49b0587a07f3\" (UID: \"f82a7536-b357-4e37-b35f-49b0587a07f3\") "
Jul 06 02:44:45.612593 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:45.612458    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f82a7536-b357-4e37-b35f-49b0587a07f3-trusted-ca-bundle\") pod \"f82a7536-b357-4e37-b35f-49b0587a07f3\" (UID: \"f82a7536-b357-4e37-b35f-49b0587a07f3\") "
Jul 06 02:44:45.612593 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:45.612492    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f82a7536-b357-4e37-b35f-49b0587a07f3-console-serving-cert\") pod \"f82a7536-b357-4e37-b35f-49b0587a07f3\" (UID: \"f82a7536-b357-4e37-b35f-49b0587a07f3\") "
Jul 06 02:44:45.612593 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:45.612520    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rbdp4\" (UniqueName: \"kubernetes.io/projected/f82a7536-b357-4e37-b35f-49b0587a07f3-kube-api-access-rbdp4\") pod \"f82a7536-b357-4e37-b35f-49b0587a07f3\" (UID: \"f82a7536-b357-4e37-b35f-49b0587a07f3\") "
Jul 06 02:44:45.612593 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:45.612568    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f82a7536-b357-4e37-b35f-49b0587a07f3-oauth-serving-cert\") pod \"f82a7536-b357-4e37-b35f-49b0587a07f3\" (UID: \"f82a7536-b357-4e37-b35f-49b0587a07f3\") "
Jul 06 02:44:45.612787 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:45.612602    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f82a7536-b357-4e37-b35f-49b0587a07f3-console-oauth-config\") pod \"f82a7536-b357-4e37-b35f-49b0587a07f3\" (UID: \"f82a7536-b357-4e37-b35f-49b0587a07f3\") "
Jul 06 02:44:45.612787 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:45.612636    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f82a7536-b357-4e37-b35f-49b0587a07f3-service-ca\") pod \"f82a7536-b357-4e37-b35f-49b0587a07f3\" (UID: \"f82a7536-b357-4e37-b35f-49b0587a07f3\") "
Jul 06 02:44:45.612894 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:45.612834    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f82a7536-b357-4e37-b35f-49b0587a07f3-console-config" (OuterVolumeSpecName: "console-config") pod "f82a7536-b357-4e37-b35f-49b0587a07f3" (UID: "f82a7536-b357-4e37-b35f-49b0587a07f3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 02:44:45.613028 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:45.613002    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f82a7536-b357-4e37-b35f-49b0587a07f3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f82a7536-b357-4e37-b35f-49b0587a07f3" (UID: "f82a7536-b357-4e37-b35f-49b0587a07f3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 02:44:45.613105 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:45.613053    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f82a7536-b357-4e37-b35f-49b0587a07f3-service-ca" (OuterVolumeSpecName: "service-ca") pod "f82a7536-b357-4e37-b35f-49b0587a07f3" (UID: "f82a7536-b357-4e37-b35f-49b0587a07f3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 02:44:45.613217 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:45.613189    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f82a7536-b357-4e37-b35f-49b0587a07f3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f82a7536-b357-4e37-b35f-49b0587a07f3" (UID: "f82a7536-b357-4e37-b35f-49b0587a07f3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 02:44:45.614605 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:45.614580    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f82a7536-b357-4e37-b35f-49b0587a07f3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f82a7536-b357-4e37-b35f-49b0587a07f3" (UID: "f82a7536-b357-4e37-b35f-49b0587a07f3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 02:44:45.614707 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:45.614656    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f82a7536-b357-4e37-b35f-49b0587a07f3-kube-api-access-rbdp4" (OuterVolumeSpecName: "kube-api-access-rbdp4") pod "f82a7536-b357-4e37-b35f-49b0587a07f3" (UID: "f82a7536-b357-4e37-b35f-49b0587a07f3"). InnerVolumeSpecName "kube-api-access-rbdp4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 02:44:45.614754 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:45.614738    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f82a7536-b357-4e37-b35f-49b0587a07f3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f82a7536-b357-4e37-b35f-49b0587a07f3" (UID: "f82a7536-b357-4e37-b35f-49b0587a07f3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 02:44:45.713227 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:45.713194    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f82a7536-b357-4e37-b35f-49b0587a07f3-trusted-ca-bundle\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:44:45.713227 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:45.713221    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f82a7536-b357-4e37-b35f-49b0587a07f3-console-serving-cert\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:44:45.713227 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:45.713233    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbdp4\" (UniqueName: \"kubernetes.io/projected/f82a7536-b357-4e37-b35f-49b0587a07f3-kube-api-access-rbdp4\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:44:45.713451 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:45.713242    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f82a7536-b357-4e37-b35f-49b0587a07f3-oauth-serving-cert\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:44:45.713451 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:45.713251    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f82a7536-b357-4e37-b35f-49b0587a07f3-console-oauth-config\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:44:45.713451 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:45.713259    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f82a7536-b357-4e37-b35f-49b0587a07f3-service-ca\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:44:45.713451 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:45.713269    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f82a7536-b357-4e37-b35f-49b0587a07f3-console-config\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:44:46.326584 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:46.326552    2570 generic.go:356] "Generic (PLEG): container finished" podID="f82a7536-b357-4e37-b35f-49b0587a07f3" containerID="0d071acba571840c131c446a53e09794f9d2bca158763a943c908c41e13727b4" exitCode=0
Jul 06 02:44:46.326742 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:46.326601    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c656f4fd9-ffsh2"
Jul 06 02:44:46.326742 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:46.326622    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c656f4fd9-ffsh2" event={"ID":"f82a7536-b357-4e37-b35f-49b0587a07f3","Type":"ContainerDied","Data":"0d071acba571840c131c446a53e09794f9d2bca158763a943c908c41e13727b4"}
Jul 06 02:44:46.326742 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:46.326661    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c656f4fd9-ffsh2" event={"ID":"f82a7536-b357-4e37-b35f-49b0587a07f3","Type":"ContainerDied","Data":"e0120b1188d308a7f3ff2eb74c629cc3948e35143a8319470025c4df13a6ea71"}
Jul 06 02:44:46.326742 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:46.326680    2570 scope.go:117] "RemoveContainer" containerID="0d071acba571840c131c446a53e09794f9d2bca158763a943c908c41e13727b4"
Jul 06 02:44:46.335599 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:46.335583    2570 scope.go:117] "RemoveContainer" containerID="0d071acba571840c131c446a53e09794f9d2bca158763a943c908c41e13727b4"
Jul 06 02:44:46.335856 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:44:46.335837    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d071acba571840c131c446a53e09794f9d2bca158763a943c908c41e13727b4\": container with ID starting with 0d071acba571840c131c446a53e09794f9d2bca158763a943c908c41e13727b4 not found: ID does not exist" containerID="0d071acba571840c131c446a53e09794f9d2bca158763a943c908c41e13727b4"
Jul 06 02:44:46.335903 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:46.335865    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d071acba571840c131c446a53e09794f9d2bca158763a943c908c41e13727b4"} err="failed to get container status \"0d071acba571840c131c446a53e09794f9d2bca158763a943c908c41e13727b4\": rpc error: code = NotFound desc = could not find container \"0d071acba571840c131c446a53e09794f9d2bca158763a943c908c41e13727b4\": container with ID starting with 0d071acba571840c131c446a53e09794f9d2bca158763a943c908c41e13727b4 not found: ID does not exist"
Jul 06 02:44:46.346874 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:46.346854    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c656f4fd9-ffsh2"]
Jul 06 02:44:46.350650 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:46.350630    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c656f4fd9-ffsh2"]
Jul 06 02:44:47.231555 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:47.231526    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f82a7536-b357-4e37-b35f-49b0587a07f3" path="/var/lib/kubelet/pods/f82a7536-b357-4e37-b35f-49b0587a07f3/volumes"
Jul 06 02:44:47.330775 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:47.330742    2570 generic.go:356] "Generic (PLEG): container finished" podID="1c8a4c86-30a0-400f-866b-4606d5284ddf" containerID="be2ba2738c3d5b732df900f372b16975a0e66af4d9b36e7b2ce9b27c42c1d636" exitCode=0
Jul 06 02:44:47.330915 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:47.330811    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-znzln" event={"ID":"1c8a4c86-30a0-400f-866b-4606d5284ddf","Type":"ContainerDied","Data":"be2ba2738c3d5b732df900f372b16975a0e66af4d9b36e7b2ce9b27c42c1d636"}
Jul 06 02:44:47.331156 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:47.331140    2570 scope.go:117] "RemoveContainer" containerID="be2ba2738c3d5b732df900f372b16975a0e66af4d9b36e7b2ce9b27c42c1d636"
Jul 06 02:44:48.337306 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:44:48.337272    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-znzln" event={"ID":"1c8a4c86-30a0-400f-866b-4606d5284ddf","Type":"ContainerStarted","Data":"4c90c5bbe7f2b1e9f0e0c4412c40ee64ddd53c8478147c019cc24c5ed84015c1"}
Jul 06 02:45:21.088285 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:45:21.088253    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35f61f76-1038-43ca-a749-71412ea26859-metrics-certs\") pod \"network-metrics-daemon-j4xxx\" (UID: \"35f61f76-1038-43ca-a749-71412ea26859\") " pod="openshift-multus/network-metrics-daemon-j4xxx"
Jul 06 02:45:21.090456 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:45:21.090437    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35f61f76-1038-43ca-a749-71412ea26859-metrics-certs\") pod \"network-metrics-daemon-j4xxx\" (UID: \"35f61f76-1038-43ca-a749-71412ea26859\") " pod="openshift-multus/network-metrics-daemon-j4xxx"
Jul 06 02:45:21.330416 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:45:21.330382    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-n2bvg\""
Jul 06 02:45:21.338125 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:45:21.338102    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j4xxx"
Jul 06 02:45:21.467774 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:45:21.467741    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-j4xxx"]
Jul 06 02:45:21.470693 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:45:21.470664    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35f61f76_1038_43ca_a749_71412ea26859.slice/crio-5a7a78d072b115880a58eb84b01dc21a3fa94908db3e3367cbeb9295359e755f WatchSource:0}: Error finding container 5a7a78d072b115880a58eb84b01dc21a3fa94908db3e3367cbeb9295359e755f: Status 404 returned error can't find the container with id 5a7a78d072b115880a58eb84b01dc21a3fa94908db3e3367cbeb9295359e755f
Jul 06 02:45:22.465127 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:45:22.465094    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j4xxx" event={"ID":"35f61f76-1038-43ca-a749-71412ea26859","Type":"ContainerStarted","Data":"5a7a78d072b115880a58eb84b01dc21a3fa94908db3e3367cbeb9295359e755f"}
Jul 06 02:45:23.469719 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:45:23.469684    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j4xxx" event={"ID":"35f61f76-1038-43ca-a749-71412ea26859","Type":"ContainerStarted","Data":"6d1feb0a0cd9d45d85cbd0042b03e14b3bb552313aa77e410a37d472c78f5056"}
Jul 06 02:45:23.470124 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:45:23.469730    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j4xxx" event={"ID":"35f61f76-1038-43ca-a749-71412ea26859","Type":"ContainerStarted","Data":"66cf7e6b5de5ad5db13fba9e63133404c6c657f8a14ca3640c38cf4dcf052d94"}
Jul 06 02:45:23.485450 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:45:23.485406    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-j4xxx" podStartSLOduration=374.450373837 podStartE2EDuration="6m15.485391434s" totalImagesPullingTime="1.035017597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:39:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:45:23.484612703 +0000 UTC m=+377.141622367" watchObservedRunningTime="2026-07-06 02:45:23.485391434 +0000 UTC m=+377.142401098"
Jul 06 02:45:23.571316 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:45:23.571284    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:45:23.631829 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:45:23.631796    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:45:26.597667 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:45:26.597618    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:45:26.651849 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:45:26.651810    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:45:29.197801 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:45:29.197753    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:45:32.674104 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:45:32.674062    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:45:32.736627 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:45:32.736589    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:45:38.550721 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:45:38.550680    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:45:38.603837 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:45:38.603790    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:45:42.072321 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:45:42.072284    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:45:42.123386 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:45:42.123358    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:45:42.183737 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:45:42.183707    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:45:42.236275 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:45:42.236242    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:45:42.995142 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:45:42.995107    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:45:43.043600 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:45:43.043571    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:45:44.327925 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:45:44.327887    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:45:44.428859 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:45:44.428829    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:45:52.695713 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:45:52.695677    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8576d5dbb4-jh96z"]
Jul 06 02:45:52.796952 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:45:52.796923    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:45:52.845604 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:45:52.845574    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:45:52.900059 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:45:52.900031    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:46:00.051933 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:00.051864    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:46:00.141538 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:00.141506    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:46:00.594149 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:00.594119    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408v86v"]
Jul 06 02:46:00.594397 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:00.594386    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7928095d-e025-43fa-bd34-1a87375adae6" containerName="console"
Jul 06 02:46:00.594481 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:00.594399    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="7928095d-e025-43fa-bd34-1a87375adae6" containerName="console"
Jul 06 02:46:00.594481 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:00.594413    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa4ac53c-39b9-4b21-a3d1-e3c16418c50e" containerName="registry"
Jul 06 02:46:00.594481 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:00.594418    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa4ac53c-39b9-4b21-a3d1-e3c16418c50e" containerName="registry"
Jul 06 02:46:00.594481 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:00.594425    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f82a7536-b357-4e37-b35f-49b0587a07f3" containerName="console"
Jul 06 02:46:00.594481 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:00.594430    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f82a7536-b357-4e37-b35f-49b0587a07f3" containerName="console"
Jul 06 02:46:00.594481 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:00.594481    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="7928095d-e025-43fa-bd34-1a87375adae6" containerName="console"
Jul 06 02:46:00.594652 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:00.594488    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa4ac53c-39b9-4b21-a3d1-e3c16418c50e" containerName="registry"
Jul 06 02:46:00.594652 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:00.594493    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="f82a7536-b357-4e37-b35f-49b0587a07f3" containerName="console"
Jul 06 02:46:00.597336 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:00.597318    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408v86v"
Jul 06 02:46:00.599863 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:00.599838    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zphg2\""
Jul 06 02:46:00.599863 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:00.599852    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 06 02:46:00.600642 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:00.600625    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 06 02:46:00.607579 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:00.607552    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408v86v"]
Jul 06 02:46:00.680800 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:00.680775    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/530c2b5a-414b-48f6-bb6b-4d187e4d1947-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408v86v\" (UID: \"530c2b5a-414b-48f6-bb6b-4d187e4d1947\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408v86v"
Jul 06 02:46:00.680899 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:00.680821    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9mzs\" (UniqueName: \"kubernetes.io/projected/530c2b5a-414b-48f6-bb6b-4d187e4d1947-kube-api-access-d9mzs\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408v86v\" (UID: \"530c2b5a-414b-48f6-bb6b-4d187e4d1947\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408v86v"
Jul 06 02:46:00.680899 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:00.680851    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/530c2b5a-414b-48f6-bb6b-4d187e4d1947-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408v86v\" (UID: \"530c2b5a-414b-48f6-bb6b-4d187e4d1947\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408v86v"
Jul 06 02:46:00.782200 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:00.782172    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9mzs\" (UniqueName: \"kubernetes.io/projected/530c2b5a-414b-48f6-bb6b-4d187e4d1947-kube-api-access-d9mzs\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408v86v\" (UID: \"530c2b5a-414b-48f6-bb6b-4d187e4d1947\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408v86v"
Jul 06 02:46:00.782292 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:00.782209    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/530c2b5a-414b-48f6-bb6b-4d187e4d1947-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408v86v\" (UID: \"530c2b5a-414b-48f6-bb6b-4d187e4d1947\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408v86v"
Jul 06 02:46:00.782292 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:00.782252    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/530c2b5a-414b-48f6-bb6b-4d187e4d1947-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408v86v\" (UID: \"530c2b5a-414b-48f6-bb6b-4d187e4d1947\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408v86v"
Jul 06 02:46:00.782589 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:00.782571    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/530c2b5a-414b-48f6-bb6b-4d187e4d1947-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408v86v\" (UID: \"530c2b5a-414b-48f6-bb6b-4d187e4d1947\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408v86v"
Jul 06 02:46:00.782656 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:00.782606    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/530c2b5a-414b-48f6-bb6b-4d187e4d1947-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408v86v\" (UID: \"530c2b5a-414b-48f6-bb6b-4d187e4d1947\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408v86v"
Jul 06 02:46:00.790316 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:00.790297    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9mzs\" (UniqueName: \"kubernetes.io/projected/530c2b5a-414b-48f6-bb6b-4d187e4d1947-kube-api-access-d9mzs\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408v86v\" (UID: \"530c2b5a-414b-48f6-bb6b-4d187e4d1947\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408v86v"
Jul 06 02:46:00.907456 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:00.907388    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408v86v"
Jul 06 02:46:01.034595 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:01.034562    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408v86v"]
Jul 06 02:46:01.037469 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:46:01.037443    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod530c2b5a_414b_48f6_bb6b_4d187e4d1947.slice/crio-4f83dea59b7321e59494af1b4513f8cfb774ffe8ade7a3c1e7727b4108a7ab29 WatchSource:0}: Error finding container 4f83dea59b7321e59494af1b4513f8cfb774ffe8ade7a3c1e7727b4108a7ab29: Status 404 returned error can't find the container with id 4f83dea59b7321e59494af1b4513f8cfb774ffe8ade7a3c1e7727b4108a7ab29
Jul 06 02:46:01.604721 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:01.604690    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408v86v" event={"ID":"530c2b5a-414b-48f6-bb6b-4d187e4d1947","Type":"ContainerStarted","Data":"4f83dea59b7321e59494af1b4513f8cfb774ffe8ade7a3c1e7727b4108a7ab29"}
Jul 06 02:46:03.208343 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:03.208303    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:46:03.261319 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:03.261286    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:46:08.255440 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:08.255397    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:46:08.632411 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:08.632378    2570 generic.go:356] "Generic (PLEG): container finished" podID="530c2b5a-414b-48f6-bb6b-4d187e4d1947" containerID="d2167c04a74277418e0df3a6b76b87505cd88834f9ed1479f32ea16b05ac6c4d" exitCode=0
Jul 06 02:46:08.632575 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:08.632458    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408v86v" event={"ID":"530c2b5a-414b-48f6-bb6b-4d187e4d1947","Type":"ContainerDied","Data":"d2167c04a74277418e0df3a6b76b87505cd88834f9ed1479f32ea16b05ac6c4d"}
Jul 06 02:46:11.645804 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:11.645765    2570 generic.go:356] "Generic (PLEG): container finished" podID="530c2b5a-414b-48f6-bb6b-4d187e4d1947" containerID="1e4d069888e3f7dcd3972b40eceb6c277dbda2665a81236d7d9c83aa2b247a2b" exitCode=0
Jul 06 02:46:11.646200 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:11.645856    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408v86v" event={"ID":"530c2b5a-414b-48f6-bb6b-4d187e4d1947","Type":"ContainerDied","Data":"1e4d069888e3f7dcd3972b40eceb6c277dbda2665a81236d7d9c83aa2b247a2b"}
Jul 06 02:46:17.715682 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:17.715641    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-8576d5dbb4-jh96z" podUID="32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff" containerName="console" containerID="cri-o://82d699bda6870fff24213a7e266282efe244d8fcc0bead675817366888f47649" gracePeriod=15
Jul 06 02:46:18.683704 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:18.683671    2570 generic.go:356] "Generic (PLEG): container finished" podID="32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff" containerID="82d699bda6870fff24213a7e266282efe244d8fcc0bead675817366888f47649" exitCode=0
Jul 06 02:46:18.683828 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:18.683721    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8576d5dbb4-jh96z" event={"ID":"32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff","Type":"ContainerDied","Data":"82d699bda6870fff24213a7e266282efe244d8fcc0bead675817366888f47649"}
Jul 06 02:46:18.758567 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:18.758541    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8576d5dbb4-jh96z"
Jul 06 02:46:18.926800 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:18.926735    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7clr\" (UniqueName: \"kubernetes.io/projected/32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff-kube-api-access-v7clr\") pod \"32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff\" (UID: \"32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff\") "
Jul 06 02:46:18.926800 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:18.926770    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff-oauth-serving-cert\") pod \"32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff\" (UID: \"32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff\") "
Jul 06 02:46:18.926969 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:18.926822    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff-console-config\") pod \"32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff\" (UID: \"32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff\") "
Jul 06 02:46:18.926969 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:18.926853    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff-console-oauth-config\") pod \"32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff\" (UID: \"32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff\") "
Jul 06 02:46:18.926969 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:18.926876    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff-service-ca\") pod \"32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff\" (UID: \"32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff\") "
Jul 06 02:46:18.926969 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:18.926907    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff-trusted-ca-bundle\") pod \"32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff\" (UID: \"32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff\") "
Jul 06 02:46:18.926969 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:18.926934    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff-console-serving-cert\") pod \"32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff\" (UID: \"32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff\") "
Jul 06 02:46:18.927311 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:18.927278    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff-console-config" (OuterVolumeSpecName: "console-config") pod "32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff" (UID: "32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 02:46:18.927384 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:18.927305    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff-service-ca" (OuterVolumeSpecName: "service-ca") pod "32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff" (UID: "32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 02:46:18.927384 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:18.927286    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff" (UID: "32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 02:46:18.927384 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:18.927326    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff" (UID: "32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 02:46:18.928787 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:18.928766    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff-kube-api-access-v7clr" (OuterVolumeSpecName: "kube-api-access-v7clr") pod "32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff" (UID: "32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff"). InnerVolumeSpecName "kube-api-access-v7clr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 02:46:18.928863 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:18.928841    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff" (UID: "32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 02:46:18.928954 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:18.928938    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff" (UID: "32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 02:46:19.027664 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:19.027637    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7clr\" (UniqueName: \"kubernetes.io/projected/32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff-kube-api-access-v7clr\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:46:19.027664 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:19.027660    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff-oauth-serving-cert\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:46:19.027822 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:19.027672    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff-console-config\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:46:19.027822 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:19.027688    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff-console-oauth-config\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:46:19.027822 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:19.027700    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff-service-ca\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:46:19.027822 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:19.027738    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff-trusted-ca-bundle\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:46:19.027822 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:19.027751    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff-console-serving-cert\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:46:19.688753 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:19.688723    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8576d5dbb4-jh96z"
Jul 06 02:46:19.688904 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:19.688762    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8576d5dbb4-jh96z" event={"ID":"32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff","Type":"ContainerDied","Data":"5390e11f36df2c445a89efd585af31e66ac7058d714c8f2a22e4212bce234229"}
Jul 06 02:46:19.688904 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:19.688834    2570 scope.go:117] "RemoveContainer" containerID="82d699bda6870fff24213a7e266282efe244d8fcc0bead675817366888f47649"
Jul 06 02:46:19.691190 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:19.691163    2570 generic.go:356] "Generic (PLEG): container finished" podID="530c2b5a-414b-48f6-bb6b-4d187e4d1947" containerID="00f1347cf705d43666417339bc93b979faa87b03247cab33ce87a99595ba07d2" exitCode=0
Jul 06 02:46:19.691298 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:19.691196    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408v86v" event={"ID":"530c2b5a-414b-48f6-bb6b-4d187e4d1947","Type":"ContainerDied","Data":"00f1347cf705d43666417339bc93b979faa87b03247cab33ce87a99595ba07d2"}
Jul 06 02:46:19.705318 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:19.705290    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8576d5dbb4-jh96z"]
Jul 06 02:46:19.709351 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:19.709331    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8576d5dbb4-jh96z"]
Jul 06 02:46:20.817858 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:20.817833    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408v86v"
Jul 06 02:46:20.841919 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:20.841894    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9mzs\" (UniqueName: \"kubernetes.io/projected/530c2b5a-414b-48f6-bb6b-4d187e4d1947-kube-api-access-d9mzs\") pod \"530c2b5a-414b-48f6-bb6b-4d187e4d1947\" (UID: \"530c2b5a-414b-48f6-bb6b-4d187e4d1947\") "
Jul 06 02:46:20.842050 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:20.841935    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/530c2b5a-414b-48f6-bb6b-4d187e4d1947-util\") pod \"530c2b5a-414b-48f6-bb6b-4d187e4d1947\" (UID: \"530c2b5a-414b-48f6-bb6b-4d187e4d1947\") "
Jul 06 02:46:20.842050 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:20.841965    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/530c2b5a-414b-48f6-bb6b-4d187e4d1947-bundle\") pod \"530c2b5a-414b-48f6-bb6b-4d187e4d1947\" (UID: \"530c2b5a-414b-48f6-bb6b-4d187e4d1947\") "
Jul 06 02:46:20.842632 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:20.842607    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/530c2b5a-414b-48f6-bb6b-4d187e4d1947-bundle" (OuterVolumeSpecName: "bundle") pod "530c2b5a-414b-48f6-bb6b-4d187e4d1947" (UID: "530c2b5a-414b-48f6-bb6b-4d187e4d1947"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 02:46:20.844051 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:20.844034    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/530c2b5a-414b-48f6-bb6b-4d187e4d1947-kube-api-access-d9mzs" (OuterVolumeSpecName: "kube-api-access-d9mzs") pod "530c2b5a-414b-48f6-bb6b-4d187e4d1947" (UID: "530c2b5a-414b-48f6-bb6b-4d187e4d1947"). InnerVolumeSpecName "kube-api-access-d9mzs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 02:46:20.849325 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:20.849293    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/530c2b5a-414b-48f6-bb6b-4d187e4d1947-util" (OuterVolumeSpecName: "util") pod "530c2b5a-414b-48f6-bb6b-4d187e4d1947" (UID: "530c2b5a-414b-48f6-bb6b-4d187e4d1947"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 02:46:20.943152 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:20.943124    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9mzs\" (UniqueName: \"kubernetes.io/projected/530c2b5a-414b-48f6-bb6b-4d187e4d1947-kube-api-access-d9mzs\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:46:20.943152 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:20.943149    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/530c2b5a-414b-48f6-bb6b-4d187e4d1947-util\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:46:20.943303 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:20.943160    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/530c2b5a-414b-48f6-bb6b-4d187e4d1947-bundle\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:46:21.231081 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:21.231055    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff" path="/var/lib/kubelet/pods/32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff/volumes"
Jul 06 02:46:21.702353 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:21.702316    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408v86v" event={"ID":"530c2b5a-414b-48f6-bb6b-4d187e4d1947","Type":"ContainerDied","Data":"4f83dea59b7321e59494af1b4513f8cfb774ffe8ade7a3c1e7727b4108a7ab29"}
Jul 06 02:46:21.702516 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:21.702367    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4f83dea59b7321e59494af1b4513f8cfb774ffe8ade7a3c1e7727b4108a7ab29"
Jul 06 02:46:21.702516 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:21.702328    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408v86v"
Jul 06 02:46:31.626737 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:31.626667    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:46:34.536544 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:34.536504    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kc6h7"]
Jul 06 02:46:34.536929 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:34.536764    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff" containerName="console"
Jul 06 02:46:34.536929 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:34.536774    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff" containerName="console"
Jul 06 02:46:34.536929 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:34.536782    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="530c2b5a-414b-48f6-bb6b-4d187e4d1947" containerName="pull"
Jul 06 02:46:34.536929 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:34.536789    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="530c2b5a-414b-48f6-bb6b-4d187e4d1947" containerName="pull"
Jul 06 02:46:34.536929 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:34.536796    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="530c2b5a-414b-48f6-bb6b-4d187e4d1947" containerName="extract"
Jul 06 02:46:34.536929 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:34.536802    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="530c2b5a-414b-48f6-bb6b-4d187e4d1947" containerName="extract"
Jul 06 02:46:34.536929 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:34.536808    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="530c2b5a-414b-48f6-bb6b-4d187e4d1947" containerName="util"
Jul 06 02:46:34.536929 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:34.536813    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="530c2b5a-414b-48f6-bb6b-4d187e4d1947" containerName="util"
Jul 06 02:46:34.536929 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:34.536867    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="530c2b5a-414b-48f6-bb6b-4d187e4d1947" containerName="extract"
Jul 06 02:46:34.536929 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:34.536876    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="32dca9a1-71e1-4b1e-aa0d-5f73e609e6ff" containerName="console"
Jul 06 02:46:34.539772 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:34.539755    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kc6h7"
Jul 06 02:46:34.542151 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:34.542126    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 06 02:46:34.542265 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:34.542231    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-fflcv\""
Jul 06 02:46:34.542265 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:34.542233    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 06 02:46:34.553456 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:34.553437    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kc6h7"]
Jul 06 02:46:34.640043 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:34.640010    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjdmm\" (UniqueName: \"kubernetes.io/projected/0fd949f2-6ef9-484f-abd8-5a836c2d4576-kube-api-access-zjdmm\") pod \"cert-manager-operator-controller-manager-55c444bf86-kc6h7\" (UID: \"0fd949f2-6ef9-484f-abd8-5a836c2d4576\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kc6h7"
Jul 06 02:46:34.640173 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:34.640078    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0fd949f2-6ef9-484f-abd8-5a836c2d4576-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-kc6h7\" (UID: \"0fd949f2-6ef9-484f-abd8-5a836c2d4576\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kc6h7"
Jul 06 02:46:34.741048 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:34.741015    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0fd949f2-6ef9-484f-abd8-5a836c2d4576-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-kc6h7\" (UID: \"0fd949f2-6ef9-484f-abd8-5a836c2d4576\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kc6h7"
Jul 06 02:46:34.741182 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:34.741065    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjdmm\" (UniqueName: \"kubernetes.io/projected/0fd949f2-6ef9-484f-abd8-5a836c2d4576-kube-api-access-zjdmm\") pod \"cert-manager-operator-controller-manager-55c444bf86-kc6h7\" (UID: \"0fd949f2-6ef9-484f-abd8-5a836c2d4576\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kc6h7"
Jul 06 02:46:34.741428 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:34.741406    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0fd949f2-6ef9-484f-abd8-5a836c2d4576-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-kc6h7\" (UID: \"0fd949f2-6ef9-484f-abd8-5a836c2d4576\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kc6h7"
Jul 06 02:46:34.750569 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:34.750547    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjdmm\" (UniqueName: \"kubernetes.io/projected/0fd949f2-6ef9-484f-abd8-5a836c2d4576-kube-api-access-zjdmm\") pod \"cert-manager-operator-controller-manager-55c444bf86-kc6h7\" (UID: \"0fd949f2-6ef9-484f-abd8-5a836c2d4576\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kc6h7"
Jul 06 02:46:34.849654 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:34.849601    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kc6h7"
Jul 06 02:46:34.982742 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:34.982704    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kc6h7"]
Jul 06 02:46:34.985531 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:46:34.985502    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fd949f2_6ef9_484f_abd8_5a836c2d4576.slice/crio-958c53046444e3b80d376434b26b33fb8fecc7aff457ca0cbc1e978fa4fbd648 WatchSource:0}: Error finding container 958c53046444e3b80d376434b26b33fb8fecc7aff457ca0cbc1e978fa4fbd648: Status 404 returned error can't find the container with id 958c53046444e3b80d376434b26b33fb8fecc7aff457ca0cbc1e978fa4fbd648
Jul 06 02:46:35.755851 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:35.755817    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kc6h7" event={"ID":"0fd949f2-6ef9-484f-abd8-5a836c2d4576","Type":"ContainerStarted","Data":"958c53046444e3b80d376434b26b33fb8fecc7aff457ca0cbc1e978fa4fbd648"}
Jul 06 02:46:36.229729 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:36.229691    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:46:36.701773 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:36.701735    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:46:36.802455 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:36.802419    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:46:37.766303 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:37.766266    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kc6h7" event={"ID":"0fd949f2-6ef9-484f-abd8-5a836c2d4576","Type":"ContainerStarted","Data":"f01d3fab8129fbdb8a388d7373cbfe1caebea84b51f19b9dec3bf8a53f87d4a4"}
Jul 06 02:46:37.788651 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:37.788597    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kc6h7" podStartSLOduration=1.9485716929999999 podStartE2EDuration="3.788580226s" totalImagesPullingTime="1.840008533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:46:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:46:37.787478448 +0000 UTC m=+451.444488111" watchObservedRunningTime="2026-07-06 02:46:37.788580226 +0000 UTC m=+451.445589890"
Jul 06 02:46:38.238515 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:38.238476    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:46:38.340157 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:38.340120    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:46:38.600058 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:38.600015    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:46:38.707098 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:38.707055    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:46:38.731182 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:38.731151    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-kvvk9"]
Jul 06 02:46:38.734454 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:38.734433    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-kvvk9"
Jul 06 02:46:38.736649 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:38.736625    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 06 02:46:38.737555 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:38.737539    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 06 02:46:38.737630 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:38.737539    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-84hdp\""
Jul 06 02:46:38.749434 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:38.749413    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-kvvk9"]
Jul 06 02:46:38.771587 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:38.771559    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7749f8e8-2d5a-42ad-a138-5bb7bd9b952f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-kvvk9\" (UID: \"7749f8e8-2d5a-42ad-a138-5bb7bd9b952f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kvvk9"
Jul 06 02:46:38.771695 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:38.771595    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49jv8\" (UniqueName: \"kubernetes.io/projected/7749f8e8-2d5a-42ad-a138-5bb7bd9b952f-kube-api-access-49jv8\") pod \"cert-manager-webhook-6486ffd997-kvvk9\" (UID: \"7749f8e8-2d5a-42ad-a138-5bb7bd9b952f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kvvk9"
Jul 06 02:46:38.871953 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:38.871891    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7749f8e8-2d5a-42ad-a138-5bb7bd9b952f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-kvvk9\" (UID: \"7749f8e8-2d5a-42ad-a138-5bb7bd9b952f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kvvk9"
Jul 06 02:46:38.871953 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:38.871920    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49jv8\" (UniqueName: \"kubernetes.io/projected/7749f8e8-2d5a-42ad-a138-5bb7bd9b952f-kube-api-access-49jv8\") pod \"cert-manager-webhook-6486ffd997-kvvk9\" (UID: \"7749f8e8-2d5a-42ad-a138-5bb7bd9b952f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kvvk9"
Jul 06 02:46:38.879770 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:38.879751    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49jv8\" (UniqueName: \"kubernetes.io/projected/7749f8e8-2d5a-42ad-a138-5bb7bd9b952f-kube-api-access-49jv8\") pod \"cert-manager-webhook-6486ffd997-kvvk9\" (UID: \"7749f8e8-2d5a-42ad-a138-5bb7bd9b952f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kvvk9"
Jul 06 02:46:38.879858 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:38.879848    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7749f8e8-2d5a-42ad-a138-5bb7bd9b952f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-kvvk9\" (UID: \"7749f8e8-2d5a-42ad-a138-5bb7bd9b952f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kvvk9"
Jul 06 02:46:39.060927 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:39.060898    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-kvvk9"
Jul 06 02:46:39.069525 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:39.069500    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh6psl"]
Jul 06 02:46:39.072775 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:39.072759    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh6psl"
Jul 06 02:46:39.075072 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:39.075050    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 06 02:46:39.075183 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:39.075145    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 06 02:46:39.075248 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:39.075180    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zphg2\""
Jul 06 02:46:39.081634 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:39.081610    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh6psl"]
Jul 06 02:46:39.175588 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:39.175560    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07089987-6ce2-4fdf-b64e-7e413fad1c88-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh6psl\" (UID: \"07089987-6ce2-4fdf-b64e-7e413fad1c88\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh6psl"
Jul 06 02:46:39.175716 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:39.175594    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07089987-6ce2-4fdf-b64e-7e413fad1c88-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh6psl\" (UID: \"07089987-6ce2-4fdf-b64e-7e413fad1c88\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh6psl"
Jul 06 02:46:39.175716 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:39.175623    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmhj4\" (UniqueName: \"kubernetes.io/projected/07089987-6ce2-4fdf-b64e-7e413fad1c88-kube-api-access-tmhj4\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh6psl\" (UID: \"07089987-6ce2-4fdf-b64e-7e413fad1c88\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh6psl"
Jul 06 02:46:39.188729 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:39.188705    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-kvvk9"]
Jul 06 02:46:39.192537 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:46:39.192512    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7749f8e8_2d5a_42ad_a138_5bb7bd9b952f.slice/crio-612ac2ea8e7f708c65d8a412fc1869d61ba27b49b07c8b4081b26d583b3940ed WatchSource:0}: Error finding container 612ac2ea8e7f708c65d8a412fc1869d61ba27b49b07c8b4081b26d583b3940ed: Status 404 returned error can't find the container with id 612ac2ea8e7f708c65d8a412fc1869d61ba27b49b07c8b4081b26d583b3940ed
Jul 06 02:46:39.276859 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:39.276822    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07089987-6ce2-4fdf-b64e-7e413fad1c88-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh6psl\" (UID: \"07089987-6ce2-4fdf-b64e-7e413fad1c88\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh6psl"
Jul 06 02:46:39.276859 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:39.276861    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07089987-6ce2-4fdf-b64e-7e413fad1c88-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh6psl\" (UID: \"07089987-6ce2-4fdf-b64e-7e413fad1c88\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh6psl"
Jul 06 02:46:39.277316 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:39.276884    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmhj4\" (UniqueName: \"kubernetes.io/projected/07089987-6ce2-4fdf-b64e-7e413fad1c88-kube-api-access-tmhj4\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh6psl\" (UID: \"07089987-6ce2-4fdf-b64e-7e413fad1c88\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh6psl"
Jul 06 02:46:39.277316 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:39.277221    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07089987-6ce2-4fdf-b64e-7e413fad1c88-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh6psl\" (UID: \"07089987-6ce2-4fdf-b64e-7e413fad1c88\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh6psl"
Jul 06 02:46:39.277316 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:39.277261    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07089987-6ce2-4fdf-b64e-7e413fad1c88-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh6psl\" (UID: \"07089987-6ce2-4fdf-b64e-7e413fad1c88\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh6psl"
Jul 06 02:46:39.287624 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:39.287602    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmhj4\" (UniqueName: \"kubernetes.io/projected/07089987-6ce2-4fdf-b64e-7e413fad1c88-kube-api-access-tmhj4\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh6psl\" (UID: \"07089987-6ce2-4fdf-b64e-7e413fad1c88\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh6psl"
Jul 06 02:46:39.389532 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:39.389505    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh6psl"
Jul 06 02:46:39.515392 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:39.515352    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh6psl"]
Jul 06 02:46:39.520049 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:46:39.520015    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07089987_6ce2_4fdf_b64e_7e413fad1c88.slice/crio-9d23990fa62f4ebafa929273e5c99b34c59f7bf8b9765ca5c985e21d27966c0c WatchSource:0}: Error finding container 9d23990fa62f4ebafa929273e5c99b34c59f7bf8b9765ca5c985e21d27966c0c: Status 404 returned error can't find the container with id 9d23990fa62f4ebafa929273e5c99b34c59f7bf8b9765ca5c985e21d27966c0c
Jul 06 02:46:39.775259 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:39.775199    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-kvvk9" event={"ID":"7749f8e8-2d5a-42ad-a138-5bb7bd9b952f","Type":"ContainerStarted","Data":"612ac2ea8e7f708c65d8a412fc1869d61ba27b49b07c8b4081b26d583b3940ed"}
Jul 06 02:46:39.776633 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:39.776602    2570 generic.go:356] "Generic (PLEG): container finished" podID="07089987-6ce2-4fdf-b64e-7e413fad1c88" containerID="8fb5a41fe628ad80faa6c20df540e9762f739fd18668f3d56f800c8511b08ade" exitCode=0
Jul 06 02:46:39.776724 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:39.776691    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh6psl" event={"ID":"07089987-6ce2-4fdf-b64e-7e413fad1c88","Type":"ContainerDied","Data":"8fb5a41fe628ad80faa6c20df540e9762f739fd18668f3d56f800c8511b08ade"}
Jul 06 02:46:39.776765 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:39.776729    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh6psl" event={"ID":"07089987-6ce2-4fdf-b64e-7e413fad1c88","Type":"ContainerStarted","Data":"9d23990fa62f4ebafa929273e5c99b34c59f7bf8b9765ca5c985e21d27966c0c"}
Jul 06 02:46:40.801910 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:40.801873    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:46:41.213094 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:41.213010    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:46:42.791930 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:42.791895    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-kvvk9" event={"ID":"7749f8e8-2d5a-42ad-a138-5bb7bd9b952f","Type":"ContainerStarted","Data":"d6d61386f07fb8d2ba6f0a10d49241882580fcfb3ee359b0db2f24c33d01e491"}
Jul 06 02:46:42.792316 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:42.791979    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-kvvk9"
Jul 06 02:46:42.811821 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:42.811781    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-kvvk9" podStartSLOduration=2.024432952 podStartE2EDuration="4.811768514s" totalImagesPullingTime="2.787335562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:46:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:46:42.810331247 +0000 UTC m=+456.467340923" watchObservedRunningTime="2026-07-06 02:46:42.811768514 +0000 UTC m=+456.468778178"
Jul 06 02:46:44.434699 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:44.434664    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:46:44.493292 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:44.493258    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:46:46.902634 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:46.902604    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-w7l5q"]
Jul 06 02:46:46.906340 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:46.906322    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-w7l5q"
Jul 06 02:46:46.908529 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:46.908506    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-zv8vc\""
Jul 06 02:46:46.912079 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:46.912060    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-w7l5q"]
Jul 06 02:46:47.034713 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:47.034680    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5qjh\" (UniqueName: \"kubernetes.io/projected/adc91d81-e8ac-48f5-89ed-e306dc09a55c-kube-api-access-z5qjh\") pod \"cert-manager-cainjector-559cdd8c87-w7l5q\" (UID: \"adc91d81-e8ac-48f5-89ed-e306dc09a55c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-w7l5q"
Jul 06 02:46:47.034864 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:47.034726    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/adc91d81-e8ac-48f5-89ed-e306dc09a55c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-w7l5q\" (UID: \"adc91d81-e8ac-48f5-89ed-e306dc09a55c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-w7l5q"
Jul 06 02:46:47.135199 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:47.135167    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5qjh\" (UniqueName: \"kubernetes.io/projected/adc91d81-e8ac-48f5-89ed-e306dc09a55c-kube-api-access-z5qjh\") pod \"cert-manager-cainjector-559cdd8c87-w7l5q\" (UID: \"adc91d81-e8ac-48f5-89ed-e306dc09a55c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-w7l5q"
Jul 06 02:46:47.135355 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:47.135220    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/adc91d81-e8ac-48f5-89ed-e306dc09a55c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-w7l5q\" (UID: \"adc91d81-e8ac-48f5-89ed-e306dc09a55c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-w7l5q"
Jul 06 02:46:47.143002 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:47.142953    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/adc91d81-e8ac-48f5-89ed-e306dc09a55c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-w7l5q\" (UID: \"adc91d81-e8ac-48f5-89ed-e306dc09a55c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-w7l5q"
Jul 06 02:46:47.143105 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:47.143042    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5qjh\" (UniqueName: \"kubernetes.io/projected/adc91d81-e8ac-48f5-89ed-e306dc09a55c-kube-api-access-z5qjh\") pod \"cert-manager-cainjector-559cdd8c87-w7l5q\" (UID: \"adc91d81-e8ac-48f5-89ed-e306dc09a55c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-w7l5q"
Jul 06 02:46:47.216637 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:47.216572    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-w7l5q"
Jul 06 02:46:47.344269 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:47.344230    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-w7l5q"]
Jul 06 02:46:47.347288 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:46:47.347266    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podadc91d81_e8ac_48f5_89ed_e306dc09a55c.slice/crio-865d0fcdd5b71979e43282293d72cda878b9aa33ef7a4a60cd9db1055436e68a WatchSource:0}: Error finding container 865d0fcdd5b71979e43282293d72cda878b9aa33ef7a4a60cd9db1055436e68a: Status 404 returned error can't find the container with id 865d0fcdd5b71979e43282293d72cda878b9aa33ef7a4a60cd9db1055436e68a
Jul 06 02:46:47.812716 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:47.812683    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-w7l5q" event={"ID":"adc91d81-e8ac-48f5-89ed-e306dc09a55c","Type":"ContainerStarted","Data":"50aaf8b1c0599e310497828fd24db999d201df5a133d8a3c8582a1624cce2d03"}
Jul 06 02:46:47.812872 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:47.812726    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-w7l5q" event={"ID":"adc91d81-e8ac-48f5-89ed-e306dc09a55c","Type":"ContainerStarted","Data":"865d0fcdd5b71979e43282293d72cda878b9aa33ef7a4a60cd9db1055436e68a"}
Jul 06 02:46:47.828116 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:47.828074    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-w7l5q" podStartSLOduration=1.828059659 podStartE2EDuration="1.828059659s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:46:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:46:47.827244287 +0000 UTC m=+461.484253945" watchObservedRunningTime="2026-07-06 02:46:47.828059659 +0000 UTC m=+461.485069324"
Jul 06 02:46:48.127517 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:48.127436    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:46:48.227801 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:48.227771    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:46:48.798122 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:48.798092    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-kvvk9"
Jul 06 02:46:48.815633 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:48.815586    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:46:50.827854 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:50.827823    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh6psl" event={"ID":"07089987-6ce2-4fdf-b64e-7e413fad1c88","Type":"ContainerStarted","Data":"14fabe1e2727931147673cadb10bf65d8fac72234ee43b8d5fc16e12243eebc8"}
Jul 06 02:46:51.833642 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:51.833606    2570 generic.go:356] "Generic (PLEG): container finished" podID="07089987-6ce2-4fdf-b64e-7e413fad1c88" containerID="14fabe1e2727931147673cadb10bf65d8fac72234ee43b8d5fc16e12243eebc8" exitCode=0
Jul 06 02:46:51.834056 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:51.833660    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh6psl" event={"ID":"07089987-6ce2-4fdf-b64e-7e413fad1c88","Type":"ContainerDied","Data":"14fabe1e2727931147673cadb10bf65d8fac72234ee43b8d5fc16e12243eebc8"}
Jul 06 02:46:52.840041 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:52.840006    2570 generic.go:356] "Generic (PLEG): container finished" podID="07089987-6ce2-4fdf-b64e-7e413fad1c88" containerID="1f2d6ac98dfd2add92c46ace14b4a7f611e17de64de8d0e9dd95167b5eb3f017" exitCode=0
Jul 06 02:46:52.840401 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:52.840043    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh6psl" event={"ID":"07089987-6ce2-4fdf-b64e-7e413fad1c88","Type":"ContainerDied","Data":"1f2d6ac98dfd2add92c46ace14b4a7f611e17de64de8d0e9dd95167b5eb3f017"}
Jul 06 02:46:53.999030 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:53.998975    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh6psl"
Jul 06 02:46:54.090032 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:54.090006    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmhj4\" (UniqueName: \"kubernetes.io/projected/07089987-6ce2-4fdf-b64e-7e413fad1c88-kube-api-access-tmhj4\") pod \"07089987-6ce2-4fdf-b64e-7e413fad1c88\" (UID: \"07089987-6ce2-4fdf-b64e-7e413fad1c88\") "
Jul 06 02:46:54.090151 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:54.090042    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07089987-6ce2-4fdf-b64e-7e413fad1c88-util\") pod \"07089987-6ce2-4fdf-b64e-7e413fad1c88\" (UID: \"07089987-6ce2-4fdf-b64e-7e413fad1c88\") "
Jul 06 02:46:54.090151 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:54.090063    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07089987-6ce2-4fdf-b64e-7e413fad1c88-bundle\") pod \"07089987-6ce2-4fdf-b64e-7e413fad1c88\" (UID: \"07089987-6ce2-4fdf-b64e-7e413fad1c88\") "
Jul 06 02:46:54.090444 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:54.090417    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07089987-6ce2-4fdf-b64e-7e413fad1c88-bundle" (OuterVolumeSpecName: "bundle") pod "07089987-6ce2-4fdf-b64e-7e413fad1c88" (UID: "07089987-6ce2-4fdf-b64e-7e413fad1c88"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 02:46:54.092026 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:54.092000    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07089987-6ce2-4fdf-b64e-7e413fad1c88-kube-api-access-tmhj4" (OuterVolumeSpecName: "kube-api-access-tmhj4") pod "07089987-6ce2-4fdf-b64e-7e413fad1c88" (UID: "07089987-6ce2-4fdf-b64e-7e413fad1c88"). InnerVolumeSpecName "kube-api-access-tmhj4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 02:46:54.094676 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:54.094621    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07089987-6ce2-4fdf-b64e-7e413fad1c88-util" (OuterVolumeSpecName: "util") pod "07089987-6ce2-4fdf-b64e-7e413fad1c88" (UID: "07089987-6ce2-4fdf-b64e-7e413fad1c88"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 02:46:54.190504 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:54.190481    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmhj4\" (UniqueName: \"kubernetes.io/projected/07089987-6ce2-4fdf-b64e-7e413fad1c88-kube-api-access-tmhj4\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:46:54.190504 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:54.190504    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07089987-6ce2-4fdf-b64e-7e413fad1c88-util\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:46:54.190632 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:54.190514    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07089987-6ce2-4fdf-b64e-7e413fad1c88-bundle\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:46:54.850241 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:54.850211    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh6psl"
Jul 06 02:46:54.850416 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:54.850217    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh6psl" event={"ID":"07089987-6ce2-4fdf-b64e-7e413fad1c88","Type":"ContainerDied","Data":"9d23990fa62f4ebafa929273e5c99b34c59f7bf8b9765ca5c985e21d27966c0c"}
Jul 06 02:46:54.850416 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:46:54.850328    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9d23990fa62f4ebafa929273e5c99b34c59f7bf8b9765ca5c985e21d27966c0c"
Jul 06 02:47:00.508537 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:00.508505    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:47:01.446586 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:01.446543    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:47:01.543587 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:01.543553    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:47:09.733093 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:09.733039    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:47:09.835477 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:09.835441    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:47:11.928288 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:11.928249    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:47:13.304520 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:13.304487    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqsfr"]
Jul 06 02:47:13.304882 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:13.304756    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07089987-6ce2-4fdf-b64e-7e413fad1c88" containerName="util"
Jul 06 02:47:13.304882 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:13.304767    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="07089987-6ce2-4fdf-b64e-7e413fad1c88" containerName="util"
Jul 06 02:47:13.304882 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:13.304774    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07089987-6ce2-4fdf-b64e-7e413fad1c88" containerName="extract"
Jul 06 02:47:13.304882 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:13.304780    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="07089987-6ce2-4fdf-b64e-7e413fad1c88" containerName="extract"
Jul 06 02:47:13.304882 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:13.304792    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07089987-6ce2-4fdf-b64e-7e413fad1c88" containerName="pull"
Jul 06 02:47:13.304882 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:13.304797    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="07089987-6ce2-4fdf-b64e-7e413fad1c88" containerName="pull"
Jul 06 02:47:13.304882 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:13.304842    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="07089987-6ce2-4fdf-b64e-7e413fad1c88" containerName="extract"
Jul 06 02:47:13.307471 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:13.307453    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqsfr"
Jul 06 02:47:13.309695 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:13.309669    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 06 02:47:13.310824 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:13.310809    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 06 02:47:13.310921 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:13.310827    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zphg2\""
Jul 06 02:47:13.315438 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:13.315417    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqsfr"]
Jul 06 02:47:13.441891 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:13.441861    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ebf2996d-47b9-4f87-b6c4-e524dbfd52b7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqsfr\" (UID: \"ebf2996d-47b9-4f87-b6c4-e524dbfd52b7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqsfr"
Jul 06 02:47:13.442043 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:13.441907    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsvgm\" (UniqueName: \"kubernetes.io/projected/ebf2996d-47b9-4f87-b6c4-e524dbfd52b7-kube-api-access-zsvgm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqsfr\" (UID: \"ebf2996d-47b9-4f87-b6c4-e524dbfd52b7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqsfr"
Jul 06 02:47:13.442043 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:13.441969    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ebf2996d-47b9-4f87-b6c4-e524dbfd52b7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqsfr\" (UID: \"ebf2996d-47b9-4f87-b6c4-e524dbfd52b7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqsfr"
Jul 06 02:47:13.542870 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:13.542838    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ebf2996d-47b9-4f87-b6c4-e524dbfd52b7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqsfr\" (UID: \"ebf2996d-47b9-4f87-b6c4-e524dbfd52b7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqsfr"
Jul 06 02:47:13.543031 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:13.542907    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ebf2996d-47b9-4f87-b6c4-e524dbfd52b7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqsfr\" (UID: \"ebf2996d-47b9-4f87-b6c4-e524dbfd52b7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqsfr"
Jul 06 02:47:13.543031 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:13.542956    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsvgm\" (UniqueName: \"kubernetes.io/projected/ebf2996d-47b9-4f87-b6c4-e524dbfd52b7-kube-api-access-zsvgm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqsfr\" (UID: \"ebf2996d-47b9-4f87-b6c4-e524dbfd52b7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqsfr"
Jul 06 02:47:13.543243 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:13.543221    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ebf2996d-47b9-4f87-b6c4-e524dbfd52b7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqsfr\" (UID: \"ebf2996d-47b9-4f87-b6c4-e524dbfd52b7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqsfr"
Jul 06 02:47:13.543301 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:13.543253    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ebf2996d-47b9-4f87-b6c4-e524dbfd52b7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqsfr\" (UID: \"ebf2996d-47b9-4f87-b6c4-e524dbfd52b7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqsfr"
Jul 06 02:47:13.550366 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:13.550349    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsvgm\" (UniqueName: \"kubernetes.io/projected/ebf2996d-47b9-4f87-b6c4-e524dbfd52b7-kube-api-access-zsvgm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqsfr\" (UID: \"ebf2996d-47b9-4f87-b6c4-e524dbfd52b7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqsfr"
Jul 06 02:47:13.617585 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:13.617532    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqsfr"
Jul 06 02:47:13.745565 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:13.745542    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqsfr"]
Jul 06 02:47:13.747691 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:47:13.747662    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebf2996d_47b9_4f87_b6c4_e524dbfd52b7.slice/crio-3d57c048ddb133d5c907f5f9372c0c32c6614de1323d7ef0ac9d52ac0928e91a WatchSource:0}: Error finding container 3d57c048ddb133d5c907f5f9372c0c32c6614de1323d7ef0ac9d52ac0928e91a: Status 404 returned error can't find the container with id 3d57c048ddb133d5c907f5f9372c0c32c6614de1323d7ef0ac9d52ac0928e91a
Jul 06 02:47:13.934512 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:13.934452    2570 generic.go:356] "Generic (PLEG): container finished" podID="ebf2996d-47b9-4f87-b6c4-e524dbfd52b7" containerID="4052e0afdf51525df5c5fef7d880510aa1089b4027e3f2f01089b71469a7bb51" exitCode=0
Jul 06 02:47:13.934512 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:13.934491    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqsfr" event={"ID":"ebf2996d-47b9-4f87-b6c4-e524dbfd52b7","Type":"ContainerDied","Data":"4052e0afdf51525df5c5fef7d880510aa1089b4027e3f2f01089b71469a7bb51"}
Jul 06 02:47:13.934657 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:13.934523    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqsfr" event={"ID":"ebf2996d-47b9-4f87-b6c4-e524dbfd52b7","Type":"ContainerStarted","Data":"3d57c048ddb133d5c907f5f9372c0c32c6614de1323d7ef0ac9d52ac0928e91a"}
Jul 06 02:47:14.940144 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:14.940057    2570 generic.go:356] "Generic (PLEG): container finished" podID="ebf2996d-47b9-4f87-b6c4-e524dbfd52b7" containerID="b31c4809f8b0f3b3222c4642f6b832588661f1fa63caec05cfc6e1755f1c6431" exitCode=0
Jul 06 02:47:14.940144 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:14.940101    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqsfr" event={"ID":"ebf2996d-47b9-4f87-b6c4-e524dbfd52b7","Type":"ContainerDied","Data":"b31c4809f8b0f3b3222c4642f6b832588661f1fa63caec05cfc6e1755f1c6431"}
Jul 06 02:47:15.946593 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:15.946555    2570 generic.go:356] "Generic (PLEG): container finished" podID="ebf2996d-47b9-4f87-b6c4-e524dbfd52b7" containerID="9bd7ad0b44567162af00615a90f51da78bc7a5c7faaaa760427fe7005d58c3f8" exitCode=0
Jul 06 02:47:15.947027 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:15.946608    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqsfr" event={"ID":"ebf2996d-47b9-4f87-b6c4-e524dbfd52b7","Type":"ContainerDied","Data":"9bd7ad0b44567162af00615a90f51da78bc7a5c7faaaa760427fe7005d58c3f8"}
Jul 06 02:47:17.070719 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:17.070696    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqsfr"
Jul 06 02:47:17.172064 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:17.172033    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zsvgm\" (UniqueName: \"kubernetes.io/projected/ebf2996d-47b9-4f87-b6c4-e524dbfd52b7-kube-api-access-zsvgm\") pod \"ebf2996d-47b9-4f87-b6c4-e524dbfd52b7\" (UID: \"ebf2996d-47b9-4f87-b6c4-e524dbfd52b7\") "
Jul 06 02:47:17.172216 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:17.172113    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ebf2996d-47b9-4f87-b6c4-e524dbfd52b7-bundle\") pod \"ebf2996d-47b9-4f87-b6c4-e524dbfd52b7\" (UID: \"ebf2996d-47b9-4f87-b6c4-e524dbfd52b7\") "
Jul 06 02:47:17.172216 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:17.172130    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ebf2996d-47b9-4f87-b6c4-e524dbfd52b7-util\") pod \"ebf2996d-47b9-4f87-b6c4-e524dbfd52b7\" (UID: \"ebf2996d-47b9-4f87-b6c4-e524dbfd52b7\") "
Jul 06 02:47:17.172781 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:17.172757    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebf2996d-47b9-4f87-b6c4-e524dbfd52b7-bundle" (OuterVolumeSpecName: "bundle") pod "ebf2996d-47b9-4f87-b6c4-e524dbfd52b7" (UID: "ebf2996d-47b9-4f87-b6c4-e524dbfd52b7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 02:47:17.174135 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:17.174112    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebf2996d-47b9-4f87-b6c4-e524dbfd52b7-kube-api-access-zsvgm" (OuterVolumeSpecName: "kube-api-access-zsvgm") pod "ebf2996d-47b9-4f87-b6c4-e524dbfd52b7" (UID: "ebf2996d-47b9-4f87-b6c4-e524dbfd52b7"). InnerVolumeSpecName "kube-api-access-zsvgm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 02:47:17.177620 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:17.177598    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebf2996d-47b9-4f87-b6c4-e524dbfd52b7-util" (OuterVolumeSpecName: "util") pod "ebf2996d-47b9-4f87-b6c4-e524dbfd52b7" (UID: "ebf2996d-47b9-4f87-b6c4-e524dbfd52b7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 02:47:17.272608 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:17.272584    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ebf2996d-47b9-4f87-b6c4-e524dbfd52b7-bundle\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:47:17.272608 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:17.272609    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ebf2996d-47b9-4f87-b6c4-e524dbfd52b7-util\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:47:17.272759 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:17.272623    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zsvgm\" (UniqueName: \"kubernetes.io/projected/ebf2996d-47b9-4f87-b6c4-e524dbfd52b7-kube-api-access-zsvgm\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:47:17.956547 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:17.956508    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqsfr" event={"ID":"ebf2996d-47b9-4f87-b6c4-e524dbfd52b7","Type":"ContainerDied","Data":"3d57c048ddb133d5c907f5f9372c0c32c6614de1323d7ef0ac9d52ac0928e91a"}
Jul 06 02:47:17.956720 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:17.956555    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzqsfr"
Jul 06 02:47:17.956720 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:17.956596    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3d57c048ddb133d5c907f5f9372c0c32c6614de1323d7ef0ac9d52ac0928e91a"
Jul 06 02:47:23.653665 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:23.653612    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:47:23.755566 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:23.755536    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:47:24.268559 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:24.268513    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:47:24.464905 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:24.464868    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:47:24.568424 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:24.568394    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:47:24.577316 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:24.577290    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d49d64447-jfmtq"]
Jul 06 02:47:24.577650 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:24.577633    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebf2996d-47b9-4f87-b6c4-e524dbfd52b7" containerName="pull"
Jul 06 02:47:24.577718 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:24.577652    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebf2996d-47b9-4f87-b6c4-e524dbfd52b7" containerName="pull"
Jul 06 02:47:24.577718 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:24.577663    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebf2996d-47b9-4f87-b6c4-e524dbfd52b7" containerName="extract"
Jul 06 02:47:24.577718 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:24.577671    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebf2996d-47b9-4f87-b6c4-e524dbfd52b7" containerName="extract"
Jul 06 02:47:24.577718 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:24.577694    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebf2996d-47b9-4f87-b6c4-e524dbfd52b7" containerName="util"
Jul 06 02:47:24.577718 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:24.577703    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebf2996d-47b9-4f87-b6c4-e524dbfd52b7" containerName="util"
Jul 06 02:47:24.578007 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:24.577792    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebf2996d-47b9-4f87-b6c4-e524dbfd52b7" containerName="extract"
Jul 06 02:47:24.581930 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:24.581913    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-jfmtq"
Jul 06 02:47:24.584490 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:24.584459    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-22csz\""
Jul 06 02:47:24.584490 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:24.584480    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 06 02:47:24.584643 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:24.584557    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 02:47:24.584643 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:24.584570    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 02:47:24.585086 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:24.585069    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 02:47:24.593716 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:24.593696    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d49d64447-jfmtq"]
Jul 06 02:47:24.724742 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:24.724712    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d7ff017-37df-4a24-a4d0-9768d6396231-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d49d64447-jfmtq\" (UID: \"4d7ff017-37df-4a24-a4d0-9768d6396231\") " pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-jfmtq"
Jul 06 02:47:24.725111 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:24.724756    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d7ff017-37df-4a24-a4d0-9768d6396231-tmp\") pod \"opendatahub-operator-controller-manager-6d49d64447-jfmtq\" (UID: \"4d7ff017-37df-4a24-a4d0-9768d6396231\") " pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-jfmtq"
Jul 06 02:47:24.725111 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:24.724776    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m92js\" (UniqueName: \"kubernetes.io/projected/4d7ff017-37df-4a24-a4d0-9768d6396231-kube-api-access-m92js\") pod \"opendatahub-operator-controller-manager-6d49d64447-jfmtq\" (UID: \"4d7ff017-37df-4a24-a4d0-9768d6396231\") " pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-jfmtq"
Jul 06 02:47:24.725111 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:24.724835    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4d7ff017-37df-4a24-a4d0-9768d6396231-manifests\") pod \"opendatahub-operator-controller-manager-6d49d64447-jfmtq\" (UID: \"4d7ff017-37df-4a24-a4d0-9768d6396231\") " pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-jfmtq"
Jul 06 02:47:24.725111 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:24.724878    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4d7ff017-37df-4a24-a4d0-9768d6396231-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d49d64447-jfmtq\" (UID: \"4d7ff017-37df-4a24-a4d0-9768d6396231\") " pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-jfmtq"
Jul 06 02:47:24.743651 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:24.743623    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:47:24.825306 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:24.825225    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m92js\" (UniqueName: \"kubernetes.io/projected/4d7ff017-37df-4a24-a4d0-9768d6396231-kube-api-access-m92js\") pod \"opendatahub-operator-controller-manager-6d49d64447-jfmtq\" (UID: \"4d7ff017-37df-4a24-a4d0-9768d6396231\") " pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-jfmtq"
Jul 06 02:47:24.825306 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:24.825280    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4d7ff017-37df-4a24-a4d0-9768d6396231-manifests\") pod \"opendatahub-operator-controller-manager-6d49d64447-jfmtq\" (UID: \"4d7ff017-37df-4a24-a4d0-9768d6396231\") " pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-jfmtq"
Jul 06 02:47:24.825489 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:24.825313    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4d7ff017-37df-4a24-a4d0-9768d6396231-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d49d64447-jfmtq\" (UID: \"4d7ff017-37df-4a24-a4d0-9768d6396231\") " pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-jfmtq"
Jul 06 02:47:24.825489 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:24.825367    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d7ff017-37df-4a24-a4d0-9768d6396231-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d49d64447-jfmtq\" (UID: \"4d7ff017-37df-4a24-a4d0-9768d6396231\") " pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-jfmtq"
Jul 06 02:47:24.825489 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:24.825435    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d7ff017-37df-4a24-a4d0-9768d6396231-tmp\") pod \"opendatahub-operator-controller-manager-6d49d64447-jfmtq\" (UID: \"4d7ff017-37df-4a24-a4d0-9768d6396231\") " pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-jfmtq"
Jul 06 02:47:24.825708 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:24.825689    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4d7ff017-37df-4a24-a4d0-9768d6396231-manifests\") pod \"opendatahub-operator-controller-manager-6d49d64447-jfmtq\" (UID: \"4d7ff017-37df-4a24-a4d0-9768d6396231\") " pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-jfmtq"
Jul 06 02:47:24.827549 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:24.827522    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d7ff017-37df-4a24-a4d0-9768d6396231-tmp\") pod \"opendatahub-operator-controller-manager-6d49d64447-jfmtq\" (UID: \"4d7ff017-37df-4a24-a4d0-9768d6396231\") " pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-jfmtq"
Jul 06 02:47:24.827747 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:24.827723    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4d7ff017-37df-4a24-a4d0-9768d6396231-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d49d64447-jfmtq\" (UID: \"4d7ff017-37df-4a24-a4d0-9768d6396231\") " pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-jfmtq"
Jul 06 02:47:24.827889 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:24.827874    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d7ff017-37df-4a24-a4d0-9768d6396231-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d49d64447-jfmtq\" (UID: \"4d7ff017-37df-4a24-a4d0-9768d6396231\") " pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-jfmtq"
Jul 06 02:47:24.833358 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:24.833338    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m92js\" (UniqueName: \"kubernetes.io/projected/4d7ff017-37df-4a24-a4d0-9768d6396231-kube-api-access-m92js\") pod \"opendatahub-operator-controller-manager-6d49d64447-jfmtq\" (UID: \"4d7ff017-37df-4a24-a4d0-9768d6396231\") " pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-jfmtq"
Jul 06 02:47:24.833536 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:24.833509    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:47:24.892615 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:24.892585    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-jfmtq"
Jul 06 02:47:24.935359 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:24.935321    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:47:25.025185 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:25.025152    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d49d64447-jfmtq"]
Jul 06 02:47:25.028834 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:47:25.028811    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d7ff017_37df_4a24_a4d0_9768d6396231.slice/crio-d63f98685fbfa41dcdcd64cbddb621b5fae7b2bb23c3fa93692efc0efd79502b WatchSource:0}: Error finding container d63f98685fbfa41dcdcd64cbddb621b5fae7b2bb23c3fa93692efc0efd79502b: Status 404 returned error can't find the container with id d63f98685fbfa41dcdcd64cbddb621b5fae7b2bb23c3fa93692efc0efd79502b
Jul 06 02:47:25.030597 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:25.030553    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:47:25.100942 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:25.100853    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:47:25.204069 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:25.204038    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:47:25.300051 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:25.300010    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:47:25.995824 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:25.995786    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-jfmtq" event={"ID":"4d7ff017-37df-4a24-a4d0-9768d6396231","Type":"ContainerStarted","Data":"d63f98685fbfa41dcdcd64cbddb621b5fae7b2bb23c3fa93692efc0efd79502b"}
Jul 06 02:47:29.013140 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:29.013105    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-jfmtq" event={"ID":"4d7ff017-37df-4a24-a4d0-9768d6396231","Type":"ContainerStarted","Data":"615e2bfc7937c0f6c78defeebcbda2b1da108f627257191522cec1bc1251f1ea"}
Jul 06 02:47:30.018434 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:30.018400    2570 generic.go:356] "Generic (PLEG): container finished" podID="4d7ff017-37df-4a24-a4d0-9768d6396231" containerID="615e2bfc7937c0f6c78defeebcbda2b1da108f627257191522cec1bc1251f1ea" exitCode=0
Jul 06 02:47:30.018786 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:30.018469    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-jfmtq" event={"ID":"4d7ff017-37df-4a24-a4d0-9768d6396231","Type":"ContainerDied","Data":"615e2bfc7937c0f6c78defeebcbda2b1da108f627257191522cec1bc1251f1ea"}
Jul 06 02:47:30.155013 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:30.154947    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:47:30.261132 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:30.261096    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:47:31.025090 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:31.025045    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-jfmtq" event={"ID":"4d7ff017-37df-4a24-a4d0-9768d6396231","Type":"ContainerStarted","Data":"9be82b26de94c804b7687818558b458ae9a64b2e965c54baaf8ccdc8a7df72f6"}
Jul 06 02:47:31.025472 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:31.025191    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-jfmtq"
Jul 06 02:47:31.048224 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:31.048180    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-jfmtq" podStartSLOduration=2.661672947 podStartE2EDuration="7.048166689s" totalImagesPullingTime="3.328661577s" totalInitContainerRuntime="1.057832165s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:47:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:47:31.046256794 +0000 UTC m=+504.703266457" watchObservedRunningTime="2026-07-06 02:47:31.048166689 +0000 UTC m=+504.705176350"
Jul 06 02:47:42.030860 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:42.030821    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-jfmtq"
Jul 06 02:47:43.808670 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:43.808634    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:47:43.910546 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:43.910511    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:47:44.134536 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:44.134449    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:47:44.221817 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:44.221785    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-59cc9f6b7-lrl7m"]
Jul 06 02:47:44.230110 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:44.230082    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59cc9f6b7-lrl7m"
Jul 06 02:47:44.232643 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:44.232621    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 06 02:47:44.232643 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:44.232635    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 06 02:47:44.232803 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:44.232669    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-8dpd9\""
Jul 06 02:47:44.237877 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:44.237537    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59cc9f6b7-lrl7m"]
Jul 06 02:47:44.261130 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:44.261103    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e2803f3-236a-4bbf-bcae-781da42167c4-tmp\") pod \"kube-auth-proxy-59cc9f6b7-lrl7m\" (UID: \"4e2803f3-236a-4bbf-bcae-781da42167c4\") " pod="openshift-ingress/kube-auth-proxy-59cc9f6b7-lrl7m"
Jul 06 02:47:44.261241 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:44.261171    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e2803f3-236a-4bbf-bcae-781da42167c4-tls-certs\") pod \"kube-auth-proxy-59cc9f6b7-lrl7m\" (UID: \"4e2803f3-236a-4bbf-bcae-781da42167c4\") " pod="openshift-ingress/kube-auth-proxy-59cc9f6b7-lrl7m"
Jul 06 02:47:44.261396 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:44.261364    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rgvq\" (UniqueName: \"kubernetes.io/projected/4e2803f3-236a-4bbf-bcae-781da42167c4-kube-api-access-7rgvq\") pod \"kube-auth-proxy-59cc9f6b7-lrl7m\" (UID: \"4e2803f3-236a-4bbf-bcae-781da42167c4\") " pod="openshift-ingress/kube-auth-proxy-59cc9f6b7-lrl7m"
Jul 06 02:47:44.341882 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:44.341836    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:47:44.362154 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:44.362132    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rgvq\" (UniqueName: \"kubernetes.io/projected/4e2803f3-236a-4bbf-bcae-781da42167c4-kube-api-access-7rgvq\") pod \"kube-auth-proxy-59cc9f6b7-lrl7m\" (UID: \"4e2803f3-236a-4bbf-bcae-781da42167c4\") " pod="openshift-ingress/kube-auth-proxy-59cc9f6b7-lrl7m"
Jul 06 02:47:44.362303 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:44.362194    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e2803f3-236a-4bbf-bcae-781da42167c4-tmp\") pod \"kube-auth-proxy-59cc9f6b7-lrl7m\" (UID: \"4e2803f3-236a-4bbf-bcae-781da42167c4\") " pod="openshift-ingress/kube-auth-proxy-59cc9f6b7-lrl7m"
Jul 06 02:47:44.362303 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:44.362224    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e2803f3-236a-4bbf-bcae-781da42167c4-tls-certs\") pod \"kube-auth-proxy-59cc9f6b7-lrl7m\" (UID: \"4e2803f3-236a-4bbf-bcae-781da42167c4\") " pod="openshift-ingress/kube-auth-proxy-59cc9f6b7-lrl7m"
Jul 06 02:47:44.364350 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:44.364330    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e2803f3-236a-4bbf-bcae-781da42167c4-tmp\") pod \"kube-auth-proxy-59cc9f6b7-lrl7m\" (UID: \"4e2803f3-236a-4bbf-bcae-781da42167c4\") " pod="openshift-ingress/kube-auth-proxy-59cc9f6b7-lrl7m"
Jul 06 02:47:44.364618 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:44.364601    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e2803f3-236a-4bbf-bcae-781da42167c4-tls-certs\") pod \"kube-auth-proxy-59cc9f6b7-lrl7m\" (UID: \"4e2803f3-236a-4bbf-bcae-781da42167c4\") " pod="openshift-ingress/kube-auth-proxy-59cc9f6b7-lrl7m"
Jul 06 02:47:44.375829 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:44.375807    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rgvq\" (UniqueName: \"kubernetes.io/projected/4e2803f3-236a-4bbf-bcae-781da42167c4-kube-api-access-7rgvq\") pod \"kube-auth-proxy-59cc9f6b7-lrl7m\" (UID: \"4e2803f3-236a-4bbf-bcae-781da42167c4\") " pod="openshift-ingress/kube-auth-proxy-59cc9f6b7-lrl7m"
Jul 06 02:47:44.438061 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:44.437974    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-f7wpp"]
Jul 06 02:47:44.441640 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:44.441619    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-f7wpp"
Jul 06 02:47:44.446349 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:44.446327    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 06 02:47:44.446450 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:44.446395    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-44kqs\""
Jul 06 02:47:44.454461 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:44.454442    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-f7wpp"]
Jul 06 02:47:44.463495 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:44.463456    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw8pr\" (UniqueName: \"kubernetes.io/projected/d45c798c-f620-40d9-8493-d04e15f091f4-kube-api-access-gw8pr\") pod \"odh-model-controller-7998c67dc4-f7wpp\" (UID: \"d45c798c-f620-40d9-8493-d04e15f091f4\") " pod="opendatahub/odh-model-controller-7998c67dc4-f7wpp"
Jul 06 02:47:44.463495 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:44.463490    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d45c798c-f620-40d9-8493-d04e15f091f4-cert\") pod \"odh-model-controller-7998c67dc4-f7wpp\" (UID: \"d45c798c-f620-40d9-8493-d04e15f091f4\") " pod="opendatahub/odh-model-controller-7998c67dc4-f7wpp"
Jul 06 02:47:44.472480 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:44.472429    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:47:44.535387 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:44.535358    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:47:44.541228 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:44.541209    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59cc9f6b7-lrl7m"
Jul 06 02:47:44.564525 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:44.564495    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw8pr\" (UniqueName: \"kubernetes.io/projected/d45c798c-f620-40d9-8493-d04e15f091f4-kube-api-access-gw8pr\") pod \"odh-model-controller-7998c67dc4-f7wpp\" (UID: \"d45c798c-f620-40d9-8493-d04e15f091f4\") " pod="opendatahub/odh-model-controller-7998c67dc4-f7wpp"
Jul 06 02:47:44.564667 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:44.564534    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d45c798c-f620-40d9-8493-d04e15f091f4-cert\") pod \"odh-model-controller-7998c67dc4-f7wpp\" (UID: \"d45c798c-f620-40d9-8493-d04e15f091f4\") " pod="opendatahub/odh-model-controller-7998c67dc4-f7wpp"
Jul 06 02:47:44.564724 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:47:44.564664    2570 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 06 02:47:44.564776 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:47:44.564728    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d45c798c-f620-40d9-8493-d04e15f091f4-cert podName:d45c798c-f620-40d9-8493-d04e15f091f4 nodeName:}" failed. No retries permitted until 2026-07-06 02:47:45.064704422 +0000 UTC m=+518.721714080 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d45c798c-f620-40d9-8493-d04e15f091f4-cert") pod "odh-model-controller-7998c67dc4-f7wpp" (UID: "d45c798c-f620-40d9-8493-d04e15f091f4") : secret "odh-model-controller-webhook-cert" not found
Jul 06 02:47:44.574339 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:44.574309    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw8pr\" (UniqueName: \"kubernetes.io/projected/d45c798c-f620-40d9-8493-d04e15f091f4-kube-api-access-gw8pr\") pod \"odh-model-controller-7998c67dc4-f7wpp\" (UID: \"d45c798c-f620-40d9-8493-d04e15f091f4\") " pod="opendatahub/odh-model-controller-7998c67dc4-f7wpp"
Jul 06 02:47:44.636576 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:44.636509    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:47:44.672649 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:44.672506    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59cc9f6b7-lrl7m"]
Jul 06 02:47:44.675489 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:47:44.675461    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e2803f3_236a_4bbf_bcae_781da42167c4.slice/crio-4f52d857642a5fb6e4fa5c22184d27af7142a9985b5d8c3946f56841086b3d00 WatchSource:0}: Error finding container 4f52d857642a5fb6e4fa5c22184d27af7142a9985b5d8c3946f56841086b3d00: Status 404 returned error can't find the container with id 4f52d857642a5fb6e4fa5c22184d27af7142a9985b5d8c3946f56841086b3d00
Jul 06 02:47:44.738942 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:44.738871    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:47:45.029474 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.029435    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-rzfdj"]
Jul 06 02:47:45.034537 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.034511    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-rzfdj"
Jul 06 02:47:45.037034 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.037010    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 06 02:47:45.043468 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.043446    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-rzfdj"]
Jul 06 02:47:45.055791 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.055698    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:47:45.077328 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.077295    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d45c798c-f620-40d9-8493-d04e15f091f4-cert\") pod \"odh-model-controller-7998c67dc4-f7wpp\" (UID: \"d45c798c-f620-40d9-8493-d04e15f091f4\") " pod="opendatahub/odh-model-controller-7998c67dc4-f7wpp"
Jul 06 02:47:45.077477 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.077348    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae0ba419-7a62-4c61-be5d-d9cc58d11a53-tls-certs\") pod \"model-serving-api-54d89bd5fc-rzfdj\" (UID: \"ae0ba419-7a62-4c61-be5d-d9cc58d11a53\") " pod="opendatahub/model-serving-api-54d89bd5fc-rzfdj"
Jul 06 02:47:45.077477 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.077396    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv4nl\" (UniqueName: \"kubernetes.io/projected/ae0ba419-7a62-4c61-be5d-d9cc58d11a53-kube-api-access-vv4nl\") pod \"model-serving-api-54d89bd5fc-rzfdj\" (UID: \"ae0ba419-7a62-4c61-be5d-d9cc58d11a53\") " pod="opendatahub/model-serving-api-54d89bd5fc-rzfdj"
Jul 06 02:47:45.079676 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.079650    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d45c798c-f620-40d9-8493-d04e15f091f4-cert\") pod \"odh-model-controller-7998c67dc4-f7wpp\" (UID: \"d45c798c-f620-40d9-8493-d04e15f091f4\") " pod="opendatahub/odh-model-controller-7998c67dc4-f7wpp"
Jul 06 02:47:45.092229 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.092195    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59cc9f6b7-lrl7m" event={"ID":"4e2803f3-236a-4bbf-bcae-781da42167c4","Type":"ContainerStarted","Data":"4f52d857642a5fb6e4fa5c22184d27af7142a9985b5d8c3946f56841086b3d00"}
Jul 06 02:47:45.155605 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.155557    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:47:45.178428 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.178396    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae0ba419-7a62-4c61-be5d-d9cc58d11a53-tls-certs\") pod \"model-serving-api-54d89bd5fc-rzfdj\" (UID: \"ae0ba419-7a62-4c61-be5d-d9cc58d11a53\") " pod="opendatahub/model-serving-api-54d89bd5fc-rzfdj"
Jul 06 02:47:45.178585 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.178449    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv4nl\" (UniqueName: \"kubernetes.io/projected/ae0ba419-7a62-4c61-be5d-d9cc58d11a53-kube-api-access-vv4nl\") pod \"model-serving-api-54d89bd5fc-rzfdj\" (UID: \"ae0ba419-7a62-4c61-be5d-d9cc58d11a53\") " pod="opendatahub/model-serving-api-54d89bd5fc-rzfdj"
Jul 06 02:47:45.180914 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.180889    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae0ba419-7a62-4c61-be5d-d9cc58d11a53-tls-certs\") pod \"model-serving-api-54d89bd5fc-rzfdj\" (UID: \"ae0ba419-7a62-4c61-be5d-d9cc58d11a53\") " pod="opendatahub/model-serving-api-54d89bd5fc-rzfdj"
Jul 06 02:47:45.191512 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.191486    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv4nl\" (UniqueName: \"kubernetes.io/projected/ae0ba419-7a62-4c61-be5d-d9cc58d11a53-kube-api-access-vv4nl\") pod \"model-serving-api-54d89bd5fc-rzfdj\" (UID: \"ae0ba419-7a62-4c61-be5d-d9cc58d11a53\") " pod="opendatahub/model-serving-api-54d89bd5fc-rzfdj"
Jul 06 02:47:45.347768 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.347673    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-rzfdj"
Jul 06 02:47:45.351684 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.351662    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-f7wpp"
Jul 06 02:47:45.467323 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.467291    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-w6hrp"]
Jul 06 02:47:45.472217 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.472196    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-w6hrp"
Jul 06 02:47:45.475638 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.475562    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 06 02:47:45.477164 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.477146    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 06 02:47:45.477329 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.477178    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 02:47:45.477409 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.477216    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 06 02:47:45.477585 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.477556    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-f2tgm\""
Jul 06 02:47:45.481694 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.481582    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:47:45.485089 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.483221    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-w6hrp"]
Jul 06 02:47:45.581205 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.580615    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-f7wpp"]
Jul 06 02:47:45.582298 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.582239    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bef3c78f-d530-474d-ae3d-e50a6f3f0d9d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-w6hrp\" (UID: \"bef3c78f-d530-474d-ae3d-e50a6f3f0d9d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-w6hrp"
Jul 06 02:47:45.582298 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.582280    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bef3c78f-d530-474d-ae3d-e50a6f3f0d9d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-w6hrp\" (UID: \"bef3c78f-d530-474d-ae3d-e50a6f3f0d9d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-w6hrp"
Jul 06 02:47:45.582502 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.582325    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bef3c78f-d530-474d-ae3d-e50a6f3f0d9d-local-certs\") pod \"istiod-openshift-gateway-7574459656-w6hrp\" (UID: \"bef3c78f-d530-474d-ae3d-e50a6f3f0d9d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-w6hrp"
Jul 06 02:47:45.582502 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.582376    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tst6v\" (UniqueName: \"kubernetes.io/projected/bef3c78f-d530-474d-ae3d-e50a6f3f0d9d-kube-api-access-tst6v\") pod \"istiod-openshift-gateway-7574459656-w6hrp\" (UID: \"bef3c78f-d530-474d-ae3d-e50a6f3f0d9d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-w6hrp"
Jul 06 02:47:45.582502 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.582411    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bef3c78f-d530-474d-ae3d-e50a6f3f0d9d-cacerts\") pod \"istiod-openshift-gateway-7574459656-w6hrp\" (UID: \"bef3c78f-d530-474d-ae3d-e50a6f3f0d9d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-w6hrp"
Jul 06 02:47:45.582502 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.582460    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bef3c78f-d530-474d-ae3d-e50a6f3f0d9d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-w6hrp\" (UID: \"bef3c78f-d530-474d-ae3d-e50a6f3f0d9d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-w6hrp"
Jul 06 02:47:45.582716 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.582596    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bef3c78f-d530-474d-ae3d-e50a6f3f0d9d-istio-token\") pod \"istiod-openshift-gateway-7574459656-w6hrp\" (UID: \"bef3c78f-d530-474d-ae3d-e50a6f3f0d9d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-w6hrp"
Jul 06 02:47:45.598633 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.598526    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:47:45.683798 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.683760    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bef3c78f-d530-474d-ae3d-e50a6f3f0d9d-istio-token\") pod \"istiod-openshift-gateway-7574459656-w6hrp\" (UID: \"bef3c78f-d530-474d-ae3d-e50a6f3f0d9d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-w6hrp"
Jul 06 02:47:45.684005 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.683827    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bef3c78f-d530-474d-ae3d-e50a6f3f0d9d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-w6hrp\" (UID: \"bef3c78f-d530-474d-ae3d-e50a6f3f0d9d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-w6hrp"
Jul 06 02:47:45.684005 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.683858    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bef3c78f-d530-474d-ae3d-e50a6f3f0d9d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-w6hrp\" (UID: \"bef3c78f-d530-474d-ae3d-e50a6f3f0d9d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-w6hrp"
Jul 06 02:47:45.684141 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.684091    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bef3c78f-d530-474d-ae3d-e50a6f3f0d9d-local-certs\") pod \"istiod-openshift-gateway-7574459656-w6hrp\" (UID: \"bef3c78f-d530-474d-ae3d-e50a6f3f0d9d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-w6hrp"
Jul 06 02:47:45.684204 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.684141    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tst6v\" (UniqueName: \"kubernetes.io/projected/bef3c78f-d530-474d-ae3d-e50a6f3f0d9d-kube-api-access-tst6v\") pod \"istiod-openshift-gateway-7574459656-w6hrp\" (UID: \"bef3c78f-d530-474d-ae3d-e50a6f3f0d9d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-w6hrp"
Jul 06 02:47:45.684204 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.684180    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bef3c78f-d530-474d-ae3d-e50a6f3f0d9d-cacerts\") pod \"istiod-openshift-gateway-7574459656-w6hrp\" (UID: \"bef3c78f-d530-474d-ae3d-e50a6f3f0d9d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-w6hrp"
Jul 06 02:47:45.684300 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.684215    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bef3c78f-d530-474d-ae3d-e50a6f3f0d9d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-w6hrp\" (UID: \"bef3c78f-d530-474d-ae3d-e50a6f3f0d9d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-w6hrp"
Jul 06 02:47:45.684673 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.684605    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bef3c78f-d530-474d-ae3d-e50a6f3f0d9d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-w6hrp\" (UID: \"bef3c78f-d530-474d-ae3d-e50a6f3f0d9d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-w6hrp"
Jul 06 02:47:45.686563 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.686534    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bef3c78f-d530-474d-ae3d-e50a6f3f0d9d-local-certs\") pod \"istiod-openshift-gateway-7574459656-w6hrp\" (UID: \"bef3c78f-d530-474d-ae3d-e50a6f3f0d9d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-w6hrp"
Jul 06 02:47:45.686926 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.686884    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bef3c78f-d530-474d-ae3d-e50a6f3f0d9d-cacerts\") pod \"istiod-openshift-gateway-7574459656-w6hrp\" (UID: \"bef3c78f-d530-474d-ae3d-e50a6f3f0d9d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-w6hrp"
Jul 06 02:47:45.687179 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.687152    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bef3c78f-d530-474d-ae3d-e50a6f3f0d9d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-w6hrp\" (UID: \"bef3c78f-d530-474d-ae3d-e50a6f3f0d9d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-w6hrp"
Jul 06 02:47:45.687396 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.687373    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bef3c78f-d530-474d-ae3d-e50a6f3f0d9d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-w6hrp\" (UID: \"bef3c78f-d530-474d-ae3d-e50a6f3f0d9d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-w6hrp"
Jul 06 02:47:45.692678 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.692654    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bef3c78f-d530-474d-ae3d-e50a6f3f0d9d-istio-token\") pod \"istiod-openshift-gateway-7574459656-w6hrp\" (UID: \"bef3c78f-d530-474d-ae3d-e50a6f3f0d9d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-w6hrp"
Jul 06 02:47:45.692777 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.692725    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tst6v\" (UniqueName: \"kubernetes.io/projected/bef3c78f-d530-474d-ae3d-e50a6f3f0d9d-kube-api-access-tst6v\") pod \"istiod-openshift-gateway-7574459656-w6hrp\" (UID: \"bef3c78f-d530-474d-ae3d-e50a6f3f0d9d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-w6hrp"
Jul 06 02:47:45.725150 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.725016    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-rzfdj"]
Jul 06 02:47:45.727705 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:47:45.727673    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae0ba419_7a62_4c61_be5d_d9cc58d11a53.slice/crio-00bc25e96dc632d2386ee26472433594943546ce7f2668c70825fbea30c1a8be WatchSource:0}: Error finding container 00bc25e96dc632d2386ee26472433594943546ce7f2668c70825fbea30c1a8be: Status 404 returned error can't find the container with id 00bc25e96dc632d2386ee26472433594943546ce7f2668c70825fbea30c1a8be
Jul 06 02:47:45.795204 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.795169    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-w6hrp"
Jul 06 02:47:45.963945 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:45.963909    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-w6hrp"]
Jul 06 02:47:45.972299 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:47:45.972264    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbef3c78f_d530_474d_ae3d_e50a6f3f0d9d.slice/crio-f8ac46836e8c0f111da570d3616026c6400319ce6f79ab4079113960e4bbc985 WatchSource:0}: Error finding container f8ac46836e8c0f111da570d3616026c6400319ce6f79ab4079113960e4bbc985: Status 404 returned error can't find the container with id f8ac46836e8c0f111da570d3616026c6400319ce6f79ab4079113960e4bbc985
Jul 06 02:47:46.100401 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:46.100359    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-w6hrp" event={"ID":"bef3c78f-d530-474d-ae3d-e50a6f3f0d9d","Type":"ContainerStarted","Data":"f8ac46836e8c0f111da570d3616026c6400319ce6f79ab4079113960e4bbc985"}
Jul 06 02:47:46.101873 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:46.101833    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-f7wpp" event={"ID":"d45c798c-f620-40d9-8493-d04e15f091f4","Type":"ContainerStarted","Data":"6b8c2ea4b3a74ea1687d9fa04c04a17c9f2565638a0d350c0a2aa75595c735cf"}
Jul 06 02:47:46.103404 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:46.103374    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-rzfdj" event={"ID":"ae0ba419-7a62-4c61-be5d-d9cc58d11a53","Type":"ContainerStarted","Data":"00bc25e96dc632d2386ee26472433594943546ce7f2668c70825fbea30c1a8be"}
Jul 06 02:47:46.498014 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:46.497958    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:47:50.610955 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:50.610922    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 02:47:50.611350 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:50.610998    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 02:47:51.136552 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:51.136514    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-rzfdj" event={"ID":"ae0ba419-7a62-4c61-be5d-d9cc58d11a53","Type":"ContainerStarted","Data":"f46ebc046c7b886149cb58763c62121f1e0eafec772319414173e079d8a633bb"}
Jul 06 02:47:51.136737 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:51.136582    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-rzfdj"
Jul 06 02:47:51.138331 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:51.138296    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-w6hrp" event={"ID":"bef3c78f-d530-474d-ae3d-e50a6f3f0d9d","Type":"ContainerStarted","Data":"41cf092e1f8b28bf8a2e5ef9fb9ea2c707272cb65a52ac02958c02f1de2f144e"}
Jul 06 02:47:51.138463 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:51.138353    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-w6hrp"
Jul 06 02:47:51.140167 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:51.140111    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-f7wpp" event={"ID":"d45c798c-f620-40d9-8493-d04e15f091f4","Type":"ContainerStarted","Data":"644b03e1c1fe4567b8c67c2884da61cdee5df6e5d33b44a0282e31b4dd22e72e"}
Jul 06 02:47:51.140293 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:51.140256    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-f7wpp"
Jul 06 02:47:51.140629 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:51.140604    2570 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-w6hrp container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 02:47:51.140729 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:51.140658    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-w6hrp" podUID="bef3c78f-d530-474d-ae3d-e50a6f3f0d9d" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 02:47:51.141794 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:51.141773    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59cc9f6b7-lrl7m" event={"ID":"4e2803f3-236a-4bbf-bcae-781da42167c4","Type":"ContainerStarted","Data":"9996cf1358a219b0777f81348b7d39ed0cb67ac592c6489e209c7195dd033d02"}
Jul 06 02:47:51.151591 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:51.151549    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-rzfdj" podStartSLOduration=1.284458611 podStartE2EDuration="6.151534847s" totalImagesPullingTime="4.867076236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:47:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:47:51.150410256 +0000 UTC m=+524.807419917" watchObservedRunningTime="2026-07-06 02:47:51.151534847 +0000 UTC m=+524.808544511"
Jul 06 02:47:51.166531 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:51.166479    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-59cc9f6b7-lrl7m" podStartSLOduration=1.2500040829999999 podStartE2EDuration="7.166461862s" totalImagesPullingTime="5.916457779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:47:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:47:51.166120368 +0000 UTC m=+524.823130032" watchObservedRunningTime="2026-07-06 02:47:51.166461862 +0000 UTC m=+524.823471527"
Jul 06 02:47:51.184880 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:51.184810    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-w6hrp" podStartSLOduration=1.548921218 podStartE2EDuration="6.18479176s" totalImagesPullingTime="4.635870542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:47:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:47:51.18451051 +0000 UTC m=+524.841520174" watchObservedRunningTime="2026-07-06 02:47:51.18479176 +0000 UTC m=+524.841801426"
Jul 06 02:47:51.198797 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:51.198749    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-f7wpp" podStartSLOduration=2.177510731 podStartE2EDuration="7.198730854s" totalImagesPullingTime="5.021220123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:47:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:47:51.198155609 +0000 UTC m=+524.855165274" watchObservedRunningTime="2026-07-06 02:47:51.198730854 +0000 UTC m=+524.855740518"
Jul 06 02:47:51.491927 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:51.491843    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:47:51.963268 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:51.963233    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:47:52.146891 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:52.146867    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-w6hrp"
Jul 06 02:47:52.172643 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:52.172609    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:47:52.511896 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:52.511858    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:47:54.085845 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:54.085808    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-56497ccf4b-fpr8t"]
Jul 06 02:47:54.089528 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:54.089505    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-56497ccf4b-fpr8t"
Jul 06 02:47:54.093188 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:54.093166    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 06 02:47:54.093284 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:54.093269    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 06 02:47:54.095029 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:54.094978    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 06 02:47:54.095194 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:54.095169    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 06 02:47:54.095282 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:54.095246    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-qpsm2\""
Jul 06 02:47:54.095358 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:54.095343    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 06 02:47:54.106056 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:54.106034    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-56497ccf4b-fpr8t"]
Jul 06 02:47:54.159124 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:54.159098    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5117eaba-0448-46e0-ae63-df33c2d13f94-cert\") pod \"lws-controller-manager-56497ccf4b-fpr8t\" (UID: \"5117eaba-0448-46e0-ae63-df33c2d13f94\") " pod="openshift-lws-operator/lws-controller-manager-56497ccf4b-fpr8t"
Jul 06 02:47:54.159272 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:54.159174    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5117eaba-0448-46e0-ae63-df33c2d13f94-metrics-cert\") pod \"lws-controller-manager-56497ccf4b-fpr8t\" (UID: \"5117eaba-0448-46e0-ae63-df33c2d13f94\") " pod="openshift-lws-operator/lws-controller-manager-56497ccf4b-fpr8t"
Jul 06 02:47:54.159272 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:54.159198    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5117eaba-0448-46e0-ae63-df33c2d13f94-manager-config\") pod \"lws-controller-manager-56497ccf4b-fpr8t\" (UID: \"5117eaba-0448-46e0-ae63-df33c2d13f94\") " pod="openshift-lws-operator/lws-controller-manager-56497ccf4b-fpr8t"
Jul 06 02:47:54.159272 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:54.159213    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cnxw\" (UniqueName: \"kubernetes.io/projected/5117eaba-0448-46e0-ae63-df33c2d13f94-kube-api-access-4cnxw\") pod \"lws-controller-manager-56497ccf4b-fpr8t\" (UID: \"5117eaba-0448-46e0-ae63-df33c2d13f94\") " pod="openshift-lws-operator/lws-controller-manager-56497ccf4b-fpr8t"
Jul 06 02:47:54.260277 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:54.260243    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5117eaba-0448-46e0-ae63-df33c2d13f94-cert\") pod \"lws-controller-manager-56497ccf4b-fpr8t\" (UID: \"5117eaba-0448-46e0-ae63-df33c2d13f94\") " pod="openshift-lws-operator/lws-controller-manager-56497ccf4b-fpr8t"
Jul 06 02:47:54.260441 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:54.260307    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5117eaba-0448-46e0-ae63-df33c2d13f94-metrics-cert\") pod \"lws-controller-manager-56497ccf4b-fpr8t\" (UID: \"5117eaba-0448-46e0-ae63-df33c2d13f94\") " pod="openshift-lws-operator/lws-controller-manager-56497ccf4b-fpr8t"
Jul 06 02:47:54.260441 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:54.260399    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5117eaba-0448-46e0-ae63-df33c2d13f94-manager-config\") pod \"lws-controller-manager-56497ccf4b-fpr8t\" (UID: \"5117eaba-0448-46e0-ae63-df33c2d13f94\") " pod="openshift-lws-operator/lws-controller-manager-56497ccf4b-fpr8t"
Jul 06 02:47:54.260441 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:54.260417    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cnxw\" (UniqueName: \"kubernetes.io/projected/5117eaba-0448-46e0-ae63-df33c2d13f94-kube-api-access-4cnxw\") pod \"lws-controller-manager-56497ccf4b-fpr8t\" (UID: \"5117eaba-0448-46e0-ae63-df33c2d13f94\") " pod="openshift-lws-operator/lws-controller-manager-56497ccf4b-fpr8t"
Jul 06 02:47:54.261078 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:54.261058    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5117eaba-0448-46e0-ae63-df33c2d13f94-manager-config\") pod \"lws-controller-manager-56497ccf4b-fpr8t\" (UID: \"5117eaba-0448-46e0-ae63-df33c2d13f94\") " pod="openshift-lws-operator/lws-controller-manager-56497ccf4b-fpr8t"
Jul 06 02:47:54.262762 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:54.262732    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5117eaba-0448-46e0-ae63-df33c2d13f94-cert\") pod \"lws-controller-manager-56497ccf4b-fpr8t\" (UID: \"5117eaba-0448-46e0-ae63-df33c2d13f94\") " pod="openshift-lws-operator/lws-controller-manager-56497ccf4b-fpr8t"
Jul 06 02:47:54.262854 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:54.262800    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5117eaba-0448-46e0-ae63-df33c2d13f94-metrics-cert\") pod \"lws-controller-manager-56497ccf4b-fpr8t\" (UID: \"5117eaba-0448-46e0-ae63-df33c2d13f94\") " pod="openshift-lws-operator/lws-controller-manager-56497ccf4b-fpr8t"
Jul 06 02:47:54.270360 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:54.270338    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cnxw\" (UniqueName: \"kubernetes.io/projected/5117eaba-0448-46e0-ae63-df33c2d13f94-kube-api-access-4cnxw\") pod \"lws-controller-manager-56497ccf4b-fpr8t\" (UID: \"5117eaba-0448-46e0-ae63-df33c2d13f94\") " pod="openshift-lws-operator/lws-controller-manager-56497ccf4b-fpr8t"
Jul 06 02:47:54.399402 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:54.399327    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-56497ccf4b-fpr8t"
Jul 06 02:47:54.529405 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:54.529312    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-56497ccf4b-fpr8t"]
Jul 06 02:47:54.531625 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:47:54.531598    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5117eaba_0448_46e0_ae63_df33c2d13f94.slice/crio-decd77e07fc922d742f5b8462a8ebd801029f6529c812a0b4519bd8d408d3047 WatchSource:0}: Error finding container decd77e07fc922d742f5b8462a8ebd801029f6529c812a0b4519bd8d408d3047: Status 404 returned error can't find the container with id decd77e07fc922d742f5b8462a8ebd801029f6529c812a0b4519bd8d408d3047
Jul 06 02:47:55.160593 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:55.160557    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-56497ccf4b-fpr8t" event={"ID":"5117eaba-0448-46e0-ae63-df33c2d13f94","Type":"ContainerStarted","Data":"decd77e07fc922d742f5b8462a8ebd801029f6529c812a0b4519bd8d408d3047"}
Jul 06 02:47:55.713175 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:55.713139    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:47:55.806605 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:55.806570    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:47:55.955961 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:55.955920    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:47:56.147811 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:56.147770    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:47:57.056384 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:57.056338    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:47:57.143171 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:57.143134    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:47:58.176610 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:58.176577    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-56497ccf4b-fpr8t" event={"ID":"5117eaba-0448-46e0-ae63-df33c2d13f94","Type":"ContainerStarted","Data":"7b78109ee3d3c2e626018be8e66bae90e46fcb817590c0c98120d0615f6371ef"}
Jul 06 02:47:58.176923 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:58.176666    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-56497ccf4b-fpr8t"
Jul 06 02:47:58.194879 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:47:58.194833    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-56497ccf4b-fpr8t" podStartSLOduration=0.693603885 podStartE2EDuration="4.194822738s" totalImagesPullingTime="3.501218853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:47:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:47:58.193966717 +0000 UTC m=+531.850976392" watchObservedRunningTime="2026-07-06 02:47:58.194822738 +0000 UTC m=+531.851832401"
Jul 06 02:48:01.239260 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:01.239165    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-w6hrp"]
Jul 06 02:48:01.239696 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:01.239485    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-w6hrp" podUID="bef3c78f-d530-474d-ae3d-e50a6f3f0d9d" containerName="discovery" containerID="cri-o://41cf092e1f8b28bf8a2e5ef9fb9ea2c707272cb65a52ac02958c02f1de2f144e" gracePeriod=30
Jul 06 02:48:01.499597 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:01.499539    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-w6hrp"
Jul 06 02:48:01.622935 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:01.622895    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tst6v\" (UniqueName: \"kubernetes.io/projected/bef3c78f-d530-474d-ae3d-e50a6f3f0d9d-kube-api-access-tst6v\") pod \"bef3c78f-d530-474d-ae3d-e50a6f3f0d9d\" (UID: \"bef3c78f-d530-474d-ae3d-e50a6f3f0d9d\") "
Jul 06 02:48:01.622935 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:01.622944    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bef3c78f-d530-474d-ae3d-e50a6f3f0d9d-istio-token\") pod \"bef3c78f-d530-474d-ae3d-e50a6f3f0d9d\" (UID: \"bef3c78f-d530-474d-ae3d-e50a6f3f0d9d\") "
Jul 06 02:48:01.623148 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:01.622971    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bef3c78f-d530-474d-ae3d-e50a6f3f0d9d-istio-kubeconfig\") pod \"bef3c78f-d530-474d-ae3d-e50a6f3f0d9d\" (UID: \"bef3c78f-d530-474d-ae3d-e50a6f3f0d9d\") "
Jul 06 02:48:01.623148 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:01.623071    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bef3c78f-d530-474d-ae3d-e50a6f3f0d9d-local-certs\") pod \"bef3c78f-d530-474d-ae3d-e50a6f3f0d9d\" (UID: \"bef3c78f-d530-474d-ae3d-e50a6f3f0d9d\") "
Jul 06 02:48:01.623148 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:01.623092    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bef3c78f-d530-474d-ae3d-e50a6f3f0d9d-cacerts\") pod \"bef3c78f-d530-474d-ae3d-e50a6f3f0d9d\" (UID: \"bef3c78f-d530-474d-ae3d-e50a6f3f0d9d\") "
Jul 06 02:48:01.623148 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:01.623109    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bef3c78f-d530-474d-ae3d-e50a6f3f0d9d-istio-csr-ca-configmap\") pod \"bef3c78f-d530-474d-ae3d-e50a6f3f0d9d\" (UID: \"bef3c78f-d530-474d-ae3d-e50a6f3f0d9d\") "
Jul 06 02:48:01.623148 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:01.623139    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bef3c78f-d530-474d-ae3d-e50a6f3f0d9d-istio-csr-dns-cert\") pod \"bef3c78f-d530-474d-ae3d-e50a6f3f0d9d\" (UID: \"bef3c78f-d530-474d-ae3d-e50a6f3f0d9d\") "
Jul 06 02:48:01.623599 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:01.623561    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bef3c78f-d530-474d-ae3d-e50a6f3f0d9d-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "bef3c78f-d530-474d-ae3d-e50a6f3f0d9d" (UID: "bef3c78f-d530-474d-ae3d-e50a6f3f0d9d"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 02:48:01.625460 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:01.625428    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bef3c78f-d530-474d-ae3d-e50a6f3f0d9d-kube-api-access-tst6v" (OuterVolumeSpecName: "kube-api-access-tst6v") pod "bef3c78f-d530-474d-ae3d-e50a6f3f0d9d" (UID: "bef3c78f-d530-474d-ae3d-e50a6f3f0d9d"). InnerVolumeSpecName "kube-api-access-tst6v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 02:48:01.625570 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:01.625482    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bef3c78f-d530-474d-ae3d-e50a6f3f0d9d-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "bef3c78f-d530-474d-ae3d-e50a6f3f0d9d" (UID: "bef3c78f-d530-474d-ae3d-e50a6f3f0d9d"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 02:48:01.625652 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:01.625574    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bef3c78f-d530-474d-ae3d-e50a6f3f0d9d-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "bef3c78f-d530-474d-ae3d-e50a6f3f0d9d" (UID: "bef3c78f-d530-474d-ae3d-e50a6f3f0d9d"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 02:48:01.625652 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:01.625640    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bef3c78f-d530-474d-ae3d-e50a6f3f0d9d-cacerts" (OuterVolumeSpecName: "cacerts") pod "bef3c78f-d530-474d-ae3d-e50a6f3f0d9d" (UID: "bef3c78f-d530-474d-ae3d-e50a6f3f0d9d"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 02:48:01.625732 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:01.625667    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bef3c78f-d530-474d-ae3d-e50a6f3f0d9d-istio-token" (OuterVolumeSpecName: "istio-token") pod "bef3c78f-d530-474d-ae3d-e50a6f3f0d9d" (UID: "bef3c78f-d530-474d-ae3d-e50a6f3f0d9d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 02:48:01.625926 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:01.625910    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bef3c78f-d530-474d-ae3d-e50a6f3f0d9d-local-certs" (OuterVolumeSpecName: "local-certs") pod "bef3c78f-d530-474d-ae3d-e50a6f3f0d9d" (UID: "bef3c78f-d530-474d-ae3d-e50a6f3f0d9d"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 02:48:01.724139 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:01.724094    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tst6v\" (UniqueName: \"kubernetes.io/projected/bef3c78f-d530-474d-ae3d-e50a6f3f0d9d-kube-api-access-tst6v\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:48:01.724139 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:01.724133    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bef3c78f-d530-474d-ae3d-e50a6f3f0d9d-istio-token\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:48:01.724139 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:01.724146    2570 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bef3c78f-d530-474d-ae3d-e50a6f3f0d9d-istio-kubeconfig\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:48:01.724398 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:01.724159    2570 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bef3c78f-d530-474d-ae3d-e50a6f3f0d9d-local-certs\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:48:01.724398 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:01.724174    2570 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bef3c78f-d530-474d-ae3d-e50a6f3f0d9d-cacerts\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:48:01.724398 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:01.724185    2570 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bef3c78f-d530-474d-ae3d-e50a6f3f0d9d-istio-csr-ca-configmap\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:48:01.724398 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:01.724197    2570 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bef3c78f-d530-474d-ae3d-e50a6f3f0d9d-istio-csr-dns-cert\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:48:02.149089 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:02.149057    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-f7wpp"
Jul 06 02:48:02.151897 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:02.151875    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-rzfdj"
Jul 06 02:48:02.198249 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:02.198213    2570 generic.go:356] "Generic (PLEG): container finished" podID="bef3c78f-d530-474d-ae3d-e50a6f3f0d9d" containerID="41cf092e1f8b28bf8a2e5ef9fb9ea2c707272cb65a52ac02958c02f1de2f144e" exitCode=0
Jul 06 02:48:02.198396 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:02.198346    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-w6hrp" event={"ID":"bef3c78f-d530-474d-ae3d-e50a6f3f0d9d","Type":"ContainerDied","Data":"41cf092e1f8b28bf8a2e5ef9fb9ea2c707272cb65a52ac02958c02f1de2f144e"}
Jul 06 02:48:02.198396 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:02.198387    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-w6hrp" event={"ID":"bef3c78f-d530-474d-ae3d-e50a6f3f0d9d","Type":"ContainerDied","Data":"f8ac46836e8c0f111da570d3616026c6400319ce6f79ab4079113960e4bbc985"}
Jul 06 02:48:02.198522 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:02.198415    2570 scope.go:117] "RemoveContainer" containerID="41cf092e1f8b28bf8a2e5ef9fb9ea2c707272cb65a52ac02958c02f1de2f144e"
Jul 06 02:48:02.198594 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:02.198570    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-w6hrp"
Jul 06 02:48:02.209400 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:02.209367    2570 scope.go:117] "RemoveContainer" containerID="41cf092e1f8b28bf8a2e5ef9fb9ea2c707272cb65a52ac02958c02f1de2f144e"
Jul 06 02:48:02.209711 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:48:02.209689    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41cf092e1f8b28bf8a2e5ef9fb9ea2c707272cb65a52ac02958c02f1de2f144e\": container with ID starting with 41cf092e1f8b28bf8a2e5ef9fb9ea2c707272cb65a52ac02958c02f1de2f144e not found: ID does not exist" containerID="41cf092e1f8b28bf8a2e5ef9fb9ea2c707272cb65a52ac02958c02f1de2f144e"
Jul 06 02:48:02.209809 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:02.209716    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41cf092e1f8b28bf8a2e5ef9fb9ea2c707272cb65a52ac02958c02f1de2f144e"} err="failed to get container status \"41cf092e1f8b28bf8a2e5ef9fb9ea2c707272cb65a52ac02958c02f1de2f144e\": rpc error: code = NotFound desc = could not find container \"41cf092e1f8b28bf8a2e5ef9fb9ea2c707272cb65a52ac02958c02f1de2f144e\": container with ID starting with 41cf092e1f8b28bf8a2e5ef9fb9ea2c707272cb65a52ac02958c02f1de2f144e not found: ID does not exist"
Jul 06 02:48:02.231071 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:02.231043    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-w6hrp"]
Jul 06 02:48:02.232661 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:02.232641    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-w6hrp"]
Jul 06 02:48:03.232147 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:03.232113    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bef3c78f-d530-474d-ae3d-e50a6f3f0d9d" path="/var/lib/kubelet/pods/bef3c78f-d530-474d-ae3d-e50a6f3f0d9d/volumes"
Jul 06 02:48:09.183549 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:09.183516    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-56497ccf4b-fpr8t"
Jul 06 02:48:09.869126 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:09.869090    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:48:09.918757 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:09.918726    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:48:11.721967 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:11.721914    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:48:11.769286 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:11.769258    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:48:26.977448 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:26.977408    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:48:27.026474 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:27.026447    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:48:45.300094 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:45.300054    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:48:46.437485 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:46.437448    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:48:46.537588 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:46.537556    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:48:57.139287 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:48:57.139236    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:49:01.044406 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:01.044365    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmn48"]
Jul 06 02:49:01.044966 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:01.044884    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bef3c78f-d530-474d-ae3d-e50a6f3f0d9d" containerName="discovery"
Jul 06 02:49:01.044966 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:01.044904    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="bef3c78f-d530-474d-ae3d-e50a6f3f0d9d" containerName="discovery"
Jul 06 02:49:01.045141 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:01.045009    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="bef3c78f-d530-474d-ae3d-e50a6f3f0d9d" containerName="discovery"
Jul 06 02:49:01.047298 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:01.047275    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmn48"
Jul 06 02:49:01.049604 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:01.049582    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-fszpk\""
Jul 06 02:49:01.049685 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:01.049623    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 02:49:01.050495 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:01.050475    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 02:49:01.055688 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:01.055665    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmn48"]
Jul 06 02:49:01.184855 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:01.184828    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ct26\" (UniqueName: \"kubernetes.io/projected/d57735f2-4f30-474d-8f7f-5363b27e3666-kube-api-access-4ct26\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmn48\" (UID: \"d57735f2-4f30-474d-8f7f-5363b27e3666\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmn48"
Jul 06 02:49:01.185003 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:01.184874    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d57735f2-4f30-474d-8f7f-5363b27e3666-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmn48\" (UID: \"d57735f2-4f30-474d-8f7f-5363b27e3666\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmn48"
Jul 06 02:49:01.185003 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:01.184903    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d57735f2-4f30-474d-8f7f-5363b27e3666-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmn48\" (UID: \"d57735f2-4f30-474d-8f7f-5363b27e3666\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmn48"
Jul 06 02:49:01.285803 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:01.285772    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ct26\" (UniqueName: \"kubernetes.io/projected/d57735f2-4f30-474d-8f7f-5363b27e3666-kube-api-access-4ct26\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmn48\" (UID: \"d57735f2-4f30-474d-8f7f-5363b27e3666\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmn48"
Jul 06 02:49:01.285930 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:01.285817    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d57735f2-4f30-474d-8f7f-5363b27e3666-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmn48\" (UID: \"d57735f2-4f30-474d-8f7f-5363b27e3666\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmn48"
Jul 06 02:49:01.285930 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:01.285861    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d57735f2-4f30-474d-8f7f-5363b27e3666-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmn48\" (UID: \"d57735f2-4f30-474d-8f7f-5363b27e3666\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmn48"
Jul 06 02:49:01.286204 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:01.286184    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d57735f2-4f30-474d-8f7f-5363b27e3666-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmn48\" (UID: \"d57735f2-4f30-474d-8f7f-5363b27e3666\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmn48"
Jul 06 02:49:01.286270 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:01.286254    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d57735f2-4f30-474d-8f7f-5363b27e3666-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmn48\" (UID: \"d57735f2-4f30-474d-8f7f-5363b27e3666\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmn48"
Jul 06 02:49:01.293416 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:01.293395    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ct26\" (UniqueName: \"kubernetes.io/projected/d57735f2-4f30-474d-8f7f-5363b27e3666-kube-api-access-4ct26\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmn48\" (UID: \"d57735f2-4f30-474d-8f7f-5363b27e3666\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmn48"
Jul 06 02:49:01.357391 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:01.357320    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmn48"
Jul 06 02:49:01.444931 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:01.444874    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mwm84"]
Jul 06 02:49:01.447529 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:01.447506    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mwm84"
Jul 06 02:49:01.456263 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:01.456222    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mwm84"]
Jul 06 02:49:01.487518 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:01.487487    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8521d6f9-91c0-4231-ac5c-90517bf722aa-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mwm84\" (UID: \"8521d6f9-91c0-4231-ac5c-90517bf722aa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mwm84"
Jul 06 02:49:01.487698 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:01.487558    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8521d6f9-91c0-4231-ac5c-90517bf722aa-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mwm84\" (UID: \"8521d6f9-91c0-4231-ac5c-90517bf722aa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mwm84"
Jul 06 02:49:01.487698 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:01.487681    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsvnm\" (UniqueName: \"kubernetes.io/projected/8521d6f9-91c0-4231-ac5c-90517bf722aa-kube-api-access-fsvnm\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mwm84\" (UID: \"8521d6f9-91c0-4231-ac5c-90517bf722aa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mwm84"
Jul 06 02:49:01.489962 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:01.489844    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmn48"]
Jul 06 02:49:01.492191 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:49:01.492169    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd57735f2_4f30_474d_8f7f_5363b27e3666.slice/crio-46e1114cfeaa7be6d7ab511f9b683d916983e1d69b9b45cb754166a15ac1bf9c WatchSource:0}: Error finding container 46e1114cfeaa7be6d7ab511f9b683d916983e1d69b9b45cb754166a15ac1bf9c: Status 404 returned error can't find the container with id 46e1114cfeaa7be6d7ab511f9b683d916983e1d69b9b45cb754166a15ac1bf9c
Jul 06 02:49:01.588855 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:01.588820    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsvnm\" (UniqueName: \"kubernetes.io/projected/8521d6f9-91c0-4231-ac5c-90517bf722aa-kube-api-access-fsvnm\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mwm84\" (UID: \"8521d6f9-91c0-4231-ac5c-90517bf722aa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mwm84"
Jul 06 02:49:01.589140 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:01.588874    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8521d6f9-91c0-4231-ac5c-90517bf722aa-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mwm84\" (UID: \"8521d6f9-91c0-4231-ac5c-90517bf722aa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mwm84"
Jul 06 02:49:01.589140 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:01.588909    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8521d6f9-91c0-4231-ac5c-90517bf722aa-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mwm84\" (UID: \"8521d6f9-91c0-4231-ac5c-90517bf722aa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mwm84"
Jul 06 02:49:01.589285 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:01.589256    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8521d6f9-91c0-4231-ac5c-90517bf722aa-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mwm84\" (UID: \"8521d6f9-91c0-4231-ac5c-90517bf722aa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mwm84"
Jul 06 02:49:01.589343 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:01.589279    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8521d6f9-91c0-4231-ac5c-90517bf722aa-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mwm84\" (UID: \"8521d6f9-91c0-4231-ac5c-90517bf722aa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mwm84"
Jul 06 02:49:01.597047 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:01.597020    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsvnm\" (UniqueName: \"kubernetes.io/projected/8521d6f9-91c0-4231-ac5c-90517bf722aa-kube-api-access-fsvnm\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mwm84\" (UID: \"8521d6f9-91c0-4231-ac5c-90517bf722aa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mwm84"
Jul 06 02:49:01.760777 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:01.760694    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mwm84"
Jul 06 02:49:01.844861 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:01.844820    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9v"]
Jul 06 02:49:01.851118 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:01.851097    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9v"
Jul 06 02:49:01.859897 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:01.859869    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9v"]
Jul 06 02:49:01.891440 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:01.891407    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19af652d-1b5b-403b-bf72-1d4124ecc11a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9v\" (UID: \"19af652d-1b5b-403b-bf72-1d4124ecc11a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9v"
Jul 06 02:49:01.891658 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:01.891473    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19af652d-1b5b-403b-bf72-1d4124ecc11a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9v\" (UID: \"19af652d-1b5b-403b-bf72-1d4124ecc11a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9v"
Jul 06 02:49:01.891658 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:01.891533    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p696s\" (UniqueName: \"kubernetes.io/projected/19af652d-1b5b-403b-bf72-1d4124ecc11a-kube-api-access-p696s\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9v\" (UID: \"19af652d-1b5b-403b-bf72-1d4124ecc11a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9v"
Jul 06 02:49:01.892574 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:01.892550    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mwm84"]
Jul 06 02:49:01.894460 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:49:01.894432    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8521d6f9_91c0_4231_ac5c_90517bf722aa.slice/crio-ab5c8ac3896439e5212df41962cc3c08abd6dfb0bbebb4e93f66254d4706481c WatchSource:0}: Error finding container ab5c8ac3896439e5212df41962cc3c08abd6dfb0bbebb4e93f66254d4706481c: Status 404 returned error can't find the container with id ab5c8ac3896439e5212df41962cc3c08abd6dfb0bbebb4e93f66254d4706481c
Jul 06 02:49:01.992638 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:01.992610    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19af652d-1b5b-403b-bf72-1d4124ecc11a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9v\" (UID: \"19af652d-1b5b-403b-bf72-1d4124ecc11a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9v"
Jul 06 02:49:01.992749 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:01.992682    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p696s\" (UniqueName: \"kubernetes.io/projected/19af652d-1b5b-403b-bf72-1d4124ecc11a-kube-api-access-p696s\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9v\" (UID: \"19af652d-1b5b-403b-bf72-1d4124ecc11a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9v"
Jul 06 02:49:01.992749 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:01.992712    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19af652d-1b5b-403b-bf72-1d4124ecc11a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9v\" (UID: \"19af652d-1b5b-403b-bf72-1d4124ecc11a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9v"
Jul 06 02:49:01.992961 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:01.992942    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19af652d-1b5b-403b-bf72-1d4124ecc11a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9v\" (UID: \"19af652d-1b5b-403b-bf72-1d4124ecc11a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9v"
Jul 06 02:49:01.993070 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:01.993051    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19af652d-1b5b-403b-bf72-1d4124ecc11a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9v\" (UID: \"19af652d-1b5b-403b-bf72-1d4124ecc11a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9v"
Jul 06 02:49:02.001294 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:02.001274    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p696s\" (UniqueName: \"kubernetes.io/projected/19af652d-1b5b-403b-bf72-1d4124ecc11a-kube-api-access-p696s\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9v\" (UID: \"19af652d-1b5b-403b-bf72-1d4124ecc11a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9v"
Jul 06 02:49:02.162078 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:02.162053    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9v"
Jul 06 02:49:02.245108 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:02.245079    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nt69q"]
Jul 06 02:49:02.248074 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:02.248052    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nt69q"
Jul 06 02:49:02.257766 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:02.257733    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nt69q"]
Jul 06 02:49:02.294952 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:02.294916    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51b453cd-788d-4a11-9b0f-984e0df62b55-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nt69q\" (UID: \"51b453cd-788d-4a11-9b0f-984e0df62b55\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nt69q"
Jul 06 02:49:02.295118 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:02.295031    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj428\" (UniqueName: \"kubernetes.io/projected/51b453cd-788d-4a11-9b0f-984e0df62b55-kube-api-access-bj428\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nt69q\" (UID: \"51b453cd-788d-4a11-9b0f-984e0df62b55\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nt69q"
Jul 06 02:49:02.295118 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:02.295097    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51b453cd-788d-4a11-9b0f-984e0df62b55-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nt69q\" (UID: \"51b453cd-788d-4a11-9b0f-984e0df62b55\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nt69q"
Jul 06 02:49:02.296398 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:02.296375    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9v"]
Jul 06 02:49:02.298006 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:49:02.297952    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19af652d_1b5b_403b_bf72_1d4124ecc11a.slice/crio-283b25078b0e2d5151a90ccf167ab53e6849cef23016bb6e2be256849d4f76f2 WatchSource:0}: Error finding container 283b25078b0e2d5151a90ccf167ab53e6849cef23016bb6e2be256849d4f76f2: Status 404 returned error can't find the container with id 283b25078b0e2d5151a90ccf167ab53e6849cef23016bb6e2be256849d4f76f2
Jul 06 02:49:02.396366 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:02.396336    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51b453cd-788d-4a11-9b0f-984e0df62b55-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nt69q\" (UID: \"51b453cd-788d-4a11-9b0f-984e0df62b55\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nt69q"
Jul 06 02:49:02.396499 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:02.396403    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51b453cd-788d-4a11-9b0f-984e0df62b55-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nt69q\" (UID: \"51b453cd-788d-4a11-9b0f-984e0df62b55\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nt69q"
Jul 06 02:49:02.396499 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:02.396459    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bj428\" (UniqueName: \"kubernetes.io/projected/51b453cd-788d-4a11-9b0f-984e0df62b55-kube-api-access-bj428\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nt69q\" (UID: \"51b453cd-788d-4a11-9b0f-984e0df62b55\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nt69q"
Jul 06 02:49:02.396781 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:02.396760    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51b453cd-788d-4a11-9b0f-984e0df62b55-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nt69q\" (UID: \"51b453cd-788d-4a11-9b0f-984e0df62b55\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nt69q"
Jul 06 02:49:02.396863 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:02.396841    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51b453cd-788d-4a11-9b0f-984e0df62b55-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nt69q\" (UID: \"51b453cd-788d-4a11-9b0f-984e0df62b55\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nt69q"
Jul 06 02:49:02.403784 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:02.403758    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj428\" (UniqueName: \"kubernetes.io/projected/51b453cd-788d-4a11-9b0f-984e0df62b55-kube-api-access-bj428\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nt69q\" (UID: \"51b453cd-788d-4a11-9b0f-984e0df62b55\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nt69q"
Jul 06 02:49:02.474641 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:02.474574    2570 generic.go:356] "Generic (PLEG): container finished" podID="d57735f2-4f30-474d-8f7f-5363b27e3666" containerID="8623e8febbe4ef88f66ce0db3d50202e14e9e162c3d83fe0f5a1c7cd9fa3211f" exitCode=0
Jul 06 02:49:02.474739 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:02.474657    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmn48" event={"ID":"d57735f2-4f30-474d-8f7f-5363b27e3666","Type":"ContainerDied","Data":"8623e8febbe4ef88f66ce0db3d50202e14e9e162c3d83fe0f5a1c7cd9fa3211f"}
Jul 06 02:49:02.474739 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:02.474705    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmn48" event={"ID":"d57735f2-4f30-474d-8f7f-5363b27e3666","Type":"ContainerStarted","Data":"46e1114cfeaa7be6d7ab511f9b683d916983e1d69b9b45cb754166a15ac1bf9c"}
Jul 06 02:49:02.476290 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:02.476270    2570 generic.go:356] "Generic (PLEG): container finished" podID="19af652d-1b5b-403b-bf72-1d4124ecc11a" containerID="2b1f48b09ffd0789f9092b901b7ed8e8f8d83c3bd6db6e5d267f93c0b469ad82" exitCode=0
Jul 06 02:49:02.476380 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:02.476352    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9v" event={"ID":"19af652d-1b5b-403b-bf72-1d4124ecc11a","Type":"ContainerDied","Data":"2b1f48b09ffd0789f9092b901b7ed8e8f8d83c3bd6db6e5d267f93c0b469ad82"}
Jul 06 02:49:02.476431 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:02.476390    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9v" event={"ID":"19af652d-1b5b-403b-bf72-1d4124ecc11a","Type":"ContainerStarted","Data":"283b25078b0e2d5151a90ccf167ab53e6849cef23016bb6e2be256849d4f76f2"}
Jul 06 02:49:02.478117 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:02.477967    2570 generic.go:356] "Generic (PLEG): container finished" podID="8521d6f9-91c0-4231-ac5c-90517bf722aa" containerID="9cf813761a80ae6b87c75c47d60545fa11cc23c06c33ec6a3e503ef11aacd088" exitCode=0
Jul 06 02:49:02.478117 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:02.478021    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mwm84" event={"ID":"8521d6f9-91c0-4231-ac5c-90517bf722aa","Type":"ContainerDied","Data":"9cf813761a80ae6b87c75c47d60545fa11cc23c06c33ec6a3e503ef11aacd088"}
Jul 06 02:49:02.478117 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:02.478057    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mwm84" event={"ID":"8521d6f9-91c0-4231-ac5c-90517bf722aa","Type":"ContainerStarted","Data":"ab5c8ac3896439e5212df41962cc3c08abd6dfb0bbebb4e93f66254d4706481c"}
Jul 06 02:49:02.559796 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:02.559766    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nt69q"
Jul 06 02:49:02.690208 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:02.690179    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nt69q"]
Jul 06 02:49:02.692022 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:49:02.691974    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51b453cd_788d_4a11_9b0f_984e0df62b55.slice/crio-758a74c531b90fe1c81d41b08b589b73ba6e6f58fea4c96cfef816ce3be94846 WatchSource:0}: Error finding container 758a74c531b90fe1c81d41b08b589b73ba6e6f58fea4c96cfef816ce3be94846: Status 404 returned error can't find the container with id 758a74c531b90fe1c81d41b08b589b73ba6e6f58fea4c96cfef816ce3be94846
Jul 06 02:49:03.486759 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:03.486726    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9v" event={"ID":"19af652d-1b5b-403b-bf72-1d4124ecc11a","Type":"ContainerStarted","Data":"7de10f623e51f678d09f6483d48cd65cfeaf4adfb0bf95f0560ad7221f681557"}
Jul 06 02:49:03.488770 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:03.488585    2570 generic.go:356] "Generic (PLEG): container finished" podID="51b453cd-788d-4a11-9b0f-984e0df62b55" containerID="e9109ca5104a835ffca8258aec79c25c05eef4a3f43e1841d09d448e47a8beb3" exitCode=0
Jul 06 02:49:03.488770 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:03.488698    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nt69q" event={"ID":"51b453cd-788d-4a11-9b0f-984e0df62b55","Type":"ContainerDied","Data":"e9109ca5104a835ffca8258aec79c25c05eef4a3f43e1841d09d448e47a8beb3"}
Jul 06 02:49:03.488770 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:03.488728    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nt69q" event={"ID":"51b453cd-788d-4a11-9b0f-984e0df62b55","Type":"ContainerStarted","Data":"758a74c531b90fe1c81d41b08b589b73ba6e6f58fea4c96cfef816ce3be94846"}
Jul 06 02:49:03.491599 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:03.491549    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mwm84" event={"ID":"8521d6f9-91c0-4231-ac5c-90517bf722aa","Type":"ContainerStarted","Data":"6e29ecbc161a792f996a5374ed29936fb3735a2667118f55186b5325449421f6"}
Jul 06 02:49:03.493597 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:03.493572    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmn48" event={"ID":"d57735f2-4f30-474d-8f7f-5363b27e3666","Type":"ContainerStarted","Data":"934dc4efcce649d98a8d47644f057b02c8bb53a71d2be556c01cc4b012c06d80"}
Jul 06 02:49:04.505333 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:04.505244    2570 generic.go:356] "Generic (PLEG): container finished" podID="19af652d-1b5b-403b-bf72-1d4124ecc11a" containerID="7de10f623e51f678d09f6483d48cd65cfeaf4adfb0bf95f0560ad7221f681557" exitCode=0
Jul 06 02:49:04.505739 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:04.505332    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9v" event={"ID":"19af652d-1b5b-403b-bf72-1d4124ecc11a","Type":"ContainerDied","Data":"7de10f623e51f678d09f6483d48cd65cfeaf4adfb0bf95f0560ad7221f681557"}
Jul 06 02:49:04.507276 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:04.507256    2570 generic.go:356] "Generic (PLEG): container finished" podID="51b453cd-788d-4a11-9b0f-984e0df62b55" containerID="4b5cb9957404ea9de430b63ea8e56af6fe3bf45fbc70cb2d656f5ba174f0ae21" exitCode=0
Jul 06 02:49:04.507404 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:04.507376    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nt69q" event={"ID":"51b453cd-788d-4a11-9b0f-984e0df62b55","Type":"ContainerDied","Data":"4b5cb9957404ea9de430b63ea8e56af6fe3bf45fbc70cb2d656f5ba174f0ae21"}
Jul 06 02:49:04.509224 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:04.509202    2570 generic.go:356] "Generic (PLEG): container finished" podID="8521d6f9-91c0-4231-ac5c-90517bf722aa" containerID="6e29ecbc161a792f996a5374ed29936fb3735a2667118f55186b5325449421f6" exitCode=0
Jul 06 02:49:04.509313 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:04.509277    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mwm84" event={"ID":"8521d6f9-91c0-4231-ac5c-90517bf722aa","Type":"ContainerDied","Data":"6e29ecbc161a792f996a5374ed29936fb3735a2667118f55186b5325449421f6"}
Jul 06 02:49:04.511128 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:04.511109    2570 generic.go:356] "Generic (PLEG): container finished" podID="d57735f2-4f30-474d-8f7f-5363b27e3666" containerID="934dc4efcce649d98a8d47644f057b02c8bb53a71d2be556c01cc4b012c06d80" exitCode=0
Jul 06 02:49:04.511210 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:04.511139    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmn48" event={"ID":"d57735f2-4f30-474d-8f7f-5363b27e3666","Type":"ContainerDied","Data":"934dc4efcce649d98a8d47644f057b02c8bb53a71d2be556c01cc4b012c06d80"}
Jul 06 02:49:05.517588 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:05.517549    2570 generic.go:356] "Generic (PLEG): container finished" podID="d57735f2-4f30-474d-8f7f-5363b27e3666" containerID="e73cf07026fd57e622e84d0bf818bdd311a1fff0e3d6ad34cd54571903a9a19b" exitCode=0
Jul 06 02:49:05.518004 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:05.517631    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmn48" event={"ID":"d57735f2-4f30-474d-8f7f-5363b27e3666","Type":"ContainerDied","Data":"e73cf07026fd57e622e84d0bf818bdd311a1fff0e3d6ad34cd54571903a9a19b"}
Jul 06 02:49:05.519602 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:05.519582    2570 generic.go:356] "Generic (PLEG): container finished" podID="19af652d-1b5b-403b-bf72-1d4124ecc11a" containerID="22d7fdfe5081d11f44604220fc5bddba9fc6a3203808da5b61671d4cedac166d" exitCode=0
Jul 06 02:49:05.519700 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:05.519663    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9v" event={"ID":"19af652d-1b5b-403b-bf72-1d4124ecc11a","Type":"ContainerDied","Data":"22d7fdfe5081d11f44604220fc5bddba9fc6a3203808da5b61671d4cedac166d"}
Jul 06 02:49:05.521672 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:05.521652    2570 generic.go:356] "Generic (PLEG): container finished" podID="51b453cd-788d-4a11-9b0f-984e0df62b55" containerID="7b84a90355e392da24e308422841e9c7a1a6326086c6f9e4cbc5e94bc55b9609" exitCode=0
Jul 06 02:49:05.521796 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:05.521775    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nt69q" event={"ID":"51b453cd-788d-4a11-9b0f-984e0df62b55","Type":"ContainerDied","Data":"7b84a90355e392da24e308422841e9c7a1a6326086c6f9e4cbc5e94bc55b9609"}
Jul 06 02:49:05.523659 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:05.523640    2570 generic.go:356] "Generic (PLEG): container finished" podID="8521d6f9-91c0-4231-ac5c-90517bf722aa" containerID="e61f5e4d8b801a10698384ca4a1a25cc9cca6e69ae7ac1c60c52d83049c98ace" exitCode=0
Jul 06 02:49:05.523748 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:05.523669    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mwm84" event={"ID":"8521d6f9-91c0-4231-ac5c-90517bf722aa","Type":"ContainerDied","Data":"e61f5e4d8b801a10698384ca4a1a25cc9cca6e69ae7ac1c60c52d83049c98ace"}
Jul 06 02:49:06.721233 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:06.721207    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mwm84"
Jul 06 02:49:06.724877 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:06.724852    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nt69q"
Jul 06 02:49:06.731353 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:06.731335    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9v"
Jul 06 02:49:06.739601 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:06.739581    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmn48"
Jul 06 02:49:06.831889 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:06.831811    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p696s\" (UniqueName: \"kubernetes.io/projected/19af652d-1b5b-403b-bf72-1d4124ecc11a-kube-api-access-p696s\") pod \"19af652d-1b5b-403b-bf72-1d4124ecc11a\" (UID: \"19af652d-1b5b-403b-bf72-1d4124ecc11a\") "
Jul 06 02:49:06.831889 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:06.831857    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bj428\" (UniqueName: \"kubernetes.io/projected/51b453cd-788d-4a11-9b0f-984e0df62b55-kube-api-access-bj428\") pod \"51b453cd-788d-4a11-9b0f-984e0df62b55\" (UID: \"51b453cd-788d-4a11-9b0f-984e0df62b55\") "
Jul 06 02:49:06.831889 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:06.831882    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19af652d-1b5b-403b-bf72-1d4124ecc11a-bundle\") pod \"19af652d-1b5b-403b-bf72-1d4124ecc11a\" (UID: \"19af652d-1b5b-403b-bf72-1d4124ecc11a\") "
Jul 06 02:49:06.832188 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:06.831902    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8521d6f9-91c0-4231-ac5c-90517bf722aa-util\") pod \"8521d6f9-91c0-4231-ac5c-90517bf722aa\" (UID: \"8521d6f9-91c0-4231-ac5c-90517bf722aa\") "
Jul 06 02:49:06.832188 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:06.831944    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d57735f2-4f30-474d-8f7f-5363b27e3666-bundle\") pod \"d57735f2-4f30-474d-8f7f-5363b27e3666\" (UID: \"d57735f2-4f30-474d-8f7f-5363b27e3666\") "
Jul 06 02:49:06.832188 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:06.831971    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51b453cd-788d-4a11-9b0f-984e0df62b55-util\") pod \"51b453cd-788d-4a11-9b0f-984e0df62b55\" (UID: \"51b453cd-788d-4a11-9b0f-984e0df62b55\") "
Jul 06 02:49:06.832188 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:06.832020    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8521d6f9-91c0-4231-ac5c-90517bf722aa-bundle\") pod \"8521d6f9-91c0-4231-ac5c-90517bf722aa\" (UID: \"8521d6f9-91c0-4231-ac5c-90517bf722aa\") "
Jul 06 02:49:06.832188 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:06.832055    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d57735f2-4f30-474d-8f7f-5363b27e3666-util\") pod \"d57735f2-4f30-474d-8f7f-5363b27e3666\" (UID: \"d57735f2-4f30-474d-8f7f-5363b27e3666\") "
Jul 06 02:49:06.832188 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:06.832074    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ct26\" (UniqueName: \"kubernetes.io/projected/d57735f2-4f30-474d-8f7f-5363b27e3666-kube-api-access-4ct26\") pod \"d57735f2-4f30-474d-8f7f-5363b27e3666\" (UID: \"d57735f2-4f30-474d-8f7f-5363b27e3666\") "
Jul 06 02:49:06.832188 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:06.832106    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51b453cd-788d-4a11-9b0f-984e0df62b55-bundle\") pod \"51b453cd-788d-4a11-9b0f-984e0df62b55\" (UID: \"51b453cd-788d-4a11-9b0f-984e0df62b55\") "
Jul 06 02:49:06.832188 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:06.832130    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19af652d-1b5b-403b-bf72-1d4124ecc11a-util\") pod \"19af652d-1b5b-403b-bf72-1d4124ecc11a\" (UID: \"19af652d-1b5b-403b-bf72-1d4124ecc11a\") "
Jul 06 02:49:06.832188 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:06.832171    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fsvnm\" (UniqueName: \"kubernetes.io/projected/8521d6f9-91c0-4231-ac5c-90517bf722aa-kube-api-access-fsvnm\") pod \"8521d6f9-91c0-4231-ac5c-90517bf722aa\" (UID: \"8521d6f9-91c0-4231-ac5c-90517bf722aa\") "
Jul 06 02:49:06.833402 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:06.832657    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19af652d-1b5b-403b-bf72-1d4124ecc11a-bundle" (OuterVolumeSpecName: "bundle") pod "19af652d-1b5b-403b-bf72-1d4124ecc11a" (UID: "19af652d-1b5b-403b-bf72-1d4124ecc11a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 02:49:06.833402 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:06.833131    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51b453cd-788d-4a11-9b0f-984e0df62b55-bundle" (OuterVolumeSpecName: "bundle") pod "51b453cd-788d-4a11-9b0f-984e0df62b55" (UID: "51b453cd-788d-4a11-9b0f-984e0df62b55"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 02:49:06.833402 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:06.833129    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d57735f2-4f30-474d-8f7f-5363b27e3666-bundle" (OuterVolumeSpecName: "bundle") pod "d57735f2-4f30-474d-8f7f-5363b27e3666" (UID: "d57735f2-4f30-474d-8f7f-5363b27e3666"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 02:49:06.834714 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:06.834686    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51b453cd-788d-4a11-9b0f-984e0df62b55-kube-api-access-bj428" (OuterVolumeSpecName: "kube-api-access-bj428") pod "51b453cd-788d-4a11-9b0f-984e0df62b55" (UID: "51b453cd-788d-4a11-9b0f-984e0df62b55"). InnerVolumeSpecName "kube-api-access-bj428". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 02:49:06.835033 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:06.835003    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8521d6f9-91c0-4231-ac5c-90517bf722aa-kube-api-access-fsvnm" (OuterVolumeSpecName: "kube-api-access-fsvnm") pod "8521d6f9-91c0-4231-ac5c-90517bf722aa" (UID: "8521d6f9-91c0-4231-ac5c-90517bf722aa"). InnerVolumeSpecName "kube-api-access-fsvnm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 02:49:06.835125 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:06.835064    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8521d6f9-91c0-4231-ac5c-90517bf722aa-bundle" (OuterVolumeSpecName: "bundle") pod "8521d6f9-91c0-4231-ac5c-90517bf722aa" (UID: "8521d6f9-91c0-4231-ac5c-90517bf722aa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 02:49:06.835558 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:06.835525    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d57735f2-4f30-474d-8f7f-5363b27e3666-kube-api-access-4ct26" (OuterVolumeSpecName: "kube-api-access-4ct26") pod "d57735f2-4f30-474d-8f7f-5363b27e3666" (UID: "d57735f2-4f30-474d-8f7f-5363b27e3666"). InnerVolumeSpecName "kube-api-access-4ct26". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 02:49:06.835783 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:06.835762    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19af652d-1b5b-403b-bf72-1d4124ecc11a-kube-api-access-p696s" (OuterVolumeSpecName: "kube-api-access-p696s") pod "19af652d-1b5b-403b-bf72-1d4124ecc11a" (UID: "19af652d-1b5b-403b-bf72-1d4124ecc11a"). InnerVolumeSpecName "kube-api-access-p696s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 02:49:06.838415 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:06.838394    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d57735f2-4f30-474d-8f7f-5363b27e3666-util" (OuterVolumeSpecName: "util") pod "d57735f2-4f30-474d-8f7f-5363b27e3666" (UID: "d57735f2-4f30-474d-8f7f-5363b27e3666"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 02:49:06.839100 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:06.839081    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8521d6f9-91c0-4231-ac5c-90517bf722aa-util" (OuterVolumeSpecName: "util") pod "8521d6f9-91c0-4231-ac5c-90517bf722aa" (UID: "8521d6f9-91c0-4231-ac5c-90517bf722aa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 02:49:06.841416 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:06.841390    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51b453cd-788d-4a11-9b0f-984e0df62b55-util" (OuterVolumeSpecName: "util") pod "51b453cd-788d-4a11-9b0f-984e0df62b55" (UID: "51b453cd-788d-4a11-9b0f-984e0df62b55"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 02:49:06.841836 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:06.841820    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19af652d-1b5b-403b-bf72-1d4124ecc11a-util" (OuterVolumeSpecName: "util") pod "19af652d-1b5b-403b-bf72-1d4124ecc11a" (UID: "19af652d-1b5b-403b-bf72-1d4124ecc11a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 02:49:06.933027 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:06.932975    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d57735f2-4f30-474d-8f7f-5363b27e3666-bundle\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:49:06.933027 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:06.933022    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51b453cd-788d-4a11-9b0f-984e0df62b55-util\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:49:06.933027 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:06.933031    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8521d6f9-91c0-4231-ac5c-90517bf722aa-bundle\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:49:06.933227 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:06.933039    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d57735f2-4f30-474d-8f7f-5363b27e3666-util\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:49:06.933227 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:06.933047    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ct26\" (UniqueName: \"kubernetes.io/projected/d57735f2-4f30-474d-8f7f-5363b27e3666-kube-api-access-4ct26\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:49:06.933227 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:06.933056    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51b453cd-788d-4a11-9b0f-984e0df62b55-bundle\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:49:06.933227 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:06.933065    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19af652d-1b5b-403b-bf72-1d4124ecc11a-util\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:49:06.933227 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:06.933073    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fsvnm\" (UniqueName: \"kubernetes.io/projected/8521d6f9-91c0-4231-ac5c-90517bf722aa-kube-api-access-fsvnm\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:49:06.933227 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:06.933081    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p696s\" (UniqueName: \"kubernetes.io/projected/19af652d-1b5b-403b-bf72-1d4124ecc11a-kube-api-access-p696s\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:49:06.933227 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:06.933089    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bj428\" (UniqueName: \"kubernetes.io/projected/51b453cd-788d-4a11-9b0f-984e0df62b55-kube-api-access-bj428\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:49:06.933227 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:06.933097    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19af652d-1b5b-403b-bf72-1d4124ecc11a-bundle\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:49:06.933227 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:06.933104    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8521d6f9-91c0-4231-ac5c-90517bf722aa-util\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:49:07.176804 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:07.176717    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfxlc_b2861d04-c87b-43b1-9bff-2b2199a136a3/ovn-acl-logging/0.log"
Jul 06 02:49:07.178695 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:07.178668    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfxlc_b2861d04-c87b-43b1-9bff-2b2199a136a3/ovn-acl-logging/0.log"
Jul 06 02:49:07.534677 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:07.534649    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmn48"
Jul 06 02:49:07.536898 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:07.534648    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmn48" event={"ID":"d57735f2-4f30-474d-8f7f-5363b27e3666","Type":"ContainerDied","Data":"46e1114cfeaa7be6d7ab511f9b683d916983e1d69b9b45cb754166a15ac1bf9c"}
Jul 06 02:49:07.536898 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:07.534774    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="46e1114cfeaa7be6d7ab511f9b683d916983e1d69b9b45cb754166a15ac1bf9c"
Jul 06 02:49:07.536898 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:07.536718    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9v"
Jul 06 02:49:07.536898 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:07.536711    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9v" event={"ID":"19af652d-1b5b-403b-bf72-1d4124ecc11a","Type":"ContainerDied","Data":"283b25078b0e2d5151a90ccf167ab53e6849cef23016bb6e2be256849d4f76f2"}
Jul 06 02:49:07.536898 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:07.536832    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="283b25078b0e2d5151a90ccf167ab53e6849cef23016bb6e2be256849d4f76f2"
Jul 06 02:49:07.538876 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:07.538854    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nt69q"
Jul 06 02:49:07.539016 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:07.538853    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nt69q" event={"ID":"51b453cd-788d-4a11-9b0f-984e0df62b55","Type":"ContainerDied","Data":"758a74c531b90fe1c81d41b08b589b73ba6e6f58fea4c96cfef816ce3be94846"}
Jul 06 02:49:07.539088 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:07.539033    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="758a74c531b90fe1c81d41b08b589b73ba6e6f58fea4c96cfef816ce3be94846"
Jul 06 02:49:07.541055 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:07.541030    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mwm84" event={"ID":"8521d6f9-91c0-4231-ac5c-90517bf722aa","Type":"ContainerDied","Data":"ab5c8ac3896439e5212df41962cc3c08abd6dfb0bbebb4e93f66254d4706481c"}
Jul 06 02:49:07.541165 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:07.541070    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab5c8ac3896439e5212df41962cc3c08abd6dfb0bbebb4e93f66254d4706481c"
Jul 06 02:49:07.541165 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:07.541099    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mwm84"
Jul 06 02:49:14.122319 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:14.122257    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:49:17.511936 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:17.511900    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:49:18.310716 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:18.310674    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:49:21.921573 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:21.921530    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:49:22.168274 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:22.168235    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:49:24.166794 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:24.166741    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:49:24.259993 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:24.259962    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:49:24.705895 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:24.705855    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:49:25.190578 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:25.190521    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:49:27.143164 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:27.143123    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:49:30.121430 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:30.121344    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:49:30.221498 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:30.221463    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:49:34.798100 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:34.798068    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:49:34.912059 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:34.911975    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:49:35.016970 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:35.016940    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:49:35.528657 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:35.528622    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:49:35.624280 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:35.624246    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:49:35.910313 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:35.910217    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:49:35.981578 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:35.981548    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:49:35.985636 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:35.985608    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-2dh4s"]
Jul 06 02:49:35.985945 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:35.985932    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19af652d-1b5b-403b-bf72-1d4124ecc11a" containerName="util"
Jul 06 02:49:35.986002 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:35.985947    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="19af652d-1b5b-403b-bf72-1d4124ecc11a" containerName="util"
Jul 06 02:49:35.986002 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:35.985955    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19af652d-1b5b-403b-bf72-1d4124ecc11a" containerName="pull"
Jul 06 02:49:35.986002 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:35.985960    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="19af652d-1b5b-403b-bf72-1d4124ecc11a" containerName="pull"
Jul 06 02:49:35.986002 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:35.985967    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d57735f2-4f30-474d-8f7f-5363b27e3666" containerName="extract"
Jul 06 02:49:35.986002 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:35.985972    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d57735f2-4f30-474d-8f7f-5363b27e3666" containerName="extract"
Jul 06 02:49:35.986002 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:35.985998    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51b453cd-788d-4a11-9b0f-984e0df62b55" containerName="extract"
Jul 06 02:49:35.986002 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:35.986004    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="51b453cd-788d-4a11-9b0f-984e0df62b55" containerName="extract"
Jul 06 02:49:35.986250 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:35.986012    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19af652d-1b5b-403b-bf72-1d4124ecc11a" containerName="extract"
Jul 06 02:49:35.986250 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:35.986017    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="19af652d-1b5b-403b-bf72-1d4124ecc11a" containerName="extract"
Jul 06 02:49:35.986250 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:35.986024    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8521d6f9-91c0-4231-ac5c-90517bf722aa" containerName="util"
Jul 06 02:49:35.986250 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:35.986030    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8521d6f9-91c0-4231-ac5c-90517bf722aa" containerName="util"
Jul 06 02:49:35.986250 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:35.986038    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8521d6f9-91c0-4231-ac5c-90517bf722aa" containerName="pull"
Jul 06 02:49:35.986250 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:35.986043    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8521d6f9-91c0-4231-ac5c-90517bf722aa" containerName="pull"
Jul 06 02:49:35.986250 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:35.986049    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51b453cd-788d-4a11-9b0f-984e0df62b55" containerName="util"
Jul 06 02:49:35.986250 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:35.986053    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="51b453cd-788d-4a11-9b0f-984e0df62b55" containerName="util"
Jul 06 02:49:35.986250 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:35.986062    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d57735f2-4f30-474d-8f7f-5363b27e3666" containerName="util"
Jul 06 02:49:35.986250 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:35.986067    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d57735f2-4f30-474d-8f7f-5363b27e3666" containerName="util"
Jul 06 02:49:35.986250 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:35.986074    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d57735f2-4f30-474d-8f7f-5363b27e3666" containerName="pull"
Jul 06 02:49:35.986250 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:35.986078    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d57735f2-4f30-474d-8f7f-5363b27e3666" containerName="pull"
Jul 06 02:49:35.986250 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:35.986083    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51b453cd-788d-4a11-9b0f-984e0df62b55" containerName="pull"
Jul 06 02:49:35.986250 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:35.986089    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="51b453cd-788d-4a11-9b0f-984e0df62b55" containerName="pull"
Jul 06 02:49:35.986250 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:35.986095    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8521d6f9-91c0-4231-ac5c-90517bf722aa" containerName="extract"
Jul 06 02:49:35.986250 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:35.986101    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8521d6f9-91c0-4231-ac5c-90517bf722aa" containerName="extract"
Jul 06 02:49:35.986250 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:35.986152    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="19af652d-1b5b-403b-bf72-1d4124ecc11a" containerName="extract"
Jul 06 02:49:35.986250 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:35.986159    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="d57735f2-4f30-474d-8f7f-5363b27e3666" containerName="extract"
Jul 06 02:49:35.986250 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:35.986166    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="51b453cd-788d-4a11-9b0f-984e0df62b55" containerName="extract"
Jul 06 02:49:35.986250 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:35.986171    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="8521d6f9-91c0-4231-ac5c-90517bf722aa" containerName="extract"
Jul 06 02:49:35.988444 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:35.988426    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2dh4s"
Jul 06 02:49:35.991044 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:35.991020    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-fszpk\""
Jul 06 02:49:35.991044 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:35.991037    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 02:49:35.991222 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:35.991036    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 02:49:35.991222 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:35.991019    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 06 02:49:35.991560 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:35.991547    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 06 02:49:35.997154 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:35.997131    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-2dh4s"]
Jul 06 02:49:36.043032 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:36.042997    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:49:36.137994 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:36.137959    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:49:36.160042 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:36.160012    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqwht\" (UniqueName: \"kubernetes.io/projected/fb8f6215-62da-4df7-a9ea-2b5a0b3fc07b-kube-api-access-dqwht\") pod \"kuadrant-console-plugin-66b5774985-2dh4s\" (UID: \"fb8f6215-62da-4df7-a9ea-2b5a0b3fc07b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2dh4s"
Jul 06 02:49:36.160175 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:36.160072    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb8f6215-62da-4df7-a9ea-2b5a0b3fc07b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-2dh4s\" (UID: \"fb8f6215-62da-4df7-a9ea-2b5a0b3fc07b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2dh4s"
Jul 06 02:49:36.160175 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:36.160134    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fb8f6215-62da-4df7-a9ea-2b5a0b3fc07b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-2dh4s\" (UID: \"fb8f6215-62da-4df7-a9ea-2b5a0b3fc07b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2dh4s"
Jul 06 02:49:36.260635 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:36.260555    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb8f6215-62da-4df7-a9ea-2b5a0b3fc07b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-2dh4s\" (UID: \"fb8f6215-62da-4df7-a9ea-2b5a0b3fc07b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2dh4s"
Jul 06 02:49:36.260635 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:36.260603    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fb8f6215-62da-4df7-a9ea-2b5a0b3fc07b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-2dh4s\" (UID: \"fb8f6215-62da-4df7-a9ea-2b5a0b3fc07b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2dh4s"
Jul 06 02:49:36.260844 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:36.260654    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqwht\" (UniqueName: \"kubernetes.io/projected/fb8f6215-62da-4df7-a9ea-2b5a0b3fc07b-kube-api-access-dqwht\") pod \"kuadrant-console-plugin-66b5774985-2dh4s\" (UID: \"fb8f6215-62da-4df7-a9ea-2b5a0b3fc07b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2dh4s"
Jul 06 02:49:36.261354 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:36.261330    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fb8f6215-62da-4df7-a9ea-2b5a0b3fc07b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-2dh4s\" (UID: \"fb8f6215-62da-4df7-a9ea-2b5a0b3fc07b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2dh4s"
Jul 06 02:49:36.262932 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:36.262914    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb8f6215-62da-4df7-a9ea-2b5a0b3fc07b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-2dh4s\" (UID: \"fb8f6215-62da-4df7-a9ea-2b5a0b3fc07b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2dh4s"
Jul 06 02:49:36.270441 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:36.270417    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqwht\" (UniqueName: \"kubernetes.io/projected/fb8f6215-62da-4df7-a9ea-2b5a0b3fc07b-kube-api-access-dqwht\") pod \"kuadrant-console-plugin-66b5774985-2dh4s\" (UID: \"fb8f6215-62da-4df7-a9ea-2b5a0b3fc07b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2dh4s"
Jul 06 02:49:36.298181 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:36.298154    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2dh4s"
Jul 06 02:49:36.422935 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:36.422905    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-2dh4s"]
Jul 06 02:49:36.424943 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:49:36.424919    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb8f6215_62da_4df7_a9ea_2b5a0b3fc07b.slice/crio-1ddc168cefce75e7744c23e45b29375df33b2de2c9cb0d1b14d9f1c23732bcbd WatchSource:0}: Error finding container 1ddc168cefce75e7744c23e45b29375df33b2de2c9cb0d1b14d9f1c23732bcbd: Status 404 returned error can't find the container with id 1ddc168cefce75e7744c23e45b29375df33b2de2c9cb0d1b14d9f1c23732bcbd
Jul 06 02:49:36.426552 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:36.426532    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 02:49:36.682245 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:36.682212    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2dh4s" event={"ID":"fb8f6215-62da-4df7-a9ea-2b5a0b3fc07b","Type":"ContainerStarted","Data":"1ddc168cefce75e7744c23e45b29375df33b2de2c9cb0d1b14d9f1c23732bcbd"}
Jul 06 02:49:39.313128 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:39.313092    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:49:39.414426 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:39.414365    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:49:41.846494 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:41.846459    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:49:41.947075 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:41.947030    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:49:42.056742 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:42.056694    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:49:48.551667 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:48.551628    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:49:48.649894 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:48.649858    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:49:53.940955 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:53.940914    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:49:53.989398 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:53.989364    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:49:54.341865 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:54.341824    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:49:54.397213 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:54.397172    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:49:57.750548 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:57.750471    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:49:57.806658 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:57.806628    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2dh4s" event={"ID":"fb8f6215-62da-4df7-a9ea-2b5a0b3fc07b","Type":"ContainerStarted","Data":"92d2e1969dc2eaef9df0932a9a63fb84950d59a840340e1da7044466d904bebb"}
Jul 06 02:49:57.824164 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:57.824117    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2dh4s" podStartSLOduration=1.873612219 podStartE2EDuration="22.824100597s" totalImagesPullingTime="20.950488378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:49:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:49:57.821564813 +0000 UTC m=+651.478574481" watchObservedRunningTime="2026-07-06 02:49:57.824100597 +0000 UTC m=+651.481110261"
Jul 06 02:49:57.828626 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:49:57.828582    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:50:00.296519 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:00.296457    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:50:00.396805 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:00.396772    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:50:19.078005 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:19.077952    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:50:19.373885 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:19.373792    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:50:21.067552 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:21.067513    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:50:21.170774 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:21.170730    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:50:21.222612 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:21.222582    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:50:21.854953 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:21.854919    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-rq92k"]
Jul 06 02:50:21.882651 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:21.882611    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:50:21.886277 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:21.886244    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-rq92k"]
Jul 06 02:50:21.886382 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:21.886330    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rq92k"
Jul 06 02:50:21.888450 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:21.888431    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-mdnmw\""
Jul 06 02:50:21.968259 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:21.968229    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:50:21.969549 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:21.969525    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-vrlnh"]
Jul 06 02:50:21.988555 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:21.988528    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vrlnh"]
Jul 06 02:50:21.988686 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:21.988623    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vrlnh"
Jul 06 02:50:22.045089 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:22.045059    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m5j2\" (UniqueName: \"kubernetes.io/projected/daa72993-48f5-4b7b-998c-6aefa69344d1-kube-api-access-8m5j2\") pod \"authorino-58cd955675-rq92k\" (UID: \"daa72993-48f5-4b7b-998c-6aefa69344d1\") " pod="kuadrant-system/authorino-58cd955675-rq92k"
Jul 06 02:50:22.146076 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:22.145951    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m5j2\" (UniqueName: \"kubernetes.io/projected/daa72993-48f5-4b7b-998c-6aefa69344d1-kube-api-access-8m5j2\") pod \"authorino-58cd955675-rq92k\" (UID: \"daa72993-48f5-4b7b-998c-6aefa69344d1\") " pod="kuadrant-system/authorino-58cd955675-rq92k"
Jul 06 02:50:22.146076 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:22.146048    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdgfs\" (UniqueName: \"kubernetes.io/projected/60529873-39f1-4c9a-ad92-61bb94bf92f3-kube-api-access-qdgfs\") pod \"authorino-75d556bd77-vrlnh\" (UID: \"60529873-39f1-4c9a-ad92-61bb94bf92f3\") " pod="kuadrant-system/authorino-75d556bd77-vrlnh"
Jul 06 02:50:22.153120 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:22.153095    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m5j2\" (UniqueName: \"kubernetes.io/projected/daa72993-48f5-4b7b-998c-6aefa69344d1-kube-api-access-8m5j2\") pod \"authorino-58cd955675-rq92k\" (UID: \"daa72993-48f5-4b7b-998c-6aefa69344d1\") " pod="kuadrant-system/authorino-58cd955675-rq92k"
Jul 06 02:50:22.195686 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:22.195660    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rq92k"
Jul 06 02:50:22.246780 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:22.246749    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdgfs\" (UniqueName: \"kubernetes.io/projected/60529873-39f1-4c9a-ad92-61bb94bf92f3-kube-api-access-qdgfs\") pod \"authorino-75d556bd77-vrlnh\" (UID: \"60529873-39f1-4c9a-ad92-61bb94bf92f3\") " pod="kuadrant-system/authorino-75d556bd77-vrlnh"
Jul 06 02:50:22.254496 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:22.254466    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdgfs\" (UniqueName: \"kubernetes.io/projected/60529873-39f1-4c9a-ad92-61bb94bf92f3-kube-api-access-qdgfs\") pod \"authorino-75d556bd77-vrlnh\" (UID: \"60529873-39f1-4c9a-ad92-61bb94bf92f3\") " pod="kuadrant-system/authorino-75d556bd77-vrlnh"
Jul 06 02:50:22.298001 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:22.297956    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vrlnh"
Jul 06 02:50:22.522875 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:22.522521    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-rq92k"]
Jul 06 02:50:22.531666 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:50:22.531621    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddaa72993_48f5_4b7b_998c_6aefa69344d1.slice/crio-11f6546f6ee7bd9b29cf2f0673c162993cd1dde8366266a19d198e6203924f03 WatchSource:0}: Error finding container 11f6546f6ee7bd9b29cf2f0673c162993cd1dde8366266a19d198e6203924f03: Status 404 returned error can't find the container with id 11f6546f6ee7bd9b29cf2f0673c162993cd1dde8366266a19d198e6203924f03
Jul 06 02:50:22.548846 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:22.548818    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vrlnh"]
Jul 06 02:50:22.551727 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:50:22.551695    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod60529873_39f1_4c9a_ad92_61bb94bf92f3.slice/crio-be232b2036f32718f6b0329fc92249c2ef6e8aedf5875028b27cf09d3690dbf7 WatchSource:0}: Error finding container be232b2036f32718f6b0329fc92249c2ef6e8aedf5875028b27cf09d3690dbf7: Status 404 returned error can't find the container with id be232b2036f32718f6b0329fc92249c2ef6e8aedf5875028b27cf09d3690dbf7
Jul 06 02:50:22.931677 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:22.931640    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rq92k" event={"ID":"daa72993-48f5-4b7b-998c-6aefa69344d1","Type":"ContainerStarted","Data":"11f6546f6ee7bd9b29cf2f0673c162993cd1dde8366266a19d198e6203924f03"}
Jul 06 02:50:22.933116 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:22.933091    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vrlnh" event={"ID":"60529873-39f1-4c9a-ad92-61bb94bf92f3","Type":"ContainerStarted","Data":"be232b2036f32718f6b0329fc92249c2ef6e8aedf5875028b27cf09d3690dbf7"}
Jul 06 02:50:26.961754 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:26.961720    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rq92k" event={"ID":"daa72993-48f5-4b7b-998c-6aefa69344d1","Type":"ContainerStarted","Data":"5adba28753c80a8215354ce3052e9cb5b9be13423cfd5f8a3e24a727d5a18462"}
Jul 06 02:50:26.963368 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:26.963340    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vrlnh" event={"ID":"60529873-39f1-4c9a-ad92-61bb94bf92f3","Type":"ContainerStarted","Data":"d8d399e059eab1572ed775f189e76587fcb76b1d328ec9236850fa4987d0f728"}
Jul 06 02:50:26.976907 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:26.976846    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-rq92k" podStartSLOduration=2.499117988 podStartE2EDuration="5.976829283s" totalImagesPullingTime="3.477711295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:50:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:50:26.976463758 +0000 UTC m=+680.633473422" watchObservedRunningTime="2026-07-06 02:50:26.976829283 +0000 UTC m=+680.633838947"
Jul 06 02:50:26.990238 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:26.990195    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-vrlnh" podStartSLOduration=2.544182294 podStartE2EDuration="5.990179738s" totalImagesPullingTime="3.445997444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:50:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:50:26.989313388 +0000 UTC m=+680.646323053" watchObservedRunningTime="2026-07-06 02:50:26.990179738 +0000 UTC m=+680.647189402"
Jul 06 02:50:27.012189 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:27.012162    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-rq92k"]
Jul 06 02:50:28.973334 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:28.973271    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-rq92k" podUID="daa72993-48f5-4b7b-998c-6aefa69344d1" containerName="authorino" containerID="cri-o://5adba28753c80a8215354ce3052e9cb5b9be13423cfd5f8a3e24a727d5a18462" gracePeriod=30
Jul 06 02:50:29.257188 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:29.257113    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rq92k"
Jul 06 02:50:29.401555 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:29.401521    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8m5j2\" (UniqueName: \"kubernetes.io/projected/daa72993-48f5-4b7b-998c-6aefa69344d1-kube-api-access-8m5j2\") pod \"daa72993-48f5-4b7b-998c-6aefa69344d1\" (UID: \"daa72993-48f5-4b7b-998c-6aefa69344d1\") "
Jul 06 02:50:29.403555 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:29.403521    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/daa72993-48f5-4b7b-998c-6aefa69344d1-kube-api-access-8m5j2" (OuterVolumeSpecName: "kube-api-access-8m5j2") pod "daa72993-48f5-4b7b-998c-6aefa69344d1" (UID: "daa72993-48f5-4b7b-998c-6aefa69344d1"). InnerVolumeSpecName "kube-api-access-8m5j2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 02:50:29.502821 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:29.502794    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8m5j2\" (UniqueName: \"kubernetes.io/projected/daa72993-48f5-4b7b-998c-6aefa69344d1-kube-api-access-8m5j2\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:50:29.979917 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:29.979880    2570 generic.go:356] "Generic (PLEG): container finished" podID="daa72993-48f5-4b7b-998c-6aefa69344d1" containerID="5adba28753c80a8215354ce3052e9cb5b9be13423cfd5f8a3e24a727d5a18462" exitCode=0
Jul 06 02:50:29.980327 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:29.979922    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rq92k"
Jul 06 02:50:29.980327 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:29.979968    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rq92k" event={"ID":"daa72993-48f5-4b7b-998c-6aefa69344d1","Type":"ContainerDied","Data":"5adba28753c80a8215354ce3052e9cb5b9be13423cfd5f8a3e24a727d5a18462"}
Jul 06 02:50:29.980327 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:29.980032    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rq92k" event={"ID":"daa72993-48f5-4b7b-998c-6aefa69344d1","Type":"ContainerDied","Data":"11f6546f6ee7bd9b29cf2f0673c162993cd1dde8366266a19d198e6203924f03"}
Jul 06 02:50:29.980327 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:29.980051    2570 scope.go:117] "RemoveContainer" containerID="5adba28753c80a8215354ce3052e9cb5b9be13423cfd5f8a3e24a727d5a18462"
Jul 06 02:50:29.988732 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:29.988713    2570 scope.go:117] "RemoveContainer" containerID="5adba28753c80a8215354ce3052e9cb5b9be13423cfd5f8a3e24a727d5a18462"
Jul 06 02:50:29.989021 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:50:29.989005    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5adba28753c80a8215354ce3052e9cb5b9be13423cfd5f8a3e24a727d5a18462\": container with ID starting with 5adba28753c80a8215354ce3052e9cb5b9be13423cfd5f8a3e24a727d5a18462 not found: ID does not exist" containerID="5adba28753c80a8215354ce3052e9cb5b9be13423cfd5f8a3e24a727d5a18462"
Jul 06 02:50:29.989075 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:29.989028    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5adba28753c80a8215354ce3052e9cb5b9be13423cfd5f8a3e24a727d5a18462"} err="failed to get container status \"5adba28753c80a8215354ce3052e9cb5b9be13423cfd5f8a3e24a727d5a18462\": rpc error: code = NotFound desc = could not find container \"5adba28753c80a8215354ce3052e9cb5b9be13423cfd5f8a3e24a727d5a18462\": container with ID starting with 5adba28753c80a8215354ce3052e9cb5b9be13423cfd5f8a3e24a727d5a18462 not found: ID does not exist"
Jul 06 02:50:29.999554 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:29.999528    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-rq92k"]
Jul 06 02:50:30.001801 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:30.001783    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-rq92k"]
Jul 06 02:50:31.232587 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:31.232556    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="daa72993-48f5-4b7b-998c-6aefa69344d1" path="/var/lib/kubelet/pods/daa72993-48f5-4b7b-998c-6aefa69344d1/volumes"
Jul 06 02:50:42.575908 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:42.575869    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:50:54.456758 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:54.456714    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:50:54.557620 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:54.557574    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:50:54.692762 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:54.692726    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-srfhc"]
Jul 06 02:50:54.693080 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:54.693066    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daa72993-48f5-4b7b-998c-6aefa69344d1" containerName="authorino"
Jul 06 02:50:54.693146 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:54.693081    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="daa72993-48f5-4b7b-998c-6aefa69344d1" containerName="authorino"
Jul 06 02:50:54.693146 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:54.693140    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="daa72993-48f5-4b7b-998c-6aefa69344d1" containerName="authorino"
Jul 06 02:50:54.696206 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:54.696190    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-srfhc"
Jul 06 02:50:54.702629 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:54.702604    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-srfhc"]
Jul 06 02:50:54.793508 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:54.793483    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vblxg\" (UniqueName: \"kubernetes.io/projected/7c8bf10b-e57a-4840-a64d-8990645ef659-kube-api-access-vblxg\") pod \"authorino-5d4b67c446-srfhc\" (UID: \"7c8bf10b-e57a-4840-a64d-8990645ef659\") " pod="kuadrant-system/authorino-5d4b67c446-srfhc"
Jul 06 02:50:54.894426 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:54.894400    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vblxg\" (UniqueName: \"kubernetes.io/projected/7c8bf10b-e57a-4840-a64d-8990645ef659-kube-api-access-vblxg\") pod \"authorino-5d4b67c446-srfhc\" (UID: \"7c8bf10b-e57a-4840-a64d-8990645ef659\") " pod="kuadrant-system/authorino-5d4b67c446-srfhc"
Jul 06 02:50:54.905209 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:54.905188    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vblxg\" (UniqueName: \"kubernetes.io/projected/7c8bf10b-e57a-4840-a64d-8990645ef659-kube-api-access-vblxg\") pod \"authorino-5d4b67c446-srfhc\" (UID: \"7c8bf10b-e57a-4840-a64d-8990645ef659\") " pod="kuadrant-system/authorino-5d4b67c446-srfhc"
Jul 06 02:50:54.928697 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:54.928663    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-srfhc"]
Jul 06 02:50:54.928938 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:54.928921    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-srfhc"
Jul 06 02:50:54.958610 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:54.958583    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6946c67598-shdkx"]
Jul 06 02:50:54.962961 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:54.962940    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6946c67598-shdkx"
Jul 06 02:50:54.970666 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:54.970643    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6946c67598-shdkx"]
Jul 06 02:50:54.995221 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:54.995187    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpplh\" (UniqueName: \"kubernetes.io/projected/61662d35-3751-4f94-88ef-9d7652146a29-kube-api-access-hpplh\") pod \"authorino-6946c67598-shdkx\" (UID: \"61662d35-3751-4f94-88ef-9d7652146a29\") " pod="kuadrant-system/authorino-6946c67598-shdkx"
Jul 06 02:50:55.062300 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:55.062278    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-srfhc"]
Jul 06 02:50:55.064299 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:50:55.064272    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c8bf10b_e57a_4840_a64d_8990645ef659.slice/crio-6690ce2a26e1d280828074e01841f29c8775b4869d31faea42f0c9101c3850b2 WatchSource:0}: Error finding container 6690ce2a26e1d280828074e01841f29c8775b4869d31faea42f0c9101c3850b2: Status 404 returned error can't find the container with id 6690ce2a26e1d280828074e01841f29c8775b4869d31faea42f0c9101c3850b2
Jul 06 02:50:55.096152 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:55.096119    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpplh\" (UniqueName: \"kubernetes.io/projected/61662d35-3751-4f94-88ef-9d7652146a29-kube-api-access-hpplh\") pod \"authorino-6946c67598-shdkx\" (UID: \"61662d35-3751-4f94-88ef-9d7652146a29\") " pod="kuadrant-system/authorino-6946c67598-shdkx"
Jul 06 02:50:55.101219 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:55.101195    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-srfhc" event={"ID":"7c8bf10b-e57a-4840-a64d-8990645ef659","Type":"ContainerStarted","Data":"6690ce2a26e1d280828074e01841f29c8775b4869d31faea42f0c9101c3850b2"}
Jul 06 02:50:55.104336 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:55.104316    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpplh\" (UniqueName: \"kubernetes.io/projected/61662d35-3751-4f94-88ef-9d7652146a29-kube-api-access-hpplh\") pod \"authorino-6946c67598-shdkx\" (UID: \"61662d35-3751-4f94-88ef-9d7652146a29\") " pod="kuadrant-system/authorino-6946c67598-shdkx"
Jul 06 02:50:55.151102 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:55.151071    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6946c67598-shdkx"]
Jul 06 02:50:55.151324 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:55.151308    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6946c67598-shdkx"
Jul 06 02:50:55.182622 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:55.182590    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c4f94d79d-cv6xz"]
Jul 06 02:50:55.187566 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:55.187543    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c4f94d79d-cv6xz"
Jul 06 02:50:55.190340 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:55.190319    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 06 02:50:55.200856 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:55.200829    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c4f94d79d-cv6xz"]
Jul 06 02:50:55.288455 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:55.288431    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6946c67598-shdkx"]
Jul 06 02:50:55.290231 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:50:55.290207    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod61662d35_3751_4f94_88ef_9d7652146a29.slice/crio-691ea371b511575c7176f34b4d2a80b9c05259350549c426e1dfc8bb5fcf73b4 WatchSource:0}: Error finding container 691ea371b511575c7176f34b4d2a80b9c05259350549c426e1dfc8bb5fcf73b4: Status 404 returned error can't find the container with id 691ea371b511575c7176f34b4d2a80b9c05259350549c426e1dfc8bb5fcf73b4
Jul 06 02:50:55.297396 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:55.297375    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26r5p\" (UniqueName: \"kubernetes.io/projected/133b0f82-7d80-47e1-9611-063840bfa2d6-kube-api-access-26r5p\") pod \"authorino-c4f94d79d-cv6xz\" (UID: \"133b0f82-7d80-47e1-9611-063840bfa2d6\") " pod="kuadrant-system/authorino-c4f94d79d-cv6xz"
Jul 06 02:50:55.297496 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:55.297412    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/133b0f82-7d80-47e1-9611-063840bfa2d6-tls-cert\") pod \"authorino-c4f94d79d-cv6xz\" (UID: \"133b0f82-7d80-47e1-9611-063840bfa2d6\") " pod="kuadrant-system/authorino-c4f94d79d-cv6xz"
Jul 06 02:50:55.398086 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:55.398025    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26r5p\" (UniqueName: \"kubernetes.io/projected/133b0f82-7d80-47e1-9611-063840bfa2d6-kube-api-access-26r5p\") pod \"authorino-c4f94d79d-cv6xz\" (UID: \"133b0f82-7d80-47e1-9611-063840bfa2d6\") " pod="kuadrant-system/authorino-c4f94d79d-cv6xz"
Jul 06 02:50:55.398086 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:55.398064    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/133b0f82-7d80-47e1-9611-063840bfa2d6-tls-cert\") pod \"authorino-c4f94d79d-cv6xz\" (UID: \"133b0f82-7d80-47e1-9611-063840bfa2d6\") " pod="kuadrant-system/authorino-c4f94d79d-cv6xz"
Jul 06 02:50:55.400284 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:55.400267    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/133b0f82-7d80-47e1-9611-063840bfa2d6-tls-cert\") pod \"authorino-c4f94d79d-cv6xz\" (UID: \"133b0f82-7d80-47e1-9611-063840bfa2d6\") " pod="kuadrant-system/authorino-c4f94d79d-cv6xz"
Jul 06 02:50:55.409103 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:55.409084    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26r5p\" (UniqueName: \"kubernetes.io/projected/133b0f82-7d80-47e1-9611-063840bfa2d6-kube-api-access-26r5p\") pod \"authorino-c4f94d79d-cv6xz\" (UID: \"133b0f82-7d80-47e1-9611-063840bfa2d6\") " pod="kuadrant-system/authorino-c4f94d79d-cv6xz"
Jul 06 02:50:55.499912 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:55.499890    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c4f94d79d-cv6xz"
Jul 06 02:50:55.640030 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:55.640001    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c4f94d79d-cv6xz"]
Jul 06 02:50:55.645502 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:50:55.645473    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod133b0f82_7d80_47e1_9611_063840bfa2d6.slice/crio-144636523f342e95002c5499a8e0de6de783e8f95fecb47e4c59189f644d0b2b WatchSource:0}: Error finding container 144636523f342e95002c5499a8e0de6de783e8f95fecb47e4c59189f644d0b2b: Status 404 returned error can't find the container with id 144636523f342e95002c5499a8e0de6de783e8f95fecb47e4c59189f644d0b2b
Jul 06 02:50:56.108340 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:56.108313    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-srfhc" event={"ID":"7c8bf10b-e57a-4840-a64d-8990645ef659","Type":"ContainerStarted","Data":"fb38fbe7531f48ac34bf606c4a5819514648c91e01d2c6045111c78fa35a7461"}
Jul 06 02:50:56.108465 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:56.108359    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-srfhc" podUID="7c8bf10b-e57a-4840-a64d-8990645ef659" containerName="authorino" containerID="cri-o://fb38fbe7531f48ac34bf606c4a5819514648c91e01d2c6045111c78fa35a7461" gracePeriod=30
Jul 06 02:50:56.109643 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:56.109616    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c4f94d79d-cv6xz" event={"ID":"133b0f82-7d80-47e1-9611-063840bfa2d6","Type":"ContainerStarted","Data":"144636523f342e95002c5499a8e0de6de783e8f95fecb47e4c59189f644d0b2b"}
Jul 06 02:50:56.111505 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:56.111479    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6946c67598-shdkx" event={"ID":"61662d35-3751-4f94-88ef-9d7652146a29","Type":"ContainerStarted","Data":"922688c48bb77685b7e4da299cb776f4459992bfb716e5631f98f34becd51fa4"}
Jul 06 02:50:56.111610 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:56.111512    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6946c67598-shdkx" event={"ID":"61662d35-3751-4f94-88ef-9d7652146a29","Type":"ContainerStarted","Data":"691ea371b511575c7176f34b4d2a80b9c05259350549c426e1dfc8bb5fcf73b4"}
Jul 06 02:50:56.111610 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:56.111576    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-6946c67598-shdkx" podUID="61662d35-3751-4f94-88ef-9d7652146a29" containerName="authorino" containerID="cri-o://922688c48bb77685b7e4da299cb776f4459992bfb716e5631f98f34becd51fa4" gracePeriod=30
Jul 06 02:50:56.122722 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:56.122683    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-srfhc" podStartSLOduration=1.757825024 podStartE2EDuration="2.122669785s" totalImagesPullingTime="364.844761ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:50:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:50:56.121793292 +0000 UTC m=+709.778802962" watchObservedRunningTime="2026-07-06 02:50:56.122669785 +0000 UTC m=+709.779679449"
Jul 06 02:50:56.138648 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:56.138602    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6946c67598-shdkx" podStartSLOduration=1.7968697630000001 podStartE2EDuration="2.138585154s" totalImagesPullingTime="341.715391ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:50:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:50:56.13586161 +0000 UTC m=+709.792871256" watchObservedRunningTime="2026-07-06 02:50:56.138585154 +0000 UTC m=+709.795594819"
Jul 06 02:50:56.394921 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:56.394894    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-srfhc"
Jul 06 02:50:56.406285 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:56.406260    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vblxg\" (UniqueName: \"kubernetes.io/projected/7c8bf10b-e57a-4840-a64d-8990645ef659-kube-api-access-vblxg\") pod \"7c8bf10b-e57a-4840-a64d-8990645ef659\" (UID: \"7c8bf10b-e57a-4840-a64d-8990645ef659\") "
Jul 06 02:50:56.408197 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:56.408170    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c8bf10b-e57a-4840-a64d-8990645ef659-kube-api-access-vblxg" (OuterVolumeSpecName: "kube-api-access-vblxg") pod "7c8bf10b-e57a-4840-a64d-8990645ef659" (UID: "7c8bf10b-e57a-4840-a64d-8990645ef659"). InnerVolumeSpecName "kube-api-access-vblxg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 02:50:56.410951 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:56.410931    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6946c67598-shdkx"
Jul 06 02:50:56.507769 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:56.507733    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpplh\" (UniqueName: \"kubernetes.io/projected/61662d35-3751-4f94-88ef-9d7652146a29-kube-api-access-hpplh\") pod \"61662d35-3751-4f94-88ef-9d7652146a29\" (UID: \"61662d35-3751-4f94-88ef-9d7652146a29\") "
Jul 06 02:50:56.508177 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:56.507850    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vblxg\" (UniqueName: \"kubernetes.io/projected/7c8bf10b-e57a-4840-a64d-8990645ef659-kube-api-access-vblxg\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:50:56.509691 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:56.509669    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61662d35-3751-4f94-88ef-9d7652146a29-kube-api-access-hpplh" (OuterVolumeSpecName: "kube-api-access-hpplh") pod "61662d35-3751-4f94-88ef-9d7652146a29" (UID: "61662d35-3751-4f94-88ef-9d7652146a29"). InnerVolumeSpecName "kube-api-access-hpplh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 02:50:56.608256 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:56.608181    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpplh\" (UniqueName: \"kubernetes.io/projected/61662d35-3751-4f94-88ef-9d7652146a29-kube-api-access-hpplh\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:50:57.119822 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:57.119787    2570 generic.go:356] "Generic (PLEG): container finished" podID="61662d35-3751-4f94-88ef-9d7652146a29" containerID="922688c48bb77685b7e4da299cb776f4459992bfb716e5631f98f34becd51fa4" exitCode=0
Jul 06 02:50:57.120077 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:57.119833    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6946c67598-shdkx"
Jul 06 02:50:57.120077 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:57.119867    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6946c67598-shdkx" event={"ID":"61662d35-3751-4f94-88ef-9d7652146a29","Type":"ContainerDied","Data":"922688c48bb77685b7e4da299cb776f4459992bfb716e5631f98f34becd51fa4"}
Jul 06 02:50:57.120077 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:57.119911    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6946c67598-shdkx" event={"ID":"61662d35-3751-4f94-88ef-9d7652146a29","Type":"ContainerDied","Data":"691ea371b511575c7176f34b4d2a80b9c05259350549c426e1dfc8bb5fcf73b4"}
Jul 06 02:50:57.120077 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:57.119930    2570 scope.go:117] "RemoveContainer" containerID="922688c48bb77685b7e4da299cb776f4459992bfb716e5631f98f34becd51fa4"
Jul 06 02:50:57.121316 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:57.121249    2570 generic.go:356] "Generic (PLEG): container finished" podID="7c8bf10b-e57a-4840-a64d-8990645ef659" containerID="fb38fbe7531f48ac34bf606c4a5819514648c91e01d2c6045111c78fa35a7461" exitCode=0
Jul 06 02:50:57.121316 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:57.121280    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-srfhc"
Jul 06 02:50:57.121435 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:57.121333    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-srfhc" event={"ID":"7c8bf10b-e57a-4840-a64d-8990645ef659","Type":"ContainerDied","Data":"fb38fbe7531f48ac34bf606c4a5819514648c91e01d2c6045111c78fa35a7461"}
Jul 06 02:50:57.121435 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:57.121373    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-srfhc" event={"ID":"7c8bf10b-e57a-4840-a64d-8990645ef659","Type":"ContainerDied","Data":"6690ce2a26e1d280828074e01841f29c8775b4869d31faea42f0c9101c3850b2"}
Jul 06 02:50:57.123106 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:57.123080    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c4f94d79d-cv6xz" event={"ID":"133b0f82-7d80-47e1-9611-063840bfa2d6","Type":"ContainerStarted","Data":"6fa7f3fd789193da2c92b3824eb076be587aec4e5f5da27921e649439b70dc95"}
Jul 06 02:50:57.130450 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:57.130430    2570 scope.go:117] "RemoveContainer" containerID="922688c48bb77685b7e4da299cb776f4459992bfb716e5631f98f34becd51fa4"
Jul 06 02:50:57.134031 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:50:57.134003    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"922688c48bb77685b7e4da299cb776f4459992bfb716e5631f98f34becd51fa4\": container with ID starting with 922688c48bb77685b7e4da299cb776f4459992bfb716e5631f98f34becd51fa4 not found: ID does not exist" containerID="922688c48bb77685b7e4da299cb776f4459992bfb716e5631f98f34becd51fa4"
Jul 06 02:50:57.134131 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:57.134041    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"922688c48bb77685b7e4da299cb776f4459992bfb716e5631f98f34becd51fa4"} err="failed to get container status \"922688c48bb77685b7e4da299cb776f4459992bfb716e5631f98f34becd51fa4\": rpc error: code = NotFound desc = could not find container \"922688c48bb77685b7e4da299cb776f4459992bfb716e5631f98f34becd51fa4\": container with ID starting with 922688c48bb77685b7e4da299cb776f4459992bfb716e5631f98f34becd51fa4 not found: ID does not exist"
Jul 06 02:50:57.134131 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:57.134064    2570 scope.go:117] "RemoveContainer" containerID="fb38fbe7531f48ac34bf606c4a5819514648c91e01d2c6045111c78fa35a7461"
Jul 06 02:50:57.141857 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:57.141795    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-c4f94d79d-cv6xz" podStartSLOduration=1.765320913 podStartE2EDuration="2.141777068s" totalImagesPullingTime="376.456155ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:50:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:50:57.140755111 +0000 UTC m=+710.797764775" watchObservedRunningTime="2026-07-06 02:50:57.141777068 +0000 UTC m=+710.798786736"
Jul 06 02:50:57.142273 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:57.142257    2570 scope.go:117] "RemoveContainer" containerID="fb38fbe7531f48ac34bf606c4a5819514648c91e01d2c6045111c78fa35a7461"
Jul 06 02:50:57.142503 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:50:57.142487    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb38fbe7531f48ac34bf606c4a5819514648c91e01d2c6045111c78fa35a7461\": container with ID starting with fb38fbe7531f48ac34bf606c4a5819514648c91e01d2c6045111c78fa35a7461 not found: ID does not exist" containerID="fb38fbe7531f48ac34bf606c4a5819514648c91e01d2c6045111c78fa35a7461"
Jul 06 02:50:57.142560 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:57.142509    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb38fbe7531f48ac34bf606c4a5819514648c91e01d2c6045111c78fa35a7461"} err="failed to get container status \"fb38fbe7531f48ac34bf606c4a5819514648c91e01d2c6045111c78fa35a7461\": rpc error: code = NotFound desc = could not find container \"fb38fbe7531f48ac34bf606c4a5819514648c91e01d2c6045111c78fa35a7461\": container with ID starting with fb38fbe7531f48ac34bf606c4a5819514648c91e01d2c6045111c78fa35a7461 not found: ID does not exist"
Jul 06 02:50:57.154737 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:57.154712    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6946c67598-shdkx"]
Jul 06 02:50:57.160076 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:57.160056    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6946c67598-shdkx"]
Jul 06 02:50:57.169521 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:57.169458    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vrlnh"]
Jul 06 02:50:57.169677 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:57.169655    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-vrlnh" podUID="60529873-39f1-4c9a-ad92-61bb94bf92f3" containerName="authorino" containerID="cri-o://d8d399e059eab1572ed775f189e76587fcb76b1d328ec9236850fa4987d0f728" gracePeriod=30
Jul 06 02:50:57.174300 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:57.174266    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-srfhc"]
Jul 06 02:50:57.182692 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:57.182666    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-srfhc"]
Jul 06 02:50:57.233190 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:57.233156    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61662d35-3751-4f94-88ef-9d7652146a29" path="/var/lib/kubelet/pods/61662d35-3751-4f94-88ef-9d7652146a29/volumes"
Jul 06 02:50:57.233547 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:57.233528    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c8bf10b-e57a-4840-a64d-8990645ef659" path="/var/lib/kubelet/pods/7c8bf10b-e57a-4840-a64d-8990645ef659/volumes"
Jul 06 02:50:57.423599 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:57.423539    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vrlnh"
Jul 06 02:50:57.515798 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:57.515767    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdgfs\" (UniqueName: \"kubernetes.io/projected/60529873-39f1-4c9a-ad92-61bb94bf92f3-kube-api-access-qdgfs\") pod \"60529873-39f1-4c9a-ad92-61bb94bf92f3\" (UID: \"60529873-39f1-4c9a-ad92-61bb94bf92f3\") "
Jul 06 02:50:57.517745 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:57.517715    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60529873-39f1-4c9a-ad92-61bb94bf92f3-kube-api-access-qdgfs" (OuterVolumeSpecName: "kube-api-access-qdgfs") pod "60529873-39f1-4c9a-ad92-61bb94bf92f3" (UID: "60529873-39f1-4c9a-ad92-61bb94bf92f3"). InnerVolumeSpecName "kube-api-access-qdgfs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 02:50:57.616909 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:57.616874    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdgfs\" (UniqueName: \"kubernetes.io/projected/60529873-39f1-4c9a-ad92-61bb94bf92f3-kube-api-access-qdgfs\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:50:58.130535 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:58.130499    2570 generic.go:356] "Generic (PLEG): container finished" podID="60529873-39f1-4c9a-ad92-61bb94bf92f3" containerID="d8d399e059eab1572ed775f189e76587fcb76b1d328ec9236850fa4987d0f728" exitCode=0
Jul 06 02:50:58.130733 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:58.130561    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vrlnh"
Jul 06 02:50:58.130733 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:58.130581    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vrlnh" event={"ID":"60529873-39f1-4c9a-ad92-61bb94bf92f3","Type":"ContainerDied","Data":"d8d399e059eab1572ed775f189e76587fcb76b1d328ec9236850fa4987d0f728"}
Jul 06 02:50:58.130733 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:58.130622    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vrlnh" event={"ID":"60529873-39f1-4c9a-ad92-61bb94bf92f3","Type":"ContainerDied","Data":"be232b2036f32718f6b0329fc92249c2ef6e8aedf5875028b27cf09d3690dbf7"}
Jul 06 02:50:58.130733 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:58.130639    2570 scope.go:117] "RemoveContainer" containerID="d8d399e059eab1572ed775f189e76587fcb76b1d328ec9236850fa4987d0f728"
Jul 06 02:50:58.139221 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:58.139206    2570 scope.go:117] "RemoveContainer" containerID="d8d399e059eab1572ed775f189e76587fcb76b1d328ec9236850fa4987d0f728"
Jul 06 02:50:58.139450 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:50:58.139431    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8d399e059eab1572ed775f189e76587fcb76b1d328ec9236850fa4987d0f728\": container with ID starting with d8d399e059eab1572ed775f189e76587fcb76b1d328ec9236850fa4987d0f728 not found: ID does not exist" containerID="d8d399e059eab1572ed775f189e76587fcb76b1d328ec9236850fa4987d0f728"
Jul 06 02:50:58.139519 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:58.139455    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8d399e059eab1572ed775f189e76587fcb76b1d328ec9236850fa4987d0f728"} err="failed to get container status \"d8d399e059eab1572ed775f189e76587fcb76b1d328ec9236850fa4987d0f728\": rpc error: code = NotFound desc = could not find container \"d8d399e059eab1572ed775f189e76587fcb76b1d328ec9236850fa4987d0f728\": container with ID starting with d8d399e059eab1572ed775f189e76587fcb76b1d328ec9236850fa4987d0f728 not found: ID does not exist"
Jul 06 02:50:58.151413 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:58.151388    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vrlnh"]
Jul 06 02:50:58.154911 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:58.154890    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vrlnh"]
Jul 06 02:50:59.233831 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:50:59.233759    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60529873-39f1-4c9a-ad92-61bb94bf92f3" path="/var/lib/kubelet/pods/60529873-39f1-4c9a-ad92-61bb94bf92f3/volumes"
Jul 06 02:51:01.454594 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:51:01.454567    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:51:01.546743 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:51:01.546713    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:51:01.637147 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:51:01.637113    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:51:01.705043 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:51:01.704936    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:51:04.944645 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:51:04.944606    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:51:05.042798 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:51:05.042762    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:51:37.638581 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:51:37.638541    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:51:38.042607 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:51:38.042569    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:51:38.342465 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:51:38.342367    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:51:38.468455 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:51:38.468425    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:51:38.558891 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:51:38.558833    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:51:38.601419 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:51:38.601299    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-4w5xk"]
Jul 06 02:51:38.601854 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:51:38.601836    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60529873-39f1-4c9a-ad92-61bb94bf92f3" containerName="authorino"
Jul 06 02:51:38.601908 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:51:38.601858    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="60529873-39f1-4c9a-ad92-61bb94bf92f3" containerName="authorino"
Jul 06 02:51:38.601908 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:51:38.601876    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61662d35-3751-4f94-88ef-9d7652146a29" containerName="authorino"
Jul 06 02:51:38.601908 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:51:38.601885    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="61662d35-3751-4f94-88ef-9d7652146a29" containerName="authorino"
Jul 06 02:51:38.602052 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:51:38.601910    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c8bf10b-e57a-4840-a64d-8990645ef659" containerName="authorino"
Jul 06 02:51:38.602052 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:51:38.601918    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c8bf10b-e57a-4840-a64d-8990645ef659" containerName="authorino"
Jul 06 02:51:38.602052 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:51:38.602014    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c8bf10b-e57a-4840-a64d-8990645ef659" containerName="authorino"
Jul 06 02:51:38.602052 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:51:38.602024    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="61662d35-3751-4f94-88ef-9d7652146a29" containerName="authorino"
Jul 06 02:51:38.602052 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:51:38.602033    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="60529873-39f1-4c9a-ad92-61bb94bf92f3" containerName="authorino"
Jul 06 02:51:38.604844 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:51:38.604827    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-4w5xk"
Jul 06 02:51:38.607240 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:51:38.607218    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 06 02:51:38.607370 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:51:38.607275    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-rjdlp\""
Jul 06 02:51:38.614150 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:51:38.614127    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-4w5xk"]
Jul 06 02:51:38.744088 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:51:38.744047    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9a836c2-3967-4051-8379-f1fa7274140b-plugins-config-volume\") pod \"payload-processing-58f86c7798-4w5xk\" (UID: \"a9a836c2-3967-4051-8379-f1fa7274140b\") " pod="openshift-ingress/payload-processing-58f86c7798-4w5xk"
Jul 06 02:51:38.744472 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:51:38.744115    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xwgq\" (UniqueName: \"kubernetes.io/projected/a9a836c2-3967-4051-8379-f1fa7274140b-kube-api-access-6xwgq\") pod \"payload-processing-58f86c7798-4w5xk\" (UID: \"a9a836c2-3967-4051-8379-f1fa7274140b\") " pod="openshift-ingress/payload-processing-58f86c7798-4w5xk"
Jul 06 02:51:38.845057 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:51:38.845025    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9a836c2-3967-4051-8379-f1fa7274140b-plugins-config-volume\") pod \"payload-processing-58f86c7798-4w5xk\" (UID: \"a9a836c2-3967-4051-8379-f1fa7274140b\") " pod="openshift-ingress/payload-processing-58f86c7798-4w5xk"
Jul 06 02:51:38.845234 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:51:38.845085    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xwgq\" (UniqueName: \"kubernetes.io/projected/a9a836c2-3967-4051-8379-f1fa7274140b-kube-api-access-6xwgq\") pod \"payload-processing-58f86c7798-4w5xk\" (UID: \"a9a836c2-3967-4051-8379-f1fa7274140b\") " pod="openshift-ingress/payload-processing-58f86c7798-4w5xk"
Jul 06 02:51:38.845785 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:51:38.845765    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9a836c2-3967-4051-8379-f1fa7274140b-plugins-config-volume\") pod \"payload-processing-58f86c7798-4w5xk\" (UID: \"a9a836c2-3967-4051-8379-f1fa7274140b\") " pod="openshift-ingress/payload-processing-58f86c7798-4w5xk"
Jul 06 02:51:38.852318 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:51:38.852255    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xwgq\" (UniqueName: \"kubernetes.io/projected/a9a836c2-3967-4051-8379-f1fa7274140b-kube-api-access-6xwgq\") pod \"payload-processing-58f86c7798-4w5xk\" (UID: \"a9a836c2-3967-4051-8379-f1fa7274140b\") " pod="openshift-ingress/payload-processing-58f86c7798-4w5xk"
Jul 06 02:51:38.914818 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:51:38.914793    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-4w5xk"
Jul 06 02:51:39.040300 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:51:39.040274    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-4w5xk"]
Jul 06 02:51:39.042977 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:51:39.042951    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9a836c2_3967_4051_8379_f1fa7274140b.slice/crio-0ebb1854d9c3ce998b96cba906e58d5f2579caff6b5232ba6fcfb9e22d48f284 WatchSource:0}: Error finding container 0ebb1854d9c3ce998b96cba906e58d5f2579caff6b5232ba6fcfb9e22d48f284: Status 404 returned error can't find the container with id 0ebb1854d9c3ce998b96cba906e58d5f2579caff6b5232ba6fcfb9e22d48f284
Jul 06 02:51:39.333308 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:51:39.333280    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-4w5xk" event={"ID":"a9a836c2-3967-4051-8379-f1fa7274140b","Type":"ContainerStarted","Data":"0ebb1854d9c3ce998b96cba906e58d5f2579caff6b5232ba6fcfb9e22d48f284"}
Jul 06 02:51:40.340292 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:51:40.340259    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-4w5xk" event={"ID":"a9a836c2-3967-4051-8379-f1fa7274140b","Type":"ContainerStarted","Data":"7041235715da4d01a33dbc7986e5cb63b7954e7be961582a18220c4085829a07"}
Jul 06 02:51:40.340643 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:51:40.340384    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-4w5xk"
Jul 06 02:51:40.354883 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:51:40.354824    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-4w5xk" podStartSLOduration=1.164792967 podStartE2EDuration="2.35480266s" totalImagesPullingTime="1.190009693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:51:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:51:40.35366308 +0000 UTC m=+754.010672744" watchObservedRunningTime="2026-07-06 02:51:40.35480266 +0000 UTC m=+754.011812325"
Jul 06 02:51:40.518674 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:51:40.518588    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:51:48.390111 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:51:48.390037    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:51:48.490231 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:51:48.490196    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:51:51.347093 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:51:51.347066    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-4w5xk"
Jul 06 02:51:57.463028 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:51:57.462964    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:52:12.282561 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:12.282526    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:52:18.168125 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:18.168086    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-9tr2g"]
Jul 06 02:52:18.173076 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:18.173057    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tr2g"
Jul 06 02:52:18.175306 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:18.175292    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 06 02:52:18.175408 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:18.175303    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 06 02:52:18.176243 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:18.176223    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-bdtkj\""
Jul 06 02:52:18.176243 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:18.176236    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 06 02:52:18.179568 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:18.179545    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-9tr2g"]
Jul 06 02:52:18.197605 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:18.197575    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:52:18.241848 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:18.241823    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03edc717-7a72-4523-b79a-dfaae03fef49-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9tr2g\" (UID: \"03edc717-7a72-4523-b79a-dfaae03fef49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tr2g"
Jul 06 02:52:18.241948 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:18.241860    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03edc717-7a72-4523-b79a-dfaae03fef49-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9tr2g\" (UID: \"03edc717-7a72-4523-b79a-dfaae03fef49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tr2g"
Jul 06 02:52:18.241948 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:18.241882    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03edc717-7a72-4523-b79a-dfaae03fef49-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9tr2g\" (UID: \"03edc717-7a72-4523-b79a-dfaae03fef49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tr2g"
Jul 06 02:52:18.241948 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:18.241931    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03edc717-7a72-4523-b79a-dfaae03fef49-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9tr2g\" (UID: \"03edc717-7a72-4523-b79a-dfaae03fef49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tr2g"
Jul 06 02:52:18.242118 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:18.242094    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03edc717-7a72-4523-b79a-dfaae03fef49-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9tr2g\" (UID: \"03edc717-7a72-4523-b79a-dfaae03fef49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tr2g"
Jul 06 02:52:18.242174 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:18.242157    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffhn9\" (UniqueName: \"kubernetes.io/projected/03edc717-7a72-4523-b79a-dfaae03fef49-kube-api-access-ffhn9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9tr2g\" (UID: \"03edc717-7a72-4523-b79a-dfaae03fef49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tr2g"
Jul 06 02:52:18.343471 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:18.343446    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03edc717-7a72-4523-b79a-dfaae03fef49-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9tr2g\" (UID: \"03edc717-7a72-4523-b79a-dfaae03fef49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tr2g"
Jul 06 02:52:18.343549 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:18.343485    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03edc717-7a72-4523-b79a-dfaae03fef49-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9tr2g\" (UID: \"03edc717-7a72-4523-b79a-dfaae03fef49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tr2g"
Jul 06 02:52:18.343549 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:18.343504    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03edc717-7a72-4523-b79a-dfaae03fef49-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9tr2g\" (UID: \"03edc717-7a72-4523-b79a-dfaae03fef49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tr2g"
Jul 06 02:52:18.343549 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:18.343536    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03edc717-7a72-4523-b79a-dfaae03fef49-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9tr2g\" (UID: \"03edc717-7a72-4523-b79a-dfaae03fef49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tr2g"
Jul 06 02:52:18.343675 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:18.343582    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03edc717-7a72-4523-b79a-dfaae03fef49-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9tr2g\" (UID: \"03edc717-7a72-4523-b79a-dfaae03fef49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tr2g"
Jul 06 02:52:18.343675 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:18.343610    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffhn9\" (UniqueName: \"kubernetes.io/projected/03edc717-7a72-4523-b79a-dfaae03fef49-kube-api-access-ffhn9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9tr2g\" (UID: \"03edc717-7a72-4523-b79a-dfaae03fef49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tr2g"
Jul 06 02:52:18.343902 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:18.343879    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03edc717-7a72-4523-b79a-dfaae03fef49-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9tr2g\" (UID: \"03edc717-7a72-4523-b79a-dfaae03fef49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tr2g"
Jul 06 02:52:18.343902 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:18.343895    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03edc717-7a72-4523-b79a-dfaae03fef49-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9tr2g\" (UID: \"03edc717-7a72-4523-b79a-dfaae03fef49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tr2g"
Jul 06 02:52:18.344050 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:18.344031    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03edc717-7a72-4523-b79a-dfaae03fef49-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9tr2g\" (UID: \"03edc717-7a72-4523-b79a-dfaae03fef49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tr2g"
Jul 06 02:52:18.345768 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:18.345749    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03edc717-7a72-4523-b79a-dfaae03fef49-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9tr2g\" (UID: \"03edc717-7a72-4523-b79a-dfaae03fef49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tr2g"
Jul 06 02:52:18.346099 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:18.346082    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03edc717-7a72-4523-b79a-dfaae03fef49-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9tr2g\" (UID: \"03edc717-7a72-4523-b79a-dfaae03fef49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tr2g"
Jul 06 02:52:18.350944 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:18.350920    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffhn9\" (UniqueName: \"kubernetes.io/projected/03edc717-7a72-4523-b79a-dfaae03fef49-kube-api-access-ffhn9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9tr2g\" (UID: \"03edc717-7a72-4523-b79a-dfaae03fef49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tr2g"
Jul 06 02:52:18.484813 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:18.484733    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tr2g"
Jul 06 02:52:18.618485 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:18.618462    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-9tr2g"]
Jul 06 02:52:18.620259 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:52:18.620228    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03edc717_7a72_4523_b79a_dfaae03fef49.slice/crio-1709375620c9c03158e680731bafeb37572213f326f130f2221a1e39d3ff93fb WatchSource:0}: Error finding container 1709375620c9c03158e680731bafeb37572213f326f130f2221a1e39d3ff93fb: Status 404 returned error can't find the container with id 1709375620c9c03158e680731bafeb37572213f326f130f2221a1e39d3ff93fb
Jul 06 02:52:19.539196 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:19.539156    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tr2g" event={"ID":"03edc717-7a72-4523-b79a-dfaae03fef49","Type":"ContainerStarted","Data":"1709375620c9c03158e680731bafeb37572213f326f130f2221a1e39d3ff93fb"}
Jul 06 02:52:20.545490 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:20.545457    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tr2g" event={"ID":"03edc717-7a72-4523-b79a-dfaae03fef49","Type":"ContainerStarted","Data":"867bfa82ad8d4847ed5f1016b1cf83ed255fca76ccaa0351ada54ed235178986"}
Jul 06 02:52:20.561993 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:20.561945    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tr2g" podStartSLOduration=1.54018933 podStartE2EDuration="2.561928425s" totalImagesPullingTime="1.021739095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:52:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:52:20.560900152 +0000 UTC m=+794.217909827" watchObservedRunningTime="2026-07-06 02:52:20.561928425 +0000 UTC m=+794.218938089"
Jul 06 02:52:28.485461 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:28.485429    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tr2g"
Jul 06 02:52:28.485897 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:28.485481    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tr2g"
Jul 06 02:52:28.497878 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:28.497854    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tr2g"
Jul 06 02:52:28.597817 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:28.597789    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9tr2g"
Jul 06 02:52:44.163902 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:44.163824    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz"]
Jul 06 02:52:44.167187 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:44.167170    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz"
Jul 06 02:52:44.169626 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:44.169602    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 06 02:52:44.177198 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:44.177177    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz"]
Jul 06 02:52:44.190696 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:44.190669    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:52:44.250411 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:44.250385    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52533cee-e7b2-4b9a-83ba-ac34661c07b9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz\" (UID: \"52533cee-e7b2-4b9a-83ba-ac34661c07b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz"
Jul 06 02:52:44.250519 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:44.250428    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52533cee-e7b2-4b9a-83ba-ac34661c07b9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz\" (UID: \"52533cee-e7b2-4b9a-83ba-ac34661c07b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz"
Jul 06 02:52:44.250519 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:44.250490    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqckv\" (UniqueName: \"kubernetes.io/projected/52533cee-e7b2-4b9a-83ba-ac34661c07b9-kube-api-access-pqckv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz\" (UID: \"52533cee-e7b2-4b9a-83ba-ac34661c07b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz"
Jul 06 02:52:44.250647 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:44.250531    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52533cee-e7b2-4b9a-83ba-ac34661c07b9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz\" (UID: \"52533cee-e7b2-4b9a-83ba-ac34661c07b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz"
Jul 06 02:52:44.250647 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:44.250558    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52533cee-e7b2-4b9a-83ba-ac34661c07b9-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz\" (UID: \"52533cee-e7b2-4b9a-83ba-ac34661c07b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz"
Jul 06 02:52:44.250647 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:44.250596    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52533cee-e7b2-4b9a-83ba-ac34661c07b9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz\" (UID: \"52533cee-e7b2-4b9a-83ba-ac34661c07b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz"
Jul 06 02:52:44.351192 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:44.351168    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52533cee-e7b2-4b9a-83ba-ac34661c07b9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz\" (UID: \"52533cee-e7b2-4b9a-83ba-ac34661c07b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz"
Jul 06 02:52:44.351295 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:44.351206    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqckv\" (UniqueName: \"kubernetes.io/projected/52533cee-e7b2-4b9a-83ba-ac34661c07b9-kube-api-access-pqckv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz\" (UID: \"52533cee-e7b2-4b9a-83ba-ac34661c07b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz"
Jul 06 02:52:44.351295 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:44.351232    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52533cee-e7b2-4b9a-83ba-ac34661c07b9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz\" (UID: \"52533cee-e7b2-4b9a-83ba-ac34661c07b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz"
Jul 06 02:52:44.351295 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:44.351248    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52533cee-e7b2-4b9a-83ba-ac34661c07b9-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz\" (UID: \"52533cee-e7b2-4b9a-83ba-ac34661c07b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz"
Jul 06 02:52:44.351453 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:44.351360    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52533cee-e7b2-4b9a-83ba-ac34661c07b9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz\" (UID: \"52533cee-e7b2-4b9a-83ba-ac34661c07b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz"
Jul 06 02:52:44.351453 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:44.351426    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52533cee-e7b2-4b9a-83ba-ac34661c07b9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz\" (UID: \"52533cee-e7b2-4b9a-83ba-ac34661c07b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz"
Jul 06 02:52:44.351632 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:44.351609    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52533cee-e7b2-4b9a-83ba-ac34661c07b9-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz\" (UID: \"52533cee-e7b2-4b9a-83ba-ac34661c07b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz"
Jul 06 02:52:44.351710 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:44.351649    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/52533cee-e7b2-4b9a-83ba-ac34661c07b9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz\" (UID: \"52533cee-e7b2-4b9a-83ba-ac34661c07b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz"
Jul 06 02:52:44.351710 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:44.351689    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/52533cee-e7b2-4b9a-83ba-ac34661c07b9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz\" (UID: \"52533cee-e7b2-4b9a-83ba-ac34661c07b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz"
Jul 06 02:52:44.353628 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:44.353609    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/52533cee-e7b2-4b9a-83ba-ac34661c07b9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz\" (UID: \"52533cee-e7b2-4b9a-83ba-ac34661c07b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz"
Jul 06 02:52:44.353710 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:44.353634    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52533cee-e7b2-4b9a-83ba-ac34661c07b9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz\" (UID: \"52533cee-e7b2-4b9a-83ba-ac34661c07b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz"
Jul 06 02:52:44.358626 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:44.358606    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqckv\" (UniqueName: \"kubernetes.io/projected/52533cee-e7b2-4b9a-83ba-ac34661c07b9-kube-api-access-pqckv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz\" (UID: \"52533cee-e7b2-4b9a-83ba-ac34661c07b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz"
Jul 06 02:52:44.477916 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:44.477828    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz"
Jul 06 02:52:44.605941 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:44.605917    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz"]
Jul 06 02:52:44.607685 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:52:44.607656    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52533cee_e7b2_4b9a_83ba_ac34661c07b9.slice/crio-521bc65cf2f5189e6fc914340dd72afbc217ddbcd467400a6008ca8c741f4660 WatchSource:0}: Error finding container 521bc65cf2f5189e6fc914340dd72afbc217ddbcd467400a6008ca8c741f4660: Status 404 returned error can't find the container with id 521bc65cf2f5189e6fc914340dd72afbc217ddbcd467400a6008ca8c741f4660
Jul 06 02:52:44.668270 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:44.668238    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz" event={"ID":"52533cee-e7b2-4b9a-83ba-ac34661c07b9","Type":"ContainerStarted","Data":"521bc65cf2f5189e6fc914340dd72afbc217ddbcd467400a6008ca8c741f4660"}
Jul 06 02:52:45.687791 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:45.687750    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz" event={"ID":"52533cee-e7b2-4b9a-83ba-ac34661c07b9","Type":"ContainerStarted","Data":"b6a869feca69fd7dea126bb2b69c4a4aa7e3f0e9fe4a45cb3630cd65058e628b"}
Jul 06 02:52:45.705331 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:45.705283    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz" podStartSLOduration=1.5305227000000001 podStartE2EDuration="1.705267743s" totalImagesPullingTime="174.745043ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:52:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:52:45.703496261 +0000 UTC m=+819.360505924" watchObservedRunningTime="2026-07-06 02:52:45.705267743 +0000 UTC m=+819.362277457"
Jul 06 02:52:51.499487 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:51.499444    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:52:54.478364 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:54.478322    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz"
Jul 06 02:52:54.478824 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:54.478420    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz"
Jul 06 02:52:54.491458 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:54.491432    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz"
Jul 06 02:52:54.751752 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:54.751676    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz"
Jul 06 02:52:57.143125 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:57.143081    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:52:57.196324 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:52:57.196294    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:53:07.874105 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:53:07.874070    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl"]
Jul 06 02:53:07.877546 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:53:07.877527    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl"
Jul 06 02:53:07.879975 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:53:07.879953    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 06 02:53:07.887676 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:53:07.887651    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl"]
Jul 06 02:53:07.895331 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:53:07.895307    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:53:07.947056 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:53:07.947031    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c709807f-ace8-40bf-b81f-d7ea0cf27545-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl\" (UID: \"c709807f-ace8-40bf-b81f-d7ea0cf27545\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl"
Jul 06 02:53:07.947155 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:53:07.947075    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c709807f-ace8-40bf-b81f-d7ea0cf27545-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl\" (UID: \"c709807f-ace8-40bf-b81f-d7ea0cf27545\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl"
Jul 06 02:53:07.947208 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:53:07.947149    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fr5k\" (UniqueName: \"kubernetes.io/projected/c709807f-ace8-40bf-b81f-d7ea0cf27545-kube-api-access-8fr5k\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl\" (UID: \"c709807f-ace8-40bf-b81f-d7ea0cf27545\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl"
Jul 06 02:53:07.947258 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:53:07.947207    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c709807f-ace8-40bf-b81f-d7ea0cf27545-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl\" (UID: \"c709807f-ace8-40bf-b81f-d7ea0cf27545\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl"
Jul 06 02:53:07.947258 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:53:07.947232    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c709807f-ace8-40bf-b81f-d7ea0cf27545-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl\" (UID: \"c709807f-ace8-40bf-b81f-d7ea0cf27545\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl"
Jul 06 02:53:07.947370 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:53:07.947291    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c709807f-ace8-40bf-b81f-d7ea0cf27545-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl\" (UID: \"c709807f-ace8-40bf-b81f-d7ea0cf27545\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl"
Jul 06 02:53:08.048093 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:53:08.048056    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c709807f-ace8-40bf-b81f-d7ea0cf27545-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl\" (UID: \"c709807f-ace8-40bf-b81f-d7ea0cf27545\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl"
Jul 06 02:53:08.048202 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:53:08.048106    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c709807f-ace8-40bf-b81f-d7ea0cf27545-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl\" (UID: \"c709807f-ace8-40bf-b81f-d7ea0cf27545\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl"
Jul 06 02:53:08.048202 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:53:08.048153    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c709807f-ace8-40bf-b81f-d7ea0cf27545-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl\" (UID: \"c709807f-ace8-40bf-b81f-d7ea0cf27545\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl"
Jul 06 02:53:08.048314 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:53:08.048205    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fr5k\" (UniqueName: \"kubernetes.io/projected/c709807f-ace8-40bf-b81f-d7ea0cf27545-kube-api-access-8fr5k\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl\" (UID: \"c709807f-ace8-40bf-b81f-d7ea0cf27545\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl"
Jul 06 02:53:08.048314 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:53:08.048263    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c709807f-ace8-40bf-b81f-d7ea0cf27545-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl\" (UID: \"c709807f-ace8-40bf-b81f-d7ea0cf27545\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl"
Jul 06 02:53:08.048314 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:53:08.048295    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c709807f-ace8-40bf-b81f-d7ea0cf27545-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl\" (UID: \"c709807f-ace8-40bf-b81f-d7ea0cf27545\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl"
Jul 06 02:53:08.048501 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:53:08.048481    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c709807f-ace8-40bf-b81f-d7ea0cf27545-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl\" (UID: \"c709807f-ace8-40bf-b81f-d7ea0cf27545\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl"
Jul 06 02:53:08.048577 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:53:08.048531    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c709807f-ace8-40bf-b81f-d7ea0cf27545-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl\" (UID: \"c709807f-ace8-40bf-b81f-d7ea0cf27545\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl"
Jul 06 02:53:08.048635 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:53:08.048587    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c709807f-ace8-40bf-b81f-d7ea0cf27545-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl\" (UID: \"c709807f-ace8-40bf-b81f-d7ea0cf27545\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl"
Jul 06 02:53:08.050344 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:53:08.050325    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c709807f-ace8-40bf-b81f-d7ea0cf27545-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl\" (UID: \"c709807f-ace8-40bf-b81f-d7ea0cf27545\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl"
Jul 06 02:53:08.050724 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:53:08.050702    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c709807f-ace8-40bf-b81f-d7ea0cf27545-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl\" (UID: \"c709807f-ace8-40bf-b81f-d7ea0cf27545\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl"
Jul 06 02:53:08.056296 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:53:08.056271    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fr5k\" (UniqueName: \"kubernetes.io/projected/c709807f-ace8-40bf-b81f-d7ea0cf27545-kube-api-access-8fr5k\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl\" (UID: \"c709807f-ace8-40bf-b81f-d7ea0cf27545\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl"
Jul 06 02:53:08.187426 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:53:08.187341    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl"
Jul 06 02:53:08.317861 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:53:08.317836    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl"]
Jul 06 02:53:08.320040 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:53:08.320013    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc709807f_ace8_40bf_b81f_d7ea0cf27545.slice/crio-cc4c1efab9646f6a6760a0778583f05f3435ea92d6b17ad6bf0f624e0361d951 WatchSource:0}: Error finding container cc4c1efab9646f6a6760a0778583f05f3435ea92d6b17ad6bf0f624e0361d951: Status 404 returned error can't find the container with id cc4c1efab9646f6a6760a0778583f05f3435ea92d6b17ad6bf0f624e0361d951
Jul 06 02:53:08.812949 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:53:08.812916    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl" event={"ID":"c709807f-ace8-40bf-b81f-d7ea0cf27545","Type":"ContainerStarted","Data":"51a8e3bd2f8686ba1a45fc55ba2cf800890b8a2d26510f2411ba28d36746665b"}
Jul 06 02:53:08.813139 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:53:08.812960    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl" event={"ID":"c709807f-ace8-40bf-b81f-d7ea0cf27545","Type":"ContainerStarted","Data":"cc4c1efab9646f6a6760a0778583f05f3435ea92d6b17ad6bf0f624e0361d951"}
Jul 06 02:53:08.829545 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:53:08.829494    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl" podStartSLOduration=1.669647833 podStartE2EDuration="1.829478335s" totalImagesPullingTime="159.830502ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:53:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:53:08.828285928 +0000 UTC m=+842.485295592" watchObservedRunningTime="2026-07-06 02:53:08.829478335 +0000 UTC m=+842.486487999"
Jul 06 02:53:14.471940 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:53:14.471902    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:53:18.188065 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:53:18.188024    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl"
Jul 06 02:53:18.188447 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:53:18.188079    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl"
Jul 06 02:53:18.200793 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:53:18.200769    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl"
Jul 06 02:53:18.874593 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:53:18.874565    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl"
Jul 06 02:54:07.219513 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:54:07.219482    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfxlc_b2861d04-c87b-43b1-9bff-2b2199a136a3/ovn-acl-logging/0.log"
Jul 06 02:54:07.223448 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:54:07.223428    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfxlc_b2861d04-c87b-43b1-9bff-2b2199a136a3/ovn-acl-logging/0.log"
Jul 06 02:54:20.486587 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:54:20.486551    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59567c567f-t2pnl"]
Jul 06 02:54:20.489746 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:54:20.489723    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59567c567f-t2pnl"
Jul 06 02:54:20.497541 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:54:20.497513    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59567c567f-t2pnl"]
Jul 06 02:54:20.544113 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:54:20.544083    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b3dde293-b9f7-4f66-944e-cdbf680af474-tls-cert\") pod \"authorino-59567c567f-t2pnl\" (UID: \"b3dde293-b9f7-4f66-944e-cdbf680af474\") " pod="kuadrant-system/authorino-59567c567f-t2pnl"
Jul 06 02:54:20.544274 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:54:20.544126    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmzpk\" (UniqueName: \"kubernetes.io/projected/b3dde293-b9f7-4f66-944e-cdbf680af474-kube-api-access-mmzpk\") pod \"authorino-59567c567f-t2pnl\" (UID: \"b3dde293-b9f7-4f66-944e-cdbf680af474\") " pod="kuadrant-system/authorino-59567c567f-t2pnl"
Jul 06 02:54:20.645030 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:54:20.644975    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b3dde293-b9f7-4f66-944e-cdbf680af474-tls-cert\") pod \"authorino-59567c567f-t2pnl\" (UID: \"b3dde293-b9f7-4f66-944e-cdbf680af474\") " pod="kuadrant-system/authorino-59567c567f-t2pnl"
Jul 06 02:54:20.645192 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:54:20.645041    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmzpk\" (UniqueName: \"kubernetes.io/projected/b3dde293-b9f7-4f66-944e-cdbf680af474-kube-api-access-mmzpk\") pod \"authorino-59567c567f-t2pnl\" (UID: \"b3dde293-b9f7-4f66-944e-cdbf680af474\") " pod="kuadrant-system/authorino-59567c567f-t2pnl"
Jul 06 02:54:20.647414 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:54:20.647390    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b3dde293-b9f7-4f66-944e-cdbf680af474-tls-cert\") pod \"authorino-59567c567f-t2pnl\" (UID: \"b3dde293-b9f7-4f66-944e-cdbf680af474\") " pod="kuadrant-system/authorino-59567c567f-t2pnl"
Jul 06 02:54:20.652669 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:54:20.652647    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmzpk\" (UniqueName: \"kubernetes.io/projected/b3dde293-b9f7-4f66-944e-cdbf680af474-kube-api-access-mmzpk\") pod \"authorino-59567c567f-t2pnl\" (UID: \"b3dde293-b9f7-4f66-944e-cdbf680af474\") " pod="kuadrant-system/authorino-59567c567f-t2pnl"
Jul 06 02:54:20.800474 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:54:20.800450    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59567c567f-t2pnl"
Jul 06 02:54:20.914286 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:54:20.914253    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:54:20.964486 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:54:20.964463    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59567c567f-t2pnl"]
Jul 06 02:54:20.966731 ip-10-0-131-238 kubenswrapper[2570]: W0706 02:54:20.966703    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb3dde293_b9f7_4f66_944e_cdbf680af474.slice/crio-2dff324ea40bfa474400b96f343c4454736230ec3df8b679d1abebe85b7196e6 WatchSource:0}: Error finding container 2dff324ea40bfa474400b96f343c4454736230ec3df8b679d1abebe85b7196e6: Status 404 returned error can't find the container with id 2dff324ea40bfa474400b96f343c4454736230ec3df8b679d1abebe85b7196e6
Jul 06 02:54:21.181073 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:54:21.181005    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59567c567f-t2pnl" event={"ID":"b3dde293-b9f7-4f66-944e-cdbf680af474","Type":"ContainerStarted","Data":"2dff324ea40bfa474400b96f343c4454736230ec3df8b679d1abebe85b7196e6"}
Jul 06 02:54:21.986870 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:54:21.986815    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:54:22.090263 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:54:22.090220    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:54:22.189067 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:54:22.189027    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:54:22.190240 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:54:22.190209    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59567c567f-t2pnl" event={"ID":"b3dde293-b9f7-4f66-944e-cdbf680af474","Type":"ContainerStarted","Data":"f6490e6a5156e7abf33a41aaf0f4df58e8477627c7227f9b8dd0a956f40e2441"}
Jul 06 02:54:22.209866 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:54:22.209817    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59567c567f-t2pnl" podStartSLOduration=1.8098289159999998 podStartE2EDuration="2.209798177s" totalImagesPullingTime="399.969261ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:54:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:54:22.20708503 +0000 UTC m=+915.864094696" watchObservedRunningTime="2026-07-06 02:54:22.209798177 +0000 UTC m=+915.866807842"
Jul 06 02:54:22.236601 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:54:22.236554    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c4f94d79d-cv6xz"]
Jul 06 02:54:22.236774 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:54:22.236748    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-c4f94d79d-cv6xz" podUID="133b0f82-7d80-47e1-9611-063840bfa2d6" containerName="authorino" containerID="cri-o://6fa7f3fd789193da2c92b3824eb076be587aec4e5f5da27921e649439b70dc95" gracePeriod=30
Jul 06 02:54:22.502880 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:54:22.502822    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c4f94d79d-cv6xz"
Jul 06 02:54:22.560852 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:54:22.560820    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-26r5p\" (UniqueName: \"kubernetes.io/projected/133b0f82-7d80-47e1-9611-063840bfa2d6-kube-api-access-26r5p\") pod \"133b0f82-7d80-47e1-9611-063840bfa2d6\" (UID: \"133b0f82-7d80-47e1-9611-063840bfa2d6\") "
Jul 06 02:54:22.561052 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:54:22.560861    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/133b0f82-7d80-47e1-9611-063840bfa2d6-tls-cert\") pod \"133b0f82-7d80-47e1-9611-063840bfa2d6\" (UID: \"133b0f82-7d80-47e1-9611-063840bfa2d6\") "
Jul 06 02:54:22.563058 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:54:22.563010    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/133b0f82-7d80-47e1-9611-063840bfa2d6-kube-api-access-26r5p" (OuterVolumeSpecName: "kube-api-access-26r5p") pod "133b0f82-7d80-47e1-9611-063840bfa2d6" (UID: "133b0f82-7d80-47e1-9611-063840bfa2d6"). InnerVolumeSpecName "kube-api-access-26r5p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 02:54:22.572074 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:54:22.572049    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/133b0f82-7d80-47e1-9611-063840bfa2d6-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "133b0f82-7d80-47e1-9611-063840bfa2d6" (UID: "133b0f82-7d80-47e1-9611-063840bfa2d6"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 02:54:22.662102 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:54:22.662072    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-26r5p\" (UniqueName: \"kubernetes.io/projected/133b0f82-7d80-47e1-9611-063840bfa2d6-kube-api-access-26r5p\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:54:22.662102 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:54:22.662101    2570 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/133b0f82-7d80-47e1-9611-063840bfa2d6-tls-cert\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 02:54:23.199065 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:54:23.199023    2570 generic.go:356] "Generic (PLEG): container finished" podID="133b0f82-7d80-47e1-9611-063840bfa2d6" containerID="6fa7f3fd789193da2c92b3824eb076be587aec4e5f5da27921e649439b70dc95" exitCode=0
Jul 06 02:54:23.199568 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:54:23.199092    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c4f94d79d-cv6xz"
Jul 06 02:54:23.199568 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:54:23.199118    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c4f94d79d-cv6xz" event={"ID":"133b0f82-7d80-47e1-9611-063840bfa2d6","Type":"ContainerDied","Data":"6fa7f3fd789193da2c92b3824eb076be587aec4e5f5da27921e649439b70dc95"}
Jul 06 02:54:23.199568 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:54:23.199168    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c4f94d79d-cv6xz" event={"ID":"133b0f82-7d80-47e1-9611-063840bfa2d6","Type":"ContainerDied","Data":"144636523f342e95002c5499a8e0de6de783e8f95fecb47e4c59189f644d0b2b"}
Jul 06 02:54:23.199568 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:54:23.199192    2570 scope.go:117] "RemoveContainer" containerID="6fa7f3fd789193da2c92b3824eb076be587aec4e5f5da27921e649439b70dc95"
Jul 06 02:54:23.208888 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:54:23.208871    2570 scope.go:117] "RemoveContainer" containerID="6fa7f3fd789193da2c92b3824eb076be587aec4e5f5da27921e649439b70dc95"
Jul 06 02:54:23.209159 ip-10-0-131-238 kubenswrapper[2570]: E0706 02:54:23.209140    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fa7f3fd789193da2c92b3824eb076be587aec4e5f5da27921e649439b70dc95\": container with ID starting with 6fa7f3fd789193da2c92b3824eb076be587aec4e5f5da27921e649439b70dc95 not found: ID does not exist" containerID="6fa7f3fd789193da2c92b3824eb076be587aec4e5f5da27921e649439b70dc95"
Jul 06 02:54:23.209232 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:54:23.209167    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fa7f3fd789193da2c92b3824eb076be587aec4e5f5da27921e649439b70dc95"} err="failed to get container status \"6fa7f3fd789193da2c92b3824eb076be587aec4e5f5da27921e649439b70dc95\": rpc error: code = NotFound desc = could not find container \"6fa7f3fd789193da2c92b3824eb076be587aec4e5f5da27921e649439b70dc95\": container with ID starting with 6fa7f3fd789193da2c92b3824eb076be587aec4e5f5da27921e649439b70dc95 not found: ID does not exist"
Jul 06 02:54:23.221833 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:54:23.221802    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c4f94d79d-cv6xz"]
Jul 06 02:54:23.225605 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:54:23.225581    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-c4f94d79d-cv6xz"]
Jul 06 02:54:23.233570 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:54:23.233545    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="133b0f82-7d80-47e1-9611-063840bfa2d6" path="/var/lib/kubelet/pods/133b0f82-7d80-47e1-9611-063840bfa2d6/volumes"
Jul 06 02:54:46.136419 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:54:46.136376    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:55:32.178578 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:55:32.178543    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:55:33.225296 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:55:33.225265    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:55:37.399003 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:55:37.398948    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:55:37.501047 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:55:37.501009    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:56:13.777915 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:56:13.777875    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:56:13.873027 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:56:13.872954    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:56:13.998148 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:56:13.998111    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:56:19.633497 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:56:19.633459    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:56:19.689671 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:56:19.689626    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:56:19.770647 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:56:19.770610    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:56:19.869436 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:56:19.869412    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:56:19.988750 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:56:19.988678    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:56:25.452741 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:56:25.452704    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:56:25.553466 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:56:25.553437    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:57:12.247676 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:57:12.247587    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:58:41.816613 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:58:41.816522    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 02:59:07.255504 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:59:07.255474    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfxlc_b2861d04-c87b-43b1-9bff-2b2199a136a3/ovn-acl-logging/0.log"
Jul 06 02:59:07.258938 ip-10-0-131-238 kubenswrapper[2570]: I0706 02:59:07.258917    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfxlc_b2861d04-c87b-43b1-9bff-2b2199a136a3/ovn-acl-logging/0.log"
Jul 06 03:02:16.144812 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:02:16.144772    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:02:17.392597 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:02:17.392564    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:03:27.092853 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:03:27.092777    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:03:58.363845 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:03:58.363803    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:04:07.296189 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:04:07.296161    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfxlc_b2861d04-c87b-43b1-9bff-2b2199a136a3/ovn-acl-logging/0.log"
Jul 06 03:04:07.301132 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:04:07.301111    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfxlc_b2861d04-c87b-43b1-9bff-2b2199a136a3/ovn-acl-logging/0.log"
Jul 06 03:06:31.308013 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:06:31.307911    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:07:00.962566 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:07:00.962523    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:07:10.585609 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:07:10.585565    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:07:18.847740 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:07:18.847704    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:07:23.946655 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:07:23.946621    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:07:26.846940 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:07:26.846901    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:07:26.946626 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:07:26.946590    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:07:27.306765 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:07:27.306731    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:07:32.984185 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:07:32.984106    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:07:33.086696 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:07:33.086663    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:07:33.185175 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:07:33.185137    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:07:33.242786 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:07:33.242711    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:07:34.370387 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:07:34.370350    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:07:34.473878 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:07:34.473841    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:07:34.646778 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:07:34.646693    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:07:34.745675 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:07:34.745642    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:07:35.113533 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:07:35.113499    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:07:35.213231 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:07:35.213180    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:07:36.551842 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:07:36.551806    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:07:39.487905 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:07:39.487866    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:07:39.675342 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:07:39.675306    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:07:39.841229 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:07:39.841198    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:07:39.930357 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:07:39.930322    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:07:41.192639 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:07:41.192602    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:07:45.611248 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:07:45.611217    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:07:45.674603 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:07:45.674569    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:07:45.809442 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:07:45.809409    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:07:45.912403 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:07:45.912310    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:07:47.002002 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:07:47.001944    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:07:47.084798 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:07:47.084764    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:07:47.156338 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:07:47.156302    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:07:47.285062 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:07:47.285027    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:07:47.692524 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:07:47.692434    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:07:47.793109 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:07:47.793066    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:07:48.993200 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:07:48.993167    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:07:52.221190 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:07:52.221154    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:07:52.562095 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:07:52.562062    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:07:58.543578 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:07:58.543538    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:07:58.638168 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:07:58.638132    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:08:00.600012 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:08:00.599938    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:08:04.281445 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:08:04.281407    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:08:04.383707 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:08:04.383674    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:08:04.508450 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:08:04.508413    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:08:04.607808 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:08:04.607723    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:08:05.699778 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:08:05.699734    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:08:05.776435 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:08:05.776387    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:08:05.842734 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:08:05.842697    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:08:06.173932 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:08:06.173900    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:08:06.343072 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:08:06.343042    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:08:06.413932 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:08:06.413898    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:08:07.746614 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:08:07.746579    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:08:10.153122 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:08:10.153084    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:08:10.338081 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:08:10.338043    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:08:10.434141 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:08:10.434052    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:08:10.553880 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:08:10.553830    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:08:12.358037 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:08:12.357955    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:08:16.012702 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:08:16.012664    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:08:16.075343 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:08:16.075286    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:08:16.515628 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:08:16.515586    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:08:16.603533 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:08:16.603490    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:08:16.704785 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:08:16.704748    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:08:18.079300 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:08:18.079263    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:08:23.901195 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:08:23.901152    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:08:24.005914 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:08:24.005880    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:08:24.101965 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:08:24.101933    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:08:24.198189 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:08:24.198097    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:08:24.610169 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:08:24.610136    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:08:40.117237 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:08:40.117199    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:08:40.166889 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:08:40.166862    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:08:50.554024 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:08:50.553962    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:08:56.263920 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:08:56.263885    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:08:56.325785 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:08:56.325747    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:08:56.412498 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:08:56.412465    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:08:56.510901 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:08:56.510867    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:09:07.331567 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:09:07.331533    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfxlc_b2861d04-c87b-43b1-9bff-2b2199a136a3/ovn-acl-logging/0.log"
Jul 06 03:09:07.336323 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:09:07.336305    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfxlc_b2861d04-c87b-43b1-9bff-2b2199a136a3/ovn-acl-logging/0.log"
Jul 06 03:09:12.377790 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:09:12.377759    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:09:18.080955 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:09:18.080912    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:09:18.180427 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:09:18.180394    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:09:18.278511 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:09:18.278472    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:09:28.800023 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:09:28.799963    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:09:29.599379 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:09:29.599343    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:09:35.543340 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:09:35.543298    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:09:35.647483 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:09:35.647437    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:09:35.743395 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:09:35.743356    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:09:35.802789 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:09:35.802682    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:09:36.658715 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:09:36.658678    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:09:36.756513 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:09:36.756482    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:09:36.888456 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:09:36.888426    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:09:38.469018 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:09:38.468970    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:09:44.085794 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:09:44.085749    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:09:44.186564 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:09:44.186534    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:09:44.751000 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:09:44.750947    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:09:50.496105 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:09:50.496066    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:09:50.596946 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:09:50.596902    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:09:50.737427 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:09:50.737388    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:09:51.054654 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:09:51.054612    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:09:51.488693 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:09:51.488615    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:09:54.100174 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:09:54.100124    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:09:54.198561 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:09:54.198510    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:09:54.304141 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:09:54.304106    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:09:54.648700 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:09:54.648664    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:09:54.905343 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:09:54.905233    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:09:55.004801 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:09:55.004763    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:09:58.623892 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:09:58.623854    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:09:59.303485 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:09:59.303445    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:09:59.403842 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:09:59.403797    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:09:59.769459 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:09:59.769349    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:10:05.747910 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:10:05.747864    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:10:05.847072 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:10:05.847029    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:10:06.208384 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:10:06.208346    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:10:06.485216 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:10:06.485130    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:10:06.562214 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:10:06.562178    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:10:12.524574 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:10:12.524530    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:10:12.586774 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:10:12.586744    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:10:12.773297 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:10:12.773257    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:10:12.998582 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:10:12.998553    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:10:13.118467 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:10:13.118433    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:10:13.217947 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:10:13.217916    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:10:13.328797 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:10:13.328759    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:10:19.025964 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:10:19.025921    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:10:19.132880 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:10:19.132844    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:10:19.226810 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:10:19.226778    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:10:19.354545 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:10:19.354515    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:10:25.060789 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:10:25.060757    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:10:25.124794 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:10:25.124754    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:10:31.842729 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:10:31.842637    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:10:32.163518 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:10:32.163416    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:10:32.485927 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:10:32.485831    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:10:35.289255 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:10:35.289222    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:10:35.369884 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:10:35.369855    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:10:35.434070 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:10:35.434030    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:10:35.693315 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:10:35.693228    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:10:35.965508 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:10:35.965415    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:10:36.065603 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:10:36.065569    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:10:39.779962 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:10:39.779924    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:10:54.993568 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:10:54.993526    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:10:55.095068 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:10:55.095030    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:10:56.683131 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:10:56.683094    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:10:56.784938 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:10:56.784903    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:11:00.810136 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:00.810102    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-7b6582bb/e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7"]
Jul 06 03:11:00.810521 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:00.810442    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="133b0f82-7d80-47e1-9611-063840bfa2d6" containerName="authorino"
Jul 06 03:11:00.810521 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:00.810452    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="133b0f82-7d80-47e1-9611-063840bfa2d6" containerName="authorino"
Jul 06 03:11:00.810521 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:00.810515    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="133b0f82-7d80-47e1-9611-063840bfa2d6" containerName="authorino"
Jul 06 03:11:00.813578 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:00.813562    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-7b6582bb/e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7"
Jul 06 03:11:00.817256 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:00.817233    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-7b6582bb\"/\"kube-root-ca.crt\""
Jul 06 03:11:00.817256 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:00.817244    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-7b6582bb\"/\"e2e-lifecycle-model-7b6582bb-kserve-self-signed-certs\""
Jul 06 03:11:00.817436 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:00.817266    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-7b6582bb\"/\"openshift-service-ca.crt\""
Jul 06 03:11:00.817436 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:00.817244    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-7b6582bb\"/\"default-dockercfg-qxxjb\""
Jul 06 03:11:00.823056 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:00.823033    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-7b6582bb/e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7"]
Jul 06 03:11:00.833429 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:00.833402    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:11:00.965168 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:00.965135    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7a16d3c-d0a9-4015-8c72-26315a4c1db0-dshm\") pod \"e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7\" (UID: \"f7a16d3c-d0a9-4015-8c72-26315a4c1db0\") " pod="ai-tenant-e2e-mt-7b6582bb/e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7"
Jul 06 03:11:00.965331 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:00.965201    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88r8x\" (UniqueName: \"kubernetes.io/projected/f7a16d3c-d0a9-4015-8c72-26315a4c1db0-kube-api-access-88r8x\") pod \"e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7\" (UID: \"f7a16d3c-d0a9-4015-8c72-26315a4c1db0\") " pod="ai-tenant-e2e-mt-7b6582bb/e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7"
Jul 06 03:11:00.965331 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:00.965241    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7a16d3c-d0a9-4015-8c72-26315a4c1db0-tmp-dir\") pod \"e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7\" (UID: \"f7a16d3c-d0a9-4015-8c72-26315a4c1db0\") " pod="ai-tenant-e2e-mt-7b6582bb/e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7"
Jul 06 03:11:00.965331 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:00.965260    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7a16d3c-d0a9-4015-8c72-26315a4c1db0-tls-certs\") pod \"e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7\" (UID: \"f7a16d3c-d0a9-4015-8c72-26315a4c1db0\") " pod="ai-tenant-e2e-mt-7b6582bb/e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7"
Jul 06 03:11:00.965331 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:00.965320    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7a16d3c-d0a9-4015-8c72-26315a4c1db0-model-cache\") pod \"e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7\" (UID: \"f7a16d3c-d0a9-4015-8c72-26315a4c1db0\") " pod="ai-tenant-e2e-mt-7b6582bb/e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7"
Jul 06 03:11:00.965486 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:00.965355    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7a16d3c-d0a9-4015-8c72-26315a4c1db0-home\") pod \"e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7\" (UID: \"f7a16d3c-d0a9-4015-8c72-26315a4c1db0\") " pod="ai-tenant-e2e-mt-7b6582bb/e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7"
Jul 06 03:11:01.066299 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:01.066240    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88r8x\" (UniqueName: \"kubernetes.io/projected/f7a16d3c-d0a9-4015-8c72-26315a4c1db0-kube-api-access-88r8x\") pod \"e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7\" (UID: \"f7a16d3c-d0a9-4015-8c72-26315a4c1db0\") " pod="ai-tenant-e2e-mt-7b6582bb/e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7"
Jul 06 03:11:01.066299 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:01.066273    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7a16d3c-d0a9-4015-8c72-26315a4c1db0-tmp-dir\") pod \"e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7\" (UID: \"f7a16d3c-d0a9-4015-8c72-26315a4c1db0\") " pod="ai-tenant-e2e-mt-7b6582bb/e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7"
Jul 06 03:11:01.066299 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:01.066294    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7a16d3c-d0a9-4015-8c72-26315a4c1db0-tls-certs\") pod \"e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7\" (UID: \"f7a16d3c-d0a9-4015-8c72-26315a4c1db0\") " pod="ai-tenant-e2e-mt-7b6582bb/e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7"
Jul 06 03:11:01.066515 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:01.066315    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7a16d3c-d0a9-4015-8c72-26315a4c1db0-model-cache\") pod \"e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7\" (UID: \"f7a16d3c-d0a9-4015-8c72-26315a4c1db0\") " pod="ai-tenant-e2e-mt-7b6582bb/e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7"
Jul 06 03:11:01.066515 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:01.066335    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7a16d3c-d0a9-4015-8c72-26315a4c1db0-home\") pod \"e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7\" (UID: \"f7a16d3c-d0a9-4015-8c72-26315a4c1db0\") " pod="ai-tenant-e2e-mt-7b6582bb/e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7"
Jul 06 03:11:01.066515 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:01.066376    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7a16d3c-d0a9-4015-8c72-26315a4c1db0-dshm\") pod \"e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7\" (UID: \"f7a16d3c-d0a9-4015-8c72-26315a4c1db0\") " pod="ai-tenant-e2e-mt-7b6582bb/e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7"
Jul 06 03:11:01.066716 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:01.066697    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7a16d3c-d0a9-4015-8c72-26315a4c1db0-tmp-dir\") pod \"e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7\" (UID: \"f7a16d3c-d0a9-4015-8c72-26315a4c1db0\") " pod="ai-tenant-e2e-mt-7b6582bb/e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7"
Jul 06 03:11:01.066776 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:01.066720    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7a16d3c-d0a9-4015-8c72-26315a4c1db0-model-cache\") pod \"e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7\" (UID: \"f7a16d3c-d0a9-4015-8c72-26315a4c1db0\") " pod="ai-tenant-e2e-mt-7b6582bb/e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7"
Jul 06 03:11:01.066833 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:01.066816    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7a16d3c-d0a9-4015-8c72-26315a4c1db0-home\") pod \"e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7\" (UID: \"f7a16d3c-d0a9-4015-8c72-26315a4c1db0\") " pod="ai-tenant-e2e-mt-7b6582bb/e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7"
Jul 06 03:11:01.068662 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:01.068636    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7a16d3c-d0a9-4015-8c72-26315a4c1db0-dshm\") pod \"e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7\" (UID: \"f7a16d3c-d0a9-4015-8c72-26315a4c1db0\") " pod="ai-tenant-e2e-mt-7b6582bb/e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7"
Jul 06 03:11:01.069011 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:01.068972    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7a16d3c-d0a9-4015-8c72-26315a4c1db0-tls-certs\") pod \"e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7\" (UID: \"f7a16d3c-d0a9-4015-8c72-26315a4c1db0\") " pod="ai-tenant-e2e-mt-7b6582bb/e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7"
Jul 06 03:11:01.075056 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:01.075033    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88r8x\" (UniqueName: \"kubernetes.io/projected/f7a16d3c-d0a9-4015-8c72-26315a4c1db0-kube-api-access-88r8x\") pod \"e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7\" (UID: \"f7a16d3c-d0a9-4015-8c72-26315a4c1db0\") " pod="ai-tenant-e2e-mt-7b6582bb/e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7"
Jul 06 03:11:01.123806 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:01.123783    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-7b6582bb/e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7"
Jul 06 03:11:01.261737 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:01.261710    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-7b6582bb/e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7"]
Jul 06 03:11:01.263867 ip-10-0-131-238 kubenswrapper[2570]: W0706 03:11:01.263838    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf7a16d3c_d0a9_4015_8c72_26315a4c1db0.slice/crio-934189f3b157ff43016ab93459524dd0309f9dfbf2ef805ea0113e16e7bd52c0 WatchSource:0}: Error finding container 934189f3b157ff43016ab93459524dd0309f9dfbf2ef805ea0113e16e7bd52c0: Status 404 returned error can't find the container with id 934189f3b157ff43016ab93459524dd0309f9dfbf2ef805ea0113e16e7bd52c0
Jul 06 03:11:01.324278 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:01.324182    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-7b6582bb/e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7" event={"ID":"f7a16d3c-d0a9-4015-8c72-26315a4c1db0","Type":"ContainerStarted","Data":"934189f3b157ff43016ab93459524dd0309f9dfbf2ef805ea0113e16e7bd52c0"}
Jul 06 03:11:02.331628 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:02.331589    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-7b6582bb/e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7" event={"ID":"f7a16d3c-d0a9-4015-8c72-26315a4c1db0","Type":"ContainerStarted","Data":"58d3a61fab61b769657eba89677aaf9ee6bc1a6791997285f620b9971820ccdb"}
Jul 06 03:11:02.351072 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:02.351025    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-7b6582bb/e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7" podStartSLOduration=2.351011307 podStartE2EDuration="2.351011307s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 03:11:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 03:11:02.349424146 +0000 UTC m=+1916.006433809" watchObservedRunningTime="2026-07-06 03:11:02.351011307 +0000 UTC m=+1916.008020968"
Jul 06 03:11:11.124822 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:11.124788    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-7b6582bb/e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7"
Jul 06 03:11:11.125344 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:11.124927    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-7b6582bb/e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7"
Jul 06 03:11:11.137652 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:11.137628    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-7b6582bb/e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7"
Jul 06 03:11:11.386640 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:11.386561    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-7b6582bb/e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7"
Jul 06 03:11:22.521204 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:22.521155    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:11:22.840593 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:22.840559    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:11:28.543034 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:28.542996    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:11:33.531060 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:33.531023    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-7b6582bb/e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7"]
Jul 06 03:11:33.626354 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:33.626314    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:11:48.551146 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:48.551103    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-7b6582bb/e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7" podUID="f7a16d3c-d0a9-4015-8c72-26315a4c1db0" containerName="main" containerID="cri-o://58d3a61fab61b769657eba89677aaf9ee6bc1a6791997285f620b9971820ccdb" gracePeriod=45
Jul 06 03:11:48.799339 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:48.799315    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-7b6582bb/e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7"
Jul 06 03:11:48.840806 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:48.840737    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7a16d3c-d0a9-4015-8c72-26315a4c1db0-tmp-dir\") pod \"f7a16d3c-d0a9-4015-8c72-26315a4c1db0\" (UID: \"f7a16d3c-d0a9-4015-8c72-26315a4c1db0\") "
Jul 06 03:11:48.840933 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:48.840833    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88r8x\" (UniqueName: \"kubernetes.io/projected/f7a16d3c-d0a9-4015-8c72-26315a4c1db0-kube-api-access-88r8x\") pod \"f7a16d3c-d0a9-4015-8c72-26315a4c1db0\" (UID: \"f7a16d3c-d0a9-4015-8c72-26315a4c1db0\") "
Jul 06 03:11:48.840933 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:48.840867    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7a16d3c-d0a9-4015-8c72-26315a4c1db0-tls-certs\") pod \"f7a16d3c-d0a9-4015-8c72-26315a4c1db0\" (UID: \"f7a16d3c-d0a9-4015-8c72-26315a4c1db0\") "
Jul 06 03:11:48.840933 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:48.840895    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7a16d3c-d0a9-4015-8c72-26315a4c1db0-model-cache\") pod \"f7a16d3c-d0a9-4015-8c72-26315a4c1db0\" (UID: \"f7a16d3c-d0a9-4015-8c72-26315a4c1db0\") "
Jul 06 03:11:48.841124 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:48.840996    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7a16d3c-d0a9-4015-8c72-26315a4c1db0-dshm\") pod \"f7a16d3c-d0a9-4015-8c72-26315a4c1db0\" (UID: \"f7a16d3c-d0a9-4015-8c72-26315a4c1db0\") "
Jul 06 03:11:48.841124 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:48.841042    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7a16d3c-d0a9-4015-8c72-26315a4c1db0-home\") pod \"f7a16d3c-d0a9-4015-8c72-26315a4c1db0\" (UID: \"f7a16d3c-d0a9-4015-8c72-26315a4c1db0\") "
Jul 06 03:11:48.841124 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:48.841037    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7a16d3c-d0a9-4015-8c72-26315a4c1db0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f7a16d3c-d0a9-4015-8c72-26315a4c1db0" (UID: "f7a16d3c-d0a9-4015-8c72-26315a4c1db0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:11:48.841282 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:48.841228    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7a16d3c-d0a9-4015-8c72-26315a4c1db0-model-cache" (OuterVolumeSpecName: "model-cache") pod "f7a16d3c-d0a9-4015-8c72-26315a4c1db0" (UID: "f7a16d3c-d0a9-4015-8c72-26315a4c1db0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:11:48.841342 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:48.841303    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7a16d3c-d0a9-4015-8c72-26315a4c1db0-tmp-dir\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:11:48.841587 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:48.841565    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7a16d3c-d0a9-4015-8c72-26315a4c1db0-home" (OuterVolumeSpecName: "home") pod "f7a16d3c-d0a9-4015-8c72-26315a4c1db0" (UID: "f7a16d3c-d0a9-4015-8c72-26315a4c1db0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:11:48.843357 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:48.843329    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7a16d3c-d0a9-4015-8c72-26315a4c1db0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f7a16d3c-d0a9-4015-8c72-26315a4c1db0" (UID: "f7a16d3c-d0a9-4015-8c72-26315a4c1db0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 03:11:48.843570 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:48.843545    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7a16d3c-d0a9-4015-8c72-26315a4c1db0-dshm" (OuterVolumeSpecName: "dshm") pod "f7a16d3c-d0a9-4015-8c72-26315a4c1db0" (UID: "f7a16d3c-d0a9-4015-8c72-26315a4c1db0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:11:48.843570 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:48.843557    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7a16d3c-d0a9-4015-8c72-26315a4c1db0-kube-api-access-88r8x" (OuterVolumeSpecName: "kube-api-access-88r8x") pod "f7a16d3c-d0a9-4015-8c72-26315a4c1db0" (UID: "f7a16d3c-d0a9-4015-8c72-26315a4c1db0"). InnerVolumeSpecName "kube-api-access-88r8x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 03:11:48.941894 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:48.941864    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7a16d3c-d0a9-4015-8c72-26315a4c1db0-home\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:11:48.941894 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:48.941891    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88r8x\" (UniqueName: \"kubernetes.io/projected/f7a16d3c-d0a9-4015-8c72-26315a4c1db0-kube-api-access-88r8x\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:11:48.942110 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:48.941904    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7a16d3c-d0a9-4015-8c72-26315a4c1db0-tls-certs\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:11:48.942110 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:48.941913    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7a16d3c-d0a9-4015-8c72-26315a4c1db0-model-cache\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:11:48.942110 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:48.941921    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7a16d3c-d0a9-4015-8c72-26315a4c1db0-dshm\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:11:49.571920 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:49.571889    2570 generic.go:356] "Generic (PLEG): container finished" podID="f7a16d3c-d0a9-4015-8c72-26315a4c1db0" containerID="58d3a61fab61b769657eba89677aaf9ee6bc1a6791997285f620b9971820ccdb" exitCode=0
Jul 06 03:11:49.572349 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:49.571943    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-7b6582bb/e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7"
Jul 06 03:11:49.572349 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:49.572000    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-7b6582bb/e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7" event={"ID":"f7a16d3c-d0a9-4015-8c72-26315a4c1db0","Type":"ContainerDied","Data":"58d3a61fab61b769657eba89677aaf9ee6bc1a6791997285f620b9971820ccdb"}
Jul 06 03:11:49.572349 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:49.572049    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-7b6582bb/e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7" event={"ID":"f7a16d3c-d0a9-4015-8c72-26315a4c1db0","Type":"ContainerDied","Data":"934189f3b157ff43016ab93459524dd0309f9dfbf2ef805ea0113e16e7bd52c0"}
Jul 06 03:11:49.572349 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:49.572068    2570 scope.go:117] "RemoveContainer" containerID="58d3a61fab61b769657eba89677aaf9ee6bc1a6791997285f620b9971820ccdb"
Jul 06 03:11:49.581320 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:49.581306    2570 scope.go:117] "RemoveContainer" containerID="58d3a61fab61b769657eba89677aaf9ee6bc1a6791997285f620b9971820ccdb"
Jul 06 03:11:49.581566 ip-10-0-131-238 kubenswrapper[2570]: E0706 03:11:49.581550    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58d3a61fab61b769657eba89677aaf9ee6bc1a6791997285f620b9971820ccdb\": container with ID starting with 58d3a61fab61b769657eba89677aaf9ee6bc1a6791997285f620b9971820ccdb not found: ID does not exist" containerID="58d3a61fab61b769657eba89677aaf9ee6bc1a6791997285f620b9971820ccdb"
Jul 06 03:11:49.581611 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:49.581574    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58d3a61fab61b769657eba89677aaf9ee6bc1a6791997285f620b9971820ccdb"} err="failed to get container status \"58d3a61fab61b769657eba89677aaf9ee6bc1a6791997285f620b9971820ccdb\": rpc error: code = NotFound desc = could not find container \"58d3a61fab61b769657eba89677aaf9ee6bc1a6791997285f620b9971820ccdb\": container with ID starting with 58d3a61fab61b769657eba89677aaf9ee6bc1a6791997285f620b9971820ccdb not found: ID does not exist"
Jul 06 03:11:49.591245 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:49.591220    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-7b6582bb/e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7"]
Jul 06 03:11:49.597731 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:49.597705    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-7b6582bb/e2e-lifecycle-model-7b6582bb-kserve-94467c959-npmq7"]
Jul 06 03:11:51.233049 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:11:51.233016    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7a16d3c-d0a9-4015-8c72-26315a4c1db0" path="/var/lib/kubelet/pods/f7a16d3c-d0a9-4015-8c72-26315a4c1db0/volumes"
Jul 06 03:12:09.671130 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:12:09.671090    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:12:10.503590 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:12:10.503553    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:12:16.032457 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:12:16.032415    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:12:16.096794 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:12:16.096758    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:12:16.313234 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:12:16.313147    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:12:16.546187 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:12:16.546150    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:12:17.604718 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:12:17.604679    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:12:17.719149 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:12:17.719106    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:12:17.813580 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:12:17.813540    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:12:18.542458 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:12:18.542417    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:12:18.639859 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:12:18.639821    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:12:18.739022 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:12:18.738969    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:12:20.078313 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:12:20.078278    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:12:25.940692 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:12:25.940645    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:12:26.040650 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:12:26.040619    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:12:26.605785 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:12:26.605753    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:12:32.332391 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:12:32.332339    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:12:32.443369 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:12:32.443325    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:12:32.531277 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:12:32.531248    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:12:43.032461 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:12:43.032427    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:12:43.385002 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:12:43.384897    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:12:52.297535 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:12:52.297496    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:13:04.332566 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:04.332533    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:13:10.224058 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:10.224016    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:13:10.325939 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:10.325898    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:13:10.583450 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:10.583408    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:13:10.889005 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:10.888902    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:13:11.244521 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:11.244441    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:13:14.049171 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:14.049129    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:13:14.145689 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:14.145654    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:13:14.245696 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:14.245657    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:13:14.345806 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:14.345715    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:13:14.706602 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:14.706515    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:13:14.809051 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:14.808978    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:13:18.561978 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:18.561933    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:13:18.901209 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:18.901120    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:13:19.205731 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:19.205645    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:13:19.487196 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:19.487114    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:13:22.078118 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:22.078078    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:13:22.167670 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:22.167625    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:13:22.229962 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:22.229925    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:13:22.598313 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:22.598253    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:13:22.700534 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:22.700488    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:13:22.800024 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:22.799963    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:13:26.599309 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:26.599265    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:13:35.475546 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:35.475458    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:13:35.577249 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:35.577211    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:13:36.165267 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:36.165234    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-2236bf/test-model-2236bf-kserve-54fcdb76cf-v9nmg"]
Jul 06 03:13:36.165583 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:36.165569    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7a16d3c-d0a9-4015-8c72-26315a4c1db0" containerName="main"
Jul 06 03:13:36.165583 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:36.165582    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7a16d3c-d0a9-4015-8c72-26315a4c1db0" containerName="main"
Jul 06 03:13:36.165752 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:36.165654    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7a16d3c-d0a9-4015-8c72-26315a4c1db0" containerName="main"
Jul 06 03:13:36.168814 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:36.168794    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2236bf/test-model-2236bf-kserve-54fcdb76cf-v9nmg"
Jul 06 03:13:36.173030 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:36.173011    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-2236bf\"/\"openshift-service-ca.crt\""
Jul 06 03:13:36.173148 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:36.173050    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-2236bf\"/\"kube-root-ca.crt\""
Jul 06 03:13:36.173148 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:36.173116    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-2236bf\"/\"default-dockercfg-wm96h\""
Jul 06 03:13:36.173266 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:36.173184    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-2236bf\"/\"test-model-2236bf-kserve-self-signed-certs\""
Jul 06 03:13:36.179174 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:36.179149    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-2236bf/test-model-2236bf-kserve-54fcdb76cf-v9nmg"]
Jul 06 03:13:36.194470 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:36.194443    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:13:36.209533 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:36.209512    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c2460f3a-585b-4df3-8b03-ce673641ac61-home\") pod \"test-model-2236bf-kserve-54fcdb76cf-v9nmg\" (UID: \"c2460f3a-585b-4df3-8b03-ce673641ac61\") " pod="ai-tenant-e2e-inf-a-2236bf/test-model-2236bf-kserve-54fcdb76cf-v9nmg"
Jul 06 03:13:36.209663 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:36.209546    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq2cv\" (UniqueName: \"kubernetes.io/projected/c2460f3a-585b-4df3-8b03-ce673641ac61-kube-api-access-zq2cv\") pod \"test-model-2236bf-kserve-54fcdb76cf-v9nmg\" (UID: \"c2460f3a-585b-4df3-8b03-ce673641ac61\") " pod="ai-tenant-e2e-inf-a-2236bf/test-model-2236bf-kserve-54fcdb76cf-v9nmg"
Jul 06 03:13:36.209663 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:36.209647    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c2460f3a-585b-4df3-8b03-ce673641ac61-dshm\") pod \"test-model-2236bf-kserve-54fcdb76cf-v9nmg\" (UID: \"c2460f3a-585b-4df3-8b03-ce673641ac61\") " pod="ai-tenant-e2e-inf-a-2236bf/test-model-2236bf-kserve-54fcdb76cf-v9nmg"
Jul 06 03:13:36.209753 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:36.209673    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2460f3a-585b-4df3-8b03-ce673641ac61-tmp-dir\") pod \"test-model-2236bf-kserve-54fcdb76cf-v9nmg\" (UID: \"c2460f3a-585b-4df3-8b03-ce673641ac61\") " pod="ai-tenant-e2e-inf-a-2236bf/test-model-2236bf-kserve-54fcdb76cf-v9nmg"
Jul 06 03:13:36.209753 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:36.209697    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2460f3a-585b-4df3-8b03-ce673641ac61-tls-certs\") pod \"test-model-2236bf-kserve-54fcdb76cf-v9nmg\" (UID: \"c2460f3a-585b-4df3-8b03-ce673641ac61\") " pod="ai-tenant-e2e-inf-a-2236bf/test-model-2236bf-kserve-54fcdb76cf-v9nmg"
Jul 06 03:13:36.209753 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:36.209714    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2460f3a-585b-4df3-8b03-ce673641ac61-model-cache\") pod \"test-model-2236bf-kserve-54fcdb76cf-v9nmg\" (UID: \"c2460f3a-585b-4df3-8b03-ce673641ac61\") " pod="ai-tenant-e2e-inf-a-2236bf/test-model-2236bf-kserve-54fcdb76cf-v9nmg"
Jul 06 03:13:36.310606 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:36.310572    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c2460f3a-585b-4df3-8b03-ce673641ac61-dshm\") pod \"test-model-2236bf-kserve-54fcdb76cf-v9nmg\" (UID: \"c2460f3a-585b-4df3-8b03-ce673641ac61\") " pod="ai-tenant-e2e-inf-a-2236bf/test-model-2236bf-kserve-54fcdb76cf-v9nmg"
Jul 06 03:13:36.310606 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:36.310604    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2460f3a-585b-4df3-8b03-ce673641ac61-tmp-dir\") pod \"test-model-2236bf-kserve-54fcdb76cf-v9nmg\" (UID: \"c2460f3a-585b-4df3-8b03-ce673641ac61\") " pod="ai-tenant-e2e-inf-a-2236bf/test-model-2236bf-kserve-54fcdb76cf-v9nmg"
Jul 06 03:13:36.310841 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:36.310647    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2460f3a-585b-4df3-8b03-ce673641ac61-tls-certs\") pod \"test-model-2236bf-kserve-54fcdb76cf-v9nmg\" (UID: \"c2460f3a-585b-4df3-8b03-ce673641ac61\") " pod="ai-tenant-e2e-inf-a-2236bf/test-model-2236bf-kserve-54fcdb76cf-v9nmg"
Jul 06 03:13:36.310841 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:36.310689    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2460f3a-585b-4df3-8b03-ce673641ac61-model-cache\") pod \"test-model-2236bf-kserve-54fcdb76cf-v9nmg\" (UID: \"c2460f3a-585b-4df3-8b03-ce673641ac61\") " pod="ai-tenant-e2e-inf-a-2236bf/test-model-2236bf-kserve-54fcdb76cf-v9nmg"
Jul 06 03:13:36.310841 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:36.310735    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c2460f3a-585b-4df3-8b03-ce673641ac61-home\") pod \"test-model-2236bf-kserve-54fcdb76cf-v9nmg\" (UID: \"c2460f3a-585b-4df3-8b03-ce673641ac61\") " pod="ai-tenant-e2e-inf-a-2236bf/test-model-2236bf-kserve-54fcdb76cf-v9nmg"
Jul 06 03:13:36.310841 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:36.310770    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq2cv\" (UniqueName: \"kubernetes.io/projected/c2460f3a-585b-4df3-8b03-ce673641ac61-kube-api-access-zq2cv\") pod \"test-model-2236bf-kserve-54fcdb76cf-v9nmg\" (UID: \"c2460f3a-585b-4df3-8b03-ce673641ac61\") " pod="ai-tenant-e2e-inf-a-2236bf/test-model-2236bf-kserve-54fcdb76cf-v9nmg"
Jul 06 03:13:36.311104 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:36.311073    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2460f3a-585b-4df3-8b03-ce673641ac61-tmp-dir\") pod \"test-model-2236bf-kserve-54fcdb76cf-v9nmg\" (UID: \"c2460f3a-585b-4df3-8b03-ce673641ac61\") " pod="ai-tenant-e2e-inf-a-2236bf/test-model-2236bf-kserve-54fcdb76cf-v9nmg"
Jul 06 03:13:36.311270 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:36.311244    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c2460f3a-585b-4df3-8b03-ce673641ac61-home\") pod \"test-model-2236bf-kserve-54fcdb76cf-v9nmg\" (UID: \"c2460f3a-585b-4df3-8b03-ce673641ac61\") " pod="ai-tenant-e2e-inf-a-2236bf/test-model-2236bf-kserve-54fcdb76cf-v9nmg"
Jul 06 03:13:36.311392 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:36.311292    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2460f3a-585b-4df3-8b03-ce673641ac61-model-cache\") pod \"test-model-2236bf-kserve-54fcdb76cf-v9nmg\" (UID: \"c2460f3a-585b-4df3-8b03-ce673641ac61\") " pod="ai-tenant-e2e-inf-a-2236bf/test-model-2236bf-kserve-54fcdb76cf-v9nmg"
Jul 06 03:13:36.313045 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:36.313028    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c2460f3a-585b-4df3-8b03-ce673641ac61-dshm\") pod \"test-model-2236bf-kserve-54fcdb76cf-v9nmg\" (UID: \"c2460f3a-585b-4df3-8b03-ce673641ac61\") " pod="ai-tenant-e2e-inf-a-2236bf/test-model-2236bf-kserve-54fcdb76cf-v9nmg"
Jul 06 03:13:36.313240 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:36.313223    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2460f3a-585b-4df3-8b03-ce673641ac61-tls-certs\") pod \"test-model-2236bf-kserve-54fcdb76cf-v9nmg\" (UID: \"c2460f3a-585b-4df3-8b03-ce673641ac61\") " pod="ai-tenant-e2e-inf-a-2236bf/test-model-2236bf-kserve-54fcdb76cf-v9nmg"
Jul 06 03:13:36.318394 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:36.318372    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq2cv\" (UniqueName: \"kubernetes.io/projected/c2460f3a-585b-4df3-8b03-ce673641ac61-kube-api-access-zq2cv\") pod \"test-model-2236bf-kserve-54fcdb76cf-v9nmg\" (UID: \"c2460f3a-585b-4df3-8b03-ce673641ac61\") " pod="ai-tenant-e2e-inf-a-2236bf/test-model-2236bf-kserve-54fcdb76cf-v9nmg"
Jul 06 03:13:36.481373 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:36.481294    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2236bf/test-model-2236bf-kserve-54fcdb76cf-v9nmg"
Jul 06 03:13:36.613651 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:36.613620    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-2236bf/test-model-2236bf-kserve-54fcdb76cf-v9nmg"]
Jul 06 03:13:36.615488 ip-10-0-131-238 kubenswrapper[2570]: W0706 03:13:36.615456    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc2460f3a_585b_4df3_8b03_ce673641ac61.slice/crio-7049cfead7bc8e33d4c70d26bc6c17bc723735a97e7cf9e2dd5c8ee72e8b93d2 WatchSource:0}: Error finding container 7049cfead7bc8e33d4c70d26bc6c17bc723735a97e7cf9e2dd5c8ee72e8b93d2: Status 404 returned error can't find the container with id 7049cfead7bc8e33d4c70d26bc6c17bc723735a97e7cf9e2dd5c8ee72e8b93d2
Jul 06 03:13:37.132338 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:37.132304    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2236bf/test-model-2236bf-kserve-54fcdb76cf-v9nmg" event={"ID":"c2460f3a-585b-4df3-8b03-ce673641ac61","Type":"ContainerStarted","Data":"56abd1530c18ecc112d1b92c482b5208c57169071b9c5cbd48530e29aaa2a795"}
Jul 06 03:13:37.132532 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:37.132347    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2236bf/test-model-2236bf-kserve-54fcdb76cf-v9nmg" event={"ID":"c2460f3a-585b-4df3-8b03-ce673641ac61","Type":"ContainerStarted","Data":"7049cfead7bc8e33d4c70d26bc6c17bc723735a97e7cf9e2dd5c8ee72e8b93d2"}
Jul 06 03:13:37.150769 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:37.150716    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-2236bf/test-model-2236bf-kserve-54fcdb76cf-v9nmg" podStartSLOduration=1.150701878 podStartE2EDuration="1.150701878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 03:13:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 03:13:37.147673788 +0000 UTC m=+2070.804683452" watchObservedRunningTime="2026-07-06 03:13:37.150701878 +0000 UTC m=+2070.807711542"
Jul 06 03:13:43.404547 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:43.404509    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:13:43.505463 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:43.505435    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:13:46.481972 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:46.481942    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-2236bf/test-model-2236bf-kserve-54fcdb76cf-v9nmg"
Jul 06 03:13:46.482345 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:46.482004    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-2236bf/test-model-2236bf-kserve-54fcdb76cf-v9nmg"
Jul 06 03:13:46.494612 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:46.494588    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-2236bf/test-model-2236bf-kserve-54fcdb76cf-v9nmg"
Jul 06 03:13:47.194593 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:13:47.194559    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-2236bf/test-model-2236bf-kserve-54fcdb76cf-v9nmg"
Jul 06 03:14:07.365157 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:07.365128    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfxlc_b2861d04-c87b-43b1-9bff-2b2199a136a3/ovn-acl-logging/0.log"
Jul 06 03:14:07.371922 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:07.371898    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfxlc_b2861d04-c87b-43b1-9bff-2b2199a136a3/ovn-acl-logging/0.log"
Jul 06 03:14:09.576290 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:09.576253    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-dd35c6/test-model-dd35c6-kserve-5749676547-bvkfv"]
Jul 06 03:14:09.580152 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:09.580134    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-dd35c6/test-model-dd35c6-kserve-5749676547-bvkfv"
Jul 06 03:14:09.583158 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:09.583128    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-dd35c6\"/\"default-dockercfg-cwjkw\""
Jul 06 03:14:09.583326 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:09.583155    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-dd35c6\"/\"test-model-dd35c6-kserve-self-signed-certs\""
Jul 06 03:14:09.583326 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:09.583193    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-dd35c6\"/\"openshift-service-ca.crt\""
Jul 06 03:14:09.583326 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:09.583323    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-dd35c6\"/\"kube-root-ca.crt\""
Jul 06 03:14:09.589235 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:09.589216    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-dd35c6/test-model-dd35c6-kserve-5749676547-bvkfv"]
Jul 06 03:14:09.683572 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:09.683541    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f386a9aa-b8c5-4d58-becb-3024a545dfe3-dshm\") pod \"test-model-dd35c6-kserve-5749676547-bvkfv\" (UID: \"f386a9aa-b8c5-4d58-becb-3024a545dfe3\") " pod="ai-tenant-e2e-inf-b-dd35c6/test-model-dd35c6-kserve-5749676547-bvkfv"
Jul 06 03:14:09.683689 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:09.683587    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw8fw\" (UniqueName: \"kubernetes.io/projected/f386a9aa-b8c5-4d58-becb-3024a545dfe3-kube-api-access-qw8fw\") pod \"test-model-dd35c6-kserve-5749676547-bvkfv\" (UID: \"f386a9aa-b8c5-4d58-becb-3024a545dfe3\") " pod="ai-tenant-e2e-inf-b-dd35c6/test-model-dd35c6-kserve-5749676547-bvkfv"
Jul 06 03:14:09.683689 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:09.683613    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f386a9aa-b8c5-4d58-becb-3024a545dfe3-tmp-dir\") pod \"test-model-dd35c6-kserve-5749676547-bvkfv\" (UID: \"f386a9aa-b8c5-4d58-becb-3024a545dfe3\") " pod="ai-tenant-e2e-inf-b-dd35c6/test-model-dd35c6-kserve-5749676547-bvkfv"
Jul 06 03:14:09.683768 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:09.683684    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f386a9aa-b8c5-4d58-becb-3024a545dfe3-model-cache\") pod \"test-model-dd35c6-kserve-5749676547-bvkfv\" (UID: \"f386a9aa-b8c5-4d58-becb-3024a545dfe3\") " pod="ai-tenant-e2e-inf-b-dd35c6/test-model-dd35c6-kserve-5749676547-bvkfv"
Jul 06 03:14:09.683768 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:09.683722    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f386a9aa-b8c5-4d58-becb-3024a545dfe3-tls-certs\") pod \"test-model-dd35c6-kserve-5749676547-bvkfv\" (UID: \"f386a9aa-b8c5-4d58-becb-3024a545dfe3\") " pod="ai-tenant-e2e-inf-b-dd35c6/test-model-dd35c6-kserve-5749676547-bvkfv"
Jul 06 03:14:09.683836 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:09.683773    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f386a9aa-b8c5-4d58-becb-3024a545dfe3-home\") pod \"test-model-dd35c6-kserve-5749676547-bvkfv\" (UID: \"f386a9aa-b8c5-4d58-becb-3024a545dfe3\") " pod="ai-tenant-e2e-inf-b-dd35c6/test-model-dd35c6-kserve-5749676547-bvkfv"
Jul 06 03:14:09.771567 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:09.771526    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:14:09.784579 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:09.784547    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f386a9aa-b8c5-4d58-becb-3024a545dfe3-home\") pod \"test-model-dd35c6-kserve-5749676547-bvkfv\" (UID: \"f386a9aa-b8c5-4d58-becb-3024a545dfe3\") " pod="ai-tenant-e2e-inf-b-dd35c6/test-model-dd35c6-kserve-5749676547-bvkfv"
Jul 06 03:14:09.784579 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:09.784585    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f386a9aa-b8c5-4d58-becb-3024a545dfe3-dshm\") pod \"test-model-dd35c6-kserve-5749676547-bvkfv\" (UID: \"f386a9aa-b8c5-4d58-becb-3024a545dfe3\") " pod="ai-tenant-e2e-inf-b-dd35c6/test-model-dd35c6-kserve-5749676547-bvkfv"
Jul 06 03:14:09.784788 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:09.784686    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw8fw\" (UniqueName: \"kubernetes.io/projected/f386a9aa-b8c5-4d58-becb-3024a545dfe3-kube-api-access-qw8fw\") pod \"test-model-dd35c6-kserve-5749676547-bvkfv\" (UID: \"f386a9aa-b8c5-4d58-becb-3024a545dfe3\") " pod="ai-tenant-e2e-inf-b-dd35c6/test-model-dd35c6-kserve-5749676547-bvkfv"
Jul 06 03:14:09.784788 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:09.784705    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f386a9aa-b8c5-4d58-becb-3024a545dfe3-tmp-dir\") pod \"test-model-dd35c6-kserve-5749676547-bvkfv\" (UID: \"f386a9aa-b8c5-4d58-becb-3024a545dfe3\") " pod="ai-tenant-e2e-inf-b-dd35c6/test-model-dd35c6-kserve-5749676547-bvkfv"
Jul 06 03:14:09.784788 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:09.784732    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f386a9aa-b8c5-4d58-becb-3024a545dfe3-model-cache\") pod \"test-model-dd35c6-kserve-5749676547-bvkfv\" (UID: \"f386a9aa-b8c5-4d58-becb-3024a545dfe3\") " pod="ai-tenant-e2e-inf-b-dd35c6/test-model-dd35c6-kserve-5749676547-bvkfv"
Jul 06 03:14:09.784788 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:09.784755    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f386a9aa-b8c5-4d58-becb-3024a545dfe3-tls-certs\") pod \"test-model-dd35c6-kserve-5749676547-bvkfv\" (UID: \"f386a9aa-b8c5-4d58-becb-3024a545dfe3\") " pod="ai-tenant-e2e-inf-b-dd35c6/test-model-dd35c6-kserve-5749676547-bvkfv"
Jul 06 03:14:09.785036 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:09.784921    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f386a9aa-b8c5-4d58-becb-3024a545dfe3-home\") pod \"test-model-dd35c6-kserve-5749676547-bvkfv\" (UID: \"f386a9aa-b8c5-4d58-becb-3024a545dfe3\") " pod="ai-tenant-e2e-inf-b-dd35c6/test-model-dd35c6-kserve-5749676547-bvkfv"
Jul 06 03:14:09.785147 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:09.785125    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f386a9aa-b8c5-4d58-becb-3024a545dfe3-tmp-dir\") pod \"test-model-dd35c6-kserve-5749676547-bvkfv\" (UID: \"f386a9aa-b8c5-4d58-becb-3024a545dfe3\") " pod="ai-tenant-e2e-inf-b-dd35c6/test-model-dd35c6-kserve-5749676547-bvkfv"
Jul 06 03:14:09.785204 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:09.785157    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f386a9aa-b8c5-4d58-becb-3024a545dfe3-model-cache\") pod \"test-model-dd35c6-kserve-5749676547-bvkfv\" (UID: \"f386a9aa-b8c5-4d58-becb-3024a545dfe3\") " pod="ai-tenant-e2e-inf-b-dd35c6/test-model-dd35c6-kserve-5749676547-bvkfv"
Jul 06 03:14:09.786943 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:09.786921    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f386a9aa-b8c5-4d58-becb-3024a545dfe3-dshm\") pod \"test-model-dd35c6-kserve-5749676547-bvkfv\" (UID: \"f386a9aa-b8c5-4d58-becb-3024a545dfe3\") " pod="ai-tenant-e2e-inf-b-dd35c6/test-model-dd35c6-kserve-5749676547-bvkfv"
Jul 06 03:14:09.787071 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:09.787055    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f386a9aa-b8c5-4d58-becb-3024a545dfe3-tls-certs\") pod \"test-model-dd35c6-kserve-5749676547-bvkfv\" (UID: \"f386a9aa-b8c5-4d58-becb-3024a545dfe3\") " pod="ai-tenant-e2e-inf-b-dd35c6/test-model-dd35c6-kserve-5749676547-bvkfv"
Jul 06 03:14:09.792562 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:09.792539    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw8fw\" (UniqueName: \"kubernetes.io/projected/f386a9aa-b8c5-4d58-becb-3024a545dfe3-kube-api-access-qw8fw\") pod \"test-model-dd35c6-kserve-5749676547-bvkfv\" (UID: \"f386a9aa-b8c5-4d58-becb-3024a545dfe3\") " pod="ai-tenant-e2e-inf-b-dd35c6/test-model-dd35c6-kserve-5749676547-bvkfv"
Jul 06 03:14:09.889474 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:09.889409    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-dd35c6/test-model-dd35c6-kserve-5749676547-bvkfv"
Jul 06 03:14:10.031409 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:10.031382    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-dd35c6/test-model-dd35c6-kserve-5749676547-bvkfv"]
Jul 06 03:14:10.032698 ip-10-0-131-238 kubenswrapper[2570]: W0706 03:14:10.032673    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf386a9aa_b8c5_4d58_becb_3024a545dfe3.slice/crio-f18a3f71cbe2565695df3d03ddde9dd5b5c2377318a3449a78d2dd254018824e WatchSource:0}: Error finding container f18a3f71cbe2565695df3d03ddde9dd5b5c2377318a3449a78d2dd254018824e: Status 404 returned error can't find the container with id f18a3f71cbe2565695df3d03ddde9dd5b5c2377318a3449a78d2dd254018824e
Jul 06 03:14:10.302423 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:10.302375    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-dd35c6/test-model-dd35c6-kserve-5749676547-bvkfv" event={"ID":"f386a9aa-b8c5-4d58-becb-3024a545dfe3","Type":"ContainerStarted","Data":"b1e9fac392c88a9b50870ae2aefcd9f3be158b8bd177d90d82632ebe6803aaa7"}
Jul 06 03:14:10.302423 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:10.302428    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-dd35c6/test-model-dd35c6-kserve-5749676547-bvkfv" event={"ID":"f386a9aa-b8c5-4d58-becb-3024a545dfe3","Type":"ContainerStarted","Data":"f18a3f71cbe2565695df3d03ddde9dd5b5c2377318a3449a78d2dd254018824e"}
Jul 06 03:14:10.321411 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:10.321361    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-dd35c6/test-model-dd35c6-kserve-5749676547-bvkfv" podStartSLOduration=1.321345026 podStartE2EDuration="1.321345026s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 03:14:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 03:14:10.319135815 +0000 UTC m=+2103.976145480" watchObservedRunningTime="2026-07-06 03:14:10.321345026 +0000 UTC m=+2103.978354690"
Jul 06 03:14:19.890023 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:19.889974    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-dd35c6/test-model-dd35c6-kserve-5749676547-bvkfv"
Jul 06 03:14:19.890427 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:19.890043    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-dd35c6/test-model-dd35c6-kserve-5749676547-bvkfv"
Jul 06 03:14:19.902316 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:19.902294    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-dd35c6/test-model-dd35c6-kserve-5749676547-bvkfv"
Jul 06 03:14:20.363268 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:20.363239    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-dd35c6/test-model-dd35c6-kserve-5749676547-bvkfv"
Jul 06 03:14:30.170503 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:30.170456    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-2236bf/test-model-2236bf-kserve-54fcdb76cf-v9nmg"]
Jul 06 03:14:30.190624 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:30.190585    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:14:31.061963 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:31.061930    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-dd35c6/test-model-dd35c6-kserve-5749676547-bvkfv"]
Jul 06 03:14:31.082810 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:31.082779    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:14:31.322369 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:31.322279    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:14:31.757136 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:31.757034    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:14:31.964962 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:31.964923    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:14:32.066429 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:32.066394    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:14:32.207561 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:32.207532    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:14:34.510124 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:34.510082    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:14:36.935352 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:36.935304    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:14:45.191305 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:45.191256    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-2236bf/test-model-2236bf-kserve-54fcdb76cf-v9nmg" podUID="c2460f3a-585b-4df3-8b03-ce673641ac61" containerName="main" containerID="cri-o://56abd1530c18ecc112d1b92c482b5208c57169071b9c5cbd48530e29aaa2a795" gracePeriod=45
Jul 06 03:14:45.433570 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:45.433544    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2236bf/test-model-2236bf-kserve-54fcdb76cf-v9nmg"
Jul 06 03:14:45.484373 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:45.484290    2570 generic.go:356] "Generic (PLEG): container finished" podID="c2460f3a-585b-4df3-8b03-ce673641ac61" containerID="56abd1530c18ecc112d1b92c482b5208c57169071b9c5cbd48530e29aaa2a795" exitCode=0
Jul 06 03:14:45.484373 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:45.484349    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2236bf/test-model-2236bf-kserve-54fcdb76cf-v9nmg"
Jul 06 03:14:45.484589 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:45.484384    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2236bf/test-model-2236bf-kserve-54fcdb76cf-v9nmg" event={"ID":"c2460f3a-585b-4df3-8b03-ce673641ac61","Type":"ContainerDied","Data":"56abd1530c18ecc112d1b92c482b5208c57169071b9c5cbd48530e29aaa2a795"}
Jul 06 03:14:45.484589 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:45.484436    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2236bf/test-model-2236bf-kserve-54fcdb76cf-v9nmg" event={"ID":"c2460f3a-585b-4df3-8b03-ce673641ac61","Type":"ContainerDied","Data":"7049cfead7bc8e33d4c70d26bc6c17bc723735a97e7cf9e2dd5c8ee72e8b93d2"}
Jul 06 03:14:45.484589 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:45.484459    2570 scope.go:117] "RemoveContainer" containerID="56abd1530c18ecc112d1b92c482b5208c57169071b9c5cbd48530e29aaa2a795"
Jul 06 03:14:45.495415 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:45.495398    2570 scope.go:117] "RemoveContainer" containerID="56abd1530c18ecc112d1b92c482b5208c57169071b9c5cbd48530e29aaa2a795"
Jul 06 03:14:45.495727 ip-10-0-131-238 kubenswrapper[2570]: E0706 03:14:45.495698    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56abd1530c18ecc112d1b92c482b5208c57169071b9c5cbd48530e29aaa2a795\": container with ID starting with 56abd1530c18ecc112d1b92c482b5208c57169071b9c5cbd48530e29aaa2a795 not found: ID does not exist" containerID="56abd1530c18ecc112d1b92c482b5208c57169071b9c5cbd48530e29aaa2a795"
Jul 06 03:14:45.495796 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:45.495736    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56abd1530c18ecc112d1b92c482b5208c57169071b9c5cbd48530e29aaa2a795"} err="failed to get container status \"56abd1530c18ecc112d1b92c482b5208c57169071b9c5cbd48530e29aaa2a795\": rpc error: code = NotFound desc = could not find container \"56abd1530c18ecc112d1b92c482b5208c57169071b9c5cbd48530e29aaa2a795\": container with ID starting with 56abd1530c18ecc112d1b92c482b5208c57169071b9c5cbd48530e29aaa2a795 not found: ID does not exist"
Jul 06 03:14:45.581818 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:45.581788    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2460f3a-585b-4df3-8b03-ce673641ac61-tmp-dir\") pod \"c2460f3a-585b-4df3-8b03-ce673641ac61\" (UID: \"c2460f3a-585b-4df3-8b03-ce673641ac61\") "
Jul 06 03:14:45.581966 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:45.581823    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c2460f3a-585b-4df3-8b03-ce673641ac61-dshm\") pod \"c2460f3a-585b-4df3-8b03-ce673641ac61\" (UID: \"c2460f3a-585b-4df3-8b03-ce673641ac61\") "
Jul 06 03:14:45.581966 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:45.581842    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2460f3a-585b-4df3-8b03-ce673641ac61-tls-certs\") pod \"c2460f3a-585b-4df3-8b03-ce673641ac61\" (UID: \"c2460f3a-585b-4df3-8b03-ce673641ac61\") "
Jul 06 03:14:45.581966 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:45.581870    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zq2cv\" (UniqueName: \"kubernetes.io/projected/c2460f3a-585b-4df3-8b03-ce673641ac61-kube-api-access-zq2cv\") pod \"c2460f3a-585b-4df3-8b03-ce673641ac61\" (UID: \"c2460f3a-585b-4df3-8b03-ce673641ac61\") "
Jul 06 03:14:45.581966 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:45.581965    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2460f3a-585b-4df3-8b03-ce673641ac61-model-cache\") pod \"c2460f3a-585b-4df3-8b03-ce673641ac61\" (UID: \"c2460f3a-585b-4df3-8b03-ce673641ac61\") "
Jul 06 03:14:45.582214 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:45.582034    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c2460f3a-585b-4df3-8b03-ce673641ac61-home\") pod \"c2460f3a-585b-4df3-8b03-ce673641ac61\" (UID: \"c2460f3a-585b-4df3-8b03-ce673641ac61\") "
Jul 06 03:14:45.582214 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:45.582124    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2460f3a-585b-4df3-8b03-ce673641ac61-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c2460f3a-585b-4df3-8b03-ce673641ac61" (UID: "c2460f3a-585b-4df3-8b03-ce673641ac61"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:14:45.582323 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:45.582280    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2460f3a-585b-4df3-8b03-ce673641ac61-model-cache" (OuterVolumeSpecName: "model-cache") pod "c2460f3a-585b-4df3-8b03-ce673641ac61" (UID: "c2460f3a-585b-4df3-8b03-ce673641ac61"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:14:45.582368 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:45.582319    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2460f3a-585b-4df3-8b03-ce673641ac61-home" (OuterVolumeSpecName: "home") pod "c2460f3a-585b-4df3-8b03-ce673641ac61" (UID: "c2460f3a-585b-4df3-8b03-ce673641ac61"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:14:45.582411 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:45.582365    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2460f3a-585b-4df3-8b03-ce673641ac61-tmp-dir\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:14:45.584164 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:45.584139    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2460f3a-585b-4df3-8b03-ce673641ac61-dshm" (OuterVolumeSpecName: "dshm") pod "c2460f3a-585b-4df3-8b03-ce673641ac61" (UID: "c2460f3a-585b-4df3-8b03-ce673641ac61"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:14:45.584439 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:45.584412    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2460f3a-585b-4df3-8b03-ce673641ac61-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c2460f3a-585b-4df3-8b03-ce673641ac61" (UID: "c2460f3a-585b-4df3-8b03-ce673641ac61"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 03:14:45.584518 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:45.584438    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2460f3a-585b-4df3-8b03-ce673641ac61-kube-api-access-zq2cv" (OuterVolumeSpecName: "kube-api-access-zq2cv") pod "c2460f3a-585b-4df3-8b03-ce673641ac61" (UID: "c2460f3a-585b-4df3-8b03-ce673641ac61"). InnerVolumeSpecName "kube-api-access-zq2cv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 03:14:45.683139 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:45.683111    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2460f3a-585b-4df3-8b03-ce673641ac61-model-cache\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:14:45.683139 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:45.683139    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c2460f3a-585b-4df3-8b03-ce673641ac61-home\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:14:45.683310 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:45.683152    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c2460f3a-585b-4df3-8b03-ce673641ac61-dshm\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:14:45.683310 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:45.683160    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2460f3a-585b-4df3-8b03-ce673641ac61-tls-certs\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:14:45.683310 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:45.683169    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zq2cv\" (UniqueName: \"kubernetes.io/projected/c2460f3a-585b-4df3-8b03-ce673641ac61-kube-api-access-zq2cv\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:14:45.807506 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:45.807477    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-2236bf/test-model-2236bf-kserve-54fcdb76cf-v9nmg"]
Jul 06 03:14:45.810868 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:45.810846    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-2236bf/test-model-2236bf-kserve-54fcdb76cf-v9nmg"]
Jul 06 03:14:46.082700 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:46.082606    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-dd35c6/test-model-dd35c6-kserve-5749676547-bvkfv" podUID="f386a9aa-b8c5-4d58-becb-3024a545dfe3" containerName="main" containerID="cri-o://b1e9fac392c88a9b50870ae2aefcd9f3be158b8bd177d90d82632ebe6803aaa7" gracePeriod=45
Jul 06 03:14:46.338495 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:46.338439    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-dd35c6/test-model-dd35c6-kserve-5749676547-bvkfv"
Jul 06 03:14:46.389278 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:46.389252    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f386a9aa-b8c5-4d58-becb-3024a545dfe3-tmp-dir\") pod \"f386a9aa-b8c5-4d58-becb-3024a545dfe3\" (UID: \"f386a9aa-b8c5-4d58-becb-3024a545dfe3\") "
Jul 06 03:14:46.389404 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:46.389290    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f386a9aa-b8c5-4d58-becb-3024a545dfe3-model-cache\") pod \"f386a9aa-b8c5-4d58-becb-3024a545dfe3\" (UID: \"f386a9aa-b8c5-4d58-becb-3024a545dfe3\") "
Jul 06 03:14:46.389404 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:46.389309    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f386a9aa-b8c5-4d58-becb-3024a545dfe3-tls-certs\") pod \"f386a9aa-b8c5-4d58-becb-3024a545dfe3\" (UID: \"f386a9aa-b8c5-4d58-becb-3024a545dfe3\") "
Jul 06 03:14:46.389404 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:46.389343    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f386a9aa-b8c5-4d58-becb-3024a545dfe3-home\") pod \"f386a9aa-b8c5-4d58-becb-3024a545dfe3\" (UID: \"f386a9aa-b8c5-4d58-becb-3024a545dfe3\") "
Jul 06 03:14:46.389404 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:46.389375    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qw8fw\" (UniqueName: \"kubernetes.io/projected/f386a9aa-b8c5-4d58-becb-3024a545dfe3-kube-api-access-qw8fw\") pod \"f386a9aa-b8c5-4d58-becb-3024a545dfe3\" (UID: \"f386a9aa-b8c5-4d58-becb-3024a545dfe3\") "
Jul 06 03:14:46.389404 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:46.389403    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f386a9aa-b8c5-4d58-becb-3024a545dfe3-dshm\") pod \"f386a9aa-b8c5-4d58-becb-3024a545dfe3\" (UID: \"f386a9aa-b8c5-4d58-becb-3024a545dfe3\") "
Jul 06 03:14:46.389665 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:46.389555    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f386a9aa-b8c5-4d58-becb-3024a545dfe3-model-cache" (OuterVolumeSpecName: "model-cache") pod "f386a9aa-b8c5-4d58-becb-3024a545dfe3" (UID: "f386a9aa-b8c5-4d58-becb-3024a545dfe3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:14:46.389665 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:46.389570    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f386a9aa-b8c5-4d58-becb-3024a545dfe3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f386a9aa-b8c5-4d58-becb-3024a545dfe3" (UID: "f386a9aa-b8c5-4d58-becb-3024a545dfe3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:14:46.389665 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:46.389606    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f386a9aa-b8c5-4d58-becb-3024a545dfe3-home" (OuterVolumeSpecName: "home") pod "f386a9aa-b8c5-4d58-becb-3024a545dfe3" (UID: "f386a9aa-b8c5-4d58-becb-3024a545dfe3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:14:46.389811 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:46.389723    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f386a9aa-b8c5-4d58-becb-3024a545dfe3-home\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:14:46.389811 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:46.389745    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f386a9aa-b8c5-4d58-becb-3024a545dfe3-tmp-dir\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:14:46.389811 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:46.389762    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f386a9aa-b8c5-4d58-becb-3024a545dfe3-model-cache\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:14:46.391621 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:46.391595    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f386a9aa-b8c5-4d58-becb-3024a545dfe3-kube-api-access-qw8fw" (OuterVolumeSpecName: "kube-api-access-qw8fw") pod "f386a9aa-b8c5-4d58-becb-3024a545dfe3" (UID: "f386a9aa-b8c5-4d58-becb-3024a545dfe3"). InnerVolumeSpecName "kube-api-access-qw8fw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 03:14:46.391752 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:46.391620    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f386a9aa-b8c5-4d58-becb-3024a545dfe3-dshm" (OuterVolumeSpecName: "dshm") pod "f386a9aa-b8c5-4d58-becb-3024a545dfe3" (UID: "f386a9aa-b8c5-4d58-becb-3024a545dfe3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:14:46.391752 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:46.391635    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f386a9aa-b8c5-4d58-becb-3024a545dfe3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f386a9aa-b8c5-4d58-becb-3024a545dfe3" (UID: "f386a9aa-b8c5-4d58-becb-3024a545dfe3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 03:14:46.490158 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:46.490126    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qw8fw\" (UniqueName: \"kubernetes.io/projected/f386a9aa-b8c5-4d58-becb-3024a545dfe3-kube-api-access-qw8fw\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:14:46.490158 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:46.490156    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f386a9aa-b8c5-4d58-becb-3024a545dfe3-dshm\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:14:46.490349 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:46.490170    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f386a9aa-b8c5-4d58-becb-3024a545dfe3-tls-certs\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:14:46.491978 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:46.491951    2570 generic.go:356] "Generic (PLEG): container finished" podID="f386a9aa-b8c5-4d58-becb-3024a545dfe3" containerID="b1e9fac392c88a9b50870ae2aefcd9f3be158b8bd177d90d82632ebe6803aaa7" exitCode=0
Jul 06 03:14:46.492083 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:46.492006    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-dd35c6/test-model-dd35c6-kserve-5749676547-bvkfv" event={"ID":"f386a9aa-b8c5-4d58-becb-3024a545dfe3","Type":"ContainerDied","Data":"b1e9fac392c88a9b50870ae2aefcd9f3be158b8bd177d90d82632ebe6803aaa7"}
Jul 06 03:14:46.492083 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:46.492048    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-dd35c6/test-model-dd35c6-kserve-5749676547-bvkfv" event={"ID":"f386a9aa-b8c5-4d58-becb-3024a545dfe3","Type":"ContainerDied","Data":"f18a3f71cbe2565695df3d03ddde9dd5b5c2377318a3449a78d2dd254018824e"}
Jul 06 03:14:46.492083 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:46.492065    2570 scope.go:117] "RemoveContainer" containerID="b1e9fac392c88a9b50870ae2aefcd9f3be158b8bd177d90d82632ebe6803aaa7"
Jul 06 03:14:46.492204 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:46.492017    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-dd35c6/test-model-dd35c6-kserve-5749676547-bvkfv"
Jul 06 03:14:46.501699 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:46.501683    2570 scope.go:117] "RemoveContainer" containerID="b1e9fac392c88a9b50870ae2aefcd9f3be158b8bd177d90d82632ebe6803aaa7"
Jul 06 03:14:46.501934 ip-10-0-131-238 kubenswrapper[2570]: E0706 03:14:46.501916    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1e9fac392c88a9b50870ae2aefcd9f3be158b8bd177d90d82632ebe6803aaa7\": container with ID starting with b1e9fac392c88a9b50870ae2aefcd9f3be158b8bd177d90d82632ebe6803aaa7 not found: ID does not exist" containerID="b1e9fac392c88a9b50870ae2aefcd9f3be158b8bd177d90d82632ebe6803aaa7"
Jul 06 03:14:46.501995 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:46.501942    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1e9fac392c88a9b50870ae2aefcd9f3be158b8bd177d90d82632ebe6803aaa7"} err="failed to get container status \"b1e9fac392c88a9b50870ae2aefcd9f3be158b8bd177d90d82632ebe6803aaa7\": rpc error: code = NotFound desc = could not find container \"b1e9fac392c88a9b50870ae2aefcd9f3be158b8bd177d90d82632ebe6803aaa7\": container with ID starting with b1e9fac392c88a9b50870ae2aefcd9f3be158b8bd177d90d82632ebe6803aaa7 not found: ID does not exist"
Jul 06 03:14:46.513623 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:46.513599    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-dd35c6/test-model-dd35c6-kserve-5749676547-bvkfv"]
Jul 06 03:14:46.515744 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:46.515722    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-dd35c6/test-model-dd35c6-kserve-5749676547-bvkfv"]
Jul 06 03:14:47.233496 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:47.233463    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2460f3a-585b-4df3-8b03-ce673641ac61" path="/var/lib/kubelet/pods/c2460f3a-585b-4df3-8b03-ce673641ac61/volumes"
Jul 06 03:14:47.233861 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:14:47.233848    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f386a9aa-b8c5-4d58-becb-3024a545dfe3" path="/var/lib/kubelet/pods/f386a9aa-b8c5-4d58-becb-3024a545dfe3/volumes"
Jul 06 03:15:13.383909 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:13.383870    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:13.747595 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:13.747500    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:14.032253 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:14.032212    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:14.243174 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:14.243134    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:14.427642 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:14.427564    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:14.820164 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:14.820127    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:14.919959 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:14.919926    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:15.023655 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:15.023625    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:15.133453 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:15.133359    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:20.539496 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:20.539459    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:20.594719 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:20.594681    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:20.795515 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:20.795420    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:21.016379 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:21.016350    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:21.354231 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:21.354197    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:21.666701 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:21.666612    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:21.797359 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:21.797305    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:24.677438 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:24.677394    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:24.778138 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:24.778088    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:24.902255 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:24.902221    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:25.324697 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:25.324658    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:25.425498 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:25.425465    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:25.538391 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:25.538348    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:29.164910 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:29.164867    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:29.371233 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:29.371198    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:29.610991 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:29.610953    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:29.918516 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:29.918424    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:30.030562 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:30.030530    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:32.751147 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:32.751111    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:32.842200 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:32.842158    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:32.942578 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:32.942552    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:33.044807 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:33.044777    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:33.411329 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:33.411258    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:33.513460 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:33.513431    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:37.233846 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:37.233810    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:45.312572 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:45.312538    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:45.677935 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:45.677831    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:45.778596 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:45.778561    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:45.842469 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:45.842423    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:46.011996 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:46.011897    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:51.355024 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:51.354965    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:51.415144 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:51.415112    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:51.601084 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:51.601049    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:51.812053 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:51.812018    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:51.985914 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:51.985878    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:52.364705 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:52.364671    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:52.464967 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:52.464933    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:52.565351 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:52.565317    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:52.665388 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:52.665300    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:55.617277 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:55.617243    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:55.718284 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:55.718243    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:58.024524 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:58.024476    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:58.086860 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:58.086821    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:58.368605 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:58.368566    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:58.526092 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:58.526058    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:58.852418 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:58.852386    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:59.183083 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:59.182994    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:15:59.382903 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:15:59.382870    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:16:01.925888 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:01.925848    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:16:02.025460 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:02.025428    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:16:02.196764 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:02.196679    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:16:02.349818 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:02.349781    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:16:02.918599 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:02.918567    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:16:03.025659 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:03.025623    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:16:06.393965 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:06.393926    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:16:06.791094 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:06.791054    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:16:07.068997 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:07.068897    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:16:07.218925 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:07.218884    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:16:09.981254 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:09.981191    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:16:10.060678 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:10.060645    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:16:10.127292 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:10.127245    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:16:10.528213 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:10.528177    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:16:10.627851 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:10.627811    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:16:14.487010 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:14.486963    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:16:23.667342 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:23.667302    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:16:23.772444 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:23.772412    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:16:31.272243 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:31.272117    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:16:31.375825 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:31.375785    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:16:33.563338 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:33.563300    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:16:34.068247 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:34.068211    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-8edd65/auth-test-model-8edd65-kserve-5645d5d987-jtjxs"]
Jul 06 03:16:34.068552 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:34.068541    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2460f3a-585b-4df3-8b03-ce673641ac61" containerName="main"
Jul 06 03:16:34.068600 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:34.068554    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2460f3a-585b-4df3-8b03-ce673641ac61" containerName="main"
Jul 06 03:16:34.068600 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:34.068571    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f386a9aa-b8c5-4d58-becb-3024a545dfe3" containerName="main"
Jul 06 03:16:34.068600 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:34.068576    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f386a9aa-b8c5-4d58-becb-3024a545dfe3" containerName="main"
Jul 06 03:16:34.068693 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:34.068636    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="f386a9aa-b8c5-4d58-becb-3024a545dfe3" containerName="main"
Jul 06 03:16:34.068693 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:34.068645    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2460f3a-585b-4df3-8b03-ce673641ac61" containerName="main"
Jul 06 03:16:34.071838 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:34.071821    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8edd65/auth-test-model-8edd65-kserve-5645d5d987-jtjxs"
Jul 06 03:16:34.075138 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:34.075112    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-8edd65\"/\"kube-root-ca.crt\""
Jul 06 03:16:34.075138 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:34.075134    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8edd65\"/\"auth-test-model-8edd65-kserve-self-signed-certs\""
Jul 06 03:16:34.075326 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:34.075163    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8edd65\"/\"default-dockercfg-trrx2\""
Jul 06 03:16:34.075326 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:34.075124    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-8edd65\"/\"openshift-service-ca.crt\""
Jul 06 03:16:34.081686 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:34.081660    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8edd65/auth-test-model-8edd65-kserve-5645d5d987-jtjxs"]
Jul 06 03:16:34.090710 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:34.090686    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:16:34.158160 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:34.158136    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b0226df-71ad-4eb2-b908-e150ffd06fdd-tls-certs\") pod \"auth-test-model-8edd65-kserve-5645d5d987-jtjxs\" (UID: \"8b0226df-71ad-4eb2-b908-e150ffd06fdd\") " pod="ai-tenant-e2e-shared-a-8edd65/auth-test-model-8edd65-kserve-5645d5d987-jtjxs"
Jul 06 03:16:34.158258 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:34.158193    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b0226df-71ad-4eb2-b908-e150ffd06fdd-model-cache\") pod \"auth-test-model-8edd65-kserve-5645d5d987-jtjxs\" (UID: \"8b0226df-71ad-4eb2-b908-e150ffd06fdd\") " pod="ai-tenant-e2e-shared-a-8edd65/auth-test-model-8edd65-kserve-5645d5d987-jtjxs"
Jul 06 03:16:34.158258 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:34.158218    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b0226df-71ad-4eb2-b908-e150ffd06fdd-dshm\") pod \"auth-test-model-8edd65-kserve-5645d5d987-jtjxs\" (UID: \"8b0226df-71ad-4eb2-b908-e150ffd06fdd\") " pod="ai-tenant-e2e-shared-a-8edd65/auth-test-model-8edd65-kserve-5645d5d987-jtjxs"
Jul 06 03:16:34.158258 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:34.158240    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkhst\" (UniqueName: \"kubernetes.io/projected/8b0226df-71ad-4eb2-b908-e150ffd06fdd-kube-api-access-hkhst\") pod \"auth-test-model-8edd65-kserve-5645d5d987-jtjxs\" (UID: \"8b0226df-71ad-4eb2-b908-e150ffd06fdd\") " pod="ai-tenant-e2e-shared-a-8edd65/auth-test-model-8edd65-kserve-5645d5d987-jtjxs"
Jul 06 03:16:34.158366 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:34.158270    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b0226df-71ad-4eb2-b908-e150ffd06fdd-tmp-dir\") pod \"auth-test-model-8edd65-kserve-5645d5d987-jtjxs\" (UID: \"8b0226df-71ad-4eb2-b908-e150ffd06fdd\") " pod="ai-tenant-e2e-shared-a-8edd65/auth-test-model-8edd65-kserve-5645d5d987-jtjxs"
Jul 06 03:16:34.158366 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:34.158321    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b0226df-71ad-4eb2-b908-e150ffd06fdd-home\") pod \"auth-test-model-8edd65-kserve-5645d5d987-jtjxs\" (UID: \"8b0226df-71ad-4eb2-b908-e150ffd06fdd\") " pod="ai-tenant-e2e-shared-a-8edd65/auth-test-model-8edd65-kserve-5645d5d987-jtjxs"
Jul 06 03:16:34.259326 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:34.259304    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b0226df-71ad-4eb2-b908-e150ffd06fdd-tmp-dir\") pod \"auth-test-model-8edd65-kserve-5645d5d987-jtjxs\" (UID: \"8b0226df-71ad-4eb2-b908-e150ffd06fdd\") " pod="ai-tenant-e2e-shared-a-8edd65/auth-test-model-8edd65-kserve-5645d5d987-jtjxs"
Jul 06 03:16:34.259417 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:34.259333    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b0226df-71ad-4eb2-b908-e150ffd06fdd-home\") pod \"auth-test-model-8edd65-kserve-5645d5d987-jtjxs\" (UID: \"8b0226df-71ad-4eb2-b908-e150ffd06fdd\") " pod="ai-tenant-e2e-shared-a-8edd65/auth-test-model-8edd65-kserve-5645d5d987-jtjxs"
Jul 06 03:16:34.259417 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:34.259367    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b0226df-71ad-4eb2-b908-e150ffd06fdd-tls-certs\") pod \"auth-test-model-8edd65-kserve-5645d5d987-jtjxs\" (UID: \"8b0226df-71ad-4eb2-b908-e150ffd06fdd\") " pod="ai-tenant-e2e-shared-a-8edd65/auth-test-model-8edd65-kserve-5645d5d987-jtjxs"
Jul 06 03:16:34.259417 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:34.259409    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b0226df-71ad-4eb2-b908-e150ffd06fdd-model-cache\") pod \"auth-test-model-8edd65-kserve-5645d5d987-jtjxs\" (UID: \"8b0226df-71ad-4eb2-b908-e150ffd06fdd\") " pod="ai-tenant-e2e-shared-a-8edd65/auth-test-model-8edd65-kserve-5645d5d987-jtjxs"
Jul 06 03:16:34.259558 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:34.259427    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b0226df-71ad-4eb2-b908-e150ffd06fdd-dshm\") pod \"auth-test-model-8edd65-kserve-5645d5d987-jtjxs\" (UID: \"8b0226df-71ad-4eb2-b908-e150ffd06fdd\") " pod="ai-tenant-e2e-shared-a-8edd65/auth-test-model-8edd65-kserve-5645d5d987-jtjxs"
Jul 06 03:16:34.259558 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:34.259449    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkhst\" (UniqueName: \"kubernetes.io/projected/8b0226df-71ad-4eb2-b908-e150ffd06fdd-kube-api-access-hkhst\") pod \"auth-test-model-8edd65-kserve-5645d5d987-jtjxs\" (UID: \"8b0226df-71ad-4eb2-b908-e150ffd06fdd\") " pod="ai-tenant-e2e-shared-a-8edd65/auth-test-model-8edd65-kserve-5645d5d987-jtjxs"
Jul 06 03:16:34.259759 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:34.259737    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b0226df-71ad-4eb2-b908-e150ffd06fdd-tmp-dir\") pod \"auth-test-model-8edd65-kserve-5645d5d987-jtjxs\" (UID: \"8b0226df-71ad-4eb2-b908-e150ffd06fdd\") " pod="ai-tenant-e2e-shared-a-8edd65/auth-test-model-8edd65-kserve-5645d5d987-jtjxs"
Jul 06 03:16:34.259834 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:34.259759    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b0226df-71ad-4eb2-b908-e150ffd06fdd-home\") pod \"auth-test-model-8edd65-kserve-5645d5d987-jtjxs\" (UID: \"8b0226df-71ad-4eb2-b908-e150ffd06fdd\") " pod="ai-tenant-e2e-shared-a-8edd65/auth-test-model-8edd65-kserve-5645d5d987-jtjxs"
Jul 06 03:16:34.259834 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:34.259810    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b0226df-71ad-4eb2-b908-e150ffd06fdd-model-cache\") pod \"auth-test-model-8edd65-kserve-5645d5d987-jtjxs\" (UID: \"8b0226df-71ad-4eb2-b908-e150ffd06fdd\") " pod="ai-tenant-e2e-shared-a-8edd65/auth-test-model-8edd65-kserve-5645d5d987-jtjxs"
Jul 06 03:16:34.261690 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:34.261663    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b0226df-71ad-4eb2-b908-e150ffd06fdd-dshm\") pod \"auth-test-model-8edd65-kserve-5645d5d987-jtjxs\" (UID: \"8b0226df-71ad-4eb2-b908-e150ffd06fdd\") " pod="ai-tenant-e2e-shared-a-8edd65/auth-test-model-8edd65-kserve-5645d5d987-jtjxs"
Jul 06 03:16:34.261947 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:34.261929    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b0226df-71ad-4eb2-b908-e150ffd06fdd-tls-certs\") pod \"auth-test-model-8edd65-kserve-5645d5d987-jtjxs\" (UID: \"8b0226df-71ad-4eb2-b908-e150ffd06fdd\") " pod="ai-tenant-e2e-shared-a-8edd65/auth-test-model-8edd65-kserve-5645d5d987-jtjxs"
Jul 06 03:16:34.267070 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:34.267048    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkhst\" (UniqueName: \"kubernetes.io/projected/8b0226df-71ad-4eb2-b908-e150ffd06fdd-kube-api-access-hkhst\") pod \"auth-test-model-8edd65-kserve-5645d5d987-jtjxs\" (UID: \"8b0226df-71ad-4eb2-b908-e150ffd06fdd\") " pod="ai-tenant-e2e-shared-a-8edd65/auth-test-model-8edd65-kserve-5645d5d987-jtjxs"
Jul 06 03:16:34.381720 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:34.381656    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8edd65/auth-test-model-8edd65-kserve-5645d5d987-jtjxs"
Jul 06 03:16:34.512638 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:34.512610    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8edd65/auth-test-model-8edd65-kserve-5645d5d987-jtjxs"]
Jul 06 03:16:34.515938 ip-10-0-131-238 kubenswrapper[2570]: W0706 03:16:34.515912    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8b0226df_71ad_4eb2_b908_e150ffd06fdd.slice/crio-46afce5e45179b2136c181ff5476adf4c43407768c817e5eb2b3b86646fddf9a WatchSource:0}: Error finding container 46afce5e45179b2136c181ff5476adf4c43407768c817e5eb2b3b86646fddf9a: Status 404 returned error can't find the container with id 46afce5e45179b2136c181ff5476adf4c43407768c817e5eb2b3b86646fddf9a
Jul 06 03:16:35.061106 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:35.061066    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8edd65/auth-test-model-8edd65-kserve-5645d5d987-jtjxs" event={"ID":"8b0226df-71ad-4eb2-b908-e150ffd06fdd","Type":"ContainerStarted","Data":"fdcb631b94ba24ae9bde0508711834643e416aa56c1d3886d7533b8e322aa2cf"}
Jul 06 03:16:35.061106 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:35.061112    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8edd65/auth-test-model-8edd65-kserve-5645d5d987-jtjxs" event={"ID":"8b0226df-71ad-4eb2-b908-e150ffd06fdd","Type":"ContainerStarted","Data":"46afce5e45179b2136c181ff5476adf4c43407768c817e5eb2b3b86646fddf9a"}
Jul 06 03:16:35.077916 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:35.076853    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-8edd65/auth-test-model-8edd65-kserve-5645d5d987-jtjxs" podStartSLOduration=1.076835231 podStartE2EDuration="1.076835231s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 03:16:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 03:16:35.075069973 +0000 UTC m=+2248.732079638" watchObservedRunningTime="2026-07-06 03:16:35.076835231 +0000 UTC m=+2248.733844897"
Jul 06 03:16:44.381886 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:44.381851    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-8edd65/auth-test-model-8edd65-kserve-5645d5d987-jtjxs"
Jul 06 03:16:44.382300 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:44.382132    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-8edd65/auth-test-model-8edd65-kserve-5645d5d987-jtjxs"
Jul 06 03:16:44.394401 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:44.394380    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-8edd65/auth-test-model-8edd65-kserve-5645d5d987-jtjxs"
Jul 06 03:16:45.124037 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:45.124004    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-8edd65/auth-test-model-8edd65-kserve-5645d5d987-jtjxs"
Jul 06 03:16:57.772762 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:57.772729    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-5fe2d5/auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7"]
Jul 06 03:16:57.776087 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:57.776070    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5fe2d5/auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7"
Jul 06 03:16:57.779379 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:57.779351    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-5fe2d5\"/\"default-dockercfg-6pjxg\""
Jul 06 03:16:57.779379 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:57.779373    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-5fe2d5\"/\"openshift-service-ca.crt\""
Jul 06 03:16:57.779589 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:57.779375    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-5fe2d5\"/\"kube-root-ca.crt\""
Jul 06 03:16:57.779589 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:57.779400    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-5fe2d5\"/\"auth-test-model-5fe2d5-kserve-self-signed-certs\""
Jul 06 03:16:57.785174 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:57.785149    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-5fe2d5/auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7"]
Jul 06 03:16:57.798032 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:57.797978    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:16:57.945903 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:57.945867    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bpfk\" (UniqueName: \"kubernetes.io/projected/1866c9ef-6040-4064-bf6b-d5acb21f01c4-kube-api-access-4bpfk\") pod \"auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7\" (UID: \"1866c9ef-6040-4064-bf6b-d5acb21f01c4\") " pod="ai-tenant-e2e-shared-b-5fe2d5/auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7"
Jul 06 03:16:57.946099 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:57.945923    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1866c9ef-6040-4064-bf6b-d5acb21f01c4-tls-certs\") pod \"auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7\" (UID: \"1866c9ef-6040-4064-bf6b-d5acb21f01c4\") " pod="ai-tenant-e2e-shared-b-5fe2d5/auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7"
Jul 06 03:16:57.946099 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:57.945993    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1866c9ef-6040-4064-bf6b-d5acb21f01c4-model-cache\") pod \"auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7\" (UID: \"1866c9ef-6040-4064-bf6b-d5acb21f01c4\") " pod="ai-tenant-e2e-shared-b-5fe2d5/auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7"
Jul 06 03:16:57.946099 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:57.946040    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1866c9ef-6040-4064-bf6b-d5acb21f01c4-home\") pod \"auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7\" (UID: \"1866c9ef-6040-4064-bf6b-d5acb21f01c4\") " pod="ai-tenant-e2e-shared-b-5fe2d5/auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7"
Jul 06 03:16:57.946099 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:57.946065    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1866c9ef-6040-4064-bf6b-d5acb21f01c4-tmp-dir\") pod \"auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7\" (UID: \"1866c9ef-6040-4064-bf6b-d5acb21f01c4\") " pod="ai-tenant-e2e-shared-b-5fe2d5/auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7"
Jul 06 03:16:57.946099 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:57.946089    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1866c9ef-6040-4064-bf6b-d5acb21f01c4-dshm\") pod \"auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7\" (UID: \"1866c9ef-6040-4064-bf6b-d5acb21f01c4\") " pod="ai-tenant-e2e-shared-b-5fe2d5/auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7"
Jul 06 03:16:58.047156 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:58.047129    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1866c9ef-6040-4064-bf6b-d5acb21f01c4-home\") pod \"auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7\" (UID: \"1866c9ef-6040-4064-bf6b-d5acb21f01c4\") " pod="ai-tenant-e2e-shared-b-5fe2d5/auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7"
Jul 06 03:16:58.047352 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:58.047169    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1866c9ef-6040-4064-bf6b-d5acb21f01c4-tmp-dir\") pod \"auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7\" (UID: \"1866c9ef-6040-4064-bf6b-d5acb21f01c4\") " pod="ai-tenant-e2e-shared-b-5fe2d5/auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7"
Jul 06 03:16:58.047352 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:58.047184    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1866c9ef-6040-4064-bf6b-d5acb21f01c4-dshm\") pod \"auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7\" (UID: \"1866c9ef-6040-4064-bf6b-d5acb21f01c4\") " pod="ai-tenant-e2e-shared-b-5fe2d5/auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7"
Jul 06 03:16:58.047352 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:58.047230    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bpfk\" (UniqueName: \"kubernetes.io/projected/1866c9ef-6040-4064-bf6b-d5acb21f01c4-kube-api-access-4bpfk\") pod \"auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7\" (UID: \"1866c9ef-6040-4064-bf6b-d5acb21f01c4\") " pod="ai-tenant-e2e-shared-b-5fe2d5/auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7"
Jul 06 03:16:58.047352 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:58.047317    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1866c9ef-6040-4064-bf6b-d5acb21f01c4-tls-certs\") pod \"auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7\" (UID: \"1866c9ef-6040-4064-bf6b-d5acb21f01c4\") " pod="ai-tenant-e2e-shared-b-5fe2d5/auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7"
Jul 06 03:16:58.047576 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:58.047407    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1866c9ef-6040-4064-bf6b-d5acb21f01c4-model-cache\") pod \"auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7\" (UID: \"1866c9ef-6040-4064-bf6b-d5acb21f01c4\") " pod="ai-tenant-e2e-shared-b-5fe2d5/auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7"
Jul 06 03:16:58.047576 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:58.047531    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1866c9ef-6040-4064-bf6b-d5acb21f01c4-home\") pod \"auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7\" (UID: \"1866c9ef-6040-4064-bf6b-d5acb21f01c4\") " pod="ai-tenant-e2e-shared-b-5fe2d5/auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7"
Jul 06 03:16:58.047659 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:58.047584    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1866c9ef-6040-4064-bf6b-d5acb21f01c4-tmp-dir\") pod \"auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7\" (UID: \"1866c9ef-6040-4064-bf6b-d5acb21f01c4\") " pod="ai-tenant-e2e-shared-b-5fe2d5/auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7"
Jul 06 03:16:58.047761 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:58.047744    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1866c9ef-6040-4064-bf6b-d5acb21f01c4-model-cache\") pod \"auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7\" (UID: \"1866c9ef-6040-4064-bf6b-d5acb21f01c4\") " pod="ai-tenant-e2e-shared-b-5fe2d5/auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7"
Jul 06 03:16:58.049527 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:58.049509    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1866c9ef-6040-4064-bf6b-d5acb21f01c4-dshm\") pod \"auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7\" (UID: \"1866c9ef-6040-4064-bf6b-d5acb21f01c4\") " pod="ai-tenant-e2e-shared-b-5fe2d5/auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7"
Jul 06 03:16:58.049655 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:58.049636    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1866c9ef-6040-4064-bf6b-d5acb21f01c4-tls-certs\") pod \"auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7\" (UID: \"1866c9ef-6040-4064-bf6b-d5acb21f01c4\") " pod="ai-tenant-e2e-shared-b-5fe2d5/auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7"
Jul 06 03:16:58.055788 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:58.055766    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bpfk\" (UniqueName: \"kubernetes.io/projected/1866c9ef-6040-4064-bf6b-d5acb21f01c4-kube-api-access-4bpfk\") pod \"auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7\" (UID: \"1866c9ef-6040-4064-bf6b-d5acb21f01c4\") " pod="ai-tenant-e2e-shared-b-5fe2d5/auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7"
Jul 06 03:16:58.087528 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:58.087503    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5fe2d5/auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7"
Jul 06 03:16:58.228412 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:58.228324    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-5fe2d5/auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7"]
Jul 06 03:16:58.230596 ip-10-0-131-238 kubenswrapper[2570]: W0706 03:16:58.230563    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1866c9ef_6040_4064_bf6b_d5acb21f01c4.slice/crio-14896bd87654e2d3b29a728926d2995d75685b6f55254cd77b1dcbdef5776a12 WatchSource:0}: Error finding container 14896bd87654e2d3b29a728926d2995d75685b6f55254cd77b1dcbdef5776a12: Status 404 returned error can't find the container with id 14896bd87654e2d3b29a728926d2995d75685b6f55254cd77b1dcbdef5776a12
Jul 06 03:16:59.189269 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:59.189230    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5fe2d5/auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7" event={"ID":"1866c9ef-6040-4064-bf6b-d5acb21f01c4","Type":"ContainerStarted","Data":"af56854f205b189e2e7029fe74f2ef7228703ac10a270d3f6daf21504688d520"}
Jul 06 03:16:59.189674 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:59.189280    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5fe2d5/auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7" event={"ID":"1866c9ef-6040-4064-bf6b-d5acb21f01c4","Type":"ContainerStarted","Data":"14896bd87654e2d3b29a728926d2995d75685b6f55254cd77b1dcbdef5776a12"}
Jul 06 03:16:59.208062 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:16:59.208014    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-5fe2d5/auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7" podStartSLOduration=2.207997992 podStartE2EDuration="2.207997992s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 03:16:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 03:16:59.206088121 +0000 UTC m=+2272.863097785" watchObservedRunningTime="2026-07-06 03:16:59.207997992 +0000 UTC m=+2272.865007647"
Jul 06 03:17:08.087913 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:17:08.087875    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-5fe2d5/auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7"
Jul 06 03:17:08.087913 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:17:08.087918    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-5fe2d5/auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7"
Jul 06 03:17:08.100590 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:17:08.100567    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-5fe2d5/auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7"
Jul 06 03:17:08.252557 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:17:08.252530    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-5fe2d5/auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7"
Jul 06 03:18:57.160691 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:18:57.160645    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8edd65/auth-test-model-8edd65-kserve-5645d5d987-jtjxs"]
Jul 06 03:18:57.211924 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:18:57.211884    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:18:58.141576 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:18:58.141547    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-5fe2d5/auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7"]
Jul 06 03:18:58.305975 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:18:58.305939    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:19:07.400553 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:07.400473    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfxlc_b2861d04-c87b-43b1-9bff-2b2199a136a3/ovn-acl-logging/0.log"
Jul 06 03:19:07.407352 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:07.407329    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfxlc_b2861d04-c87b-43b1-9bff-2b2199a136a3/ovn-acl-logging/0.log"
Jul 06 03:19:08.693702 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:08.693658    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:19:12.180743 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:12.180686    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-8edd65/auth-test-model-8edd65-kserve-5645d5d987-jtjxs" podUID="8b0226df-71ad-4eb2-b908-e150ffd06fdd" containerName="main" containerID="cri-o://fdcb631b94ba24ae9bde0508711834643e416aa56c1d3886d7533b8e322aa2cf" gracePeriod=45
Jul 06 03:19:12.454481 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:12.454456    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8edd65/auth-test-model-8edd65-kserve-5645d5d987-jtjxs"
Jul 06 03:19:12.570558 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:12.570520    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b0226df-71ad-4eb2-b908-e150ffd06fdd-tmp-dir\") pod \"8b0226df-71ad-4eb2-b908-e150ffd06fdd\" (UID: \"8b0226df-71ad-4eb2-b908-e150ffd06fdd\") "
Jul 06 03:19:12.570720 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:12.570599    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b0226df-71ad-4eb2-b908-e150ffd06fdd-model-cache\") pod \"8b0226df-71ad-4eb2-b908-e150ffd06fdd\" (UID: \"8b0226df-71ad-4eb2-b908-e150ffd06fdd\") "
Jul 06 03:19:12.570720 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:12.570649    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b0226df-71ad-4eb2-b908-e150ffd06fdd-home\") pod \"8b0226df-71ad-4eb2-b908-e150ffd06fdd\" (UID: \"8b0226df-71ad-4eb2-b908-e150ffd06fdd\") "
Jul 06 03:19:12.570720 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:12.570681    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b0226df-71ad-4eb2-b908-e150ffd06fdd-dshm\") pod \"8b0226df-71ad-4eb2-b908-e150ffd06fdd\" (UID: \"8b0226df-71ad-4eb2-b908-e150ffd06fdd\") "
Jul 06 03:19:12.570889 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:12.570744    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkhst\" (UniqueName: \"kubernetes.io/projected/8b0226df-71ad-4eb2-b908-e150ffd06fdd-kube-api-access-hkhst\") pod \"8b0226df-71ad-4eb2-b908-e150ffd06fdd\" (UID: \"8b0226df-71ad-4eb2-b908-e150ffd06fdd\") "
Jul 06 03:19:12.570889 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:12.570786    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b0226df-71ad-4eb2-b908-e150ffd06fdd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8b0226df-71ad-4eb2-b908-e150ffd06fdd" (UID: "8b0226df-71ad-4eb2-b908-e150ffd06fdd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:19:12.570889 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:12.570805    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b0226df-71ad-4eb2-b908-e150ffd06fdd-tls-certs\") pod \"8b0226df-71ad-4eb2-b908-e150ffd06fdd\" (UID: \"8b0226df-71ad-4eb2-b908-e150ffd06fdd\") "
Jul 06 03:19:12.570889 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:12.570864    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b0226df-71ad-4eb2-b908-e150ffd06fdd-model-cache" (OuterVolumeSpecName: "model-cache") pod "8b0226df-71ad-4eb2-b908-e150ffd06fdd" (UID: "8b0226df-71ad-4eb2-b908-e150ffd06fdd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:19:12.571120 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:12.570886    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b0226df-71ad-4eb2-b908-e150ffd06fdd-home" (OuterVolumeSpecName: "home") pod "8b0226df-71ad-4eb2-b908-e150ffd06fdd" (UID: "8b0226df-71ad-4eb2-b908-e150ffd06fdd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:19:12.571181 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:12.571131    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b0226df-71ad-4eb2-b908-e150ffd06fdd-home\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:19:12.571181 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:12.571169    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b0226df-71ad-4eb2-b908-e150ffd06fdd-tmp-dir\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:19:12.571181 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:12.571180    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b0226df-71ad-4eb2-b908-e150ffd06fdd-model-cache\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:19:12.573198 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:12.573158    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b0226df-71ad-4eb2-b908-e150ffd06fdd-kube-api-access-hkhst" (OuterVolumeSpecName: "kube-api-access-hkhst") pod "8b0226df-71ad-4eb2-b908-e150ffd06fdd" (UID: "8b0226df-71ad-4eb2-b908-e150ffd06fdd"). InnerVolumeSpecName "kube-api-access-hkhst". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 03:19:12.573337 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:12.573242    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b0226df-71ad-4eb2-b908-e150ffd06fdd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8b0226df-71ad-4eb2-b908-e150ffd06fdd" (UID: "8b0226df-71ad-4eb2-b908-e150ffd06fdd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 03:19:12.573406 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:12.573331    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b0226df-71ad-4eb2-b908-e150ffd06fdd-dshm" (OuterVolumeSpecName: "dshm") pod "8b0226df-71ad-4eb2-b908-e150ffd06fdd" (UID: "8b0226df-71ad-4eb2-b908-e150ffd06fdd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:19:12.672425 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:12.672383    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b0226df-71ad-4eb2-b908-e150ffd06fdd-dshm\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:19:12.672425 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:12.672412    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkhst\" (UniqueName: \"kubernetes.io/projected/8b0226df-71ad-4eb2-b908-e150ffd06fdd-kube-api-access-hkhst\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:19:12.672425 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:12.672422    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b0226df-71ad-4eb2-b908-e150ffd06fdd-tls-certs\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:19:12.899246 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:12.899208    2570 generic.go:356] "Generic (PLEG): container finished" podID="8b0226df-71ad-4eb2-b908-e150ffd06fdd" containerID="fdcb631b94ba24ae9bde0508711834643e416aa56c1d3886d7533b8e322aa2cf" exitCode=0
Jul 06 03:19:12.899434 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:12.899253    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8edd65/auth-test-model-8edd65-kserve-5645d5d987-jtjxs"
Jul 06 03:19:12.899434 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:12.899298    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8edd65/auth-test-model-8edd65-kserve-5645d5d987-jtjxs" event={"ID":"8b0226df-71ad-4eb2-b908-e150ffd06fdd","Type":"ContainerDied","Data":"fdcb631b94ba24ae9bde0508711834643e416aa56c1d3886d7533b8e322aa2cf"}
Jul 06 03:19:12.899434 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:12.899339    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8edd65/auth-test-model-8edd65-kserve-5645d5d987-jtjxs" event={"ID":"8b0226df-71ad-4eb2-b908-e150ffd06fdd","Type":"ContainerDied","Data":"46afce5e45179b2136c181ff5476adf4c43407768c817e5eb2b3b86646fddf9a"}
Jul 06 03:19:12.899434 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:12.899360    2570 scope.go:117] "RemoveContainer" containerID="fdcb631b94ba24ae9bde0508711834643e416aa56c1d3886d7533b8e322aa2cf"
Jul 06 03:19:12.908684 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:12.908665    2570 scope.go:117] "RemoveContainer" containerID="fdcb631b94ba24ae9bde0508711834643e416aa56c1d3886d7533b8e322aa2cf"
Jul 06 03:19:12.908926 ip-10-0-131-238 kubenswrapper[2570]: E0706 03:19:12.908908    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdcb631b94ba24ae9bde0508711834643e416aa56c1d3886d7533b8e322aa2cf\": container with ID starting with fdcb631b94ba24ae9bde0508711834643e416aa56c1d3886d7533b8e322aa2cf not found: ID does not exist" containerID="fdcb631b94ba24ae9bde0508711834643e416aa56c1d3886d7533b8e322aa2cf"
Jul 06 03:19:12.908969 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:12.908937    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdcb631b94ba24ae9bde0508711834643e416aa56c1d3886d7533b8e322aa2cf"} err="failed to get container status \"fdcb631b94ba24ae9bde0508711834643e416aa56c1d3886d7533b8e322aa2cf\": rpc error: code = NotFound desc = could not find container \"fdcb631b94ba24ae9bde0508711834643e416aa56c1d3886d7533b8e322aa2cf\": container with ID starting with fdcb631b94ba24ae9bde0508711834643e416aa56c1d3886d7533b8e322aa2cf not found: ID does not exist"
Jul 06 03:19:12.920454 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:12.920432    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8edd65/auth-test-model-8edd65-kserve-5645d5d987-jtjxs"]
Jul 06 03:19:12.923609 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:12.923589    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-8edd65/auth-test-model-8edd65-kserve-5645d5d987-jtjxs"]
Jul 06 03:19:13.161783 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:13.161693    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-5fe2d5/auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7" podUID="1866c9ef-6040-4064-bf6b-d5acb21f01c4" containerName="main" containerID="cri-o://af56854f205b189e2e7029fe74f2ef7228703ac10a270d3f6daf21504688d520" gracePeriod=45
Jul 06 03:19:13.233909 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:13.233882    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b0226df-71ad-4eb2-b908-e150ffd06fdd" path="/var/lib/kubelet/pods/8b0226df-71ad-4eb2-b908-e150ffd06fdd/volumes"
Jul 06 03:19:13.409789 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:13.409766    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5fe2d5/auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7"
Jul 06 03:19:13.479303 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:13.479239    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1866c9ef-6040-4064-bf6b-d5acb21f01c4-home\") pod \"1866c9ef-6040-4064-bf6b-d5acb21f01c4\" (UID: \"1866c9ef-6040-4064-bf6b-d5acb21f01c4\") "
Jul 06 03:19:13.479303 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:13.479273    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1866c9ef-6040-4064-bf6b-d5acb21f01c4-model-cache\") pod \"1866c9ef-6040-4064-bf6b-d5acb21f01c4\" (UID: \"1866c9ef-6040-4064-bf6b-d5acb21f01c4\") "
Jul 06 03:19:13.479483 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:13.479316    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bpfk\" (UniqueName: \"kubernetes.io/projected/1866c9ef-6040-4064-bf6b-d5acb21f01c4-kube-api-access-4bpfk\") pod \"1866c9ef-6040-4064-bf6b-d5acb21f01c4\" (UID: \"1866c9ef-6040-4064-bf6b-d5acb21f01c4\") "
Jul 06 03:19:13.479483 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:13.479351    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1866c9ef-6040-4064-bf6b-d5acb21f01c4-dshm\") pod \"1866c9ef-6040-4064-bf6b-d5acb21f01c4\" (UID: \"1866c9ef-6040-4064-bf6b-d5acb21f01c4\") "
Jul 06 03:19:13.479483 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:13.479371    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1866c9ef-6040-4064-bf6b-d5acb21f01c4-tls-certs\") pod \"1866c9ef-6040-4064-bf6b-d5acb21f01c4\" (UID: \"1866c9ef-6040-4064-bf6b-d5acb21f01c4\") "
Jul 06 03:19:13.479483 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:13.479385    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1866c9ef-6040-4064-bf6b-d5acb21f01c4-tmp-dir\") pod \"1866c9ef-6040-4064-bf6b-d5acb21f01c4\" (UID: \"1866c9ef-6040-4064-bf6b-d5acb21f01c4\") "
Jul 06 03:19:13.479697 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:13.479546    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1866c9ef-6040-4064-bf6b-d5acb21f01c4-home" (OuterVolumeSpecName: "home") pod "1866c9ef-6040-4064-bf6b-d5acb21f01c4" (UID: "1866c9ef-6040-4064-bf6b-d5acb21f01c4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:19:13.479697 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:13.479549    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1866c9ef-6040-4064-bf6b-d5acb21f01c4-model-cache" (OuterVolumeSpecName: "model-cache") pod "1866c9ef-6040-4064-bf6b-d5acb21f01c4" (UID: "1866c9ef-6040-4064-bf6b-d5acb21f01c4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:19:13.479697 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:13.479682    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1866c9ef-6040-4064-bf6b-d5acb21f01c4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1866c9ef-6040-4064-bf6b-d5acb21f01c4" (UID: "1866c9ef-6040-4064-bf6b-d5acb21f01c4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:19:13.479867 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:13.479689    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1866c9ef-6040-4064-bf6b-d5acb21f01c4-home\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:19:13.479867 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:13.479727    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1866c9ef-6040-4064-bf6b-d5acb21f01c4-model-cache\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:19:13.481575 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:13.481544    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1866c9ef-6040-4064-bf6b-d5acb21f01c4-dshm" (OuterVolumeSpecName: "dshm") pod "1866c9ef-6040-4064-bf6b-d5acb21f01c4" (UID: "1866c9ef-6040-4064-bf6b-d5acb21f01c4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:19:13.481575 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:13.481545    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1866c9ef-6040-4064-bf6b-d5acb21f01c4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1866c9ef-6040-4064-bf6b-d5acb21f01c4" (UID: "1866c9ef-6040-4064-bf6b-d5acb21f01c4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 03:19:13.481730 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:13.481647    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1866c9ef-6040-4064-bf6b-d5acb21f01c4-kube-api-access-4bpfk" (OuterVolumeSpecName: "kube-api-access-4bpfk") pod "1866c9ef-6040-4064-bf6b-d5acb21f01c4" (UID: "1866c9ef-6040-4064-bf6b-d5acb21f01c4"). InnerVolumeSpecName "kube-api-access-4bpfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 03:19:13.580622 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:13.580598    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bpfk\" (UniqueName: \"kubernetes.io/projected/1866c9ef-6040-4064-bf6b-d5acb21f01c4-kube-api-access-4bpfk\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:19:13.580622 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:13.580620    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1866c9ef-6040-4064-bf6b-d5acb21f01c4-dshm\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:19:13.580789 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:13.580630    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1866c9ef-6040-4064-bf6b-d5acb21f01c4-tls-certs\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:19:13.580789 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:13.580639    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1866c9ef-6040-4064-bf6b-d5acb21f01c4-tmp-dir\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:19:13.907465 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:13.907428    2570 generic.go:356] "Generic (PLEG): container finished" podID="1866c9ef-6040-4064-bf6b-d5acb21f01c4" containerID="af56854f205b189e2e7029fe74f2ef7228703ac10a270d3f6daf21504688d520" exitCode=0
Jul 06 03:19:13.907633 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:13.907470    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5fe2d5/auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7"
Jul 06 03:19:13.907633 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:13.907510    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5fe2d5/auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7" event={"ID":"1866c9ef-6040-4064-bf6b-d5acb21f01c4","Type":"ContainerDied","Data":"af56854f205b189e2e7029fe74f2ef7228703ac10a270d3f6daf21504688d520"}
Jul 06 03:19:13.907633 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:13.907549    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5fe2d5/auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7" event={"ID":"1866c9ef-6040-4064-bf6b-d5acb21f01c4","Type":"ContainerDied","Data":"14896bd87654e2d3b29a728926d2995d75685b6f55254cd77b1dcbdef5776a12"}
Jul 06 03:19:13.907633 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:13.907569    2570 scope.go:117] "RemoveContainer" containerID="af56854f205b189e2e7029fe74f2ef7228703ac10a270d3f6daf21504688d520"
Jul 06 03:19:13.917869 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:13.917853    2570 scope.go:117] "RemoveContainer" containerID="af56854f205b189e2e7029fe74f2ef7228703ac10a270d3f6daf21504688d520"
Jul 06 03:19:13.918135 ip-10-0-131-238 kubenswrapper[2570]: E0706 03:19:13.918114    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af56854f205b189e2e7029fe74f2ef7228703ac10a270d3f6daf21504688d520\": container with ID starting with af56854f205b189e2e7029fe74f2ef7228703ac10a270d3f6daf21504688d520 not found: ID does not exist" containerID="af56854f205b189e2e7029fe74f2ef7228703ac10a270d3f6daf21504688d520"
Jul 06 03:19:13.918203 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:13.918143    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af56854f205b189e2e7029fe74f2ef7228703ac10a270d3f6daf21504688d520"} err="failed to get container status \"af56854f205b189e2e7029fe74f2ef7228703ac10a270d3f6daf21504688d520\": rpc error: code = NotFound desc = could not find container \"af56854f205b189e2e7029fe74f2ef7228703ac10a270d3f6daf21504688d520\": container with ID starting with af56854f205b189e2e7029fe74f2ef7228703ac10a270d3f6daf21504688d520 not found: ID does not exist"
Jul 06 03:19:13.929745 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:13.929725    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-5fe2d5/auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7"]
Jul 06 03:19:13.932515 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:13.932492    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-5fe2d5/auth-test-model-5fe2d5-kserve-5f7fd88995-m94b7"]
Jul 06 03:19:15.234094 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:15.234060    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1866c9ef-6040-4064-bf6b-d5acb21f01c4" path="/var/lib/kubelet/pods/1866c9ef-6040-4064-bf6b-d5acb21f01c4/volumes"
Jul 06 03:19:39.870638 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:39.870566    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-5fe2d5/sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6"]
Jul 06 03:19:39.871109 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:39.870908    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1866c9ef-6040-4064-bf6b-d5acb21f01c4" containerName="main"
Jul 06 03:19:39.871109 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:39.870925    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1866c9ef-6040-4064-bf6b-d5acb21f01c4" containerName="main"
Jul 06 03:19:39.871109 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:39.870950    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b0226df-71ad-4eb2-b908-e150ffd06fdd" containerName="main"
Jul 06 03:19:39.871109 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:39.870959    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b0226df-71ad-4eb2-b908-e150ffd06fdd" containerName="main"
Jul 06 03:19:39.871109 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:39.871092    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1866c9ef-6040-4064-bf6b-d5acb21f01c4" containerName="main"
Jul 06 03:19:39.871109 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:39.871109    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b0226df-71ad-4eb2-b908-e150ffd06fdd" containerName="main"
Jul 06 03:19:39.875591 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:39.875574    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5fe2d5/sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6"
Jul 06 03:19:39.878434 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:39.878414    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-5fe2d5\"/\"default-dockercfg-6pjxg\""
Jul 06 03:19:39.879396 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:39.879379    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-5fe2d5\"/\"sub-test-model-5fe2d5-kserve-self-signed-certs\""
Jul 06 03:19:39.879462 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:39.879385    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-5fe2d5\"/\"kube-root-ca.crt\""
Jul 06 03:19:39.879462 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:39.879437    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-5fe2d5\"/\"openshift-service-ca.crt\""
Jul 06 03:19:39.885153 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:39.885129    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-5fe2d5/sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6"]
Jul 06 03:19:39.890070 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:39.890040    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d056b20-d798-4498-a244-96caa015dae7-dshm\") pod \"sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6\" (UID: \"1d056b20-d798-4498-a244-96caa015dae7\") " pod="ai-tenant-e2e-shared-b-5fe2d5/sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6"
Jul 06 03:19:39.890164 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:39.890082    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d056b20-d798-4498-a244-96caa015dae7-model-cache\") pod \"sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6\" (UID: \"1d056b20-d798-4498-a244-96caa015dae7\") " pod="ai-tenant-e2e-shared-b-5fe2d5/sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6"
Jul 06 03:19:39.890164 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:39.890112    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d056b20-d798-4498-a244-96caa015dae7-home\") pod \"sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6\" (UID: \"1d056b20-d798-4498-a244-96caa015dae7\") " pod="ai-tenant-e2e-shared-b-5fe2d5/sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6"
Jul 06 03:19:39.890164 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:39.890150    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb7wf\" (UniqueName: \"kubernetes.io/projected/1d056b20-d798-4498-a244-96caa015dae7-kube-api-access-gb7wf\") pod \"sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6\" (UID: \"1d056b20-d798-4498-a244-96caa015dae7\") " pod="ai-tenant-e2e-shared-b-5fe2d5/sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6"
Jul 06 03:19:39.890270 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:39.890178    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d056b20-d798-4498-a244-96caa015dae7-tls-certs\") pod \"sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6\" (UID: \"1d056b20-d798-4498-a244-96caa015dae7\") " pod="ai-tenant-e2e-shared-b-5fe2d5/sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6"
Jul 06 03:19:39.890270 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:39.890234    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d056b20-d798-4498-a244-96caa015dae7-tmp-dir\") pod \"sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6\" (UID: \"1d056b20-d798-4498-a244-96caa015dae7\") " pod="ai-tenant-e2e-shared-b-5fe2d5/sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6"
Jul 06 03:19:39.899956 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:39.899929    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:19:39.991194 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:39.991166    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d056b20-d798-4498-a244-96caa015dae7-tls-certs\") pod \"sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6\" (UID: \"1d056b20-d798-4498-a244-96caa015dae7\") " pod="ai-tenant-e2e-shared-b-5fe2d5/sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6"
Jul 06 03:19:39.991306 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:39.991224    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d056b20-d798-4498-a244-96caa015dae7-tmp-dir\") pod \"sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6\" (UID: \"1d056b20-d798-4498-a244-96caa015dae7\") " pod="ai-tenant-e2e-shared-b-5fe2d5/sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6"
Jul 06 03:19:39.991306 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:39.991301    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d056b20-d798-4498-a244-96caa015dae7-dshm\") pod \"sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6\" (UID: \"1d056b20-d798-4498-a244-96caa015dae7\") " pod="ai-tenant-e2e-shared-b-5fe2d5/sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6"
Jul 06 03:19:39.991420 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:39.991319    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d056b20-d798-4498-a244-96caa015dae7-model-cache\") pod \"sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6\" (UID: \"1d056b20-d798-4498-a244-96caa015dae7\") " pod="ai-tenant-e2e-shared-b-5fe2d5/sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6"
Jul 06 03:19:39.991420 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:39.991337    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d056b20-d798-4498-a244-96caa015dae7-home\") pod \"sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6\" (UID: \"1d056b20-d798-4498-a244-96caa015dae7\") " pod="ai-tenant-e2e-shared-b-5fe2d5/sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6"
Jul 06 03:19:39.991420 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:39.991372    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb7wf\" (UniqueName: \"kubernetes.io/projected/1d056b20-d798-4498-a244-96caa015dae7-kube-api-access-gb7wf\") pod \"sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6\" (UID: \"1d056b20-d798-4498-a244-96caa015dae7\") " pod="ai-tenant-e2e-shared-b-5fe2d5/sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6"
Jul 06 03:19:39.991688 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:39.991665    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d056b20-d798-4498-a244-96caa015dae7-model-cache\") pod \"sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6\" (UID: \"1d056b20-d798-4498-a244-96caa015dae7\") " pod="ai-tenant-e2e-shared-b-5fe2d5/sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6"
Jul 06 03:19:39.991820 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:39.991803    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d056b20-d798-4498-a244-96caa015dae7-home\") pod \"sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6\" (UID: \"1d056b20-d798-4498-a244-96caa015dae7\") " pod="ai-tenant-e2e-shared-b-5fe2d5/sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6"
Jul 06 03:19:39.991887 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:39.991844    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d056b20-d798-4498-a244-96caa015dae7-tmp-dir\") pod \"sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6\" (UID: \"1d056b20-d798-4498-a244-96caa015dae7\") " pod="ai-tenant-e2e-shared-b-5fe2d5/sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6"
Jul 06 03:19:39.993459 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:39.993443    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d056b20-d798-4498-a244-96caa015dae7-dshm\") pod \"sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6\" (UID: \"1d056b20-d798-4498-a244-96caa015dae7\") " pod="ai-tenant-e2e-shared-b-5fe2d5/sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6"
Jul 06 03:19:39.993888 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:39.993867    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d056b20-d798-4498-a244-96caa015dae7-tls-certs\") pod \"sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6\" (UID: \"1d056b20-d798-4498-a244-96caa015dae7\") " pod="ai-tenant-e2e-shared-b-5fe2d5/sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6"
Jul 06 03:19:39.999462 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:39.999439    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb7wf\" (UniqueName: \"kubernetes.io/projected/1d056b20-d798-4498-a244-96caa015dae7-kube-api-access-gb7wf\") pod \"sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6\" (UID: \"1d056b20-d798-4498-a244-96caa015dae7\") " pod="ai-tenant-e2e-shared-b-5fe2d5/sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6"
Jul 06 03:19:40.185212 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:40.185126    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5fe2d5/sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6"
Jul 06 03:19:40.319399 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:40.319364    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-5fe2d5/sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6"]
Jul 06 03:19:40.322512 ip-10-0-131-238 kubenswrapper[2570]: W0706 03:19:40.322485    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d056b20_d798_4498_a244_96caa015dae7.slice/crio-d7ad0543e4a441d4c1884c89720042ed32f4333f37e249c31143dd6ae8a61879 WatchSource:0}: Error finding container d7ad0543e4a441d4c1884c89720042ed32f4333f37e249c31143dd6ae8a61879: Status 404 returned error can't find the container with id d7ad0543e4a441d4c1884c89720042ed32f4333f37e249c31143dd6ae8a61879
Jul 06 03:19:41.050722 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:41.050687    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5fe2d5/sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6" event={"ID":"1d056b20-d798-4498-a244-96caa015dae7","Type":"ContainerStarted","Data":"67fba7679b16ba2fb4cfcd09a2c12de1ad294ee201304ed5ed7cb81b5b0b3304"}
Jul 06 03:19:41.051130 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:41.050733    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5fe2d5/sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6" event={"ID":"1d056b20-d798-4498-a244-96caa015dae7","Type":"ContainerStarted","Data":"d7ad0543e4a441d4c1884c89720042ed32f4333f37e249c31143dd6ae8a61879"}
Jul 06 03:19:41.068629 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:41.068576    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-5fe2d5/sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6" podStartSLOduration=2.068562433 podStartE2EDuration="2.068562433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 03:19:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 03:19:41.065780547 +0000 UTC m=+2434.722790210" watchObservedRunningTime="2026-07-06 03:19:41.068562433 +0000 UTC m=+2434.725572098"
Jul 06 03:19:50.185674 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:50.185633    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-5fe2d5/sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6"
Jul 06 03:19:50.186165 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:50.185690    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-5fe2d5/sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6"
Jul 06 03:19:50.197949 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:50.197928    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-5fe2d5/sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6"
Jul 06 03:19:51.112696 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:19:51.112665    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-5fe2d5/sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6"
Jul 06 03:20:12.477332 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:12.477296    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:20:19.193326 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:19.193289    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:20:20.052296 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:20.052258    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-5fe2d5/sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6"]
Jul 06 03:20:20.070287 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:20.070256    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:20:23.851763 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:23.851720    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-8edd65/rate-test-model-8edd65-kserve-77f5d99f47-4mspb"]
Jul 06 03:20:23.855147 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:23.855121    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8edd65/rate-test-model-8edd65-kserve-77f5d99f47-4mspb"
Jul 06 03:20:23.857540 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:23.857519    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-8edd65\"/\"kube-root-ca.crt\""
Jul 06 03:20:23.858685 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:23.858663    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-8edd65\"/\"openshift-service-ca.crt\""
Jul 06 03:20:23.858685 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:23.858680    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8edd65\"/\"rate-test-model-8edd65-kserve-self-signed-certs\""
Jul 06 03:20:23.858838 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:23.858723    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8edd65\"/\"default-dockercfg-trrx2\""
Jul 06 03:20:23.864655 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:23.864635    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8edd65/rate-test-model-8edd65-kserve-77f5d99f47-4mspb"]
Jul 06 03:20:23.870011 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:23.869964    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad-dshm\") pod \"rate-test-model-8edd65-kserve-77f5d99f47-4mspb\" (UID: \"e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad\") " pod="ai-tenant-e2e-shared-a-8edd65/rate-test-model-8edd65-kserve-77f5d99f47-4mspb"
Jul 06 03:20:23.870112 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:23.870045    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad-home\") pod \"rate-test-model-8edd65-kserve-77f5d99f47-4mspb\" (UID: \"e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad\") " pod="ai-tenant-e2e-shared-a-8edd65/rate-test-model-8edd65-kserve-77f5d99f47-4mspb"
Jul 06 03:20:23.870166 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:23.870121    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad-tmp-dir\") pod \"rate-test-model-8edd65-kserve-77f5d99f47-4mspb\" (UID: \"e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad\") " pod="ai-tenant-e2e-shared-a-8edd65/rate-test-model-8edd65-kserve-77f5d99f47-4mspb"
Jul 06 03:20:23.870166 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:23.870144    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad-model-cache\") pod \"rate-test-model-8edd65-kserve-77f5d99f47-4mspb\" (UID: \"e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad\") " pod="ai-tenant-e2e-shared-a-8edd65/rate-test-model-8edd65-kserve-77f5d99f47-4mspb"
Jul 06 03:20:23.870252 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:23.870189    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad-tls-certs\") pod \"rate-test-model-8edd65-kserve-77f5d99f47-4mspb\" (UID: \"e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad\") " pod="ai-tenant-e2e-shared-a-8edd65/rate-test-model-8edd65-kserve-77f5d99f47-4mspb"
Jul 06 03:20:23.870252 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:23.870216    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ch4pj\" (UniqueName: \"kubernetes.io/projected/e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad-kube-api-access-ch4pj\") pod \"rate-test-model-8edd65-kserve-77f5d99f47-4mspb\" (UID: \"e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad\") " pod="ai-tenant-e2e-shared-a-8edd65/rate-test-model-8edd65-kserve-77f5d99f47-4mspb"
Jul 06 03:20:23.875714 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:23.875690    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:20:23.970614 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:23.970580    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad-tmp-dir\") pod \"rate-test-model-8edd65-kserve-77f5d99f47-4mspb\" (UID: \"e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad\") " pod="ai-tenant-e2e-shared-a-8edd65/rate-test-model-8edd65-kserve-77f5d99f47-4mspb"
Jul 06 03:20:23.970614 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:23.970614    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad-model-cache\") pod \"rate-test-model-8edd65-kserve-77f5d99f47-4mspb\" (UID: \"e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad\") " pod="ai-tenant-e2e-shared-a-8edd65/rate-test-model-8edd65-kserve-77f5d99f47-4mspb"
Jul 06 03:20:23.970757 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:23.970635    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad-tls-certs\") pod \"rate-test-model-8edd65-kserve-77f5d99f47-4mspb\" (UID: \"e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad\") " pod="ai-tenant-e2e-shared-a-8edd65/rate-test-model-8edd65-kserve-77f5d99f47-4mspb"
Jul 06 03:20:23.970757 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:23.970667    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch4pj\" (UniqueName: \"kubernetes.io/projected/e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad-kube-api-access-ch4pj\") pod \"rate-test-model-8edd65-kserve-77f5d99f47-4mspb\" (UID: \"e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad\") " pod="ai-tenant-e2e-shared-a-8edd65/rate-test-model-8edd65-kserve-77f5d99f47-4mspb"
Jul 06 03:20:23.970757 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:23.970702    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad-dshm\") pod \"rate-test-model-8edd65-kserve-77f5d99f47-4mspb\" (UID: \"e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad\") " pod="ai-tenant-e2e-shared-a-8edd65/rate-test-model-8edd65-kserve-77f5d99f47-4mspb"
Jul 06 03:20:23.970757 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:23.970743    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad-home\") pod \"rate-test-model-8edd65-kserve-77f5d99f47-4mspb\" (UID: \"e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad\") " pod="ai-tenant-e2e-shared-a-8edd65/rate-test-model-8edd65-kserve-77f5d99f47-4mspb"
Jul 06 03:20:23.971074 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:23.971051    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad-tmp-dir\") pod \"rate-test-model-8edd65-kserve-77f5d99f47-4mspb\" (UID: \"e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad\") " pod="ai-tenant-e2e-shared-a-8edd65/rate-test-model-8edd65-kserve-77f5d99f47-4mspb"
Jul 06 03:20:23.971145 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:23.971108    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad-model-cache\") pod \"rate-test-model-8edd65-kserve-77f5d99f47-4mspb\" (UID: \"e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad\") " pod="ai-tenant-e2e-shared-a-8edd65/rate-test-model-8edd65-kserve-77f5d99f47-4mspb"
Jul 06 03:20:23.971145 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:23.971126    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad-home\") pod \"rate-test-model-8edd65-kserve-77f5d99f47-4mspb\" (UID: \"e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad\") " pod="ai-tenant-e2e-shared-a-8edd65/rate-test-model-8edd65-kserve-77f5d99f47-4mspb"
Jul 06 03:20:23.973021 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:23.973005    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad-dshm\") pod \"rate-test-model-8edd65-kserve-77f5d99f47-4mspb\" (UID: \"e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad\") " pod="ai-tenant-e2e-shared-a-8edd65/rate-test-model-8edd65-kserve-77f5d99f47-4mspb"
Jul 06 03:20:23.973426 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:23.973406    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad-tls-certs\") pod \"rate-test-model-8edd65-kserve-77f5d99f47-4mspb\" (UID: \"e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad\") " pod="ai-tenant-e2e-shared-a-8edd65/rate-test-model-8edd65-kserve-77f5d99f47-4mspb"
Jul 06 03:20:23.979376 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:23.979350    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ch4pj\" (UniqueName: \"kubernetes.io/projected/e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad-kube-api-access-ch4pj\") pod \"rate-test-model-8edd65-kserve-77f5d99f47-4mspb\" (UID: \"e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad\") " pod="ai-tenant-e2e-shared-a-8edd65/rate-test-model-8edd65-kserve-77f5d99f47-4mspb"
Jul 06 03:20:24.165048 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:24.164942    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8edd65/rate-test-model-8edd65-kserve-77f5d99f47-4mspb"
Jul 06 03:20:24.298785 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:24.298753    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8edd65/rate-test-model-8edd65-kserve-77f5d99f47-4mspb"]
Jul 06 03:20:24.301833 ip-10-0-131-238 kubenswrapper[2570]: W0706 03:20:24.301805    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode91fd201_1b21_42e0_a0d1_5fa2f4ab11ad.slice/crio-50198a1b310fbea1b189322a5352c4e9e444b30b87d25968536b0e67153d59cc WatchSource:0}: Error finding container 50198a1b310fbea1b189322a5352c4e9e444b30b87d25968536b0e67153d59cc: Status 404 returned error can't find the container with id 50198a1b310fbea1b189322a5352c4e9e444b30b87d25968536b0e67153d59cc
Jul 06 03:20:25.277515 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:25.277479    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8edd65/rate-test-model-8edd65-kserve-77f5d99f47-4mspb" event={"ID":"e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad","Type":"ContainerStarted","Data":"9a5a80936fcee25f504d7adacc3dcdfab000419e014fb895ddb5fc22a3c2c0e4"}
Jul 06 03:20:25.277515 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:25.277520    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8edd65/rate-test-model-8edd65-kserve-77f5d99f47-4mspb" event={"ID":"e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad","Type":"ContainerStarted","Data":"50198a1b310fbea1b189322a5352c4e9e444b30b87d25968536b0e67153d59cc"}
Jul 06 03:20:25.295770 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:25.295716    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-8edd65/rate-test-model-8edd65-kserve-77f5d99f47-4mspb" podStartSLOduration=2.295702083 podStartE2EDuration="2.295702083s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 03:20:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 03:20:25.294892152 +0000 UTC m=+2478.951901815" watchObservedRunningTime="2026-07-06 03:20:25.295702083 +0000 UTC m=+2478.952711746"
Jul 06 03:20:34.165301 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:34.165262    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-8edd65/rate-test-model-8edd65-kserve-77f5d99f47-4mspb"
Jul 06 03:20:34.165301 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:34.165309    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-8edd65/rate-test-model-8edd65-kserve-77f5d99f47-4mspb"
Jul 06 03:20:34.177813 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:34.177789    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-8edd65/rate-test-model-8edd65-kserve-77f5d99f47-4mspb"
Jul 06 03:20:34.334263 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:34.334238    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-8edd65/rate-test-model-8edd65-kserve-77f5d99f47-4mspb"
Jul 06 03:20:35.072335 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:35.072298    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-5fe2d5/sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6" podUID="1d056b20-d798-4498-a244-96caa015dae7" containerName="main" containerID="cri-o://67fba7679b16ba2fb4cfcd09a2c12de1ad294ee201304ed5ed7cb81b5b0b3304" gracePeriod=45
Jul 06 03:20:35.326072 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:35.326006    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5fe2d5/sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6"
Jul 06 03:20:35.328324 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:35.328299    2570 generic.go:356] "Generic (PLEG): container finished" podID="1d056b20-d798-4498-a244-96caa015dae7" containerID="67fba7679b16ba2fb4cfcd09a2c12de1ad294ee201304ed5ed7cb81b5b0b3304" exitCode=0
Jul 06 03:20:35.328436 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:35.328335    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5fe2d5/sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6"
Jul 06 03:20:35.328436 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:35.328377    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5fe2d5/sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6" event={"ID":"1d056b20-d798-4498-a244-96caa015dae7","Type":"ContainerDied","Data":"67fba7679b16ba2fb4cfcd09a2c12de1ad294ee201304ed5ed7cb81b5b0b3304"}
Jul 06 03:20:35.328436 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:35.328417    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5fe2d5/sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6" event={"ID":"1d056b20-d798-4498-a244-96caa015dae7","Type":"ContainerDied","Data":"d7ad0543e4a441d4c1884c89720042ed32f4333f37e249c31143dd6ae8a61879"}
Jul 06 03:20:35.328436 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:35.328435    2570 scope.go:117] "RemoveContainer" containerID="67fba7679b16ba2fb4cfcd09a2c12de1ad294ee201304ed5ed7cb81b5b0b3304"
Jul 06 03:20:35.336548 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:35.336530    2570 scope.go:117] "RemoveContainer" containerID="67fba7679b16ba2fb4cfcd09a2c12de1ad294ee201304ed5ed7cb81b5b0b3304"
Jul 06 03:20:35.336813 ip-10-0-131-238 kubenswrapper[2570]: E0706 03:20:35.336790    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67fba7679b16ba2fb4cfcd09a2c12de1ad294ee201304ed5ed7cb81b5b0b3304\": container with ID starting with 67fba7679b16ba2fb4cfcd09a2c12de1ad294ee201304ed5ed7cb81b5b0b3304 not found: ID does not exist" containerID="67fba7679b16ba2fb4cfcd09a2c12de1ad294ee201304ed5ed7cb81b5b0b3304"
Jul 06 03:20:35.336928 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:35.336818    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67fba7679b16ba2fb4cfcd09a2c12de1ad294ee201304ed5ed7cb81b5b0b3304"} err="failed to get container status \"67fba7679b16ba2fb4cfcd09a2c12de1ad294ee201304ed5ed7cb81b5b0b3304\": rpc error: code = NotFound desc = could not find container \"67fba7679b16ba2fb4cfcd09a2c12de1ad294ee201304ed5ed7cb81b5b0b3304\": container with ID starting with 67fba7679b16ba2fb4cfcd09a2c12de1ad294ee201304ed5ed7cb81b5b0b3304 not found: ID does not exist"
Jul 06 03:20:35.361031 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:35.361007    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d056b20-d798-4498-a244-96caa015dae7-tmp-dir\") pod \"1d056b20-d798-4498-a244-96caa015dae7\" (UID: \"1d056b20-d798-4498-a244-96caa015dae7\") "
Jul 06 03:20:35.361140 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:35.361100    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d056b20-d798-4498-a244-96caa015dae7-dshm\") pod \"1d056b20-d798-4498-a244-96caa015dae7\" (UID: \"1d056b20-d798-4498-a244-96caa015dae7\") "
Jul 06 03:20:35.361183 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:35.361151    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d056b20-d798-4498-a244-96caa015dae7-tls-certs\") pod \"1d056b20-d798-4498-a244-96caa015dae7\" (UID: \"1d056b20-d798-4498-a244-96caa015dae7\") "
Jul 06 03:20:35.361231 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:35.361218    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d056b20-d798-4498-a244-96caa015dae7-home\") pod \"1d056b20-d798-4498-a244-96caa015dae7\" (UID: \"1d056b20-d798-4498-a244-96caa015dae7\") "
Jul 06 03:20:35.361273 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:35.361231    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d056b20-d798-4498-a244-96caa015dae7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1d056b20-d798-4498-a244-96caa015dae7" (UID: "1d056b20-d798-4498-a244-96caa015dae7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:20:35.361315 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:35.361269    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d056b20-d798-4498-a244-96caa015dae7-model-cache\") pod \"1d056b20-d798-4498-a244-96caa015dae7\" (UID: \"1d056b20-d798-4498-a244-96caa015dae7\") "
Jul 06 03:20:35.361315 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:35.361306    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gb7wf\" (UniqueName: \"kubernetes.io/projected/1d056b20-d798-4498-a244-96caa015dae7-kube-api-access-gb7wf\") pod \"1d056b20-d798-4498-a244-96caa015dae7\" (UID: \"1d056b20-d798-4498-a244-96caa015dae7\") "
Jul 06 03:20:35.361499 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:35.361477    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d056b20-d798-4498-a244-96caa015dae7-home" (OuterVolumeSpecName: "home") pod "1d056b20-d798-4498-a244-96caa015dae7" (UID: "1d056b20-d798-4498-a244-96caa015dae7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:20:35.361573 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:35.361509    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d056b20-d798-4498-a244-96caa015dae7-model-cache" (OuterVolumeSpecName: "model-cache") pod "1d056b20-d798-4498-a244-96caa015dae7" (UID: "1d056b20-d798-4498-a244-96caa015dae7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:20:35.361631 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:35.361617    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d056b20-d798-4498-a244-96caa015dae7-home\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:20:35.361695 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:35.361636    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d056b20-d798-4498-a244-96caa015dae7-model-cache\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:20:35.361695 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:35.361651    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d056b20-d798-4498-a244-96caa015dae7-tmp-dir\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:20:35.363374 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:35.363355    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d056b20-d798-4498-a244-96caa015dae7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1d056b20-d798-4498-a244-96caa015dae7" (UID: "1d056b20-d798-4498-a244-96caa015dae7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 03:20:35.363583 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:35.363568    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d056b20-d798-4498-a244-96caa015dae7-dshm" (OuterVolumeSpecName: "dshm") pod "1d056b20-d798-4498-a244-96caa015dae7" (UID: "1d056b20-d798-4498-a244-96caa015dae7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:20:35.363658 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:35.363628    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d056b20-d798-4498-a244-96caa015dae7-kube-api-access-gb7wf" (OuterVolumeSpecName: "kube-api-access-gb7wf") pod "1d056b20-d798-4498-a244-96caa015dae7" (UID: "1d056b20-d798-4498-a244-96caa015dae7"). InnerVolumeSpecName "kube-api-access-gb7wf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 03:20:35.462622 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:35.462596    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gb7wf\" (UniqueName: \"kubernetes.io/projected/1d056b20-d798-4498-a244-96caa015dae7-kube-api-access-gb7wf\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:20:35.462622 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:35.462619    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d056b20-d798-4498-a244-96caa015dae7-dshm\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:20:35.462793 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:35.462629    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d056b20-d798-4498-a244-96caa015dae7-tls-certs\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:20:35.649813 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:35.649784    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-5fe2d5/sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6"]
Jul 06 03:20:35.653676 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:35.653651    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-5fe2d5/sub-test-model-5fe2d5-kserve-5ccb669c49-2gmc6"]
Jul 06 03:20:37.233394 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:37.233357    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d056b20-d798-4498-a244-96caa015dae7" path="/var/lib/kubelet/pods/1d056b20-d798-4498-a244-96caa015dae7/volumes"
Jul 06 03:20:56.282844 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:56.282807    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:20:56.385838 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:56.385804    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:20:57.064857 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:57.064822    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-5fe2d5/rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx"]
Jul 06 03:20:57.065251 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:57.065236    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d056b20-d798-4498-a244-96caa015dae7" containerName="main"
Jul 06 03:20:57.065335 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:57.065252    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d056b20-d798-4498-a244-96caa015dae7" containerName="main"
Jul 06 03:20:57.065335 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:57.065310    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d056b20-d798-4498-a244-96caa015dae7" containerName="main"
Jul 06 03:20:57.068302 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:57.068280    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5fe2d5/rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx"
Jul 06 03:20:57.071648 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:57.071625    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-5fe2d5\"/\"default-dockercfg-6pjxg\""
Jul 06 03:20:57.071789 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:57.071651    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-5fe2d5\"/\"kube-root-ca.crt\""
Jul 06 03:20:57.071944 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:57.071929    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-5fe2d5\"/\"openshift-service-ca.crt\""
Jul 06 03:20:57.072062 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:57.072050    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-5fe2d5\"/\"rate-test-model-5fe2d5-kserve-self-signed-certs\""
Jul 06 03:20:57.077087 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:57.077066    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-5fe2d5/rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx"]
Jul 06 03:20:57.092844 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:57.092821    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:20:57.143527 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:57.143497    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e7797a3-99db-4651-ad6d-1bc642317c43-model-cache\") pod \"rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx\" (UID: \"9e7797a3-99db-4651-ad6d-1bc642317c43\") " pod="ai-tenant-e2e-shared-b-5fe2d5/rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx"
Jul 06 03:20:57.143637 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:57.143536    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e7797a3-99db-4651-ad6d-1bc642317c43-dshm\") pod \"rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx\" (UID: \"9e7797a3-99db-4651-ad6d-1bc642317c43\") " pod="ai-tenant-e2e-shared-b-5fe2d5/rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx"
Jul 06 03:20:57.143637 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:57.143623    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e7797a3-99db-4651-ad6d-1bc642317c43-home\") pod \"rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx\" (UID: \"9e7797a3-99db-4651-ad6d-1bc642317c43\") " pod="ai-tenant-e2e-shared-b-5fe2d5/rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx"
Jul 06 03:20:57.143716 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:57.143659    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e7797a3-99db-4651-ad6d-1bc642317c43-tmp-dir\") pod \"rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx\" (UID: \"9e7797a3-99db-4651-ad6d-1bc642317c43\") " pod="ai-tenant-e2e-shared-b-5fe2d5/rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx"
Jul 06 03:20:57.143716 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:57.143690    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld49k\" (UniqueName: \"kubernetes.io/projected/9e7797a3-99db-4651-ad6d-1bc642317c43-kube-api-access-ld49k\") pod \"rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx\" (UID: \"9e7797a3-99db-4651-ad6d-1bc642317c43\") " pod="ai-tenant-e2e-shared-b-5fe2d5/rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx"
Jul 06 03:20:57.143790 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:57.143730    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e7797a3-99db-4651-ad6d-1bc642317c43-tls-certs\") pod \"rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx\" (UID: \"9e7797a3-99db-4651-ad6d-1bc642317c43\") " pod="ai-tenant-e2e-shared-b-5fe2d5/rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx"
Jul 06 03:20:57.244970 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:57.244942    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e7797a3-99db-4651-ad6d-1bc642317c43-model-cache\") pod \"rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx\" (UID: \"9e7797a3-99db-4651-ad6d-1bc642317c43\") " pod="ai-tenant-e2e-shared-b-5fe2d5/rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx"
Jul 06 03:20:57.245218 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:57.245002    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e7797a3-99db-4651-ad6d-1bc642317c43-dshm\") pod \"rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx\" (UID: \"9e7797a3-99db-4651-ad6d-1bc642317c43\") " pod="ai-tenant-e2e-shared-b-5fe2d5/rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx"
Jul 06 03:20:57.245218 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:57.245042    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e7797a3-99db-4651-ad6d-1bc642317c43-home\") pod \"rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx\" (UID: \"9e7797a3-99db-4651-ad6d-1bc642317c43\") " pod="ai-tenant-e2e-shared-b-5fe2d5/rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx"
Jul 06 03:20:57.245218 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:57.245061    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e7797a3-99db-4651-ad6d-1bc642317c43-tmp-dir\") pod \"rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx\" (UID: \"9e7797a3-99db-4651-ad6d-1bc642317c43\") " pod="ai-tenant-e2e-shared-b-5fe2d5/rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx"
Jul 06 03:20:57.245218 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:57.245086    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld49k\" (UniqueName: \"kubernetes.io/projected/9e7797a3-99db-4651-ad6d-1bc642317c43-kube-api-access-ld49k\") pod \"rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx\" (UID: \"9e7797a3-99db-4651-ad6d-1bc642317c43\") " pod="ai-tenant-e2e-shared-b-5fe2d5/rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx"
Jul 06 03:20:57.245458 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:57.245245    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e7797a3-99db-4651-ad6d-1bc642317c43-tls-certs\") pod \"rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx\" (UID: \"9e7797a3-99db-4651-ad6d-1bc642317c43\") " pod="ai-tenant-e2e-shared-b-5fe2d5/rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx"
Jul 06 03:20:57.245458 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:57.245394    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e7797a3-99db-4651-ad6d-1bc642317c43-model-cache\") pod \"rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx\" (UID: \"9e7797a3-99db-4651-ad6d-1bc642317c43\") " pod="ai-tenant-e2e-shared-b-5fe2d5/rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx"
Jul 06 03:20:57.245458 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:57.245440    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e7797a3-99db-4651-ad6d-1bc642317c43-tmp-dir\") pod \"rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx\" (UID: \"9e7797a3-99db-4651-ad6d-1bc642317c43\") " pod="ai-tenant-e2e-shared-b-5fe2d5/rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx"
Jul 06 03:20:57.245559 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:57.245469    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e7797a3-99db-4651-ad6d-1bc642317c43-home\") pod \"rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx\" (UID: \"9e7797a3-99db-4651-ad6d-1bc642317c43\") " pod="ai-tenant-e2e-shared-b-5fe2d5/rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx"
Jul 06 03:20:57.247245 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:57.247221    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e7797a3-99db-4651-ad6d-1bc642317c43-dshm\") pod \"rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx\" (UID: \"9e7797a3-99db-4651-ad6d-1bc642317c43\") " pod="ai-tenant-e2e-shared-b-5fe2d5/rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx"
Jul 06 03:20:57.247579 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:57.247560    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e7797a3-99db-4651-ad6d-1bc642317c43-tls-certs\") pod \"rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx\" (UID: \"9e7797a3-99db-4651-ad6d-1bc642317c43\") " pod="ai-tenant-e2e-shared-b-5fe2d5/rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx"
Jul 06 03:20:57.253172 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:57.253150    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld49k\" (UniqueName: \"kubernetes.io/projected/9e7797a3-99db-4651-ad6d-1bc642317c43-kube-api-access-ld49k\") pod \"rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx\" (UID: \"9e7797a3-99db-4651-ad6d-1bc642317c43\") " pod="ai-tenant-e2e-shared-b-5fe2d5/rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx"
Jul 06 03:20:57.381071 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:57.381002    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5fe2d5/rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx"
Jul 06 03:20:57.517328 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:57.517299    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-5fe2d5/rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx"]
Jul 06 03:20:57.519448 ip-10-0-131-238 kubenswrapper[2570]: W0706 03:20:57.519424    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9e7797a3_99db_4651_ad6d_1bc642317c43.slice/crio-8701d8c89361e52d0493a4a4203c398050864f1320d68efd80a10cd91e09a6c2 WatchSource:0}: Error finding container 8701d8c89361e52d0493a4a4203c398050864f1320d68efd80a10cd91e09a6c2: Status 404 returned error can't find the container with id 8701d8c89361e52d0493a4a4203c398050864f1320d68efd80a10cd91e09a6c2
Jul 06 03:20:58.455527 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:58.455489    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5fe2d5/rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx" event={"ID":"9e7797a3-99db-4651-ad6d-1bc642317c43","Type":"ContainerStarted","Data":"f5c9ee8b5b2ba10e3c260bfa64145983fd2ee229732bd41b442af638c6d59bd3"}
Jul 06 03:20:58.455937 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:58.455539    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5fe2d5/rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx" event={"ID":"9e7797a3-99db-4651-ad6d-1bc642317c43","Type":"ContainerStarted","Data":"8701d8c89361e52d0493a4a4203c398050864f1320d68efd80a10cd91e09a6c2"}
Jul 06 03:20:58.471920 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:20:58.471868    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-5fe2d5/rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx" podStartSLOduration=1.471854058 podStartE2EDuration="1.471854058s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 03:20:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 03:20:58.470139032 +0000 UTC m=+2512.127148697" watchObservedRunningTime="2026-07-06 03:20:58.471854058 +0000 UTC m=+2512.128863722"
Jul 06 03:21:07.381748 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:07.381718    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-5fe2d5/rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx"
Jul 06 03:21:07.382209 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:07.381974    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-5fe2d5/rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx"
Jul 06 03:21:07.394570 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:07.394509    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-5fe2d5/rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx"
Jul 06 03:21:07.515636 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:07.515611    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-5fe2d5/rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx"
Jul 06 03:21:24.343922 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:24.343885    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:21:24.444342 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:24.444310    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:21:29.538629 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:29.538589    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:21:29.638093 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:29.638059    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:21:31.950538 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:31.950506    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:21:32.054747 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:32.054718    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:21:41.002201 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:41.002159    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8edd65/rate-test-model-8edd65-kserve-77f5d99f47-4mspb"]
Jul 06 03:21:41.021194 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:41.021167    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:21:41.848510 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:41.848477    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-5fe2d5/rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx"]
Jul 06 03:21:41.867992 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:41.867946    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:21:42.887857 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:42.887808    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:21:43.263739 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:43.263653    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:21:43.363951 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:43.363922    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:21:43.464030 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:43.463999    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:21:43.529382 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:43.529349    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:21:48.344111 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:48.344075    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:21:56.022150 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:56.022104    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-8edd65/rate-test-model-8edd65-kserve-77f5d99f47-4mspb" podUID="e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad" containerName="main" containerID="cri-o://9a5a80936fcee25f504d7adacc3dcdfab000419e014fb895ddb5fc22a3c2c0e4" gracePeriod=45
Jul 06 03:21:56.265499 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:56.265469    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8edd65/rate-test-model-8edd65-kserve-77f5d99f47-4mspb"
Jul 06 03:21:56.332926 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:56.332901    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ch4pj\" (UniqueName: \"kubernetes.io/projected/e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad-kube-api-access-ch4pj\") pod \"e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad\" (UID: \"e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad\") "
Jul 06 03:21:56.333117 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:56.332953    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad-dshm\") pod \"e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad\" (UID: \"e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad\") "
Jul 06 03:21:56.333117 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:56.332978    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad-tmp-dir\") pod \"e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad\" (UID: \"e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad\") "
Jul 06 03:21:56.333117 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:56.333070    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad-tls-certs\") pod \"e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad\" (UID: \"e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad\") "
Jul 06 03:21:56.333282 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:56.333130    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad-model-cache\") pod \"e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad\" (UID: \"e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad\") "
Jul 06 03:21:56.333282 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:56.333179    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad-home\") pod \"e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad\" (UID: \"e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad\") "
Jul 06 03:21:56.333282 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:56.333255    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad" (UID: "e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:21:56.333494 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:56.333444    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad-model-cache" (OuterVolumeSpecName: "model-cache") pod "e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad" (UID: "e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:21:56.333494 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:56.333495    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad-home" (OuterVolumeSpecName: "home") pod "e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad" (UID: "e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:21:56.333751 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:56.333625    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad-tmp-dir\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:21:56.333751 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:56.333644    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad-model-cache\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:21:56.333751 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:56.333656    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad-home\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:21:56.335229 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:56.335210    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad-kube-api-access-ch4pj" (OuterVolumeSpecName: "kube-api-access-ch4pj") pod "e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad" (UID: "e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad"). InnerVolumeSpecName "kube-api-access-ch4pj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 03:21:56.335507 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:56.335487    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad" (UID: "e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 03:21:56.335565 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:56.335492    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad-dshm" (OuterVolumeSpecName: "dshm") pod "e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad" (UID: "e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:21:56.434690 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:56.434664    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ch4pj\" (UniqueName: \"kubernetes.io/projected/e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad-kube-api-access-ch4pj\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:21:56.434690 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:56.434687    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad-dshm\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:21:56.434857 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:56.434699    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad-tls-certs\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:21:56.762453 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:56.762350    2570 generic.go:356] "Generic (PLEG): container finished" podID="e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad" containerID="9a5a80936fcee25f504d7adacc3dcdfab000419e014fb895ddb5fc22a3c2c0e4" exitCode=0
Jul 06 03:21:56.762453 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:56.762397    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8edd65/rate-test-model-8edd65-kserve-77f5d99f47-4mspb"
Jul 06 03:21:56.762681 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:56.762440    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8edd65/rate-test-model-8edd65-kserve-77f5d99f47-4mspb" event={"ID":"e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad","Type":"ContainerDied","Data":"9a5a80936fcee25f504d7adacc3dcdfab000419e014fb895ddb5fc22a3c2c0e4"}
Jul 06 03:21:56.762681 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:56.762495    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8edd65/rate-test-model-8edd65-kserve-77f5d99f47-4mspb" event={"ID":"e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad","Type":"ContainerDied","Data":"50198a1b310fbea1b189322a5352c4e9e444b30b87d25968536b0e67153d59cc"}
Jul 06 03:21:56.762681 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:56.762519    2570 scope.go:117] "RemoveContainer" containerID="9a5a80936fcee25f504d7adacc3dcdfab000419e014fb895ddb5fc22a3c2c0e4"
Jul 06 03:21:56.772088 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:56.772071    2570 scope.go:117] "RemoveContainer" containerID="9a5a80936fcee25f504d7adacc3dcdfab000419e014fb895ddb5fc22a3c2c0e4"
Jul 06 03:21:56.772372 ip-10-0-131-238 kubenswrapper[2570]: E0706 03:21:56.772350    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a5a80936fcee25f504d7adacc3dcdfab000419e014fb895ddb5fc22a3c2c0e4\": container with ID starting with 9a5a80936fcee25f504d7adacc3dcdfab000419e014fb895ddb5fc22a3c2c0e4 not found: ID does not exist" containerID="9a5a80936fcee25f504d7adacc3dcdfab000419e014fb895ddb5fc22a3c2c0e4"
Jul 06 03:21:56.772421 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:56.772382    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a5a80936fcee25f504d7adacc3dcdfab000419e014fb895ddb5fc22a3c2c0e4"} err="failed to get container status \"9a5a80936fcee25f504d7adacc3dcdfab000419e014fb895ddb5fc22a3c2c0e4\": rpc error: code = NotFound desc = could not find container \"9a5a80936fcee25f504d7adacc3dcdfab000419e014fb895ddb5fc22a3c2c0e4\": container with ID starting with 9a5a80936fcee25f504d7adacc3dcdfab000419e014fb895ddb5fc22a3c2c0e4 not found: ID does not exist"
Jul 06 03:21:56.784653 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:56.784630    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8edd65/rate-test-model-8edd65-kserve-77f5d99f47-4mspb"]
Jul 06 03:21:56.791347 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:56.791327    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-8edd65/rate-test-model-8edd65-kserve-77f5d99f47-4mspb"]
Jul 06 03:21:56.868896 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:56.868867    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-5fe2d5/rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx" podUID="9e7797a3-99db-4651-ad6d-1bc642317c43" containerName="main" containerID="cri-o://f5c9ee8b5b2ba10e3c260bfa64145983fd2ee229732bd41b442af638c6d59bd3" gracePeriod=45
Jul 06 03:21:57.124743 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:57.124720    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5fe2d5/rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx"
Jul 06 03:21:57.235974 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:57.235934    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad" path="/var/lib/kubelet/pods/e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad/volumes"
Jul 06 03:21:57.241397 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:57.241372    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e7797a3-99db-4651-ad6d-1bc642317c43-home\") pod \"9e7797a3-99db-4651-ad6d-1bc642317c43\" (UID: \"9e7797a3-99db-4651-ad6d-1bc642317c43\") "
Jul 06 03:21:57.241567 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:57.241421    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e7797a3-99db-4651-ad6d-1bc642317c43-tls-certs\") pod \"9e7797a3-99db-4651-ad6d-1bc642317c43\" (UID: \"9e7797a3-99db-4651-ad6d-1bc642317c43\") "
Jul 06 03:21:57.241632 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:57.241616    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e7797a3-99db-4651-ad6d-1bc642317c43-model-cache\") pod \"9e7797a3-99db-4651-ad6d-1bc642317c43\" (UID: \"9e7797a3-99db-4651-ad6d-1bc642317c43\") "
Jul 06 03:21:57.241672 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:57.241660    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e7797a3-99db-4651-ad6d-1bc642317c43-dshm\") pod \"9e7797a3-99db-4651-ad6d-1bc642317c43\" (UID: \"9e7797a3-99db-4651-ad6d-1bc642317c43\") "
Jul 06 03:21:57.241722 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:57.241692    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e7797a3-99db-4651-ad6d-1bc642317c43-tmp-dir\") pod \"9e7797a3-99db-4651-ad6d-1bc642317c43\" (UID: \"9e7797a3-99db-4651-ad6d-1bc642317c43\") "
Jul 06 03:21:57.241722 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:57.241714    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ld49k\" (UniqueName: \"kubernetes.io/projected/9e7797a3-99db-4651-ad6d-1bc642317c43-kube-api-access-ld49k\") pod \"9e7797a3-99db-4651-ad6d-1bc642317c43\" (UID: \"9e7797a3-99db-4651-ad6d-1bc642317c43\") "
Jul 06 03:21:57.241828 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:57.241772    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e7797a3-99db-4651-ad6d-1bc642317c43-home" (OuterVolumeSpecName: "home") pod "9e7797a3-99db-4651-ad6d-1bc642317c43" (UID: "9e7797a3-99db-4651-ad6d-1bc642317c43"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:21:57.241955 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:57.241914    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e7797a3-99db-4651-ad6d-1bc642317c43-model-cache" (OuterVolumeSpecName: "model-cache") pod "9e7797a3-99db-4651-ad6d-1bc642317c43" (UID: "9e7797a3-99db-4651-ad6d-1bc642317c43"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:21:57.242054 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:57.242013    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e7797a3-99db-4651-ad6d-1bc642317c43-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9e7797a3-99db-4651-ad6d-1bc642317c43" (UID: "9e7797a3-99db-4651-ad6d-1bc642317c43"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:21:57.242054 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:57.242018    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e7797a3-99db-4651-ad6d-1bc642317c43-home\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:21:57.243537 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:57.243513    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e7797a3-99db-4651-ad6d-1bc642317c43-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9e7797a3-99db-4651-ad6d-1bc642317c43" (UID: "9e7797a3-99db-4651-ad6d-1bc642317c43"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 03:21:57.243822 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:57.243799    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e7797a3-99db-4651-ad6d-1bc642317c43-dshm" (OuterVolumeSpecName: "dshm") pod "9e7797a3-99db-4651-ad6d-1bc642317c43" (UID: "9e7797a3-99db-4651-ad6d-1bc642317c43"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:21:57.244080 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:57.244063    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e7797a3-99db-4651-ad6d-1bc642317c43-kube-api-access-ld49k" (OuterVolumeSpecName: "kube-api-access-ld49k") pod "9e7797a3-99db-4651-ad6d-1bc642317c43" (UID: "9e7797a3-99db-4651-ad6d-1bc642317c43"). InnerVolumeSpecName "kube-api-access-ld49k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 03:21:57.343394 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:57.343296    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e7797a3-99db-4651-ad6d-1bc642317c43-tls-certs\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:21:57.343394 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:57.343339    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e7797a3-99db-4651-ad6d-1bc642317c43-model-cache\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:21:57.343394 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:57.343347    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e7797a3-99db-4651-ad6d-1bc642317c43-dshm\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:21:57.343394 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:57.343355    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e7797a3-99db-4651-ad6d-1bc642317c43-tmp-dir\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:21:57.343394 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:57.343365    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ld49k\" (UniqueName: \"kubernetes.io/projected/9e7797a3-99db-4651-ad6d-1bc642317c43-kube-api-access-ld49k\") on node \"ip-10-0-131-238.ec2.internal\" DevicePath \"\""
Jul 06 03:21:57.770519 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:57.770434    2570 generic.go:356] "Generic (PLEG): container finished" podID="9e7797a3-99db-4651-ad6d-1bc642317c43" containerID="f5c9ee8b5b2ba10e3c260bfa64145983fd2ee229732bd41b442af638c6d59bd3" exitCode=0
Jul 06 03:21:57.770519 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:57.770473    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5fe2d5/rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx" event={"ID":"9e7797a3-99db-4651-ad6d-1bc642317c43","Type":"ContainerDied","Data":"f5c9ee8b5b2ba10e3c260bfa64145983fd2ee229732bd41b442af638c6d59bd3"}
Jul 06 03:21:57.770519 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:57.770492    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5fe2d5/rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx"
Jul 06 03:21:57.770519 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:57.770508    2570 scope.go:117] "RemoveContainer" containerID="f5c9ee8b5b2ba10e3c260bfa64145983fd2ee229732bd41b442af638c6d59bd3"
Jul 06 03:21:57.770797 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:57.770499    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5fe2d5/rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx" event={"ID":"9e7797a3-99db-4651-ad6d-1bc642317c43","Type":"ContainerDied","Data":"8701d8c89361e52d0493a4a4203c398050864f1320d68efd80a10cd91e09a6c2"}
Jul 06 03:21:57.780196 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:57.780176    2570 scope.go:117] "RemoveContainer" containerID="f5c9ee8b5b2ba10e3c260bfa64145983fd2ee229732bd41b442af638c6d59bd3"
Jul 06 03:21:57.780484 ip-10-0-131-238 kubenswrapper[2570]: E0706 03:21:57.780468    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5c9ee8b5b2ba10e3c260bfa64145983fd2ee229732bd41b442af638c6d59bd3\": container with ID starting with f5c9ee8b5b2ba10e3c260bfa64145983fd2ee229732bd41b442af638c6d59bd3 not found: ID does not exist" containerID="f5c9ee8b5b2ba10e3c260bfa64145983fd2ee229732bd41b442af638c6d59bd3"
Jul 06 03:21:57.780520 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:57.780495    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5c9ee8b5b2ba10e3c260bfa64145983fd2ee229732bd41b442af638c6d59bd3"} err="failed to get container status \"f5c9ee8b5b2ba10e3c260bfa64145983fd2ee229732bd41b442af638c6d59bd3\": rpc error: code = NotFound desc = could not find container \"f5c9ee8b5b2ba10e3c260bfa64145983fd2ee229732bd41b442af638c6d59bd3\": container with ID starting with f5c9ee8b5b2ba10e3c260bfa64145983fd2ee229732bd41b442af638c6d59bd3 not found: ID does not exist"
Jul 06 03:21:57.792064 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:57.792039    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-5fe2d5/rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx"]
Jul 06 03:21:57.794149 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:57.794129    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-5fe2d5/rate-test-model-5fe2d5-kserve-b447bd6d7-klvmx"]
Jul 06 03:21:59.233523 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:21:59.233492    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e7797a3-99db-4651-ad6d-1bc642317c43" path="/var/lib/kubelet/pods/9e7797a3-99db-4651-ad6d-1bc642317c43/volumes"
Jul 06 03:22:14.519334 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:14.519297    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:22:25.156045 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:25.155976    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:22:25.420862 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:25.420773    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:22:25.648964 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:25.648930    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:22:25.915192 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:25.915162    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:22:26.286558 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:26.286514    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:22:26.386313 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:26.386280    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:22:26.490677 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:26.490644    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:22:26.633027 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:26.632927    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:22:31.985750 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:31.985670    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:22:32.048313 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:32.048277    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:22:32.255609 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:32.255526    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:22:32.539252 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:32.539217    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:22:32.893574 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:32.893492    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-59567c567f-t2pnl_b3dde293-b9f7-4f66-944e-cdbf680af474/authorino/0.log"
Jul 06 03:22:38.239462 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:38.239431    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-rzfdj_ae0ba419-7a62-4c61-be5d-d9cc58d11a53/server/0.log"
Jul 06 03:22:38.354369 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:38.354340    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-f7wpp_d45c798c-f620-40d9-8493-d04e15f091f4/manager/0.log"
Jul 06 03:22:38.595236 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:38.595205    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d49d64447-jfmtq_4d7ff017-37df-4a24-a4d0-9768d6396231/copy-manifests/0.log"
Jul 06 03:22:38.609172 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:38.609144    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d49d64447-jfmtq_4d7ff017-37df-4a24-a4d0-9768d6396231/manager/0.log"
Jul 06 03:22:39.605118 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:39.605086    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mwm84_8521d6f9-91c0-4231-ac5c-90517bf722aa/util/0.log"
Jul 06 03:22:39.610942 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:39.610920    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mwm84_8521d6f9-91c0-4231-ac5c-90517bf722aa/pull/0.log"
Jul 06 03:22:39.616171 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:39.616149    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mwm84_8521d6f9-91c0-4231-ac5c-90517bf722aa/extract/0.log"
Jul 06 03:22:39.728336 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:39.728309    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nt69q_51b453cd-788d-4a11-9b0f-984e0df62b55/pull/0.log"
Jul 06 03:22:39.733758 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:39.733741    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nt69q_51b453cd-788d-4a11-9b0f-984e0df62b55/extract/0.log"
Jul 06 03:22:39.738869 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:39.738850    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nt69q_51b453cd-788d-4a11-9b0f-984e0df62b55/util/0.log"
Jul 06 03:22:39.854585 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:39.854562    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9v_19af652d-1b5b-403b-bf72-1d4124ecc11a/util/0.log"
Jul 06 03:22:39.862268 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:39.862211    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9v_19af652d-1b5b-403b-bf72-1d4124ecc11a/pull/0.log"
Jul 06 03:22:39.868494 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:39.868473    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9v_19af652d-1b5b-403b-bf72-1d4124ecc11a/extract/0.log"
Jul 06 03:22:39.979112 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:39.979095    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmn48_d57735f2-4f30-474d-8f7f-5363b27e3666/util/0.log"
Jul 06 03:22:39.985091 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:39.985059    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmn48_d57735f2-4f30-474d-8f7f-5363b27e3666/pull/0.log"
Jul 06 03:22:39.990819 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:39.990801    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmn48_d57735f2-4f30-474d-8f7f-5363b27e3666/extract/0.log"
Jul 06 03:22:40.110510 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:40.110485    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-59567c567f-t2pnl_b3dde293-b9f7-4f66-944e-cdbf680af474/authorino/0.log"
Jul 06 03:22:40.471457 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:40.471429    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-2dh4s_fb8f6215-62da-4df7-a9ea-2b5a0b3fc07b/kuadrant-console-plugin/0.log"
Jul 06 03:22:41.564661 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:41.564633    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59cc9f6b7-lrl7m_4e2803f3-236a-4bbf-bcae-781da42167c4/kube-auth-proxy/0.log"
Jul 06 03:22:42.055725 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:42.055697    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-4w5xk_a9a836c2-3967-4051-8379-f1fa7274140b/payload-processing/0.log"
Jul 06 03:22:42.175421 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:42.175394    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7444877bcc-p6fm2_9a08183a-b8db-4b2c-94b3-357e745e785b/router/0.log"
Jul 06 03:22:42.757939 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:42.757907    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-9tr2g_03edc717-7a72-4523-b79a-dfaae03fef49/main/0.log"
Jul 06 03:22:42.874386 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:42.874364    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db45xgz_52533cee-e7b2-4b9a-83ba-ac34661c07b9/main/0.log"
Jul 06 03:22:43.116135 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:43.116113    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-rmlhl_c709807f-ace8-40bf-b81f-d7ea0cf27545/main/0.log"
Jul 06 03:22:47.132613 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:47.132573    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ftgk5/must-gather-8jrtm"]
Jul 06 03:22:47.133205 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:47.133103    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e7797a3-99db-4651-ad6d-1bc642317c43" containerName="main"
Jul 06 03:22:47.133205 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:47.133124    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e7797a3-99db-4651-ad6d-1bc642317c43" containerName="main"
Jul 06 03:22:47.133205 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:47.133152    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad" containerName="main"
Jul 06 03:22:47.133205 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:47.133160    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad" containerName="main"
Jul 06 03:22:47.133439 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:47.133236    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e91fd201-1b21-42e0-a0d1-5fa2f4ab11ad" containerName="main"
Jul 06 03:22:47.133439 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:47.133249    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e7797a3-99db-4651-ad6d-1bc642317c43" containerName="main"
Jul 06 03:22:47.136576 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:47.136552    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ftgk5/must-gather-8jrtm"
Jul 06 03:22:47.139111 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:47.139085    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ftgk5\"/\"openshift-service-ca.crt\""
Jul 06 03:22:47.139298 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:47.139238    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ftgk5\"/\"kube-root-ca.crt\""
Jul 06 03:22:47.140161 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:47.140146    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ftgk5\"/\"default-dockercfg-lnmn7\""
Jul 06 03:22:47.145940 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:47.145917    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ftgk5/must-gather-8jrtm"]
Jul 06 03:22:47.150793 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:47.150773    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:22:47.242274 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:47.242238    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr6gd\" (UniqueName: \"kubernetes.io/projected/762a15fe-9658-4f8f-83b5-7937f1464e45-kube-api-access-wr6gd\") pod \"must-gather-8jrtm\" (UID: \"762a15fe-9658-4f8f-83b5-7937f1464e45\") " pod="openshift-must-gather-ftgk5/must-gather-8jrtm"
Jul 06 03:22:47.242420 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:47.242317    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/762a15fe-9658-4f8f-83b5-7937f1464e45-must-gather-output\") pod \"must-gather-8jrtm\" (UID: \"762a15fe-9658-4f8f-83b5-7937f1464e45\") " pod="openshift-must-gather-ftgk5/must-gather-8jrtm"
Jul 06 03:22:47.246623 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:47.246600    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log" limit=1024
Jul 06 03:22:47.343247 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:47.343214    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr6gd\" (UniqueName: \"kubernetes.io/projected/762a15fe-9658-4f8f-83b5-7937f1464e45-kube-api-access-wr6gd\") pod \"must-gather-8jrtm\" (UID: \"762a15fe-9658-4f8f-83b5-7937f1464e45\") " pod="openshift-must-gather-ftgk5/must-gather-8jrtm"
Jul 06 03:22:47.343402 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:47.343282    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/762a15fe-9658-4f8f-83b5-7937f1464e45-must-gather-output\") pod \"must-gather-8jrtm\" (UID: \"762a15fe-9658-4f8f-83b5-7937f1464e45\") " pod="openshift-must-gather-ftgk5/must-gather-8jrtm"
Jul 06 03:22:47.343646 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:47.343624    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/762a15fe-9658-4f8f-83b5-7937f1464e45-must-gather-output\") pod \"must-gather-8jrtm\" (UID: \"762a15fe-9658-4f8f-83b5-7937f1464e45\") " pod="openshift-must-gather-ftgk5/must-gather-8jrtm"
Jul 06 03:22:47.350749 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:47.350726    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr6gd\" (UniqueName: \"kubernetes.io/projected/762a15fe-9658-4f8f-83b5-7937f1464e45-kube-api-access-wr6gd\") pod \"must-gather-8jrtm\" (UID: \"762a15fe-9658-4f8f-83b5-7937f1464e45\") " pod="openshift-must-gather-ftgk5/must-gather-8jrtm"
Jul 06 03:22:47.447863 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:47.447793    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ftgk5/must-gather-8jrtm"
Jul 06 03:22:47.579116 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:47.579085    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ftgk5/must-gather-8jrtm"]
Jul 06 03:22:47.581759 ip-10-0-131-238 kubenswrapper[2570]: W0706 03:22:47.581718    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod762a15fe_9658_4f8f_83b5_7937f1464e45.slice/crio-af4a6a1f7218686cb0025c1104c25205b5d4af3157ab84c15518b8fb50d7428a WatchSource:0}: Error finding container af4a6a1f7218686cb0025c1104c25205b5d4af3157ab84c15518b8fb50d7428a: Status 404 returned error can't find the container with id af4a6a1f7218686cb0025c1104c25205b5d4af3157ab84c15518b8fb50d7428a
Jul 06 03:22:47.583873 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:47.583841    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 03:22:48.031775 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:48.031735    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ftgk5/must-gather-8jrtm" event={"ID":"762a15fe-9658-4f8f-83b5-7937f1464e45","Type":"ContainerStarted","Data":"af4a6a1f7218686cb0025c1104c25205b5d4af3157ab84c15518b8fb50d7428a"}
Jul 06 03:22:49.038715 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:49.038676    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ftgk5/must-gather-8jrtm" event={"ID":"762a15fe-9658-4f8f-83b5-7937f1464e45","Type":"ContainerStarted","Data":"907d6d4bffbc0c252298a9cf587f67a30314a7585d8ae18aeb0589d0d5d7554a"}
Jul 06 03:22:49.039143 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:49.038734    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ftgk5/must-gather-8jrtm" event={"ID":"762a15fe-9658-4f8f-83b5-7937f1464e45","Type":"ContainerStarted","Data":"9d3dc96701496153d46ecccbcc6863efa1c958a1a0f5bdb3f8691cd1eeabc6a1"}
Jul 06 03:22:49.055360 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:49.055299    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ftgk5/must-gather-8jrtm" podStartSLOduration=1.109201408 podStartE2EDuration="2.055279528s" totalImagesPullingTime="946.07812ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 03:22:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 03:22:49.052479263 +0000 UTC m=+2622.709488930" watchObservedRunningTime="2026-07-06 03:22:49.055279528 +0000 UTC m=+2622.712289193"
Jul 06 03:22:50.087999 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:50.087959    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lkl9q_152ac564-1081-4f4e-bf7c-fce7f2bc64a7/global-pull-secret-syncer/0.log"
Jul 06 03:22:50.219641 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:50.219613    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mlsf8_f8506b55-5900-4c57-bd12-9fda440b337a/konnectivity-agent/0.log"
Jul 06 03:22:50.308035 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:50.308004    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-238.ec2.internal_cf1e3a4f17d935523c08b1265303c61f/haproxy/0.log"
Jul 06 03:22:54.535519 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:54.535490    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mwm84_8521d6f9-91c0-4231-ac5c-90517bf722aa/extract/0.log"
Jul 06 03:22:54.557336 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:54.557245    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mwm84_8521d6f9-91c0-4231-ac5c-90517bf722aa/util/0.log"
Jul 06 03:22:54.581927 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:54.581901    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mwm84_8521d6f9-91c0-4231-ac5c-90517bf722aa/pull/0.log"
Jul 06 03:22:54.607995 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:54.607957    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nt69q_51b453cd-788d-4a11-9b0f-984e0df62b55/extract/0.log"
Jul 06 03:22:54.631631 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:54.631540    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nt69q_51b453cd-788d-4a11-9b0f-984e0df62b55/util/0.log"
Jul 06 03:22:54.655464 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:54.655428    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nt69q_51b453cd-788d-4a11-9b0f-984e0df62b55/pull/0.log"
Jul 06 03:22:54.682639 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:54.682586    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9v_19af652d-1b5b-403b-bf72-1d4124ecc11a/extract/0.log"
Jul 06 03:22:54.704448 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:54.704419    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9v_19af652d-1b5b-403b-bf72-1d4124ecc11a/util/0.log"
Jul 06 03:22:54.729210 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:54.729185    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c7m9v_19af652d-1b5b-403b-bf72-1d4124ecc11a/pull/0.log"
Jul 06 03:22:54.759700 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:54.759658    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmn48_d57735f2-4f30-474d-8f7f-5363b27e3666/extract/0.log"
Jul 06 03:22:54.795820 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:54.795693    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmn48_d57735f2-4f30-474d-8f7f-5363b27e3666/util/0.log"
Jul 06 03:22:54.819398 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:54.819361    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wmn48_d57735f2-4f30-474d-8f7f-5363b27e3666/pull/0.log"
Jul 06 03:22:55.238646 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:55.238245    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-59567c567f-t2pnl_b3dde293-b9f7-4f66-944e-cdbf680af474/authorino/0.log"
Jul 06 03:22:55.334746 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:55.334707    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-2dh4s_fb8f6215-62da-4df7-a9ea-2b5a0b3fc07b/kuadrant-console-plugin/0.log"
Jul 06 03:22:57.500686 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:57.500612    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-x2lrc_c3246741-951c-41e7-a4f7-c7d3638e12e6/cluster-monitoring-operator/0.log"
Jul 06 03:22:57.641293 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:57.641258    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-lsk29_0cd8bc7b-dfb4-42f2-ba1c-8b03f8157c40/monitoring-plugin/0.log"
Jul 06 03:22:57.769016 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:57.768888    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jgp4t_3029180d-d7dc-43fb-bf63-fe20abb9a93e/node-exporter/0.log"
Jul 06 03:22:57.790492 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:57.790444    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jgp4t_3029180d-d7dc-43fb-bf63-fe20abb9a93e/kube-rbac-proxy/0.log"
Jul 06 03:22:57.813218 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:57.813188    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jgp4t_3029180d-d7dc-43fb-bf63-fe20abb9a93e/init-textfile/0.log"
Jul 06 03:22:58.250721 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:58.250691    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5bdd969686-d72dn_5bc64425-90ca-49ac-bfb9-56ae4edade5a/telemeter-client/0.log"
Jul 06 03:22:58.273054 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:58.273012    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5bdd969686-d72dn_5bc64425-90ca-49ac-bfb9-56ae4edade5a/reload/0.log"
Jul 06 03:22:58.295027 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:58.294973    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5bdd969686-d72dn_5bc64425-90ca-49ac-bfb9-56ae4edade5a/kube-rbac-proxy/0.log"
Jul 06 03:22:59.600646 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:22:59.600616    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-jfb42_072a4522-4dd2-440e-b0c0-d0b131322bca/networking-console-plugin/0.log"
Jul 06 03:23:00.471063 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:00.471027    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ftgk5/perf-node-gather-daemonset-w9rhv"]
Jul 06 03:23:00.476848 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:00.476819    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ftgk5/perf-node-gather-daemonset-w9rhv"
Jul 06 03:23:00.485767 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:00.485739    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ftgk5/perf-node-gather-daemonset-w9rhv"]
Jul 06 03:23:00.597438 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:00.597397    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8a3a0814-d1c9-4932-ae6b-39b53e057e45-proc\") pod \"perf-node-gather-daemonset-w9rhv\" (UID: \"8a3a0814-d1c9-4932-ae6b-39b53e057e45\") " pod="openshift-must-gather-ftgk5/perf-node-gather-daemonset-w9rhv"
Jul 06 03:23:00.597648 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:00.597470    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8a3a0814-d1c9-4932-ae6b-39b53e057e45-podres\") pod \"perf-node-gather-daemonset-w9rhv\" (UID: \"8a3a0814-d1c9-4932-ae6b-39b53e057e45\") " pod="openshift-must-gather-ftgk5/perf-node-gather-daemonset-w9rhv"
Jul 06 03:23:00.597648 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:00.597528    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a3a0814-d1c9-4932-ae6b-39b53e057e45-sys\") pod \"perf-node-gather-daemonset-w9rhv\" (UID: \"8a3a0814-d1c9-4932-ae6b-39b53e057e45\") " pod="openshift-must-gather-ftgk5/perf-node-gather-daemonset-w9rhv"
Jul 06 03:23:00.597783 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:00.597655    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a3a0814-d1c9-4932-ae6b-39b53e057e45-lib-modules\") pod \"perf-node-gather-daemonset-w9rhv\" (UID: \"8a3a0814-d1c9-4932-ae6b-39b53e057e45\") " pod="openshift-must-gather-ftgk5/perf-node-gather-daemonset-w9rhv"
Jul 06 03:23:00.597783 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:00.597693    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2c2t\" (UniqueName: \"kubernetes.io/projected/8a3a0814-d1c9-4932-ae6b-39b53e057e45-kube-api-access-m2c2t\") pod \"perf-node-gather-daemonset-w9rhv\" (UID: \"8a3a0814-d1c9-4932-ae6b-39b53e057e45\") " pod="openshift-must-gather-ftgk5/perf-node-gather-daemonset-w9rhv"
Jul 06 03:23:00.698683 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:00.698638    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a3a0814-d1c9-4932-ae6b-39b53e057e45-sys\") pod \"perf-node-gather-daemonset-w9rhv\" (UID: \"8a3a0814-d1c9-4932-ae6b-39b53e057e45\") " pod="openshift-must-gather-ftgk5/perf-node-gather-daemonset-w9rhv"
Jul 06 03:23:00.699196 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:00.698722    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a3a0814-d1c9-4932-ae6b-39b53e057e45-lib-modules\") pod \"perf-node-gather-daemonset-w9rhv\" (UID: \"8a3a0814-d1c9-4932-ae6b-39b53e057e45\") " pod="openshift-must-gather-ftgk5/perf-node-gather-daemonset-w9rhv"
Jul 06 03:23:00.699196 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:00.698750    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2c2t\" (UniqueName: \"kubernetes.io/projected/8a3a0814-d1c9-4932-ae6b-39b53e057e45-kube-api-access-m2c2t\") pod \"perf-node-gather-daemonset-w9rhv\" (UID: \"8a3a0814-d1c9-4932-ae6b-39b53e057e45\") " pod="openshift-must-gather-ftgk5/perf-node-gather-daemonset-w9rhv"
Jul 06 03:23:00.699196 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:00.698794    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8a3a0814-d1c9-4932-ae6b-39b53e057e45-proc\") pod \"perf-node-gather-daemonset-w9rhv\" (UID: \"8a3a0814-d1c9-4932-ae6b-39b53e057e45\") " pod="openshift-must-gather-ftgk5/perf-node-gather-daemonset-w9rhv"
Jul 06 03:23:00.699196 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:00.698843    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8a3a0814-d1c9-4932-ae6b-39b53e057e45-podres\") pod \"perf-node-gather-daemonset-w9rhv\" (UID: \"8a3a0814-d1c9-4932-ae6b-39b53e057e45\") " pod="openshift-must-gather-ftgk5/perf-node-gather-daemonset-w9rhv"
Jul 06 03:23:00.699196 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:00.699046    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8a3a0814-d1c9-4932-ae6b-39b53e057e45-podres\") pod \"perf-node-gather-daemonset-w9rhv\" (UID: \"8a3a0814-d1c9-4932-ae6b-39b53e057e45\") " pod="openshift-must-gather-ftgk5/perf-node-gather-daemonset-w9rhv"
Jul 06 03:23:00.699196 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:00.699082    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a3a0814-d1c9-4932-ae6b-39b53e057e45-sys\") pod \"perf-node-gather-daemonset-w9rhv\" (UID: \"8a3a0814-d1c9-4932-ae6b-39b53e057e45\") " pod="openshift-must-gather-ftgk5/perf-node-gather-daemonset-w9rhv"
Jul 06 03:23:00.699196 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:00.699151    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8a3a0814-d1c9-4932-ae6b-39b53e057e45-proc\") pod \"perf-node-gather-daemonset-w9rhv\" (UID: \"8a3a0814-d1c9-4932-ae6b-39b53e057e45\") " pod="openshift-must-gather-ftgk5/perf-node-gather-daemonset-w9rhv"
Jul 06 03:23:00.699648 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:00.699256    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a3a0814-d1c9-4932-ae6b-39b53e057e45-lib-modules\") pod \"perf-node-gather-daemonset-w9rhv\" (UID: \"8a3a0814-d1c9-4932-ae6b-39b53e057e45\") " pod="openshift-must-gather-ftgk5/perf-node-gather-daemonset-w9rhv"
Jul 06 03:23:00.708329 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:00.708298    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2c2t\" (UniqueName: \"kubernetes.io/projected/8a3a0814-d1c9-4932-ae6b-39b53e057e45-kube-api-access-m2c2t\") pod \"perf-node-gather-daemonset-w9rhv\" (UID: \"8a3a0814-d1c9-4932-ae6b-39b53e057e45\") " pod="openshift-must-gather-ftgk5/perf-node-gather-daemonset-w9rhv"
Jul 06 03:23:00.792485 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:00.792441    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ftgk5/perf-node-gather-daemonset-w9rhv"
Jul 06 03:23:00.970698 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:00.970661    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ftgk5/perf-node-gather-daemonset-w9rhv"]
Jul 06 03:23:00.971919 ip-10-0-131-238 kubenswrapper[2570]: W0706 03:23:00.971881    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8a3a0814_d1c9_4932_ae6b_39b53e057e45.slice/crio-4124c731b4fd8e03e50ad972f5bd4011bd666868419dd1f24f646d37809077ad WatchSource:0}: Error finding container 4124c731b4fd8e03e50ad972f5bd4011bd666868419dd1f24f646d37809077ad: Status 404 returned error can't find the container with id 4124c731b4fd8e03e50ad972f5bd4011bd666868419dd1f24f646d37809077ad
Jul 06 03:23:01.140326 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:01.140288    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ftgk5/perf-node-gather-daemonset-w9rhv" event={"ID":"8a3a0814-d1c9-4932-ae6b-39b53e057e45","Type":"ContainerStarted","Data":"da8e34d46eff09acbcd9a1532ba8f858f6e9333243ce8837d32bc6f61023e89a"}
Jul 06 03:23:01.140487 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:01.140352    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ftgk5/perf-node-gather-daemonset-w9rhv" event={"ID":"8a3a0814-d1c9-4932-ae6b-39b53e057e45","Type":"ContainerStarted","Data":"4124c731b4fd8e03e50ad972f5bd4011bd666868419dd1f24f646d37809077ad"}
Jul 06 03:23:01.140487 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:01.140424    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ftgk5/perf-node-gather-daemonset-w9rhv"
Jul 06 03:23:01.157038 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:01.156968    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ftgk5/perf-node-gather-daemonset-w9rhv" podStartSLOduration=1.156947388 podStartE2EDuration="1.156947388s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 03:23:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 03:23:01.155087718 +0000 UTC m=+2634.812097382" watchObservedRunningTime="2026-07-06 03:23:01.156947388 +0000 UTC m=+2634.813957054"
Jul 06 03:23:02.392108 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:02.392077    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-775zk_268b24ef-43c1-4813-b69e-0ba3f6cf44ad/dns/0.log"
Jul 06 03:23:02.416756 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:02.416729    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-775zk_268b24ef-43c1-4813-b69e-0ba3f6cf44ad/kube-rbac-proxy/0.log"
Jul 06 03:23:02.573212 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:02.573186    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v6b8r_5dea5b0e-3e8c-4ca2-9939-57e6bc1c2c80/dns-node-resolver/0.log"
Jul 06 03:23:03.138143 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:03.138115    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-drltx_d6e0698e-7d78-4805-9704-03a57ae7ccce/node-ca/0.log"
Jul 06 03:23:04.239626 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:04.239595    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59cc9f6b7-lrl7m_4e2803f3-236a-4bbf-bcae-781da42167c4/kube-auth-proxy/0.log"
Jul 06 03:23:04.444077 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:04.444038    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-4w5xk_a9a836c2-3967-4051-8379-f1fa7274140b/payload-processing/0.log"
Jul 06 03:23:04.467552 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:04.467501    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7444877bcc-p6fm2_9a08183a-b8db-4b2c-94b3-357e745e785b/router/0.log"
Jul 06 03:23:05.151201 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:05.151158    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lfk4b_90203301-698e-4c93-abcc-211c1d8bdd51/serve-healthcheck-canary/0.log"
Jul 06 03:23:05.773559 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:05.773528    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m5lr8_66eae218-7faa-4efc-84dd-7e019ed36e88/kube-rbac-proxy/0.log"
Jul 06 03:23:05.796240 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:05.796202    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m5lr8_66eae218-7faa-4efc-84dd-7e019ed36e88/exporter/0.log"
Jul 06 03:23:05.817333 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:05.817305    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m5lr8_66eae218-7faa-4efc-84dd-7e019ed36e88/extractor/0.log"
Jul 06 03:23:07.157907 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:07.157882    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ftgk5/perf-node-gather-daemonset-w9rhv"
Jul 06 03:23:08.410522 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:08.410486    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-rzfdj_ae0ba419-7a62-4c61-be5d-d9cc58d11a53/server/0.log"
Jul 06 03:23:08.503309 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:08.503242    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-f7wpp_d45c798c-f620-40d9-8493-d04e15f091f4/manager/0.log"
Jul 06 03:23:08.658689 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:08.658649    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d49d64447-jfmtq_4d7ff017-37df-4a24-a4d0-9768d6396231/manager/0.log"
Jul 06 03:23:08.675748 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:08.675666    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d49d64447-jfmtq_4d7ff017-37df-4a24-a4d0-9768d6396231/copy-manifests/0.log"
Jul 06 03:23:10.282181 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:10.282096    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-56497ccf4b-fpr8t_5117eaba-0448-46e0-ae63-df33c2d13f94/manager/0.log"
Jul 06 03:23:10.620281 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:10.620242    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59cc9f6b7-lrl7m_4e2803f3-236a-4bbf-bcae-781da42167c4/kube-auth-proxy/0.log"
Jul 06 03:23:10.794858 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:10.794775    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-4w5xk_a9a836c2-3967-4051-8379-f1fa7274140b/payload-processing/0.log"
Jul 06 03:23:10.807591 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:10.807563    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7444877bcc-p6fm2_9a08183a-b8db-4b2c-94b3-357e745e785b/router/0.log"
Jul 06 03:23:12.045440 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:12.045403    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59cc9f6b7-lrl7m_4e2803f3-236a-4bbf-bcae-781da42167c4/kube-auth-proxy/0.log"
Jul 06 03:23:12.238401 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:12.238370    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-4w5xk_a9a836c2-3967-4051-8379-f1fa7274140b/payload-processing/0.log"
Jul 06 03:23:12.263274 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:12.263246    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7444877bcc-p6fm2_9a08183a-b8db-4b2c-94b3-357e745e785b/router/0.log"
Jul 06 03:23:15.166701 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:15.166672    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-v9d95_6c4c14f0-d61d-433a-9264-7449f715925b/migrator/0.log"
Jul 06 03:23:15.186953 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:15.186929    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-v9d95_6c4c14f0-d61d-433a-9264-7449f715925b/graceful-termination/0.log"
Jul 06 03:23:15.537884 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:15.537851    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-znzln_1c8a4c86-30a0-400f-866b-4606d5284ddf/kube-storage-version-migrator-operator/1.log"
Jul 06 03:23:15.539011 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:15.538974    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-znzln_1c8a4c86-30a0-400f-866b-4606d5284ddf/kube-storage-version-migrator-operator/0.log"
Jul 06 03:23:16.513325 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:16.513291    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4ljj8_a8e34855-89c9-415e-9513-596bb1ae12ae/kube-multus/0.log"
Jul 06 03:23:16.947445 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:16.947414    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lvbvz_988da6f0-e2d4-416f-bbfc-3812c7ae2f6a/kube-multus-additional-cni-plugins/0.log"
Jul 06 03:23:16.968163 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:16.968137    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lvbvz_988da6f0-e2d4-416f-bbfc-3812c7ae2f6a/egress-router-binary-copy/0.log"
Jul 06 03:23:16.988064 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:16.988039    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lvbvz_988da6f0-e2d4-416f-bbfc-3812c7ae2f6a/cni-plugins/0.log"
Jul 06 03:23:17.008345 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:17.008320    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lvbvz_988da6f0-e2d4-416f-bbfc-3812c7ae2f6a/bond-cni-plugin/0.log"
Jul 06 03:23:17.031077 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:17.031050    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lvbvz_988da6f0-e2d4-416f-bbfc-3812c7ae2f6a/routeoverride-cni/0.log"
Jul 06 03:23:17.056372 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:17.056350    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lvbvz_988da6f0-e2d4-416f-bbfc-3812c7ae2f6a/whereabouts-cni-bincopy/0.log"
Jul 06 03:23:17.079096 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:17.079069    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lvbvz_988da6f0-e2d4-416f-bbfc-3812c7ae2f6a/whereabouts-cni/0.log"
Jul 06 03:23:17.268951 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:17.262704    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-j4xxx_35f61f76-1038-43ca-a749-71412ea26859/network-metrics-daemon/0.log"
Jul 06 03:23:17.288494 ip-10-0-131-238 kubenswrapper[2570]: I0706 03:23:17.288438    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-j4xxx_35f61f76-1038-43ca-a749-71412ea26859/kube-rbac-proxy/0.log"