Jul 21 01:20:03.651056 ip-10-0-128-147 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 21 01:20:03.651211 ip-10-0-128-147 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 21 01:20:03.651230 ip-10-0-128-147 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 21 01:20:03.651716 ip-10-0-128-147 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 21 01:20:13.882464 ip-10-0-128-147 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 21 01:20:13.882479 ip-10-0-128-147 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot c0531607e75d43a5bc5d982165efd364 --
Jul 21 01:22:10.166508 ip-10-0-128-147 systemd[1]: Starting Kubernetes Kubelet...
Jul 21 01:22:10.506780 ip-10-0-128-147 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 01:22:10.506780 ip-10-0-128-147 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 21 01:22:10.506780 ip-10-0-128-147 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 01:22:10.506780 ip-10-0-128-147 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 21 01:22:10.506780 ip-10-0-128-147 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 01:22:10.507599 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.507515    2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 21 01:22:10.512437 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512421    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 01:22:10.512437 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512436    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 01:22:10.512437 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512440    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 01:22:10.512528 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512443    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 01:22:10.512528 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512448    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 01:22:10.512528 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512452    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 01:22:10.512528 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512455    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 01:22:10.512528 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512458    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 01:22:10.512528 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512461    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 01:22:10.512528 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512464    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 01:22:10.512528 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512466    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 01:22:10.512528 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512469    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 01:22:10.512528 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512471    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 01:22:10.512528 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512473    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 01:22:10.512528 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512476    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 01:22:10.512528 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512478    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 01:22:10.512528 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512481    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 01:22:10.512528 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512483    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 01:22:10.512528 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512486    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 01:22:10.512528 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512489    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 01:22:10.512528 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512493    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 01:22:10.512528 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512496    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 01:22:10.512976 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512500    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 01:22:10.512976 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512508    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 01:22:10.512976 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512511    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 01:22:10.512976 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512514    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 01:22:10.512976 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512517    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 01:22:10.512976 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512519    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 01:22:10.512976 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512522    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 01:22:10.512976 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512525    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 01:22:10.512976 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512527    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 01:22:10.512976 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512530    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 01:22:10.512976 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512533    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 01:22:10.512976 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512535    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 01:22:10.512976 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512538    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 01:22:10.512976 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512540    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 01:22:10.512976 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512543    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 01:22:10.512976 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512546    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 01:22:10.512976 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512548    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 01:22:10.512976 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512551    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 01:22:10.512976 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512553    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 01:22:10.512976 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512556    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 01:22:10.513507 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512559    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 01:22:10.513507 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512561    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 01:22:10.513507 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512564    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 01:22:10.513507 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512566    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 01:22:10.513507 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512568    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 01:22:10.513507 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512571    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 01:22:10.513507 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512573    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 01:22:10.513507 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512576    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 01:22:10.513507 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512578    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 01:22:10.513507 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512580    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 01:22:10.513507 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512583    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 01:22:10.513507 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512585    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 01:22:10.513507 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512587    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 01:22:10.513507 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512590    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 01:22:10.513507 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512593    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 01:22:10.513507 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512596    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 01:22:10.513507 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512598    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 01:22:10.513507 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512600    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 01:22:10.513507 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512605    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 01:22:10.513507 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512608    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 01:22:10.513993 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512610    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 01:22:10.513993 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512612    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 01:22:10.513993 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512615    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 01:22:10.513993 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512617    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 01:22:10.513993 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512619    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 01:22:10.513993 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512622    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 01:22:10.513993 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512624    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 01:22:10.513993 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512626    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 01:22:10.513993 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512629    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 01:22:10.513993 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512631    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 01:22:10.513993 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512633    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 01:22:10.513993 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512636    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 01:22:10.513993 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512638    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 01:22:10.513993 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512643    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 01:22:10.513993 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512646    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 01:22:10.513993 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512648    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 01:22:10.513993 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512651    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 01:22:10.513993 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512653    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 01:22:10.513993 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512656    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 01:22:10.513993 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512658    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 01:22:10.514477 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512660    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 01:22:10.514477 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512663    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 01:22:10.514477 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512665    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 01:22:10.514477 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512667    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 01:22:10.514477 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512670    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 01:22:10.514477 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512673    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 01:22:10.514477 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512675    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 01:22:10.514477 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512678    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 01:22:10.514477 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512680    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 01:22:10.514477 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512682    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 01:22:10.514477 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512685    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 01:22:10.514477 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512688    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 01:22:10.514477 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512692    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 01:22:10.514477 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512696    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 01:22:10.514477 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512698    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 01:22:10.514477 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512701    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 01:22:10.514477 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.512704    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 01:22:10.514477 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513413    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 01:22:10.514477 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513420    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 01:22:10.514927 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513423    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 01:22:10.514927 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513426    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 01:22:10.514927 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513429    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 01:22:10.514927 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513432    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 01:22:10.514927 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513437    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 01:22:10.514927 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513440    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 01:22:10.514927 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513444    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 01:22:10.514927 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513447    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 01:22:10.514927 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513450    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 01:22:10.514927 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513453    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 01:22:10.514927 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513456    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 01:22:10.514927 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513459    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 01:22:10.514927 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513462    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 01:22:10.514927 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513465    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 01:22:10.514927 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513468    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 01:22:10.514927 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513470    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 01:22:10.514927 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513473    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 01:22:10.514927 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513475    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 01:22:10.514927 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513478    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 01:22:10.515404 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513481    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 01:22:10.515404 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513484    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 01:22:10.515404 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513487    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 01:22:10.515404 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513489    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 01:22:10.515404 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513492    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 01:22:10.515404 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513494    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 01:22:10.515404 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513497    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 01:22:10.515404 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513499    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 01:22:10.515404 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513502    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 01:22:10.515404 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513504    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 01:22:10.515404 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513506    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 01:22:10.515404 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513509    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 01:22:10.515404 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513512    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 01:22:10.515404 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513515    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 01:22:10.515404 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513517    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 01:22:10.515404 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513520    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 01:22:10.515404 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513522    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 01:22:10.515404 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513525    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 01:22:10.515404 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513527    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 01:22:10.515404 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513529    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 01:22:10.515884 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513532    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 01:22:10.515884 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513535    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 01:22:10.515884 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513539    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 01:22:10.515884 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513541    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 01:22:10.515884 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513544    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 01:22:10.515884 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513546    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 01:22:10.515884 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513549    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 01:22:10.515884 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513551    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 01:22:10.515884 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513554    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 01:22:10.515884 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513557    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 01:22:10.515884 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513559    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 01:22:10.515884 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513561    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 01:22:10.515884 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513564    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 01:22:10.515884 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513566    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 01:22:10.515884 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513569    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 01:22:10.515884 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513571    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 01:22:10.515884 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513574    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 01:22:10.515884 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513576    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 01:22:10.515884 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513579    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 01:22:10.515884 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513581    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 01:22:10.516428 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513583    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 01:22:10.516428 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513586    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 01:22:10.516428 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513588    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 01:22:10.516428 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513591    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 01:22:10.516428 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513593    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 01:22:10.516428 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513595    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 01:22:10.516428 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513597    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 01:22:10.516428 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513600    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 01:22:10.516428 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513602    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 01:22:10.516428 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513605    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 01:22:10.516428 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513607    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 01:22:10.516428 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513609    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 01:22:10.516428 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513612    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 01:22:10.516428 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513615    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 01:22:10.516428 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513619    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 01:22:10.516428 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513622    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 01:22:10.516428 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513625    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 01:22:10.516428 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513628    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 01:22:10.516428 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513631    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 01:22:10.516901 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513634    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 01:22:10.516901 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513636    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 01:22:10.516901 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513639    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 01:22:10.516901 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513641    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 01:22:10.516901 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513644    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 01:22:10.516901 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513646    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 01:22:10.516901 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513649    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 01:22:10.516901 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513651    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 01:22:10.516901 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513654    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 01:22:10.516901 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513656    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 01:22:10.516901 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513659    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 01:22:10.516901 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513661    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 01:22:10.516901 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513663    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 01:22:10.516901 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513665    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 01:22:10.516901 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513668    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 01:22:10.516901 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513672    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 01:22:10.516901 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513676    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 01:22:10.516901 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513678    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 01:22:10.516901 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.513681    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 01:22:10.516901 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514046    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 01:22:10.517391 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514051    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 01:22:10.517391 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514053    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 01:22:10.517391 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514056    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 01:22:10.517391 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514058    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 01:22:10.517391 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514062    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 01:22:10.517391 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514064    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 01:22:10.517391 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514067    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 01:22:10.517391 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514070    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 01:22:10.517391 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514073    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 01:22:10.517391 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514075    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 01:22:10.517391 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514077    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 01:22:10.517391 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514080    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 01:22:10.517391 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514083    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 01:22:10.517391 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514085    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 01:22:10.517391 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514088    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 01:22:10.517391 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514090    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 01:22:10.517391 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514093    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 01:22:10.517391 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514095    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 01:22:10.517391 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514098    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 01:22:10.517391 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514101    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 01:22:10.517872 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514103    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 01:22:10.517872 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514106    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 01:22:10.517872 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514108    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 01:22:10.517872 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514110    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 01:22:10.517872 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514113    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 01:22:10.517872 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514115    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 01:22:10.517872 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514117    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 01:22:10.517872 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514120    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 01:22:10.517872 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514122    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 01:22:10.517872 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514125    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 01:22:10.517872 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514127    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 01:22:10.517872 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514129    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 01:22:10.517872 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514132    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 01:22:10.517872 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514134    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 01:22:10.517872 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514136    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 01:22:10.517872 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514139    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 01:22:10.517872 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514143    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 01:22:10.517872 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514146    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 01:22:10.517872 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514149    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 01:22:10.517872 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514151    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 01:22:10.518371 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514154    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 01:22:10.518371 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514157    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 01:22:10.518371 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514159    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 01:22:10.518371 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514161    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 01:22:10.518371 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514164    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 01:22:10.518371 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514166    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 01:22:10.518371 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514169    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 01:22:10.518371 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514171    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 01:22:10.518371 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514173    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 01:22:10.518371 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514176    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 01:22:10.518371 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514178    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 01:22:10.518371 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514181    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 01:22:10.518371 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514183    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 01:22:10.518371 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514186    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 01:22:10.518371 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514188    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 01:22:10.518371 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514190    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 01:22:10.518371 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514193    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 01:22:10.518371 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514210    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 01:22:10.518371 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514213    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 01:22:10.518371 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514216    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 01:22:10.518854 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514218    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 01:22:10.518854 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514221    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 01:22:10.518854 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514224    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 01:22:10.518854 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514227    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 01:22:10.518854 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514229    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 01:22:10.518854 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514232    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 01:22:10.518854 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514234    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 01:22:10.518854 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514237    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 01:22:10.518854 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514241    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 01:22:10.518854 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514243    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 01:22:10.518854 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514246    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 01:22:10.518854 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514248    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 01:22:10.518854 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514251    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 01:22:10.518854 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514254    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 01:22:10.518854 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514256    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 01:22:10.518854 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514259    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 01:22:10.518854 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514261    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 01:22:10.518854 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514264    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 01:22:10.518854 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514266    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 01:22:10.519322 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514269    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 01:22:10.519322 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514271    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 01:22:10.519322 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514273    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 01:22:10.519322 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514276    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 01:22:10.519322 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514278    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 01:22:10.519322 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514281    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 01:22:10.519322 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514285    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 01:22:10.519322 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514288    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 01:22:10.519322 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514291    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 01:22:10.519322 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514294    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 01:22:10.519322 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514296    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 01:22:10.519322 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514298    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 01:22:10.519322 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514301    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 01:22:10.519322 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514303    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 01:22:10.519322 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514306    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 01:22:10.519322 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514308    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 01:22:10.519322 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514312    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 01:22:10.519322 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514316    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 01:22:10.519322 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514320    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 01:22:10.519770 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514390    2561 flags.go:64] FLAG: --address="0.0.0.0"
Jul 21 01:22:10.519770 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514396    2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 21 01:22:10.519770 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514406    2561 flags.go:64] FLAG: --anonymous-auth="true"
Jul 21 01:22:10.519770 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514411    2561 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 21 01:22:10.519770 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514414    2561 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 21 01:22:10.519770 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514418    2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 21 01:22:10.519770 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514422    2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 21 01:22:10.519770 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514426    2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 21 01:22:10.519770 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514431    2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 21 01:22:10.519770 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514434    2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 21 01:22:10.519770 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514437    2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 21 01:22:10.519770 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514441    2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 21 01:22:10.519770 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514444    2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 21 01:22:10.519770 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514447    2561 flags.go:64] FLAG: --cgroup-root=""
Jul 21 01:22:10.519770 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514450    2561 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 21 01:22:10.519770 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514452    2561 flags.go:64] FLAG: --client-ca-file=""
Jul 21 01:22:10.519770 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514455    2561 flags.go:64] FLAG: --cloud-provider="external"
Jul 21 01:22:10.519770 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514458    2561 flags.go:64] FLAG: --cluster-dns="[]"
Jul 21 01:22:10.519770 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514462    2561 flags.go:64] FLAG: --cluster-domain=""
Jul 21 01:22:10.519770 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514464    2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 21 01:22:10.519770 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514467    2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 21 01:22:10.519770 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514470    2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 21 01:22:10.519770 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514473    2561 flags.go:64] FLAG: --container-log-max-files="5"
Jul 21 01:22:10.519770 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514477    2561 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 21 01:22:10.520370 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514480    2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 21 01:22:10.520370 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514483    2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 21 01:22:10.520370 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514486    2561 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 21 01:22:10.520370 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514489    2561 flags.go:64] FLAG: --contention-profiling="false"
Jul 21 01:22:10.520370 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514492    2561 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 21 01:22:10.520370 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514494    2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 21 01:22:10.520370 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514497    2561 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 21 01:22:10.520370 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514500    2561 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 21 01:22:10.520370 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514504    2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 21 01:22:10.520370 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514507    2561 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 21 01:22:10.520370 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514510    2561 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 21 01:22:10.520370 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514513    2561 flags.go:64] FLAG: --enable-load-reader="false"
Jul 21 01:22:10.520370 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514516    2561 flags.go:64] FLAG: --enable-server="true"
Jul 21 01:22:10.520370 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514519    2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 21 01:22:10.520370 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514523    2561 flags.go:64] FLAG: --event-burst="100"
Jul 21 01:22:10.520370 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514526    2561 flags.go:64] FLAG: --event-qps="50"
Jul 21 01:22:10.520370 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514530    2561 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 21 01:22:10.520370 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514534    2561 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 21 01:22:10.520370 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514537    2561 flags.go:64] FLAG: --eviction-hard=""
Jul 21 01:22:10.520370 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514541    2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 21 01:22:10.520370 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514543    2561 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 21 01:22:10.520370 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514546    2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 21 01:22:10.520370 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514549    2561 flags.go:64] FLAG: --eviction-soft=""
Jul 21 01:22:10.520370 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514551    2561 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 21 01:22:10.520370 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514554    2561 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 21 01:22:10.521049 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514557    2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 21 01:22:10.521049 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514559    2561 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 21 01:22:10.521049 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514562    2561 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 21 01:22:10.521049 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514564    2561 flags.go:64] FLAG: --fail-swap-on="true"
Jul 21 01:22:10.521049 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514567    2561 flags.go:64] FLAG: --feature-gates=""
Jul 21 01:22:10.521049 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514570    2561 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 21 01:22:10.521049 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514573    2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 21 01:22:10.521049 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514576    2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 21 01:22:10.521049 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514579    2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 21 01:22:10.521049 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514582    2561 flags.go:64] FLAG: --healthz-port="10248"
Jul 21 01:22:10.521049 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514584    2561 flags.go:64] FLAG: --help="false"
Jul 21 01:22:10.521049 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514587    2561 flags.go:64] FLAG: --hostname-override="ip-10-0-128-147.ec2.internal"
Jul 21 01:22:10.521049 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514590    2561 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 21 01:22:10.521049 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514592    2561 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 21 01:22:10.521049 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514595    2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 21 01:22:10.521049 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514598    2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 21 01:22:10.521049 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514601    2561 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 21 01:22:10.521049 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514604    2561 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 21 01:22:10.521049 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514607    2561 flags.go:64] FLAG: --image-service-endpoint=""
Jul 21 01:22:10.521049 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514610    2561 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 21 01:22:10.521049 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514613    2561 flags.go:64] FLAG: --kube-api-burst="100"
Jul 21 01:22:10.521049 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514616    2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 21 01:22:10.521049 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514619    2561 flags.go:64] FLAG: --kube-api-qps="50"
Jul 21 01:22:10.521049 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514622    2561 flags.go:64] FLAG: --kube-reserved=""
Jul 21 01:22:10.521670 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514625    2561 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 21 01:22:10.521670 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514628    2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 21 01:22:10.521670 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514631    2561 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 21 01:22:10.521670 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514634    2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 21 01:22:10.521670 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514636    2561 flags.go:64] FLAG: --lock-file=""
Jul 21 01:22:10.521670 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514639    2561 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 21 01:22:10.521670 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514642    2561 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 21 01:22:10.521670 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514645    2561 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 21 01:22:10.521670 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514650    2561 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 21 01:22:10.521670 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514653    2561 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 21 01:22:10.521670 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514655    2561 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 21 01:22:10.521670 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514658    2561 flags.go:64] FLAG: --logging-format="text"
Jul 21 01:22:10.521670 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514661    2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 21 01:22:10.521670 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514664    2561 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 21 01:22:10.521670 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514667    2561 flags.go:64] FLAG: --manifest-url=""
Jul 21 01:22:10.521670 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514670    2561 flags.go:64] FLAG: --manifest-url-header=""
Jul 21 01:22:10.521670 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514674    2561 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 21 01:22:10.521670 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514676    2561 flags.go:64] FLAG: --max-open-files="1000000"
Jul 21 01:22:10.521670 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514681    2561 flags.go:64] FLAG: --max-pods="110"
Jul 21 01:22:10.521670 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514684    2561 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 21 01:22:10.521670 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514686    2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 21 01:22:10.521670 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514689    2561 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 21 01:22:10.521670 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514692    2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 21 01:22:10.521670 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514694    2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 21 01:22:10.521670 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514697    2561 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 21 01:22:10.522279 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514701    2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 21 01:22:10.522279 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514708    2561 flags.go:64] FLAG: --node-status-max-images="50"
Jul 21 01:22:10.522279 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514711    2561 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 21 01:22:10.522279 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514714    2561 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 21 01:22:10.522279 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514717    2561 flags.go:64] FLAG: --pod-cidr=""
Jul 21 01:22:10.522279 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514720    2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 21 01:22:10.522279 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514727    2561 flags.go:64] FLAG: --pod-manifest-path=""
Jul 21 01:22:10.522279 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514729    2561 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 21 01:22:10.522279 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514732    2561 flags.go:64] FLAG: --pods-per-core="0"
Jul 21 01:22:10.522279 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514735    2561 flags.go:64] FLAG: --port="10250"
Jul 21 01:22:10.522279 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514738    2561 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 21 01:22:10.522279 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514741    2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07c969033238b167b"
Jul 21 01:22:10.522279 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514744    2561 flags.go:64] FLAG: --qos-reserved=""
Jul 21 01:22:10.522279 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514747    2561 flags.go:64] FLAG: --read-only-port="10255"
Jul 21 01:22:10.522279 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514750    2561 flags.go:64] FLAG: --register-node="true"
Jul 21 01:22:10.522279 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514752    2561 flags.go:64] FLAG: --register-with-taints=""
Jul 21 01:22:10.522279 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514756    2561 flags.go:64] FLAG: --registry-burst="10"
Jul 21 01:22:10.522279 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514758    2561 flags.go:64] FLAG: --registry-qps="5"
Jul 21 01:22:10.522279 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514761    2561 flags.go:64] FLAG: --reserved-cpus=""
Jul 21 01:22:10.522279 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514763    2561 flags.go:64] FLAG: --reserved-memory=""
Jul 21 01:22:10.522279 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514767    2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 21 01:22:10.522279 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514769    2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 21 01:22:10.522279 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514772    2561 flags.go:64] FLAG: --rotate-certificates="false"
Jul 21 01:22:10.522279 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514775    2561 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 21 01:22:10.522279 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514777    2561 flags.go:64] FLAG: --runonce="false"
Jul 21 01:22:10.522970 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514780    2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 21 01:22:10.522970 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514783    2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 21 01:22:10.522970 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514786    2561 flags.go:64] FLAG: --seccomp-default="false"
Jul 21 01:22:10.522970 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514789    2561 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 21 01:22:10.522970 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514791    2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 21 01:22:10.522970 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514794    2561 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 21 01:22:10.522970 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514797    2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 21 01:22:10.522970 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514800    2561 flags.go:64] FLAG: --storage-driver-password="root"
Jul 21 01:22:10.522970 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514803    2561 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 21 01:22:10.522970 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514805    2561 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 21 01:22:10.522970 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514808    2561 flags.go:64] FLAG: --storage-driver-user="root"
Jul 21 01:22:10.522970 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514811    2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 21 01:22:10.522970 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514813    2561 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 21 01:22:10.522970 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514817    2561 flags.go:64] FLAG: --system-cgroups=""
Jul 21 01:22:10.522970 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514820    2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 21 01:22:10.522970 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514825    2561 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 21 01:22:10.522970 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514827    2561 flags.go:64] FLAG: --tls-cert-file=""
Jul 21 01:22:10.522970 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514830    2561 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 21 01:22:10.522970 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514834    2561 flags.go:64] FLAG: --tls-min-version=""
Jul 21 01:22:10.522970 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514837    2561 flags.go:64] FLAG: --tls-private-key-file=""
Jul 21 01:22:10.522970 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514840    2561 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 21 01:22:10.522970 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514842    2561 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 21 01:22:10.522970 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514845    2561 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 21 01:22:10.522970 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514848    2561 flags.go:64] FLAG: --v="2"
Jul 21 01:22:10.522970 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514851    2561 flags.go:64] FLAG: --version="false"
Jul 21 01:22:10.523598 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514855    2561 flags.go:64] FLAG: --vmodule=""
Jul 21 01:22:10.523598 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514858    2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 21 01:22:10.523598 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.514861    2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 21 01:22:10.523598 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514972    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 01:22:10.523598 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514976    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 01:22:10.523598 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514979    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 01:22:10.523598 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514981    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 01:22:10.523598 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514984    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 01:22:10.523598 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514987    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 01:22:10.523598 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514989    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 01:22:10.523598 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514992    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 01:22:10.523598 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514994    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 01:22:10.523598 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.514997    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 01:22:10.523598 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515003    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 01:22:10.523598 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515006    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 01:22:10.523598 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515009    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 01:22:10.523598 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515012    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 01:22:10.523598 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515015    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 01:22:10.523598 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515018    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 01:22:10.523598 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515021    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 01:22:10.524081 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515025    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 01:22:10.524081 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515027    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 01:22:10.524081 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515031    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 01:22:10.524081 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515033    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 01:22:10.524081 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515036    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 01:22:10.524081 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515038    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 01:22:10.524081 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515041    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 01:22:10.524081 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515043    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 01:22:10.524081 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515045    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 01:22:10.524081 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515048    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 01:22:10.524081 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515051    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 01:22:10.524081 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515055    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 01:22:10.524081 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515057    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 01:22:10.524081 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515060    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 01:22:10.524081 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515063    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 01:22:10.524081 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515065    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 01:22:10.524081 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515068    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 01:22:10.524081 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515070    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 01:22:10.524081 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515073    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 01:22:10.524573 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515075    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 01:22:10.524573 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515078    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 01:22:10.524573 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515080    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 01:22:10.524573 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515083    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 01:22:10.524573 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515085    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 01:22:10.524573 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515088    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 01:22:10.524573 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515091    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 01:22:10.524573 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515094    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 01:22:10.524573 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515096    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 01:22:10.524573 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515099    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 01:22:10.524573 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515101    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 01:22:10.524573 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515104    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 01:22:10.524573 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515106    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 01:22:10.524573 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515110    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 01:22:10.524573 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515112    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 01:22:10.524573 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515115    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 01:22:10.524573 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515117    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 01:22:10.524573 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515120    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 01:22:10.524573 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515122    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 01:22:10.525035 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515125    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 01:22:10.525035 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515127    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 01:22:10.525035 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515130    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 01:22:10.525035 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515132    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 01:22:10.525035 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515135    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 01:22:10.525035 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515137    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 01:22:10.525035 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515139    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 01:22:10.525035 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515142    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 01:22:10.525035 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515144    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 01:22:10.525035 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515146    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 01:22:10.525035 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515149    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 01:22:10.525035 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515151    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 01:22:10.525035 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515153    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 01:22:10.525035 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515156    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 01:22:10.525035 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515158    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 01:22:10.525035 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515160    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 01:22:10.525035 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515163    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 01:22:10.525035 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515165    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 01:22:10.525035 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515168    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 01:22:10.525035 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515172    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 01:22:10.525576 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515174    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 01:22:10.525576 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515176    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 01:22:10.525576 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515179    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 01:22:10.525576 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515181    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 01:22:10.525576 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515184    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 01:22:10.525576 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515186    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 01:22:10.525576 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515190    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 01:22:10.525576 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515193    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 01:22:10.525576 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515209    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 01:22:10.525576 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515212    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 01:22:10.525576 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515214    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 01:22:10.525576 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515217    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 01:22:10.525576 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515219    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 01:22:10.525576 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515222    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 01:22:10.525576 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515225    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 01:22:10.525576 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515227    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 01:22:10.525576 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515229    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 01:22:10.525576 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515232    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 01:22:10.525576 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515234    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 01:22:10.525576 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515237    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 01:22:10.526080 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515239    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 01:22:10.526080 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515241    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 01:22:10.526080 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515244    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 01:22:10.526080 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.515248    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 01:22:10.526080 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.515728    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 01:22:10.526080 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.522484    2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 21 01:22:10.526080 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.522502    2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 21 01:22:10.526080 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.523121    2561 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 21 01:22:10.526080 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.523128    2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 21 01:22:10.526080 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523194    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 01:22:10.526080 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523219    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 01:22:10.526080 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523223    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 01:22:10.526080 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523226    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 01:22:10.526080 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523228    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 01:22:10.526467 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523231    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 01:22:10.526467 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523233    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 01:22:10.526467 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523236    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 01:22:10.526467 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523238    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 01:22:10.526467 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523241    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 01:22:10.526467 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523243    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 01:22:10.526467 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523246    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 01:22:10.526467 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523248    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 01:22:10.526467 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523250    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 01:22:10.526467 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523253    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 01:22:10.526467 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523256    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 01:22:10.526467 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523258    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 01:22:10.526467 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523261    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 01:22:10.526467 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523263    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 01:22:10.526467 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523266    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 01:22:10.526467 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523268    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 01:22:10.526467 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523270    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 01:22:10.526467 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523273    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 01:22:10.526467 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523275    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 01:22:10.526467 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523278    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 01:22:10.526467 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523280    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 01:22:10.526979 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523282    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 01:22:10.526979 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523285    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 01:22:10.526979 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523287    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 01:22:10.526979 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523299    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 01:22:10.526979 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523303    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 01:22:10.526979 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523307    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 01:22:10.526979 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523310    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 01:22:10.526979 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523312    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 01:22:10.526979 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523315    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 01:22:10.526979 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523317    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 01:22:10.526979 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523319    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 01:22:10.526979 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523322    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 01:22:10.526979 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523324    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 01:22:10.526979 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523327    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 01:22:10.526979 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523329    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 01:22:10.526979 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523332    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 01:22:10.526979 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523334    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 01:22:10.526979 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523337    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 01:22:10.526979 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523339    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 01:22:10.526979 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523341    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 01:22:10.527505 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523343    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 01:22:10.527505 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523346    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 01:22:10.527505 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523348    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 01:22:10.527505 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523351    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 01:22:10.527505 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523353    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 01:22:10.527505 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523356    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 01:22:10.527505 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523358    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 01:22:10.527505 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523361    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 01:22:10.527505 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523363    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 01:22:10.527505 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523365    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 01:22:10.527505 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523368    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 01:22:10.527505 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523370    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 01:22:10.527505 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523372    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 01:22:10.527505 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523375    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 01:22:10.527505 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523377    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 01:22:10.527505 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523380    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 01:22:10.527505 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523389    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 01:22:10.527505 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523392    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 01:22:10.527505 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523394    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 01:22:10.527972 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523397    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 01:22:10.527972 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523399    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 01:22:10.527972 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523402    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 01:22:10.527972 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523406    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 01:22:10.527972 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523410    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 01:22:10.527972 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523412    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 01:22:10.527972 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523415    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 01:22:10.527972 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523418    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 01:22:10.527972 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523420    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 01:22:10.527972 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523423    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 01:22:10.527972 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523426    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 01:22:10.527972 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523429    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 01:22:10.527972 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523432    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 01:22:10.527972 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523435    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 01:22:10.527972 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523437    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 01:22:10.527972 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523440    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 01:22:10.527972 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523443    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 01:22:10.527972 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523446    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 01:22:10.527972 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523448    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 01:22:10.528453 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523451    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 01:22:10.528453 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523454    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 01:22:10.528453 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523456    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 01:22:10.528453 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523459    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 01:22:10.528453 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523461    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 01:22:10.528453 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523463    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 01:22:10.528453 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523466    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 01:22:10.528453 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523469    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 01:22:10.528453 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523471    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 01:22:10.528453 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523474    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 01:22:10.528453 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523477    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 01:22:10.528453 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523485    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 01:22:10.528453 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523489    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 01:22:10.528453 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523492    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 01:22:10.528453 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523495    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 01:22:10.528863 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.523500    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 01:22:10.528863 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523652    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 01:22:10.528863 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523658    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 01:22:10.528863 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523661    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 01:22:10.528863 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523664    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 01:22:10.528863 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523667    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 01:22:10.528863 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523669    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 01:22:10.528863 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523672    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 01:22:10.528863 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523675    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 01:22:10.528863 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523677    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 01:22:10.528863 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523680    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 01:22:10.528863 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523683    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 01:22:10.528863 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523685    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 01:22:10.528863 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523687    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 01:22:10.528863 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523690    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 01:22:10.528863 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523692    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 01:22:10.529365 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523694    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 01:22:10.529365 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523697    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 01:22:10.529365 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523699    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 01:22:10.529365 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523702    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 01:22:10.529365 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523704    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 01:22:10.529365 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523707    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 01:22:10.529365 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523709    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 01:22:10.529365 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523711    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 01:22:10.529365 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523713    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 01:22:10.529365 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523716    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 01:22:10.529365 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523719    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 01:22:10.529365 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523722    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 01:22:10.529365 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523724    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 01:22:10.529365 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523732    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 01:22:10.529365 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523735    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 01:22:10.529365 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523737    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 01:22:10.529365 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523739    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 01:22:10.529365 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523742    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 01:22:10.529365 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523744    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 01:22:10.529365 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523746    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 01:22:10.529860 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523749    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 01:22:10.529860 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523751    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 01:22:10.529860 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523753    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 01:22:10.529860 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523755    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 01:22:10.529860 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523758    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 01:22:10.529860 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523760    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 01:22:10.529860 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523763    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 01:22:10.529860 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523765    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 01:22:10.529860 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523768    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 01:22:10.529860 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523770    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 01:22:10.529860 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523772    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 01:22:10.529860 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523774    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 01:22:10.529860 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523777    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 01:22:10.529860 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523779    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 01:22:10.529860 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523781    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 01:22:10.529860 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523784    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 01:22:10.529860 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523786    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 01:22:10.529860 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523789    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 01:22:10.529860 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523791    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 01:22:10.529860 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523793    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 01:22:10.530352 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523796    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 01:22:10.530352 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523798    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 01:22:10.530352 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523800    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 01:22:10.530352 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523803    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 01:22:10.530352 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523807    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 01:22:10.530352 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523810    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 01:22:10.530352 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523818    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 01:22:10.530352 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523821    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 01:22:10.530352 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523825    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 01:22:10.530352 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523828    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 01:22:10.530352 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523831    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 01:22:10.530352 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523833    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 01:22:10.530352 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523836    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 01:22:10.530352 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523838    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 01:22:10.530352 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523840    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 01:22:10.530352 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523843    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 01:22:10.530352 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523845    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 01:22:10.530352 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523848    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 01:22:10.530352 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523850    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 01:22:10.531021 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523852    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 01:22:10.531021 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523855    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 01:22:10.531021 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523857    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 01:22:10.531021 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523859    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 01:22:10.531021 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523862    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 01:22:10.531021 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523864    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 01:22:10.531021 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523866    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 01:22:10.531021 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523869    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 01:22:10.531021 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523871    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 01:22:10.531021 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523874    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 01:22:10.531021 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523876    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 01:22:10.531021 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523878    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 01:22:10.531021 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523881    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 01:22:10.531021 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523883    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 01:22:10.531021 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523885    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 01:22:10.531021 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523888    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 01:22:10.531021 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523891    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 01:22:10.531021 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523893    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 01:22:10.531021 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523897    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 01:22:10.531588 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523899    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 01:22:10.531588 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523908    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 01:22:10.531588 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523911    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 01:22:10.531588 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523914    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 01:22:10.531588 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523917    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 01:22:10.531588 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:10.523919    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 01:22:10.531588 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.523924    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 01:22:10.531588 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.524078    2561 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 21 01:22:10.531588 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.526005    2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 21 01:22:10.531588 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.527254    2561 server.go:1019] "Starting client certificate rotation"
Jul 21 01:22:10.531588 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.527363    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 01:22:10.531588 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.527842    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 01:22:10.532487 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.532472    2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 01:22:10.534961 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.534940    2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 01:22:10.543668 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.543647    2561 log.go:25] "Validated CRI v1 runtime API"
Jul 21 01:22:10.546954 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.546937    2561 log.go:25] "Validated CRI v1 image API"
Jul 21 01:22:10.547728 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.547712    2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 21 01:22:10.550406 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.550387    2561 fs.go:135] Filesystem UUIDs: map[77ec0329-fbc5-4926-bd25-5f8d7cc48e5d:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ec252261-67c8-4499-ac34-0a2d1b15cda4:/dev/nvme0n1p3]
Jul 21 01:22:10.550465 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.550405    2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 21 01:22:10.556708 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.556602    2561 manager.go:216] Machine: {Timestamp:2026-07-21 01:22:10.555525885 +0000 UTC m=+0.285894547 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3106244 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2aecdbaa08926339040e193e662ab7 SystemUUID:ec2aecdb-aa08-9263-3904-0e193e662ab7 BootID:c0531607-e75d-43a5-bc5d-982165efd364 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:47:c8:ac:66:cb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:47:c8:ac:66:cb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f6:d0:31:3e:a2:a3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 21 01:22:10.556708 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.556707    2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 21 01:22:10.556814 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.556782    2561 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 21 01:22:10.559113 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.559096    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 01:22:10.559393 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.559368    2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 21 01:22:10.559523 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.559398    2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-147.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 21 01:22:10.560028 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.560017    2561 topology_manager.go:138] "Creating topology manager with none policy"
Jul 21 01:22:10.560060 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.560030    2561 container_manager_linux.go:309] "Creating device plugin manager"
Jul 21 01:22:10.560060 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.560038    2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 01:22:10.560603 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.560592    2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 01:22:10.561842 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.561831    2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 21 01:22:10.564471 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.564460    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 01:22:10.564593 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.564582    2561 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 21 01:22:10.564648 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.564613    2561 kubelet.go:486] "Attempting to sync node with API server"
Jul 21 01:22:10.564648 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.564622    2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 21 01:22:10.564648 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.564646    2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 21 01:22:10.564747 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.564657    2561 kubelet.go:398] "Adding apiserver pod source"
Jul 21 01:22:10.564747 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.564669    2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 21 01:22:10.565052 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.565040    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 01:22:10.565088 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.565062    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 01:22:10.566977 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.566961    2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 21 01:22:10.568643 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.568630    2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 21 01:22:10.568695 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.568660    2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 21 01:22:10.569630 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.569615    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 21 01:22:10.569683 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.569640    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 21 01:22:10.569683 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.569652    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 21 01:22:10.569683 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.569660    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 21 01:22:10.569683 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.569672    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 21 01:22:10.569683 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.569680    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 21 01:22:10.569832 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.569701    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 21 01:22:10.569832 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.569711    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 21 01:22:10.569832 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.569720    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 21 01:22:10.569832 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.569745    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 21 01:22:10.569832 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.569758    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 21 01:22:10.569832 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.569763    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 21 01:22:10.570404 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.570393    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 21 01:22:10.570441 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.570406    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 21 01:22:10.574514 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.574488    2561 server.go:1268] "Started kubelet"
Jul 21 01:22:10.574619 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.574570    2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 21 01:22:10.574714 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.574696    2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 21 01:22:10.574819 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.574800    2561 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 21 01:22:10.575181 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.575145    2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-147.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 21 01:22:10.575652 ip-10-0-128-147 systemd[1]: Started Kubernetes Kubelet.
Jul 21 01:22:10.575800 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:10.575728    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 21 01:22:10.575800 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:10.575738    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-147.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 21 01:22:10.576331 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.576166    2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 21 01:22:10.578593 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.578577    2561 server.go:310] "Adding debug handlers to kubelet server"
Jul 21 01:22:10.579741 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.579720    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8mmwt"
Jul 21 01:22:10.579822 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:10.579763    2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 21 01:22:10.581549 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:10.580730    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-147.ec2.internal.18c429740224965e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-147.ec2.internal,UID:ip-10-0-128-147.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-147.ec2.internal,},FirstTimestamp:2026-07-21 01:22:10.574456414 +0000 UTC m=+0.304825075,LastTimestamp:2026-07-21 01:22:10.574456414 +0000 UTC m=+0.304825075,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-147.ec2.internal,}"
Jul 21 01:22:10.582384 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.582365    2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 21 01:22:10.582384 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.582384    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 21 01:22:10.582580 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:10.582566    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-147.ec2.internal\" not found"
Jul 21 01:22:10.582985 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.582967    2561 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 21 01:22:10.583062 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.582988    2561 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 21 01:22:10.583062 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.582977    2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 21 01:22:10.583153 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.583099    2561 reconstruct.go:97] "Volume reconstruction finished"
Jul 21 01:22:10.583153 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.583107    2561 reconciler.go:29] "Reconciler: start to sync state"
Jul 21 01:22:10.583697 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.583681    2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 21 01:22:10.583697 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.583696    2561 factory.go:55] Registering systemd factory
Jul 21 01:22:10.583697 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.583702    2561 factory.go:223] Registration of the systemd container factory successfully
Jul 21 01:22:10.584066 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.584054    2561 factory.go:153] Registering CRI-O factory
Jul 21 01:22:10.584066 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.584063    2561 factory.go:223] Registration of the crio container factory successfully
Jul 21 01:22:10.584187 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.584080    2561 factory.go:103] Registering Raw factory
Jul 21 01:22:10.584187 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.584089    2561 manager.go:1196] Started watching for new ooms in manager
Jul 21 01:22:10.584569 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.584556    2561 manager.go:349] Starting recovery of all containers
Jul 21 01:22:10.589327 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.589270    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8mmwt"
Jul 21 01:22:10.594114 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.594096    2561 manager.go:354] Recovery completed
Jul 21 01:22:10.597880 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.597778    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 01:22:10.602035 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:10.602014    2561 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-147.ec2.internal\" not found" node="ip-10-0-128-147.ec2.internal"
Jul 21 01:22:10.602110 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.602089    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 01:22:10.603838 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.603824    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-147.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 01:22:10.603894 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.603851    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-147.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 01:22:10.603894 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.603861    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-147.ec2.internal" event="NodeHasSufficientPID"
Jul 21 01:22:10.604395 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.604378    2561 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 21 01:22:10.604471 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.604394    2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 21 01:22:10.604471 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.604419    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 01:22:10.604471 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.604379    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 01:22:10.605154 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.605138    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-147.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 01:22:10.605242 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.605169    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-147.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 01:22:10.605242 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.605181    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-147.ec2.internal" event="NodeHasSufficientPID"
Jul 21 01:22:10.605445 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.605433    2561 policy_none.go:49] "None policy: Start"
Jul 21 01:22:10.605479 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.605450    2561 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 21 01:22:10.605479 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.605459    2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 21 01:22:10.606346 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.606335    2561 policy_none.go:47] "Start"
Jul 21 01:22:10.640770 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.640752    2561 manager.go:337] "Starting Device Plugin manager"
Jul 21 01:22:10.640845 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:10.640782    2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 21 01:22:10.640845 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.640791    2561 server.go:87] "Starting device plugin registration server"
Jul 21 01:22:10.641034 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.641022    2561 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 21 01:22:10.641075 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.641037    2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 21 01:22:10.641148 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.641119    2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 21 01:22:10.641232 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.641192    2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 21 01:22:10.641232 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.641222    2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 21 01:22:10.641684 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:10.641661    2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 21 01:22:10.641760 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:10.641719    2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-147.ec2.internal\" not found"
Jul 21 01:22:10.707565 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.707536    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 21 01:22:10.708894 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.708877    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 21 01:22:10.708973 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.708924    2561 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 21 01:22:10.708973 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.708952    2561 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 21 01:22:10.709064 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:10.708999    2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 21 01:22:10.710939 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.710917    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 01:22:10.742014 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.741985    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 01:22:10.742884 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.742866    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-147.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 01:22:10.742955 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.742899    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-147.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 01:22:10.742955 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.742918    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-147.ec2.internal" event="NodeHasSufficientPID"
Jul 21 01:22:10.742955 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.742940    2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-147.ec2.internal"
Jul 21 01:22:10.750923 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.750906    2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-147.ec2.internal"
Jul 21 01:22:10.751013 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:10.750929    2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-147.ec2.internal\": node \"ip-10-0-128-147.ec2.internal\" not found"
Jul 21 01:22:10.766053 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:10.765991    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-147.ec2.internal\" not found"
Jul 21 01:22:10.809932 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.809883    2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-147.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-147.ec2.internal"]
Jul 21 01:22:10.810087 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.809988    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 01:22:10.811735 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.811716    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-147.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 01:22:10.811815 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.811755    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-147.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 01:22:10.811815 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.811772    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-147.ec2.internal" event="NodeHasSufficientPID"
Jul 21 01:22:10.813005 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.812992    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 01:22:10.813110 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.813095    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-147.ec2.internal"
Jul 21 01:22:10.813159 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.813130    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 01:22:10.813701 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.813687    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-147.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 01:22:10.813769 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.813720    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-147.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 01:22:10.813769 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.813736    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-147.ec2.internal" event="NodeHasSufficientPID"
Jul 21 01:22:10.813839 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.813737    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-147.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 01:22:10.813839 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.813813    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-147.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 01:22:10.813839 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.813831    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-147.ec2.internal" event="NodeHasSufficientPID"
Jul 21 01:22:10.814898 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.814878    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-147.ec2.internal"
Jul 21 01:22:10.814975 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.814906    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 01:22:10.815555 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.815541    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-147.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 01:22:10.815621 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.815569    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-147.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 01:22:10.815621 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.815580    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-147.ec2.internal" event="NodeHasSufficientPID"
Jul 21 01:22:10.837862 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:10.837838    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-147.ec2.internal\" not found" node="ip-10-0-128-147.ec2.internal"
Jul 21 01:22:10.842442 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:10.842428    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-147.ec2.internal\" not found" node="ip-10-0-128-147.ec2.internal"
Jul 21 01:22:10.866841 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:10.866823    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-147.ec2.internal\" not found"
Jul 21 01:22:10.884649 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.884618    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cc1b51a7ee645186d00208039d5f8c77-config\") pod \"kube-apiserver-proxy-ip-10-0-128-147.ec2.internal\" (UID: \"cc1b51a7ee645186d00208039d5f8c77\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-147.ec2.internal"
Jul 21 01:22:10.884757 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.884653    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9d7e0f4a3fad0e13e8662877d91e1039-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-147.ec2.internal\" (UID: \"9d7e0f4a3fad0e13e8662877d91e1039\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-147.ec2.internal"
Jul 21 01:22:10.884757 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.884677    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d7e0f4a3fad0e13e8662877d91e1039-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-147.ec2.internal\" (UID: \"9d7e0f4a3fad0e13e8662877d91e1039\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-147.ec2.internal"
Jul 21 01:22:10.967431 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:10.967403    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-147.ec2.internal\" not found"
Jul 21 01:22:10.985811 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.985788    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d7e0f4a3fad0e13e8662877d91e1039-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-147.ec2.internal\" (UID: \"9d7e0f4a3fad0e13e8662877d91e1039\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-147.ec2.internal"
Jul 21 01:22:10.985876 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.985812    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d7e0f4a3fad0e13e8662877d91e1039-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-147.ec2.internal\" (UID: \"9d7e0f4a3fad0e13e8662877d91e1039\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-147.ec2.internal"
Jul 21 01:22:10.985876 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.985851    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cc1b51a7ee645186d00208039d5f8c77-config\") pod \"kube-apiserver-proxy-ip-10-0-128-147.ec2.internal\" (UID: \"cc1b51a7ee645186d00208039d5f8c77\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-147.ec2.internal"
Jul 21 01:22:10.985876 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.985869    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9d7e0f4a3fad0e13e8662877d91e1039-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-147.ec2.internal\" (UID: \"9d7e0f4a3fad0e13e8662877d91e1039\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-147.ec2.internal"
Jul 21 01:22:10.985963 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.985907    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9d7e0f4a3fad0e13e8662877d91e1039-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-147.ec2.internal\" (UID: \"9d7e0f4a3fad0e13e8662877d91e1039\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-147.ec2.internal"
Jul 21 01:22:10.985963 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:10.985943    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cc1b51a7ee645186d00208039d5f8c77-config\") pod \"kube-apiserver-proxy-ip-10-0-128-147.ec2.internal\" (UID: \"cc1b51a7ee645186d00208039d5f8c77\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-147.ec2.internal"
Jul 21 01:22:11.068256 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:11.068221    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-147.ec2.internal\" not found"
Jul 21 01:22:11.140721 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:11.140679    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-147.ec2.internal"
Jul 21 01:22:11.145610 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:11.145591    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-147.ec2.internal"
Jul 21 01:22:11.168362 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:11.168335    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-147.ec2.internal\" not found"
Jul 21 01:22:11.268900 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:11.268855    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-147.ec2.internal\" not found"
Jul 21 01:22:11.369490 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:11.369407    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-147.ec2.internal\" not found"
Jul 21 01:22:11.469943 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:11.469914    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-147.ec2.internal\" not found"
Jul 21 01:22:11.509606 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:11.509581    2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 01:22:11.527293 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:11.527273    2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 21 01:22:11.527412 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:11.527396    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 01:22:11.527468 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:11.527437    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 01:22:11.527468 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:11.527444    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 01:22:11.570720 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:11.570690    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-147.ec2.internal\" not found"
Jul 21 01:22:11.593138 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:11.593093    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 01:17:10 +0000 UTC" deadline="2028-04-08 08:20:59.149076884 +0000 UTC"
Jul 21 01:22:11.593138 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:11.593125    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15054h58m47.555955138s"
Jul 21 01:22:11.632241 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:11.632194    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d7e0f4a3fad0e13e8662877d91e1039.slice/crio-61c1b77b97a4cb36834192d8aea1cf1c52433805e4b447c2cc88571a8cce25f4 WatchSource:0}: Error finding container 61c1b77b97a4cb36834192d8aea1cf1c52433805e4b447c2cc88571a8cce25f4: Status 404 returned error can't find the container with id 61c1b77b97a4cb36834192d8aea1cf1c52433805e4b447c2cc88571a8cce25f4
Jul 21 01:22:11.632808 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:11.632793    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc1b51a7ee645186d00208039d5f8c77.slice/crio-40462ca4ecb082f0ec107d9847aeb6eb4b5c6936f038e6d6a3d2e9d202740622 WatchSource:0}: Error finding container 40462ca4ecb082f0ec107d9847aeb6eb4b5c6936f038e6d6a3d2e9d202740622: Status 404 returned error can't find the container with id 40462ca4ecb082f0ec107d9847aeb6eb4b5c6936f038e6d6a3d2e9d202740622
Jul 21 01:22:11.637110 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:11.637094    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 01:22:11.670850 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:11.670823    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-147.ec2.internal\" not found"
Jul 21 01:22:11.713019 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:11.712967    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-147.ec2.internal" event={"ID":"cc1b51a7ee645186d00208039d5f8c77","Type":"ContainerStarted","Data":"40462ca4ecb082f0ec107d9847aeb6eb4b5c6936f038e6d6a3d2e9d202740622"}
Jul 21 01:22:11.714060 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:11.714040    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-147.ec2.internal" event={"ID":"9d7e0f4a3fad0e13e8662877d91e1039","Type":"ContainerStarted","Data":"61c1b77b97a4cb36834192d8aea1cf1c52433805e4b447c2cc88571a8cce25f4"}
Jul 21 01:22:11.771269 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:11.771239    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-147.ec2.internal\" not found"
Jul 21 01:22:11.815549 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:11.815522    2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 01:22:11.882906 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:11.882849    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-147.ec2.internal"
Jul 21 01:22:11.894946 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:11.894931    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 01:22:11.895982 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:11.895970    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-147.ec2.internal"
Jul 21 01:22:11.905093 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:11.905074    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 01:22:12.566369 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.566332    2561 apiserver.go:52] "Watching apiserver"
Jul 21 01:22:12.574278 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.574255    2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 21 01:22:12.574704 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.574683    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-j6mqn","openshift-image-registry/node-ca-cfqrc","openshift-multus/network-metrics-daemon-6j8g9","openshift-network-diagnostics/network-check-target-fpg98","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2t6p","openshift-dns/node-resolver-4zvd6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-147.ec2.internal","openshift-multus/multus-48xjv","openshift-multus/multus-additional-cni-plugins-2gzwb","openshift-network-operator/iptables-alerter-gfrks","openshift-ovn-kubernetes/ovnkube-node-2p4wt","kube-system/global-pull-secret-syncer-n4nls","kube-system/konnectivity-agent-bmr7r","kube-system/kube-apiserver-proxy-ip-10-0-128-147.ec2.internal"]
Jul 21 01:22:12.576123 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.576084    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gfrks"
Jul 21 01:22:12.577507 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.577481    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bmr7r"
Jul 21 01:22:12.579401 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.578540    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6j8g9"
Jul 21 01:22:12.579401 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:12.578608    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6j8g9" podUID="8d45da68-d967-4df2-9623-2aec040ab204"
Jul 21 01:22:12.579401 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.578750    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 21 01:22:12.579401 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.578894    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 21 01:22:12.579401 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.578910    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 21 01:22:12.579401 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.579052    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vjtth\""
Jul 21 01:22:12.579733 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.579478    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpg98"
Jul 21 01:22:12.579733 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:12.579536    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpg98" podUID="85c43f1f-b8b3-49e1-ae09-d266df7facf3"
Jul 21 01:22:12.579837 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.579811    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 21 01:22:12.580080 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.580059    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 21 01:22:12.580160 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.580113    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6sn85\""
Jul 21 01:22:12.580808 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.580786    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2t6p"
Jul 21 01:22:12.582412 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.581965    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4zvd6"
Jul 21 01:22:12.583225 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.582988    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 21 01:22:12.583225 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.582988    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 21 01:22:12.583225 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.583055    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nkpjj\""
Jul 21 01:22:12.583225 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.583169    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2gzwb"
Jul 21 01:22:12.583464 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.583292    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 21 01:22:12.584713 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.583823    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 21 01:22:12.584713 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.584309    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7dllt\""
Jul 21 01:22:12.584713 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.584337    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 21 01:22:12.584713 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.584379    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 21 01:22:12.585085 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.585063    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.587288 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.586454    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cfqrc"
Jul 21 01:22:12.587642 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.587598    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vs6nd\""
Jul 21 01:22:12.588252 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.587599    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 21 01:22:12.588252 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.588244    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 21 01:22:12.588388 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.588319    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qnsn2\""
Jul 21 01:22:12.588388 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.588380    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 21 01:22:12.588547 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.588475    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 21 01:22:12.588598 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.588560    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 21 01:22:12.588953 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.588935    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 21 01:22:12.590051 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.589576    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 21 01:22:12.590051 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.589721    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6r5mg\""
Jul 21 01:22:12.590051 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.589790    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 21 01:22:12.590242 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.590126    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-j6mqn"
Jul 21 01:22:12.592168 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.592151    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 21 01:22:12.592545 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.592526    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 21 01:22:12.592649 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.592630    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.592868 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.592839    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-glftd\""
Jul 21 01:22:12.593772 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.593748    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 21 01:22:12.593871 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.593830    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4nls"
Jul 21 01:22:12.593935 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:12.593897    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4nls" podUID="2f652ed3-d73f-4b66-be66-dd7bdba8a027"
Jul 21 01:22:12.594126 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.594102    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2ce45c65-d65b-4537-8de3-1bc541026538-cnibin\") pod \"multus-additional-cni-plugins-2gzwb\" (UID: \"2ce45c65-d65b-4537-8de3-1bc541026538\") " pod="openshift-multus/multus-additional-cni-plugins-2gzwb"
Jul 21 01:22:12.594186 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.594141    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2ce45c65-d65b-4537-8de3-1bc541026538-os-release\") pod \"multus-additional-cni-plugins-2gzwb\" (UID: \"2ce45c65-d65b-4537-8de3-1bc541026538\") " pod="openshift-multus/multus-additional-cni-plugins-2gzwb"
Jul 21 01:22:12.594186 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.594167    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2ce45c65-d65b-4537-8de3-1bc541026538-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2gzwb\" (UID: \"2ce45c65-d65b-4537-8de3-1bc541026538\") " pod="openshift-multus/multus-additional-cni-plugins-2gzwb"
Jul 21 01:22:12.594323 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.594223    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2ce45c65-d65b-4537-8de3-1bc541026538-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2gzwb\" (UID: \"2ce45c65-d65b-4537-8de3-1bc541026538\") " pod="openshift-multus/multus-additional-cni-plugins-2gzwb"
Jul 21 01:22:12.594323 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.594257    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdnz4\" (UniqueName: \"kubernetes.io/projected/8d45da68-d967-4df2-9623-2aec040ab204-kube-api-access-jdnz4\") pod \"network-metrics-daemon-6j8g9\" (UID: \"8d45da68-d967-4df2-9623-2aec040ab204\") " pod="openshift-multus/network-metrics-daemon-6j8g9"
Jul 21 01:22:12.594323 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.594284    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/594f0782-5edf-4c98-ad04-2be6317c3a28-sys-fs\") pod \"aws-ebs-csi-driver-node-p2t6p\" (UID: \"594f0782-5edf-4c98-ad04-2be6317c3a28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2t6p"
Jul 21 01:22:12.594323 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.594305    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8ab4dce6-4fd1-4202-8c35-08253d62ae38-hosts-file\") pod \"node-resolver-4zvd6\" (UID: \"8ab4dce6-4fd1-4202-8c35-08253d62ae38\") " pod="openshift-dns/node-resolver-4zvd6"
Jul 21 01:22:12.594515 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.594345    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/594f0782-5edf-4c98-ad04-2be6317c3a28-socket-dir\") pod \"aws-ebs-csi-driver-node-p2t6p\" (UID: \"594f0782-5edf-4c98-ad04-2be6317c3a28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2t6p"
Jul 21 01:22:12.594515 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.594368    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/594f0782-5edf-4c98-ad04-2be6317c3a28-device-dir\") pod \"aws-ebs-csi-driver-node-p2t6p\" (UID: \"594f0782-5edf-4c98-ad04-2be6317c3a28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2t6p"
Jul 21 01:22:12.594515 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.594385    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2ce45c65-d65b-4537-8de3-1bc541026538-cni-binary-copy\") pod \"multus-additional-cni-plugins-2gzwb\" (UID: \"2ce45c65-d65b-4537-8de3-1bc541026538\") " pod="openshift-multus/multus-additional-cni-plugins-2gzwb"
Jul 21 01:22:12.594515 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.594401    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84hc4\" (UniqueName: \"kubernetes.io/projected/2ce45c65-d65b-4537-8de3-1bc541026538-kube-api-access-84hc4\") pod \"multus-additional-cni-plugins-2gzwb\" (UID: \"2ce45c65-d65b-4537-8de3-1bc541026538\") " pod="openshift-multus/multus-additional-cni-plugins-2gzwb"
Jul 21 01:22:12.594515 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.594424    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8tvn\" (UniqueName: \"kubernetes.io/projected/594f0782-5edf-4c98-ad04-2be6317c3a28-kube-api-access-m8tvn\") pod \"aws-ebs-csi-driver-node-p2t6p\" (UID: \"594f0782-5edf-4c98-ad04-2be6317c3a28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2t6p"
Jul 21 01:22:12.594515 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.594460    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ce45c65-d65b-4537-8de3-1bc541026538-system-cni-dir\") pod \"multus-additional-cni-plugins-2gzwb\" (UID: \"2ce45c65-d65b-4537-8de3-1bc541026538\") " pod="openshift-multus/multus-additional-cni-plugins-2gzwb"
Jul 21 01:22:12.594515 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.594487    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ab4dce6-4fd1-4202-8c35-08253d62ae38-tmp-dir\") pod \"node-resolver-4zvd6\" (UID: \"8ab4dce6-4fd1-4202-8c35-08253d62ae38\") " pod="openshift-dns/node-resolver-4zvd6"
Jul 21 01:22:12.594515 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.594508    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/74d1adf3-d3fe-43cd-9bcf-67e60150c965-iptables-alerter-script\") pod \"iptables-alerter-gfrks\" (UID: \"74d1adf3-d3fe-43cd-9bcf-67e60150c965\") " pod="openshift-network-operator/iptables-alerter-gfrks"
Jul 21 01:22:12.594901 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.594553    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j6zg\" (UniqueName: \"kubernetes.io/projected/8ab4dce6-4fd1-4202-8c35-08253d62ae38-kube-api-access-7j6zg\") pod \"node-resolver-4zvd6\" (UID: \"8ab4dce6-4fd1-4202-8c35-08253d62ae38\") " pod="openshift-dns/node-resolver-4zvd6"
Jul 21 01:22:12.594901 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.594585    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d45da68-d967-4df2-9623-2aec040ab204-metrics-certs\") pod \"network-metrics-daemon-6j8g9\" (UID: \"8d45da68-d967-4df2-9623-2aec040ab204\") " pod="openshift-multus/network-metrics-daemon-6j8g9"
Jul 21 01:22:12.594901 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.594610    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/74d1adf3-d3fe-43cd-9bcf-67e60150c965-host-slash\") pod \"iptables-alerter-gfrks\" (UID: \"74d1adf3-d3fe-43cd-9bcf-67e60150c965\") " pod="openshift-network-operator/iptables-alerter-gfrks"
Jul 21 01:22:12.594901 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.594636    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/941a0372-0f5c-4f67-a620-e1a1ee0de499-agent-certs\") pod \"konnectivity-agent-bmr7r\" (UID: \"941a0372-0f5c-4f67-a620-e1a1ee0de499\") " pod="kube-system/konnectivity-agent-bmr7r"
Jul 21 01:22:12.594901 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.594660    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/594f0782-5edf-4c98-ad04-2be6317c3a28-etc-selinux\") pod \"aws-ebs-csi-driver-node-p2t6p\" (UID: \"594f0782-5edf-4c98-ad04-2be6317c3a28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2t6p"
Jul 21 01:22:12.594901 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.594682    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2ce45c65-d65b-4537-8de3-1bc541026538-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2gzwb\" (UID: \"2ce45c65-d65b-4537-8de3-1bc541026538\") " pod="openshift-multus/multus-additional-cni-plugins-2gzwb"
Jul 21 01:22:12.594901 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.594701    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8925\" (UniqueName: \"kubernetes.io/projected/74d1adf3-d3fe-43cd-9bcf-67e60150c965-kube-api-access-m8925\") pod \"iptables-alerter-gfrks\" (UID: \"74d1adf3-d3fe-43cd-9bcf-67e60150c965\") " pod="openshift-network-operator/iptables-alerter-gfrks"
Jul 21 01:22:12.594901 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.594719    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/941a0372-0f5c-4f67-a620-e1a1ee0de499-konnectivity-ca\") pod \"konnectivity-agent-bmr7r\" (UID: \"941a0372-0f5c-4f67-a620-e1a1ee0de499\") " pod="kube-system/konnectivity-agent-bmr7r"
Jul 21 01:22:12.594901 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.594733    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69x5p\" (UniqueName: \"kubernetes.io/projected/85c43f1f-b8b3-49e1-ae09-d266df7facf3-kube-api-access-69x5p\") pod \"network-check-target-fpg98\" (UID: \"85c43f1f-b8b3-49e1-ae09-d266df7facf3\") " pod="openshift-network-diagnostics/network-check-target-fpg98"
Jul 21 01:22:12.594901 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.594760    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/594f0782-5edf-4c98-ad04-2be6317c3a28-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p2t6p\" (UID: \"594f0782-5edf-4c98-ad04-2be6317c3a28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2t6p"
Jul 21 01:22:12.594901 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.594784    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/594f0782-5edf-4c98-ad04-2be6317c3a28-registration-dir\") pod \"aws-ebs-csi-driver-node-p2t6p\" (UID: \"594f0782-5edf-4c98-ad04-2be6317c3a28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2t6p"
Jul 21 01:22:12.594901 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.594836    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lfhqh\""
Jul 21 01:22:12.596383 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.595987    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 21 01:22:12.596383 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.596245    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 21 01:22:12.596383 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.596320    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 21 01:22:12.596383 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.596358    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 21 01:22:12.596609 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.596428    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 21 01:22:12.596609 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.596511    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 21 01:22:12.597445 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.597411    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 01:22:12.616298 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.616279    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4xtc6"
Jul 21 01:22:12.624555 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.624535    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4xtc6"
Jul 21 01:22:12.655977 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.655957    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 01:22:12.684389 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.684364    2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 21 01:22:12.695828 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.695798    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48754e37-1055-42a7-9cc3-7c3b78735407-system-cni-dir\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.695967 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.695838    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/48754e37-1055-42a7-9cc3-7c3b78735407-multus-conf-dir\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.695967 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.695863    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/48754e37-1055-42a7-9cc3-7c3b78735407-multus-daemon-config\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.695967 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.695889    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48754e37-1055-42a7-9cc3-7c3b78735407-etc-kubernetes\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.695967 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.695913    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1701009a-d778-4d6d-b59f-e91ec4b13a60-systemd-units\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.695967 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.695934    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1701009a-d778-4d6d-b59f-e91ec4b13a60-run-ovn\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.695967 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.695957    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1701009a-d778-4d6d-b59f-e91ec4b13a60-host-cni-bin\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.696289 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.696004    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1701009a-d778-4d6d-b59f-e91ec4b13a60-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.696289 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.696056    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/594f0782-5edf-4c98-ad04-2be6317c3a28-registration-dir\") pod \"aws-ebs-csi-driver-node-p2t6p\" (UID: \"594f0782-5edf-4c98-ad04-2be6317c3a28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2t6p"
Jul 21 01:22:12.696289 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.696098    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2ce45c65-d65b-4537-8de3-1bc541026538-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2gzwb\" (UID: \"2ce45c65-d65b-4537-8de3-1bc541026538\") " pod="openshift-multus/multus-additional-cni-plugins-2gzwb"
Jul 21 01:22:12.696289 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.696123    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1701009a-d778-4d6d-b59f-e91ec4b13a60-run-systemd\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.696289 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.696158    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdnz4\" (UniqueName: \"kubernetes.io/projected/8d45da68-d967-4df2-9623-2aec040ab204-kube-api-access-jdnz4\") pod \"network-metrics-daemon-6j8g9\" (UID: \"8d45da68-d967-4df2-9623-2aec040ab204\") " pod="openshift-multus/network-metrics-daemon-6j8g9"
Jul 21 01:22:12.696289 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.696171    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/594f0782-5edf-4c98-ad04-2be6317c3a28-registration-dir\") pod \"aws-ebs-csi-driver-node-p2t6p\" (UID: \"594f0782-5edf-4c98-ad04-2be6317c3a28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2t6p"
Jul 21 01:22:12.696289 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.696182    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/48754e37-1055-42a7-9cc3-7c3b78735407-os-release\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.696289 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.696246    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1701009a-d778-4d6d-b59f-e91ec4b13a60-host-kubelet\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.696289 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.696278    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1701009a-d778-4d6d-b59f-e91ec4b13a60-host-slash\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.696715 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.696310    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1701009a-d778-4d6d-b59f-e91ec4b13a60-run-openvswitch\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.696715 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.696331    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1701009a-d778-4d6d-b59f-e91ec4b13a60-host-cni-netd\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.696715 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.696352    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2rvg\" (UniqueName: \"kubernetes.io/projected/f31b4061-dd8c-44fa-bd6c-601d8f373be2-kube-api-access-g2rvg\") pod \"node-ca-cfqrc\" (UID: \"f31b4061-dd8c-44fa-bd6c-601d8f373be2\") " pod="openshift-image-registry/node-ca-cfqrc"
Jul 21 01:22:12.696715 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.696374    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d8e410a3-7034-456a-91f9-a2f3dfae2621-etc-systemd\") pod \"tuned-j6mqn\" (UID: \"d8e410a3-7034-456a-91f9-a2f3dfae2621\") " pod="openshift-cluster-node-tuning-operator/tuned-j6mqn"
Jul 21 01:22:12.696715 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.696401    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/594f0782-5edf-4c98-ad04-2be6317c3a28-socket-dir\") pod \"aws-ebs-csi-driver-node-p2t6p\" (UID: \"594f0782-5edf-4c98-ad04-2be6317c3a28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2t6p"
Jul 21 01:22:12.696715 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.696425    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/594f0782-5edf-4c98-ad04-2be6317c3a28-device-dir\") pod \"aws-ebs-csi-driver-node-p2t6p\" (UID: \"594f0782-5edf-4c98-ad04-2be6317c3a28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2t6p"
Jul 21 01:22:12.696715 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.696450    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2ce45c65-d65b-4537-8de3-1bc541026538-cni-binary-copy\") pod \"multus-additional-cni-plugins-2gzwb\" (UID: \"2ce45c65-d65b-4537-8de3-1bc541026538\") " pod="openshift-multus/multus-additional-cni-plugins-2gzwb"
Jul 21 01:22:12.696715 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.696465    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84hc4\" (UniqueName: \"kubernetes.io/projected/2ce45c65-d65b-4537-8de3-1bc541026538-kube-api-access-84hc4\") pod \"multus-additional-cni-plugins-2gzwb\" (UID: \"2ce45c65-d65b-4537-8de3-1bc541026538\") " pod="openshift-multus/multus-additional-cni-plugins-2gzwb"
Jul 21 01:22:12.696715 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.696493    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htbv9\" (UniqueName: \"kubernetes.io/projected/48754e37-1055-42a7-9cc3-7c3b78735407-kube-api-access-htbv9\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.696715 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.696510    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d8e410a3-7034-456a-91f9-a2f3dfae2621-etc-sysconfig\") pod \"tuned-j6mqn\" (UID: \"d8e410a3-7034-456a-91f9-a2f3dfae2621\") " pod="openshift-cluster-node-tuning-operator/tuned-j6mqn"
Jul 21 01:22:12.696715 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.696532    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ce45c65-d65b-4537-8de3-1bc541026538-system-cni-dir\") pod \"multus-additional-cni-plugins-2gzwb\" (UID: \"2ce45c65-d65b-4537-8de3-1bc541026538\") " pod="openshift-multus/multus-additional-cni-plugins-2gzwb"
Jul 21 01:22:12.696715 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.696562    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/48754e37-1055-42a7-9cc3-7c3b78735407-host-var-lib-cni-bin\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.696715 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.696575    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/594f0782-5edf-4c98-ad04-2be6317c3a28-socket-dir\") pod \"aws-ebs-csi-driver-node-p2t6p\" (UID: \"594f0782-5edf-4c98-ad04-2be6317c3a28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2t6p"
Jul 21 01:22:12.696715 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.696581    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1701009a-d778-4d6d-b59f-e91ec4b13a60-var-lib-openvswitch\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.696715 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.696531    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/594f0782-5edf-4c98-ad04-2be6317c3a28-device-dir\") pod \"aws-ebs-csi-driver-node-p2t6p\" (UID: \"594f0782-5edf-4c98-ad04-2be6317c3a28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2t6p"
Jul 21 01:22:12.696715 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.696654    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ce45c65-d65b-4537-8de3-1bc541026538-system-cni-dir\") pod \"multus-additional-cni-plugins-2gzwb\" (UID: \"2ce45c65-d65b-4537-8de3-1bc541026538\") " pod="openshift-multus/multus-additional-cni-plugins-2gzwb"
Jul 21 01:22:12.697335 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.696678    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/48754e37-1055-42a7-9cc3-7c3b78735407-multus-socket-dir-parent\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.697335 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.696698    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f31b4061-dd8c-44fa-bd6c-601d8f373be2-host\") pod \"node-ca-cfqrc\" (UID: \"f31b4061-dd8c-44fa-bd6c-601d8f373be2\") " pod="openshift-image-registry/node-ca-cfqrc"
Jul 21 01:22:12.697335 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.696713    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d8e410a3-7034-456a-91f9-a2f3dfae2621-etc-tuned\") pod \"tuned-j6mqn\" (UID: \"d8e410a3-7034-456a-91f9-a2f3dfae2621\") " pod="openshift-cluster-node-tuning-operator/tuned-j6mqn"
Jul 21 01:22:12.697335 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.696726    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2ce45c65-d65b-4537-8de3-1bc541026538-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2gzwb\" (UID: \"2ce45c65-d65b-4537-8de3-1bc541026538\") " pod="openshift-multus/multus-additional-cni-plugins-2gzwb"
Jul 21 01:22:12.697335 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.697052    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2ce45c65-d65b-4537-8de3-1bc541026538-cni-binary-copy\") pod \"multus-additional-cni-plugins-2gzwb\" (UID: \"2ce45c65-d65b-4537-8de3-1bc541026538\") " pod="openshift-multus/multus-additional-cni-plugins-2gzwb"
Jul 21 01:22:12.697335 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.697175    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j6zg\" (UniqueName: \"kubernetes.io/projected/8ab4dce6-4fd1-4202-8c35-08253d62ae38-kube-api-access-7j6zg\") pod \"node-resolver-4zvd6\" (UID: \"8ab4dce6-4fd1-4202-8c35-08253d62ae38\") " pod="openshift-dns/node-resolver-4zvd6"
Jul 21 01:22:12.697335 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.697228    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/74d1adf3-d3fe-43cd-9bcf-67e60150c965-host-slash\") pod \"iptables-alerter-gfrks\" (UID: \"74d1adf3-d3fe-43cd-9bcf-67e60150c965\") " pod="openshift-network-operator/iptables-alerter-gfrks"
Jul 21 01:22:12.697335 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.697258    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/48754e37-1055-42a7-9cc3-7c3b78735407-hostroot\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.697335 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.697283    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2ce45c65-d65b-4537-8de3-1bc541026538-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2gzwb\" (UID: \"2ce45c65-d65b-4537-8de3-1bc541026538\") " pod="openshift-multus/multus-additional-cni-plugins-2gzwb"
Jul 21 01:22:12.697335 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.697307    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8925\" (UniqueName: \"kubernetes.io/projected/74d1adf3-d3fe-43cd-9bcf-67e60150c965-kube-api-access-m8925\") pod \"iptables-alerter-gfrks\" (UID: \"74d1adf3-d3fe-43cd-9bcf-67e60150c965\") " pod="openshift-network-operator/iptables-alerter-gfrks"
Jul 21 01:22:12.697335 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.697330    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/941a0372-0f5c-4f67-a620-e1a1ee0de499-konnectivity-ca\") pod \"konnectivity-agent-bmr7r\" (UID: \"941a0372-0f5c-4f67-a620-e1a1ee0de499\") " pod="kube-system/konnectivity-agent-bmr7r"
Jul 21 01:22:12.697712 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.697354    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48754e37-1055-42a7-9cc3-7c3b78735407-multus-cni-dir\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.697712 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.697374    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48754e37-1055-42a7-9cc3-7c3b78735407-host-var-lib-kubelet\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.697712 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.697394    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1701009a-d778-4d6d-b59f-e91ec4b13a60-host-run-netns\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.697712 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.697410    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1701009a-d778-4d6d-b59f-e91ec4b13a60-ovn-node-metrics-cert\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.697712 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.697452    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njsfp\" (UniqueName: \"kubernetes.io/projected/1701009a-d778-4d6d-b59f-e91ec4b13a60-kube-api-access-njsfp\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.697712 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.697480    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f652ed3-d73f-4b66-be66-dd7bdba8a027-original-pull-secret\") pod \"global-pull-secret-syncer-n4nls\" (UID: \"2f652ed3-d73f-4b66-be66-dd7bdba8a027\") " pod="kube-system/global-pull-secret-syncer-n4nls"
Jul 21 01:22:12.697712 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.697497    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69x5p\" (UniqueName: \"kubernetes.io/projected/85c43f1f-b8b3-49e1-ae09-d266df7facf3-kube-api-access-69x5p\") pod \"network-check-target-fpg98\" (UID: \"85c43f1f-b8b3-49e1-ae09-d266df7facf3\") " pod="openshift-network-diagnostics/network-check-target-fpg98"
Jul 21 01:22:12.697712 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.697511    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/594f0782-5edf-4c98-ad04-2be6317c3a28-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p2t6p\" (UID: \"594f0782-5edf-4c98-ad04-2be6317c3a28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2t6p"
Jul 21 01:22:12.697712 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.697526    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2ce45c65-d65b-4537-8de3-1bc541026538-cnibin\") pod \"multus-additional-cni-plugins-2gzwb\" (UID: \"2ce45c65-d65b-4537-8de3-1bc541026538\") " pod="openshift-multus/multus-additional-cni-plugins-2gzwb"
Jul 21 01:22:12.697712 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.697550    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2ce45c65-d65b-4537-8de3-1bc541026538-os-release\") pod \"multus-additional-cni-plugins-2gzwb\" (UID: \"2ce45c65-d65b-4537-8de3-1bc541026538\") " pod="openshift-multus/multus-additional-cni-plugins-2gzwb"
Jul 21 01:22:12.697712 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.697575    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2ce45c65-d65b-4537-8de3-1bc541026538-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2gzwb\" (UID: \"2ce45c65-d65b-4537-8de3-1bc541026538\") " pod="openshift-multus/multus-additional-cni-plugins-2gzwb"
Jul 21 01:22:12.697712 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.697598    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/48754e37-1055-42a7-9cc3-7c3b78735407-cni-binary-copy\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.697712 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.697628    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8e410a3-7034-456a-91f9-a2f3dfae2621-etc-kubernetes\") pod \"tuned-j6mqn\" (UID: \"d8e410a3-7034-456a-91f9-a2f3dfae2621\") " pod="openshift-cluster-node-tuning-operator/tuned-j6mqn"
Jul 21 01:22:12.697712 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.697642    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d8e410a3-7034-456a-91f9-a2f3dfae2621-sys\") pod \"tuned-j6mqn\" (UID: \"d8e410a3-7034-456a-91f9-a2f3dfae2621\") " pod="openshift-cluster-node-tuning-operator/tuned-j6mqn"
Jul 21 01:22:12.697712 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.697656    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/594f0782-5edf-4c98-ad04-2be6317c3a28-sys-fs\") pod \"aws-ebs-csi-driver-node-p2t6p\" (UID: \"594f0782-5edf-4c98-ad04-2be6317c3a28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2t6p"
Jul 21 01:22:12.697712 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.697692    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/48754e37-1055-42a7-9cc3-7c3b78735407-host-run-k8s-cni-cncf-io\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.698264 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.697710    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/48754e37-1055-42a7-9cc3-7c3b78735407-host-run-netns\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.698264 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.697734    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/48754e37-1055-42a7-9cc3-7c3b78735407-host-var-lib-cni-multus\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.698264 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.697754    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1701009a-d778-4d6d-b59f-e91ec4b13a60-host-run-ovn-kubernetes\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.698264 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.697770    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d8e410a3-7034-456a-91f9-a2f3dfae2621-etc-sysctl-conf\") pod \"tuned-j6mqn\" (UID: \"d8e410a3-7034-456a-91f9-a2f3dfae2621\") " pod="openshift-cluster-node-tuning-operator/tuned-j6mqn"
Jul 21 01:22:12.698264 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.697783    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d8e410a3-7034-456a-91f9-a2f3dfae2621-lib-modules\") pod \"tuned-j6mqn\" (UID: \"d8e410a3-7034-456a-91f9-a2f3dfae2621\") " pod="openshift-cluster-node-tuning-operator/tuned-j6mqn"
Jul 21 01:22:12.698264 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.697796    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8e410a3-7034-456a-91f9-a2f3dfae2621-var-lib-kubelet\") pod \"tuned-j6mqn\" (UID: \"d8e410a3-7034-456a-91f9-a2f3dfae2621\") " pod="openshift-cluster-node-tuning-operator/tuned-j6mqn"
Jul 21 01:22:12.698264 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.697810    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8ab4dce6-4fd1-4202-8c35-08253d62ae38-hosts-file\") pod \"node-resolver-4zvd6\" (UID: \"8ab4dce6-4fd1-4202-8c35-08253d62ae38\") " pod="openshift-dns/node-resolver-4zvd6"
Jul 21 01:22:12.698264 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.697824    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1701009a-d778-4d6d-b59f-e91ec4b13a60-etc-openvswitch\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.698264 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.697838    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1701009a-d778-4d6d-b59f-e91ec4b13a60-log-socket\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.698264 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.697853    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2f652ed3-d73f-4b66-be66-dd7bdba8a027-kubelet-config\") pod \"global-pull-secret-syncer-n4nls\" (UID: \"2f652ed3-d73f-4b66-be66-dd7bdba8a027\") " pod="kube-system/global-pull-secret-syncer-n4nls"
Jul 21 01:22:12.698264 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.697870    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2f652ed3-d73f-4b66-be66-dd7bdba8a027-dbus\") pod \"global-pull-secret-syncer-n4nls\" (UID: \"2f652ed3-d73f-4b66-be66-dd7bdba8a027\") " pod="kube-system/global-pull-secret-syncer-n4nls"
Jul 21 01:22:12.698264 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.697894    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8tvn\" (UniqueName: \"kubernetes.io/projected/594f0782-5edf-4c98-ad04-2be6317c3a28-kube-api-access-m8tvn\") pod \"aws-ebs-csi-driver-node-p2t6p\" (UID: \"594f0782-5edf-4c98-ad04-2be6317c3a28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2t6p"
Jul 21 01:22:12.698264 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.697909    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/48754e37-1055-42a7-9cc3-7c3b78735407-host-run-multus-certs\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.698264 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.697933    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1701009a-d778-4d6d-b59f-e91ec4b13a60-node-log\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.698264 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.697947    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1701009a-d778-4d6d-b59f-e91ec4b13a60-ovnkube-config\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.698264 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.697975    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8e410a3-7034-456a-91f9-a2f3dfae2621-tmp\") pod \"tuned-j6mqn\" (UID: \"d8e410a3-7034-456a-91f9-a2f3dfae2621\") " pod="openshift-cluster-node-tuning-operator/tuned-j6mqn"
Jul 21 01:22:12.698264 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.697992    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ab4dce6-4fd1-4202-8c35-08253d62ae38-tmp-dir\") pod \"node-resolver-4zvd6\" (UID: \"8ab4dce6-4fd1-4202-8c35-08253d62ae38\") " pod="openshift-dns/node-resolver-4zvd6"
Jul 21 01:22:12.698845 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.698017    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/74d1adf3-d3fe-43cd-9bcf-67e60150c965-iptables-alerter-script\") pod \"iptables-alerter-gfrks\" (UID: \"74d1adf3-d3fe-43cd-9bcf-67e60150c965\") " pod="openshift-network-operator/iptables-alerter-gfrks"
Jul 21 01:22:12.698845 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.698041    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1701009a-d778-4d6d-b59f-e91ec4b13a60-ovnkube-script-lib\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.698845 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.698060    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d8e410a3-7034-456a-91f9-a2f3dfae2621-etc-modprobe-d\") pod \"tuned-j6mqn\" (UID: \"d8e410a3-7034-456a-91f9-a2f3dfae2621\") " pod="openshift-cluster-node-tuning-operator/tuned-j6mqn"
Jul 21 01:22:12.698845 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.698074    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d8e410a3-7034-456a-91f9-a2f3dfae2621-etc-sysctl-d\") pod \"tuned-j6mqn\" (UID: \"d8e410a3-7034-456a-91f9-a2f3dfae2621\") " pod="openshift-cluster-node-tuning-operator/tuned-j6mqn"
Jul 21 01:22:12.698845 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.698089    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d45da68-d967-4df2-9623-2aec040ab204-metrics-certs\") pod \"network-metrics-daemon-6j8g9\" (UID: \"8d45da68-d967-4df2-9623-2aec040ab204\") " pod="openshift-multus/network-metrics-daemon-6j8g9"
Jul 21 01:22:12.698845 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.698106    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/941a0372-0f5c-4f67-a620-e1a1ee0de499-agent-certs\") pod \"konnectivity-agent-bmr7r\" (UID: \"941a0372-0f5c-4f67-a620-e1a1ee0de499\") " pod="kube-system/konnectivity-agent-bmr7r"
Jul 21 01:22:12.698845 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.698119    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/48754e37-1055-42a7-9cc3-7c3b78735407-cnibin\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.698845 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.698134    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1701009a-d778-4d6d-b59f-e91ec4b13a60-env-overrides\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.698845 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.698147    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f31b4061-dd8c-44fa-bd6c-601d8f373be2-serviceca\") pod \"node-ca-cfqrc\" (UID: \"f31b4061-dd8c-44fa-bd6c-601d8f373be2\") " pod="openshift-image-registry/node-ca-cfqrc"
Jul 21 01:22:12.698845 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.698165    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d8e410a3-7034-456a-91f9-a2f3dfae2621-host\") pod \"tuned-j6mqn\" (UID: \"d8e410a3-7034-456a-91f9-a2f3dfae2621\") " pod="openshift-cluster-node-tuning-operator/tuned-j6mqn"
Jul 21 01:22:12.698845 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.698188    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/594f0782-5edf-4c98-ad04-2be6317c3a28-etc-selinux\") pod \"aws-ebs-csi-driver-node-p2t6p\" (UID: \"594f0782-5edf-4c98-ad04-2be6317c3a28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2t6p"
Jul 21 01:22:12.698845 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.698225    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d8e410a3-7034-456a-91f9-a2f3dfae2621-run\") pod \"tuned-j6mqn\" (UID: \"d8e410a3-7034-456a-91f9-a2f3dfae2621\") " pod="openshift-cluster-node-tuning-operator/tuned-j6mqn"
Jul 21 01:22:12.698845 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.698248    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwvlh\" (UniqueName: \"kubernetes.io/projected/d8e410a3-7034-456a-91f9-a2f3dfae2621-kube-api-access-mwvlh\") pod \"tuned-j6mqn\" (UID: \"d8e410a3-7034-456a-91f9-a2f3dfae2621\") " pod="openshift-cluster-node-tuning-operator/tuned-j6mqn"
Jul 21 01:22:12.698845 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.698282    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/74d1adf3-d3fe-43cd-9bcf-67e60150c965-host-slash\") pod \"iptables-alerter-gfrks\" (UID: \"74d1adf3-d3fe-43cd-9bcf-67e60150c965\") " pod="openshift-network-operator/iptables-alerter-gfrks"
Jul 21 01:22:12.698845 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.698378    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8ab4dce6-4fd1-4202-8c35-08253d62ae38-hosts-file\") pod \"node-resolver-4zvd6\" (UID: \"8ab4dce6-4fd1-4202-8c35-08253d62ae38\") " pod="openshift-dns/node-resolver-4zvd6"
Jul 21 01:22:12.698845 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.698392    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2ce45c65-d65b-4537-8de3-1bc541026538-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2gzwb\" (UID: \"2ce45c65-d65b-4537-8de3-1bc541026538\") " pod="openshift-multus/multus-additional-cni-plugins-2gzwb"
Jul 21 01:22:12.698845 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.698659    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ab4dce6-4fd1-4202-8c35-08253d62ae38-tmp-dir\") pod \"node-resolver-4zvd6\" (UID: \"8ab4dce6-4fd1-4202-8c35-08253d62ae38\") " pod="openshift-dns/node-resolver-4zvd6"
Jul 21 01:22:12.699451 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.698849    2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 21 01:22:12.699451 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.698881    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/594f0782-5edf-4c98-ad04-2be6317c3a28-etc-selinux\") pod \"aws-ebs-csi-driver-node-p2t6p\" (UID: \"594f0782-5edf-4c98-ad04-2be6317c3a28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2t6p"
Jul 21 01:22:12.699451 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.699160    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/594f0782-5edf-4c98-ad04-2be6317c3a28-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p2t6p\" (UID: \"594f0782-5edf-4c98-ad04-2be6317c3a28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2t6p"
Jul 21 01:22:12.699451 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.699174    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/594f0782-5edf-4c98-ad04-2be6317c3a28-sys-fs\") pod \"aws-ebs-csi-driver-node-p2t6p\" (UID: \"594f0782-5edf-4c98-ad04-2be6317c3a28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2t6p"
Jul 21 01:22:12.699451 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.699190    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2ce45c65-d65b-4537-8de3-1bc541026538-cnibin\") pod \"multus-additional-cni-plugins-2gzwb\" (UID: \"2ce45c65-d65b-4537-8de3-1bc541026538\") " pod="openshift-multus/multus-additional-cni-plugins-2gzwb"
Jul 21 01:22:12.699451 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.699228    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/941a0372-0f5c-4f67-a620-e1a1ee0de499-konnectivity-ca\") pod \"konnectivity-agent-bmr7r\" (UID: \"941a0372-0f5c-4f67-a620-e1a1ee0de499\") " pod="kube-system/konnectivity-agent-bmr7r"
Jul 21 01:22:12.699451 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.699351    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2ce45c65-d65b-4537-8de3-1bc541026538-os-release\") pod \"multus-additional-cni-plugins-2gzwb\" (UID: \"2ce45c65-d65b-4537-8de3-1bc541026538\") " pod="openshift-multus/multus-additional-cni-plugins-2gzwb"
Jul 21 01:22:12.699451 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:12.699404    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:22:12.699451 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.699433    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/74d1adf3-d3fe-43cd-9bcf-67e60150c965-iptables-alerter-script\") pod \"iptables-alerter-gfrks\" (UID: \"74d1adf3-d3fe-43cd-9bcf-67e60150c965\") " pod="openshift-network-operator/iptables-alerter-gfrks"
Jul 21 01:22:12.699846 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:12.699506    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d45da68-d967-4df2-9623-2aec040ab204-metrics-certs podName:8d45da68-d967-4df2-9623-2aec040ab204 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:13.19948688 +0000 UTC m=+2.929855548 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d45da68-d967-4df2-9623-2aec040ab204-metrics-certs") pod "network-metrics-daemon-6j8g9" (UID: "8d45da68-d967-4df2-9623-2aec040ab204") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:22:12.699846 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.699533    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2ce45c65-d65b-4537-8de3-1bc541026538-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2gzwb\" (UID: \"2ce45c65-d65b-4537-8de3-1bc541026538\") " pod="openshift-multus/multus-additional-cni-plugins-2gzwb"
Jul 21 01:22:12.703349 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.703322    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/941a0372-0f5c-4f67-a620-e1a1ee0de499-agent-certs\") pod \"konnectivity-agent-bmr7r\" (UID: \"941a0372-0f5c-4f67-a620-e1a1ee0de499\") " pod="kube-system/konnectivity-agent-bmr7r"
Jul 21 01:22:12.705526 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.705503    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84hc4\" (UniqueName: \"kubernetes.io/projected/2ce45c65-d65b-4537-8de3-1bc541026538-kube-api-access-84hc4\") pod \"multus-additional-cni-plugins-2gzwb\" (UID: \"2ce45c65-d65b-4537-8de3-1bc541026538\") " pod="openshift-multus/multus-additional-cni-plugins-2gzwb"
Jul 21 01:22:12.705729 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:12.705658    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 01:22:12.705729 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:12.705687    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 01:22:12.705729 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:12.705702    2561 projected.go:196] Error preparing data for projected volume kube-api-access-69x5p for pod openshift-network-diagnostics/network-check-target-fpg98: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:22:12.705950 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:12.705817    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85c43f1f-b8b3-49e1-ae09-d266df7facf3-kube-api-access-69x5p podName:85c43f1f-b8b3-49e1-ae09-d266df7facf3 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:13.205790382 +0000 UTC m=+2.936159044 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-69x5p" (UniqueName: "kubernetes.io/projected/85c43f1f-b8b3-49e1-ae09-d266df7facf3-kube-api-access-69x5p") pod "network-check-target-fpg98" (UID: "85c43f1f-b8b3-49e1-ae09-d266df7facf3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:22:12.706806 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.706778    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8925\" (UniqueName: \"kubernetes.io/projected/74d1adf3-d3fe-43cd-9bcf-67e60150c965-kube-api-access-m8925\") pod \"iptables-alerter-gfrks\" (UID: \"74d1adf3-d3fe-43cd-9bcf-67e60150c965\") " pod="openshift-network-operator/iptables-alerter-gfrks"
Jul 21 01:22:12.708677 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.708652    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdnz4\" (UniqueName: \"kubernetes.io/projected/8d45da68-d967-4df2-9623-2aec040ab204-kube-api-access-jdnz4\") pod \"network-metrics-daemon-6j8g9\" (UID: \"8d45da68-d967-4df2-9623-2aec040ab204\") " pod="openshift-multus/network-metrics-daemon-6j8g9"
Jul 21 01:22:12.708960 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.708806    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j6zg\" (UniqueName: \"kubernetes.io/projected/8ab4dce6-4fd1-4202-8c35-08253d62ae38-kube-api-access-7j6zg\") pod \"node-resolver-4zvd6\" (UID: \"8ab4dce6-4fd1-4202-8c35-08253d62ae38\") " pod="openshift-dns/node-resolver-4zvd6"
Jul 21 01:22:12.715261 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.715238    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8tvn\" (UniqueName: \"kubernetes.io/projected/594f0782-5edf-4c98-ad04-2be6317c3a28-kube-api-access-m8tvn\") pod \"aws-ebs-csi-driver-node-p2t6p\" (UID: \"594f0782-5edf-4c98-ad04-2be6317c3a28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2t6p"
Jul 21 01:22:12.799454 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.799420    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/48754e37-1055-42a7-9cc3-7c3b78735407-os-release\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.799454 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.799457    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1701009a-d778-4d6d-b59f-e91ec4b13a60-host-kubelet\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.799685 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.799480    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1701009a-d778-4d6d-b59f-e91ec4b13a60-host-slash\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.799685 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.799502    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1701009a-d778-4d6d-b59f-e91ec4b13a60-run-openvswitch\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.799685 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.799523    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1701009a-d778-4d6d-b59f-e91ec4b13a60-host-cni-netd\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.799685 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.799553    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/48754e37-1055-42a7-9cc3-7c3b78735407-os-release\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.799685 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.799555    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1701009a-d778-4d6d-b59f-e91ec4b13a60-host-slash\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.799685 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.799577    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1701009a-d778-4d6d-b59f-e91ec4b13a60-run-openvswitch\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.799685 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.799563    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1701009a-d778-4d6d-b59f-e91ec4b13a60-host-cni-netd\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.799685 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.799555    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1701009a-d778-4d6d-b59f-e91ec4b13a60-host-kubelet\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.799685 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.799633    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2rvg\" (UniqueName: \"kubernetes.io/projected/f31b4061-dd8c-44fa-bd6c-601d8f373be2-kube-api-access-g2rvg\") pod \"node-ca-cfqrc\" (UID: \"f31b4061-dd8c-44fa-bd6c-601d8f373be2\") " pod="openshift-image-registry/node-ca-cfqrc"
Jul 21 01:22:12.799685 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.799654    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d8e410a3-7034-456a-91f9-a2f3dfae2621-etc-systemd\") pod \"tuned-j6mqn\" (UID: \"d8e410a3-7034-456a-91f9-a2f3dfae2621\") " pod="openshift-cluster-node-tuning-operator/tuned-j6mqn"
Jul 21 01:22:12.799685 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.799676    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htbv9\" (UniqueName: \"kubernetes.io/projected/48754e37-1055-42a7-9cc3-7c3b78735407-kube-api-access-htbv9\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.799685 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.799690    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d8e410a3-7034-456a-91f9-a2f3dfae2621-etc-sysconfig\") pod \"tuned-j6mqn\" (UID: \"d8e410a3-7034-456a-91f9-a2f3dfae2621\") " pod="openshift-cluster-node-tuning-operator/tuned-j6mqn"
Jul 21 01:22:12.800125 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.799711    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/48754e37-1055-42a7-9cc3-7c3b78735407-host-var-lib-cni-bin\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.800125 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.799735    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1701009a-d778-4d6d-b59f-e91ec4b13a60-var-lib-openvswitch\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.800125 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.799738    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d8e410a3-7034-456a-91f9-a2f3dfae2621-etc-systemd\") pod \"tuned-j6mqn\" (UID: \"d8e410a3-7034-456a-91f9-a2f3dfae2621\") " pod="openshift-cluster-node-tuning-operator/tuned-j6mqn"
Jul 21 01:22:12.800125 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.799758    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/48754e37-1055-42a7-9cc3-7c3b78735407-multus-socket-dir-parent\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.800125 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.799781    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f31b4061-dd8c-44fa-bd6c-601d8f373be2-host\") pod \"node-ca-cfqrc\" (UID: \"f31b4061-dd8c-44fa-bd6c-601d8f373be2\") " pod="openshift-image-registry/node-ca-cfqrc"
Jul 21 01:22:12.800125 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.799788    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d8e410a3-7034-456a-91f9-a2f3dfae2621-etc-sysconfig\") pod \"tuned-j6mqn\" (UID: \"d8e410a3-7034-456a-91f9-a2f3dfae2621\") " pod="openshift-cluster-node-tuning-operator/tuned-j6mqn"
Jul 21 01:22:12.800125 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.799804    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d8e410a3-7034-456a-91f9-a2f3dfae2621-etc-tuned\") pod \"tuned-j6mqn\" (UID: \"d8e410a3-7034-456a-91f9-a2f3dfae2621\") " pod="openshift-cluster-node-tuning-operator/tuned-j6mqn"
Jul 21 01:22:12.800125 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.799844    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/48754e37-1055-42a7-9cc3-7c3b78735407-hostroot\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.800125 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.799860    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48754e37-1055-42a7-9cc3-7c3b78735407-multus-cni-dir\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.800125 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.799875    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48754e37-1055-42a7-9cc3-7c3b78735407-host-var-lib-kubelet\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.800125 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.799889    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1701009a-d778-4d6d-b59f-e91ec4b13a60-host-run-netns\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.800125 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.799901    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/48754e37-1055-42a7-9cc3-7c3b78735407-multus-socket-dir-parent\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.800125 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.799905    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1701009a-d778-4d6d-b59f-e91ec4b13a60-ovn-node-metrics-cert\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.800125 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.799944    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njsfp\" (UniqueName: \"kubernetes.io/projected/1701009a-d778-4d6d-b59f-e91ec4b13a60-kube-api-access-njsfp\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.800125 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.799972    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f652ed3-d73f-4b66-be66-dd7bdba8a027-original-pull-secret\") pod \"global-pull-secret-syncer-n4nls\" (UID: \"2f652ed3-d73f-4b66-be66-dd7bdba8a027\") " pod="kube-system/global-pull-secret-syncer-n4nls"
Jul 21 01:22:12.800125 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800015    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/48754e37-1055-42a7-9cc3-7c3b78735407-cni-binary-copy\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.800125 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800042    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8e410a3-7034-456a-91f9-a2f3dfae2621-etc-kubernetes\") pod \"tuned-j6mqn\" (UID: \"d8e410a3-7034-456a-91f9-a2f3dfae2621\") " pod="openshift-cluster-node-tuning-operator/tuned-j6mqn"
Jul 21 01:22:12.800125 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800047    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/48754e37-1055-42a7-9cc3-7c3b78735407-host-var-lib-cni-bin\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.800921 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800077    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d8e410a3-7034-456a-91f9-a2f3dfae2621-sys\") pod \"tuned-j6mqn\" (UID: \"d8e410a3-7034-456a-91f9-a2f3dfae2621\") " pod="openshift-cluster-node-tuning-operator/tuned-j6mqn"
Jul 21 01:22:12.800921 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800094    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8e410a3-7034-456a-91f9-a2f3dfae2621-etc-kubernetes\") pod \"tuned-j6mqn\" (UID: \"d8e410a3-7034-456a-91f9-a2f3dfae2621\") " pod="openshift-cluster-node-tuning-operator/tuned-j6mqn"
Jul 21 01:22:12.800921 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800104    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/48754e37-1055-42a7-9cc3-7c3b78735407-host-run-k8s-cni-cncf-io\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.800921 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800129    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/48754e37-1055-42a7-9cc3-7c3b78735407-host-run-netns\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.800921 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800153    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/48754e37-1055-42a7-9cc3-7c3b78735407-host-var-lib-cni-multus\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.800921 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800177    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1701009a-d778-4d6d-b59f-e91ec4b13a60-host-run-ovn-kubernetes\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.800921 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800227    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d8e410a3-7034-456a-91f9-a2f3dfae2621-etc-sysctl-conf\") pod \"tuned-j6mqn\" (UID: \"d8e410a3-7034-456a-91f9-a2f3dfae2621\") " pod="openshift-cluster-node-tuning-operator/tuned-j6mqn"
Jul 21 01:22:12.800921 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:12.800238    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 01:22:12.800921 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800251    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d8e410a3-7034-456a-91f9-a2f3dfae2621-lib-modules\") pod \"tuned-j6mqn\" (UID: \"d8e410a3-7034-456a-91f9-a2f3dfae2621\") " pod="openshift-cluster-node-tuning-operator/tuned-j6mqn"
Jul 21 01:22:12.800921 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800276    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8e410a3-7034-456a-91f9-a2f3dfae2621-var-lib-kubelet\") pod \"tuned-j6mqn\" (UID: \"d8e410a3-7034-456a-91f9-a2f3dfae2621\") " pod="openshift-cluster-node-tuning-operator/tuned-j6mqn"
Jul 21 01:22:12.800921 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800016    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1701009a-d778-4d6d-b59f-e91ec4b13a60-var-lib-openvswitch\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.800921 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:12.800307    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f652ed3-d73f-4b66-be66-dd7bdba8a027-original-pull-secret podName:2f652ed3-d73f-4b66-be66-dd7bdba8a027 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:13.300287434 +0000 UTC m=+3.030656096 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2f652ed3-d73f-4b66-be66-dd7bdba8a027-original-pull-secret") pod "global-pull-secret-syncer-n4nls" (UID: "2f652ed3-d73f-4b66-be66-dd7bdba8a027") : object "kube-system"/"original-pull-secret" not registered
Jul 21 01:22:12.800921 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800315    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d8e410a3-7034-456a-91f9-a2f3dfae2621-sys\") pod \"tuned-j6mqn\" (UID: \"d8e410a3-7034-456a-91f9-a2f3dfae2621\") " pod="openshift-cluster-node-tuning-operator/tuned-j6mqn"
Jul 21 01:22:12.800921 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800320    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/48754e37-1055-42a7-9cc3-7c3b78735407-host-var-lib-cni-multus\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.800921 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800272    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/48754e37-1055-42a7-9cc3-7c3b78735407-host-run-netns\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.800921 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800363    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/48754e37-1055-42a7-9cc3-7c3b78735407-host-run-k8s-cni-cncf-io\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.800921 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800410    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1701009a-d778-4d6d-b59f-e91ec4b13a60-host-run-ovn-kubernetes\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.801734 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800464    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d8e410a3-7034-456a-91f9-a2f3dfae2621-etc-sysctl-conf\") pod \"tuned-j6mqn\" (UID: \"d8e410a3-7034-456a-91f9-a2f3dfae2621\") " pod="openshift-cluster-node-tuning-operator/tuned-j6mqn"
Jul 21 01:22:12.801734 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800471    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1701009a-d778-4d6d-b59f-e91ec4b13a60-etc-openvswitch\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.801734 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800535    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f31b4061-dd8c-44fa-bd6c-601d8f373be2-host\") pod \"node-ca-cfqrc\" (UID: \"f31b4061-dd8c-44fa-bd6c-601d8f373be2\") " pod="openshift-image-registry/node-ca-cfqrc"
Jul 21 01:22:12.801734 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800608    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48754e37-1055-42a7-9cc3-7c3b78735407-host-var-lib-kubelet\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.801734 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800612    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d8e410a3-7034-456a-91f9-a2f3dfae2621-lib-modules\") pod \"tuned-j6mqn\" (UID: \"d8e410a3-7034-456a-91f9-a2f3dfae2621\") " pod="openshift-cluster-node-tuning-operator/tuned-j6mqn"
Jul 21 01:22:12.801734 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800505    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/48754e37-1055-42a7-9cc3-7c3b78735407-hostroot\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.801734 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800656    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1701009a-d778-4d6d-b59f-e91ec4b13a60-log-socket\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.801734 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800674    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1701009a-d778-4d6d-b59f-e91ec4b13a60-etc-openvswitch\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.801734 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800680    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2f652ed3-d73f-4b66-be66-dd7bdba8a027-kubelet-config\") pod \"global-pull-secret-syncer-n4nls\" (UID: \"2f652ed3-d73f-4b66-be66-dd7bdba8a027\") " pod="kube-system/global-pull-secret-syncer-n4nls"
Jul 21 01:22:12.801734 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800711    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2f652ed3-d73f-4b66-be66-dd7bdba8a027-dbus\") pod \"global-pull-secret-syncer-n4nls\" (UID: \"2f652ed3-d73f-4b66-be66-dd7bdba8a027\") " pod="kube-system/global-pull-secret-syncer-n4nls"
Jul 21 01:22:12.801734 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800723    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2f652ed3-d73f-4b66-be66-dd7bdba8a027-kubelet-config\") pod \"global-pull-secret-syncer-n4nls\" (UID: \"2f652ed3-d73f-4b66-be66-dd7bdba8a027\") " pod="kube-system/global-pull-secret-syncer-n4nls"
Jul 21 01:22:12.801734 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800739    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/48754e37-1055-42a7-9cc3-7c3b78735407-host-run-multus-certs\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.801734 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800765    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1701009a-d778-4d6d-b59f-e91ec4b13a60-node-log\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.801734 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800775    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2f652ed3-d73f-4b66-be66-dd7bdba8a027-dbus\") pod \"global-pull-secret-syncer-n4nls\" (UID: \"2f652ed3-d73f-4b66-be66-dd7bdba8a027\") " pod="kube-system/global-pull-secret-syncer-n4nls"
Jul 21 01:22:12.801734 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800788    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1701009a-d778-4d6d-b59f-e91ec4b13a60-ovnkube-config\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.801734 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800810    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8e410a3-7034-456a-91f9-a2f3dfae2621-tmp\") pod \"tuned-j6mqn\" (UID: \"d8e410a3-7034-456a-91f9-a2f3dfae2621\") " pod="openshift-cluster-node-tuning-operator/tuned-j6mqn"
Jul 21 01:22:12.801734 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800821    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1701009a-d778-4d6d-b59f-e91ec4b13a60-host-run-netns\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.801734 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800836    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1701009a-d778-4d6d-b59f-e91ec4b13a60-ovnkube-script-lib\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.802618 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800855    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/48754e37-1055-42a7-9cc3-7c3b78735407-host-run-multus-certs\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.802618 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800860    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d8e410a3-7034-456a-91f9-a2f3dfae2621-etc-modprobe-d\") pod \"tuned-j6mqn\" (UID: \"d8e410a3-7034-456a-91f9-a2f3dfae2621\") " pod="openshift-cluster-node-tuning-operator/tuned-j6mqn"
Jul 21 01:22:12.802618 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800886    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d8e410a3-7034-456a-91f9-a2f3dfae2621-etc-sysctl-d\") pod \"tuned-j6mqn\" (UID: \"d8e410a3-7034-456a-91f9-a2f3dfae2621\") " pod="openshift-cluster-node-tuning-operator/tuned-j6mqn"
Jul 21 01:22:12.802618 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800890    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1701009a-d778-4d6d-b59f-e91ec4b13a60-log-socket\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.802618 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800858    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1701009a-d778-4d6d-b59f-e91ec4b13a60-node-log\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.802618 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800933    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/48754e37-1055-42a7-9cc3-7c3b78735407-cnibin\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.802618 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800957    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1701009a-d778-4d6d-b59f-e91ec4b13a60-env-overrides\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.802618 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800980    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f31b4061-dd8c-44fa-bd6c-601d8f373be2-serviceca\") pod \"node-ca-cfqrc\" (UID: \"f31b4061-dd8c-44fa-bd6c-601d8f373be2\") " pod="openshift-image-registry/node-ca-cfqrc"
Jul 21 01:22:12.802618 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.801003    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d8e410a3-7034-456a-91f9-a2f3dfae2621-host\") pod \"tuned-j6mqn\" (UID: \"d8e410a3-7034-456a-91f9-a2f3dfae2621\") " pod="openshift-cluster-node-tuning-operator/tuned-j6mqn"
Jul 21 01:22:12.802618 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.801034    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d8e410a3-7034-456a-91f9-a2f3dfae2621-run\") pod \"tuned-j6mqn\" (UID: \"d8e410a3-7034-456a-91f9-a2f3dfae2621\") " pod="openshift-cluster-node-tuning-operator/tuned-j6mqn"
Jul 21 01:22:12.802618 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.801058    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwvlh\" (UniqueName: \"kubernetes.io/projected/d8e410a3-7034-456a-91f9-a2f3dfae2621-kube-api-access-mwvlh\") pod \"tuned-j6mqn\" (UID: \"d8e410a3-7034-456a-91f9-a2f3dfae2621\") " pod="openshift-cluster-node-tuning-operator/tuned-j6mqn"
Jul 21 01:22:12.802618 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.801101    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48754e37-1055-42a7-9cc3-7c3b78735407-system-cni-dir\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.802618 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.801125    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/48754e37-1055-42a7-9cc3-7c3b78735407-multus-conf-dir\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.802618 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.801164    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/48754e37-1055-42a7-9cc3-7c3b78735407-multus-daemon-config\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.802618 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.801190    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d8e410a3-7034-456a-91f9-a2f3dfae2621-host\") pod \"tuned-j6mqn\" (UID: \"d8e410a3-7034-456a-91f9-a2f3dfae2621\") " pod="openshift-cluster-node-tuning-operator/tuned-j6mqn"
Jul 21 01:22:12.802618 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.801229    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48754e37-1055-42a7-9cc3-7c3b78735407-etc-kubernetes\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.802618 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.801257    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1701009a-d778-4d6d-b59f-e91ec4b13a60-systemd-units\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.802618 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.801282    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1701009a-d778-4d6d-b59f-e91ec4b13a60-run-ovn\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.803330 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.801313    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1701009a-d778-4d6d-b59f-e91ec4b13a60-host-cni-bin\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.803330 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.801339    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1701009a-d778-4d6d-b59f-e91ec4b13a60-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.803330 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.801359    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1701009a-d778-4d6d-b59f-e91ec4b13a60-ovnkube-config\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.803330 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.801367    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1701009a-d778-4d6d-b59f-e91ec4b13a60-run-systemd\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.803330 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.801411    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/48754e37-1055-42a7-9cc3-7c3b78735407-cnibin\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.803330 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.801447    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1701009a-d778-4d6d-b59f-e91ec4b13a60-systemd-units\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.803330 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.801453    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/48754e37-1055-42a7-9cc3-7c3b78735407-multus-conf-dir\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.803330 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.801494    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d8e410a3-7034-456a-91f9-a2f3dfae2621-run\") pod \"tuned-j6mqn\" (UID: \"d8e410a3-7034-456a-91f9-a2f3dfae2621\") " pod="openshift-cluster-node-tuning-operator/tuned-j6mqn"
Jul 21 01:22:12.803330 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.801494    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1701009a-d778-4d6d-b59f-e91ec4b13a60-host-cni-bin\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.803330 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.801529    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1701009a-d778-4d6d-b59f-e91ec4b13a60-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.803330 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.801568    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1701009a-d778-4d6d-b59f-e91ec4b13a60-env-overrides\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.803330 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.801607    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1701009a-d778-4d6d-b59f-e91ec4b13a60-run-systemd\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.803330 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800821    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/48754e37-1055-42a7-9cc3-7c3b78735407-cni-binary-copy\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.803330 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800724    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48754e37-1055-42a7-9cc3-7c3b78735407-multus-cni-dir\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.803330 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.801871    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d8e410a3-7034-456a-91f9-a2f3dfae2621-etc-sysctl-d\") pod \"tuned-j6mqn\" (UID: \"d8e410a3-7034-456a-91f9-a2f3dfae2621\") " pod="openshift-cluster-node-tuning-operator/tuned-j6mqn"
Jul 21 01:22:12.803330 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.801930    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48754e37-1055-42a7-9cc3-7c3b78735407-system-cni-dir\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.803330 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.801967    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1701009a-d778-4d6d-b59f-e91ec4b13a60-run-ovn\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.803330 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.801974    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f31b4061-dd8c-44fa-bd6c-601d8f373be2-serviceca\") pod \"node-ca-cfqrc\" (UID: \"f31b4061-dd8c-44fa-bd6c-601d8f373be2\") " pod="openshift-image-registry/node-ca-cfqrc"
Jul 21 01:22:12.804023 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.800767    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8e410a3-7034-456a-91f9-a2f3dfae2621-var-lib-kubelet\") pod \"tuned-j6mqn\" (UID: \"d8e410a3-7034-456a-91f9-a2f3dfae2621\") " pod="openshift-cluster-node-tuning-operator/tuned-j6mqn"
Jul 21 01:22:12.804023 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.801915    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48754e37-1055-42a7-9cc3-7c3b78735407-etc-kubernetes\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.804023 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.802041    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d8e410a3-7034-456a-91f9-a2f3dfae2621-etc-modprobe-d\") pod \"tuned-j6mqn\" (UID: \"d8e410a3-7034-456a-91f9-a2f3dfae2621\") " pod="openshift-cluster-node-tuning-operator/tuned-j6mqn"
Jul 21 01:22:12.804023 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.802082    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1701009a-d778-4d6d-b59f-e91ec4b13a60-ovnkube-script-lib\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.804023 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.802368    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/48754e37-1055-42a7-9cc3-7c3b78735407-multus-daemon-config\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.804023 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.802783    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1701009a-d778-4d6d-b59f-e91ec4b13a60-ovn-node-metrics-cert\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.804023 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.803514    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8e410a3-7034-456a-91f9-a2f3dfae2621-tmp\") pod \"tuned-j6mqn\" (UID: \"d8e410a3-7034-456a-91f9-a2f3dfae2621\") " pod="openshift-cluster-node-tuning-operator/tuned-j6mqn"
Jul 21 01:22:12.804304 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.804273    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d8e410a3-7034-456a-91f9-a2f3dfae2621-etc-tuned\") pod \"tuned-j6mqn\" (UID: \"d8e410a3-7034-456a-91f9-a2f3dfae2621\") " pod="openshift-cluster-node-tuning-operator/tuned-j6mqn"
Jul 21 01:22:12.810657 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.810630    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njsfp\" (UniqueName: \"kubernetes.io/projected/1701009a-d778-4d6d-b59f-e91ec4b13a60-kube-api-access-njsfp\") pod \"ovnkube-node-2p4wt\" (UID: \"1701009a-d778-4d6d-b59f-e91ec4b13a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:12.811558 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.811535    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2rvg\" (UniqueName: \"kubernetes.io/projected/f31b4061-dd8c-44fa-bd6c-601d8f373be2-kube-api-access-g2rvg\") pod \"node-ca-cfqrc\" (UID: \"f31b4061-dd8c-44fa-bd6c-601d8f373be2\") " pod="openshift-image-registry/node-ca-cfqrc"
Jul 21 01:22:12.811668 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.811653    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htbv9\" (UniqueName: \"kubernetes.io/projected/48754e37-1055-42a7-9cc3-7c3b78735407-kube-api-access-htbv9\") pod \"multus-48xjv\" (UID: \"48754e37-1055-42a7-9cc3-7c3b78735407\") " pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.812383 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.812365    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwvlh\" (UniqueName: \"kubernetes.io/projected/d8e410a3-7034-456a-91f9-a2f3dfae2621-kube-api-access-mwvlh\") pod \"tuned-j6mqn\" (UID: \"d8e410a3-7034-456a-91f9-a2f3dfae2621\") " pod="openshift-cluster-node-tuning-operator/tuned-j6mqn"
Jul 21 01:22:12.897569 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.897494    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gfrks"
Jul 21 01:22:12.903726 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.903706    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bmr7r"
Jul 21 01:22:12.911306 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.911285    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2t6p"
Jul 21 01:22:12.915928 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.915908    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4zvd6"
Jul 21 01:22:12.924300 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.924282    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2gzwb"
Jul 21 01:22:12.929850 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.929835    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-48xjv"
Jul 21 01:22:12.936195 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.936178    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cfqrc"
Jul 21 01:22:12.943819 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.943804    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-j6mqn"
Jul 21 01:22:12.951542 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:12.951522    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:13.085223 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:13.085174    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 01:22:13.203179 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:13.203093    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d45da68-d967-4df2-9623-2aec040ab204-metrics-certs\") pod \"network-metrics-daemon-6j8g9\" (UID: \"8d45da68-d967-4df2-9623-2aec040ab204\") " pod="openshift-multus/network-metrics-daemon-6j8g9"
Jul 21 01:22:13.203341 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:13.203273    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:22:13.203341 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:13.203337    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d45da68-d967-4df2-9623-2aec040ab204-metrics-certs podName:8d45da68-d967-4df2-9623-2aec040ab204 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:14.203319504 +0000 UTC m=+3.933688151 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d45da68-d967-4df2-9623-2aec040ab204-metrics-certs") pod "network-metrics-daemon-6j8g9" (UID: "8d45da68-d967-4df2-9623-2aec040ab204") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:22:13.303737 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:13.303707    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f652ed3-d73f-4b66-be66-dd7bdba8a027-original-pull-secret\") pod \"global-pull-secret-syncer-n4nls\" (UID: \"2f652ed3-d73f-4b66-be66-dd7bdba8a027\") " pod="kube-system/global-pull-secret-syncer-n4nls"
Jul 21 01:22:13.303737 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:13.303742    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69x5p\" (UniqueName: \"kubernetes.io/projected/85c43f1f-b8b3-49e1-ae09-d266df7facf3-kube-api-access-69x5p\") pod \"network-check-target-fpg98\" (UID: \"85c43f1f-b8b3-49e1-ae09-d266df7facf3\") " pod="openshift-network-diagnostics/network-check-target-fpg98"
Jul 21 01:22:13.303946 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:13.303855    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 01:22:13.303946 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:13.303860    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 01:22:13.303946 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:13.303872    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 01:22:13.303946 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:13.303883    2561 projected.go:196] Error preparing data for projected volume kube-api-access-69x5p for pod openshift-network-diagnostics/network-check-target-fpg98: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:22:13.303946 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:13.303938    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f652ed3-d73f-4b66-be66-dd7bdba8a027-original-pull-secret podName:2f652ed3-d73f-4b66-be66-dd7bdba8a027 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:14.30391368 +0000 UTC m=+4.034282331 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2f652ed3-d73f-4b66-be66-dd7bdba8a027-original-pull-secret") pod "global-pull-secret-syncer-n4nls" (UID: "2f652ed3-d73f-4b66-be66-dd7bdba8a027") : object "kube-system"/"original-pull-secret" not registered
Jul 21 01:22:13.304150 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:13.303958    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85c43f1f-b8b3-49e1-ae09-d266df7facf3-kube-api-access-69x5p podName:85c43f1f-b8b3-49e1-ae09-d266df7facf3 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:14.303947606 +0000 UTC m=+4.034316256 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-69x5p" (UniqueName: "kubernetes.io/projected/85c43f1f-b8b3-49e1-ae09-d266df7facf3-kube-api-access-69x5p") pod "network-check-target-fpg98" (UID: "85c43f1f-b8b3-49e1-ae09-d266df7facf3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:22:13.596594 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:13.596565    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74d1adf3_d3fe_43cd_9bcf_67e60150c965.slice/crio-aa9e64bc33ec917e058f8527ed9f4a70687df3d40bf6d804e050fd96c8a11a62 WatchSource:0}: Error finding container aa9e64bc33ec917e058f8527ed9f4a70687df3d40bf6d804e050fd96c8a11a62: Status 404 returned error can't find the container with id aa9e64bc33ec917e058f8527ed9f4a70687df3d40bf6d804e050fd96c8a11a62
Jul 21 01:22:13.599894 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:13.599855    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ab4dce6_4fd1_4202_8c35_08253d62ae38.slice/crio-ecef8375f25d7423623ec0848f9f63f48317c4c87205c85c776d79bb8e96b0ad WatchSource:0}: Error finding container ecef8375f25d7423623ec0848f9f63f48317c4c87205c85c776d79bb8e96b0ad: Status 404 returned error can't find the container with id ecef8375f25d7423623ec0848f9f63f48317c4c87205c85c776d79bb8e96b0ad
Jul 21 01:22:13.603697 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:13.603675    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf31b4061_dd8c_44fa_bd6c_601d8f373be2.slice/crio-694f42edaee01fb7c7afa7ed19c9103e9ea10ad1bb6a251d91307c82c9b55a7e WatchSource:0}: Error finding container 694f42edaee01fb7c7afa7ed19c9103e9ea10ad1bb6a251d91307c82c9b55a7e: Status 404 returned error can't find the container with id 694f42edaee01fb7c7afa7ed19c9103e9ea10ad1bb6a251d91307c82c9b55a7e
Jul 21 01:22:13.604515 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:13.604494    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ce45c65_d65b_4537_8de3_1bc541026538.slice/crio-9defe6e8f7e6ec8803ae398d5bf111ecede391ebfbf9516a2c014eabdadabab9 WatchSource:0}: Error finding container 9defe6e8f7e6ec8803ae398d5bf111ecede391ebfbf9516a2c014eabdadabab9: Status 404 returned error can't find the container with id 9defe6e8f7e6ec8803ae398d5bf111ecede391ebfbf9516a2c014eabdadabab9
Jul 21 01:22:13.626736 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:13.626685    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 01:17:12 +0000 UTC" deadline="2028-03-07 03:48:00.549709026 +0000 UTC"
Jul 21 01:22:13.626832 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:13.626736    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14282h25m46.922976835s"
Jul 21 01:22:13.722213 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:13.721988    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4zvd6" event={"ID":"8ab4dce6-4fd1-4202-8c35-08253d62ae38","Type":"ContainerStarted","Data":"ecef8375f25d7423623ec0848f9f63f48317c4c87205c85c776d79bb8e96b0ad"}
Jul 21 01:22:13.723728 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:13.723704    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gfrks" event={"ID":"74d1adf3-d3fe-43cd-9bcf-67e60150c965","Type":"ContainerStarted","Data":"aa9e64bc33ec917e058f8527ed9f4a70687df3d40bf6d804e050fd96c8a11a62"}
Jul 21 01:22:13.725864 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:13.725809    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-147.ec2.internal" event={"ID":"cc1b51a7ee645186d00208039d5f8c77","Type":"ContainerStarted","Data":"4fdbafe9b8f81756133fba03e12d63ce228f77ada99700c8782b038af77a28de"}
Jul 21 01:22:13.727173 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:13.727150    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-j6mqn" event={"ID":"d8e410a3-7034-456a-91f9-a2f3dfae2621","Type":"ContainerStarted","Data":"56afae638009db03ff453335e9ca9c97d6f6bbb9fc1ec913da55383b40c4b1a6"}
Jul 21 01:22:13.728366 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:13.728340    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-48xjv" event={"ID":"48754e37-1055-42a7-9cc3-7c3b78735407","Type":"ContainerStarted","Data":"5730e3b9c99ad7cc3097c7683396ec7b3e58d687a8644633259158de18e0646b"}
Jul 21 01:22:13.730128 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:13.730109    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bmr7r" event={"ID":"941a0372-0f5c-4f67-a620-e1a1ee0de499","Type":"ContainerStarted","Data":"72eff45cfe7531fef76ca29a2c4e68cd812f6f5f831186b8730df32773a2f484"}
Jul 21 01:22:13.731105 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:13.731085    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2t6p" event={"ID":"594f0782-5edf-4c98-ad04-2be6317c3a28","Type":"ContainerStarted","Data":"129a25abb67a9d23f484d2e7f66757e459e3aa4f63335beab9f2a6db52a731cb"}
Jul 21 01:22:13.732240 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:13.732221    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt" event={"ID":"1701009a-d778-4d6d-b59f-e91ec4b13a60","Type":"ContainerStarted","Data":"7f9dc5c1e9aba384a69fe96b7a0d3ad307e413fd205d7ab8fe17ba3a5e096e9e"}
Jul 21 01:22:13.733100 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:13.733074    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2gzwb" event={"ID":"2ce45c65-d65b-4537-8de3-1bc541026538","Type":"ContainerStarted","Data":"9defe6e8f7e6ec8803ae398d5bf111ecede391ebfbf9516a2c014eabdadabab9"}
Jul 21 01:22:13.734093 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:13.734074    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cfqrc" event={"ID":"f31b4061-dd8c-44fa-bd6c-601d8f373be2","Type":"ContainerStarted","Data":"694f42edaee01fb7c7afa7ed19c9103e9ea10ad1bb6a251d91307c82c9b55a7e"}
Jul 21 01:22:13.740355 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:13.740316    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-147.ec2.internal" podStartSLOduration=2.740303947 podStartE2EDuration="2.740303947s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:22:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:22:13.740053239 +0000 UTC m=+3.470421908" watchObservedRunningTime="2026-07-21 01:22:13.740303947 +0000 UTC m=+3.470672616"
Jul 21 01:22:14.210681 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:14.210646    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d45da68-d967-4df2-9623-2aec040ab204-metrics-certs\") pod \"network-metrics-daemon-6j8g9\" (UID: \"8d45da68-d967-4df2-9623-2aec040ab204\") " pod="openshift-multus/network-metrics-daemon-6j8g9"
Jul 21 01:22:14.210865 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:14.210817    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:22:14.210932 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:14.210906    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d45da68-d967-4df2-9623-2aec040ab204-metrics-certs podName:8d45da68-d967-4df2-9623-2aec040ab204 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:16.210884431 +0000 UTC m=+5.941253093 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d45da68-d967-4df2-9623-2aec040ab204-metrics-certs") pod "network-metrics-daemon-6j8g9" (UID: "8d45da68-d967-4df2-9623-2aec040ab204") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:22:14.311533 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:14.311494    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f652ed3-d73f-4b66-be66-dd7bdba8a027-original-pull-secret\") pod \"global-pull-secret-syncer-n4nls\" (UID: \"2f652ed3-d73f-4b66-be66-dd7bdba8a027\") " pod="kube-system/global-pull-secret-syncer-n4nls"
Jul 21 01:22:14.311701 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:14.311549    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69x5p\" (UniqueName: \"kubernetes.io/projected/85c43f1f-b8b3-49e1-ae09-d266df7facf3-kube-api-access-69x5p\") pod \"network-check-target-fpg98\" (UID: \"85c43f1f-b8b3-49e1-ae09-d266df7facf3\") " pod="openshift-network-diagnostics/network-check-target-fpg98"
Jul 21 01:22:14.311764 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:14.311745    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 01:22:14.311816 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:14.311767    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 01:22:14.311816 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:14.311780    2561 projected.go:196] Error preparing data for projected volume kube-api-access-69x5p for pod openshift-network-diagnostics/network-check-target-fpg98: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:22:14.311920 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:14.311836    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85c43f1f-b8b3-49e1-ae09-d266df7facf3-kube-api-access-69x5p podName:85c43f1f-b8b3-49e1-ae09-d266df7facf3 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:16.311818054 +0000 UTC m=+6.042186705 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-69x5p" (UniqueName: "kubernetes.io/projected/85c43f1f-b8b3-49e1-ae09-d266df7facf3-kube-api-access-69x5p") pod "network-check-target-fpg98" (UID: "85c43f1f-b8b3-49e1-ae09-d266df7facf3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:22:14.312248 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:14.312228    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 01:22:14.312341 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:14.312281    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f652ed3-d73f-4b66-be66-dd7bdba8a027-original-pull-secret podName:2f652ed3-d73f-4b66-be66-dd7bdba8a027 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:16.312266621 +0000 UTC m=+6.042635272 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2f652ed3-d73f-4b66-be66-dd7bdba8a027-original-pull-secret") pod "global-pull-secret-syncer-n4nls" (UID: "2f652ed3-d73f-4b66-be66-dd7bdba8a027") : object "kube-system"/"original-pull-secret" not registered
Jul 21 01:22:14.571103 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:14.571071    2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 01:22:14.627754 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:14.627717    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 01:17:12 +0000 UTC" deadline="2028-01-16 18:42:47.617264191 +0000 UTC"
Jul 21 01:22:14.627754 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:14.627753    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13073h20m32.989515142s"
Jul 21 01:22:14.712321 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:14.712292    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4nls"
Jul 21 01:22:14.712478 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:14.712296    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpg98"
Jul 21 01:22:14.712478 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:14.712421    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6j8g9"
Jul 21 01:22:14.712478 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:14.712421    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4nls" podUID="2f652ed3-d73f-4b66-be66-dd7bdba8a027"
Jul 21 01:22:14.712658 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:14.712484    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpg98" podUID="85c43f1f-b8b3-49e1-ae09-d266df7facf3"
Jul 21 01:22:14.712658 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:14.712575    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6j8g9" podUID="8d45da68-d967-4df2-9623-2aec040ab204"
Jul 21 01:22:14.761353 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:14.761317    2561 generic.go:356] "Generic (PLEG): container finished" podID="9d7e0f4a3fad0e13e8662877d91e1039" containerID="fd6021cbc9261df6032b430f739a88123e2da9a3fa41ff6b5550cf552413d2e2" exitCode=0
Jul 21 01:22:14.761762 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:14.761743    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-147.ec2.internal" event={"ID":"9d7e0f4a3fad0e13e8662877d91e1039","Type":"ContainerDied","Data":"fd6021cbc9261df6032b430f739a88123e2da9a3fa41ff6b5550cf552413d2e2"}
Jul 21 01:22:15.788590 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:15.788552    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-147.ec2.internal" event={"ID":"9d7e0f4a3fad0e13e8662877d91e1039","Type":"ContainerStarted","Data":"cc89bed5599b8cd6a1f5188e4e3982468a2157d47ead438d8f1f733d58fcd814"}
Jul 21 01:22:16.224904 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:16.224822    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d45da68-d967-4df2-9623-2aec040ab204-metrics-certs\") pod \"network-metrics-daemon-6j8g9\" (UID: \"8d45da68-d967-4df2-9623-2aec040ab204\") " pod="openshift-multus/network-metrics-daemon-6j8g9"
Jul 21 01:22:16.225069 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:16.225049    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:22:16.225159 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:16.225124    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d45da68-d967-4df2-9623-2aec040ab204-metrics-certs podName:8d45da68-d967-4df2-9623-2aec040ab204 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:20.225101585 +0000 UTC m=+9.955470232 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d45da68-d967-4df2-9623-2aec040ab204-metrics-certs") pod "network-metrics-daemon-6j8g9" (UID: "8d45da68-d967-4df2-9623-2aec040ab204") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:22:16.325712 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:16.325679    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f652ed3-d73f-4b66-be66-dd7bdba8a027-original-pull-secret\") pod \"global-pull-secret-syncer-n4nls\" (UID: \"2f652ed3-d73f-4b66-be66-dd7bdba8a027\") " pod="kube-system/global-pull-secret-syncer-n4nls"
Jul 21 01:22:16.325884 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:16.325741    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69x5p\" (UniqueName: \"kubernetes.io/projected/85c43f1f-b8b3-49e1-ae09-d266df7facf3-kube-api-access-69x5p\") pod \"network-check-target-fpg98\" (UID: \"85c43f1f-b8b3-49e1-ae09-d266df7facf3\") " pod="openshift-network-diagnostics/network-check-target-fpg98"
Jul 21 01:22:16.325954 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:16.325937    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 01:22:16.326009 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:16.325961    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 01:22:16.326009 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:16.325973    2561 projected.go:196] Error preparing data for projected volume kube-api-access-69x5p for pod openshift-network-diagnostics/network-check-target-fpg98: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:22:16.326103 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:16.326028    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85c43f1f-b8b3-49e1-ae09-d266df7facf3-kube-api-access-69x5p podName:85c43f1f-b8b3-49e1-ae09-d266df7facf3 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:20.326009971 +0000 UTC m=+10.056378642 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-69x5p" (UniqueName: "kubernetes.io/projected/85c43f1f-b8b3-49e1-ae09-d266df7facf3-kube-api-access-69x5p") pod "network-check-target-fpg98" (UID: "85c43f1f-b8b3-49e1-ae09-d266df7facf3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:22:16.326395 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:16.326286    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 01:22:16.326395 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:16.326355    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f652ed3-d73f-4b66-be66-dd7bdba8a027-original-pull-secret podName:2f652ed3-d73f-4b66-be66-dd7bdba8a027 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:20.326330574 +0000 UTC m=+10.056699228 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2f652ed3-d73f-4b66-be66-dd7bdba8a027-original-pull-secret") pod "global-pull-secret-syncer-n4nls" (UID: "2f652ed3-d73f-4b66-be66-dd7bdba8a027") : object "kube-system"/"original-pull-secret" not registered
Jul 21 01:22:16.711704 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:16.711218    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4nls"
Jul 21 01:22:16.711704 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:16.711351    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4nls" podUID="2f652ed3-d73f-4b66-be66-dd7bdba8a027"
Jul 21 01:22:16.711704 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:16.711421    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpg98"
Jul 21 01:22:16.711704 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:16.711512    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6j8g9"
Jul 21 01:22:16.711704 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:16.711626    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6j8g9" podUID="8d45da68-d967-4df2-9623-2aec040ab204"
Jul 21 01:22:16.711704 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:16.711692    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpg98" podUID="85c43f1f-b8b3-49e1-ae09-d266df7facf3"
Jul 21 01:22:18.711767 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:18.711735    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6j8g9"
Jul 21 01:22:18.712229 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:18.711859    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6j8g9" podUID="8d45da68-d967-4df2-9623-2aec040ab204"
Jul 21 01:22:18.712229 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:18.712211    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4nls"
Jul 21 01:22:18.712345 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:18.712274    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4nls" podUID="2f652ed3-d73f-4b66-be66-dd7bdba8a027"
Jul 21 01:22:18.712345 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:18.712305    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpg98"
Jul 21 01:22:18.712345 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:18.712342    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpg98" podUID="85c43f1f-b8b3-49e1-ae09-d266df7facf3"
Jul 21 01:22:20.264391 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:20.264345    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d45da68-d967-4df2-9623-2aec040ab204-metrics-certs\") pod \"network-metrics-daemon-6j8g9\" (UID: \"8d45da68-d967-4df2-9623-2aec040ab204\") " pod="openshift-multus/network-metrics-daemon-6j8g9"
Jul 21 01:22:20.264776 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:20.264496    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:22:20.264776 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:20.264590    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d45da68-d967-4df2-9623-2aec040ab204-metrics-certs podName:8d45da68-d967-4df2-9623-2aec040ab204 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:28.264568133 +0000 UTC m=+17.994936809 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d45da68-d967-4df2-9623-2aec040ab204-metrics-certs") pod "network-metrics-daemon-6j8g9" (UID: "8d45da68-d967-4df2-9623-2aec040ab204") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:22:20.365707 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:20.365667    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f652ed3-d73f-4b66-be66-dd7bdba8a027-original-pull-secret\") pod \"global-pull-secret-syncer-n4nls\" (UID: \"2f652ed3-d73f-4b66-be66-dd7bdba8a027\") " pod="kube-system/global-pull-secret-syncer-n4nls"
Jul 21 01:22:20.365884 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:20.365721    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69x5p\" (UniqueName: \"kubernetes.io/projected/85c43f1f-b8b3-49e1-ae09-d266df7facf3-kube-api-access-69x5p\") pod \"network-check-target-fpg98\" (UID: \"85c43f1f-b8b3-49e1-ae09-d266df7facf3\") " pod="openshift-network-diagnostics/network-check-target-fpg98"
Jul 21 01:22:20.365884 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:20.365842    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 01:22:20.365980 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:20.365886    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 01:22:20.365980 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:20.365905    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 01:22:20.365980 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:20.365918    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f652ed3-d73f-4b66-be66-dd7bdba8a027-original-pull-secret podName:2f652ed3-d73f-4b66-be66-dd7bdba8a027 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:28.365898328 +0000 UTC m=+18.096266978 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2f652ed3-d73f-4b66-be66-dd7bdba8a027-original-pull-secret") pod "global-pull-secret-syncer-n4nls" (UID: "2f652ed3-d73f-4b66-be66-dd7bdba8a027") : object "kube-system"/"original-pull-secret" not registered
Jul 21 01:22:20.365980 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:20.365942    2561 projected.go:196] Error preparing data for projected volume kube-api-access-69x5p for pod openshift-network-diagnostics/network-check-target-fpg98: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:22:20.366102 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:20.365989    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85c43f1f-b8b3-49e1-ae09-d266df7facf3-kube-api-access-69x5p podName:85c43f1f-b8b3-49e1-ae09-d266df7facf3 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:28.365977604 +0000 UTC m=+18.096346252 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-69x5p" (UniqueName: "kubernetes.io/projected/85c43f1f-b8b3-49e1-ae09-d266df7facf3-kube-api-access-69x5p") pod "network-check-target-fpg98" (UID: "85c43f1f-b8b3-49e1-ae09-d266df7facf3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:22:20.710476 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:20.710438    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4nls"
Jul 21 01:22:20.710658 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:20.710545    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpg98"
Jul 21 01:22:20.710658 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:20.710555    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4nls" podUID="2f652ed3-d73f-4b66-be66-dd7bdba8a027"
Jul 21 01:22:20.710658 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:20.710638    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpg98" podUID="85c43f1f-b8b3-49e1-ae09-d266df7facf3"
Jul 21 01:22:20.710825 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:20.710692    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6j8g9"
Jul 21 01:22:20.710825 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:20.710765    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6j8g9" podUID="8d45da68-d967-4df2-9623-2aec040ab204"
Jul 21 01:22:22.709571 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:22.709536    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4nls"
Jul 21 01:22:22.710018 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:22.709669    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4nls" podUID="2f652ed3-d73f-4b66-be66-dd7bdba8a027"
Jul 21 01:22:22.710018 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:22.709959    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpg98"
Jul 21 01:22:22.710018 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:22.710016    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpg98" podUID="85c43f1f-b8b3-49e1-ae09-d266df7facf3"
Jul 21 01:22:22.710169 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:22.710053    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6j8g9"
Jul 21 01:22:22.710169 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:22.710101    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6j8g9" podUID="8d45da68-d967-4df2-9623-2aec040ab204"
Jul 21 01:22:24.709231 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:24.709179    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6j8g9"
Jul 21 01:22:24.709694 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:24.709179    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpg98"
Jul 21 01:22:24.709694 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:24.709366    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6j8g9" podUID="8d45da68-d967-4df2-9623-2aec040ab204"
Jul 21 01:22:24.709694 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:24.709463    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpg98" podUID="85c43f1f-b8b3-49e1-ae09-d266df7facf3"
Jul 21 01:22:24.709694 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:24.709180    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4nls"
Jul 21 01:22:24.709694 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:24.709570    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4nls" podUID="2f652ed3-d73f-4b66-be66-dd7bdba8a027"
Jul 21 01:22:26.709754 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:26.709714    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4nls"
Jul 21 01:22:26.710164 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:26.709714    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6j8g9"
Jul 21 01:22:26.710164 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:26.709857    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4nls" podUID="2f652ed3-d73f-4b66-be66-dd7bdba8a027"
Jul 21 01:22:26.710164 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:26.709714    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpg98"
Jul 21 01:22:26.710164 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:26.709956    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6j8g9" podUID="8d45da68-d967-4df2-9623-2aec040ab204"
Jul 21 01:22:26.710164 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:26.710033    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpg98" podUID="85c43f1f-b8b3-49e1-ae09-d266df7facf3"
Jul 21 01:22:28.328003 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:28.327958    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d45da68-d967-4df2-9623-2aec040ab204-metrics-certs\") pod \"network-metrics-daemon-6j8g9\" (UID: \"8d45da68-d967-4df2-9623-2aec040ab204\") " pod="openshift-multus/network-metrics-daemon-6j8g9"
Jul 21 01:22:28.328494 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:28.328110    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:22:28.328494 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:28.328189    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d45da68-d967-4df2-9623-2aec040ab204-metrics-certs podName:8d45da68-d967-4df2-9623-2aec040ab204 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:44.328167456 +0000 UTC m=+34.058536115 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d45da68-d967-4df2-9623-2aec040ab204-metrics-certs") pod "network-metrics-daemon-6j8g9" (UID: "8d45da68-d967-4df2-9623-2aec040ab204") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:22:28.429052 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:28.429012    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f652ed3-d73f-4b66-be66-dd7bdba8a027-original-pull-secret\") pod \"global-pull-secret-syncer-n4nls\" (UID: \"2f652ed3-d73f-4b66-be66-dd7bdba8a027\") " pod="kube-system/global-pull-secret-syncer-n4nls"
Jul 21 01:22:28.429052 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:28.429058    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69x5p\" (UniqueName: \"kubernetes.io/projected/85c43f1f-b8b3-49e1-ae09-d266df7facf3-kube-api-access-69x5p\") pod \"network-check-target-fpg98\" (UID: \"85c43f1f-b8b3-49e1-ae09-d266df7facf3\") " pod="openshift-network-diagnostics/network-check-target-fpg98"
Jul 21 01:22:28.429323 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:28.429166    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 01:22:28.429323 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:28.429233    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 01:22:28.429323 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:28.429251    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 01:22:28.429323 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:28.429254    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f652ed3-d73f-4b66-be66-dd7bdba8a027-original-pull-secret podName:2f652ed3-d73f-4b66-be66-dd7bdba8a027 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:44.429238401 +0000 UTC m=+34.159607048 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2f652ed3-d73f-4b66-be66-dd7bdba8a027-original-pull-secret") pod "global-pull-secret-syncer-n4nls" (UID: "2f652ed3-d73f-4b66-be66-dd7bdba8a027") : object "kube-system"/"original-pull-secret" not registered
Jul 21 01:22:28.429323 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:28.429263    2561 projected.go:196] Error preparing data for projected volume kube-api-access-69x5p for pod openshift-network-diagnostics/network-check-target-fpg98: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:22:28.429323 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:28.429313    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85c43f1f-b8b3-49e1-ae09-d266df7facf3-kube-api-access-69x5p podName:85c43f1f-b8b3-49e1-ae09-d266df7facf3 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:44.4292965 +0000 UTC m=+34.159665162 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-69x5p" (UniqueName: "kubernetes.io/projected/85c43f1f-b8b3-49e1-ae09-d266df7facf3-kube-api-access-69x5p") pod "network-check-target-fpg98" (UID: "85c43f1f-b8b3-49e1-ae09-d266df7facf3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:22:28.710417 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:28.710322    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6j8g9"
Jul 21 01:22:28.710568 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:28.710466    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6j8g9" podUID="8d45da68-d967-4df2-9623-2aec040ab204"
Jul 21 01:22:28.710925 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:28.710904    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4nls"
Jul 21 01:22:28.711023 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:28.710993    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4nls" podUID="2f652ed3-d73f-4b66-be66-dd7bdba8a027"
Jul 21 01:22:28.711170 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:28.711150    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpg98"
Jul 21 01:22:28.711304 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:28.711276    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpg98" podUID="85c43f1f-b8b3-49e1-ae09-d266df7facf3"
Jul 21 01:22:30.710769 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:30.710732    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6j8g9"
Jul 21 01:22:30.711180 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:30.710869    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6j8g9" podUID="8d45da68-d967-4df2-9623-2aec040ab204"
Jul 21 01:22:30.711180 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:30.711114    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4nls"
Jul 21 01:22:30.711343 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:30.711250    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4nls" podUID="2f652ed3-d73f-4b66-be66-dd7bdba8a027"
Jul 21 01:22:30.711343 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:30.711289    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpg98"
Jul 21 01:22:30.711421 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:30.711391    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpg98" podUID="85c43f1f-b8b3-49e1-ae09-d266df7facf3"
Jul 21 01:22:32.709388 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:32.709362    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpg98"
Jul 21 01:22:32.709748 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:32.709501    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpg98" podUID="85c43f1f-b8b3-49e1-ae09-d266df7facf3"
Jul 21 01:22:32.709935 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:32.709915    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6j8g9"
Jul 21 01:22:32.710049 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:32.710030    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6j8g9" podUID="8d45da68-d967-4df2-9623-2aec040ab204"
Jul 21 01:22:32.710724 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:32.710702    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4nls"
Jul 21 01:22:32.710829 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:32.710809    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4nls" podUID="2f652ed3-d73f-4b66-be66-dd7bdba8a027"
Jul 21 01:22:32.839492 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:32.839119    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-j6mqn" event={"ID":"d8e410a3-7034-456a-91f9-a2f3dfae2621","Type":"ContainerStarted","Data":"96784acb82a967657e0af0cafc067ca6f9ab5596104dd03ae36a26a672b476a9"}
Jul 21 01:22:32.840967 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:32.840794    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bmr7r" event={"ID":"941a0372-0f5c-4f67-a620-e1a1ee0de499","Type":"ContainerStarted","Data":"a52a2147e1713f2c07f0c279ba78aaad7ba5fc2cf0bddb64f6a4143fe7279439"}
Jul 21 01:22:32.842824 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:32.842798    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4zvd6" event={"ID":"8ab4dce6-4fd1-4202-8c35-08253d62ae38","Type":"ContainerStarted","Data":"b3e37b40e8cb148d3403b69bdc6cb3fd10ea0b5b42a8d9a7d818f0774b50e3e6"}
Jul 21 01:22:32.857455 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:32.857407    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-147.ec2.internal" podStartSLOduration=21.857390995 podStartE2EDuration="21.857390995s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:22:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:22:15.806980793 +0000 UTC m=+5.537349464" watchObservedRunningTime="2026-07-21 01:22:32.857390995 +0000 UTC m=+22.587759666"
Jul 21 01:22:32.858151 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:32.857990    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-j6mqn" podStartSLOduration=3.8210130810000003 podStartE2EDuration="22.857973901s" totalImagesPullingTime="19.03696082s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:22:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:22:32.856868623 +0000 UTC m=+22.587237296" watchObservedRunningTime="2026-07-21 01:22:32.857973901 +0000 UTC m=+22.588342575"
Jul 21 01:22:32.873165 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:32.873051    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bmr7r" podStartSLOduration=11.949198888 podStartE2EDuration="22.873033995s" totalImagesPullingTime="10.923835107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:22:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:22:32.872414884 +0000 UTC m=+22.602783554" watchObservedRunningTime="2026-07-21 01:22:32.873033995 +0000 UTC m=+22.603402664"
Jul 21 01:22:33.245421 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:33.245232    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bmr7r"
Jul 21 01:22:33.245732 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:33.245710    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bmr7r"
Jul 21 01:22:33.846040 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:33.846001    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-48xjv" event={"ID":"48754e37-1055-42a7-9cc3-7c3b78735407","Type":"ContainerStarted","Data":"fcda32a997a7167505d27951c08bce0647f1fefacc2dc63660dc13e4bf793da6"}
Jul 21 01:22:33.847483 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:33.847460    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2t6p" event={"ID":"594f0782-5edf-4c98-ad04-2be6317c3a28","Type":"ContainerStarted","Data":"944fe7e7e6118862c97adf7a2ff974b2d51ea6f2b60ec7cccdf64d434a8b3e8d"}
Jul 21 01:22:33.850093 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:33.850074    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2p4wt_1701009a-d778-4d6d-b59f-e91ec4b13a60/ovn-acl-logging/0.log"
Jul 21 01:22:33.850446 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:33.850419    2561 generic.go:356] "Generic (PLEG): container finished" podID="1701009a-d778-4d6d-b59f-e91ec4b13a60" containerID="16c54f9d937ce12f6fa8429018442cbc9fdd57b2c911972f1b83751c3fb97c0b" exitCode=1
Jul 21 01:22:33.850510 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:33.850486    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt" event={"ID":"1701009a-d778-4d6d-b59f-e91ec4b13a60","Type":"ContainerStarted","Data":"cda15b2f040e609d2c77b6667fa724b9eaeea3b8c6c716f33d53ac35a65c20de"}
Jul 21 01:22:33.850562 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:33.850551    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt" event={"ID":"1701009a-d778-4d6d-b59f-e91ec4b13a60","Type":"ContainerStarted","Data":"48de9eb05bb89674b1ce217851f706c36340124d79f60d5dbcad815825d215fe"}
Jul 21 01:22:33.850601 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:33.850592    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt" event={"ID":"1701009a-d778-4d6d-b59f-e91ec4b13a60","Type":"ContainerStarted","Data":"e8b4dd03e9bf36144f289273a1bbb3dfaf18889b3ef4759908f2bab1dd3632d5"}
Jul 21 01:22:33.850646 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:33.850633    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt" event={"ID":"1701009a-d778-4d6d-b59f-e91ec4b13a60","Type":"ContainerStarted","Data":"bd7f167b5d9940a2bff4e636108d567bf9465fe79440a50570790d633ea7d4ef"}
Jul 21 01:22:33.850701 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:33.850688    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt" event={"ID":"1701009a-d778-4d6d-b59f-e91ec4b13a60","Type":"ContainerDied","Data":"16c54f9d937ce12f6fa8429018442cbc9fdd57b2c911972f1b83751c3fb97c0b"}
Jul 21 01:22:33.850739 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:33.850733    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt" event={"ID":"1701009a-d778-4d6d-b59f-e91ec4b13a60","Type":"ContainerStarted","Data":"6caaff937427fad22b684cc51c59f1f903cf650c73361af28e480211a74210da"}
Jul 21 01:22:33.851948 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:33.851929    2561 generic.go:356] "Generic (PLEG): container finished" podID="2ce45c65-d65b-4537-8de3-1bc541026538" containerID="dd4f46c0f961e1e18c28ca401fc961cce147b16536fb08e4c8e2ceb46ba4a1f6" exitCode=0
Jul 21 01:22:33.852037 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:33.851990    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2gzwb" event={"ID":"2ce45c65-d65b-4537-8de3-1bc541026538","Type":"ContainerDied","Data":"dd4f46c0f961e1e18c28ca401fc961cce147b16536fb08e4c8e2ceb46ba4a1f6"}
Jul 21 01:22:33.853383 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:33.853365    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cfqrc" event={"ID":"f31b4061-dd8c-44fa-bd6c-601d8f373be2","Type":"ContainerStarted","Data":"8f9c56ea6d58a1a454b2a2c9cc8f1981c609d1aff4f250abf53237a842b1ab00"}
Jul 21 01:22:33.853891 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:33.853877    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bmr7r"
Jul 21 01:22:33.854301 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:33.854283    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bmr7r"
Jul 21 01:22:33.863861 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:33.863818    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-48xjv" podStartSLOduration=4.76504265 podStartE2EDuration="23.863805066s" totalImagesPullingTime="19.098762416s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:22:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:22:33.863606166 +0000 UTC m=+23.593974837" watchObservedRunningTime="2026-07-21 01:22:33.863805066 +0000 UTC m=+23.594173735"
Jul 21 01:22:33.879312 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:33.879275    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4zvd6" podStartSLOduration=4.832676747 podStartE2EDuration="23.879262587s" totalImagesPullingTime="19.04658584s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:22:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:22:33.879084227 +0000 UTC m=+23.609452897" watchObservedRunningTime="2026-07-21 01:22:33.879262587 +0000 UTC m=+23.609631257"
Jul 21 01:22:33.893907 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:33.893872    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cfqrc" podStartSLOduration=4.849780411 podStartE2EDuration="23.893859645s" totalImagesPullingTime="19.044079234s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:22:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:22:33.893705006 +0000 UTC m=+23.624073674" watchObservedRunningTime="2026-07-21 01:22:33.893859645 +0000 UTC m=+23.624228315"
Jul 21 01:22:34.258126 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:34.258102    2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 21 01:22:34.657043 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:34.656938    2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T01:22:34.258120055Z","UUID":"b1c1960d-b4b0-43de-8211-539f2f43c987","Handler":null,"Name":"","Endpoint":""}
Jul 21 01:22:34.658577 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:34.658543    2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 21 01:22:34.658577 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:34.658577    2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 21 01:22:34.709831 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:34.709800    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpg98"
Jul 21 01:22:34.709998 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:34.709809    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6j8g9"
Jul 21 01:22:34.710067 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:34.709916    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpg98" podUID="85c43f1f-b8b3-49e1-ae09-d266df7facf3"
Jul 21 01:22:34.710067 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:34.710039    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6j8g9" podUID="8d45da68-d967-4df2-9623-2aec040ab204"
Jul 21 01:22:34.710164 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:34.710073    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4nls"
Jul 21 01:22:34.710164 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:34.710143    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4nls" podUID="2f652ed3-d73f-4b66-be66-dd7bdba8a027"
Jul 21 01:22:34.858466 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:34.858424    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gfrks" event={"ID":"74d1adf3-d3fe-43cd-9bcf-67e60150c965","Type":"ContainerStarted","Data":"62395aa16f6fdffea7f049278b6ea40bb0c455a8119fd2edd5b83c7d1ad61273"}
Jul 21 01:22:34.861626 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:34.861598    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2t6p" event={"ID":"594f0782-5edf-4c98-ad04-2be6317c3a28","Type":"ContainerStarted","Data":"8a1a033f71b8306beed5b3dc2744495b308e550ad920c13297ec172bfd635898"}
Jul 21 01:22:34.874700 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:34.874647    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-gfrks" podStartSLOduration=5.851418885 podStartE2EDuration="24.87462812s" totalImagesPullingTime="19.023209235s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:22:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:22:34.874229192 +0000 UTC m=+24.604597860" watchObservedRunningTime="2026-07-21 01:22:34.87462812 +0000 UTC m=+24.604996790"
Jul 21 01:22:35.866877 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:35.866828    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2t6p" event={"ID":"594f0782-5edf-4c98-ad04-2be6317c3a28","Type":"ContainerStarted","Data":"cf0069087cdf54d421a1f3ddbdea79c9b20efc6a561f3f47c918193178f5a13f"}
Jul 21 01:22:35.870689 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:35.870668    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2p4wt_1701009a-d778-4d6d-b59f-e91ec4b13a60/ovn-acl-logging/0.log"
Jul 21 01:22:35.871158 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:35.871133    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt" event={"ID":"1701009a-d778-4d6d-b59f-e91ec4b13a60","Type":"ContainerStarted","Data":"da1f141cb4ef5c403338268f6904b15e7d92084abae4a7789489b80862775b66"}
Jul 21 01:22:35.891572 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:35.891521    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2t6p" podStartSLOduration=4.356964897 podStartE2EDuration="25.891504598s" totalImagesPullingTime="21.534539701s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:22:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:22:35.891463585 +0000 UTC m=+25.621832255" watchObservedRunningTime="2026-07-21 01:22:35.891504598 +0000 UTC m=+25.621873261"
Jul 21 01:22:36.709981 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:36.709815    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpg98"
Jul 21 01:22:36.710262 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:36.709824    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6j8g9"
Jul 21 01:22:36.710262 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:36.710052    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpg98" podUID="85c43f1f-b8b3-49e1-ae09-d266df7facf3"
Jul 21 01:22:36.710262 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:36.709872    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4nls"
Jul 21 01:22:36.710262 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:36.710165    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6j8g9" podUID="8d45da68-d967-4df2-9623-2aec040ab204"
Jul 21 01:22:36.710262 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:36.710250    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4nls" podUID="2f652ed3-d73f-4b66-be66-dd7bdba8a027"
Jul 21 01:22:38.710153 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:38.710074    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4nls"
Jul 21 01:22:38.710719 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:38.710086    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6j8g9"
Jul 21 01:22:38.710719 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:38.710191    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4nls" podUID="2f652ed3-d73f-4b66-be66-dd7bdba8a027"
Jul 21 01:22:38.710719 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:38.710079    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpg98"
Jul 21 01:22:38.710719 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:38.710299    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6j8g9" podUID="8d45da68-d967-4df2-9623-2aec040ab204"
Jul 21 01:22:38.710719 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:38.710345    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpg98" podUID="85c43f1f-b8b3-49e1-ae09-d266df7facf3"
Jul 21 01:22:39.883897 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:39.883732    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2p4wt_1701009a-d778-4d6d-b59f-e91ec4b13a60/ovn-acl-logging/0.log"
Jul 21 01:22:39.884646 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:39.884291    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt" event={"ID":"1701009a-d778-4d6d-b59f-e91ec4b13a60","Type":"ContainerStarted","Data":"add4bb7b4665a919d945fd6ea674fbd41fa572df6f575c20dbaf1f84826122d7"}
Jul 21 01:22:39.884646 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:39.884550    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:39.884646 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:39.884638    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:39.884790 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:39.884689    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:39.884839 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:39.884786    2561 scope.go:117] "RemoveContainer" containerID="16c54f9d937ce12f6fa8429018442cbc9fdd57b2c911972f1b83751c3fb97c0b"
Jul 21 01:22:39.886394 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:39.886364    2561 generic.go:356] "Generic (PLEG): container finished" podID="2ce45c65-d65b-4537-8de3-1bc541026538" containerID="f8c7148188df12150740f71809642b4982f1981243dd8ad25af642467ac23488" exitCode=0
Jul 21 01:22:39.886501 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:39.886421    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2gzwb" event={"ID":"2ce45c65-d65b-4537-8de3-1bc541026538","Type":"ContainerDied","Data":"f8c7148188df12150740f71809642b4982f1981243dd8ad25af642467ac23488"}
Jul 21 01:22:39.900861 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:39.900842    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:39.901027 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:39.901013    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:22:39.907408 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:39.907387    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:40.012378 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:40.012342    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:40.710242 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:40.710193    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4nls"
Jul 21 01:22:40.710487 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:40.710320    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4nls" podUID="2f652ed3-d73f-4b66-be66-dd7bdba8a027"
Jul 21 01:22:40.710487 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:40.710327    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpg98"
Jul 21 01:22:40.710487 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:40.710404    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpg98" podUID="85c43f1f-b8b3-49e1-ae09-d266df7facf3"
Jul 21 01:22:40.710487 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:40.710427    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6j8g9"
Jul 21 01:22:40.710668 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:40.710501    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6j8g9" podUID="8d45da68-d967-4df2-9623-2aec040ab204"
Jul 21 01:22:40.839917 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:40.839884    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fpg98"]
Jul 21 01:22:40.842692 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:40.842667    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n4nls"]
Jul 21 01:22:40.843302 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:40.843276    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6j8g9"]
Jul 21 01:22:40.892241 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:40.892224    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2p4wt_1701009a-d778-4d6d-b59f-e91ec4b13a60/ovn-acl-logging/0.log"
Jul 21 01:22:40.892610 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:40.892594    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6j8g9"
Jul 21 01:22:40.892677 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:40.892645    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt" event={"ID":"1701009a-d778-4d6d-b59f-e91ec4b13a60","Type":"ContainerStarted","Data":"dcb94c94e3289f508cd45448566a7ee4984f04e6dbe16908ccb6017f3ae48011"}
Jul 21 01:22:40.892781 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:40.892762    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4nls"
Jul 21 01:22:40.892781 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:40.892761    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6j8g9" podUID="8d45da68-d967-4df2-9623-2aec040ab204"
Jul 21 01:22:40.893060 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:40.892766    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpg98"
Jul 21 01:22:40.893060 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:40.892939    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4nls" podUID="2f652ed3-d73f-4b66-be66-dd7bdba8a027"
Jul 21 01:22:40.893060 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:40.893022    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpg98" podUID="85c43f1f-b8b3-49e1-ae09-d266df7facf3"
Jul 21 01:22:41.896787 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:41.896617    2561 generic.go:356] "Generic (PLEG): container finished" podID="2ce45c65-d65b-4537-8de3-1bc541026538" containerID="ee37838e3e5c2c3e665e014c32ff557d3bac165e73c33728f1b93f3ff1005c73" exitCode=0
Jul 21 01:22:41.897155 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:41.896698    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2gzwb" event={"ID":"2ce45c65-d65b-4537-8de3-1bc541026538","Type":"ContainerDied","Data":"ee37838e3e5c2c3e665e014c32ff557d3bac165e73c33728f1b93f3ff1005c73"}
Jul 21 01:22:41.917843 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:41.917696    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt" podStartSLOduration=12.810845043 podStartE2EDuration="31.917681666s" totalImagesPullingTime="19.106836623s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:22:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:22:40.919410998 +0000 UTC m=+30.649779667" watchObservedRunningTime="2026-07-21 01:22:41.917681666 +0000 UTC m=+31.648050337"
Jul 21 01:22:42.709441 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:42.709405    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6j8g9"
Jul 21 01:22:42.709612 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:42.709529    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpg98"
Jul 21 01:22:42.709612 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:42.709536    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6j8g9" podUID="8d45da68-d967-4df2-9623-2aec040ab204"
Jul 21 01:22:42.709730 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:42.709642    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpg98" podUID="85c43f1f-b8b3-49e1-ae09-d266df7facf3"
Jul 21 01:22:42.709730 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:42.709691    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4nls"
Jul 21 01:22:42.709820 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:42.709791    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4nls" podUID="2f652ed3-d73f-4b66-be66-dd7bdba8a027"
Jul 21 01:22:43.167697 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:43.167669    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:43.271726 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:43.271700    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:43.903188 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:43.903151    2561 generic.go:356] "Generic (PLEG): container finished" podID="2ce45c65-d65b-4537-8de3-1bc541026538" containerID="34de374691e5f4ee8995437b3e8aea21ab5268ade98be0a8c4a2d9b8a230a48c" exitCode=0
Jul 21 01:22:43.903350 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:43.903223    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2gzwb" event={"ID":"2ce45c65-d65b-4537-8de3-1bc541026538","Type":"ContainerDied","Data":"34de374691e5f4ee8995437b3e8aea21ab5268ade98be0a8c4a2d9b8a230a48c"}
Jul 21 01:22:44.347087 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:44.347053    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d45da68-d967-4df2-9623-2aec040ab204-metrics-certs\") pod \"network-metrics-daemon-6j8g9\" (UID: \"8d45da68-d967-4df2-9623-2aec040ab204\") " pod="openshift-multus/network-metrics-daemon-6j8g9"
Jul 21 01:22:44.347497 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:44.347219    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:22:44.347497 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:44.347287    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d45da68-d967-4df2-9623-2aec040ab204-metrics-certs podName:8d45da68-d967-4df2-9623-2aec040ab204 nodeName:}" failed. No retries permitted until 2026-07-21 01:23:16.347270297 +0000 UTC m=+66.077638956 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d45da68-d967-4df2-9623-2aec040ab204-metrics-certs") pod "network-metrics-daemon-6j8g9" (UID: "8d45da68-d967-4df2-9623-2aec040ab204") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:22:44.448402 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:44.448365    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f652ed3-d73f-4b66-be66-dd7bdba8a027-original-pull-secret\") pod \"global-pull-secret-syncer-n4nls\" (UID: \"2f652ed3-d73f-4b66-be66-dd7bdba8a027\") " pod="kube-system/global-pull-secret-syncer-n4nls"
Jul 21 01:22:44.448583 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:44.448408    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69x5p\" (UniqueName: \"kubernetes.io/projected/85c43f1f-b8b3-49e1-ae09-d266df7facf3-kube-api-access-69x5p\") pod \"network-check-target-fpg98\" (UID: \"85c43f1f-b8b3-49e1-ae09-d266df7facf3\") " pod="openshift-network-diagnostics/network-check-target-fpg98"
Jul 21 01:22:44.448583 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:44.448522    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 01:22:44.448583 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:44.448577    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 01:22:44.448728 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:44.448596    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 01:22:44.448728 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:44.448605    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f652ed3-d73f-4b66-be66-dd7bdba8a027-original-pull-secret podName:2f652ed3-d73f-4b66-be66-dd7bdba8a027 nodeName:}" failed. No retries permitted until 2026-07-21 01:23:16.448584466 +0000 UTC m=+66.178953115 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2f652ed3-d73f-4b66-be66-dd7bdba8a027-original-pull-secret") pod "global-pull-secret-syncer-n4nls" (UID: "2f652ed3-d73f-4b66-be66-dd7bdba8a027") : object "kube-system"/"original-pull-secret" not registered
Jul 21 01:22:44.448728 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:44.448609    2561 projected.go:196] Error preparing data for projected volume kube-api-access-69x5p for pod openshift-network-diagnostics/network-check-target-fpg98: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:22:44.448728 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:44.448658    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/85c43f1f-b8b3-49e1-ae09-d266df7facf3-kube-api-access-69x5p podName:85c43f1f-b8b3-49e1-ae09-d266df7facf3 nodeName:}" failed. No retries permitted until 2026-07-21 01:23:16.448643299 +0000 UTC m=+66.179011952 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-69x5p" (UniqueName: "kubernetes.io/projected/85c43f1f-b8b3-49e1-ae09-d266df7facf3-kube-api-access-69x5p") pod "network-check-target-fpg98" (UID: "85c43f1f-b8b3-49e1-ae09-d266df7facf3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:22:44.622948 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:44.622866    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:44.709874 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:44.709844    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6j8g9"
Jul 21 01:22:44.710047 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:44.709844    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4nls"
Jul 21 01:22:44.710047 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:44.709986    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6j8g9" podUID="8d45da68-d967-4df2-9623-2aec040ab204"
Jul 21 01:22:44.710047 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:44.710039    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpg98"
Jul 21 01:22:44.710226 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:44.710144    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4nls" podUID="2f652ed3-d73f-4b66-be66-dd7bdba8a027"
Jul 21 01:22:44.710304 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:44.710283    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fpg98" podUID="85c43f1f-b8b3-49e1-ae09-d266df7facf3"
Jul 21 01:22:44.716100 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:44.716065    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:44.815547 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:44.815513    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:45.619979 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.619955    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-147.ec2.internal" event="NodeReady"
Jul 21 01:22:45.620432 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.620093    2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 21 01:22:45.656317 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.656243    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-69f8ccbdb8-kttn7"]
Jul 21 01:22:45.658297 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.658275    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69f8ccbdb8-kttn7"
Jul 21 01:22:45.660183 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.660130    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:45.661001 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.660793    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 21 01:22:45.661001 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.660833    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 21 01:22:45.661001 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.660959    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hmzxh\""
Jul 21 01:22:45.661275 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.661256    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 21 01:22:45.667393 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.667366    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qhbcs"]
Jul 21 01:22:45.667529 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.667511    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 21 01:22:45.669323 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.669306    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qhbcs"
Jul 21 01:22:45.671496 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.671473    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kmmsr"]
Jul 21 01:22:45.672231 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.672174    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wtqvb\""
Jul 21 01:22:45.673153 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.672402    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 21 01:22:45.673153 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.672685    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 21 01:22:45.673844 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.673762    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kmmsr"
Jul 21 01:22:45.675713 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.674934    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-69f8ccbdb8-kttn7"]
Jul 21 01:22:45.676610 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.676580    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gltw9\""
Jul 21 01:22:45.676891 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.676873    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 21 01:22:45.677027 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.677009    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 21 01:22:45.677097 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.677042    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 21 01:22:45.683490 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.683465    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kmmsr"]
Jul 21 01:22:45.684211 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.684176    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qhbcs"]
Jul 21 01:22:45.727600 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.727571    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:45.758607 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.758578    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-995xx\" (UniqueName: \"kubernetes.io/projected/098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd-kube-api-access-995xx\") pod \"dns-default-qhbcs\" (UID: \"098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd\") " pod="openshift-dns/dns-default-qhbcs"
Jul 21 01:22:45.758757 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.758611    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9056ad83-0493-4340-9642-90030b3c4ad0-cert\") pod \"ingress-canary-kmmsr\" (UID: \"9056ad83-0493-4340-9642-90030b3c4ad0\") " pod="openshift-ingress-canary/ingress-canary-kmmsr"
Jul 21 01:22:45.758757 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.758640    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-ca-trust-extracted\") pod \"image-registry-69f8ccbdb8-kttn7\" (UID: \"3e80a7f1-349e-4692-9fbd-6e539d9e6d63\") " pod="openshift-image-registry/image-registry-69f8ccbdb8-kttn7"
Jul 21 01:22:45.758757 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.758701    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-image-registry-private-configuration\") pod \"image-registry-69f8ccbdb8-kttn7\" (UID: \"3e80a7f1-349e-4692-9fbd-6e539d9e6d63\") " pod="openshift-image-registry/image-registry-69f8ccbdb8-kttn7"
Jul 21 01:22:45.758922 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.758762    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-registry-tls\") pod \"image-registry-69f8ccbdb8-kttn7\" (UID: \"3e80a7f1-349e-4692-9fbd-6e539d9e6d63\") " pod="openshift-image-registry/image-registry-69f8ccbdb8-kttn7"
Jul 21 01:22:45.758922 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.758786    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-bound-sa-token\") pod \"image-registry-69f8ccbdb8-kttn7\" (UID: \"3e80a7f1-349e-4692-9fbd-6e539d9e6d63\") " pod="openshift-image-registry/image-registry-69f8ccbdb8-kttn7"
Jul 21 01:22:45.758922 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.758808    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd-metrics-tls\") pod \"dns-default-qhbcs\" (UID: \"098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd\") " pod="openshift-dns/dns-default-qhbcs"
Jul 21 01:22:45.758922 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.758828    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd-tmp-dir\") pod \"dns-default-qhbcs\" (UID: \"098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd\") " pod="openshift-dns/dns-default-qhbcs"
Jul 21 01:22:45.758922 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.758871    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-registry-certificates\") pod \"image-registry-69f8ccbdb8-kttn7\" (UID: \"3e80a7f1-349e-4692-9fbd-6e539d9e6d63\") " pod="openshift-image-registry/image-registry-69f8ccbdb8-kttn7"
Jul 21 01:22:45.759132 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.758934    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8wrv\" (UniqueName: \"kubernetes.io/projected/9056ad83-0493-4340-9642-90030b3c4ad0-kube-api-access-f8wrv\") pod \"ingress-canary-kmmsr\" (UID: \"9056ad83-0493-4340-9642-90030b3c4ad0\") " pod="openshift-ingress-canary/ingress-canary-kmmsr"
Jul 21 01:22:45.759132 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.758989    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-installation-pull-secrets\") pod \"image-registry-69f8ccbdb8-kttn7\" (UID: \"3e80a7f1-349e-4692-9fbd-6e539d9e6d63\") " pod="openshift-image-registry/image-registry-69f8ccbdb8-kttn7"
Jul 21 01:22:45.759132 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.759024    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-trusted-ca\") pod \"image-registry-69f8ccbdb8-kttn7\" (UID: \"3e80a7f1-349e-4692-9fbd-6e539d9e6d63\") " pod="openshift-image-registry/image-registry-69f8ccbdb8-kttn7"
Jul 21 01:22:45.759132 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.759052    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8p4w\" (UniqueName: \"kubernetes.io/projected/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-kube-api-access-g8p4w\") pod \"image-registry-69f8ccbdb8-kttn7\" (UID: \"3e80a7f1-349e-4692-9fbd-6e539d9e6d63\") " pod="openshift-image-registry/image-registry-69f8ccbdb8-kttn7"
Jul 21 01:22:45.759132 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.759075    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd-config-volume\") pod \"dns-default-qhbcs\" (UID: \"098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd\") " pod="openshift-dns/dns-default-qhbcs"
Jul 21 01:22:45.792162 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.792126    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:45.847370 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.847344    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:45.859448 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.859414    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-installation-pull-secrets\") pod \"image-registry-69f8ccbdb8-kttn7\" (UID: \"3e80a7f1-349e-4692-9fbd-6e539d9e6d63\") " pod="openshift-image-registry/image-registry-69f8ccbdb8-kttn7"
Jul 21 01:22:45.859448 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.859449    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-trusted-ca\") pod \"image-registry-69f8ccbdb8-kttn7\" (UID: \"3e80a7f1-349e-4692-9fbd-6e539d9e6d63\") " pod="openshift-image-registry/image-registry-69f8ccbdb8-kttn7"
Jul 21 01:22:45.859635 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.859470    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8p4w\" (UniqueName: \"kubernetes.io/projected/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-kube-api-access-g8p4w\") pod \"image-registry-69f8ccbdb8-kttn7\" (UID: \"3e80a7f1-349e-4692-9fbd-6e539d9e6d63\") " pod="openshift-image-registry/image-registry-69f8ccbdb8-kttn7"
Jul 21 01:22:45.859679 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.859637    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd-config-volume\") pod \"dns-default-qhbcs\" (UID: \"098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd\") " pod="openshift-dns/dns-default-qhbcs"
Jul 21 01:22:45.859715 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.859682    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-995xx\" (UniqueName: \"kubernetes.io/projected/098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd-kube-api-access-995xx\") pod \"dns-default-qhbcs\" (UID: \"098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd\") " pod="openshift-dns/dns-default-qhbcs"
Jul 21 01:22:45.859892 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.859871    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9056ad83-0493-4340-9642-90030b3c4ad0-cert\") pod \"ingress-canary-kmmsr\" (UID: \"9056ad83-0493-4340-9642-90030b3c4ad0\") " pod="openshift-ingress-canary/ingress-canary-kmmsr"
Jul 21 01:22:45.859939 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.859917    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-ca-trust-extracted\") pod \"image-registry-69f8ccbdb8-kttn7\" (UID: \"3e80a7f1-349e-4692-9fbd-6e539d9e6d63\") " pod="openshift-image-registry/image-registry-69f8ccbdb8-kttn7"
Jul 21 01:22:45.859986 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.859946    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-image-registry-private-configuration\") pod \"image-registry-69f8ccbdb8-kttn7\" (UID: \"3e80a7f1-349e-4692-9fbd-6e539d9e6d63\") " pod="openshift-image-registry/image-registry-69f8ccbdb8-kttn7"
Jul 21 01:22:45.860031 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.859994    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-registry-tls\") pod \"image-registry-69f8ccbdb8-kttn7\" (UID: \"3e80a7f1-349e-4692-9fbd-6e539d9e6d63\") " pod="openshift-image-registry/image-registry-69f8ccbdb8-kttn7"
Jul 21 01:22:45.860031 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.860017    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-bound-sa-token\") pod \"image-registry-69f8ccbdb8-kttn7\" (UID: \"3e80a7f1-349e-4692-9fbd-6e539d9e6d63\") " pod="openshift-image-registry/image-registry-69f8ccbdb8-kttn7"
Jul 21 01:22:45.860110 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.860044    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd-metrics-tls\") pod \"dns-default-qhbcs\" (UID: \"098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd\") " pod="openshift-dns/dns-default-qhbcs"
Jul 21 01:22:45.860110 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.860067    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd-tmp-dir\") pod \"dns-default-qhbcs\" (UID: \"098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd\") " pod="openshift-dns/dns-default-qhbcs"
Jul 21 01:22:45.860222 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.860118    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-registry-certificates\") pod \"image-registry-69f8ccbdb8-kttn7\" (UID: \"3e80a7f1-349e-4692-9fbd-6e539d9e6d63\") " pod="openshift-image-registry/image-registry-69f8ccbdb8-kttn7"
Jul 21 01:22:45.860222 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.860147    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8wrv\" (UniqueName: \"kubernetes.io/projected/9056ad83-0493-4340-9642-90030b3c4ad0-kube-api-access-f8wrv\") pod \"ingress-canary-kmmsr\" (UID: \"9056ad83-0493-4340-9642-90030b3c4ad0\") " pod="openshift-ingress-canary/ingress-canary-kmmsr"
Jul 21 01:22:45.860325 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.860231    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd-config-volume\") pod \"dns-default-qhbcs\" (UID: \"098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd\") " pod="openshift-dns/dns-default-qhbcs"
Jul 21 01:22:45.860325 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:45.860318    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 01:22:45.860421 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:45.860333    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69f8ccbdb8-kttn7: secret "image-registry-tls" not found
Jul 21 01:22:45.860421 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:45.860398    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-registry-tls podName:3e80a7f1-349e-4692-9fbd-6e539d9e6d63 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:46.360378221 +0000 UTC m=+36.090746873 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-registry-tls") pod "image-registry-69f8ccbdb8-kttn7" (UID: "3e80a7f1-349e-4692-9fbd-6e539d9e6d63") : secret "image-registry-tls" not found
Jul 21 01:22:45.860628 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.860594    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-trusted-ca\") pod \"image-registry-69f8ccbdb8-kttn7\" (UID: \"3e80a7f1-349e-4692-9fbd-6e539d9e6d63\") " pod="openshift-image-registry/image-registry-69f8ccbdb8-kttn7"
Jul 21 01:22:45.860715 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:45.860642    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 01:22:45.860715 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.860662    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd-tmp-dir\") pod \"dns-default-qhbcs\" (UID: \"098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd\") " pod="openshift-dns/dns-default-qhbcs"
Jul 21 01:22:45.860715 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:45.860685    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd-metrics-tls podName:098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd nodeName:}" failed. No retries permitted until 2026-07-21 01:22:46.360670055 +0000 UTC m=+36.091038702 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd-metrics-tls") pod "dns-default-qhbcs" (UID: "098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd") : secret "dns-default-metrics-tls" not found
Jul 21 01:22:45.860988 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.860964    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-ca-trust-extracted\") pod \"image-registry-69f8ccbdb8-kttn7\" (UID: \"3e80a7f1-349e-4692-9fbd-6e539d9e6d63\") " pod="openshift-image-registry/image-registry-69f8ccbdb8-kttn7"
Jul 21 01:22:45.861162 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.861055    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-registry-certificates\") pod \"image-registry-69f8ccbdb8-kttn7\" (UID: \"3e80a7f1-349e-4692-9fbd-6e539d9e6d63\") " pod="openshift-image-registry/image-registry-69f8ccbdb8-kttn7"
Jul 21 01:22:45.864795 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.864762    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-installation-pull-secrets\") pod \"image-registry-69f8ccbdb8-kttn7\" (UID: \"3e80a7f1-349e-4692-9fbd-6e539d9e6d63\") " pod="openshift-image-registry/image-registry-69f8ccbdb8-kttn7"
Jul 21 01:22:45.864909 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.864814    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9056ad83-0493-4340-9642-90030b3c4ad0-cert\") pod \"ingress-canary-kmmsr\" (UID: \"9056ad83-0493-4340-9642-90030b3c4ad0\") " pod="openshift-ingress-canary/ingress-canary-kmmsr"
Jul 21 01:22:45.865150 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.865132    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-image-registry-private-configuration\") pod \"image-registry-69f8ccbdb8-kttn7\" (UID: \"3e80a7f1-349e-4692-9fbd-6e539d9e6d63\") " pod="openshift-image-registry/image-registry-69f8ccbdb8-kttn7"
Jul 21 01:22:45.871441 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.871390    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-995xx\" (UniqueName: \"kubernetes.io/projected/098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd-kube-api-access-995xx\") pod \"dns-default-qhbcs\" (UID: \"098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd\") " pod="openshift-dns/dns-default-qhbcs"
Jul 21 01:22:45.871780 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.871756    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8p4w\" (UniqueName: \"kubernetes.io/projected/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-kube-api-access-g8p4w\") pod \"image-registry-69f8ccbdb8-kttn7\" (UID: \"3e80a7f1-349e-4692-9fbd-6e539d9e6d63\") " pod="openshift-image-registry/image-registry-69f8ccbdb8-kttn7"
Jul 21 01:22:45.871881 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.871859    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8wrv\" (UniqueName: \"kubernetes.io/projected/9056ad83-0493-4340-9642-90030b3c4ad0-kube-api-access-f8wrv\") pod \"ingress-canary-kmmsr\" (UID: \"9056ad83-0493-4340-9642-90030b3c4ad0\") " pod="openshift-ingress-canary/ingress-canary-kmmsr"
Jul 21 01:22:45.873900 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.873881    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-bound-sa-token\") pod \"image-registry-69f8ccbdb8-kttn7\" (UID: \"3e80a7f1-349e-4692-9fbd-6e539d9e6d63\") " pod="openshift-image-registry/image-registry-69f8ccbdb8-kttn7"
Jul 21 01:22:45.988504 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:45.988426    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kmmsr"
Jul 21 01:22:46.135287 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:46.135055    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kmmsr"]
Jul 21 01:22:46.139481 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:46.139456    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9056ad83_0493_4340_9642_90030b3c4ad0.slice/crio-f199c41c11d5ec4f72e4de9ba83631134ac9e5d083462fc2455c92beb2d38eab WatchSource:0}: Error finding container f199c41c11d5ec4f72e4de9ba83631134ac9e5d083462fc2455c92beb2d38eab: Status 404 returned error can't find the container with id f199c41c11d5ec4f72e4de9ba83631134ac9e5d083462fc2455c92beb2d38eab
Jul 21 01:22:46.365561 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:46.365527    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-registry-tls\") pod \"image-registry-69f8ccbdb8-kttn7\" (UID: \"3e80a7f1-349e-4692-9fbd-6e539d9e6d63\") " pod="openshift-image-registry/image-registry-69f8ccbdb8-kttn7"
Jul 21 01:22:46.365758 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:46.365568    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd-metrics-tls\") pod \"dns-default-qhbcs\" (UID: \"098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd\") " pod="openshift-dns/dns-default-qhbcs"
Jul 21 01:22:46.365758 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:46.365703    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 01:22:46.365758 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:46.365718    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 01:22:46.365758 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:46.365723    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69f8ccbdb8-kttn7: secret "image-registry-tls" not found
Jul 21 01:22:46.365934 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:46.365784    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-registry-tls podName:3e80a7f1-349e-4692-9fbd-6e539d9e6d63 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:47.365765598 +0000 UTC m=+37.096134259 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-registry-tls") pod "image-registry-69f8ccbdb8-kttn7" (UID: "3e80a7f1-349e-4692-9fbd-6e539d9e6d63") : secret "image-registry-tls" not found
Jul 21 01:22:46.365934 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:46.365800    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd-metrics-tls podName:098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd nodeName:}" failed. No retries permitted until 2026-07-21 01:22:47.365792096 +0000 UTC m=+37.096160744 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd-metrics-tls") pod "dns-default-qhbcs" (UID: "098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd") : secret "dns-default-metrics-tls" not found
Jul 21 01:22:46.710149 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:46.710077    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6j8g9"
Jul 21 01:22:46.710714 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:46.710488    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4nls"
Jul 21 01:22:46.710846 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:46.710832    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpg98"
Jul 21 01:22:46.713919 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:46.713248    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 01:22:46.713919 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:46.713577    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 01:22:46.713919 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:46.713767    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 01:22:46.714585 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:46.714563    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 01:22:46.714796 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:46.714775    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-48mr4\""
Jul 21 01:22:46.714982 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:46.714962    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qrsnk\""
Jul 21 01:22:46.912599 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:46.912561    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kmmsr" event={"ID":"9056ad83-0493-4340-9642-90030b3c4ad0","Type":"ContainerStarted","Data":"f199c41c11d5ec4f72e4de9ba83631134ac9e5d083462fc2455c92beb2d38eab"}
Jul 21 01:22:47.373826 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:47.373789    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-registry-tls\") pod \"image-registry-69f8ccbdb8-kttn7\" (UID: \"3e80a7f1-349e-4692-9fbd-6e539d9e6d63\") " pod="openshift-image-registry/image-registry-69f8ccbdb8-kttn7"
Jul 21 01:22:47.373826 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:47.373830    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd-metrics-tls\") pod \"dns-default-qhbcs\" (UID: \"098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd\") " pod="openshift-dns/dns-default-qhbcs"
Jul 21 01:22:47.374067 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:47.373959    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 01:22:47.374067 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:47.374037    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd-metrics-tls podName:098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd nodeName:}" failed. No retries permitted until 2026-07-21 01:22:49.374015283 +0000 UTC m=+39.104383933 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd-metrics-tls") pod "dns-default-qhbcs" (UID: "098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd") : secret "dns-default-metrics-tls" not found
Jul 21 01:22:47.374067 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:47.373961    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 01:22:47.374249 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:47.374074    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69f8ccbdb8-kttn7: secret "image-registry-tls" not found
Jul 21 01:22:47.374249 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:47.374129    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-registry-tls podName:3e80a7f1-349e-4692-9fbd-6e539d9e6d63 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:49.374114455 +0000 UTC m=+39.104483103 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-registry-tls") pod "image-registry-69f8ccbdb8-kttn7" (UID: "3e80a7f1-349e-4692-9fbd-6e539d9e6d63") : secret "image-registry-tls" not found
Jul 21 01:22:47.469361 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:47.469326    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:48.581739 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:48.581700    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:48.633419 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:48.633382    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:49.030653 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:49.030627    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:49.088036 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:49.088003    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:49.175654 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:49.175629    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:49.181771 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:49.181749    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lmh88"]
Jul 21 01:22:49.202150 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:49.202120    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lmh88"]
Jul 21 01:22:49.202261 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:49.202236    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lmh88"
Jul 21 01:22:49.204949 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:49.204925    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 21 01:22:49.204949 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:49.204949    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-x266r\""
Jul 21 01:22:49.205097 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:49.204927    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 21 01:22:49.237032 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:49.237009    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:49.291412 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:49.291350    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbdlp\" (UniqueName: \"kubernetes.io/projected/a5111c80-940a-4c22-8960-63f1ace7b1d4-kube-api-access-vbdlp\") pod \"migrator-7cc9c7ffd7-lmh88\" (UID: \"a5111c80-940a-4c22-8960-63f1ace7b1d4\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lmh88"
Jul 21 01:22:49.318244 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:49.318215    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:49.357568 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:49.357535    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-sfq2c"]
Jul 21 01:22:49.381694 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:49.381672    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sfq2c"]
Jul 21 01:22:49.381809 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:49.381769    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sfq2c"
Jul 21 01:22:49.384389 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:49.384367    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 21 01:22:49.384502 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:49.384484    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 21 01:22:49.384727 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:49.384695    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 21 01:22:49.384727 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:49.384713    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fx296\""
Jul 21 01:22:49.384727 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:49.384719    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 21 01:22:49.390349 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:49.390317    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:49.391887 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:49.391867    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbdlp\" (UniqueName: \"kubernetes.io/projected/a5111c80-940a-4c22-8960-63f1ace7b1d4-kube-api-access-vbdlp\") pod \"migrator-7cc9c7ffd7-lmh88\" (UID: \"a5111c80-940a-4c22-8960-63f1ace7b1d4\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lmh88"
Jul 21 01:22:49.391977 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:49.391911    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-registry-tls\") pod \"image-registry-69f8ccbdb8-kttn7\" (UID: \"3e80a7f1-349e-4692-9fbd-6e539d9e6d63\") " pod="openshift-image-registry/image-registry-69f8ccbdb8-kttn7"
Jul 21 01:22:49.391977 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:49.391939    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd-metrics-tls\") pod \"dns-default-qhbcs\" (UID: \"098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd\") " pod="openshift-dns/dns-default-qhbcs"
Jul 21 01:22:49.392077 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:49.392007    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 01:22:49.392077 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:49.392021    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69f8ccbdb8-kttn7: secret "image-registry-tls" not found
Jul 21 01:22:49.392077 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:49.392061    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 01:22:49.392192 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:49.392064    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-registry-tls podName:3e80a7f1-349e-4692-9fbd-6e539d9e6d63 nodeName:}" failed. No retries permitted until 2026-07-21 01:22:53.392051426 +0000 UTC m=+43.122420074 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-registry-tls") pod "image-registry-69f8ccbdb8-kttn7" (UID: "3e80a7f1-349e-4692-9fbd-6e539d9e6d63") : secret "image-registry-tls" not found
Jul 21 01:22:49.392192 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:49.392120    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd-metrics-tls podName:098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd nodeName:}" failed. No retries permitted until 2026-07-21 01:22:53.39210443 +0000 UTC m=+43.122473085 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd-metrics-tls") pod "dns-default-qhbcs" (UID: "098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd") : secret "dns-default-metrics-tls" not found
Jul 21 01:22:49.404758 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:49.404729    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbdlp\" (UniqueName: \"kubernetes.io/projected/a5111c80-940a-4c22-8960-63f1ace7b1d4-kube-api-access-vbdlp\") pod \"migrator-7cc9c7ffd7-lmh88\" (UID: \"a5111c80-940a-4c22-8960-63f1ace7b1d4\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lmh88"
Jul 21 01:22:49.492950 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:49.492921    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df3bdff2-1267-40ea-8f92-4e201393382f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sfq2c\" (UID: \"df3bdff2-1267-40ea-8f92-4e201393382f\") " pod="openshift-insights/insights-runtime-extractor-sfq2c"
Jul 21 01:22:49.493040 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:49.493028    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/df3bdff2-1267-40ea-8f92-4e201393382f-crio-socket\") pod \"insights-runtime-extractor-sfq2c\" (UID: \"df3bdff2-1267-40ea-8f92-4e201393382f\") " pod="openshift-insights/insights-runtime-extractor-sfq2c"
Jul 21 01:22:49.493100 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:49.493075    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df3bdff2-1267-40ea-8f92-4e201393382f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sfq2c\" (UID: \"df3bdff2-1267-40ea-8f92-4e201393382f\") " pod="openshift-insights/insights-runtime-extractor-sfq2c"
Jul 21 01:22:49.493175 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:49.493102    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l679k\" (UniqueName: \"kubernetes.io/projected/df3bdff2-1267-40ea-8f92-4e201393382f-kube-api-access-l679k\") pod \"insights-runtime-extractor-sfq2c\" (UID: \"df3bdff2-1267-40ea-8f92-4e201393382f\") " pod="openshift-insights/insights-runtime-extractor-sfq2c"
Jul 21 01:22:49.493175 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:49.493135    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/df3bdff2-1267-40ea-8f92-4e201393382f-data-volume\") pod \"insights-runtime-extractor-sfq2c\" (UID: \"df3bdff2-1267-40ea-8f92-4e201393382f\") " pod="openshift-insights/insights-runtime-extractor-sfq2c"
Jul 21 01:22:49.510879 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:49.510857    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lmh88"
Jul 21 01:22:49.593754 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:49.593718    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df3bdff2-1267-40ea-8f92-4e201393382f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sfq2c\" (UID: \"df3bdff2-1267-40ea-8f92-4e201393382f\") " pod="openshift-insights/insights-runtime-extractor-sfq2c"
Jul 21 01:22:49.594149 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:49.593770    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l679k\" (UniqueName: \"kubernetes.io/projected/df3bdff2-1267-40ea-8f92-4e201393382f-kube-api-access-l679k\") pod \"insights-runtime-extractor-sfq2c\" (UID: \"df3bdff2-1267-40ea-8f92-4e201393382f\") " pod="openshift-insights/insights-runtime-extractor-sfq2c"
Jul 21 01:22:49.594149 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:49.593815    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/df3bdff2-1267-40ea-8f92-4e201393382f-data-volume\") pod \"insights-runtime-extractor-sfq2c\" (UID: \"df3bdff2-1267-40ea-8f92-4e201393382f\") " pod="openshift-insights/insights-runtime-extractor-sfq2c"
Jul 21 01:22:49.594149 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:49.593860    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df3bdff2-1267-40ea-8f92-4e201393382f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sfq2c\" (UID: \"df3bdff2-1267-40ea-8f92-4e201393382f\") " pod="openshift-insights/insights-runtime-extractor-sfq2c"
Jul 21 01:22:49.594149 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:49.593963    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/df3bdff2-1267-40ea-8f92-4e201393382f-crio-socket\") pod \"insights-runtime-extractor-sfq2c\" (UID: \"df3bdff2-1267-40ea-8f92-4e201393382f\") " pod="openshift-insights/insights-runtime-extractor-sfq2c"
Jul 21 01:22:49.594932 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:49.594230    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/df3bdff2-1267-40ea-8f92-4e201393382f-crio-socket\") pod \"insights-runtime-extractor-sfq2c\" (UID: \"df3bdff2-1267-40ea-8f92-4e201393382f\") " pod="openshift-insights/insights-runtime-extractor-sfq2c"
Jul 21 01:22:49.594932 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:49.594260    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 01:22:49.594932 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:49.594503    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df3bdff2-1267-40ea-8f92-4e201393382f-insights-runtime-extractor-tls podName:df3bdff2-1267-40ea-8f92-4e201393382f nodeName:}" failed. No retries permitted until 2026-07-21 01:22:50.094482219 +0000 UTC m=+39.824850866 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/df3bdff2-1267-40ea-8f92-4e201393382f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sfq2c" (UID: "df3bdff2-1267-40ea-8f92-4e201393382f") : secret "insights-runtime-extractor-tls" not found
Jul 21 01:22:49.594932 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:49.594703    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 01:22:49.594932 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:49.594755    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/df3bdff2-1267-40ea-8f92-4e201393382f-kube-rbac-proxy-cm podName:df3bdff2-1267-40ea-8f92-4e201393382f nodeName:}" failed. No retries permitted until 2026-07-21 01:22:50.094740451 +0000 UTC m=+39.825109101 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/df3bdff2-1267-40ea-8f92-4e201393382f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sfq2c" (UID: "df3bdff2-1267-40ea-8f92-4e201393382f") : configmap "kube-rbac-proxy" not found
Jul 21 01:22:49.595280 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:49.595255    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/df3bdff2-1267-40ea-8f92-4e201393382f-data-volume\") pod \"insights-runtime-extractor-sfq2c\" (UID: \"df3bdff2-1267-40ea-8f92-4e201393382f\") " pod="openshift-insights/insights-runtime-extractor-sfq2c"
Jul 21 01:22:49.606790 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:49.606763    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l679k\" (UniqueName: \"kubernetes.io/projected/df3bdff2-1267-40ea-8f92-4e201393382f-kube-api-access-l679k\") pod \"insights-runtime-extractor-sfq2c\" (UID: \"df3bdff2-1267-40ea-8f92-4e201393382f\") " pod="openshift-insights/insights-runtime-extractor-sfq2c"
Jul 21 01:22:49.660260 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:49.660045    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lmh88"]
Jul 21 01:22:49.663632 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:49.663602    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5111c80_940a_4c22_8960_63f1ace7b1d4.slice/crio-d5ddd22a26afa3c1bbaa9cbdbda2442e04d883a8e76532a3025a2c88e8e8578a WatchSource:0}: Error finding container d5ddd22a26afa3c1bbaa9cbdbda2442e04d883a8e76532a3025a2c88e8e8578a: Status 404 returned error can't find the container with id d5ddd22a26afa3c1bbaa9cbdbda2442e04d883a8e76532a3025a2c88e8e8578a
Jul 21 01:22:49.921059 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:49.920976    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kmmsr" event={"ID":"9056ad83-0493-4340-9642-90030b3c4ad0","Type":"ContainerStarted","Data":"0212daaf01799cd0710be43115ac0191b7c8f5840b13cf03a88904013b55906e"}
Jul 21 01:22:49.922098 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:49.922077    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lmh88" event={"ID":"a5111c80-940a-4c22-8960-63f1ace7b1d4","Type":"ContainerStarted","Data":"d5ddd22a26afa3c1bbaa9cbdbda2442e04d883a8e76532a3025a2c88e8e8578a"}
Jul 21 01:22:49.924753 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:49.924730    2561 generic.go:356] "Generic (PLEG): container finished" podID="2ce45c65-d65b-4537-8de3-1bc541026538" containerID="a0985440ee69c0a6de57f11bc7caedccc0cda9e028b2eb50ec03721493c3bef7" exitCode=0
Jul 21 01:22:49.924830 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:49.924768    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2gzwb" event={"ID":"2ce45c65-d65b-4537-8de3-1bc541026538","Type":"ContainerDied","Data":"a0985440ee69c0a6de57f11bc7caedccc0cda9e028b2eb50ec03721493c3bef7"}
Jul 21 01:22:49.937590 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:49.937552    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kmmsr" podStartSLOduration=1.6035326479999998 podStartE2EDuration="4.937538318s" totalImagesPullingTime="3.33400567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:22:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:22:49.936757987 +0000 UTC m=+39.667126657" watchObservedRunningTime="2026-07-21 01:22:49.937538318 +0000 UTC m=+39.667906988"
Jul 21 01:22:50.097816 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:50.097794    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df3bdff2-1267-40ea-8f92-4e201393382f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sfq2c\" (UID: \"df3bdff2-1267-40ea-8f92-4e201393382f\") " pod="openshift-insights/insights-runtime-extractor-sfq2c"
Jul 21 01:22:50.097970 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:50.097950    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 01:22:50.098029 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:50.097968    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df3bdff2-1267-40ea-8f92-4e201393382f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sfq2c\" (UID: \"df3bdff2-1267-40ea-8f92-4e201393382f\") " pod="openshift-insights/insights-runtime-extractor-sfq2c"
Jul 21 01:22:50.098029 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:50.098019    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df3bdff2-1267-40ea-8f92-4e201393382f-insights-runtime-extractor-tls podName:df3bdff2-1267-40ea-8f92-4e201393382f nodeName:}" failed. No retries permitted until 2026-07-21 01:22:51.097998191 +0000 UTC m=+40.828366841 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/df3bdff2-1267-40ea-8f92-4e201393382f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sfq2c" (UID: "df3bdff2-1267-40ea-8f92-4e201393382f") : secret "insights-runtime-extractor-tls" not found
Jul 21 01:22:50.098144 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:50.098042    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 01:22:50.098144 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:50.098097    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/df3bdff2-1267-40ea-8f92-4e201393382f-kube-rbac-proxy-cm podName:df3bdff2-1267-40ea-8f92-4e201393382f nodeName:}" failed. No retries permitted until 2026-07-21 01:22:51.098077673 +0000 UTC m=+40.828446335 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/df3bdff2-1267-40ea-8f92-4e201393382f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sfq2c" (UID: "df3bdff2-1267-40ea-8f92-4e201393382f") : configmap "kube-rbac-proxy" not found
Jul 21 01:22:50.891082 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:50.891045    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-5ghfw"]
Jul 21 01:22:50.910323 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:50.910295    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-5ghfw"
Jul 21 01:22:50.914085 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:50.914057    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 21 01:22:50.914251 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:50.914229    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-5ghfw"]
Jul 21 01:22:50.914358 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:50.914340    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 21 01:22:50.914472 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:50.914453    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-p69lt\""
Jul 21 01:22:50.914729 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:50.914562    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 21 01:22:50.915154 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:50.915138    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 21 01:22:50.926310 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:50.926274    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:50.930534 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:50.930507    2561 generic.go:356] "Generic (PLEG): container finished" podID="2ce45c65-d65b-4537-8de3-1bc541026538" containerID="52d74de79bc0219a599d66384e7d9af746c3decef19ff74c5f411be1d32c6ef2" exitCode=0
Jul 21 01:22:50.930623 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:50.930573    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2gzwb" event={"ID":"2ce45c65-d65b-4537-8de3-1bc541026538","Type":"ContainerDied","Data":"52d74de79bc0219a599d66384e7d9af746c3decef19ff74c5f411be1d32c6ef2"}
Jul 21 01:22:50.993966 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:50.993919    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:51.005009 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:51.004984    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/53e3a75d-2bc2-4232-a84f-04e8c51c4864-signing-key\") pod \"service-ca-58598695f7-5ghfw\" (UID: \"53e3a75d-2bc2-4232-a84f-04e8c51c4864\") " pod="openshift-service-ca/service-ca-58598695f7-5ghfw"
Jul 21 01:22:51.005091 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:51.005012    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/53e3a75d-2bc2-4232-a84f-04e8c51c4864-signing-cabundle\") pod \"service-ca-58598695f7-5ghfw\" (UID: \"53e3a75d-2bc2-4232-a84f-04e8c51c4864\") " pod="openshift-service-ca/service-ca-58598695f7-5ghfw"
Jul 21 01:22:51.005091 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:51.005054    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjwxv\" (UniqueName: \"kubernetes.io/projected/53e3a75d-2bc2-4232-a84f-04e8c51c4864-kube-api-access-rjwxv\") pod \"service-ca-58598695f7-5ghfw\" (UID: \"53e3a75d-2bc2-4232-a84f-04e8c51c4864\") " pod="openshift-service-ca/service-ca-58598695f7-5ghfw"
Jul 21 01:22:51.105710 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:51.105686    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjwxv\" (UniqueName: \"kubernetes.io/projected/53e3a75d-2bc2-4232-a84f-04e8c51c4864-kube-api-access-rjwxv\") pod \"service-ca-58598695f7-5ghfw\" (UID: \"53e3a75d-2bc2-4232-a84f-04e8c51c4864\") " pod="openshift-service-ca/service-ca-58598695f7-5ghfw"
Jul 21 01:22:51.105800 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:51.105757    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df3bdff2-1267-40ea-8f92-4e201393382f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sfq2c\" (UID: \"df3bdff2-1267-40ea-8f92-4e201393382f\") " pod="openshift-insights/insights-runtime-extractor-sfq2c"
Jul 21 01:22:51.105899 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:51.105871    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/53e3a75d-2bc2-4232-a84f-04e8c51c4864-signing-key\") pod \"service-ca-58598695f7-5ghfw\" (UID: \"53e3a75d-2bc2-4232-a84f-04e8c51c4864\") " pod="openshift-service-ca/service-ca-58598695f7-5ghfw"
Jul 21 01:22:51.106019 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:51.105902    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/53e3a75d-2bc2-4232-a84f-04e8c51c4864-signing-cabundle\") pod \"service-ca-58598695f7-5ghfw\" (UID: \"53e3a75d-2bc2-4232-a84f-04e8c51c4864\") " pod="openshift-service-ca/service-ca-58598695f7-5ghfw"
Jul 21 01:22:51.106019 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:51.105943    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df3bdff2-1267-40ea-8f92-4e201393382f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sfq2c\" (UID: \"df3bdff2-1267-40ea-8f92-4e201393382f\") " pod="openshift-insights/insights-runtime-extractor-sfq2c"
Jul 21 01:22:51.106019 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:51.105976    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 01:22:51.106148 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:51.106063    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 01:22:51.106148 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:51.106095    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/df3bdff2-1267-40ea-8f92-4e201393382f-kube-rbac-proxy-cm podName:df3bdff2-1267-40ea-8f92-4e201393382f nodeName:}" failed. No retries permitted until 2026-07-21 01:22:53.106058254 +0000 UTC m=+42.836426906 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/df3bdff2-1267-40ea-8f92-4e201393382f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sfq2c" (UID: "df3bdff2-1267-40ea-8f92-4e201393382f") : configmap "kube-rbac-proxy" not found
Jul 21 01:22:51.106148 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:51.106121    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df3bdff2-1267-40ea-8f92-4e201393382f-insights-runtime-extractor-tls podName:df3bdff2-1267-40ea-8f92-4e201393382f nodeName:}" failed. No retries permitted until 2026-07-21 01:22:53.106105154 +0000 UTC m=+42.836473802 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/df3bdff2-1267-40ea-8f92-4e201393382f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sfq2c" (UID: "df3bdff2-1267-40ea-8f92-4e201393382f") : secret "insights-runtime-extractor-tls" not found
Jul 21 01:22:51.106623 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:51.106601    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/53e3a75d-2bc2-4232-a84f-04e8c51c4864-signing-cabundle\") pod \"service-ca-58598695f7-5ghfw\" (UID: \"53e3a75d-2bc2-4232-a84f-04e8c51c4864\") " pod="openshift-service-ca/service-ca-58598695f7-5ghfw"
Jul 21 01:22:51.108968 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:51.108949    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/53e3a75d-2bc2-4232-a84f-04e8c51c4864-signing-key\") pod \"service-ca-58598695f7-5ghfw\" (UID: \"53e3a75d-2bc2-4232-a84f-04e8c51c4864\") " pod="openshift-service-ca/service-ca-58598695f7-5ghfw"
Jul 21 01:22:51.114554 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:51.114531    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjwxv\" (UniqueName: \"kubernetes.io/projected/53e3a75d-2bc2-4232-a84f-04e8c51c4864-kube-api-access-rjwxv\") pod \"service-ca-58598695f7-5ghfw\" (UID: \"53e3a75d-2bc2-4232-a84f-04e8c51c4864\") " pod="openshift-service-ca/service-ca-58598695f7-5ghfw"
Jul 21 01:22:51.221660 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:51.221632    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-5ghfw"
Jul 21 01:22:51.515634 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:51.515605    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-5ghfw"]
Jul 21 01:22:51.518229 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:22:51.518169    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53e3a75d_2bc2_4232_a84f_04e8c51c4864.slice/crio-eef8675d7970fb16c7c7a052f6e59c241034108bfb0ff6decb462ee7b8bb3e62 WatchSource:0}: Error finding container eef8675d7970fb16c7c7a052f6e59c241034108bfb0ff6decb462ee7b8bb3e62: Status 404 returned error can't find the container with id eef8675d7970fb16c7c7a052f6e59c241034108bfb0ff6decb462ee7b8bb3e62
Jul 21 01:22:51.539369 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:51.539348    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4zvd6_8ab4dce6-4fd1-4202-8c35-08253d62ae38/dns-node-resolver/0.log"
Jul 21 01:22:51.833466 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:51.833435    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:51.936394 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:51.936358    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2gzwb" event={"ID":"2ce45c65-d65b-4537-8de3-1bc541026538","Type":"ContainerStarted","Data":"68682cd0bb9615757f48c32d90d3d434d6d5176f12ad2e7aff8639949b413055"}
Jul 21 01:22:51.938020 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:51.937997    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lmh88" event={"ID":"a5111c80-940a-4c22-8960-63f1ace7b1d4","Type":"ContainerStarted","Data":"a736207143ec15ab1eacbcf8283763d4aff4d3b95d5c2af768f8c5093eddd592"}
Jul 21 01:22:51.938136 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:51.938047    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lmh88" event={"ID":"a5111c80-940a-4c22-8960-63f1ace7b1d4","Type":"ContainerStarted","Data":"a619891baaa618f13b0c130afb3b0f16913434b0255709c97d597c38910a0680"}
Jul 21 01:22:51.939015 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:51.938997    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-5ghfw" event={"ID":"53e3a75d-2bc2-4232-a84f-04e8c51c4864","Type":"ContainerStarted","Data":"eef8675d7970fb16c7c7a052f6e59c241034108bfb0ff6decb462ee7b8bb3e62"}
Jul 21 01:22:51.972951 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:51.972896    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2gzwb" podStartSLOduration=9.901150051 podStartE2EDuration="41.972880414s" totalImagesPullingTime="32.071730363s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:22:10 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:22:51.971409616 +0000 UTC m=+41.701778285" watchObservedRunningTime="2026-07-21 01:22:51.972880414 +0000 UTC m=+41.703249084"
Jul 21 01:22:51.989617 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:51.989558    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lmh88" podStartSLOduration=1.259510011 podStartE2EDuration="2.989541219s" totalImagesPullingTime="1.730031208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:22:51.988588879 +0000 UTC m=+41.718957548" watchObservedRunningTime="2026-07-21 01:22:51.989541219 +0000 UTC m=+41.719909888"
Jul 21 01:22:52.019833 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:52.019802    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:52.139601 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:52.139521    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:52.740128 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:52.740099    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cfqrc_f31b4061-dd8c-44fa-bd6c-601d8f373be2/node-ca/0.log"
Jul 21 01:22:53.123002 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:53.122964    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df3bdff2-1267-40ea-8f92-4e201393382f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sfq2c\" (UID: \"df3bdff2-1267-40ea-8f92-4e201393382f\") " pod="openshift-insights/insights-runtime-extractor-sfq2c"
Jul 21 01:22:53.123504 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:53.123075    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 01:22:53.123504 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:53.123146    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/df3bdff2-1267-40ea-8f92-4e201393382f-kube-rbac-proxy-cm podName:df3bdff2-1267-40ea-8f92-4e201393382f nodeName:}" failed. No retries permitted until 2026-07-21 01:22:57.123125002 +0000 UTC m=+46.853493652 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/df3bdff2-1267-40ea-8f92-4e201393382f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sfq2c" (UID: "df3bdff2-1267-40ea-8f92-4e201393382f") : configmap "kube-rbac-proxy" not found
Jul 21 01:22:53.123504 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:53.123336    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df3bdff2-1267-40ea-8f92-4e201393382f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sfq2c\" (UID: \"df3bdff2-1267-40ea-8f92-4e201393382f\") " pod="openshift-insights/insights-runtime-extractor-sfq2c"
Jul 21 01:22:53.123504 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:53.123474    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 01:22:53.123703 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:53.123525    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df3bdff2-1267-40ea-8f92-4e201393382f-insights-runtime-extractor-tls podName:df3bdff2-1267-40ea-8f92-4e201393382f nodeName:}" failed. No retries permitted until 2026-07-21 01:22:57.123513916 +0000 UTC m=+46.853882564 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/df3bdff2-1267-40ea-8f92-4e201393382f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sfq2c" (UID: "df3bdff2-1267-40ea-8f92-4e201393382f") : secret "insights-runtime-extractor-tls" not found
Jul 21 01:22:53.425139 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:53.425052    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-registry-tls\") pod \"image-registry-69f8ccbdb8-kttn7\" (UID: \"3e80a7f1-349e-4692-9fbd-6e539d9e6d63\") " pod="openshift-image-registry/image-registry-69f8ccbdb8-kttn7"
Jul 21 01:22:53.425139 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:53.425091    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd-metrics-tls\") pod \"dns-default-qhbcs\" (UID: \"098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd\") " pod="openshift-dns/dns-default-qhbcs"
Jul 21 01:22:53.425377 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:53.425217    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 01:22:53.425377 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:53.425232    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 01:22:53.425377 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:53.425255    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69f8ccbdb8-kttn7: secret "image-registry-tls" not found
Jul 21 01:22:53.425377 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:53.425294    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd-metrics-tls podName:098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd nodeName:}" failed. No retries permitted until 2026-07-21 01:23:01.425275315 +0000 UTC m=+51.155643963 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd-metrics-tls") pod "dns-default-qhbcs" (UID: "098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd") : secret "dns-default-metrics-tls" not found
Jul 21 01:22:53.425377 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:53.425314    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-registry-tls podName:3e80a7f1-349e-4692-9fbd-6e539d9e6d63 nodeName:}" failed. No retries permitted until 2026-07-21 01:23:01.425304423 +0000 UTC m=+51.155673073 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-registry-tls") pod "image-registry-69f8ccbdb8-kttn7" (UID: "3e80a7f1-349e-4692-9fbd-6e539d9e6d63") : secret "image-registry-tls" not found
Jul 21 01:22:53.539364 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:53.539321    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kmmsr_9056ad83-0493-4340-9642-90030b3c4ad0/serve-healthcheck-canary/0.log"
Jul 21 01:22:53.739803 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:53.739700    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-lmh88_a5111c80-940a-4c22-8960-63f1ace7b1d4/migrator/0.log"
Jul 21 01:22:53.940250 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:53.940181    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-lmh88_a5111c80-940a-4c22-8960-63f1ace7b1d4/graceful-termination/0.log"
Jul 21 01:22:54.861800 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:54.861757    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:54.955224 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:54.951590    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-5ghfw" event={"ID":"53e3a75d-2bc2-4232-a84f-04e8c51c4864","Type":"ContainerStarted","Data":"80fb3c4ad5656ff4d2b7eab7664b802a460a09e21f2f461a88a09e27195e4187"}
Jul 21 01:22:54.973793 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:54.973745    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-5ghfw" podStartSLOduration=2.6318333210000002 podStartE2EDuration="4.973731658s" totalImagesPullingTime="2.341898337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:22:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:22:54.973061945 +0000 UTC m=+44.703430618" watchObservedRunningTime="2026-07-21 01:22:54.973731658 +0000 UTC m=+44.704100328"
Jul 21 01:22:54.977888 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:54.977858    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:55.058925 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:55.058898    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:55.201218 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:55.201131    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:55.327604 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:55.327568    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:55.428829 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:55.428794    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:55.525535 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:55.525499    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:55.625440 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:55.625407    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:56.553377 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:56.553340    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:56.755480 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:56.755448    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:57.156780 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:57.156750    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df3bdff2-1267-40ea-8f92-4e201393382f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sfq2c\" (UID: \"df3bdff2-1267-40ea-8f92-4e201393382f\") " pod="openshift-insights/insights-runtime-extractor-sfq2c"
Jul 21 01:22:57.156951 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:57.156799    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df3bdff2-1267-40ea-8f92-4e201393382f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sfq2c\" (UID: \"df3bdff2-1267-40ea-8f92-4e201393382f\") " pod="openshift-insights/insights-runtime-extractor-sfq2c"
Jul 21 01:22:57.156951 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:57.156875    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 01:22:57.156951 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:57.156925    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 01:22:57.156951 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:57.156937    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/df3bdff2-1267-40ea-8f92-4e201393382f-kube-rbac-proxy-cm podName:df3bdff2-1267-40ea-8f92-4e201393382f nodeName:}" failed. No retries permitted until 2026-07-21 01:23:05.156922635 +0000 UTC m=+54.887291286 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/df3bdff2-1267-40ea-8f92-4e201393382f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sfq2c" (UID: "df3bdff2-1267-40ea-8f92-4e201393382f") : configmap "kube-rbac-proxy" not found
Jul 21 01:22:57.157114 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:22:57.156986    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df3bdff2-1267-40ea-8f92-4e201393382f-insights-runtime-extractor-tls podName:df3bdff2-1267-40ea-8f92-4e201393382f nodeName:}" failed. No retries permitted until 2026-07-21 01:23:05.156968118 +0000 UTC m=+54.887336768 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/df3bdff2-1267-40ea-8f92-4e201393382f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sfq2c" (UID: "df3bdff2-1267-40ea-8f92-4e201393382f") : secret "insights-runtime-extractor-tls" not found
Jul 21 01:22:57.160533 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:57.160500    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:57.356491 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:57.356459    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:57.955036 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:57.955006    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:58.563043 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:58.563006    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:58.664420 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:58.664388    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:58.769451 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:58.769420    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:59.178813 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:59.178780    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:59.364238 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:59.364193    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:59.448276 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:59.448183    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:22:59.965876 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:22:59.965850    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:00.357446 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:00.357415    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:00.752174 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:00.752104    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:00.853141 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:00.853114    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:00.909941 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:00.909914    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:01.161328 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:01.161293    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:01.262251 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:01.262225    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:01.492958 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:01.492876    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-registry-tls\") pod \"image-registry-69f8ccbdb8-kttn7\" (UID: \"3e80a7f1-349e-4692-9fbd-6e539d9e6d63\") " pod="openshift-image-registry/image-registry-69f8ccbdb8-kttn7"
Jul 21 01:23:01.492958 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:01.492912    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd-metrics-tls\") pod \"dns-default-qhbcs\" (UID: \"098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd\") " pod="openshift-dns/dns-default-qhbcs"
Jul 21 01:23:01.495319 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:01.495296    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd-metrics-tls\") pod \"dns-default-qhbcs\" (UID: \"098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd\") " pod="openshift-dns/dns-default-qhbcs"
Jul 21 01:23:01.495422 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:01.495366    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-registry-tls\") pod \"image-registry-69f8ccbdb8-kttn7\" (UID: \"3e80a7f1-349e-4692-9fbd-6e539d9e6d63\") " pod="openshift-image-registry/image-registry-69f8ccbdb8-kttn7"
Jul 21 01:23:01.556149 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:01.556119    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:01.570286 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:01.570266    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69f8ccbdb8-kttn7"
Jul 21 01:23:01.582378 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:01.582356    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qhbcs"
Jul 21 01:23:01.725975 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:01.725950    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-69f8ccbdb8-kttn7"]
Jul 21 01:23:01.728587 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:23:01.728561    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e80a7f1_349e_4692_9fbd_6e539d9e6d63.slice/crio-ca07b11f60b884d90c82176ef569192815964940491b24bce8934a9d362c731e WatchSource:0}: Error finding container ca07b11f60b884d90c82176ef569192815964940491b24bce8934a9d362c731e: Status 404 returned error can't find the container with id ca07b11f60b884d90c82176ef569192815964940491b24bce8934a9d362c731e
Jul 21 01:23:01.739119 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:01.739095    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qhbcs"]
Jul 21 01:23:01.741445 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:23:01.741421    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod098fdc6d_6eb4_40e7_b29a_7ca1ad9cf4fd.slice/crio-97fff98f6627b27a2a99d932d35c82403a7b34cecfe628c541520b98cbdc7171 WatchSource:0}: Error finding container 97fff98f6627b27a2a99d932d35c82403a7b34cecfe628c541520b98cbdc7171: Status 404 returned error can't find the container with id 97fff98f6627b27a2a99d932d35c82403a7b34cecfe628c541520b98cbdc7171
Jul 21 01:23:01.758554 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:01.758525    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:01.971423 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:01.971387    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69f8ccbdb8-kttn7" event={"ID":"3e80a7f1-349e-4692-9fbd-6e539d9e6d63","Type":"ContainerStarted","Data":"ac7ba0adac00aa334293de70c84a0159e6214c137298a0ea3c408c180b8897aa"}
Jul 21 01:23:01.971589 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:01.971443    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69f8ccbdb8-kttn7" event={"ID":"3e80a7f1-349e-4692-9fbd-6e539d9e6d63","Type":"ContainerStarted","Data":"ca07b11f60b884d90c82176ef569192815964940491b24bce8934a9d362c731e"}
Jul 21 01:23:01.971589 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:01.971473    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-69f8ccbdb8-kttn7"
Jul 21 01:23:01.972580 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:01.972557    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qhbcs" event={"ID":"098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd","Type":"ContainerStarted","Data":"97fff98f6627b27a2a99d932d35c82403a7b34cecfe628c541520b98cbdc7171"}
Jul 21 01:23:01.990558 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:01.990502    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-69f8ccbdb8-kttn7" podStartSLOduration=58.990483896 podStartE2EDuration="58.990483896s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:22:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:23:01.989798587 +0000 UTC m=+51.720167256" watchObservedRunningTime="2026-07-21 01:23:01.990483896 +0000 UTC m=+51.720852566"
Jul 21 01:23:02.157053 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:02.157016    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:02.259190 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:02.259156    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:02.756550 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:02.756508    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:02.861406 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:02.861370    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:03.360046 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:03.360011    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:03.555381 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:03.555342    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:03.956442 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:03.956410    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:04.155378 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:04.155346    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:04.557543 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:04.557508    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:04.986268 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:04.986165    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qhbcs" event={"ID":"098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd","Type":"ContainerStarted","Data":"35e2854f7cff21f85ec32f931ea2bf9c739c09218e26c1ffdd4c049ab66c8a4a"}
Jul 21 01:23:04.986268 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:04.986232    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qhbcs" event={"ID":"098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd","Type":"ContainerStarted","Data":"b5247ea62db9519631ba20d3503a8e56d36b4b7db13b4897b04633b07c4aef00"}
Jul 21 01:23:04.986688 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:04.986309    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qhbcs"
Jul 21 01:23:05.005920 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:05.005869    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qhbcs" podStartSLOduration=17.615976978 podStartE2EDuration="20.005853799s" totalImagesPullingTime="2.389876821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:22:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:23:05.00418556 +0000 UTC m=+54.734554258" watchObservedRunningTime="2026-07-21 01:23:05.005853799 +0000 UTC m=+54.736222468"
Jul 21 01:23:05.159904 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:05.159875    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:05.226119 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:05.226084    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df3bdff2-1267-40ea-8f92-4e201393382f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sfq2c\" (UID: \"df3bdff2-1267-40ea-8f92-4e201393382f\") " pod="openshift-insights/insights-runtime-extractor-sfq2c"
Jul 21 01:23:05.226284 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:05.226169    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df3bdff2-1267-40ea-8f92-4e201393382f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sfq2c\" (UID: \"df3bdff2-1267-40ea-8f92-4e201393382f\") " pod="openshift-insights/insights-runtime-extractor-sfq2c"
Jul 21 01:23:05.226635 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:05.226608    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df3bdff2-1267-40ea-8f92-4e201393382f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sfq2c\" (UID: \"df3bdff2-1267-40ea-8f92-4e201393382f\") " pod="openshift-insights/insights-runtime-extractor-sfq2c"
Jul 21 01:23:05.228544 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:05.228510    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df3bdff2-1267-40ea-8f92-4e201393382f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sfq2c\" (UID: \"df3bdff2-1267-40ea-8f92-4e201393382f\") " pod="openshift-insights/insights-runtime-extractor-sfq2c"
Jul 21 01:23:05.290587 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:05.290556    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sfq2c"
Jul 21 01:23:05.356097 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:05.356063    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:05.413375 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:05.413330    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sfq2c"]
Jul 21 01:23:05.415703 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:23:05.415675    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf3bdff2_1267_40ea_8f92_4e201393382f.slice/crio-b8c18b31534cb8c8ee856605fc9ea5e2ba2a9bfb0d46cb978fe3da66914af86e WatchSource:0}: Error finding container b8c18b31534cb8c8ee856605fc9ea5e2ba2a9bfb0d46cb978fe3da66914af86e: Status 404 returned error can't find the container with id b8c18b31534cb8c8ee856605fc9ea5e2ba2a9bfb0d46cb978fe3da66914af86e
Jul 21 01:23:05.558385 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:05.558302    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:05.994289 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:05.994187    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sfq2c" event={"ID":"df3bdff2-1267-40ea-8f92-4e201393382f","Type":"ContainerStarted","Data":"b8c18b31534cb8c8ee856605fc9ea5e2ba2a9bfb0d46cb978fe3da66914af86e"}
Jul 21 01:23:07.022918 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:07.022854    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:07.129804 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:07.129739    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:11.016426 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:11.016347    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sfq2c" event={"ID":"df3bdff2-1267-40ea-8f92-4e201393382f","Type":"ContainerStarted","Data":"703c6c4ed6f00634e32b2522133e46d94b20238981d898dbe7943bbdd6f9e0e7"}
Jul 21 01:23:11.909278 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:11.909246    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2p4wt"
Jul 21 01:23:13.249084 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.249046    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d8b8cf9f6-wtwff"]
Jul 21 01:23:13.262371 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.262344    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5794988c97-j46kb"]
Jul 21 01:23:13.262573 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.262454    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d8b8cf9f6-wtwff"
Jul 21 01:23:13.265387 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.265352    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 21 01:23:13.265554 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.265536    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 21 01:23:13.266931 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.266913    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 21 01:23:13.267230 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.267213    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-b87th\""
Jul 21 01:23:13.267396 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.267381    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 21 01:23:13.274642 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.274624    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d8b8cf9f6-wtwff"]
Jul 21 01:23:13.274642 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.274651    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5794988c97-j46kb"]
Jul 21 01:23:13.274803 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.274728    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5794988c97-j46kb"
Jul 21 01:23:13.278397 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.278373    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 21 01:23:13.278649 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.278631    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 21 01:23:13.278865 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.278838    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 21 01:23:13.279050 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.279031    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 21 01:23:13.285808 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.285780    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j569m\" (UniqueName: \"kubernetes.io/projected/137022bd-d60e-46a4-80f1-c61bfeba5048-kube-api-access-j569m\") pod \"managed-serviceaccount-addon-agent-5d8b8cf9f6-wtwff\" (UID: \"137022bd-d60e-46a4-80f1-c61bfeba5048\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d8b8cf9f6-wtwff"
Jul 21 01:23:13.285957 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.285931    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/137022bd-d60e-46a4-80f1-c61bfeba5048-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5d8b8cf9f6-wtwff\" (UID: \"137022bd-d60e-46a4-80f1-c61bfeba5048\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d8b8cf9f6-wtwff"
Jul 21 01:23:13.344803 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.344765    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-69f8ccbdb8-kttn7"]
Jul 21 01:23:13.386486 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.386456    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b332724a-1bb4-4be7-8065-cf42fd36bfc3-hub\") pod \"cluster-proxy-proxy-agent-5794988c97-j46kb\" (UID: \"b332724a-1bb4-4be7-8065-cf42fd36bfc3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5794988c97-j46kb"
Jul 21 01:23:13.386668 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.386495    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b332724a-1bb4-4be7-8065-cf42fd36bfc3-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5794988c97-j46kb\" (UID: \"b332724a-1bb4-4be7-8065-cf42fd36bfc3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5794988c97-j46kb"
Jul 21 01:23:13.386668 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.386521    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j569m\" (UniqueName: \"kubernetes.io/projected/137022bd-d60e-46a4-80f1-c61bfeba5048-kube-api-access-j569m\") pod \"managed-serviceaccount-addon-agent-5d8b8cf9f6-wtwff\" (UID: \"137022bd-d60e-46a4-80f1-c61bfeba5048\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d8b8cf9f6-wtwff"
Jul 21 01:23:13.386668 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.386540    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56sv5\" (UniqueName: \"kubernetes.io/projected/b332724a-1bb4-4be7-8065-cf42fd36bfc3-kube-api-access-56sv5\") pod \"cluster-proxy-proxy-agent-5794988c97-j46kb\" (UID: \"b332724a-1bb4-4be7-8065-cf42fd36bfc3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5794988c97-j46kb"
Jul 21 01:23:13.386841 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.386665    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/137022bd-d60e-46a4-80f1-c61bfeba5048-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5d8b8cf9f6-wtwff\" (UID: \"137022bd-d60e-46a4-80f1-c61bfeba5048\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d8b8cf9f6-wtwff"
Jul 21 01:23:13.386841 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.386708    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b332724a-1bb4-4be7-8065-cf42fd36bfc3-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5794988c97-j46kb\" (UID: \"b332724a-1bb4-4be7-8065-cf42fd36bfc3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5794988c97-j46kb"
Jul 21 01:23:13.386841 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.386740    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b332724a-1bb4-4be7-8065-cf42fd36bfc3-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5794988c97-j46kb\" (UID: \"b332724a-1bb4-4be7-8065-cf42fd36bfc3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5794988c97-j46kb"
Jul 21 01:23:13.386841 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.386797    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b332724a-1bb4-4be7-8065-cf42fd36bfc3-ca\") pod \"cluster-proxy-proxy-agent-5794988c97-j46kb\" (UID: \"b332724a-1bb4-4be7-8065-cf42fd36bfc3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5794988c97-j46kb"
Jul 21 01:23:13.389645 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.389395    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/137022bd-d60e-46a4-80f1-c61bfeba5048-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5d8b8cf9f6-wtwff\" (UID: \"137022bd-d60e-46a4-80f1-c61bfeba5048\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d8b8cf9f6-wtwff"
Jul 21 01:23:13.395415 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.395395    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8ccddf454-2zz49"]
Jul 21 01:23:13.395988 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.395932    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:13.400262 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.400242    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8ccddf454-2zz49"
Jul 21 01:23:13.404092 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.404062    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j569m\" (UniqueName: \"kubernetes.io/projected/137022bd-d60e-46a4-80f1-c61bfeba5048-kube-api-access-j569m\") pod \"managed-serviceaccount-addon-agent-5d8b8cf9f6-wtwff\" (UID: \"137022bd-d60e-46a4-80f1-c61bfeba5048\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d8b8cf9f6-wtwff"
Jul 21 01:23:13.417944 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.417924    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8ccddf454-2zz49"]
Jul 21 01:23:13.485074 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.485038    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:13.488076 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.488051    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b332724a-1bb4-4be7-8065-cf42fd36bfc3-ca\") pod \"cluster-proxy-proxy-agent-5794988c97-j46kb\" (UID: \"b332724a-1bb4-4be7-8065-cf42fd36bfc3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5794988c97-j46kb"
Jul 21 01:23:13.488224 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.488094    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7a451f56-01d4-4ab3-af25-470792468eec-image-registry-private-configuration\") pod \"image-registry-8ccddf454-2zz49\" (UID: \"7a451f56-01d4-4ab3-af25-470792468eec\") " pod="openshift-image-registry/image-registry-8ccddf454-2zz49"
Jul 21 01:23:13.488550 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.488314    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs4c6\" (UniqueName: \"kubernetes.io/projected/7a451f56-01d4-4ab3-af25-470792468eec-kube-api-access-gs4c6\") pod \"image-registry-8ccddf454-2zz49\" (UID: \"7a451f56-01d4-4ab3-af25-470792468eec\") " pod="openshift-image-registry/image-registry-8ccddf454-2zz49"
Jul 21 01:23:13.488635 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.488623    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7a451f56-01d4-4ab3-af25-470792468eec-trusted-ca\") pod \"image-registry-8ccddf454-2zz49\" (UID: \"7a451f56-01d4-4ab3-af25-470792468eec\") " pod="openshift-image-registry/image-registry-8ccddf454-2zz49"
Jul 21 01:23:13.488673 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.488653    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7a451f56-01d4-4ab3-af25-470792468eec-ca-trust-extracted\") pod \"image-registry-8ccddf454-2zz49\" (UID: \"7a451f56-01d4-4ab3-af25-470792468eec\") " pod="openshift-image-registry/image-registry-8ccddf454-2zz49"
Jul 21 01:23:13.488710 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.488678    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7a451f56-01d4-4ab3-af25-470792468eec-bound-sa-token\") pod \"image-registry-8ccddf454-2zz49\" (UID: \"7a451f56-01d4-4ab3-af25-470792468eec\") " pod="openshift-image-registry/image-registry-8ccddf454-2zz49"
Jul 21 01:23:13.488710 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.488700    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b332724a-1bb4-4be7-8065-cf42fd36bfc3-hub\") pod \"cluster-proxy-proxy-agent-5794988c97-j46kb\" (UID: \"b332724a-1bb4-4be7-8065-cf42fd36bfc3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5794988c97-j46kb"
Jul 21 01:23:13.488767 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.488722    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b332724a-1bb4-4be7-8065-cf42fd36bfc3-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5794988c97-j46kb\" (UID: \"b332724a-1bb4-4be7-8065-cf42fd36bfc3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5794988c97-j46kb"
Jul 21 01:23:13.490272 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.488756    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56sv5\" (UniqueName: \"kubernetes.io/projected/b332724a-1bb4-4be7-8065-cf42fd36bfc3-kube-api-access-56sv5\") pod \"cluster-proxy-proxy-agent-5794988c97-j46kb\" (UID: \"b332724a-1bb4-4be7-8065-cf42fd36bfc3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5794988c97-j46kb"
Jul 21 01:23:13.490272 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.489733    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7a451f56-01d4-4ab3-af25-470792468eec-registry-tls\") pod \"image-registry-8ccddf454-2zz49\" (UID: \"7a451f56-01d4-4ab3-af25-470792468eec\") " pod="openshift-image-registry/image-registry-8ccddf454-2zz49"
Jul 21 01:23:13.490272 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.489780    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7a451f56-01d4-4ab3-af25-470792468eec-registry-certificates\") pod \"image-registry-8ccddf454-2zz49\" (UID: \"7a451f56-01d4-4ab3-af25-470792468eec\") " pod="openshift-image-registry/image-registry-8ccddf454-2zz49"
Jul 21 01:23:13.490272 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.489821    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b332724a-1bb4-4be7-8065-cf42fd36bfc3-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5794988c97-j46kb\" (UID: \"b332724a-1bb4-4be7-8065-cf42fd36bfc3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5794988c97-j46kb"
Jul 21 01:23:13.490272 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.489854    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b332724a-1bb4-4be7-8065-cf42fd36bfc3-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5794988c97-j46kb\" (UID: \"b332724a-1bb4-4be7-8065-cf42fd36bfc3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5794988c97-j46kb"
Jul 21 01:23:13.490272 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.489902    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7a451f56-01d4-4ab3-af25-470792468eec-installation-pull-secrets\") pod \"image-registry-8ccddf454-2zz49\" (UID: \"7a451f56-01d4-4ab3-af25-470792468eec\") " pod="openshift-image-registry/image-registry-8ccddf454-2zz49"
Jul 21 01:23:13.491285 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.491257    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b332724a-1bb4-4be7-8065-cf42fd36bfc3-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5794988c97-j46kb\" (UID: \"b332724a-1bb4-4be7-8065-cf42fd36bfc3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5794988c97-j46kb"
Jul 21 01:23:13.491401 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.491380    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b332724a-1bb4-4be7-8065-cf42fd36bfc3-ca\") pod \"cluster-proxy-proxy-agent-5794988c97-j46kb\" (UID: \"b332724a-1bb4-4be7-8065-cf42fd36bfc3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5794988c97-j46kb"
Jul 21 01:23:13.494456 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.494434    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b332724a-1bb4-4be7-8065-cf42fd36bfc3-hub\") pod \"cluster-proxy-proxy-agent-5794988c97-j46kb\" (UID: \"b332724a-1bb4-4be7-8065-cf42fd36bfc3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5794988c97-j46kb"
Jul 21 01:23:13.495525 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.495502    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b332724a-1bb4-4be7-8065-cf42fd36bfc3-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5794988c97-j46kb\" (UID: \"b332724a-1bb4-4be7-8065-cf42fd36bfc3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5794988c97-j46kb"
Jul 21 01:23:13.496506 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.496483    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b332724a-1bb4-4be7-8065-cf42fd36bfc3-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5794988c97-j46kb\" (UID: \"b332724a-1bb4-4be7-8065-cf42fd36bfc3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5794988c97-j46kb"
Jul 21 01:23:13.501082 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.501031    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56sv5\" (UniqueName: \"kubernetes.io/projected/b332724a-1bb4-4be7-8065-cf42fd36bfc3-kube-api-access-56sv5\") pod \"cluster-proxy-proxy-agent-5794988c97-j46kb\" (UID: \"b332724a-1bb4-4be7-8065-cf42fd36bfc3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5794988c97-j46kb"
Jul 21 01:23:13.580569 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.580529    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d8b8cf9f6-wtwff"
Jul 21 01:23:13.587729 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.587703    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:13.590457 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.590439    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5794988c97-j46kb"
Jul 21 01:23:13.590605 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.590587    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7a451f56-01d4-4ab3-af25-470792468eec-bound-sa-token\") pod \"image-registry-8ccddf454-2zz49\" (UID: \"7a451f56-01d4-4ab3-af25-470792468eec\") " pod="openshift-image-registry/image-registry-8ccddf454-2zz49"
Jul 21 01:23:13.590664 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.590625    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7a451f56-01d4-4ab3-af25-470792468eec-registry-tls\") pod \"image-registry-8ccddf454-2zz49\" (UID: \"7a451f56-01d4-4ab3-af25-470792468eec\") " pod="openshift-image-registry/image-registry-8ccddf454-2zz49"
Jul 21 01:23:13.590849 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.590829    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7a451f56-01d4-4ab3-af25-470792468eec-registry-certificates\") pod \"image-registry-8ccddf454-2zz49\" (UID: \"7a451f56-01d4-4ab3-af25-470792468eec\") " pod="openshift-image-registry/image-registry-8ccddf454-2zz49"
Jul 21 01:23:13.590984 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.590893    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7a451f56-01d4-4ab3-af25-470792468eec-installation-pull-secrets\") pod \"image-registry-8ccddf454-2zz49\" (UID: \"7a451f56-01d4-4ab3-af25-470792468eec\") " pod="openshift-image-registry/image-registry-8ccddf454-2zz49"
Jul 21 01:23:13.590984 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.590971    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7a451f56-01d4-4ab3-af25-470792468eec-image-registry-private-configuration\") pod \"image-registry-8ccddf454-2zz49\" (UID: \"7a451f56-01d4-4ab3-af25-470792468eec\") " pod="openshift-image-registry/image-registry-8ccddf454-2zz49"
Jul 21 01:23:13.591102 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.591000    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs4c6\" (UniqueName: \"kubernetes.io/projected/7a451f56-01d4-4ab3-af25-470792468eec-kube-api-access-gs4c6\") pod \"image-registry-8ccddf454-2zz49\" (UID: \"7a451f56-01d4-4ab3-af25-470792468eec\") " pod="openshift-image-registry/image-registry-8ccddf454-2zz49"
Jul 21 01:23:13.591102 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.591064    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7a451f56-01d4-4ab3-af25-470792468eec-trusted-ca\") pod \"image-registry-8ccddf454-2zz49\" (UID: \"7a451f56-01d4-4ab3-af25-470792468eec\") " pod="openshift-image-registry/image-registry-8ccddf454-2zz49"
Jul 21 01:23:13.591102 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.591094    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7a451f56-01d4-4ab3-af25-470792468eec-ca-trust-extracted\") pod \"image-registry-8ccddf454-2zz49\" (UID: \"7a451f56-01d4-4ab3-af25-470792468eec\") " pod="openshift-image-registry/image-registry-8ccddf454-2zz49"
Jul 21 01:23:13.591772 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.591724    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7a451f56-01d4-4ab3-af25-470792468eec-registry-certificates\") pod \"image-registry-8ccddf454-2zz49\" (UID: \"7a451f56-01d4-4ab3-af25-470792468eec\") " pod="openshift-image-registry/image-registry-8ccddf454-2zz49"
Jul 21 01:23:13.591874 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.591788    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7a451f56-01d4-4ab3-af25-470792468eec-ca-trust-extracted\") pod \"image-registry-8ccddf454-2zz49\" (UID: \"7a451f56-01d4-4ab3-af25-470792468eec\") " pod="openshift-image-registry/image-registry-8ccddf454-2zz49"
Jul 21 01:23:13.592544 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.592361    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7a451f56-01d4-4ab3-af25-470792468eec-trusted-ca\") pod \"image-registry-8ccddf454-2zz49\" (UID: \"7a451f56-01d4-4ab3-af25-470792468eec\") " pod="openshift-image-registry/image-registry-8ccddf454-2zz49"
Jul 21 01:23:13.593593 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.593572    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7a451f56-01d4-4ab3-af25-470792468eec-installation-pull-secrets\") pod \"image-registry-8ccddf454-2zz49\" (UID: \"7a451f56-01d4-4ab3-af25-470792468eec\") " pod="openshift-image-registry/image-registry-8ccddf454-2zz49"
Jul 21 01:23:13.594069 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.594046    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7a451f56-01d4-4ab3-af25-470792468eec-registry-tls\") pod \"image-registry-8ccddf454-2zz49\" (UID: \"7a451f56-01d4-4ab3-af25-470792468eec\") " pod="openshift-image-registry/image-registry-8ccddf454-2zz49"
Jul 21 01:23:13.594429 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.594408    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7a451f56-01d4-4ab3-af25-470792468eec-image-registry-private-configuration\") pod \"image-registry-8ccddf454-2zz49\" (UID: \"7a451f56-01d4-4ab3-af25-470792468eec\") " pod="openshift-image-registry/image-registry-8ccddf454-2zz49"
Jul 21 01:23:13.602467 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.602443    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs4c6\" (UniqueName: \"kubernetes.io/projected/7a451f56-01d4-4ab3-af25-470792468eec-kube-api-access-gs4c6\") pod \"image-registry-8ccddf454-2zz49\" (UID: \"7a451f56-01d4-4ab3-af25-470792468eec\") " pod="openshift-image-registry/image-registry-8ccddf454-2zz49"
Jul 21 01:23:13.602559 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.602540    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7a451f56-01d4-4ab3-af25-470792468eec-bound-sa-token\") pod \"image-registry-8ccddf454-2zz49\" (UID: \"7a451f56-01d4-4ab3-af25-470792468eec\") " pod="openshift-image-registry/image-registry-8ccddf454-2zz49"
Jul 21 01:23:13.692842 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.692805    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:13.728983 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:13.728946    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8ccddf454-2zz49"
Jul 21 01:23:14.394808 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:14.394743    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d8b8cf9f6-wtwff"]
Jul 21 01:23:14.397929 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:23:14.397898    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod137022bd_d60e_46a4_80f1_c61bfeba5048.slice/crio-c31566539f264bac1709473029a20ecaa3ebe42b3359d302a8a5167abc96b54a WatchSource:0}: Error finding container c31566539f264bac1709473029a20ecaa3ebe42b3359d302a8a5167abc96b54a: Status 404 returned error can't find the container with id c31566539f264bac1709473029a20ecaa3ebe42b3359d302a8a5167abc96b54a
Jul 21 01:23:14.414059 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:14.414038    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8ccddf454-2zz49"]
Jul 21 01:23:14.416501 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:23:14.416477    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a451f56_01d4_4ab3_af25_470792468eec.slice/crio-792a09a8b8fd710a0df51c18a85790ad1b172168694e86a23798e4615547c5bd WatchSource:0}: Error finding container 792a09a8b8fd710a0df51c18a85790ad1b172168694e86a23798e4615547c5bd: Status 404 returned error can't find the container with id 792a09a8b8fd710a0df51c18a85790ad1b172168694e86a23798e4615547c5bd
Jul 21 01:23:14.427718 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:14.427702    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5794988c97-j46kb"]
Jul 21 01:23:14.430094 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:23:14.430073    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb332724a_1bb4_4be7_8065_cf42fd36bfc3.slice/crio-c2628f87ff81f1b64a805d0b4c2441ca13ecc1313716590351d62ed0be33c59a WatchSource:0}: Error finding container c2628f87ff81f1b64a805d0b4c2441ca13ecc1313716590351d62ed0be33c59a: Status 404 returned error can't find the container with id c2628f87ff81f1b64a805d0b4c2441ca13ecc1313716590351d62ed0be33c59a
Jul 21 01:23:14.830118 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:14.829987    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:14.932996 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:14.932964    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:14.997310 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:14.997281    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qhbcs"
Jul 21 01:23:15.036394 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:15.035558    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8ccddf454-2zz49" event={"ID":"7a451f56-01d4-4ab3-af25-470792468eec","Type":"ContainerStarted","Data":"ad0f7460dcae0e0a0b9d206a36a54245d4a0e52e40dcd9cd9e0efa46c72fd254"}
Jul 21 01:23:15.036394 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:15.035613    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8ccddf454-2zz49" event={"ID":"7a451f56-01d4-4ab3-af25-470792468eec","Type":"ContainerStarted","Data":"792a09a8b8fd710a0df51c18a85790ad1b172168694e86a23798e4615547c5bd"}
Jul 21 01:23:15.036394 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:15.036340    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8ccddf454-2zz49"
Jul 21 01:23:15.040506 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:15.040448    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5794988c97-j46kb" event={"ID":"b332724a-1bb4-4be7-8065-cf42fd36bfc3","Type":"ContainerStarted","Data":"c2628f87ff81f1b64a805d0b4c2441ca13ecc1313716590351d62ed0be33c59a"}
Jul 21 01:23:15.045699 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:15.045620    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sfq2c" event={"ID":"df3bdff2-1267-40ea-8f92-4e201393382f","Type":"ContainerStarted","Data":"f2f8157901e1dbc559b339f3783a9caec95396251cf6c3380ba7facbe7f64a65"}
Jul 21 01:23:15.048214 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:15.048115    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d8b8cf9f6-wtwff" event={"ID":"137022bd-d60e-46a4-80f1-c61bfeba5048","Type":"ContainerStarted","Data":"c31566539f264bac1709473029a20ecaa3ebe42b3359d302a8a5167abc96b54a"}
Jul 21 01:23:15.060365 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:15.059657    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8ccddf454-2zz49" podStartSLOduration=2.059639072 podStartE2EDuration="2.059639072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:23:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:23:15.05856222 +0000 UTC m=+64.788930892" watchObservedRunningTime="2026-07-21 01:23:15.059639072 +0000 UTC m=+64.790007722"
Jul 21 01:23:16.419890 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:16.419846    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d45da68-d967-4df2-9623-2aec040ab204-metrics-certs\") pod \"network-metrics-daemon-6j8g9\" (UID: \"8d45da68-d967-4df2-9623-2aec040ab204\") " pod="openshift-multus/network-metrics-daemon-6j8g9"
Jul 21 01:23:16.423713 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:16.423688    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 01:23:16.437386 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:16.437360    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d45da68-d967-4df2-9623-2aec040ab204-metrics-certs\") pod \"network-metrics-daemon-6j8g9\" (UID: \"8d45da68-d967-4df2-9623-2aec040ab204\") " pod="openshift-multus/network-metrics-daemon-6j8g9"
Jul 21 01:23:16.521498 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:16.521461    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69x5p\" (UniqueName: \"kubernetes.io/projected/85c43f1f-b8b3-49e1-ae09-d266df7facf3-kube-api-access-69x5p\") pod \"network-check-target-fpg98\" (UID: \"85c43f1f-b8b3-49e1-ae09-d266df7facf3\") " pod="openshift-network-diagnostics/network-check-target-fpg98"
Jul 21 01:23:16.521643 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:16.521578    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f652ed3-d73f-4b66-be66-dd7bdba8a027-original-pull-secret\") pod \"global-pull-secret-syncer-n4nls\" (UID: \"2f652ed3-d73f-4b66-be66-dd7bdba8a027\") " pod="kube-system/global-pull-secret-syncer-n4nls"
Jul 21 01:23:16.524844 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:16.524611    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 01:23:16.524978 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:16.524889    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 01:23:16.537560 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:16.534949    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 01:23:16.539319 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:16.538906    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f652ed3-d73f-4b66-be66-dd7bdba8a027-original-pull-secret\") pod \"global-pull-secret-syncer-n4nls\" (UID: \"2f652ed3-d73f-4b66-be66-dd7bdba8a027\") " pod="kube-system/global-pull-secret-syncer-n4nls"
Jul 21 01:23:16.547024 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:16.546963    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69x5p\" (UniqueName: \"kubernetes.io/projected/85c43f1f-b8b3-49e1-ae09-d266df7facf3-kube-api-access-69x5p\") pod \"network-check-target-fpg98\" (UID: \"85c43f1f-b8b3-49e1-ae09-d266df7facf3\") " pod="openshift-network-diagnostics/network-check-target-fpg98"
Jul 21 01:23:16.726499 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:16.726415    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qrsnk\""
Jul 21 01:23:16.731317 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:16.731293    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4nls"
Jul 21 01:23:16.734414 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:16.734385    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6j8g9"
Jul 21 01:23:16.739937 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:16.739918    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-48mr4\""
Jul 21 01:23:16.748414 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:16.748181    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fpg98"
Jul 21 01:23:20.902779 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:20.902674    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fpg98"]
Jul 21 01:23:20.917885 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:23:20.917830    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85c43f1f_b8b3_49e1_ae09_d266df7facf3.slice/crio-91b7c33431867c0b282e0b046168dda661611ed8da77ac6287847ffa0b1cee46 WatchSource:0}: Error finding container 91b7c33431867c0b282e0b046168dda661611ed8da77ac6287847ffa0b1cee46: Status 404 returned error can't find the container with id 91b7c33431867c0b282e0b046168dda661611ed8da77ac6287847ffa0b1cee46
Jul 21 01:23:20.932934 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:20.932909    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6j8g9"]
Jul 21 01:23:20.938098 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:23:20.938077    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d45da68_d967_4df2_9623_2aec040ab204.slice/crio-b2ea2468f6e248c941a9a0b4c41f89ba15b3212a641c756db50417b24a65aa0a WatchSource:0}: Error finding container b2ea2468f6e248c941a9a0b4c41f89ba15b3212a641c756db50417b24a65aa0a: Status 404 returned error can't find the container with id b2ea2468f6e248c941a9a0b4c41f89ba15b3212a641c756db50417b24a65aa0a
Jul 21 01:23:21.073813 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:21.073779    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d8b8cf9f6-wtwff" event={"ID":"137022bd-d60e-46a4-80f1-c61bfeba5048","Type":"ContainerStarted","Data":"819bef5a063a9520d9df8b82a3aa2e3573092dbaddeb438c306eee902fb68902"}
Jul 21 01:23:21.075856 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:21.075825    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5794988c97-j46kb" event={"ID":"b332724a-1bb4-4be7-8065-cf42fd36bfc3","Type":"ContainerStarted","Data":"8eccf269ed650bc3fddbbe2ee350a17b73e6b328c6b53118cf46a7d30b242f7d"}
Jul 21 01:23:21.076013 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:21.075861    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5794988c97-j46kb" event={"ID":"b332724a-1bb4-4be7-8065-cf42fd36bfc3","Type":"ContainerStarted","Data":"6ef3b9e3acb5d3bdb7f1b958be6b624cf92d1c80bfa4c123218b3d013638e8b4"}
Jul 21 01:23:21.076013 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:21.075880    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5794988c97-j46kb" event={"ID":"b332724a-1bb4-4be7-8065-cf42fd36bfc3","Type":"ContainerStarted","Data":"e307925a9e09b11ad653d42cecca5cc20bc3766ece445c3c5edb38bb0eee89df"}
Jul 21 01:23:21.076955 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:21.076926    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6j8g9" event={"ID":"8d45da68-d967-4df2-9623-2aec040ab204","Type":"ContainerStarted","Data":"b2ea2468f6e248c941a9a0b4c41f89ba15b3212a641c756db50417b24a65aa0a"}
Jul 21 01:23:21.078046 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:21.078022    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fpg98" event={"ID":"85c43f1f-b8b3-49e1-ae09-d266df7facf3","Type":"ContainerStarted","Data":"91b7c33431867c0b282e0b046168dda661611ed8da77ac6287847ffa0b1cee46"}
Jul 21 01:23:21.079965 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:21.079939    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sfq2c" event={"ID":"df3bdff2-1267-40ea-8f92-4e201393382f","Type":"ContainerStarted","Data":"bc4504a9711b5d795407f0efe3ff5d8a530a1a6330a494cbc386accd1eb3ad1d"}
Jul 21 01:23:21.091790 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:21.091747    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d8b8cf9f6-wtwff" podStartSLOduration=1.748916592 podStartE2EDuration="8.091734706s" totalImagesPullingTime="6.342818114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:23:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:23:21.090766465 +0000 UTC m=+70.821135135" watchObservedRunningTime="2026-07-21 01:23:21.091734706 +0000 UTC m=+70.822103377"
Jul 21 01:23:21.109528 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:21.109478    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-sfq2c" podStartSLOduration=16.98586835 podStartE2EDuration="32.109460461s" totalImagesPullingTime="15.123592111s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:22:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:23:21.109311021 +0000 UTC m=+70.839679693" watchObservedRunningTime="2026-07-21 01:23:21.109460461 +0000 UTC m=+70.839829128"
Jul 21 01:23:21.128786 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:21.128746    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5794988c97-j46kb" podStartSLOduration=1.789303839 podStartE2EDuration="8.128731144s" totalImagesPullingTime="6.339427305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:23:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:23:21.127860483 +0000 UTC m=+70.858229153" watchObservedRunningTime="2026-07-21 01:23:21.128731144 +0000 UTC m=+70.859099813"
Jul 21 01:23:21.133752 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:21.133732    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n4nls"]
Jul 21 01:23:21.136602 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:23:21.136577    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f652ed3_d73f_4b66_be66_dd7bdba8a027.slice/crio-dda15d099726174298a968d6abef8ef35cf7b83703ac7f348576f546a93955de WatchSource:0}: Error finding container dda15d099726174298a968d6abef8ef35cf7b83703ac7f348576f546a93955de: Status 404 returned error can't find the container with id dda15d099726174298a968d6abef8ef35cf7b83703ac7f348576f546a93955de
Jul 21 01:23:21.433013 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:21.432978    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:21.528560 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:21.528519    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:21.662655 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:21.662592    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:21.902123 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:21.902089    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:22.003094 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:22.003018    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:22.087406 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:22.087374    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n4nls" event={"ID":"2f652ed3-d73f-4b66-be66-dd7bdba8a027","Type":"ContainerStarted","Data":"dda15d099726174298a968d6abef8ef35cf7b83703ac7f348576f546a93955de"}
Jul 21 01:23:22.103494 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:22.103469    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:22.694326 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:22.694289    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:22.769600 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:22.769568    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:23.094147 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:23.094108    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6j8g9" event={"ID":"8d45da68-d967-4df2-9623-2aec040ab204","Type":"ContainerStarted","Data":"bf3917115e8d0a2a0e9db3cf1e51bd9cffe019c8e4a4cd45dadecbcdb72009fb"}
Jul 21 01:23:23.094660 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:23.094172    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6j8g9" event={"ID":"8d45da68-d967-4df2-9623-2aec040ab204","Type":"ContainerStarted","Data":"d9ba036f6628ad5766f4172ff49361cc5aa5cf4c0b2f53be54d55670dda7b3fe"}
Jul 21 01:23:23.112977 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:23.112910    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6j8g9" podStartSLOduration=71.998465827 podStartE2EDuration="1m13.112889464s" totalImagesPullingTime="1.114423637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:22:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:23:23.11224749 +0000 UTC m=+72.842616161" watchObservedRunningTime="2026-07-21 01:23:23.112889464 +0000 UTC m=+72.843258137"
Jul 21 01:23:23.225775 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:23.225737    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:23.326048 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:23.326000    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:23.351756 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:23.351652    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-69f8ccbdb8-kttn7"
Jul 21 01:23:24.139282 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:24.139242    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:26.107050 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:26.107010    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fpg98" event={"ID":"85c43f1f-b8b3-49e1-ae09-d266df7facf3","Type":"ContainerStarted","Data":"d8ddeeeeab03a73d0e748968e51950f78ecd248f18c0fdb784f7aee691459cea"}
Jul 21 01:23:26.107505 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:26.107086    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fpg98"
Jul 21 01:23:26.108389 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:26.108363    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n4nls" event={"ID":"2f652ed3-d73f-4b66-be66-dd7bdba8a027","Type":"ContainerStarted","Data":"9fdc5daf487da7467b0784846dad7471aa8a6c06ea979025afa5de30711d8813"}
Jul 21 01:23:26.128369 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:26.128326    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fpg98" podStartSLOduration=71.407050432 podStartE2EDuration="1m16.128310084s" totalImagesPullingTime="4.721259652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:22:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:23:26.12802808 +0000 UTC m=+75.858396761" watchObservedRunningTime="2026-07-21 01:23:26.128310084 +0000 UTC m=+75.858678754"
Jul 21 01:23:26.146471 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:26.146430    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-n4nls" podStartSLOduration=71.639836477 podStartE2EDuration="1m16.146417969s" totalImagesPullingTime="4.506581492s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:22:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:23:26.144954884 +0000 UTC m=+75.875323555" watchObservedRunningTime="2026-07-21 01:23:26.146417969 +0000 UTC m=+75.876786635"
Jul 21 01:23:27.696725 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:27.696696    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:27.797681 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:27.797653    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:27.919616 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:27.919577    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:30.943581 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:30.943546    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:31.044218 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:31.044173    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:31.107795 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:31.107768    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:31.844971 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:31.844854    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:31.943462 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:31.943427    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:33.862532 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:33.862500    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:34.071126 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:34.071096    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:34.113759 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:34.113666    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-c7vb5"]
Jul 21 01:23:34.117410 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:34.117394    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c7vb5"
Jul 21 01:23:34.120992 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:34.120963    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 21 01:23:34.121482 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:34.121462    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 21 01:23:34.121711 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:34.121695    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 21 01:23:34.121807 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:34.121783    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 21 01:23:34.122066 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:34.122049    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6twlm\""
Jul 21 01:23:34.122430 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:34.122414    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 21 01:23:34.122494 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:34.122444    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 21 01:23:34.171983 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:34.171948    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:34.235430 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:34.235392    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:34.266596 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:34.266563    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d2594a35-25ca-4d21-a2b4-df328fabd2b8-node-exporter-textfile\") pod \"node-exporter-c7vb5\" (UID: \"d2594a35-25ca-4d21-a2b4-df328fabd2b8\") " pod="openshift-monitoring/node-exporter-c7vb5"
Jul 21 01:23:34.266755 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:34.266610    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d2594a35-25ca-4d21-a2b4-df328fabd2b8-root\") pod \"node-exporter-c7vb5\" (UID: \"d2594a35-25ca-4d21-a2b4-df328fabd2b8\") " pod="openshift-monitoring/node-exporter-c7vb5"
Jul 21 01:23:34.266755 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:34.266699    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d2594a35-25ca-4d21-a2b4-df328fabd2b8-node-exporter-wtmp\") pod \"node-exporter-c7vb5\" (UID: \"d2594a35-25ca-4d21-a2b4-df328fabd2b8\") " pod="openshift-monitoring/node-exporter-c7vb5"
Jul 21 01:23:34.266755 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:34.266728    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d2594a35-25ca-4d21-a2b4-df328fabd2b8-sys\") pod \"node-exporter-c7vb5\" (UID: \"d2594a35-25ca-4d21-a2b4-df328fabd2b8\") " pod="openshift-monitoring/node-exporter-c7vb5"
Jul 21 01:23:34.266910 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:34.266757    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2594a35-25ca-4d21-a2b4-df328fabd2b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c7vb5\" (UID: \"d2594a35-25ca-4d21-a2b4-df328fabd2b8\") " pod="openshift-monitoring/node-exporter-c7vb5"
Jul 21 01:23:34.266910 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:34.266795    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d2594a35-25ca-4d21-a2b4-df328fabd2b8-node-exporter-tls\") pod \"node-exporter-c7vb5\" (UID: \"d2594a35-25ca-4d21-a2b4-df328fabd2b8\") " pod="openshift-monitoring/node-exporter-c7vb5"
Jul 21 01:23:34.266910 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:34.266826    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smmsk\" (UniqueName: \"kubernetes.io/projected/d2594a35-25ca-4d21-a2b4-df328fabd2b8-kube-api-access-smmsk\") pod \"node-exporter-c7vb5\" (UID: \"d2594a35-25ca-4d21-a2b4-df328fabd2b8\") " pod="openshift-monitoring/node-exporter-c7vb5"
Jul 21 01:23:34.266910 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:34.266845    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2594a35-25ca-4d21-a2b4-df328fabd2b8-metrics-client-ca\") pod \"node-exporter-c7vb5\" (UID: \"d2594a35-25ca-4d21-a2b4-df328fabd2b8\") " pod="openshift-monitoring/node-exporter-c7vb5"
Jul 21 01:23:34.266910 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:34.266889    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d2594a35-25ca-4d21-a2b4-df328fabd2b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-c7vb5\" (UID: \"d2594a35-25ca-4d21-a2b4-df328fabd2b8\") " pod="openshift-monitoring/node-exporter-c7vb5"
Jul 21 01:23:34.367445 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:34.367353    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d2594a35-25ca-4d21-a2b4-df328fabd2b8-node-exporter-textfile\") pod \"node-exporter-c7vb5\" (UID: \"d2594a35-25ca-4d21-a2b4-df328fabd2b8\") " pod="openshift-monitoring/node-exporter-c7vb5"
Jul 21 01:23:34.367445 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:34.367402    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d2594a35-25ca-4d21-a2b4-df328fabd2b8-root\") pod \"node-exporter-c7vb5\" (UID: \"d2594a35-25ca-4d21-a2b4-df328fabd2b8\") " pod="openshift-monitoring/node-exporter-c7vb5"
Jul 21 01:23:34.367445 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:34.367445    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d2594a35-25ca-4d21-a2b4-df328fabd2b8-node-exporter-wtmp\") pod \"node-exporter-c7vb5\" (UID: \"d2594a35-25ca-4d21-a2b4-df328fabd2b8\") " pod="openshift-monitoring/node-exporter-c7vb5"
Jul 21 01:23:34.367717 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:34.367472    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d2594a35-25ca-4d21-a2b4-df328fabd2b8-sys\") pod \"node-exporter-c7vb5\" (UID: \"d2594a35-25ca-4d21-a2b4-df328fabd2b8\") " pod="openshift-monitoring/node-exporter-c7vb5"
Jul 21 01:23:34.367717 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:34.367501    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2594a35-25ca-4d21-a2b4-df328fabd2b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c7vb5\" (UID: \"d2594a35-25ca-4d21-a2b4-df328fabd2b8\") " pod="openshift-monitoring/node-exporter-c7vb5"
Jul 21 01:23:34.367717 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:34.367528    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d2594a35-25ca-4d21-a2b4-df328fabd2b8-node-exporter-tls\") pod \"node-exporter-c7vb5\" (UID: \"d2594a35-25ca-4d21-a2b4-df328fabd2b8\") " pod="openshift-monitoring/node-exporter-c7vb5"
Jul 21 01:23:34.367717 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:34.367545    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d2594a35-25ca-4d21-a2b4-df328fabd2b8-root\") pod \"node-exporter-c7vb5\" (UID: \"d2594a35-25ca-4d21-a2b4-df328fabd2b8\") " pod="openshift-monitoring/node-exporter-c7vb5"
Jul 21 01:23:34.367717 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:34.367564    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d2594a35-25ca-4d21-a2b4-df328fabd2b8-sys\") pod \"node-exporter-c7vb5\" (UID: \"d2594a35-25ca-4d21-a2b4-df328fabd2b8\") " pod="openshift-monitoring/node-exporter-c7vb5"
Jul 21 01:23:34.367717 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:34.367559    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smmsk\" (UniqueName: \"kubernetes.io/projected/d2594a35-25ca-4d21-a2b4-df328fabd2b8-kube-api-access-smmsk\") pod \"node-exporter-c7vb5\" (UID: \"d2594a35-25ca-4d21-a2b4-df328fabd2b8\") " pod="openshift-monitoring/node-exporter-c7vb5"
Jul 21 01:23:34.367717 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:34.367622    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d2594a35-25ca-4d21-a2b4-df328fabd2b8-node-exporter-wtmp\") pod \"node-exporter-c7vb5\" (UID: \"d2594a35-25ca-4d21-a2b4-df328fabd2b8\") " pod="openshift-monitoring/node-exporter-c7vb5"
Jul 21 01:23:34.367717 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:34.367716    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2594a35-25ca-4d21-a2b4-df328fabd2b8-metrics-client-ca\") pod \"node-exporter-c7vb5\" (UID: \"d2594a35-25ca-4d21-a2b4-df328fabd2b8\") " pod="openshift-monitoring/node-exporter-c7vb5"
Jul 21 01:23:34.368126 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:23:34.367740    2561 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 21 01:23:34.368126 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:34.367770    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d2594a35-25ca-4d21-a2b4-df328fabd2b8-node-exporter-textfile\") pod \"node-exporter-c7vb5\" (UID: \"d2594a35-25ca-4d21-a2b4-df328fabd2b8\") " pod="openshift-monitoring/node-exporter-c7vb5"
Jul 21 01:23:34.368126 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:23:34.367799    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2594a35-25ca-4d21-a2b4-df328fabd2b8-node-exporter-tls podName:d2594a35-25ca-4d21-a2b4-df328fabd2b8 nodeName:}" failed. No retries permitted until 2026-07-21 01:23:34.867779288 +0000 UTC m=+84.598147940 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d2594a35-25ca-4d21-a2b4-df328fabd2b8-node-exporter-tls") pod "node-exporter-c7vb5" (UID: "d2594a35-25ca-4d21-a2b4-df328fabd2b8") : secret "node-exporter-tls" not found
Jul 21 01:23:34.368126 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:34.367871    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d2594a35-25ca-4d21-a2b4-df328fabd2b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-c7vb5\" (UID: \"d2594a35-25ca-4d21-a2b4-df328fabd2b8\") " pod="openshift-monitoring/node-exporter-c7vb5"
Jul 21 01:23:34.368402 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:34.368368    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2594a35-25ca-4d21-a2b4-df328fabd2b8-metrics-client-ca\") pod \"node-exporter-c7vb5\" (UID: \"d2594a35-25ca-4d21-a2b4-df328fabd2b8\") " pod="openshift-monitoring/node-exporter-c7vb5"
Jul 21 01:23:34.368462 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:34.368420    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d2594a35-25ca-4d21-a2b4-df328fabd2b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-c7vb5\" (UID: \"d2594a35-25ca-4d21-a2b4-df328fabd2b8\") " pod="openshift-monitoring/node-exporter-c7vb5"
Jul 21 01:23:34.370276 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:34.370254    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2594a35-25ca-4d21-a2b4-df328fabd2b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c7vb5\" (UID: \"d2594a35-25ca-4d21-a2b4-df328fabd2b8\") " pod="openshift-monitoring/node-exporter-c7vb5"
Jul 21 01:23:34.378911 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:34.378889    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smmsk\" (UniqueName: \"kubernetes.io/projected/d2594a35-25ca-4d21-a2b4-df328fabd2b8-kube-api-access-smmsk\") pod \"node-exporter-c7vb5\" (UID: \"d2594a35-25ca-4d21-a2b4-df328fabd2b8\") " pod="openshift-monitoring/node-exporter-c7vb5"
Jul 21 01:23:34.388475 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:34.388454    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:34.488637 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:34.488606    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:34.546835 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:34.546802    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:34.609589 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:34.609554    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:34.712516 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:34.712430    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:34.871921 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:34.871886    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d2594a35-25ca-4d21-a2b4-df328fabd2b8-node-exporter-tls\") pod \"node-exporter-c7vb5\" (UID: \"d2594a35-25ca-4d21-a2b4-df328fabd2b8\") " pod="openshift-monitoring/node-exporter-c7vb5"
Jul 21 01:23:34.874351 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:34.874333    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d2594a35-25ca-4d21-a2b4-df328fabd2b8-node-exporter-tls\") pod \"node-exporter-c7vb5\" (UID: \"d2594a35-25ca-4d21-a2b4-df328fabd2b8\") " pod="openshift-monitoring/node-exporter-c7vb5"
Jul 21 01:23:35.031234 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:35.031185    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c7vb5"
Jul 21 01:23:35.043020 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:23:35.042997    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2594a35_25ca_4d21_a2b4_df328fabd2b8.slice/crio-d71ffea0a347902b73becd2731076a624c5d967cb06cbe3aac60bc824724b2b2 WatchSource:0}: Error finding container d71ffea0a347902b73becd2731076a624c5d967cb06cbe3aac60bc824724b2b2: Status 404 returned error can't find the container with id d71ffea0a347902b73becd2731076a624c5d967cb06cbe3aac60bc824724b2b2
Jul 21 01:23:35.076412 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:35.076339    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:35.139795 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:35.139761    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c7vb5" event={"ID":"d2594a35-25ca-4d21-a2b4-df328fabd2b8","Type":"ContainerStarted","Data":"d71ffea0a347902b73becd2731076a624c5d967cb06cbe3aac60bc824724b2b2"}
Jul 21 01:23:35.200236 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:35.200183    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:35.447543 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:35.447463    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:36.145182 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:36.145146    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c7vb5" event={"ID":"d2594a35-25ca-4d21-a2b4-df328fabd2b8","Type":"ContainerStarted","Data":"fa8ab3dc71b5b81e8e2f87edec0073d9d5af8ee34a21ef57a9a76dc92515b4c0"}
Jul 21 01:23:36.836035 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:36.835984    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:36.972114 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:36.972060    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:37.062018 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:37.061994    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8ccddf454-2zz49"
Jul 21 01:23:37.066422 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:37.066399    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:37.152230 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:37.152119    2561 generic.go:356] "Generic (PLEG): container finished" podID="d2594a35-25ca-4d21-a2b4-df328fabd2b8" containerID="fa8ab3dc71b5b81e8e2f87edec0073d9d5af8ee34a21ef57a9a76dc92515b4c0" exitCode=0
Jul 21 01:23:37.152698 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:37.152227    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c7vb5" event={"ID":"d2594a35-25ca-4d21-a2b4-df328fabd2b8","Type":"ContainerDied","Data":"fa8ab3dc71b5b81e8e2f87edec0073d9d5af8ee34a21ef57a9a76dc92515b4c0"}
Jul 21 01:23:37.157488 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:37.157462    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:37.220151 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:37.220120    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:37.391601 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:37.391566    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:37.493987 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:37.493899    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:37.558039 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:37.558007    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:37.702111 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:37.702078    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:37.788514 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:37.788480    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:37.932679 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:37.932649    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:37.994185 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:37.994155    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:38.157428 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:38.157340    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c7vb5" event={"ID":"d2594a35-25ca-4d21-a2b4-df328fabd2b8","Type":"ContainerStarted","Data":"59d54b81d8b0bf222218fe096e736783c9e4488bd4cd5573b5c5034ec96d4d24"}
Jul 21 01:23:38.157428 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:38.157412    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c7vb5" event={"ID":"d2594a35-25ca-4d21-a2b4-df328fabd2b8","Type":"ContainerStarted","Data":"e2d403fe79d38f51f91a89f8e462b2ed1b91bd45ff0b28fcdf4e0e433a6d4205"}
Jul 21 01:23:38.196230 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:38.196167    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-c7vb5" podStartSLOduration=3.149405792 podStartE2EDuration="4.196153008s" totalImagesPullingTime="976.622777ms" totalInitContainerRuntime="70.124439ms" isStatefulPod=true podCreationTimestamp="2026-07-21 01:23:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:23:38.194229914 +0000 UTC m=+87.924598582" watchObservedRunningTime="2026-07-21 01:23:38.196153008 +0000 UTC m=+87.926521677"
Jul 21 01:23:38.367490 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:38.367448    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-69f8ccbdb8-kttn7" podUID="3e80a7f1-349e-4692-9fbd-6e539d9e6d63" containerName="registry" containerID="cri-o://ac7ba0adac00aa334293de70c84a0159e6214c137298a0ea3c408c180b8897aa" gracePeriod=30
Jul 21 01:23:38.544717 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:38.544686    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:38.622547 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:38.622524    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69f8ccbdb8-kttn7"
Jul 21 01:23:38.703331 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:38.703293    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8p4w\" (UniqueName: \"kubernetes.io/projected/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-kube-api-access-g8p4w\") pod \"3e80a7f1-349e-4692-9fbd-6e539d9e6d63\" (UID: \"3e80a7f1-349e-4692-9fbd-6e539d9e6d63\") "
Jul 21 01:23:38.703493 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:38.703345    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-trusted-ca\") pod \"3e80a7f1-349e-4692-9fbd-6e539d9e6d63\" (UID: \"3e80a7f1-349e-4692-9fbd-6e539d9e6d63\") "
Jul 21 01:23:38.703493 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:38.703367    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-ca-trust-extracted\") pod \"3e80a7f1-349e-4692-9fbd-6e539d9e6d63\" (UID: \"3e80a7f1-349e-4692-9fbd-6e539d9e6d63\") "
Jul 21 01:23:38.703587 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:38.703557    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-image-registry-private-configuration\") pod \"3e80a7f1-349e-4692-9fbd-6e539d9e6d63\" (UID: \"3e80a7f1-349e-4692-9fbd-6e539d9e6d63\") "
Jul 21 01:23:38.703641 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:38.703601    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-installation-pull-secrets\") pod \"3e80a7f1-349e-4692-9fbd-6e539d9e6d63\" (UID: \"3e80a7f1-349e-4692-9fbd-6e539d9e6d63\") "
Jul 21 01:23:38.703695 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:38.703641    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-bound-sa-token\") pod \"3e80a7f1-349e-4692-9fbd-6e539d9e6d63\" (UID: \"3e80a7f1-349e-4692-9fbd-6e539d9e6d63\") "
Jul 21 01:23:38.703695 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:38.703683    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-registry-tls\") pod \"3e80a7f1-349e-4692-9fbd-6e539d9e6d63\" (UID: \"3e80a7f1-349e-4692-9fbd-6e539d9e6d63\") "
Jul 21 01:23:38.703791 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:38.703712    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-registry-certificates\") pod \"3e80a7f1-349e-4692-9fbd-6e539d9e6d63\" (UID: \"3e80a7f1-349e-4692-9fbd-6e539d9e6d63\") "
Jul 21 01:23:38.704402 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:38.703710    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "3e80a7f1-349e-4692-9fbd-6e539d9e6d63" (UID: "3e80a7f1-349e-4692-9fbd-6e539d9e6d63"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:23:38.704555 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:38.704462    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "3e80a7f1-349e-4692-9fbd-6e539d9e6d63" (UID: "3e80a7f1-349e-4692-9fbd-6e539d9e6d63"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:23:38.706148 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:38.706116    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "3e80a7f1-349e-4692-9fbd-6e539d9e6d63" (UID: "3e80a7f1-349e-4692-9fbd-6e539d9e6d63"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:23:38.706276 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:38.706217    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-kube-api-access-g8p4w" (OuterVolumeSpecName: "kube-api-access-g8p4w") pod "3e80a7f1-349e-4692-9fbd-6e539d9e6d63" (UID: "3e80a7f1-349e-4692-9fbd-6e539d9e6d63"). InnerVolumeSpecName "kube-api-access-g8p4w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:23:38.706331 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:38.706274    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "3e80a7f1-349e-4692-9fbd-6e539d9e6d63" (UID: "3e80a7f1-349e-4692-9fbd-6e539d9e6d63"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:23:38.706601 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:38.706577    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "3e80a7f1-349e-4692-9fbd-6e539d9e6d63" (UID: "3e80a7f1-349e-4692-9fbd-6e539d9e6d63"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:23:38.706668 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:38.706640    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3e80a7f1-349e-4692-9fbd-6e539d9e6d63" (UID: "3e80a7f1-349e-4692-9fbd-6e539d9e6d63"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:23:38.712748 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:38.712726    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "3e80a7f1-349e-4692-9fbd-6e539d9e6d63" (UID: "3e80a7f1-349e-4692-9fbd-6e539d9e6d63"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:23:38.718831 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:38.718804    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:38.805147 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:38.805112    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-registry-tls\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 01:23:38.805147 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:38.805142    2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-registry-certificates\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 01:23:38.805348 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:38.805154    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8p4w\" (UniqueName: \"kubernetes.io/projected/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-kube-api-access-g8p4w\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 01:23:38.805348 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:38.805163    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-trusted-ca\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 01:23:38.805348 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:38.805171    2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-ca-trust-extracted\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 01:23:38.805348 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:38.805179    2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-image-registry-private-configuration\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 01:23:38.805348 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:38.805187    2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-installation-pull-secrets\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 01:23:38.805348 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:38.805223    2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3e80a7f1-349e-4692-9fbd-6e539d9e6d63-bound-sa-token\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 01:23:38.842644 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:38.842598    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:38.942594 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:38.942555    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:39.003911 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:39.003876    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:39.060315 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:39.060240    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:39.162188 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:39.162150    2561 generic.go:356] "Generic (PLEG): container finished" podID="3e80a7f1-349e-4692-9fbd-6e539d9e6d63" containerID="ac7ba0adac00aa334293de70c84a0159e6214c137298a0ea3c408c180b8897aa" exitCode=0
Jul 21 01:23:39.162659 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:39.162222    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69f8ccbdb8-kttn7"
Jul 21 01:23:39.162659 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:39.162238    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69f8ccbdb8-kttn7" event={"ID":"3e80a7f1-349e-4692-9fbd-6e539d9e6d63","Type":"ContainerDied","Data":"ac7ba0adac00aa334293de70c84a0159e6214c137298a0ea3c408c180b8897aa"}
Jul 21 01:23:39.162659 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:39.162284    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69f8ccbdb8-kttn7" event={"ID":"3e80a7f1-349e-4692-9fbd-6e539d9e6d63","Type":"ContainerDied","Data":"ca07b11f60b884d90c82176ef569192815964940491b24bce8934a9d362c731e"}
Jul 21 01:23:39.162659 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:39.162317    2561 scope.go:117] "RemoveContainer" containerID="ac7ba0adac00aa334293de70c84a0159e6214c137298a0ea3c408c180b8897aa"
Jul 21 01:23:39.170603 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:39.170587    2561 scope.go:117] "RemoveContainer" containerID="ac7ba0adac00aa334293de70c84a0159e6214c137298a0ea3c408c180b8897aa"
Jul 21 01:23:39.170867 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:23:39.170847    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac7ba0adac00aa334293de70c84a0159e6214c137298a0ea3c408c180b8897aa\": container with ID starting with ac7ba0adac00aa334293de70c84a0159e6214c137298a0ea3c408c180b8897aa not found: ID does not exist" containerID="ac7ba0adac00aa334293de70c84a0159e6214c137298a0ea3c408c180b8897aa"
Jul 21 01:23:39.170910 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:39.170874    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac7ba0adac00aa334293de70c84a0159e6214c137298a0ea3c408c180b8897aa"} err="failed to get container status \"ac7ba0adac00aa334293de70c84a0159e6214c137298a0ea3c408c180b8897aa\": rpc error: code = NotFound desc = could not find container \"ac7ba0adac00aa334293de70c84a0159e6214c137298a0ea3c408c180b8897aa\": container with ID starting with ac7ba0adac00aa334293de70c84a0159e6214c137298a0ea3c408c180b8897aa not found: ID does not exist"
Jul 21 01:23:39.178653 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:39.178630    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-69f8ccbdb8-kttn7"]
Jul 21 01:23:39.181991 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:39.181959    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:39.182497 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:39.182482    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-69f8ccbdb8-kttn7"]
Jul 21 01:23:40.518668 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:40.518637    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:40.584810 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:40.584780    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:40.713650 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:40.713609    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e80a7f1-349e-4692-9fbd-6e539d9e6d63" path="/var/lib/kubelet/pods/3e80a7f1-349e-4692-9fbd-6e539d9e6d63/volumes"
Jul 21 01:23:44.121946 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:44.121911    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:44.175526 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:44.175494    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:45.772469 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:45.772439    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:45.824552 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:45.824517    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:46.359094 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:46.359062    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:46.460899 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:46.460867    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:48.760829 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:48.760798    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:48.861586 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:48.861551    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:51.566175 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:51.566134    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:51.667714 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:51.667671    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:52.012685 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:52.012583    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:52.113466 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:52.113435    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:55.966396 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:55.966361    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:56.066534 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:56.066498    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:23:57.114272 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:23:57.114246    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fpg98"
Jul 21 01:24:05.560666 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:24:05.560626    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:24:05.662639 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:24:05.662607    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:24:06.967811 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:24:06.967779    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:24:07.034224 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:24:07.034172    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:24:07.373729 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:24:07.373691    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:24:07.439023 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:24:07.438992    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:24:13.779466 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:24:13.779427    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:24:13.881861 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:24:13.881814    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:24:13.980861 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:24:13.980829    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:24:22.009357 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:24:22.009316    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:24:22.107503 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:24:22.107465    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:24:22.206693 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:24:22.206653    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:24:37.071527 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:24:37.071493    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:24:37.172021 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:24:37.171988    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:24:53.428668 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:24:53.428624    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:24:53.848975 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:24:53.848940    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:25:02.943415 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:25:02.943333    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:25:02.994383 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:25:02.994351    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:25:13.073220 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:25:13.073163    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:25:13.902114 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:25:13.902085    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:25:14.063781 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:25:14.063746    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:25:14.117216 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:25:14.117167    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:25:45.690841 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:25:45.690804    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:25:45.745656 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:25:45.745608    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:26:08.634054 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:26:08.634020    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:26:08.686819 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:26:08.686789    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:26:20.621055 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:26:20.621023    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:26:20.689245 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:26:20.689192    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:26:25.627340 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:26:25.627304    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:26:25.684424 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:26:25.684398    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:26:25.751903 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:26:25.751871    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:26:25.806987 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:26:25.806956    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:26:26.349733 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:26:26.349703    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:26:26.408644 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:26:26.408615    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:26:28.336417 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:26:28.336382    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:26:36.220748 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:26:36.220669    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:26:36.320921 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:26:36.320889    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:26:36.421518 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:26:36.421485    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:26:37.019770 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:26:37.019743    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:26:37.120505 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:26:37.120465    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:27:10.594408 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:27:10.594378    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2p4wt_1701009a-d778-4d6d-b59f-e91ec4b13a60/ovn-acl-logging/0.log"
Jul 21 01:27:10.598070 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:27:10.598048    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2p4wt_1701009a-d778-4d6d-b59f-e91ec4b13a60/ovn-acl-logging/0.log"
Jul 21 01:27:10.600019 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:27:10.600002    2561 kubelet.go:1648] "Image garbage collection succeeded"
Jul 21 01:27:17.248866 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:27:17.248833    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:27:18.554182 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:27:18.554154    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:27:40.794338 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:27:40.794304    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:27:40.888134 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:27:40.888103    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:07.586580 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:07.586540    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:08.362474 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:08.362441    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:11.159315 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:11.159287    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:11.265184 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:11.265158    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:12.567052 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:12.567007    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:12.667684 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:12.667649    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:12.889160 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:12.889078    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:12.985658 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:12.985626    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:14.779951 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:14.779919    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:15.383552 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:15.383517    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:17.957771 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:17.957738    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:18.009535 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:18.009506    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:22.333169 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:22.333126    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:22.390850 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:22.390817    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:23.385089 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:23.385060    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:23.969521 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:23.969490    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:24.067582 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:24.067551    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:30.473979 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:30.473946    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:30.574194 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:30.574164    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:32.353455 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:32.353426    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:44.173968 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:44.173928    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:44.269453 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:44.269420    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:44.792650 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:44.792611    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:44.990229 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:44.990185    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:45.090793 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:45.090720    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:45.136173 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:45.136143    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-bx7mf"]
Jul 21 01:28:45.136419 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:45.136405    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e80a7f1-349e-4692-9fbd-6e539d9e6d63" containerName="registry"
Jul 21 01:28:45.136419 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:45.136420    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e80a7f1-349e-4692-9fbd-6e539d9e6d63" containerName="registry"
Jul 21 01:28:45.136540 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:45.136475    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e80a7f1-349e-4692-9fbd-6e539d9e6d63" containerName="registry"
Jul 21 01:28:45.138241 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:45.138220    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-bx7mf"
Jul 21 01:28:45.141562 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:45.141535    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 21 01:28:45.141726 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:45.141587    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 21 01:28:45.141726 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:45.141587    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 21 01:28:45.141853 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:45.141735    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 21 01:28:45.141853 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:45.141765    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6gbcd\""
Jul 21 01:28:45.179772 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:45.179739    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-bx7mf"]
Jul 21 01:28:45.250752 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:45.250718    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec96e083-a540-4ac3-8899-c04e96d9225f-webhook-cert\") pod \"opendatahub-operator-controller-manager-74c7b5f9f-bx7mf\" (UID: \"ec96e083-a540-4ac3-8899-c04e96d9225f\") " pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-bx7mf"
Jul 21 01:28:45.250929 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:45.250759    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rx49\" (UniqueName: \"kubernetes.io/projected/ec96e083-a540-4ac3-8899-c04e96d9225f-kube-api-access-7rx49\") pod \"opendatahub-operator-controller-manager-74c7b5f9f-bx7mf\" (UID: \"ec96e083-a540-4ac3-8899-c04e96d9225f\") " pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-bx7mf"
Jul 21 01:28:45.250929 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:45.250789    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec96e083-a540-4ac3-8899-c04e96d9225f-tmp\") pod \"opendatahub-operator-controller-manager-74c7b5f9f-bx7mf\" (UID: \"ec96e083-a540-4ac3-8899-c04e96d9225f\") " pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-bx7mf"
Jul 21 01:28:45.250929 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:45.250869    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ec96e083-a540-4ac3-8899-c04e96d9225f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74c7b5f9f-bx7mf\" (UID: \"ec96e083-a540-4ac3-8899-c04e96d9225f\") " pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-bx7mf"
Jul 21 01:28:45.251057 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:45.250951    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ec96e083-a540-4ac3-8899-c04e96d9225f-manifests\") pod \"opendatahub-operator-controller-manager-74c7b5f9f-bx7mf\" (UID: \"ec96e083-a540-4ac3-8899-c04e96d9225f\") " pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-bx7mf"
Jul 21 01:28:45.304823 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:45.304789    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:45.351669 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:45.351580    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec96e083-a540-4ac3-8899-c04e96d9225f-webhook-cert\") pod \"opendatahub-operator-controller-manager-74c7b5f9f-bx7mf\" (UID: \"ec96e083-a540-4ac3-8899-c04e96d9225f\") " pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-bx7mf"
Jul 21 01:28:45.351669 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:45.351615    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rx49\" (UniqueName: \"kubernetes.io/projected/ec96e083-a540-4ac3-8899-c04e96d9225f-kube-api-access-7rx49\") pod \"opendatahub-operator-controller-manager-74c7b5f9f-bx7mf\" (UID: \"ec96e083-a540-4ac3-8899-c04e96d9225f\") " pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-bx7mf"
Jul 21 01:28:45.351669 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:45.351634    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec96e083-a540-4ac3-8899-c04e96d9225f-tmp\") pod \"opendatahub-operator-controller-manager-74c7b5f9f-bx7mf\" (UID: \"ec96e083-a540-4ac3-8899-c04e96d9225f\") " pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-bx7mf"
Jul 21 01:28:45.351952 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:45.351755    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ec96e083-a540-4ac3-8899-c04e96d9225f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74c7b5f9f-bx7mf\" (UID: \"ec96e083-a540-4ac3-8899-c04e96d9225f\") " pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-bx7mf"
Jul 21 01:28:45.351952 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:45.351832    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ec96e083-a540-4ac3-8899-c04e96d9225f-manifests\") pod \"opendatahub-operator-controller-manager-74c7b5f9f-bx7mf\" (UID: \"ec96e083-a540-4ac3-8899-c04e96d9225f\") " pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-bx7mf"
Jul 21 01:28:45.352188 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:45.352161    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ec96e083-a540-4ac3-8899-c04e96d9225f-manifests\") pod \"opendatahub-operator-controller-manager-74c7b5f9f-bx7mf\" (UID: \"ec96e083-a540-4ac3-8899-c04e96d9225f\") " pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-bx7mf"
Jul 21 01:28:45.354061 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:45.354037    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec96e083-a540-4ac3-8899-c04e96d9225f-tmp\") pod \"opendatahub-operator-controller-manager-74c7b5f9f-bx7mf\" (UID: \"ec96e083-a540-4ac3-8899-c04e96d9225f\") " pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-bx7mf"
Jul 21 01:28:45.354399 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:45.354379    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ec96e083-a540-4ac3-8899-c04e96d9225f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74c7b5f9f-bx7mf\" (UID: \"ec96e083-a540-4ac3-8899-c04e96d9225f\") " pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-bx7mf"
Jul 21 01:28:45.354470 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:45.354453    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec96e083-a540-4ac3-8899-c04e96d9225f-webhook-cert\") pod \"opendatahub-operator-controller-manager-74c7b5f9f-bx7mf\" (UID: \"ec96e083-a540-4ac3-8899-c04e96d9225f\") " pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-bx7mf"
Jul 21 01:28:45.361919 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:45.361896    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rx49\" (UniqueName: \"kubernetes.io/projected/ec96e083-a540-4ac3-8899-c04e96d9225f-kube-api-access-7rx49\") pod \"opendatahub-operator-controller-manager-74c7b5f9f-bx7mf\" (UID: \"ec96e083-a540-4ac3-8899-c04e96d9225f\") " pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-bx7mf"
Jul 21 01:28:45.408392 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:45.408363    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:45.447972 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:45.447943    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-bx7mf"
Jul 21 01:28:45.506328 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:45.506295    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:45.582105 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:45.582063    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:45.582299 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:45.582261    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-bx7mf"]
Jul 21 01:28:45.585260 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:28:45.585236    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec96e083_a540_4ac3_8899_c04e96d9225f.slice/crio-07863ec78d327e01501191d46936589f599ec4d47ec1f376185d87bea36e7a20 WatchSource:0}: Error finding container 07863ec78d327e01501191d46936589f599ec4d47ec1f376185d87bea36e7a20: Status 404 returned error can't find the container with id 07863ec78d327e01501191d46936589f599ec4d47ec1f376185d87bea36e7a20
Jul 21 01:28:45.586919 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:45.586904    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 01:28:45.644099 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:45.643995    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:45.745298 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:45.745257    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:45.845774 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:45.845744    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:28:46.141502 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:46.141465    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-bx7mf" event={"ID":"ec96e083-a540-4ac3-8899-c04e96d9225f","Type":"ContainerStarted","Data":"07863ec78d327e01501191d46936589f599ec4d47ec1f376185d87bea36e7a20"}
Jul 21 01:28:49.154935 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:49.154903    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-bx7mf" event={"ID":"ec96e083-a540-4ac3-8899-c04e96d9225f","Type":"ContainerStarted","Data":"7b90319866ed2c74d1b3e9d3bbbe95169a54dd9653913b538273326b30df773d"}
Jul 21 01:28:50.160013 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:50.159931    2561 generic.go:356] "Generic (PLEG): container finished" podID="ec96e083-a540-4ac3-8899-c04e96d9225f" containerID="7b90319866ed2c74d1b3e9d3bbbe95169a54dd9653913b538273326b30df773d" exitCode=0
Jul 21 01:28:50.160013 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:50.159979    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-bx7mf" event={"ID":"ec96e083-a540-4ac3-8899-c04e96d9225f","Type":"ContainerDied","Data":"7b90319866ed2c74d1b3e9d3bbbe95169a54dd9653913b538273326b30df773d"}
Jul 21 01:28:51.166122 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:51.166085    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-bx7mf" event={"ID":"ec96e083-a540-4ac3-8899-c04e96d9225f","Type":"ContainerStarted","Data":"ab5688566c7496f41c09eba38f44a2aee0e9643b430b487d4f95d311d5784933"}
Jul 21 01:28:51.166540 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:51.166242    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-bx7mf"
Jul 21 01:28:51.189910 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:28:51.189858    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-bx7mf" podStartSLOduration=1.626932539 podStartE2EDuration="6.189842036s" totalImagesPullingTime="3.557215934s" totalInitContainerRuntime="1.005693563s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:28:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:28:51.188153898 +0000 UTC m=+400.918522586" watchObservedRunningTime="2026-07-21 01:28:51.189842036 +0000 UTC m=+400.920210707"
Jul 21 01:29:01.342931 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:01.342899    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:29:01.605586 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:01.605508    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:29:01.712425 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:01.712392    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:29:02.172706 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:02.172679    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-74c7b5f9f-bx7mf"
Jul 21 01:29:03.679823 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:03.679790    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c984b598c-2hmct"]
Jul 21 01:29:03.683043 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:03.683026    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c984b598c-2hmct"
Jul 21 01:29:03.689705 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:03.689674    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 21 01:29:03.689849 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:03.689706    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 21 01:29:03.689849 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:03.689759    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-62jbl\""
Jul 21 01:29:03.689849 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:03.689674    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 21 01:29:03.689849 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:03.689842    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 21 01:29:03.690034 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:03.689675    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 21 01:29:03.693195 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:03.693162    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c984b598c-2hmct"]
Jul 21 01:29:03.789445 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:03.789399    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef6d1e0c-cf5b-4a58-a05c-bf6e60436c5f-metrics-cert\") pod \"lws-controller-manager-7c984b598c-2hmct\" (UID: \"ef6d1e0c-cf5b-4a58-a05c-bf6e60436c5f\") " pod="openshift-lws-operator/lws-controller-manager-7c984b598c-2hmct"
Jul 21 01:29:03.789445 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:03.789453    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ef6d1e0c-cf5b-4a58-a05c-bf6e60436c5f-manager-config\") pod \"lws-controller-manager-7c984b598c-2hmct\" (UID: \"ef6d1e0c-cf5b-4a58-a05c-bf6e60436c5f\") " pod="openshift-lws-operator/lws-controller-manager-7c984b598c-2hmct"
Jul 21 01:29:03.789661 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:03.789514    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p299f\" (UniqueName: \"kubernetes.io/projected/ef6d1e0c-cf5b-4a58-a05c-bf6e60436c5f-kube-api-access-p299f\") pod \"lws-controller-manager-7c984b598c-2hmct\" (UID: \"ef6d1e0c-cf5b-4a58-a05c-bf6e60436c5f\") " pod="openshift-lws-operator/lws-controller-manager-7c984b598c-2hmct"
Jul 21 01:29:03.789661 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:03.789565    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef6d1e0c-cf5b-4a58-a05c-bf6e60436c5f-cert\") pod \"lws-controller-manager-7c984b598c-2hmct\" (UID: \"ef6d1e0c-cf5b-4a58-a05c-bf6e60436c5f\") " pod="openshift-lws-operator/lws-controller-manager-7c984b598c-2hmct"
Jul 21 01:29:03.890786 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:03.890744    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef6d1e0c-cf5b-4a58-a05c-bf6e60436c5f-metrics-cert\") pod \"lws-controller-manager-7c984b598c-2hmct\" (UID: \"ef6d1e0c-cf5b-4a58-a05c-bf6e60436c5f\") " pod="openshift-lws-operator/lws-controller-manager-7c984b598c-2hmct"
Jul 21 01:29:03.890786 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:03.890781    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ef6d1e0c-cf5b-4a58-a05c-bf6e60436c5f-manager-config\") pod \"lws-controller-manager-7c984b598c-2hmct\" (UID: \"ef6d1e0c-cf5b-4a58-a05c-bf6e60436c5f\") " pod="openshift-lws-operator/lws-controller-manager-7c984b598c-2hmct"
Jul 21 01:29:03.891008 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:03.890804    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p299f\" (UniqueName: \"kubernetes.io/projected/ef6d1e0c-cf5b-4a58-a05c-bf6e60436c5f-kube-api-access-p299f\") pod \"lws-controller-manager-7c984b598c-2hmct\" (UID: \"ef6d1e0c-cf5b-4a58-a05c-bf6e60436c5f\") " pod="openshift-lws-operator/lws-controller-manager-7c984b598c-2hmct"
Jul 21 01:29:03.891008 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:03.890837    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef6d1e0c-cf5b-4a58-a05c-bf6e60436c5f-cert\") pod \"lws-controller-manager-7c984b598c-2hmct\" (UID: \"ef6d1e0c-cf5b-4a58-a05c-bf6e60436c5f\") " pod="openshift-lws-operator/lws-controller-manager-7c984b598c-2hmct"
Jul 21 01:29:03.891590 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:03.891561    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ef6d1e0c-cf5b-4a58-a05c-bf6e60436c5f-manager-config\") pod \"lws-controller-manager-7c984b598c-2hmct\" (UID: \"ef6d1e0c-cf5b-4a58-a05c-bf6e60436c5f\") " pod="openshift-lws-operator/lws-controller-manager-7c984b598c-2hmct"
Jul 21 01:29:03.893542 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:03.893522    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef6d1e0c-cf5b-4a58-a05c-bf6e60436c5f-metrics-cert\") pod \"lws-controller-manager-7c984b598c-2hmct\" (UID: \"ef6d1e0c-cf5b-4a58-a05c-bf6e60436c5f\") " pod="openshift-lws-operator/lws-controller-manager-7c984b598c-2hmct"
Jul 21 01:29:03.893652 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:03.893583    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef6d1e0c-cf5b-4a58-a05c-bf6e60436c5f-cert\") pod \"lws-controller-manager-7c984b598c-2hmct\" (UID: \"ef6d1e0c-cf5b-4a58-a05c-bf6e60436c5f\") " pod="openshift-lws-operator/lws-controller-manager-7c984b598c-2hmct"
Jul 21 01:29:03.908392 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:03.908371    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p299f\" (UniqueName: \"kubernetes.io/projected/ef6d1e0c-cf5b-4a58-a05c-bf6e60436c5f-kube-api-access-p299f\") pod \"lws-controller-manager-7c984b598c-2hmct\" (UID: \"ef6d1e0c-cf5b-4a58-a05c-bf6e60436c5f\") " pod="openshift-lws-operator/lws-controller-manager-7c984b598c-2hmct"
Jul 21 01:29:03.997849 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:03.997748    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c984b598c-2hmct"
Jul 21 01:29:04.163757 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:04.163721    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c984b598c-2hmct"]
Jul 21 01:29:04.167138 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:29:04.167104    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef6d1e0c_cf5b_4a58_a05c_bf6e60436c5f.slice/crio-8c6c735e908d9f8d2128b7eea5825245ad8aff32f64f34a2675dde7a7d7c634c WatchSource:0}: Error finding container 8c6c735e908d9f8d2128b7eea5825245ad8aff32f64f34a2675dde7a7d7c634c: Status 404 returned error can't find the container with id 8c6c735e908d9f8d2128b7eea5825245ad8aff32f64f34a2675dde7a7d7c634c
Jul 21 01:29:04.204883 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:04.204838    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:29:04.211144 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:04.211104    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c984b598c-2hmct" event={"ID":"ef6d1e0c-cf5b-4a58-a05c-bf6e60436c5f","Type":"ContainerStarted","Data":"8c6c735e908d9f8d2128b7eea5825245ad8aff32f64f34a2675dde7a7d7c634c"}
Jul 21 01:29:04.376705 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:04.376662    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:29:04.653559 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:04.653425    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:29:04.787385 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:04.787352    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:29:05.245558 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:05.245524    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:29:05.333694 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:05.333598    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:29:05.423795 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:05.423759    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:29:05.715523 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:05.715457    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:29:06.127801 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:06.127729    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:29:06.220185 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:06.220151    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:29:06.278328 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:06.278294    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:29:07.225051 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:07.224961    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c984b598c-2hmct" event={"ID":"ef6d1e0c-cf5b-4a58-a05c-bf6e60436c5f","Type":"ContainerStarted","Data":"021a590c958106882c16cf8afc5d68f74849b97a6eaa902e96e453b17d13e641"}
Jul 21 01:29:07.225455 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:07.225094    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7c984b598c-2hmct"
Jul 21 01:29:07.242874 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:07.242826    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7c984b598c-2hmct" podStartSLOduration=1.5644741610000001 podStartE2EDuration="4.242810991s" totalImagesPullingTime="2.67833683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:29:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:29:07.241659817 +0000 UTC m=+416.972028504" watchObservedRunningTime="2026-07-21 01:29:07.242810991 +0000 UTC m=+416.973179660"
Jul 21 01:29:07.252374 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:07.252330    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:29:11.950297 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:11.950264    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:29:12.048507 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:12.048467    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:29:12.602672 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:12.602639    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wzf5m"]
Jul 21 01:29:12.607152 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:12.607131    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wzf5m"
Jul 21 01:29:12.610173 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:12.610155    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 21 01:29:12.610322 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:12.610239    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 21 01:29:12.610322 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:12.610268    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 21 01:29:12.610322 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:12.610278    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 21 01:29:12.610322 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:12.610282    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-dfmk2\""
Jul 21 01:29:12.610596 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:12.610337    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 21 01:29:12.610596 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:12.610576    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 21 01:29:12.620489 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:12.620465    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wzf5m"]
Jul 21 01:29:12.660798 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:12.660769    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4c368a1b-8af1-4f86-84ee-1c46e4f49f9f-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-wzf5m\" (UID: \"4c368a1b-8af1-4f86-84ee-1c46e4f49f9f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wzf5m"
Jul 21 01:29:12.660798 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:12.660801    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4c368a1b-8af1-4f86-84ee-1c46e4f49f9f-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-wzf5m\" (UID: \"4c368a1b-8af1-4f86-84ee-1c46e4f49f9f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wzf5m"
Jul 21 01:29:12.661039 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:12.660826    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c368a1b-8af1-4f86-84ee-1c46e4f49f9f-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-wzf5m\" (UID: \"4c368a1b-8af1-4f86-84ee-1c46e4f49f9f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wzf5m"
Jul 21 01:29:12.661039 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:12.660916    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4c368a1b-8af1-4f86-84ee-1c46e4f49f9f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-wzf5m\" (UID: \"4c368a1b-8af1-4f86-84ee-1c46e4f49f9f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wzf5m"
Jul 21 01:29:12.661039 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:12.660956    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4c368a1b-8af1-4f86-84ee-1c46e4f49f9f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-wzf5m\" (UID: \"4c368a1b-8af1-4f86-84ee-1c46e4f49f9f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wzf5m"
Jul 21 01:29:12.661039 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:12.660999    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8fqk\" (UniqueName: \"kubernetes.io/projected/4c368a1b-8af1-4f86-84ee-1c46e4f49f9f-kube-api-access-n8fqk\") pod \"istiod-openshift-gateway-94bb8fbfd-wzf5m\" (UID: \"4c368a1b-8af1-4f86-84ee-1c46e4f49f9f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wzf5m"
Jul 21 01:29:12.661039 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:12.661028    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c368a1b-8af1-4f86-84ee-1c46e4f49f9f-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-wzf5m\" (UID: \"4c368a1b-8af1-4f86-84ee-1c46e4f49f9f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wzf5m"
Jul 21 01:29:12.724056 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:12.724025    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:29:12.761955 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:12.761920    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4c368a1b-8af1-4f86-84ee-1c46e4f49f9f-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-wzf5m\" (UID: \"4c368a1b-8af1-4f86-84ee-1c46e4f49f9f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wzf5m"
Jul 21 01:29:12.761955 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:12.761954    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4c368a1b-8af1-4f86-84ee-1c46e4f49f9f-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-wzf5m\" (UID: \"4c368a1b-8af1-4f86-84ee-1c46e4f49f9f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wzf5m"
Jul 21 01:29:12.762194 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:12.761977    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c368a1b-8af1-4f86-84ee-1c46e4f49f9f-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-wzf5m\" (UID: \"4c368a1b-8af1-4f86-84ee-1c46e4f49f9f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wzf5m"
Jul 21 01:29:12.762194 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:12.762013    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4c368a1b-8af1-4f86-84ee-1c46e4f49f9f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-wzf5m\" (UID: \"4c368a1b-8af1-4f86-84ee-1c46e4f49f9f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wzf5m"
Jul 21 01:29:12.762194 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:12.762042    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4c368a1b-8af1-4f86-84ee-1c46e4f49f9f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-wzf5m\" (UID: \"4c368a1b-8af1-4f86-84ee-1c46e4f49f9f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wzf5m"
Jul 21 01:29:12.762194 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:12.762080    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8fqk\" (UniqueName: \"kubernetes.io/projected/4c368a1b-8af1-4f86-84ee-1c46e4f49f9f-kube-api-access-n8fqk\") pod \"istiod-openshift-gateway-94bb8fbfd-wzf5m\" (UID: \"4c368a1b-8af1-4f86-84ee-1c46e4f49f9f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wzf5m"
Jul 21 01:29:12.762194 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:12.762108    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c368a1b-8af1-4f86-84ee-1c46e4f49f9f-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-wzf5m\" (UID: \"4c368a1b-8af1-4f86-84ee-1c46e4f49f9f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wzf5m"
Jul 21 01:29:12.762967 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:12.762940    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4c368a1b-8af1-4f86-84ee-1c46e4f49f9f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-wzf5m\" (UID: \"4c368a1b-8af1-4f86-84ee-1c46e4f49f9f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wzf5m"
Jul 21 01:29:12.765041 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:12.765015    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4c368a1b-8af1-4f86-84ee-1c46e4f49f9f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-wzf5m\" (UID: \"4c368a1b-8af1-4f86-84ee-1c46e4f49f9f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wzf5m"
Jul 21 01:29:12.765153 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:12.765015    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c368a1b-8af1-4f86-84ee-1c46e4f49f9f-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-wzf5m\" (UID: \"4c368a1b-8af1-4f86-84ee-1c46e4f49f9f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wzf5m"
Jul 21 01:29:12.765153 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:12.765083    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4c368a1b-8af1-4f86-84ee-1c46e4f49f9f-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-wzf5m\" (UID: \"4c368a1b-8af1-4f86-84ee-1c46e4f49f9f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wzf5m"
Jul 21 01:29:12.765276 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:12.765148    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4c368a1b-8af1-4f86-84ee-1c46e4f49f9f-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-wzf5m\" (UID: \"4c368a1b-8af1-4f86-84ee-1c46e4f49f9f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wzf5m"
Jul 21 01:29:12.772830 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:12.772808    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c368a1b-8af1-4f86-84ee-1c46e4f49f9f-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-wzf5m\" (UID: \"4c368a1b-8af1-4f86-84ee-1c46e4f49f9f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wzf5m"
Jul 21 01:29:12.773084 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:12.773069    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8fqk\" (UniqueName: \"kubernetes.io/projected/4c368a1b-8af1-4f86-84ee-1c46e4f49f9f-kube-api-access-n8fqk\") pod \"istiod-openshift-gateway-94bb8fbfd-wzf5m\" (UID: \"4c368a1b-8af1-4f86-84ee-1c46e4f49f9f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wzf5m"
Jul 21 01:29:12.916742 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:12.916655    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wzf5m"
Jul 21 01:29:13.009054 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:13.008982    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:29:13.060086 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:13.060047    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wzf5m"]
Jul 21 01:29:13.063351 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:29:13.063311    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c368a1b_8af1_4f86_84ee_1c46e4f49f9f.slice/crio-b5b0e889851b9e9c1328c8d7075f47e557a49a22665baff175394326b5dd6f82 WatchSource:0}: Error finding container b5b0e889851b9e9c1328c8d7075f47e557a49a22665baff175394326b5dd6f82: Status 404 returned error can't find the container with id b5b0e889851b9e9c1328c8d7075f47e557a49a22665baff175394326b5dd6f82
Jul 21 01:29:13.110435 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:13.110395    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:29:13.254994 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:13.254901    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wzf5m" event={"ID":"4c368a1b-8af1-4f86-84ee-1c46e4f49f9f","Type":"ContainerStarted","Data":"b5b0e889851b9e9c1328c8d7075f47e557a49a22665baff175394326b5dd6f82"}
Jul 21 01:29:15.136594 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:15.136550    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 01:29:15.136947 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:15.136620    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 21 01:29:15.264023 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:15.263988    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wzf5m" event={"ID":"4c368a1b-8af1-4f86-84ee-1c46e4f49f9f","Type":"ContainerStarted","Data":"ee8838465d29fb9e5db5ec82c7f0d2bee7d318b7c805ec0ceb9b7446462e65f9"}
Jul 21 01:29:15.264158 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:15.264084    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wzf5m"
Jul 21 01:29:15.320762 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:15.320715    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wzf5m" podStartSLOduration=1.25051761 podStartE2EDuration="3.320698799s" totalImagesPullingTime="2.070181189s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:29:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:29:15.320151319 +0000 UTC m=+425.050519990" watchObservedRunningTime="2026-07-21 01:29:15.320698799 +0000 UTC m=+425.051067469"
Jul 21 01:29:15.411167 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:15.411079    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:29:15.530607 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:15.530579    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:29:15.628896 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:15.628830    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:29:15.734631 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:15.734530    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:29:15.854471 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:15.854430    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:29:15.976913 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:15.976879    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:29:16.269845 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:16.269819    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wzf5m"
Jul 21 01:29:18.231489 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:18.231458    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7c984b598c-2hmct"
Jul 21 01:29:25.123328 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:25.123292    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:29:25.178529 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:25.178492    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:29:39.316037 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:39.315950    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:29:39.369501 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:39.369473    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:29:41.270732 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:41.270692    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:29:41.324999 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:41.324946    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:29:43.100822 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:29:43.100790    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:30:05.669918 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:30:05.669860    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:30:05.770061 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:30:05.770006    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:30:05.869372 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:30:05.869331    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:30:12.089575 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:30:12.089542    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:30:12.351002 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:30:12.350904    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:30:12.951572 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:30:12.951539    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:30:13.005802 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:30:13.005734    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:30:23.342153 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:30:23.342116    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:30:23.443052 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:30:23.443016    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:30:23.503770 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:30:23.503736    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:30:34.515478 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:30:34.515443    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:30:38.721053 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:30:38.721020    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:30:41.712792 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:30:41.712757    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:30:43.354854 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:30:43.354817    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:30:44.795733 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:30:44.795696    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:30:46.299885 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:30:46.299835    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:30:46.564825 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:30:46.564735    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:30:46.912184 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:30:46.912100    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:30:49.202458 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:30:49.202427    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:30:49.326478 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:30:49.326446    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:30:51.312846 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:30:51.312818    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:30:51.420669 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:30:51.420632    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:30:53.319513 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:30:53.319479    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:30:53.387988 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:30:53.387955    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:30:56.218427 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:30:56.218393    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:30:56.330859 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:30:56.330829    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:30:56.893810 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:30:56.893780    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:30:58.523485 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:30:58.523455    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:30:58.580760 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:30:58.580726    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:31:06.706070 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:31:06.706035    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:31:06.813070 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:31:06.813035    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:31:09.344004 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:31:09.343960    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:31:09.444362 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:31:09.444324    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:31:12.282526 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:31:12.282490    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:31:12.384403 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:31:12.384374    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:31:16.088673 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:31:16.088642    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:31:16.146125 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:31:16.146093    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:31:19.935790 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:31:19.935758    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:31:24.662403 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:31:24.662373    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:31:24.761674 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:31:24.761641    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:31:35.976889 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:31:35.976857    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:31:36.480388 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:31:36.480351    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:31:36.854378 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:31:36.854342    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:31:36.955272 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:31:36.955193    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:31:51.291777 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:31:51.291746    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-plwwc"]
Jul 21 01:31:51.294891 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:31:51.294874    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-plwwc"
Jul 21 01:31:51.297604 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:31:51.297499    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 21 01:31:51.297604 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:31:51.297555    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 21 01:31:51.297604 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:31:51.297566    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-z6sgp\""
Jul 21 01:31:51.298370 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:31:51.298344    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:31:51.298505 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:31:51.298489    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 21 01:31:51.302144 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:31:51.302120    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-plwwc"]
Jul 21 01:31:51.364471 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:31:51.364436    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d2030dbc-2773-44be-b4f7-fade33fb982b-config-file\") pod \"limitador-limitador-64c94fd64f-plwwc\" (UID: \"d2030dbc-2773-44be-b4f7-fade33fb982b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-plwwc"
Jul 21 01:31:51.364674 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:31:51.364478    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqrth\" (UniqueName: \"kubernetes.io/projected/d2030dbc-2773-44be-b4f7-fade33fb982b-kube-api-access-vqrth\") pod \"limitador-limitador-64c94fd64f-plwwc\" (UID: \"d2030dbc-2773-44be-b4f7-fade33fb982b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-plwwc"
Jul 21 01:31:51.387909 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:31:51.387875    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-plwwc"]
Jul 21 01:31:51.390059 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:31:51.390031    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:31:51.453853 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:31:51.453810    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:31:51.465009 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:31:51.464988    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d2030dbc-2773-44be-b4f7-fade33fb982b-config-file\") pod \"limitador-limitador-64c94fd64f-plwwc\" (UID: \"d2030dbc-2773-44be-b4f7-fade33fb982b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-plwwc"
Jul 21 01:31:51.465136 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:31:51.465027    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqrth\" (UniqueName: \"kubernetes.io/projected/d2030dbc-2773-44be-b4f7-fade33fb982b-kube-api-access-vqrth\") pod \"limitador-limitador-64c94fd64f-plwwc\" (UID: \"d2030dbc-2773-44be-b4f7-fade33fb982b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-plwwc"
Jul 21 01:31:51.465596 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:31:51.465576    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d2030dbc-2773-44be-b4f7-fade33fb982b-config-file\") pod \"limitador-limitador-64c94fd64f-plwwc\" (UID: \"d2030dbc-2773-44be-b4f7-fade33fb982b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-plwwc"
Jul 21 01:31:51.474335 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:31:51.474313    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqrth\" (UniqueName: \"kubernetes.io/projected/d2030dbc-2773-44be-b4f7-fade33fb982b-kube-api-access-vqrth\") pod \"limitador-limitador-64c94fd64f-plwwc\" (UID: \"d2030dbc-2773-44be-b4f7-fade33fb982b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-plwwc"
Jul 21 01:31:51.606040 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:31:51.605972    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-plwwc"
Jul 21 01:31:51.730890 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:31:51.730867    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-plwwc"]
Jul 21 01:31:51.733006 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:31:51.732975    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2030dbc_2773_44be_b4f7_fade33fb982b.slice/crio-10833e43f6fdbfbbec6c602c2cd42bcfb02950d34091d7c27509a72457414138 WatchSource:0}: Error finding container 10833e43f6fdbfbbec6c602c2cd42bcfb02950d34091d7c27509a72457414138: Status 404 returned error can't find the container with id 10833e43f6fdbfbbec6c602c2cd42bcfb02950d34091d7c27509a72457414138
Jul 21 01:31:51.804025 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:31:51.803993    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-plwwc" event={"ID":"d2030dbc-2773-44be-b4f7-fade33fb982b","Type":"ContainerStarted","Data":"10833e43f6fdbfbbec6c602c2cd42bcfb02950d34091d7c27509a72457414138"}
Jul 21 01:31:52.109423 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:31:52.109374    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:31:52.169774 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:31:52.169741    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:31:54.817416 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:31:54.817381    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-plwwc" event={"ID":"d2030dbc-2773-44be-b4f7-fade33fb982b","Type":"ContainerStarted","Data":"3fa122131af85bb4aad37f96351f56f3ecc5534c307880ee12511f6d32fdb596"}
Jul 21 01:31:54.817809 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:31:54.817523    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-plwwc"
Jul 21 01:31:54.838620 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:31:54.834991    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-plwwc" podStartSLOduration=1.18251669 podStartE2EDuration="3.834967508s" totalImagesPullingTime="2.652450818s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:31:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:31:54.833530181 +0000 UTC m=+584.563898852" watchObservedRunningTime="2026-07-21 01:31:54.834967508 +0000 UTC m=+584.565336180"
Jul 21 01:32:05.822735 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:05.822703    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-plwwc"
Jul 21 01:32:08.154030 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:08.153991    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-plwwc"]
Jul 21 01:32:08.154571 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:08.154241    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-plwwc" podUID="d2030dbc-2773-44be-b4f7-fade33fb982b" containerName="limitador" containerID="cri-o://3fa122131af85bb4aad37f96351f56f3ecc5534c307880ee12511f6d32fdb596" gracePeriod=30
Jul 21 01:32:08.696976 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:08.696954    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-plwwc"
Jul 21 01:32:08.796566 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:08.796545    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqrth\" (UniqueName: \"kubernetes.io/projected/d2030dbc-2773-44be-b4f7-fade33fb982b-kube-api-access-vqrth\") pod \"d2030dbc-2773-44be-b4f7-fade33fb982b\" (UID: \"d2030dbc-2773-44be-b4f7-fade33fb982b\") "
Jul 21 01:32:08.796737 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:08.796589    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d2030dbc-2773-44be-b4f7-fade33fb982b-config-file\") pod \"d2030dbc-2773-44be-b4f7-fade33fb982b\" (UID: \"d2030dbc-2773-44be-b4f7-fade33fb982b\") "
Jul 21 01:32:08.796995 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:08.796972    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2030dbc-2773-44be-b4f7-fade33fb982b-config-file" (OuterVolumeSpecName: "config-file") pod "d2030dbc-2773-44be-b4f7-fade33fb982b" (UID: "d2030dbc-2773-44be-b4f7-fade33fb982b"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:32:08.798844 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:08.798823    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2030dbc-2773-44be-b4f7-fade33fb982b-kube-api-access-vqrth" (OuterVolumeSpecName: "kube-api-access-vqrth") pod "d2030dbc-2773-44be-b4f7-fade33fb982b" (UID: "d2030dbc-2773-44be-b4f7-fade33fb982b"). InnerVolumeSpecName "kube-api-access-vqrth". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:32:08.867963 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:08.867933    2561 generic.go:356] "Generic (PLEG): container finished" podID="d2030dbc-2773-44be-b4f7-fade33fb982b" containerID="3fa122131af85bb4aad37f96351f56f3ecc5534c307880ee12511f6d32fdb596" exitCode=0
Jul 21 01:32:08.868121 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:08.867984    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-plwwc"
Jul 21 01:32:08.868121 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:08.868019    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-plwwc" event={"ID":"d2030dbc-2773-44be-b4f7-fade33fb982b","Type":"ContainerDied","Data":"3fa122131af85bb4aad37f96351f56f3ecc5534c307880ee12511f6d32fdb596"}
Jul 21 01:32:08.868121 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:08.868068    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-plwwc" event={"ID":"d2030dbc-2773-44be-b4f7-fade33fb982b","Type":"ContainerDied","Data":"10833e43f6fdbfbbec6c602c2cd42bcfb02950d34091d7c27509a72457414138"}
Jul 21 01:32:08.868121 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:08.868091    2561 scope.go:117] "RemoveContainer" containerID="3fa122131af85bb4aad37f96351f56f3ecc5534c307880ee12511f6d32fdb596"
Jul 21 01:32:08.876780 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:08.876707    2561 scope.go:117] "RemoveContainer" containerID="3fa122131af85bb4aad37f96351f56f3ecc5534c307880ee12511f6d32fdb596"
Jul 21 01:32:08.878063 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:32:08.877299    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fa122131af85bb4aad37f96351f56f3ecc5534c307880ee12511f6d32fdb596\": container with ID starting with 3fa122131af85bb4aad37f96351f56f3ecc5534c307880ee12511f6d32fdb596 not found: ID does not exist" containerID="3fa122131af85bb4aad37f96351f56f3ecc5534c307880ee12511f6d32fdb596"
Jul 21 01:32:08.878063 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:08.877335    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fa122131af85bb4aad37f96351f56f3ecc5534c307880ee12511f6d32fdb596"} err="failed to get container status \"3fa122131af85bb4aad37f96351f56f3ecc5534c307880ee12511f6d32fdb596\": rpc error: code = NotFound desc = could not find container \"3fa122131af85bb4aad37f96351f56f3ecc5534c307880ee12511f6d32fdb596\": container with ID starting with 3fa122131af85bb4aad37f96351f56f3ecc5534c307880ee12511f6d32fdb596 not found: ID does not exist"
Jul 21 01:32:08.890730 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:08.890705    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-plwwc"]
Jul 21 01:32:08.892507 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:08.892489    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-plwwc"]
Jul 21 01:32:08.897679 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:08.897663    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqrth\" (UniqueName: \"kubernetes.io/projected/d2030dbc-2773-44be-b4f7-fade33fb982b-kube-api-access-vqrth\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 01:32:08.897734 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:08.897683    2561 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d2030dbc-2773-44be-b4f7-fade33fb982b-config-file\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 01:32:09.471852 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:09.471819    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:32:09.591432 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:09.591402    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:32:09.972622 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:09.972583    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-kz4m4"]
Jul 21 01:32:09.972885 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:09.972873    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2030dbc-2773-44be-b4f7-fade33fb982b" containerName="limitador"
Jul 21 01:32:09.972928 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:09.972887    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2030dbc-2773-44be-b4f7-fade33fb982b" containerName="limitador"
Jul 21 01:32:09.972965 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:09.972950    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2030dbc-2773-44be-b4f7-fade33fb982b" containerName="limitador"
Jul 21 01:32:09.975546 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:09.975527    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kz4m4"
Jul 21 01:32:09.978429 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:09.978410    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 21 01:32:09.978429 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:09.978415    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 01:32:09.979547 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:09.979526    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 21 01:32:09.979664 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:09.979589    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-njs2s\""
Jul 21 01:32:09.986367 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:09.986343    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-kz4m4"]
Jul 21 01:32:10.016264 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:10.016226    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:32:10.106863 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:10.106830    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/65aaddf2-b288-4706-9c6e-51375ad564e4-data\") pod \"postgres-69fb4594cf-kz4m4\" (UID: \"65aaddf2-b288-4706-9c6e-51375ad564e4\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kz4m4"
Jul 21 01:32:10.107027 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:10.106871    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9cp6\" (UniqueName: \"kubernetes.io/projected/65aaddf2-b288-4706-9c6e-51375ad564e4-kube-api-access-n9cp6\") pod \"postgres-69fb4594cf-kz4m4\" (UID: \"65aaddf2-b288-4706-9c6e-51375ad564e4\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kz4m4"
Jul 21 01:32:10.207834 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:10.207795    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/65aaddf2-b288-4706-9c6e-51375ad564e4-data\") pod \"postgres-69fb4594cf-kz4m4\" (UID: \"65aaddf2-b288-4706-9c6e-51375ad564e4\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kz4m4"
Jul 21 01:32:10.207834 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:10.207838    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9cp6\" (UniqueName: \"kubernetes.io/projected/65aaddf2-b288-4706-9c6e-51375ad564e4-kube-api-access-n9cp6\") pod \"postgres-69fb4594cf-kz4m4\" (UID: \"65aaddf2-b288-4706-9c6e-51375ad564e4\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kz4m4"
Jul 21 01:32:10.208290 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:10.208267    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/65aaddf2-b288-4706-9c6e-51375ad564e4-data\") pod \"postgres-69fb4594cf-kz4m4\" (UID: \"65aaddf2-b288-4706-9c6e-51375ad564e4\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kz4m4"
Jul 21 01:32:10.216108 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:10.216088    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9cp6\" (UniqueName: \"kubernetes.io/projected/65aaddf2-b288-4706-9c6e-51375ad564e4-kube-api-access-n9cp6\") pod \"postgres-69fb4594cf-kz4m4\" (UID: \"65aaddf2-b288-4706-9c6e-51375ad564e4\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kz4m4"
Jul 21 01:32:10.286488 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:10.286464    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kz4m4"
Jul 21 01:32:10.414230 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:10.414177    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-kz4m4"]
Jul 21 01:32:10.417577 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:32:10.417552    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65aaddf2_b288_4706_9c6e_51375ad564e4.slice/crio-ce18c8a069a5043bca655105a4c560f12c9946909ff6e3540f59d9b7ee2921c7 WatchSource:0}: Error finding container ce18c8a069a5043bca655105a4c560f12c9946909ff6e3540f59d9b7ee2921c7: Status 404 returned error can't find the container with id ce18c8a069a5043bca655105a4c560f12c9946909ff6e3540f59d9b7ee2921c7
Jul 21 01:32:10.616731 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:10.616655    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2p4wt_1701009a-d778-4d6d-b59f-e91ec4b13a60/ovn-acl-logging/0.log"
Jul 21 01:32:10.618731 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:10.618707    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2p4wt_1701009a-d778-4d6d-b59f-e91ec4b13a60/ovn-acl-logging/0.log"
Jul 21 01:32:10.714590 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:10.714561    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2030dbc-2773-44be-b4f7-fade33fb982b" path="/var/lib/kubelet/pods/d2030dbc-2773-44be-b4f7-fade33fb982b/volumes"
Jul 21 01:32:10.876971 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:10.876888    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kz4m4" event={"ID":"65aaddf2-b288-4706-9c6e-51375ad564e4","Type":"ContainerStarted","Data":"ce18c8a069a5043bca655105a4c560f12c9946909ff6e3540f59d9b7ee2921c7"}
Jul 21 01:32:15.276545 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:15.276512    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 21 01:32:15.900244 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:15.900184    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kz4m4" event={"ID":"65aaddf2-b288-4706-9c6e-51375ad564e4","Type":"ContainerStarted","Data":"e94d376ffe4c1aeb75ee4f48cf1e8b467d84de0201746f1dd6f8e1dc73778383"}
Jul 21 01:32:15.900413 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:15.900256    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kz4m4"
Jul 21 01:32:15.916115 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:15.916058    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kz4m4" podStartSLOduration=2.061352847 podStartE2EDuration="6.916036829s" totalImagesPullingTime="4.854683982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:32:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:32:15.91457874 +0000 UTC m=+605.644947412" watchObservedRunningTime="2026-07-21 01:32:15.916036829 +0000 UTC m=+605.646405501"
Jul 21 01:32:21.933153 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:21.933122    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kz4m4"
Jul 21 01:32:22.264577 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:22.264494    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:32:23.592720 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:23.592688    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:32:31.068761 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:31.068722    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:32:31.154323 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:31.154272    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:32:31.255522 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:31.255476    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:32:34.246883 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:34.246850    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:32:34.347056 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:34.347024    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:32:49.567678 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:32:49.567634    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:33:05.833391 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:05.833346    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:33:05.924675 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:05.924641    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:33:06.452918 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:06.452890    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:33:06.490149 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:06.490123    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7cdd5cf58c-4nw9v"]
Jul 21 01:33:06.492283 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:06.492262    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7cdd5cf58c-4nw9v"
Jul 21 01:33:06.494938 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:06.494914    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 21 01:33:06.495080 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:06.495057    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-5rr5s\""
Jul 21 01:33:06.505241 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:06.505220    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7cdd5cf58c-4nw9v"]
Jul 21 01:33:06.540167 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:06.540145    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmggw\" (UniqueName: \"kubernetes.io/projected/82337c89-a0e9-4ff0-b602-e0fc5b2de031-kube-api-access-cmggw\") pod \"maas-api-7cdd5cf58c-4nw9v\" (UID: \"82337c89-a0e9-4ff0-b602-e0fc5b2de031\") " pod="odh-ai-gateway-infra/maas-api-7cdd5cf58c-4nw9v"
Jul 21 01:33:06.540308 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:06.540182    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/82337c89-a0e9-4ff0-b602-e0fc5b2de031-openshift-service-ca\") pod \"maas-api-7cdd5cf58c-4nw9v\" (UID: \"82337c89-a0e9-4ff0-b602-e0fc5b2de031\") " pod="odh-ai-gateway-infra/maas-api-7cdd5cf58c-4nw9v"
Jul 21 01:33:06.540308 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:06.540247    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82337c89-a0e9-4ff0-b602-e0fc5b2de031-maas-api-tls\") pod \"maas-api-7cdd5cf58c-4nw9v\" (UID: \"82337c89-a0e9-4ff0-b602-e0fc5b2de031\") " pod="odh-ai-gateway-infra/maas-api-7cdd5cf58c-4nw9v"
Jul 21 01:33:06.560346 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:06.560318    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:33:06.640718 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:06.640685    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/82337c89-a0e9-4ff0-b602-e0fc5b2de031-openshift-service-ca\") pod \"maas-api-7cdd5cf58c-4nw9v\" (UID: \"82337c89-a0e9-4ff0-b602-e0fc5b2de031\") " pod="odh-ai-gateway-infra/maas-api-7cdd5cf58c-4nw9v"
Jul 21 01:33:06.640900 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:06.640756    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82337c89-a0e9-4ff0-b602-e0fc5b2de031-maas-api-tls\") pod \"maas-api-7cdd5cf58c-4nw9v\" (UID: \"82337c89-a0e9-4ff0-b602-e0fc5b2de031\") " pod="odh-ai-gateway-infra/maas-api-7cdd5cf58c-4nw9v"
Jul 21 01:33:06.640900 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:06.640822    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmggw\" (UniqueName: \"kubernetes.io/projected/82337c89-a0e9-4ff0-b602-e0fc5b2de031-kube-api-access-cmggw\") pod \"maas-api-7cdd5cf58c-4nw9v\" (UID: \"82337c89-a0e9-4ff0-b602-e0fc5b2de031\") " pod="odh-ai-gateway-infra/maas-api-7cdd5cf58c-4nw9v"
Jul 21 01:33:06.641382 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:06.641362    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/82337c89-a0e9-4ff0-b602-e0fc5b2de031-openshift-service-ca\") pod \"maas-api-7cdd5cf58c-4nw9v\" (UID: \"82337c89-a0e9-4ff0-b602-e0fc5b2de031\") " pod="odh-ai-gateway-infra/maas-api-7cdd5cf58c-4nw9v"
Jul 21 01:33:06.643427 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:06.643398    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82337c89-a0e9-4ff0-b602-e0fc5b2de031-maas-api-tls\") pod \"maas-api-7cdd5cf58c-4nw9v\" (UID: \"82337c89-a0e9-4ff0-b602-e0fc5b2de031\") " pod="odh-ai-gateway-infra/maas-api-7cdd5cf58c-4nw9v"
Jul 21 01:33:06.657166 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:06.657143    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmggw\" (UniqueName: \"kubernetes.io/projected/82337c89-a0e9-4ff0-b602-e0fc5b2de031-kube-api-access-cmggw\") pod \"maas-api-7cdd5cf58c-4nw9v\" (UID: \"82337c89-a0e9-4ff0-b602-e0fc5b2de031\") " pod="odh-ai-gateway-infra/maas-api-7cdd5cf58c-4nw9v"
Jul 21 01:33:06.803904 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:06.803870    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7cdd5cf58c-4nw9v"
Jul 21 01:33:06.937328 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:06.937303    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7cdd5cf58c-4nw9v"]
Jul 21 01:33:06.939322 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:33:06.939283    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82337c89_a0e9_4ff0_b602_e0fc5b2de031.slice/crio-1e38785c595331d525c27f25093a804871d9c018ccc2e4c1d271d0daee633c67 WatchSource:0}: Error finding container 1e38785c595331d525c27f25093a804871d9c018ccc2e4c1d271d0daee633c67: Status 404 returned error can't find the container with id 1e38785c595331d525c27f25093a804871d9c018ccc2e4c1d271d0daee633c67
Jul 21 01:33:06.960934 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:06.960912    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:33:07.057923 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:07.057842    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:33:07.077357 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:07.077325    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7cdd5cf58c-4nw9v" event={"ID":"82337c89-a0e9-4ff0-b602-e0fc5b2de031","Type":"ContainerStarted","Data":"1e38785c595331d525c27f25093a804871d9c018ccc2e4c1d271d0daee633c67"}
Jul 21 01:33:07.136819 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:07.136782    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-tmj65"]
Jul 21 01:33:07.139678 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:07.139659    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-tmj65"
Jul 21 01:33:07.142564 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:07.142543    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-zktn2\""
Jul 21 01:33:07.142564 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:07.142562    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 21 01:33:07.152370 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:07.152347    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-tmj65"]
Jul 21 01:33:07.245889 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:07.245849    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05cff6b0-bed4-4162-ae3c-83f1c75feb3d-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-tmj65\" (UID: \"05cff6b0-bed4-4162-ae3c-83f1c75feb3d\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-tmj65"
Jul 21 01:33:07.246076 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:07.245915    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76jts\" (UniqueName: \"kubernetes.io/projected/05cff6b0-bed4-4162-ae3c-83f1c75feb3d-kube-api-access-76jts\") pod \"payload-pre-processing-7677b774bb-tmj65\" (UID: \"05cff6b0-bed4-4162-ae3c-83f1c75feb3d\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-tmj65"
Jul 21 01:33:07.347046 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:07.346946    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05cff6b0-bed4-4162-ae3c-83f1c75feb3d-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-tmj65\" (UID: \"05cff6b0-bed4-4162-ae3c-83f1c75feb3d\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-tmj65"
Jul 21 01:33:07.347046 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:07.347005    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76jts\" (UniqueName: \"kubernetes.io/projected/05cff6b0-bed4-4162-ae3c-83f1c75feb3d-kube-api-access-76jts\") pod \"payload-pre-processing-7677b774bb-tmj65\" (UID: \"05cff6b0-bed4-4162-ae3c-83f1c75feb3d\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-tmj65"
Jul 21 01:33:07.347759 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:07.347735    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05cff6b0-bed4-4162-ae3c-83f1c75feb3d-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-tmj65\" (UID: \"05cff6b0-bed4-4162-ae3c-83f1c75feb3d\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-tmj65"
Jul 21 01:33:07.355176 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:07.355155    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76jts\" (UniqueName: \"kubernetes.io/projected/05cff6b0-bed4-4162-ae3c-83f1c75feb3d-kube-api-access-76jts\") pod \"payload-pre-processing-7677b774bb-tmj65\" (UID: \"05cff6b0-bed4-4162-ae3c-83f1c75feb3d\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-tmj65"
Jul 21 01:33:07.450356 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:07.450318    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-tmj65"
Jul 21 01:33:07.614070 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:07.613986    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-tmj65"]
Jul 21 01:33:07.617116 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:33:07.617087    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05cff6b0_bed4_4162_ae3c_83f1c75feb3d.slice/crio-cbb266e1ccefe093857205dbeedbd69493d7db4cbcf0da0557b0c0268edb9462 WatchSource:0}: Error finding container cbb266e1ccefe093857205dbeedbd69493d7db4cbcf0da0557b0c0268edb9462: Status 404 returned error can't find the container with id cbb266e1ccefe093857205dbeedbd69493d7db4cbcf0da0557b0c0268edb9462
Jul 21 01:33:08.083256 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:08.083220    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-tmj65" event={"ID":"05cff6b0-bed4-4162-ae3c-83f1c75feb3d","Type":"ContainerStarted","Data":"cbb266e1ccefe093857205dbeedbd69493d7db4cbcf0da0557b0c0268edb9462"}
Jul 21 01:33:11.097657 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:11.097615    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7cdd5cf58c-4nw9v" event={"ID":"82337c89-a0e9-4ff0-b602-e0fc5b2de031","Type":"ContainerStarted","Data":"8cf479e9aa1958527d43aace07b1728d56524736418f98edc29e212505aaefbf"}
Jul 21 01:33:11.098101 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:11.097705    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7cdd5cf58c-4nw9v"
Jul 21 01:33:11.098930 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:11.098910    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-tmj65" event={"ID":"05cff6b0-bed4-4162-ae3c-83f1c75feb3d","Type":"ContainerStarted","Data":"e87fbe8dfc60769141b79c2e428366e0c04acdf15a32fa33a2397242bdab4e0b"}
Jul 21 01:33:11.099032 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:11.098954    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-tmj65"
Jul 21 01:33:11.116042 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:11.115997    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7cdd5cf58c-4nw9v" podStartSLOduration=1.7961091219999998 podStartE2EDuration="5.115984055s" totalImagesPullingTime="3.319874933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:33:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:33:11.115182374 +0000 UTC m=+660.845551045" watchObservedRunningTime="2026-07-21 01:33:11.115984055 +0000 UTC m=+660.846352724"
Jul 21 01:33:11.132677 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:11.132630    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-tmj65" podStartSLOduration=1.4828395589999999 podStartE2EDuration="4.132614664s" totalImagesPullingTime="2.649775105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:33:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:33:11.130915956 +0000 UTC m=+660.861284626" watchObservedRunningTime="2026-07-21 01:33:11.132614664 +0000 UTC m=+660.862983344"
Jul 21 01:33:15.366370 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:15.366332    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:33:17.108748 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:17.108719    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7cdd5cf58c-4nw9v"
Jul 21 01:33:18.216234 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:18.216184    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:33:18.316511 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:18.316476    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:33:22.104826 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:22.104757    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-7677b774bb-tmj65" podUID="05cff6b0-bed4-4162-ae3c-83f1c75feb3d" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.21:9004: connect: connection refused"
Jul 21 01:33:27.514537 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:27.514506    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:33:32.103999 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:32.103966    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-tmj65"
Jul 21 01:33:32.599297 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:32.599263    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-rxlck"]
Jul 21 01:33:32.613511 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:32.613482    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-rxlck"]
Jul 21 01:33:32.613675 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:32.613586    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rxlck"
Jul 21 01:33:32.616245 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:32.616218    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 21 01:33:32.616385 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:32.616220    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hv87n\""
Jul 21 01:33:32.617528 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:32.617446    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 21 01:33:32.617630 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:32.617535    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 21 01:33:32.635130 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:32.635103    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:33:32.759054 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:32.759026    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81bbfe1d-516a-46d7-a443-bf56959eee7f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rxlck\" (UID: \"81bbfe1d-516a-46d7-a443-bf56959eee7f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rxlck"
Jul 21 01:33:32.759249 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:32.759062    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81bbfe1d-516a-46d7-a443-bf56959eee7f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rxlck\" (UID: \"81bbfe1d-516a-46d7-a443-bf56959eee7f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rxlck"
Jul 21 01:33:32.759249 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:32.759093    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81bbfe1d-516a-46d7-a443-bf56959eee7f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rxlck\" (UID: \"81bbfe1d-516a-46d7-a443-bf56959eee7f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rxlck"
Jul 21 01:33:32.759249 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:32.759160    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dd8r\" (UniqueName: \"kubernetes.io/projected/81bbfe1d-516a-46d7-a443-bf56959eee7f-kube-api-access-7dd8r\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rxlck\" (UID: \"81bbfe1d-516a-46d7-a443-bf56959eee7f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rxlck"
Jul 21 01:33:32.759374 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:32.759248    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81bbfe1d-516a-46d7-a443-bf56959eee7f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rxlck\" (UID: \"81bbfe1d-516a-46d7-a443-bf56959eee7f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rxlck"
Jul 21 01:33:32.759374 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:32.759296    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81bbfe1d-516a-46d7-a443-bf56959eee7f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rxlck\" (UID: \"81bbfe1d-516a-46d7-a443-bf56959eee7f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rxlck"
Jul 21 01:33:32.860464 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:32.860387    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81bbfe1d-516a-46d7-a443-bf56959eee7f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rxlck\" (UID: \"81bbfe1d-516a-46d7-a443-bf56959eee7f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rxlck"
Jul 21 01:33:32.860464 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:32.860445    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81bbfe1d-516a-46d7-a443-bf56959eee7f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rxlck\" (UID: \"81bbfe1d-516a-46d7-a443-bf56959eee7f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rxlck"
Jul 21 01:33:32.860714 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:32.860475    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81bbfe1d-516a-46d7-a443-bf56959eee7f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rxlck\" (UID: \"81bbfe1d-516a-46d7-a443-bf56959eee7f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rxlck"
Jul 21 01:33:32.860714 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:32.860520    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81bbfe1d-516a-46d7-a443-bf56959eee7f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rxlck\" (UID: \"81bbfe1d-516a-46d7-a443-bf56959eee7f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rxlck"
Jul 21 01:33:32.860714 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:32.860698    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dd8r\" (UniqueName: \"kubernetes.io/projected/81bbfe1d-516a-46d7-a443-bf56959eee7f-kube-api-access-7dd8r\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rxlck\" (UID: \"81bbfe1d-516a-46d7-a443-bf56959eee7f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rxlck"
Jul 21 01:33:32.860872 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:32.860758    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81bbfe1d-516a-46d7-a443-bf56959eee7f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rxlck\" (UID: \"81bbfe1d-516a-46d7-a443-bf56959eee7f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rxlck"
Jul 21 01:33:32.860941 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:32.860894    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81bbfe1d-516a-46d7-a443-bf56959eee7f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rxlck\" (UID: \"81bbfe1d-516a-46d7-a443-bf56959eee7f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rxlck"
Jul 21 01:33:32.860997 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:32.860945    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81bbfe1d-516a-46d7-a443-bf56959eee7f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rxlck\" (UID: \"81bbfe1d-516a-46d7-a443-bf56959eee7f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rxlck"
Jul 21 01:33:32.861219 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:32.861177    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81bbfe1d-516a-46d7-a443-bf56959eee7f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rxlck\" (UID: \"81bbfe1d-516a-46d7-a443-bf56959eee7f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rxlck"
Jul 21 01:33:32.863009 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:32.862988    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81bbfe1d-516a-46d7-a443-bf56959eee7f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rxlck\" (UID: \"81bbfe1d-516a-46d7-a443-bf56959eee7f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rxlck"
Jul 21 01:33:32.863154 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:32.863138    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81bbfe1d-516a-46d7-a443-bf56959eee7f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rxlck\" (UID: \"81bbfe1d-516a-46d7-a443-bf56959eee7f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rxlck"
Jul 21 01:33:32.869205 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:32.869178    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dd8r\" (UniqueName: \"kubernetes.io/projected/81bbfe1d-516a-46d7-a443-bf56959eee7f-kube-api-access-7dd8r\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rxlck\" (UID: \"81bbfe1d-516a-46d7-a443-bf56959eee7f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rxlck"
Jul 21 01:33:32.925053 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:32.925016    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rxlck"
Jul 21 01:33:33.067822 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:33.067802    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-rxlck"]
Jul 21 01:33:33.069953 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:33:33.069927    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81bbfe1d_516a_46d7_a443_bf56959eee7f.slice/crio-4f0614a0b412aacfb7984137ba2aace89967071fc96f46b4e5d679ad007ef150 WatchSource:0}: Error finding container 4f0614a0b412aacfb7984137ba2aace89967071fc96f46b4e5d679ad007ef150: Status 404 returned error can't find the container with id 4f0614a0b412aacfb7984137ba2aace89967071fc96f46b4e5d679ad007ef150
Jul 21 01:33:33.183769 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:33.183691    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rxlck" event={"ID":"81bbfe1d-516a-46d7-a443-bf56959eee7f","Type":"ContainerStarted","Data":"4f0614a0b412aacfb7984137ba2aace89967071fc96f46b4e5d679ad007ef150"}
Jul 21 01:33:34.189357 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:34.189322    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rxlck" event={"ID":"81bbfe1d-516a-46d7-a443-bf56959eee7f","Type":"ContainerStarted","Data":"ad184f93d645c834d29f1e8a7321874333a5be1944d694458bd17890e17c172c"}
Jul 21 01:33:34.206102 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:34.206023    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rxlck" podStartSLOduration=1.145450308 podStartE2EDuration="2.20600608s" totalImagesPullingTime="1.060555772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:33:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:33:34.205038955 +0000 UTC m=+683.935407626" watchObservedRunningTime="2026-07-21 01:33:34.20600608 +0000 UTC m=+683.936374744"
Jul 21 01:33:41.122496 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:41.122456    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:33:42.925823 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:42.925773    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rxlck"
Jul 21 01:33:42.926339 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:42.925862    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rxlck"
Jul 21 01:33:42.938764 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:42.938738    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rxlck"
Jul 21 01:33:43.237489 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:43.237407    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rxlck"
Jul 21 01:33:48.195368 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:48.195332    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27"]
Jul 21 01:33:48.197754 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:48.197730    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27"
Jul 21 01:33:48.200251 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:48.200230    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 21 01:33:48.208292 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:48.208271    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27"]
Jul 21 01:33:48.224873 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:48.224849    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:33:48.291519 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:48.291485    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76c009af-d744-447f-b28d-352ec6186ea8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27\" (UID: \"76c009af-d744-447f-b28d-352ec6186ea8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27"
Jul 21 01:33:48.291676 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:48.291528    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76c009af-d744-447f-b28d-352ec6186ea8-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27\" (UID: \"76c009af-d744-447f-b28d-352ec6186ea8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27"
Jul 21 01:33:48.291676 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:48.291562    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76c009af-d744-447f-b28d-352ec6186ea8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27\" (UID: \"76c009af-d744-447f-b28d-352ec6186ea8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27"
Jul 21 01:33:48.291676 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:48.291585    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f78z\" (UniqueName: \"kubernetes.io/projected/76c009af-d744-447f-b28d-352ec6186ea8-kube-api-access-9f78z\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27\" (UID: \"76c009af-d744-447f-b28d-352ec6186ea8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27"
Jul 21 01:33:48.291676 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:48.291607    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76c009af-d744-447f-b28d-352ec6186ea8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27\" (UID: \"76c009af-d744-447f-b28d-352ec6186ea8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27"
Jul 21 01:33:48.291676 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:48.291639    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76c009af-d744-447f-b28d-352ec6186ea8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27\" (UID: \"76c009af-d744-447f-b28d-352ec6186ea8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27"
Jul 21 01:33:48.392289 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:48.392252    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76c009af-d744-447f-b28d-352ec6186ea8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27\" (UID: \"76c009af-d744-447f-b28d-352ec6186ea8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27"
Jul 21 01:33:48.392289 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:48.392291    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f78z\" (UniqueName: \"kubernetes.io/projected/76c009af-d744-447f-b28d-352ec6186ea8-kube-api-access-9f78z\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27\" (UID: \"76c009af-d744-447f-b28d-352ec6186ea8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27"
Jul 21 01:33:48.392483 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:48.392315    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76c009af-d744-447f-b28d-352ec6186ea8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27\" (UID: \"76c009af-d744-447f-b28d-352ec6186ea8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27"
Jul 21 01:33:48.392483 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:48.392341    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76c009af-d744-447f-b28d-352ec6186ea8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27\" (UID: \"76c009af-d744-447f-b28d-352ec6186ea8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27"
Jul 21 01:33:48.392483 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:48.392395    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76c009af-d744-447f-b28d-352ec6186ea8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27\" (UID: \"76c009af-d744-447f-b28d-352ec6186ea8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27"
Jul 21 01:33:48.392483 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:48.392421    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76c009af-d744-447f-b28d-352ec6186ea8-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27\" (UID: \"76c009af-d744-447f-b28d-352ec6186ea8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27"
Jul 21 01:33:48.392795 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:48.392774    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76c009af-d744-447f-b28d-352ec6186ea8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27\" (UID: \"76c009af-d744-447f-b28d-352ec6186ea8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27"
Jul 21 01:33:48.392870 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:48.392796    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76c009af-d744-447f-b28d-352ec6186ea8-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27\" (UID: \"76c009af-d744-447f-b28d-352ec6186ea8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27"
Jul 21 01:33:48.392870 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:48.392835    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76c009af-d744-447f-b28d-352ec6186ea8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27\" (UID: \"76c009af-d744-447f-b28d-352ec6186ea8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27"
Jul 21 01:33:48.394777 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:48.394742    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76c009af-d744-447f-b28d-352ec6186ea8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27\" (UID: \"76c009af-d744-447f-b28d-352ec6186ea8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27"
Jul 21 01:33:48.394947 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:48.394932    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76c009af-d744-447f-b28d-352ec6186ea8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27\" (UID: \"76c009af-d744-447f-b28d-352ec6186ea8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27"
Jul 21 01:33:48.400193 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:48.400171    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f78z\" (UniqueName: \"kubernetes.io/projected/76c009af-d744-447f-b28d-352ec6186ea8-kube-api-access-9f78z\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27\" (UID: \"76c009af-d744-447f-b28d-352ec6186ea8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27"
Jul 21 01:33:48.508601 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:48.508519    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27"
Jul 21 01:33:48.638224 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:48.638181    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27"]
Jul 21 01:33:48.640454 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:33:48.640433    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76c009af_d744_447f_b28d_352ec6186ea8.slice/crio-da5f6387e191acc724a290047318dc8e6bcbb129e814b1ce81be54182f870eab WatchSource:0}: Error finding container da5f6387e191acc724a290047318dc8e6bcbb129e814b1ce81be54182f870eab: Status 404 returned error can't find the container with id da5f6387e191acc724a290047318dc8e6bcbb129e814b1ce81be54182f870eab
Jul 21 01:33:48.642268 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:48.642248    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 01:33:49.257602 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:49.257495    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27" event={"ID":"76c009af-d744-447f-b28d-352ec6186ea8","Type":"ContainerStarted","Data":"014f12ef166bff1e60a2a482c5f6d6af92b5899223829c0111f71150d04ba211"}
Jul 21 01:33:49.257602 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:49.257560    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27" event={"ID":"76c009af-d744-447f-b28d-352ec6186ea8","Type":"ContainerStarted","Data":"da5f6387e191acc724a290047318dc8e6bcbb129e814b1ce81be54182f870eab"}
Jul 21 01:33:49.275896 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:49.275852    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27" podStartSLOduration=1.117532044 podStartE2EDuration="1.275835938s" totalImagesPullingTime="158.303894ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:33:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:33:49.274304533 +0000 UTC m=+699.004673202" watchObservedRunningTime="2026-07-21 01:33:49.275835938 +0000 UTC m=+699.006204609"
Jul 21 01:33:58.508744 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:58.508705    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27"
Jul 21 01:33:58.509233 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:58.508771    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27"
Jul 21 01:33:58.521306 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:58.521287    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27"
Jul 21 01:33:58.720009 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:58.719976    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:33:59.306375 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:33:59.306346    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27"
Jul 21 01:34:10.428451 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:34:10.428409    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:34:38.505347 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:34:38.505311    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:34:38.556573 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:34:38.556541    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:35:30.305548 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:35:30.305489    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:35:30.353211 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:35:30.353166    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:35:55.776284 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:35:55.776240    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:35:55.876570 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:35:55.876524    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:35:56.976811 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:35:56.976772    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:35:57.075992 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:35:57.075962    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:37:10.639288 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:37:10.639255    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2p4wt_1701009a-d778-4d6d-b59f-e91ec4b13a60/ovn-acl-logging/0.log"
Jul 21 01:37:10.639980 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:37:10.639964    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2p4wt_1701009a-d778-4d6d-b59f-e91ec4b13a60/ovn-acl-logging/0.log"
Jul 21 01:37:31.155433 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:37:31.155396    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:37:32.107352 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:37:32.107307    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:37:45.340343 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:37:45.340309    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6bb6957b54-hb24v"]
Jul 21 01:37:45.342424 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:37:45.342402    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bb6957b54-hb24v"
Jul 21 01:37:45.346455 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:37:45.346434    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 21 01:37:45.346961 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:37:45.346934    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-wj5n8\""
Jul 21 01:37:45.347105 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:37:45.347088    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 21 01:37:45.348705 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:37:45.348673    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/320f542f-5291-4b1b-b45b-4ef3c9b53ed5-webhook-cert\") pod \"maas-controller-6bb6957b54-hb24v\" (UID: \"320f542f-5291-4b1b-b45b-4ef3c9b53ed5\") " pod="opendatahub/maas-controller-6bb6957b54-hb24v"
Jul 21 01:37:45.348805 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:37:45.348787    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fv6p\" (UniqueName: \"kubernetes.io/projected/320f542f-5291-4b1b-b45b-4ef3c9b53ed5-kube-api-access-8fv6p\") pod \"maas-controller-6bb6957b54-hb24v\" (UID: \"320f542f-5291-4b1b-b45b-4ef3c9b53ed5\") " pod="opendatahub/maas-controller-6bb6957b54-hb24v"
Jul 21 01:37:45.354436 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:37:45.354411    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bb6957b54-hb24v"]
Jul 21 01:37:45.449366 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:37:45.449332    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fv6p\" (UniqueName: \"kubernetes.io/projected/320f542f-5291-4b1b-b45b-4ef3c9b53ed5-kube-api-access-8fv6p\") pod \"maas-controller-6bb6957b54-hb24v\" (UID: \"320f542f-5291-4b1b-b45b-4ef3c9b53ed5\") " pod="opendatahub/maas-controller-6bb6957b54-hb24v"
Jul 21 01:37:45.449560 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:37:45.449408    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/320f542f-5291-4b1b-b45b-4ef3c9b53ed5-webhook-cert\") pod \"maas-controller-6bb6957b54-hb24v\" (UID: \"320f542f-5291-4b1b-b45b-4ef3c9b53ed5\") " pod="opendatahub/maas-controller-6bb6957b54-hb24v"
Jul 21 01:37:45.451980 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:37:45.451955    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/320f542f-5291-4b1b-b45b-4ef3c9b53ed5-webhook-cert\") pod \"maas-controller-6bb6957b54-hb24v\" (UID: \"320f542f-5291-4b1b-b45b-4ef3c9b53ed5\") " pod="opendatahub/maas-controller-6bb6957b54-hb24v"
Jul 21 01:37:45.457732 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:37:45.457706    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fv6p\" (UniqueName: \"kubernetes.io/projected/320f542f-5291-4b1b-b45b-4ef3c9b53ed5-kube-api-access-8fv6p\") pod \"maas-controller-6bb6957b54-hb24v\" (UID: \"320f542f-5291-4b1b-b45b-4ef3c9b53ed5\") " pod="opendatahub/maas-controller-6bb6957b54-hb24v"
Jul 21 01:37:45.655924 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:37:45.655835    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bb6957b54-hb24v"
Jul 21 01:37:45.785918 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:37:45.785891    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bb6957b54-hb24v"]
Jul 21 01:37:45.787780 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:37:45.787746    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod320f542f_5291_4b1b_b45b_4ef3c9b53ed5.slice/crio-d3cbf24190007b8d13eabfcf66c57e957bc050358dc4f5afbd2d0eecd891331c WatchSource:0}: Error finding container d3cbf24190007b8d13eabfcf66c57e957bc050358dc4f5afbd2d0eecd891331c: Status 404 returned error can't find the container with id d3cbf24190007b8d13eabfcf66c57e957bc050358dc4f5afbd2d0eecd891331c
Jul 21 01:37:46.210611 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:37:46.210578    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bb6957b54-hb24v" event={"ID":"320f542f-5291-4b1b-b45b-4ef3c9b53ed5","Type":"ContainerStarted","Data":"d3cbf24190007b8d13eabfcf66c57e957bc050358dc4f5afbd2d0eecd891331c"}
Jul 21 01:37:48.222510 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:37:48.222474    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bb6957b54-hb24v" event={"ID":"320f542f-5291-4b1b-b45b-4ef3c9b53ed5","Type":"ContainerStarted","Data":"8d3afef0d58d6b70b903977afd5ef993ec2d7d0973e4707fa3ee76f45367d358"}
Jul 21 01:37:48.222927 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:37:48.222611    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6bb6957b54-hb24v"
Jul 21 01:37:48.240621 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:37:48.240570    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6bb6957b54-hb24v" podStartSLOduration=1.767031555 podStartE2EDuration="3.240546622s" totalImagesPullingTime="1.473515067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:37:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:37:48.238175691 +0000 UTC m=+937.968544362" watchObservedRunningTime="2026-07-21 01:37:48.240546622 +0000 UTC m=+937.970915291"
Jul 21 01:37:59.229424 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:37:59.229394    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6bb6957b54-hb24v"
Jul 21 01:38:03.745573 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:38:03.745536    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:38:03.847354 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:38:03.847320    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6bb6957b54-hb24v"]
Jul 21 01:38:03.847521 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:38:03.847505    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6bb6957b54-hb24v" podUID="320f542f-5291-4b1b-b45b-4ef3c9b53ed5" containerName="manager" containerID="cri-o://8d3afef0d58d6b70b903977afd5ef993ec2d7d0973e4707fa3ee76f45367d358" gracePeriod=30
Jul 21 01:38:04.091372 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:38:04.091345    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bb6957b54-hb24v"
Jul 21 01:38:04.193713 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:38:04.193673    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8fv6p\" (UniqueName: \"kubernetes.io/projected/320f542f-5291-4b1b-b45b-4ef3c9b53ed5-kube-api-access-8fv6p\") pod \"320f542f-5291-4b1b-b45b-4ef3c9b53ed5\" (UID: \"320f542f-5291-4b1b-b45b-4ef3c9b53ed5\") "
Jul 21 01:38:04.193902 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:38:04.193782    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/320f542f-5291-4b1b-b45b-4ef3c9b53ed5-webhook-cert\") pod \"320f542f-5291-4b1b-b45b-4ef3c9b53ed5\" (UID: \"320f542f-5291-4b1b-b45b-4ef3c9b53ed5\") "
Jul 21 01:38:04.196017 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:38:04.195985    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/320f542f-5291-4b1b-b45b-4ef3c9b53ed5-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "320f542f-5291-4b1b-b45b-4ef3c9b53ed5" (UID: "320f542f-5291-4b1b-b45b-4ef3c9b53ed5"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:38:04.196117 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:38:04.196031    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/320f542f-5291-4b1b-b45b-4ef3c9b53ed5-kube-api-access-8fv6p" (OuterVolumeSpecName: "kube-api-access-8fv6p") pod "320f542f-5291-4b1b-b45b-4ef3c9b53ed5" (UID: "320f542f-5291-4b1b-b45b-4ef3c9b53ed5"). InnerVolumeSpecName "kube-api-access-8fv6p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:38:04.288321 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:38:04.288292    2561 generic.go:356] "Generic (PLEG): container finished" podID="320f542f-5291-4b1b-b45b-4ef3c9b53ed5" containerID="8d3afef0d58d6b70b903977afd5ef993ec2d7d0973e4707fa3ee76f45367d358" exitCode=0
Jul 21 01:38:04.288574 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:38:04.288338    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bb6957b54-hb24v"
Jul 21 01:38:04.288574 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:38:04.288375    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bb6957b54-hb24v" event={"ID":"320f542f-5291-4b1b-b45b-4ef3c9b53ed5","Type":"ContainerDied","Data":"8d3afef0d58d6b70b903977afd5ef993ec2d7d0973e4707fa3ee76f45367d358"}
Jul 21 01:38:04.288574 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:38:04.288425    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bb6957b54-hb24v" event={"ID":"320f542f-5291-4b1b-b45b-4ef3c9b53ed5","Type":"ContainerDied","Data":"d3cbf24190007b8d13eabfcf66c57e957bc050358dc4f5afbd2d0eecd891331c"}
Jul 21 01:38:04.288574 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:38:04.288447    2561 scope.go:117] "RemoveContainer" containerID="8d3afef0d58d6b70b903977afd5ef993ec2d7d0973e4707fa3ee76f45367d358"
Jul 21 01:38:04.294372 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:38:04.294349    2561 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/320f542f-5291-4b1b-b45b-4ef3c9b53ed5-webhook-cert\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 01:38:04.294507 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:38:04.294374    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8fv6p\" (UniqueName: \"kubernetes.io/projected/320f542f-5291-4b1b-b45b-4ef3c9b53ed5-kube-api-access-8fv6p\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 01:38:04.297059 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:38:04.297039    2561 scope.go:117] "RemoveContainer" containerID="8d3afef0d58d6b70b903977afd5ef993ec2d7d0973e4707fa3ee76f45367d358"
Jul 21 01:38:04.297366 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:38:04.297349    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d3afef0d58d6b70b903977afd5ef993ec2d7d0973e4707fa3ee76f45367d358\": container with ID starting with 8d3afef0d58d6b70b903977afd5ef993ec2d7d0973e4707fa3ee76f45367d358 not found: ID does not exist" containerID="8d3afef0d58d6b70b903977afd5ef993ec2d7d0973e4707fa3ee76f45367d358"
Jul 21 01:38:04.297429 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:38:04.297374    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d3afef0d58d6b70b903977afd5ef993ec2d7d0973e4707fa3ee76f45367d358"} err="failed to get container status \"8d3afef0d58d6b70b903977afd5ef993ec2d7d0973e4707fa3ee76f45367d358\": rpc error: code = NotFound desc = could not find container \"8d3afef0d58d6b70b903977afd5ef993ec2d7d0973e4707fa3ee76f45367d358\": container with ID starting with 8d3afef0d58d6b70b903977afd5ef993ec2d7d0973e4707fa3ee76f45367d358 not found: ID does not exist"
Jul 21 01:38:04.308620 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:38:04.308593    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6bb6957b54-hb24v"]
Jul 21 01:38:04.312740 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:38:04.312713    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6bb6957b54-hb24v"]
Jul 21 01:38:04.715218 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:38:04.715123    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="320f542f-5291-4b1b-b45b-4ef3c9b53ed5" path="/var/lib/kubelet/pods/320f542f-5291-4b1b-b45b-4ef3c9b53ed5/volumes"
Jul 21 01:38:04.961976 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:38:04.961936    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:38:07.755241 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:38:07.755178    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:38:44.298607 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:38:44.298523    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:38:44.400334 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:38:44.400294    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:38:44.507495 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:38:44.507458    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:38:50.221000 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:38:50.220955    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:38:50.326833 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:38:50.326792    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:38:50.419418 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:38:50.419384    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:38:50.575489 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:38:50.575459    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:38:56.446605 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:38:56.446568    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:38:56.547314 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:38:56.547277    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:39:02.392167 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:39:02.392131    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:39:15.647946 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:39:15.647888    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:41:42.238684 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:41:42.238596    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:42:10.664032 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:42:10.664002    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2p4wt_1701009a-d778-4d6d-b59f-e91ec4b13a60/ovn-acl-logging/0.log"
Jul 21 01:42:10.664474 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:42:10.664422    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2p4wt_1701009a-d778-4d6d-b59f-e91ec4b13a60/ovn-acl-logging/0.log"
Jul 21 01:45:00.133662 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:45:00.133588    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743305-xbtvj"]
Jul 21 01:45:00.134101 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:45:00.133883    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="320f542f-5291-4b1b-b45b-4ef3c9b53ed5" containerName="manager"
Jul 21 01:45:00.134101 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:45:00.133896    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="320f542f-5291-4b1b-b45b-4ef3c9b53ed5" containerName="manager"
Jul 21 01:45:00.134101 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:45:00.133953    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="320f542f-5291-4b1b-b45b-4ef3c9b53ed5" containerName="manager"
Jul 21 01:45:00.136823 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:45:00.136808    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743305-xbtvj"
Jul 21 01:45:00.139232 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:45:00.139195    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8wthr\""
Jul 21 01:45:00.142342 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:45:00.142316    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743305-xbtvj"]
Jul 21 01:45:00.147914 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:45:00.147894    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743305-xbtvj"
Jul 21 01:45:00.480597 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:45:00.480564    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743305-xbtvj"]
Jul 21 01:45:00.483316 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:45:00.483292    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1628403a_342f_475c_807b_2258f10ad5ca.slice/crio-bb7a5771542c661840c6f29d43236abbc5226487b70600d4ad2adf8e6d9f15aa WatchSource:0}: Error finding container bb7a5771542c661840c6f29d43236abbc5226487b70600d4ad2adf8e6d9f15aa: Status 404 returned error can't find the container with id bb7a5771542c661840c6f29d43236abbc5226487b70600d4ad2adf8e6d9f15aa
Jul 21 01:45:00.485531 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:45:00.485516    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 01:45:00.941721 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:45:00.941685    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743305-xbtvj" event={"ID":"1628403a-342f-475c-807b-2258f10ad5ca","Type":"ContainerStarted","Data":"bb7a5771542c661840c6f29d43236abbc5226487b70600d4ad2adf8e6d9f15aa"}
Jul 21 01:45:03.955870 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:45:03.955833    2561 generic.go:356] "Generic (PLEG): container finished" podID="1628403a-342f-475c-807b-2258f10ad5ca" containerID="5dad79ed0045d82fff4539de9ad288d1c0d90417043ef0f670f048b7fd885b16" exitCode=0
Jul 21 01:45:03.956255 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:45:03.955925    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743305-xbtvj" event={"ID":"1628403a-342f-475c-807b-2258f10ad5ca","Type":"ContainerDied","Data":"5dad79ed0045d82fff4539de9ad288d1c0d90417043ef0f670f048b7fd885b16"}
Jul 21 01:45:05.088151 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:45:05.088123    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743305-xbtvj"
Jul 21 01:45:05.965096 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:45:05.965064    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743305-xbtvj"
Jul 21 01:45:05.965290 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:45:05.965072    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743305-xbtvj" event={"ID":"1628403a-342f-475c-807b-2258f10ad5ca","Type":"ContainerDied","Data":"bb7a5771542c661840c6f29d43236abbc5226487b70600d4ad2adf8e6d9f15aa"}
Jul 21 01:45:05.965290 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:45:05.965178    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bb7a5771542c661840c6f29d43236abbc5226487b70600d4ad2adf8e6d9f15aa"
Jul 21 01:45:30.441796 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:45:30.441761    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:46:35.608897 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:46:35.608865    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:46:40.390444 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:46:40.390413    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w"]
Jul 21 01:46:40.390834 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:46:40.390704    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1628403a-342f-475c-807b-2258f10ad5ca" containerName="cleanup"
Jul 21 01:46:40.390834 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:46:40.390713    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1628403a-342f-475c-807b-2258f10ad5ca" containerName="cleanup"
Jul 21 01:46:40.390834 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:46:40.390768    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1628403a-342f-475c-807b-2258f10ad5ca" containerName="cleanup"
Jul 21 01:46:40.393645 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:46:40.393626    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w"
Jul 21 01:46:40.396527 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:46:40.396509    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-914199c4-kserve-self-signed-certs\""
Jul 21 01:46:40.404819 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:46:40.404798    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w"]
Jul 21 01:46:40.414875 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:46:40.414846    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:46:40.433137 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:46:40.433116    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87d5f66f-d51a-40e2-aaee-c1c8be77897e-dshm\") pod \"e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w\" (UID: \"87d5f66f-d51a-40e2-aaee-c1c8be77897e\") " pod="llm/e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w"
Jul 21 01:46:40.433265 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:46:40.433157    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mmsb\" (UniqueName: \"kubernetes.io/projected/87d5f66f-d51a-40e2-aaee-c1c8be77897e-kube-api-access-5mmsb\") pod \"e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w\" (UID: \"87d5f66f-d51a-40e2-aaee-c1c8be77897e\") " pod="llm/e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w"
Jul 21 01:46:40.433265 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:46:40.433189    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87d5f66f-d51a-40e2-aaee-c1c8be77897e-tmp-dir\") pod \"e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w\" (UID: \"87d5f66f-d51a-40e2-aaee-c1c8be77897e\") " pod="llm/e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w"
Jul 21 01:46:40.433265 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:46:40.433234    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87d5f66f-d51a-40e2-aaee-c1c8be77897e-home\") pod \"e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w\" (UID: \"87d5f66f-d51a-40e2-aaee-c1c8be77897e\") " pod="llm/e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w"
Jul 21 01:46:40.433265 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:46:40.433249    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87d5f66f-d51a-40e2-aaee-c1c8be77897e-model-cache\") pod \"e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w\" (UID: \"87d5f66f-d51a-40e2-aaee-c1c8be77897e\") " pod="llm/e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w"
Jul 21 01:46:40.433421 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:46:40.433299    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87d5f66f-d51a-40e2-aaee-c1c8be77897e-tls-certs\") pod \"e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w\" (UID: \"87d5f66f-d51a-40e2-aaee-c1c8be77897e\") " pod="llm/e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w"
Jul 21 01:46:40.534083 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:46:40.534041    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87d5f66f-d51a-40e2-aaee-c1c8be77897e-home\") pod \"e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w\" (UID: \"87d5f66f-d51a-40e2-aaee-c1c8be77897e\") " pod="llm/e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w"
Jul 21 01:46:40.534083 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:46:40.534085    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87d5f66f-d51a-40e2-aaee-c1c8be77897e-model-cache\") pod \"e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w\" (UID: \"87d5f66f-d51a-40e2-aaee-c1c8be77897e\") " pod="llm/e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w"
Jul 21 01:46:40.534377 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:46:40.534315    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87d5f66f-d51a-40e2-aaee-c1c8be77897e-tls-certs\") pod \"e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w\" (UID: \"87d5f66f-d51a-40e2-aaee-c1c8be77897e\") " pod="llm/e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w"
Jul 21 01:46:40.534377 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:46:40.534371    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87d5f66f-d51a-40e2-aaee-c1c8be77897e-dshm\") pod \"e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w\" (UID: \"87d5f66f-d51a-40e2-aaee-c1c8be77897e\") " pod="llm/e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w"
Jul 21 01:46:40.534479 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:46:40.534425    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mmsb\" (UniqueName: \"kubernetes.io/projected/87d5f66f-d51a-40e2-aaee-c1c8be77897e-kube-api-access-5mmsb\") pod \"e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w\" (UID: \"87d5f66f-d51a-40e2-aaee-c1c8be77897e\") " pod="llm/e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w"
Jul 21 01:46:40.534532 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:46:40.534497    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87d5f66f-d51a-40e2-aaee-c1c8be77897e-model-cache\") pod \"e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w\" (UID: \"87d5f66f-d51a-40e2-aaee-c1c8be77897e\") " pod="llm/e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w"
Jul 21 01:46:40.534585 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:46:40.534535    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87d5f66f-d51a-40e2-aaee-c1c8be77897e-tmp-dir\") pod \"e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w\" (UID: \"87d5f66f-d51a-40e2-aaee-c1c8be77897e\") " pod="llm/e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w"
Jul 21 01:46:40.534585 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:46:40.534555    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87d5f66f-d51a-40e2-aaee-c1c8be77897e-home\") pod \"e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w\" (UID: \"87d5f66f-d51a-40e2-aaee-c1c8be77897e\") " pod="llm/e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w"
Jul 21 01:46:40.534822 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:46:40.534798    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87d5f66f-d51a-40e2-aaee-c1c8be77897e-tmp-dir\") pod \"e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w\" (UID: \"87d5f66f-d51a-40e2-aaee-c1c8be77897e\") " pod="llm/e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w"
Jul 21 01:46:40.536707 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:46:40.536676    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87d5f66f-d51a-40e2-aaee-c1c8be77897e-dshm\") pod \"e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w\" (UID: \"87d5f66f-d51a-40e2-aaee-c1c8be77897e\") " pod="llm/e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w"
Jul 21 01:46:40.536917 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:46:40.536901    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87d5f66f-d51a-40e2-aaee-c1c8be77897e-tls-certs\") pod \"e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w\" (UID: \"87d5f66f-d51a-40e2-aaee-c1c8be77897e\") " pod="llm/e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w"
Jul 21 01:46:40.543108 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:46:40.543084    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mmsb\" (UniqueName: \"kubernetes.io/projected/87d5f66f-d51a-40e2-aaee-c1c8be77897e-kube-api-access-5mmsb\") pod \"e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w\" (UID: \"87d5f66f-d51a-40e2-aaee-c1c8be77897e\") " pod="llm/e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w"
Jul 21 01:46:40.702608 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:46:40.702524    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w"
Jul 21 01:46:40.831177 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:46:40.831145    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w"]
Jul 21 01:46:40.834053 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:46:40.834029    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod87d5f66f_d51a_40e2_aaee_c1c8be77897e.slice/crio-b6e04cdefcef6be20814756f1b3db79898fb58164e516959d6fe7229b7da46c0 WatchSource:0}: Error finding container b6e04cdefcef6be20814756f1b3db79898fb58164e516959d6fe7229b7da46c0: Status 404 returned error can't find the container with id b6e04cdefcef6be20814756f1b3db79898fb58164e516959d6fe7229b7da46c0
Jul 21 01:46:41.350108 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:46:41.350068    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w" event={"ID":"87d5f66f-d51a-40e2-aaee-c1c8be77897e","Type":"ContainerStarted","Data":"e5092925f0d75bd2026dc4d28476db1d6f88343f19c83126014db8e739daa84f"}
Jul 21 01:46:41.350108 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:46:41.350110    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w" event={"ID":"87d5f66f-d51a-40e2-aaee-c1c8be77897e","Type":"ContainerStarted","Data":"b6e04cdefcef6be20814756f1b3db79898fb58164e516959d6fe7229b7da46c0"}
Jul 21 01:46:41.366370 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:46:41.366324    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w" podStartSLOduration=1.366310052 podStartE2EDuration="1.366310052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:46:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:46:41.365409758 +0000 UTC m=+1471.095778427" watchObservedRunningTime="2026-07-21 01:46:41.366310052 +0000 UTC m=+1471.096678743"
Jul 21 01:46:50.703486 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:46:50.703451    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w"
Jul 21 01:46:50.703870 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:46:50.703503    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w"
Jul 21 01:46:50.716345 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:46:50.716322    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w"
Jul 21 01:46:51.399854 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:46:51.399825    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w"
Jul 21 01:47:09.916243 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:47:09.916185    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:47:10.507158 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:47:10.507126    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w"]
Jul 21 01:47:10.540441 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:47:10.540413    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:47:10.686231 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:47:10.686185    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2p4wt_1701009a-d778-4d6d-b59f-e91ec4b13a60/ovn-acl-logging/0.log"
Jul 21 01:47:10.688163 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:47:10.688141    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2p4wt_1701009a-d778-4d6d-b59f-e91ec4b13a60/ovn-acl-logging/0.log"
Jul 21 01:47:25.527137 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:47:25.527072    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w" podUID="87d5f66f-d51a-40e2-aaee-c1c8be77897e" containerName="main" containerID="cri-o://e5092925f0d75bd2026dc4d28476db1d6f88343f19c83126014db8e739daa84f" gracePeriod=45
Jul 21 01:47:25.765492 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:47:25.765469    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w"
Jul 21 01:47:25.913888 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:47:25.913810    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87d5f66f-d51a-40e2-aaee-c1c8be77897e-dshm\") pod \"87d5f66f-d51a-40e2-aaee-c1c8be77897e\" (UID: \"87d5f66f-d51a-40e2-aaee-c1c8be77897e\") "
Jul 21 01:47:25.913888 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:47:25.913877    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87d5f66f-d51a-40e2-aaee-c1c8be77897e-home\") pod \"87d5f66f-d51a-40e2-aaee-c1c8be77897e\" (UID: \"87d5f66f-d51a-40e2-aaee-c1c8be77897e\") "
Jul 21 01:47:25.914163 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:47:25.913922    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87d5f66f-d51a-40e2-aaee-c1c8be77897e-tmp-dir\") pod \"87d5f66f-d51a-40e2-aaee-c1c8be77897e\" (UID: \"87d5f66f-d51a-40e2-aaee-c1c8be77897e\") "
Jul 21 01:47:25.914163 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:47:25.913962    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87d5f66f-d51a-40e2-aaee-c1c8be77897e-model-cache\") pod \"87d5f66f-d51a-40e2-aaee-c1c8be77897e\" (UID: \"87d5f66f-d51a-40e2-aaee-c1c8be77897e\") "
Jul 21 01:47:25.914163 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:47:25.914002    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mmsb\" (UniqueName: \"kubernetes.io/projected/87d5f66f-d51a-40e2-aaee-c1c8be77897e-kube-api-access-5mmsb\") pod \"87d5f66f-d51a-40e2-aaee-c1c8be77897e\" (UID: \"87d5f66f-d51a-40e2-aaee-c1c8be77897e\") "
Jul 21 01:47:25.914163 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:47:25.914029    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87d5f66f-d51a-40e2-aaee-c1c8be77897e-tls-certs\") pod \"87d5f66f-d51a-40e2-aaee-c1c8be77897e\" (UID: \"87d5f66f-d51a-40e2-aaee-c1c8be77897e\") "
Jul 21 01:47:25.914163 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:47:25.914135    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87d5f66f-d51a-40e2-aaee-c1c8be77897e-home" (OuterVolumeSpecName: "home") pod "87d5f66f-d51a-40e2-aaee-c1c8be77897e" (UID: "87d5f66f-d51a-40e2-aaee-c1c8be77897e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:47:25.914163 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:47:25.914152    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87d5f66f-d51a-40e2-aaee-c1c8be77897e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "87d5f66f-d51a-40e2-aaee-c1c8be77897e" (UID: "87d5f66f-d51a-40e2-aaee-c1c8be77897e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:47:25.914438 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:47:25.914292    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87d5f66f-d51a-40e2-aaee-c1c8be77897e-model-cache" (OuterVolumeSpecName: "model-cache") pod "87d5f66f-d51a-40e2-aaee-c1c8be77897e" (UID: "87d5f66f-d51a-40e2-aaee-c1c8be77897e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:47:25.914438 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:47:25.914317    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87d5f66f-d51a-40e2-aaee-c1c8be77897e-home\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 01:47:25.914438 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:47:25.914330    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87d5f66f-d51a-40e2-aaee-c1c8be77897e-tmp-dir\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 01:47:25.916287 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:47:25.916263    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87d5f66f-d51a-40e2-aaee-c1c8be77897e-kube-api-access-5mmsb" (OuterVolumeSpecName: "kube-api-access-5mmsb") pod "87d5f66f-d51a-40e2-aaee-c1c8be77897e" (UID: "87d5f66f-d51a-40e2-aaee-c1c8be77897e"). InnerVolumeSpecName "kube-api-access-5mmsb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:47:25.916287 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:47:25.916270    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87d5f66f-d51a-40e2-aaee-c1c8be77897e-dshm" (OuterVolumeSpecName: "dshm") pod "87d5f66f-d51a-40e2-aaee-c1c8be77897e" (UID: "87d5f66f-d51a-40e2-aaee-c1c8be77897e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:47:25.916406 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:47:25.916341    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87d5f66f-d51a-40e2-aaee-c1c8be77897e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "87d5f66f-d51a-40e2-aaee-c1c8be77897e" (UID: "87d5f66f-d51a-40e2-aaee-c1c8be77897e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:47:26.015666 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:47:26.015626    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87d5f66f-d51a-40e2-aaee-c1c8be77897e-model-cache\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 01:47:26.015666 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:47:26.015659    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mmsb\" (UniqueName: \"kubernetes.io/projected/87d5f66f-d51a-40e2-aaee-c1c8be77897e-kube-api-access-5mmsb\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 01:47:26.015666 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:47:26.015673    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87d5f66f-d51a-40e2-aaee-c1c8be77897e-tls-certs\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 01:47:26.015903 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:47:26.015684    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87d5f66f-d51a-40e2-aaee-c1c8be77897e-dshm\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 01:47:26.533291 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:47:26.533257    2561 generic.go:356] "Generic (PLEG): container finished" podID="87d5f66f-d51a-40e2-aaee-c1c8be77897e" containerID="e5092925f0d75bd2026dc4d28476db1d6f88343f19c83126014db8e739daa84f" exitCode=0
Jul 21 01:47:26.533729 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:47:26.533305    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w"
Jul 21 01:47:26.533729 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:47:26.533306    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w" event={"ID":"87d5f66f-d51a-40e2-aaee-c1c8be77897e","Type":"ContainerDied","Data":"e5092925f0d75bd2026dc4d28476db1d6f88343f19c83126014db8e739daa84f"}
Jul 21 01:47:26.533729 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:47:26.533411    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w" event={"ID":"87d5f66f-d51a-40e2-aaee-c1c8be77897e","Type":"ContainerDied","Data":"b6e04cdefcef6be20814756f1b3db79898fb58164e516959d6fe7229b7da46c0"}
Jul 21 01:47:26.533729 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:47:26.533438    2561 scope.go:117] "RemoveContainer" containerID="e5092925f0d75bd2026dc4d28476db1d6f88343f19c83126014db8e739daa84f"
Jul 21 01:47:26.542459 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:47:26.542440    2561 scope.go:117] "RemoveContainer" containerID="e5092925f0d75bd2026dc4d28476db1d6f88343f19c83126014db8e739daa84f"
Jul 21 01:47:26.542711 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:47:26.542691    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5092925f0d75bd2026dc4d28476db1d6f88343f19c83126014db8e739daa84f\": container with ID starting with e5092925f0d75bd2026dc4d28476db1d6f88343f19c83126014db8e739daa84f not found: ID does not exist" containerID="e5092925f0d75bd2026dc4d28476db1d6f88343f19c83126014db8e739daa84f"
Jul 21 01:47:26.542777 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:47:26.542718    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5092925f0d75bd2026dc4d28476db1d6f88343f19c83126014db8e739daa84f"} err="failed to get container status \"e5092925f0d75bd2026dc4d28476db1d6f88343f19c83126014db8e739daa84f\": rpc error: code = NotFound desc = could not find container \"e5092925f0d75bd2026dc4d28476db1d6f88343f19c83126014db8e739daa84f\": container with ID starting with e5092925f0d75bd2026dc4d28476db1d6f88343f19c83126014db8e739daa84f not found: ID does not exist"
Jul 21 01:47:26.556116 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:47:26.556090    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w"]
Jul 21 01:47:26.559260 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:47:26.559238    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-914199c4-kserve-54c7d66d75-7ms8w"]
Jul 21 01:47:26.716110 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:47:26.716078    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87d5f66f-d51a-40e2-aaee-c1c8be77897e" path="/var/lib/kubelet/pods/87d5f66f-d51a-40e2-aaee-c1c8be77897e/volumes"
Jul 21 01:48:48.932467 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:48:48.932431    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:49:59.078636 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:49:59.078601    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:49:59.179009 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:49:59.178983    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:50:26.107252 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:50:26.107216    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:50:33.566627 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:50:33.566541    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:50:41.817622 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:50:41.817579    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:50:47.306546 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:50:47.306509    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:50:50.194607 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:50:50.194572    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:50:50.290031 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:50:50.289989    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:50:50.690577 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:50:50.690542    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:50:56.289965 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:50:56.289926    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:50:56.350887 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:50:56.350857    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:50:56.516792 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:50:56.516761    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:50:56.823765 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:50:56.823732    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:50:56.946139 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:50:56.946108    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:50:58.941771 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:50:58.941738    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:50:59.044481 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:50:59.044421    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:50:59.137775 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:50:59.137746    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-11e2e27d-67b47c76fc-9sps9"]
Jul 21 01:50:59.138042 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:50:59.138030    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87d5f66f-d51a-40e2-aaee-c1c8be77897e" containerName="main"
Jul 21 01:50:59.138104 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:50:59.138043    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="87d5f66f-d51a-40e2-aaee-c1c8be77897e" containerName="main"
Jul 21 01:50:59.138154 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:50:59.138104    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="87d5f66f-d51a-40e2-aaee-c1c8be77897e" containerName="main"
Jul 21 01:50:59.140820 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:50:59.140799    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-11e2e27d-67b47c76fc-9sps9"
Jul 21 01:50:59.143481 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:50:59.143457    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-11e2e27d-serving-cert\""
Jul 21 01:50:59.150165 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:50:59.150134    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-11e2e27d-67b47c76fc-9sps9"]
Jul 21 01:50:59.169181 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:50:59.169145    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:50:59.206433 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:50:59.206358    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70804f13-ea8b-4258-bb54-30a73e811803-maas-api-tls\") pod \"maas-api-e2e-ait-11e2e27d-67b47c76fc-9sps9\" (UID: \"70804f13-ea8b-4258-bb54-30a73e811803\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-11e2e27d-67b47c76fc-9sps9"
Jul 21 01:50:59.206433 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:50:59.206398    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfvvc\" (UniqueName: \"kubernetes.io/projected/70804f13-ea8b-4258-bb54-30a73e811803-kube-api-access-kfvvc\") pod \"maas-api-e2e-ait-11e2e27d-67b47c76fc-9sps9\" (UID: \"70804f13-ea8b-4258-bb54-30a73e811803\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-11e2e27d-67b47c76fc-9sps9"
Jul 21 01:50:59.206433 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:50:59.206428    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/70804f13-ea8b-4258-bb54-30a73e811803-openshift-service-ca\") pod \"maas-api-e2e-ait-11e2e27d-67b47c76fc-9sps9\" (UID: \"70804f13-ea8b-4258-bb54-30a73e811803\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-11e2e27d-67b47c76fc-9sps9"
Jul 21 01:50:59.308070 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:50:59.308035    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfvvc\" (UniqueName: \"kubernetes.io/projected/70804f13-ea8b-4258-bb54-30a73e811803-kube-api-access-kfvvc\") pod \"maas-api-e2e-ait-11e2e27d-67b47c76fc-9sps9\" (UID: \"70804f13-ea8b-4258-bb54-30a73e811803\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-11e2e27d-67b47c76fc-9sps9"
Jul 21 01:50:59.308299 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:50:59.308089    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/70804f13-ea8b-4258-bb54-30a73e811803-openshift-service-ca\") pod \"maas-api-e2e-ait-11e2e27d-67b47c76fc-9sps9\" (UID: \"70804f13-ea8b-4258-bb54-30a73e811803\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-11e2e27d-67b47c76fc-9sps9"
Jul 21 01:50:59.308299 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:50:59.308162    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70804f13-ea8b-4258-bb54-30a73e811803-maas-api-tls\") pod \"maas-api-e2e-ait-11e2e27d-67b47c76fc-9sps9\" (UID: \"70804f13-ea8b-4258-bb54-30a73e811803\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-11e2e27d-67b47c76fc-9sps9"
Jul 21 01:50:59.308299 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:50:59.308284    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-11e2e27d-serving-cert: secret "maas-api-e2e-ait-11e2e27d-serving-cert" not found
Jul 21 01:50:59.308453 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:50:59.308362    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70804f13-ea8b-4258-bb54-30a73e811803-maas-api-tls podName:70804f13-ea8b-4258-bb54-30a73e811803 nodeName:}" failed. No retries permitted until 2026-07-21 01:50:59.808346127 +0000 UTC m=+1729.538714777 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/70804f13-ea8b-4258-bb54-30a73e811803-maas-api-tls") pod "maas-api-e2e-ait-11e2e27d-67b47c76fc-9sps9" (UID: "70804f13-ea8b-4258-bb54-30a73e811803") : secret "maas-api-e2e-ait-11e2e27d-serving-cert" not found
Jul 21 01:50:59.308887 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:50:59.308864    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/70804f13-ea8b-4258-bb54-30a73e811803-openshift-service-ca\") pod \"maas-api-e2e-ait-11e2e27d-67b47c76fc-9sps9\" (UID: \"70804f13-ea8b-4258-bb54-30a73e811803\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-11e2e27d-67b47c76fc-9sps9"
Jul 21 01:50:59.317778 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:50:59.317747    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfvvc\" (UniqueName: \"kubernetes.io/projected/70804f13-ea8b-4258-bb54-30a73e811803-kube-api-access-kfvvc\") pod \"maas-api-e2e-ait-11e2e27d-67b47c76fc-9sps9\" (UID: \"70804f13-ea8b-4258-bb54-30a73e811803\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-11e2e27d-67b47c76fc-9sps9"
Jul 21 01:50:59.724303 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:50:59.724252    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:50:59.812925 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:50:59.812891    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70804f13-ea8b-4258-bb54-30a73e811803-maas-api-tls\") pod \"maas-api-e2e-ait-11e2e27d-67b47c76fc-9sps9\" (UID: \"70804f13-ea8b-4258-bb54-30a73e811803\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-11e2e27d-67b47c76fc-9sps9"
Jul 21 01:50:59.815408 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:50:59.815389    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70804f13-ea8b-4258-bb54-30a73e811803-maas-api-tls\") pod \"maas-api-e2e-ait-11e2e27d-67b47c76fc-9sps9\" (UID: \"70804f13-ea8b-4258-bb54-30a73e811803\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-11e2e27d-67b47c76fc-9sps9"
Jul 21 01:50:59.838167 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:50:59.838133    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:50:59.908579 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:50:59.908541    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:51:00.053478 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:00.053448    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-11e2e27d-67b47c76fc-9sps9"
Jul 21 01:51:00.186466 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:00.186439    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-11e2e27d-67b47c76fc-9sps9"]
Jul 21 01:51:00.188772 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:51:00.188747    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70804f13_ea8b_4258_bb54_30a73e811803.slice/crio-38068cef18c7c7a17257ca31ae45819aea68f0ee03fcb493bec017669d0fb1eb WatchSource:0}: Error finding container 38068cef18c7c7a17257ca31ae45819aea68f0ee03fcb493bec017669d0fb1eb: Status 404 returned error can't find the container with id 38068cef18c7c7a17257ca31ae45819aea68f0ee03fcb493bec017669d0fb1eb
Jul 21 01:51:00.190073 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:00.190053    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 01:51:00.393505 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:00.393414    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-11e2e27d-67b47c76fc-9sps9" event={"ID":"70804f13-ea8b-4258-bb54-30a73e811803","Type":"ContainerStarted","Data":"38068cef18c7c7a17257ca31ae45819aea68f0ee03fcb493bec017669d0fb1eb"}
Jul 21 01:51:01.398817 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:01.398780    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-11e2e27d-67b47c76fc-9sps9" event={"ID":"70804f13-ea8b-4258-bb54-30a73e811803","Type":"ContainerStarted","Data":"daf5df73aa4e5081292a80cb578895d73f69185ce71fedd2d8cff88b8315b8c9"}
Jul 21 01:51:01.399222 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:01.398856    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-11e2e27d-67b47c76fc-9sps9"
Jul 21 01:51:01.416680 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:01.416612    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-11e2e27d-67b47c76fc-9sps9" podStartSLOduration=1.938243556 podStartE2EDuration="2.416598178s" totalImagesPullingTime="478.354622ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:50:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:51:01.415281614 +0000 UTC m=+1731.145650286" watchObservedRunningTime="2026-07-21 01:51:01.416598178 +0000 UTC m=+1731.146966847"
Jul 21 01:51:07.407973 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:07.407945    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-11e2e27d-67b47c76fc-9sps9"
Jul 21 01:51:12.732869 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:12.732814    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:51:12.833036 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:12.832997    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:51:34.895514 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:34.895477    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-11e2e27d-67b47c76fc-9sps9"]
Jul 21 01:51:34.895970 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:34.895714    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-11e2e27d-67b47c76fc-9sps9" podUID="70804f13-ea8b-4258-bb54-30a73e811803" containerName="maas-api" containerID="cri-o://daf5df73aa4e5081292a80cb578895d73f69185ce71fedd2d8cff88b8315b8c9" gracePeriod=30
Jul 21 01:51:34.923140 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:34.923097    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:51:35.145312 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:35.145290    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-11e2e27d-67b47c76fc-9sps9"
Jul 21 01:51:35.313242 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:35.313187    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70804f13-ea8b-4258-bb54-30a73e811803-maas-api-tls\") pod \"70804f13-ea8b-4258-bb54-30a73e811803\" (UID: \"70804f13-ea8b-4258-bb54-30a73e811803\") "
Jul 21 01:51:35.313411 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:35.313289    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kfvvc\" (UniqueName: \"kubernetes.io/projected/70804f13-ea8b-4258-bb54-30a73e811803-kube-api-access-kfvvc\") pod \"70804f13-ea8b-4258-bb54-30a73e811803\" (UID: \"70804f13-ea8b-4258-bb54-30a73e811803\") "
Jul 21 01:51:35.313411 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:35.313343    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/70804f13-ea8b-4258-bb54-30a73e811803-openshift-service-ca\") pod \"70804f13-ea8b-4258-bb54-30a73e811803\" (UID: \"70804f13-ea8b-4258-bb54-30a73e811803\") "
Jul 21 01:51:35.313726 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:35.313699    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70804f13-ea8b-4258-bb54-30a73e811803-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "70804f13-ea8b-4258-bb54-30a73e811803" (UID: "70804f13-ea8b-4258-bb54-30a73e811803"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:51:35.315668 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:35.315629    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70804f13-ea8b-4258-bb54-30a73e811803-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "70804f13-ea8b-4258-bb54-30a73e811803" (UID: "70804f13-ea8b-4258-bb54-30a73e811803"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:51:35.315767 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:35.315716    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70804f13-ea8b-4258-bb54-30a73e811803-kube-api-access-kfvvc" (OuterVolumeSpecName: "kube-api-access-kfvvc") pod "70804f13-ea8b-4258-bb54-30a73e811803" (UID: "70804f13-ea8b-4258-bb54-30a73e811803"). InnerVolumeSpecName "kube-api-access-kfvvc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:51:35.414330 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:35.414300    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/70804f13-ea8b-4258-bb54-30a73e811803-openshift-service-ca\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 01:51:35.414330 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:35.414327    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70804f13-ea8b-4258-bb54-30a73e811803-maas-api-tls\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 01:51:35.414330 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:35.414336    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kfvvc\" (UniqueName: \"kubernetes.io/projected/70804f13-ea8b-4258-bb54-30a73e811803-kube-api-access-kfvvc\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 01:51:35.534872 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:35.534834    2561 generic.go:356] "Generic (PLEG): container finished" podID="70804f13-ea8b-4258-bb54-30a73e811803" containerID="daf5df73aa4e5081292a80cb578895d73f69185ce71fedd2d8cff88b8315b8c9" exitCode=0
Jul 21 01:51:35.535045 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:35.534881    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-11e2e27d-67b47c76fc-9sps9"
Jul 21 01:51:35.535045 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:35.534911    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-11e2e27d-67b47c76fc-9sps9" event={"ID":"70804f13-ea8b-4258-bb54-30a73e811803","Type":"ContainerDied","Data":"daf5df73aa4e5081292a80cb578895d73f69185ce71fedd2d8cff88b8315b8c9"}
Jul 21 01:51:35.535045 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:35.534957    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-11e2e27d-67b47c76fc-9sps9" event={"ID":"70804f13-ea8b-4258-bb54-30a73e811803","Type":"ContainerDied","Data":"38068cef18c7c7a17257ca31ae45819aea68f0ee03fcb493bec017669d0fb1eb"}
Jul 21 01:51:35.535045 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:35.534979    2561 scope.go:117] "RemoveContainer" containerID="daf5df73aa4e5081292a80cb578895d73f69185ce71fedd2d8cff88b8315b8c9"
Jul 21 01:51:35.543523 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:35.543507    2561 scope.go:117] "RemoveContainer" containerID="daf5df73aa4e5081292a80cb578895d73f69185ce71fedd2d8cff88b8315b8c9"
Jul 21 01:51:35.543763 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:51:35.543744    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"daf5df73aa4e5081292a80cb578895d73f69185ce71fedd2d8cff88b8315b8c9\": container with ID starting with daf5df73aa4e5081292a80cb578895d73f69185ce71fedd2d8cff88b8315b8c9 not found: ID does not exist" containerID="daf5df73aa4e5081292a80cb578895d73f69185ce71fedd2d8cff88b8315b8c9"
Jul 21 01:51:35.543823 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:35.543768    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"daf5df73aa4e5081292a80cb578895d73f69185ce71fedd2d8cff88b8315b8c9"} err="failed to get container status \"daf5df73aa4e5081292a80cb578895d73f69185ce71fedd2d8cff88b8315b8c9\": rpc error: code = NotFound desc = could not find container \"daf5df73aa4e5081292a80cb578895d73f69185ce71fedd2d8cff88b8315b8c9\": container with ID starting with daf5df73aa4e5081292a80cb578895d73f69185ce71fedd2d8cff88b8315b8c9 not found: ID does not exist"
Jul 21 01:51:35.555651 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:35.555624    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-11e2e27d-67b47c76fc-9sps9"]
Jul 21 01:51:35.559608 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:35.559581    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-11e2e27d-67b47c76fc-9sps9"]
Jul 21 01:51:36.715616 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:36.715578    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70804f13-ea8b-4258-bb54-30a73e811803" path="/var/lib/kubelet/pods/70804f13-ea8b-4258-bb54-30a73e811803/volumes"
Jul 21 01:51:39.580293 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:39.580255    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:51:39.733397 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:39.733354    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:51:39.979386 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:39.979264    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:51:40.228686 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:40.228656    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:51:40.327930 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:40.327893    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:51:40.448912 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:40.448878    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:51:40.765777 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:40.765693    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:51:40.936396 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:40.936361    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:51:43.330938 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:43.330901    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:51:43.593659 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:43.593585    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-18d78b1a-84dc7c8b87-bhgn8"]
Jul 21 01:51:43.593905 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:43.593893    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70804f13-ea8b-4258-bb54-30a73e811803" containerName="maas-api"
Jul 21 01:51:43.593950 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:43.593908    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="70804f13-ea8b-4258-bb54-30a73e811803" containerName="maas-api"
Jul 21 01:51:43.593986 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:43.593951    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="70804f13-ea8b-4258-bb54-30a73e811803" containerName="maas-api"
Jul 21 01:51:43.596680 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:43.596665    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-18d78b1a-84dc7c8b87-bhgn8"
Jul 21 01:51:43.599917 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:43.599888    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-18d78b1a-serving-cert\""
Jul 21 01:51:43.620024 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:43.619998    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-18d78b1a-84dc7c8b87-bhgn8"]
Jul 21 01:51:43.639903 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:43.639837    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:51:43.691485 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:43.691454    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5f86a33-a16a-472d-9fba-00db5a8628a6-openshift-service-ca\") pod \"maas-api-e2e-migrate-18d78b1a-84dc7c8b87-bhgn8\" (UID: \"d5f86a33-a16a-472d-9fba-00db5a8628a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-18d78b1a-84dc7c8b87-bhgn8"
Jul 21 01:51:43.691624 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:43.691490    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5f86a33-a16a-472d-9fba-00db5a8628a6-maas-api-tls\") pod \"maas-api-e2e-migrate-18d78b1a-84dc7c8b87-bhgn8\" (UID: \"d5f86a33-a16a-472d-9fba-00db5a8628a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-18d78b1a-84dc7c8b87-bhgn8"
Jul 21 01:51:43.691624 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:43.691508    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxlrd\" (UniqueName: \"kubernetes.io/projected/d5f86a33-a16a-472d-9fba-00db5a8628a6-kube-api-access-dxlrd\") pod \"maas-api-e2e-migrate-18d78b1a-84dc7c8b87-bhgn8\" (UID: \"d5f86a33-a16a-472d-9fba-00db5a8628a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-18d78b1a-84dc7c8b87-bhgn8"
Jul 21 01:51:43.791924 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:43.791890    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5f86a33-a16a-472d-9fba-00db5a8628a6-openshift-service-ca\") pod \"maas-api-e2e-migrate-18d78b1a-84dc7c8b87-bhgn8\" (UID: \"d5f86a33-a16a-472d-9fba-00db5a8628a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-18d78b1a-84dc7c8b87-bhgn8"
Jul 21 01:51:43.791924 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:43.791936    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5f86a33-a16a-472d-9fba-00db5a8628a6-maas-api-tls\") pod \"maas-api-e2e-migrate-18d78b1a-84dc7c8b87-bhgn8\" (UID: \"d5f86a33-a16a-472d-9fba-00db5a8628a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-18d78b1a-84dc7c8b87-bhgn8"
Jul 21 01:51:43.792133 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:43.792051    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxlrd\" (UniqueName: \"kubernetes.io/projected/d5f86a33-a16a-472d-9fba-00db5a8628a6-kube-api-access-dxlrd\") pod \"maas-api-e2e-migrate-18d78b1a-84dc7c8b87-bhgn8\" (UID: \"d5f86a33-a16a-472d-9fba-00db5a8628a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-18d78b1a-84dc7c8b87-bhgn8"
Jul 21 01:51:43.792577 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:43.792549    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:51:43.792702 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:43.792685    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5f86a33-a16a-472d-9fba-00db5a8628a6-openshift-service-ca\") pod \"maas-api-e2e-migrate-18d78b1a-84dc7c8b87-bhgn8\" (UID: \"d5f86a33-a16a-472d-9fba-00db5a8628a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-18d78b1a-84dc7c8b87-bhgn8"
Jul 21 01:51:43.794823 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:43.794804    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5f86a33-a16a-472d-9fba-00db5a8628a6-maas-api-tls\") pod \"maas-api-e2e-migrate-18d78b1a-84dc7c8b87-bhgn8\" (UID: \"d5f86a33-a16a-472d-9fba-00db5a8628a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-18d78b1a-84dc7c8b87-bhgn8"
Jul 21 01:51:43.801391 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:43.801368    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxlrd\" (UniqueName: \"kubernetes.io/projected/d5f86a33-a16a-472d-9fba-00db5a8628a6-kube-api-access-dxlrd\") pod \"maas-api-e2e-migrate-18d78b1a-84dc7c8b87-bhgn8\" (UID: \"d5f86a33-a16a-472d-9fba-00db5a8628a6\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-18d78b1a-84dc7c8b87-bhgn8"
Jul 21 01:51:43.906369 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:43.906264    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-18d78b1a-84dc7c8b87-bhgn8"
Jul 21 01:51:44.033443 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:44.033417    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-18d78b1a-84dc7c8b87-bhgn8"]
Jul 21 01:51:44.034958 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:51:44.034924    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5f86a33_a16a_472d_9fba_00db5a8628a6.slice/crio-a760434e89bb41c5c43a67720b03460b2f69539c61c88051dd8912892d8b5b80 WatchSource:0}: Error finding container a760434e89bb41c5c43a67720b03460b2f69539c61c88051dd8912892d8b5b80: Status 404 returned error can't find the container with id a760434e89bb41c5c43a67720b03460b2f69539c61c88051dd8912892d8b5b80
Jul 21 01:51:44.102744 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:44.102718    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:51:44.204487 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:44.204410    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:51:44.573576 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:44.573545    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-18d78b1a-84dc7c8b87-bhgn8" event={"ID":"d5f86a33-a16a-472d-9fba-00db5a8628a6","Type":"ContainerStarted","Data":"a760434e89bb41c5c43a67720b03460b2f69539c61c88051dd8912892d8b5b80"}
Jul 21 01:51:45.579330 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:45.579294    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-18d78b1a-84dc7c8b87-bhgn8" event={"ID":"d5f86a33-a16a-472d-9fba-00db5a8628a6","Type":"ContainerStarted","Data":"cc9439960780226d977b0d0f6cd8a010efd0a4f140fdb10d0f9a6f107120f538"}
Jul 21 01:51:45.579712 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:45.579366    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-18d78b1a-84dc7c8b87-bhgn8"
Jul 21 01:51:45.595686 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:45.595644    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-18d78b1a-84dc7c8b87-bhgn8" podStartSLOduration=1.67141715 podStartE2EDuration="2.595630222s" totalImagesPullingTime="924.213072ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:51:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:51:45.594787733 +0000 UTC m=+1775.325156401" watchObservedRunningTime="2026-07-21 01:51:45.595630222 +0000 UTC m=+1775.325998892"
Jul 21 01:51:51.588296 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:51:51.588268    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-18d78b1a-84dc7c8b87-bhgn8"
Jul 21 01:52:10.706889 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:10.706861    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2p4wt_1701009a-d778-4d6d-b59f-e91ec4b13a60/ovn-acl-logging/0.log"
Jul 21 01:52:10.711875 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:10.711851    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2p4wt_1701009a-d778-4d6d-b59f-e91ec4b13a60/ovn-acl-logging/0.log"
Jul 21 01:52:18.845677 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:18.845640    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-18d78b1a-84dc7c8b87-bhgn8"]
Jul 21 01:52:18.846107 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:18.845906    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-18d78b1a-84dc7c8b87-bhgn8" podUID="d5f86a33-a16a-472d-9fba-00db5a8628a6" containerName="maas-api" containerID="cri-o://cc9439960780226d977b0d0f6cd8a010efd0a4f140fdb10d0f9a6f107120f538" gracePeriod=30
Jul 21 01:52:18.864154 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:18.864126    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:52:19.081600 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:19.081575    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-18d78b1a-84dc7c8b87-bhgn8"
Jul 21 01:52:19.155717 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:19.155649    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dxlrd\" (UniqueName: \"kubernetes.io/projected/d5f86a33-a16a-472d-9fba-00db5a8628a6-kube-api-access-dxlrd\") pod \"d5f86a33-a16a-472d-9fba-00db5a8628a6\" (UID: \"d5f86a33-a16a-472d-9fba-00db5a8628a6\") "
Jul 21 01:52:19.155717 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:19.155682    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5f86a33-a16a-472d-9fba-00db5a8628a6-maas-api-tls\") pod \"d5f86a33-a16a-472d-9fba-00db5a8628a6\" (UID: \"d5f86a33-a16a-472d-9fba-00db5a8628a6\") "
Jul 21 01:52:19.155872 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:19.155736    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5f86a33-a16a-472d-9fba-00db5a8628a6-openshift-service-ca\") pod \"d5f86a33-a16a-472d-9fba-00db5a8628a6\" (UID: \"d5f86a33-a16a-472d-9fba-00db5a8628a6\") "
Jul 21 01:52:19.156164 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:19.156141    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5f86a33-a16a-472d-9fba-00db5a8628a6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d5f86a33-a16a-472d-9fba-00db5a8628a6" (UID: "d5f86a33-a16a-472d-9fba-00db5a8628a6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:52:19.157877 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:19.157856    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5f86a33-a16a-472d-9fba-00db5a8628a6-kube-api-access-dxlrd" (OuterVolumeSpecName: "kube-api-access-dxlrd") pod "d5f86a33-a16a-472d-9fba-00db5a8628a6" (UID: "d5f86a33-a16a-472d-9fba-00db5a8628a6"). InnerVolumeSpecName "kube-api-access-dxlrd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:52:19.157957 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:19.157938    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5f86a33-a16a-472d-9fba-00db5a8628a6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d5f86a33-a16a-472d-9fba-00db5a8628a6" (UID: "d5f86a33-a16a-472d-9fba-00db5a8628a6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:52:19.256416 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:19.256382    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5f86a33-a16a-472d-9fba-00db5a8628a6-openshift-service-ca\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 01:52:19.256416 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:19.256410    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxlrd\" (UniqueName: \"kubernetes.io/projected/d5f86a33-a16a-472d-9fba-00db5a8628a6-kube-api-access-dxlrd\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 01:52:19.256605 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:19.256422    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5f86a33-a16a-472d-9fba-00db5a8628a6-maas-api-tls\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 01:52:19.727525 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:19.727486    2561 generic.go:356] "Generic (PLEG): container finished" podID="d5f86a33-a16a-472d-9fba-00db5a8628a6" containerID="cc9439960780226d977b0d0f6cd8a010efd0a4f140fdb10d0f9a6f107120f538" exitCode=0
Jul 21 01:52:19.727689 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:19.727535    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-18d78b1a-84dc7c8b87-bhgn8"
Jul 21 01:52:19.727689 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:19.727574    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-18d78b1a-84dc7c8b87-bhgn8" event={"ID":"d5f86a33-a16a-472d-9fba-00db5a8628a6","Type":"ContainerDied","Data":"cc9439960780226d977b0d0f6cd8a010efd0a4f140fdb10d0f9a6f107120f538"}
Jul 21 01:52:19.727689 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:19.727624    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-18d78b1a-84dc7c8b87-bhgn8" event={"ID":"d5f86a33-a16a-472d-9fba-00db5a8628a6","Type":"ContainerDied","Data":"a760434e89bb41c5c43a67720b03460b2f69539c61c88051dd8912892d8b5b80"}
Jul 21 01:52:19.727689 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:19.727648    2561 scope.go:117] "RemoveContainer" containerID="cc9439960780226d977b0d0f6cd8a010efd0a4f140fdb10d0f9a6f107120f538"
Jul 21 01:52:19.736246 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:19.736230    2561 scope.go:117] "RemoveContainer" containerID="cc9439960780226d977b0d0f6cd8a010efd0a4f140fdb10d0f9a6f107120f538"
Jul 21 01:52:19.736500 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:52:19.736480    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc9439960780226d977b0d0f6cd8a010efd0a4f140fdb10d0f9a6f107120f538\": container with ID starting with cc9439960780226d977b0d0f6cd8a010efd0a4f140fdb10d0f9a6f107120f538 not found: ID does not exist" containerID="cc9439960780226d977b0d0f6cd8a010efd0a4f140fdb10d0f9a6f107120f538"
Jul 21 01:52:19.736562 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:19.736511    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc9439960780226d977b0d0f6cd8a010efd0a4f140fdb10d0f9a6f107120f538"} err="failed to get container status \"cc9439960780226d977b0d0f6cd8a010efd0a4f140fdb10d0f9a6f107120f538\": rpc error: code = NotFound desc = could not find container \"cc9439960780226d977b0d0f6cd8a010efd0a4f140fdb10d0f9a6f107120f538\": container with ID starting with cc9439960780226d977b0d0f6cd8a010efd0a4f140fdb10d0f9a6f107120f538 not found: ID does not exist"
Jul 21 01:52:19.748656 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:19.748630    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-18d78b1a-84dc7c8b87-bhgn8"]
Jul 21 01:52:19.752373 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:19.752353    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-18d78b1a-84dc7c8b87-bhgn8"]
Jul 21 01:52:20.714349 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:20.714317    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5f86a33-a16a-472d-9fba-00db5a8628a6" path="/var/lib/kubelet/pods/d5f86a33-a16a-472d-9fba-00db5a8628a6/volumes"
Jul 21 01:52:23.384635 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:23.384597    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:52:23.539032 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:23.539002    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:52:23.780952 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:23.780926    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:52:24.008983 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:24.008946    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:52:24.470686 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:24.470654    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:52:24.642450 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:24.642412    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:52:26.503848 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:26.503811    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:52:26.580737 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:26.580705    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c01c70b7-6557b64bf5-tj4gr"]
Jul 21 01:52:26.581028 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:26.581014    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5f86a33-a16a-472d-9fba-00db5a8628a6" containerName="maas-api"
Jul 21 01:52:26.581028 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:26.581029    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5f86a33-a16a-472d-9fba-00db5a8628a6" containerName="maas-api"
Jul 21 01:52:26.581145 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:26.581078    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5f86a33-a16a-472d-9fba-00db5a8628a6" containerName="maas-api"
Jul 21 01:52:26.585516 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:26.585495    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c01c70b7-6557b64bf5-tj4gr"
Jul 21 01:52:26.588389 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:26.588372    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-c01c70b7-serving-cert\""
Jul 21 01:52:26.594649 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:26.594627    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c01c70b7-6557b64bf5-tj4gr"]
Jul 21 01:52:26.599420 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:26.599397    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:52:26.666130 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:26.666103    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:52:26.717710 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:26.717685    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88ea9cda-0f88-4e68-a4cd-781a53807adf-maas-api-tls\") pod \"maas-api-e2e-ait-c01c70b7-6557b64bf5-tj4gr\" (UID: \"88ea9cda-0f88-4e68-a4cd-781a53807adf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c01c70b7-6557b64bf5-tj4gr"
Jul 21 01:52:26.717880 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:26.717729    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88ea9cda-0f88-4e68-a4cd-781a53807adf-openshift-service-ca\") pod \"maas-api-e2e-ait-c01c70b7-6557b64bf5-tj4gr\" (UID: \"88ea9cda-0f88-4e68-a4cd-781a53807adf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c01c70b7-6557b64bf5-tj4gr"
Jul 21 01:52:26.717880 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:26.717755    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xt4mq\" (UniqueName: \"kubernetes.io/projected/88ea9cda-0f88-4e68-a4cd-781a53807adf-kube-api-access-xt4mq\") pod \"maas-api-e2e-ait-c01c70b7-6557b64bf5-tj4gr\" (UID: \"88ea9cda-0f88-4e68-a4cd-781a53807adf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c01c70b7-6557b64bf5-tj4gr"
Jul 21 01:52:26.818291 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:26.818257    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88ea9cda-0f88-4e68-a4cd-781a53807adf-maas-api-tls\") pod \"maas-api-e2e-ait-c01c70b7-6557b64bf5-tj4gr\" (UID: \"88ea9cda-0f88-4e68-a4cd-781a53807adf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c01c70b7-6557b64bf5-tj4gr"
Jul 21 01:52:26.818488 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:26.818338    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88ea9cda-0f88-4e68-a4cd-781a53807adf-openshift-service-ca\") pod \"maas-api-e2e-ait-c01c70b7-6557b64bf5-tj4gr\" (UID: \"88ea9cda-0f88-4e68-a4cd-781a53807adf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c01c70b7-6557b64bf5-tj4gr"
Jul 21 01:52:26.818488 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:26.818368    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt4mq\" (UniqueName: \"kubernetes.io/projected/88ea9cda-0f88-4e68-a4cd-781a53807adf-kube-api-access-xt4mq\") pod \"maas-api-e2e-ait-c01c70b7-6557b64bf5-tj4gr\" (UID: \"88ea9cda-0f88-4e68-a4cd-781a53807adf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c01c70b7-6557b64bf5-tj4gr"
Jul 21 01:52:26.819079 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:26.819011    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88ea9cda-0f88-4e68-a4cd-781a53807adf-openshift-service-ca\") pod \"maas-api-e2e-ait-c01c70b7-6557b64bf5-tj4gr\" (UID: \"88ea9cda-0f88-4e68-a4cd-781a53807adf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c01c70b7-6557b64bf5-tj4gr"
Jul 21 01:52:26.820945 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:26.820920    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88ea9cda-0f88-4e68-a4cd-781a53807adf-maas-api-tls\") pod \"maas-api-e2e-ait-c01c70b7-6557b64bf5-tj4gr\" (UID: \"88ea9cda-0f88-4e68-a4cd-781a53807adf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c01c70b7-6557b64bf5-tj4gr"
Jul 21 01:52:26.836407 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:26.836375    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xt4mq\" (UniqueName: \"kubernetes.io/projected/88ea9cda-0f88-4e68-a4cd-781a53807adf-kube-api-access-xt4mq\") pod \"maas-api-e2e-ait-c01c70b7-6557b64bf5-tj4gr\" (UID: \"88ea9cda-0f88-4e68-a4cd-781a53807adf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c01c70b7-6557b64bf5-tj4gr"
Jul 21 01:52:26.879586 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:26.879542    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:52:26.897258 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:26.897232    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c01c70b7-6557b64bf5-tj4gr"
Jul 21 01:52:27.027049 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:27.027026    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c01c70b7-6557b64bf5-tj4gr"]
Jul 21 01:52:27.029559 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:52:27.029532    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88ea9cda_0f88_4e68_a4cd_781a53807adf.slice/crio-0877a5701dda43a64388cee94d513bbefe8d9ee1aef43db67db024b4fb6e699c WatchSource:0}: Error finding container 0877a5701dda43a64388cee94d513bbefe8d9ee1aef43db67db024b4fb6e699c: Status 404 returned error can't find the container with id 0877a5701dda43a64388cee94d513bbefe8d9ee1aef43db67db024b4fb6e699c
Jul 21 01:52:27.074919 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:27.074845    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:52:27.176091 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:27.176062    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:52:27.761244 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:27.761136    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c01c70b7-6557b64bf5-tj4gr" event={"ID":"88ea9cda-0f88-4e68-a4cd-781a53807adf","Type":"ContainerStarted","Data":"4c689ed38f9bf551d09f6dc2a8bce310bf236b141af1a1d296a1985804556041"}
Jul 21 01:52:27.761244 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:27.761194    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c01c70b7-6557b64bf5-tj4gr" event={"ID":"88ea9cda-0f88-4e68-a4cd-781a53807adf","Type":"ContainerStarted","Data":"0877a5701dda43a64388cee94d513bbefe8d9ee1aef43db67db024b4fb6e699c"}
Jul 21 01:52:27.761244 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:27.761236    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c01c70b7-6557b64bf5-tj4gr"
Jul 21 01:52:27.794047 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:27.793994    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c01c70b7-6557b64bf5-tj4gr" podStartSLOduration=1.390419773 podStartE2EDuration="1.793977034s" totalImagesPullingTime="403.557261ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:52:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:52:27.793094191 +0000 UTC m=+1817.523462915" watchObservedRunningTime="2026-07-21 01:52:27.793977034 +0000 UTC m=+1817.524345704"
Jul 21 01:52:33.771014 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:52:33.770986    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c01c70b7-6557b64bf5-tj4gr"
Jul 21 01:53:02.718133 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:02.718086    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c01c70b7-6557b64bf5-tj4gr"]
Jul 21 01:53:02.718725 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:02.718361    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c01c70b7-6557b64bf5-tj4gr" podUID="88ea9cda-0f88-4e68-a4cd-781a53807adf" containerName="maas-api" containerID="cri-o://4c689ed38f9bf551d09f6dc2a8bce310bf236b141af1a1d296a1985804556041" gracePeriod=30
Jul 21 01:53:02.741326 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:02.741293    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:53:02.905767 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:02.905724    2561 generic.go:356] "Generic (PLEG): container finished" podID="88ea9cda-0f88-4e68-a4cd-781a53807adf" containerID="4c689ed38f9bf551d09f6dc2a8bce310bf236b141af1a1d296a1985804556041" exitCode=0
Jul 21 01:53:02.905917 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:02.905795    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c01c70b7-6557b64bf5-tj4gr" event={"ID":"88ea9cda-0f88-4e68-a4cd-781a53807adf","Type":"ContainerDied","Data":"4c689ed38f9bf551d09f6dc2a8bce310bf236b141af1a1d296a1985804556041"}
Jul 21 01:53:02.964733 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:02.964710    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c01c70b7-6557b64bf5-tj4gr"
Jul 21 01:53:03.030038 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:03.030011    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xt4mq\" (UniqueName: \"kubernetes.io/projected/88ea9cda-0f88-4e68-a4cd-781a53807adf-kube-api-access-xt4mq\") pod \"88ea9cda-0f88-4e68-a4cd-781a53807adf\" (UID: \"88ea9cda-0f88-4e68-a4cd-781a53807adf\") "
Jul 21 01:53:03.030260 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:03.030062    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88ea9cda-0f88-4e68-a4cd-781a53807adf-maas-api-tls\") pod \"88ea9cda-0f88-4e68-a4cd-781a53807adf\" (UID: \"88ea9cda-0f88-4e68-a4cd-781a53807adf\") "
Jul 21 01:53:03.030260 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:03.030102    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88ea9cda-0f88-4e68-a4cd-781a53807adf-openshift-service-ca\") pod \"88ea9cda-0f88-4e68-a4cd-781a53807adf\" (UID: \"88ea9cda-0f88-4e68-a4cd-781a53807adf\") "
Jul 21 01:53:03.030543 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:03.030507    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88ea9cda-0f88-4e68-a4cd-781a53807adf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "88ea9cda-0f88-4e68-a4cd-781a53807adf" (UID: "88ea9cda-0f88-4e68-a4cd-781a53807adf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:53:03.032385 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:03.032360    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88ea9cda-0f88-4e68-a4cd-781a53807adf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "88ea9cda-0f88-4e68-a4cd-781a53807adf" (UID: "88ea9cda-0f88-4e68-a4cd-781a53807adf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:53:03.032483 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:03.032380    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88ea9cda-0f88-4e68-a4cd-781a53807adf-kube-api-access-xt4mq" (OuterVolumeSpecName: "kube-api-access-xt4mq") pod "88ea9cda-0f88-4e68-a4cd-781a53807adf" (UID: "88ea9cda-0f88-4e68-a4cd-781a53807adf"). InnerVolumeSpecName "kube-api-access-xt4mq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:53:03.131294 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:03.131256    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88ea9cda-0f88-4e68-a4cd-781a53807adf-openshift-service-ca\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 01:53:03.131294 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:03.131286    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xt4mq\" (UniqueName: \"kubernetes.io/projected/88ea9cda-0f88-4e68-a4cd-781a53807adf-kube-api-access-xt4mq\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 01:53:03.131294 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:03.131301    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88ea9cda-0f88-4e68-a4cd-781a53807adf-maas-api-tls\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 01:53:03.911731 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:03.911696    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c01c70b7-6557b64bf5-tj4gr" event={"ID":"88ea9cda-0f88-4e68-a4cd-781a53807adf","Type":"ContainerDied","Data":"0877a5701dda43a64388cee94d513bbefe8d9ee1aef43db67db024b4fb6e699c"}
Jul 21 01:53:03.911731 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:03.911725    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c01c70b7-6557b64bf5-tj4gr"
Jul 21 01:53:03.912248 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:03.911760    2561 scope.go:117] "RemoveContainer" containerID="4c689ed38f9bf551d09f6dc2a8bce310bf236b141af1a1d296a1985804556041"
Jul 21 01:53:03.932845 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:03.932815    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c01c70b7-6557b64bf5-tj4gr"]
Jul 21 01:53:03.939668 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:03.939644    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c01c70b7-6557b64bf5-tj4gr"]
Jul 21 01:53:04.714395 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:04.714364    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88ea9cda-0f88-4e68-a4cd-781a53807adf" path="/var/lib/kubelet/pods/88ea9cda-0f88-4e68-a4cd-781a53807adf/volumes"
Jul 21 01:53:07.430075 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:07.430040    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:53:08.631163 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:08.631133    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:53:08.854957 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:08.854925    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:53:09.135959 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:09.135925    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:53:09.417255 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:09.417114    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:53:09.711477 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:09.711351    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:53:11.788476 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:11.788418    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:53:11.887084 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:11.886998    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:53:12.038042 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:12.037990    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e1f6418d-7c6b7ccd7b-v7qf9"]
Jul 21 01:53:12.038449 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:12.038433    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88ea9cda-0f88-4e68-a4cd-781a53807adf" containerName="maas-api"
Jul 21 01:53:12.038783 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:12.038451    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="88ea9cda-0f88-4e68-a4cd-781a53807adf" containerName="maas-api"
Jul 21 01:53:12.038783 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:12.038534    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="88ea9cda-0f88-4e68-a4cd-781a53807adf" containerName="maas-api"
Jul 21 01:53:12.042874 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:12.042853    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e1f6418d-7c6b7ccd7b-v7qf9"
Jul 21 01:53:12.045477 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:12.045454    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-e1f6418d-serving-cert\""
Jul 21 01:53:12.054419 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:12.054394    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e1f6418d-7c6b7ccd7b-v7qf9"]
Jul 21 01:53:12.077165 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:12.077138    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:53:12.108812 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:12.108780    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p78q9\" (UniqueName: \"kubernetes.io/projected/48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca-kube-api-access-p78q9\") pod \"maas-api-e2e-derive-e1f6418d-7c6b7ccd7b-v7qf9\" (UID: \"48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e1f6418d-7c6b7ccd7b-v7qf9"
Jul 21 01:53:12.108972 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:12.108836    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca-maas-api-tls\") pod \"maas-api-e2e-derive-e1f6418d-7c6b7ccd7b-v7qf9\" (UID: \"48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e1f6418d-7c6b7ccd7b-v7qf9"
Jul 21 01:53:12.108972 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:12.108910    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca-openshift-service-ca\") pod \"maas-api-e2e-derive-e1f6418d-7c6b7ccd7b-v7qf9\" (UID: \"48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e1f6418d-7c6b7ccd7b-v7qf9"
Jul 21 01:53:12.209757 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:12.209722    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p78q9\" (UniqueName: \"kubernetes.io/projected/48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca-kube-api-access-p78q9\") pod \"maas-api-e2e-derive-e1f6418d-7c6b7ccd7b-v7qf9\" (UID: \"48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e1f6418d-7c6b7ccd7b-v7qf9"
Jul 21 01:53:12.209955 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:12.209777    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca-maas-api-tls\") pod \"maas-api-e2e-derive-e1f6418d-7c6b7ccd7b-v7qf9\" (UID: \"48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e1f6418d-7c6b7ccd7b-v7qf9"
Jul 21 01:53:12.209955 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:12.209811    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca-openshift-service-ca\") pod \"maas-api-e2e-derive-e1f6418d-7c6b7ccd7b-v7qf9\" (UID: \"48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e1f6418d-7c6b7ccd7b-v7qf9"
Jul 21 01:53:12.209955 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:53:12.209933    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-e1f6418d-serving-cert: secret "maas-api-e2e-derive-e1f6418d-serving-cert" not found
Jul 21 01:53:12.210085 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:53:12.210013    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca-maas-api-tls podName:48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca nodeName:}" failed. No retries permitted until 2026-07-21 01:53:12.70999116 +0000 UTC m=+1862.440359810 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca-maas-api-tls") pod "maas-api-e2e-derive-e1f6418d-7c6b7ccd7b-v7qf9" (UID: "48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca") : secret "maas-api-e2e-derive-e1f6418d-serving-cert" not found
Jul 21 01:53:12.210455 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:12.210438    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca-openshift-service-ca\") pod \"maas-api-e2e-derive-e1f6418d-7c6b7ccd7b-v7qf9\" (UID: \"48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e1f6418d-7c6b7ccd7b-v7qf9"
Jul 21 01:53:12.219624 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:12.219595    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p78q9\" (UniqueName: \"kubernetes.io/projected/48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca-kube-api-access-p78q9\") pod \"maas-api-e2e-derive-e1f6418d-7c6b7ccd7b-v7qf9\" (UID: \"48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e1f6418d-7c6b7ccd7b-v7qf9"
Jul 21 01:53:12.311405 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:12.311314    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:53:12.645988 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:12.645890    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:53:12.713802 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:12.713770    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca-maas-api-tls\") pod \"maas-api-e2e-derive-e1f6418d-7c6b7ccd7b-v7qf9\" (UID: \"48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e1f6418d-7c6b7ccd7b-v7qf9"
Jul 21 01:53:12.716357 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:12.716330    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca-maas-api-tls\") pod \"maas-api-e2e-derive-e1f6418d-7c6b7ccd7b-v7qf9\" (UID: \"48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e1f6418d-7c6b7ccd7b-v7qf9"
Jul 21 01:53:12.745851 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:12.745818    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:53:12.954959 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:12.954863    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e1f6418d-7c6b7ccd7b-v7qf9"
Jul 21 01:53:13.089194 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:13.089158    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e1f6418d-7c6b7ccd7b-v7qf9"]
Jul 21 01:53:13.092021 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:53:13.091994    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48ccda3a_2f52_4fd6_8cf6_4a434dd7a0ca.slice/crio-90f39d1d8db97b65f60747c28f90c514f1d8ce6c5e88f73b55abb26d54b1fb30 WatchSource:0}: Error finding container 90f39d1d8db97b65f60747c28f90c514f1d8ce6c5e88f73b55abb26d54b1fb30: Status 404 returned error can't find the container with id 90f39d1d8db97b65f60747c28f90c514f1d8ce6c5e88f73b55abb26d54b1fb30
Jul 21 01:53:13.954060 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:13.953971    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e1f6418d-7c6b7ccd7b-v7qf9" event={"ID":"48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca","Type":"ContainerStarted","Data":"1f05c4b3339058f73eb5c6a4cc04a0a40e5e4c67cca1bfd35e4e0ebd1c21102a"}
Jul 21 01:53:13.954251 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:13.954127    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e1f6418d-7c6b7ccd7b-v7qf9"
Jul 21 01:53:13.954251 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:13.954170    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e1f6418d-7c6b7ccd7b-v7qf9" event={"ID":"48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca","Type":"ContainerStarted","Data":"90f39d1d8db97b65f60747c28f90c514f1d8ce6c5e88f73b55abb26d54b1fb30"}
Jul 21 01:53:13.982397 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:13.982345    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e1f6418d-7c6b7ccd7b-v7qf9" podStartSLOduration=1.487569304 podStartE2EDuration="1.982329536s" totalImagesPullingTime="494.760232ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:53:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:53:13.982055344 +0000 UTC m=+1863.712424014" watchObservedRunningTime="2026-07-21 01:53:13.982329536 +0000 UTC m=+1863.712698206"
Jul 21 01:53:19.962854 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:19.962822    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e1f6418d-7c6b7ccd7b-v7qf9"
Jul 21 01:53:30.369775 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:30.369742    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:53:30.469836 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:30.469800    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:53:33.413676 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:33.413588    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:53:33.533592 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:33.533554    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:53:47.145256 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:47.145217    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e1f6418d-7c6b7ccd7b-v7qf9"]
Jul 21 01:53:47.145743 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:47.145445    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e1f6418d-7c6b7ccd7b-v7qf9" podUID="48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca" containerName="maas-api" containerID="cri-o://1f05c4b3339058f73eb5c6a4cc04a0a40e5e4c67cca1bfd35e4e0ebd1c21102a" gracePeriod=30
Jul 21 01:53:47.167067 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:47.167039    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:53:47.386933 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:47.386908    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e1f6418d-7c6b7ccd7b-v7qf9"
Jul 21 01:53:47.404638 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:47.404544    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca-maas-api-tls\") pod \"48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca\" (UID: \"48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca\") "
Jul 21 01:53:47.404765 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:47.404642    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p78q9\" (UniqueName: \"kubernetes.io/projected/48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca-kube-api-access-p78q9\") pod \"48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca\" (UID: \"48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca\") "
Jul 21 01:53:47.404765 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:47.404734    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca-openshift-service-ca\") pod \"48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca\" (UID: \"48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca\") "
Jul 21 01:53:47.405559 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:47.405522    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca" (UID: "48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:53:47.407189 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:47.407150    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca" (UID: "48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:53:47.407572 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:47.407545    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca-kube-api-access-p78q9" (OuterVolumeSpecName: "kube-api-access-p78q9") pod "48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca" (UID: "48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca"). InnerVolumeSpecName "kube-api-access-p78q9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:53:47.506181 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:47.506138    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca-openshift-service-ca\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 01:53:47.506181 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:47.506178    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca-maas-api-tls\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 01:53:47.506181 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:47.506188    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p78q9\" (UniqueName: \"kubernetes.io/projected/48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca-kube-api-access-p78q9\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 01:53:48.087959 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:48.087920    2561 generic.go:356] "Generic (PLEG): container finished" podID="48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca" containerID="1f05c4b3339058f73eb5c6a4cc04a0a40e5e4c67cca1bfd35e4e0ebd1c21102a" exitCode=0
Jul 21 01:53:48.087959 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:48.087963    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e1f6418d-7c6b7ccd7b-v7qf9"
Jul 21 01:53:48.088165 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:48.088008    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e1f6418d-7c6b7ccd7b-v7qf9" event={"ID":"48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca","Type":"ContainerDied","Data":"1f05c4b3339058f73eb5c6a4cc04a0a40e5e4c67cca1bfd35e4e0ebd1c21102a"}
Jul 21 01:53:48.088165 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:48.088055    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e1f6418d-7c6b7ccd7b-v7qf9" event={"ID":"48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca","Type":"ContainerDied","Data":"90f39d1d8db97b65f60747c28f90c514f1d8ce6c5e88f73b55abb26d54b1fb30"}
Jul 21 01:53:48.088165 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:48.088077    2561 scope.go:117] "RemoveContainer" containerID="1f05c4b3339058f73eb5c6a4cc04a0a40e5e4c67cca1bfd35e4e0ebd1c21102a"
Jul 21 01:53:48.096922 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:48.096906    2561 scope.go:117] "RemoveContainer" containerID="1f05c4b3339058f73eb5c6a4cc04a0a40e5e4c67cca1bfd35e4e0ebd1c21102a"
Jul 21 01:53:48.097174 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:53:48.097155    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f05c4b3339058f73eb5c6a4cc04a0a40e5e4c67cca1bfd35e4e0ebd1c21102a\": container with ID starting with 1f05c4b3339058f73eb5c6a4cc04a0a40e5e4c67cca1bfd35e4e0ebd1c21102a not found: ID does not exist" containerID="1f05c4b3339058f73eb5c6a4cc04a0a40e5e4c67cca1bfd35e4e0ebd1c21102a"
Jul 21 01:53:48.097266 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:48.097184    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f05c4b3339058f73eb5c6a4cc04a0a40e5e4c67cca1bfd35e4e0ebd1c21102a"} err="failed to get container status \"1f05c4b3339058f73eb5c6a4cc04a0a40e5e4c67cca1bfd35e4e0ebd1c21102a\": rpc error: code = NotFound desc = could not find container \"1f05c4b3339058f73eb5c6a4cc04a0a40e5e4c67cca1bfd35e4e0ebd1c21102a\": container with ID starting with 1f05c4b3339058f73eb5c6a4cc04a0a40e5e4c67cca1bfd35e4e0ebd1c21102a not found: ID does not exist"
Jul 21 01:53:48.108959 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:48.108937    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e1f6418d-7c6b7ccd7b-v7qf9"]
Jul 21 01:53:48.113656 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:48.113636    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e1f6418d-7c6b7ccd7b-v7qf9"]
Jul 21 01:53:48.714729 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:48.714695    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca" path="/var/lib/kubelet/pods/48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca/volumes"
Jul 21 01:53:51.791896 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:51.791860    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:53:51.976265 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:51.976239    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:53:52.217190 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:52.217101    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:53:52.728930 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:52.728898    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:53:52.828978 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:52.828947    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:53:52.929105 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:52.929071    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:53:54.428494 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:53:54.428459    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:54:00.264590 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:54:00.264548    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:54:00.323886 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:54:00.323856    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:54:00.395990 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:54:00.395956    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:54:00.496875 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:54:00.496840    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:54:00.597316 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:54:00.597285    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:54:00.978674 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:54:00.978600    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:54:26.964604 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:54:26.964561    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:54:33.614008 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:54:33.613973    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:54:33.721046 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:54:33.721012    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:54:33.814917 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:54:33.814886    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:54:49.725907 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:54:49.725871    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:54:55.424084 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:54:55.424033    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:54:55.528326 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:54:55.528297    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:54:55.621816 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:54:55.621785    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:55:06.154594 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:06.154562    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:55:06.964505 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:06.964473    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:55:13.084662 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:13.084628    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:55:13.185570 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:13.185537    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:55:13.283783 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:13.283750    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:55:13.384214 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:13.384123    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:55:14.169404 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:14.169366    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:55:14.277508 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:14.277478    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:55:14.369303 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:14.369271    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:55:21.118050 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:21.118015    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:55:27.338571 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:27.338537    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:55:27.437879 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:27.437831    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:55:28.036824 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:28.036790    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:55:33.745333 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:33.745301    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:55:33.842773 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:33.842742    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:55:34.002954 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:34.002874    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:55:34.308144 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:34.308113    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:55:34.585099 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:34.585017    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:55:37.364997 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:37.364960    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:55:37.443568 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:37.443535    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a83ed288-7c449dd68d-8cbqk"]
Jul 21 01:55:37.443992 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:37.443977    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca" containerName="maas-api"
Jul 21 01:55:37.444035 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:37.443997    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca" containerName="maas-api"
Jul 21 01:55:37.444100 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:37.444090    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="48ccda3a-2f52-4fd6-8cf6-4a434dd7a0ca" containerName="maas-api"
Jul 21 01:55:37.447330 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:37.447310    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a83ed288-7c449dd68d-8cbqk"
Jul 21 01:55:37.450075 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:37.450054    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-a83ed288-serving-cert\""
Jul 21 01:55:37.457634 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:37.457611    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a83ed288-7c449dd68d-8cbqk"]
Jul 21 01:55:37.621344 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:37.621251    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22f3c7a3-70b0-4b00-b714-c83578911aad-maas-api-tls\") pod \"maas-api-e2e-mt-a83ed288-7c449dd68d-8cbqk\" (UID: \"22f3c7a3-70b0-4b00-b714-c83578911aad\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a83ed288-7c449dd68d-8cbqk"
Jul 21 01:55:37.621344 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:37.621306    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g9mv\" (UniqueName: \"kubernetes.io/projected/22f3c7a3-70b0-4b00-b714-c83578911aad-kube-api-access-6g9mv\") pod \"maas-api-e2e-mt-a83ed288-7c449dd68d-8cbqk\" (UID: \"22f3c7a3-70b0-4b00-b714-c83578911aad\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a83ed288-7c449dd68d-8cbqk"
Jul 21 01:55:37.621545 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:37.621356    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22f3c7a3-70b0-4b00-b714-c83578911aad-openshift-service-ca\") pod \"maas-api-e2e-mt-a83ed288-7c449dd68d-8cbqk\" (UID: \"22f3c7a3-70b0-4b00-b714-c83578911aad\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a83ed288-7c449dd68d-8cbqk"
Jul 21 01:55:37.722395 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:37.722362    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22f3c7a3-70b0-4b00-b714-c83578911aad-maas-api-tls\") pod \"maas-api-e2e-mt-a83ed288-7c449dd68d-8cbqk\" (UID: \"22f3c7a3-70b0-4b00-b714-c83578911aad\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a83ed288-7c449dd68d-8cbqk"
Jul 21 01:55:37.722604 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:37.722415    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g9mv\" (UniqueName: \"kubernetes.io/projected/22f3c7a3-70b0-4b00-b714-c83578911aad-kube-api-access-6g9mv\") pod \"maas-api-e2e-mt-a83ed288-7c449dd68d-8cbqk\" (UID: \"22f3c7a3-70b0-4b00-b714-c83578911aad\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a83ed288-7c449dd68d-8cbqk"
Jul 21 01:55:37.722604 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:37.722439    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22f3c7a3-70b0-4b00-b714-c83578911aad-openshift-service-ca\") pod \"maas-api-e2e-mt-a83ed288-7c449dd68d-8cbqk\" (UID: \"22f3c7a3-70b0-4b00-b714-c83578911aad\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a83ed288-7c449dd68d-8cbqk"
Jul 21 01:55:37.723020 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:37.723002    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22f3c7a3-70b0-4b00-b714-c83578911aad-openshift-service-ca\") pod \"maas-api-e2e-mt-a83ed288-7c449dd68d-8cbqk\" (UID: \"22f3c7a3-70b0-4b00-b714-c83578911aad\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a83ed288-7c449dd68d-8cbqk"
Jul 21 01:55:37.724931 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:37.724910    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22f3c7a3-70b0-4b00-b714-c83578911aad-maas-api-tls\") pod \"maas-api-e2e-mt-a83ed288-7c449dd68d-8cbqk\" (UID: \"22f3c7a3-70b0-4b00-b714-c83578911aad\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a83ed288-7c449dd68d-8cbqk"
Jul 21 01:55:37.730824 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:37.730799    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g9mv\" (UniqueName: \"kubernetes.io/projected/22f3c7a3-70b0-4b00-b714-c83578911aad-kube-api-access-6g9mv\") pod \"maas-api-e2e-mt-a83ed288-7c449dd68d-8cbqk\" (UID: \"22f3c7a3-70b0-4b00-b714-c83578911aad\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a83ed288-7c449dd68d-8cbqk"
Jul 21 01:55:37.758926 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:37.758897    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a83ed288-7c449dd68d-8cbqk"
Jul 21 01:55:37.888162 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:37.888135    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a83ed288-7c449dd68d-8cbqk"]
Jul 21 01:55:37.890343 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:55:37.890314    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22f3c7a3_70b0_4b00_b714_c83578911aad.slice/crio-d6ae69b52067b978ca4fca80164fdcfdc07399d8d60f3400ef5bb92f53baa31c WatchSource:0}: Error finding container d6ae69b52067b978ca4fca80164fdcfdc07399d8d60f3400ef5bb92f53baa31c: Status 404 returned error can't find the container with id d6ae69b52067b978ca4fca80164fdcfdc07399d8d60f3400ef5bb92f53baa31c
Jul 21 01:55:38.477697 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:38.477665    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:55:38.540635 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:38.540603    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a83ed288-7c449dd68d-8cbqk" event={"ID":"22f3c7a3-70b0-4b00-b714-c83578911aad","Type":"ContainerStarted","Data":"381d3661a06bb26eca3e994d5420ace2ad9ee5420621ef50056ec00cf18a33e9"}
Jul 21 01:55:38.540803 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:38.540655    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a83ed288-7c449dd68d-8cbqk" event={"ID":"22f3c7a3-70b0-4b00-b714-c83578911aad","Type":"ContainerStarted","Data":"d6ae69b52067b978ca4fca80164fdcfdc07399d8d60f3400ef5bb92f53baa31c"}
Jul 21 01:55:38.540803 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:38.540680    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a83ed288-7c449dd68d-8cbqk"
Jul 21 01:55:38.559319 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:38.559271    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a83ed288-7c449dd68d-8cbqk" podStartSLOduration=1.036610186 podStartE2EDuration="1.559256136s" totalImagesPullingTime="522.64595ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:55:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:55:38.55675188 +0000 UTC m=+2008.287120550" watchObservedRunningTime="2026-07-21 01:55:38.559256136 +0000 UTC m=+2008.289624803"
Jul 21 01:55:41.868702 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:41.868669    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:55:42.531412 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:42.531374    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:55:42.628236 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:42.628176    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:55:43.016842 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:43.016755    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:55:44.551135 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:44.551104    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a83ed288-7c449dd68d-8cbqk"
Jul 21 01:55:48.707471 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:48.707432    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:55:48.767052 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:48.767020    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:55:59.468079 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:59.468044    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a83ed288-7c449dd68d-8cbqk"]
Jul 21 01:55:59.468561 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:59.468334    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a83ed288-7c449dd68d-8cbqk" podUID="22f3c7a3-70b0-4b00-b714-c83578911aad" containerName="maas-api" containerID="cri-o://381d3661a06bb26eca3e994d5420ace2ad9ee5420621ef50056ec00cf18a33e9" gracePeriod=30
Jul 21 01:55:59.498192 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:59.498165    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:55:59.545337 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:59.545305    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a83ed288-7c449dd68d-8cbqk" podUID="22f3c7a3-70b0-4b00-b714-c83578911aad" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.31:8443/health\": dial tcp 10.133.0.31:8443: connect: connection refused"
Jul 21 01:55:59.630276 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:59.630242    2561 generic.go:356] "Generic (PLEG): container finished" podID="22f3c7a3-70b0-4b00-b714-c83578911aad" containerID="381d3661a06bb26eca3e994d5420ace2ad9ee5420621ef50056ec00cf18a33e9" exitCode=0
Jul 21 01:55:59.630440 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:59.630310    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a83ed288-7c449dd68d-8cbqk" event={"ID":"22f3c7a3-70b0-4b00-b714-c83578911aad","Type":"ContainerDied","Data":"381d3661a06bb26eca3e994d5420ace2ad9ee5420621ef50056ec00cf18a33e9"}
Jul 21 01:55:59.707246 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:59.707226    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a83ed288-7c449dd68d-8cbqk"
Jul 21 01:55:59.813076 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:59.813044    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22f3c7a3-70b0-4b00-b714-c83578911aad-openshift-service-ca\") pod \"22f3c7a3-70b0-4b00-b714-c83578911aad\" (UID: \"22f3c7a3-70b0-4b00-b714-c83578911aad\") "
Jul 21 01:55:59.813260 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:59.813103    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22f3c7a3-70b0-4b00-b714-c83578911aad-maas-api-tls\") pod \"22f3c7a3-70b0-4b00-b714-c83578911aad\" (UID: \"22f3c7a3-70b0-4b00-b714-c83578911aad\") "
Jul 21 01:55:59.813260 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:59.813227    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6g9mv\" (UniqueName: \"kubernetes.io/projected/22f3c7a3-70b0-4b00-b714-c83578911aad-kube-api-access-6g9mv\") pod \"22f3c7a3-70b0-4b00-b714-c83578911aad\" (UID: \"22f3c7a3-70b0-4b00-b714-c83578911aad\") "
Jul 21 01:55:59.813451 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:59.813425    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22f3c7a3-70b0-4b00-b714-c83578911aad-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "22f3c7a3-70b0-4b00-b714-c83578911aad" (UID: "22f3c7a3-70b0-4b00-b714-c83578911aad"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:55:59.813521 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:59.813501    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22f3c7a3-70b0-4b00-b714-c83578911aad-openshift-service-ca\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 01:55:59.815321 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:59.815298    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22f3c7a3-70b0-4b00-b714-c83578911aad-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "22f3c7a3-70b0-4b00-b714-c83578911aad" (UID: "22f3c7a3-70b0-4b00-b714-c83578911aad"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:55:59.815398 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:59.815340    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22f3c7a3-70b0-4b00-b714-c83578911aad-kube-api-access-6g9mv" (OuterVolumeSpecName: "kube-api-access-6g9mv") pod "22f3c7a3-70b0-4b00-b714-c83578911aad" (UID: "22f3c7a3-70b0-4b00-b714-c83578911aad"). InnerVolumeSpecName "kube-api-access-6g9mv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:55:59.914701 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:59.914673    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6g9mv\" (UniqueName: \"kubernetes.io/projected/22f3c7a3-70b0-4b00-b714-c83578911aad-kube-api-access-6g9mv\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 01:55:59.914701 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:55:59.914699    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22f3c7a3-70b0-4b00-b714-c83578911aad-maas-api-tls\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 01:56:00.635162 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:00.635125    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a83ed288-7c449dd68d-8cbqk" event={"ID":"22f3c7a3-70b0-4b00-b714-c83578911aad","Type":"ContainerDied","Data":"d6ae69b52067b978ca4fca80164fdcfdc07399d8d60f3400ef5bb92f53baa31c"}
Jul 21 01:56:00.635601 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:00.635191    2561 scope.go:117] "RemoveContainer" containerID="381d3661a06bb26eca3e994d5420ace2ad9ee5420621ef50056ec00cf18a33e9"
Jul 21 01:56:00.635601 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:00.635136    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a83ed288-7c449dd68d-8cbqk"
Jul 21 01:56:00.671901 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:00.671866    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a83ed288-7c449dd68d-8cbqk"]
Jul 21 01:56:00.673712 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:00.673690    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a83ed288-7c449dd68d-8cbqk"]
Jul 21 01:56:00.714489 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:00.714463    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22f3c7a3-70b0-4b00-b714-c83578911aad" path="/var/lib/kubelet/pods/22f3c7a3-70b0-4b00-b714-c83578911aad/volumes"
Jul 21 01:56:04.155069 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:04.155034    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:56:04.659355 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:04.659322    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:56:10.277877 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:10.277842    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:56:10.378032 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:10.377996    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:56:10.547865 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:10.547784    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:56:10.760306 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:10.760275    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:56:10.880628 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:10.880592    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:56:10.980653 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:10.980614    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:56:11.129554 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:11.129472    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:56:16.768016 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:16.767974    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:56:16.869605 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:16.869570    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:56:16.967259 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:16.967225    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:56:17.116733 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:17.116701    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:56:22.765924 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:22.765866    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:56:22.865139 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:22.865096    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:56:29.627312 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:29.627279    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:56:29.931115 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:29.931029    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:56:30.648186 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:30.648149    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:56:32.592902 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:32.592820    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:56:32.692720 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:32.692682    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:56:32.761165 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:32.761127    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-12818e85-9dfc94955-tfw79"]
Jul 21 01:56:32.761525 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:32.761507    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22f3c7a3-70b0-4b00-b714-c83578911aad" containerName="maas-api"
Jul 21 01:56:32.761626 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:32.761527    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="22f3c7a3-70b0-4b00-b714-c83578911aad" containerName="maas-api"
Jul 21 01:56:32.761626 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:32.761606    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="22f3c7a3-70b0-4b00-b714-c83578911aad" containerName="maas-api"
Jul 21 01:56:32.764548 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:32.764528    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12818e85-9dfc94955-tfw79"
Jul 21 01:56:32.767049 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:32.767028    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-12818e85-serving-cert\""
Jul 21 01:56:32.776007 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:32.775970    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-12818e85-9dfc94955-tfw79"]
Jul 21 01:56:32.793046 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:32.793019    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpjtf\" (UniqueName: \"kubernetes.io/projected/94905041-b332-4ec8-bd59-16cde63b4ce2-kube-api-access-tpjtf\") pod \"maas-api-e2e-mt-12818e85-9dfc94955-tfw79\" (UID: \"94905041-b332-4ec8-bd59-16cde63b4ce2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12818e85-9dfc94955-tfw79"
Jul 21 01:56:32.793218 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:32.793059    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94905041-b332-4ec8-bd59-16cde63b4ce2-maas-api-tls\") pod \"maas-api-e2e-mt-12818e85-9dfc94955-tfw79\" (UID: \"94905041-b332-4ec8-bd59-16cde63b4ce2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12818e85-9dfc94955-tfw79"
Jul 21 01:56:32.793218 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:32.793157    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94905041-b332-4ec8-bd59-16cde63b4ce2-openshift-service-ca\") pod \"maas-api-e2e-mt-12818e85-9dfc94955-tfw79\" (UID: \"94905041-b332-4ec8-bd59-16cde63b4ce2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12818e85-9dfc94955-tfw79"
Jul 21 01:56:32.798462 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:32.798441    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:56:32.893846 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:32.893758    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94905041-b332-4ec8-bd59-16cde63b4ce2-openshift-service-ca\") pod \"maas-api-e2e-mt-12818e85-9dfc94955-tfw79\" (UID: \"94905041-b332-4ec8-bd59-16cde63b4ce2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12818e85-9dfc94955-tfw79"
Jul 21 01:56:32.893846 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:32.893807    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpjtf\" (UniqueName: \"kubernetes.io/projected/94905041-b332-4ec8-bd59-16cde63b4ce2-kube-api-access-tpjtf\") pod \"maas-api-e2e-mt-12818e85-9dfc94955-tfw79\" (UID: \"94905041-b332-4ec8-bd59-16cde63b4ce2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12818e85-9dfc94955-tfw79"
Jul 21 01:56:32.893846 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:32.893832    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94905041-b332-4ec8-bd59-16cde63b4ce2-maas-api-tls\") pod \"maas-api-e2e-mt-12818e85-9dfc94955-tfw79\" (UID: \"94905041-b332-4ec8-bd59-16cde63b4ce2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12818e85-9dfc94955-tfw79"
Jul 21 01:56:32.894467 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:32.894448    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94905041-b332-4ec8-bd59-16cde63b4ce2-openshift-service-ca\") pod \"maas-api-e2e-mt-12818e85-9dfc94955-tfw79\" (UID: \"94905041-b332-4ec8-bd59-16cde63b4ce2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12818e85-9dfc94955-tfw79"
Jul 21 01:56:32.896388 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:32.896372    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94905041-b332-4ec8-bd59-16cde63b4ce2-maas-api-tls\") pod \"maas-api-e2e-mt-12818e85-9dfc94955-tfw79\" (UID: \"94905041-b332-4ec8-bd59-16cde63b4ce2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12818e85-9dfc94955-tfw79"
Jul 21 01:56:32.902016 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:32.901991    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpjtf\" (UniqueName: \"kubernetes.io/projected/94905041-b332-4ec8-bd59-16cde63b4ce2-kube-api-access-tpjtf\") pod \"maas-api-e2e-mt-12818e85-9dfc94955-tfw79\" (UID: \"94905041-b332-4ec8-bd59-16cde63b4ce2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12818e85-9dfc94955-tfw79"
Jul 21 01:56:32.923379 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:32.923350    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:56:33.077592 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:33.077557    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12818e85-9dfc94955-tfw79"
Jul 21 01:56:33.214051 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:33.214019    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-12818e85-9dfc94955-tfw79"]
Jul 21 01:56:33.216273 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:56:33.216247    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94905041_b332_4ec8_bd59_16cde63b4ce2.slice/crio-a0b2155286a6679c78f0bea05dca64a3f2a523ef5b49bf8a84340d3ba9b629bf WatchSource:0}: Error finding container a0b2155286a6679c78f0bea05dca64a3f2a523ef5b49bf8a84340d3ba9b629bf: Status 404 returned error can't find the container with id a0b2155286a6679c78f0bea05dca64a3f2a523ef5b49bf8a84340d3ba9b629bf
Jul 21 01:56:33.217515 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:33.217493    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 01:56:33.357236 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:33.357187    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:56:33.449143 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:33.449060    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:56:33.765557 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:33.765477    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12818e85-9dfc94955-tfw79" event={"ID":"94905041-b332-4ec8-bd59-16cde63b4ce2","Type":"ContainerStarted","Data":"8c2a245718ef7ee45d74eafd94b182295edd472b58e61c45bede790b4132d142"}
Jul 21 01:56:33.765557 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:33.765525    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12818e85-9dfc94955-tfw79" event={"ID":"94905041-b332-4ec8-bd59-16cde63b4ce2","Type":"ContainerStarted","Data":"a0b2155286a6679c78f0bea05dca64a3f2a523ef5b49bf8a84340d3ba9b629bf"}
Jul 21 01:56:33.765557 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:33.765555    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12818e85-9dfc94955-tfw79"
Jul 21 01:56:33.786732 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:33.786682    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12818e85-9dfc94955-tfw79" podStartSLOduration=1.429387543 podStartE2EDuration="1.786665994s" totalImagesPullingTime="357.278451ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:56:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:56:33.784895441 +0000 UTC m=+2063.515264111" watchObservedRunningTime="2026-07-21 01:56:33.786665994 +0000 UTC m=+2063.517034706"
Jul 21 01:56:37.075513 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:37.075480    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:56:39.774652 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:39.774621    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12818e85-9dfc94955-tfw79"
Jul 21 01:56:47.524689 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:56:47.524653    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:57:00.626813 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:00.626776    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:57:00.681845 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:00.681819    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:57:10.411885 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:10.411845    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12818e85-k5cw9"]
Jul 21 01:57:10.415079 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:10.415061    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12818e85-k5cw9"
Jul 21 01:57:10.417585 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:10.417569    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8wthr\""
Jul 21 01:57:10.421789 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:10.421742    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12818e85-k5cw9"]
Jul 21 01:57:10.512535 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:10.512489    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/84a8a1d1-64ef-4eb7-b374-1ce44fb1aed9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-12818e85-k5cw9\" (UID: \"84a8a1d1-64ef-4eb7-b374-1ce44fb1aed9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12818e85-k5cw9"
Jul 21 01:57:10.613262 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:10.613191    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/84a8a1d1-64ef-4eb7-b374-1ce44fb1aed9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-12818e85-k5cw9\" (UID: \"84a8a1d1-64ef-4eb7-b374-1ce44fb1aed9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12818e85-k5cw9"
Jul 21 01:57:10.613750 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:10.613729    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/84a8a1d1-64ef-4eb7-b374-1ce44fb1aed9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-12818e85-k5cw9\" (UID: \"84a8a1d1-64ef-4eb7-b374-1ce44fb1aed9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12818e85-k5cw9"
Jul 21 01:57:10.729865 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:10.729779    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8wthr\""
Jul 21 01:57:10.729865 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:10.729845    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2p4wt_1701009a-d778-4d6d-b59f-e91ec4b13a60/ovn-acl-logging/0.log"
Jul 21 01:57:10.737584 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:10.737562    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12818e85-k5cw9"
Jul 21 01:57:10.741711 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:10.741694    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2p4wt_1701009a-d778-4d6d-b59f-e91ec4b13a60/ovn-acl-logging/0.log"
Jul 21 01:57:10.866073 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:10.866049    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12818e85-k5cw9"]
Jul 21 01:57:10.867870 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:57:10.867840    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84a8a1d1_64ef_4eb7_b374_1ce44fb1aed9.slice/crio-cea0802312853c6106d36adc969b46236e93b88f4f4fd51e0002ae45d858f065 WatchSource:0}: Error finding container cea0802312853c6106d36adc969b46236e93b88f4f4fd51e0002ae45d858f065: Status 404 returned error can't find the container with id cea0802312853c6106d36adc969b46236e93b88f4f4fd51e0002ae45d858f065
Jul 21 01:57:10.913463 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:10.913440    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12818e85-k5cw9" event={"ID":"84a8a1d1-64ef-4eb7-b374-1ce44fb1aed9","Type":"ContainerStarted","Data":"cea0802312853c6106d36adc969b46236e93b88f4f4fd51e0002ae45d858f065"}
Jul 21 01:57:11.918719 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:11.918689    2561 generic.go:356] "Generic (PLEG): container finished" podID="84a8a1d1-64ef-4eb7-b374-1ce44fb1aed9" containerID="859a2ca7045406397eb172c2ce98efa96fe6f4289fab3b0bb3d08737a9e9ec85" exitCode=0
Jul 21 01:57:11.919131 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:11.918773    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12818e85-k5cw9" event={"ID":"84a8a1d1-64ef-4eb7-b374-1ce44fb1aed9","Type":"ContainerDied","Data":"859a2ca7045406397eb172c2ce98efa96fe6f4289fab3b0bb3d08737a9e9ec85"}
Jul 21 01:57:13.045058 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:13.045036    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12818e85-k5cw9"
Jul 21 01:57:13.132454 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:13.132418    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/84a8a1d1-64ef-4eb7-b374-1ce44fb1aed9-maas-api-service-ca\") pod \"84a8a1d1-64ef-4eb7-b374-1ce44fb1aed9\" (UID: \"84a8a1d1-64ef-4eb7-b374-1ce44fb1aed9\") "
Jul 21 01:57:13.132760 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:13.132737    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84a8a1d1-64ef-4eb7-b374-1ce44fb1aed9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "84a8a1d1-64ef-4eb7-b374-1ce44fb1aed9" (UID: "84a8a1d1-64ef-4eb7-b374-1ce44fb1aed9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:57:13.233142 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:13.233069    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/84a8a1d1-64ef-4eb7-b374-1ce44fb1aed9-maas-api-service-ca\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 01:57:13.928034 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:13.928001    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12818e85-k5cw9"
Jul 21 01:57:13.928034 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:13.928021    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12818e85-k5cw9" event={"ID":"84a8a1d1-64ef-4eb7-b374-1ce44fb1aed9","Type":"ContainerDied","Data":"cea0802312853c6106d36adc969b46236e93b88f4f4fd51e0002ae45d858f065"}
Jul 21 01:57:13.928286 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:13.928062    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cea0802312853c6106d36adc969b46236e93b88f4f4fd51e0002ae45d858f065"
Jul 21 01:57:25.843406 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:25.843370    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-12818e85-9dfc94955-tfw79"]
Jul 21 01:57:25.843880 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:25.843617    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12818e85-9dfc94955-tfw79" podUID="94905041-b332-4ec8-bd59-16cde63b4ce2" containerName="maas-api" containerID="cri-o://8c2a245718ef7ee45d74eafd94b182295edd472b58e61c45bede790b4132d142" gracePeriod=30
Jul 21 01:57:25.863863 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:25.863837    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:57:25.979899 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:25.979862    2561 generic.go:356] "Generic (PLEG): container finished" podID="94905041-b332-4ec8-bd59-16cde63b4ce2" containerID="8c2a245718ef7ee45d74eafd94b182295edd472b58e61c45bede790b4132d142" exitCode=0
Jul 21 01:57:25.980120 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:25.979939    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12818e85-9dfc94955-tfw79" event={"ID":"94905041-b332-4ec8-bd59-16cde63b4ce2","Type":"ContainerDied","Data":"8c2a245718ef7ee45d74eafd94b182295edd472b58e61c45bede790b4132d142"}
Jul 21 01:57:26.085430 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:26.085403    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12818e85-9dfc94955-tfw79"
Jul 21 01:57:26.248601 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:26.248501    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94905041-b332-4ec8-bd59-16cde63b4ce2-maas-api-tls\") pod \"94905041-b332-4ec8-bd59-16cde63b4ce2\" (UID: \"94905041-b332-4ec8-bd59-16cde63b4ce2\") "
Jul 21 01:57:26.248601 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:26.248551    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tpjtf\" (UniqueName: \"kubernetes.io/projected/94905041-b332-4ec8-bd59-16cde63b4ce2-kube-api-access-tpjtf\") pod \"94905041-b332-4ec8-bd59-16cde63b4ce2\" (UID: \"94905041-b332-4ec8-bd59-16cde63b4ce2\") "
Jul 21 01:57:26.248837 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:26.248612    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94905041-b332-4ec8-bd59-16cde63b4ce2-openshift-service-ca\") pod \"94905041-b332-4ec8-bd59-16cde63b4ce2\" (UID: \"94905041-b332-4ec8-bd59-16cde63b4ce2\") "
Jul 21 01:57:26.249024 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:26.248999    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94905041-b332-4ec8-bd59-16cde63b4ce2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "94905041-b332-4ec8-bd59-16cde63b4ce2" (UID: "94905041-b332-4ec8-bd59-16cde63b4ce2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:57:26.250838 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:26.250812    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94905041-b332-4ec8-bd59-16cde63b4ce2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "94905041-b332-4ec8-bd59-16cde63b4ce2" (UID: "94905041-b332-4ec8-bd59-16cde63b4ce2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:57:26.250954 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:26.250872    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94905041-b332-4ec8-bd59-16cde63b4ce2-kube-api-access-tpjtf" (OuterVolumeSpecName: "kube-api-access-tpjtf") pod "94905041-b332-4ec8-bd59-16cde63b4ce2" (UID: "94905041-b332-4ec8-bd59-16cde63b4ce2"). InnerVolumeSpecName "kube-api-access-tpjtf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:57:26.349451 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:26.349409    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94905041-b332-4ec8-bd59-16cde63b4ce2-openshift-service-ca\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 01:57:26.349451 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:26.349441    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94905041-b332-4ec8-bd59-16cde63b4ce2-maas-api-tls\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 01:57:26.349451 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:26.349450    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tpjtf\" (UniqueName: \"kubernetes.io/projected/94905041-b332-4ec8-bd59-16cde63b4ce2-kube-api-access-tpjtf\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 01:57:26.990625 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:26.990539    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12818e85-9dfc94955-tfw79" event={"ID":"94905041-b332-4ec8-bd59-16cde63b4ce2","Type":"ContainerDied","Data":"a0b2155286a6679c78f0bea05dca64a3f2a523ef5b49bf8a84340d3ba9b629bf"}
Jul 21 01:57:26.990625 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:26.990572    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12818e85-9dfc94955-tfw79"
Jul 21 01:57:26.990625 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:26.990619    2561 scope.go:117] "RemoveContainer" containerID="8c2a245718ef7ee45d74eafd94b182295edd472b58e61c45bede790b4132d142"
Jul 21 01:57:27.007791 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:27.007768    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-12818e85-9dfc94955-tfw79"]
Jul 21 01:57:27.017690 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:27.017668    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-12818e85-9dfc94955-tfw79"]
Jul 21 01:57:28.715257 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:28.715191    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94905041-b332-4ec8-bd59-16cde63b4ce2" path="/var/lib/kubelet/pods/94905041-b332-4ec8-bd59-16cde63b4ce2/volumes"
Jul 21 01:57:30.485910 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:30.485833    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12818e85-k5cw9"]
Jul 21 01:57:30.486515 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:30.486104    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:57:30.487693 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:30.487672    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12818e85-k5cw9"]
Jul 21 01:57:30.714482 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:30.714453    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84a8a1d1-64ef-4eb7-b374-1ce44fb1aed9" path="/var/lib/kubelet/pods/84a8a1d1-64ef-4eb7-b374-1ce44fb1aed9/volumes"
Jul 21 01:57:32.734383 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:32.734341    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:57:37.761512 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:37.761483    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:57:44.882075 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:44.882038    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:57:46.860995 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:57:46.860963    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:58:14.556737 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:58:14.556696    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:58:15.048033 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:58:15.047999    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:58:20.532215 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:58:20.532172    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:58:26.067137 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:58:26.067092    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:58:26.132514 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:58:26.132479    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:58:26.334572 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:58:26.334472    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:58:26.566711 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:58:26.566680    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:58:27.617607 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:58:27.617564    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:58:27.709153 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:58:27.709122    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:58:27.809020 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:58:27.808988    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:58:28.569954 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:58:28.569924    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:58:28.667793 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:58:28.667753    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:58:28.770971 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:58:28.770939    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:58:30.142414 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:58:30.142380    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:58:31.127890 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:58:31.127847    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:58:31.228977 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:58:31.228944    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:58:36.257833 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:58:36.257799    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:58:36.313886 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:58:36.313850    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:58:36.955916 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:58:36.955887    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:58:43.310804 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:58:43.310775    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:58:43.415838 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:58:43.415805    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:58:43.511847 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:58:43.511817    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:58:54.071992 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:58:54.071959    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:58:54.420767 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:58:54.420670    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:59:15.435093 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:15.435058    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:59:21.756838 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:21.756808    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:59:21.858304 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:21.858271    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:59:22.163181 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:22.163148    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:59:22.496683 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:22.496593    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:59:22.626541 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:22.626511    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:59:25.698316 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:25.698267    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:59:25.777137 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:25.777101    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:59:25.781109 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:25.781084    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-811ee7-7c98d5586d-gtw62"]
Jul 21 01:59:25.781396 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:25.781382    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94905041-b332-4ec8-bd59-16cde63b4ce2" containerName="maas-api"
Jul 21 01:59:25.781396 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:25.781397    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="94905041-b332-4ec8-bd59-16cde63b4ce2" containerName="maas-api"
Jul 21 01:59:25.781534 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:25.781408    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84a8a1d1-64ef-4eb7-b374-1ce44fb1aed9" containerName="revoke-keys"
Jul 21 01:59:25.781534 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:25.781415    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="84a8a1d1-64ef-4eb7-b374-1ce44fb1aed9" containerName="revoke-keys"
Jul 21 01:59:25.781534 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:25.781480    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="84a8a1d1-64ef-4eb7-b374-1ce44fb1aed9" containerName="revoke-keys"
Jul 21 01:59:25.781534 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:25.781488    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="94905041-b332-4ec8-bd59-16cde63b4ce2" containerName="maas-api"
Jul 21 01:59:25.784513 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:25.784495    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-811ee7-7c98d5586d-gtw62"
Jul 21 01:59:25.787507 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:25.787488    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-811ee7-serving-cert\""
Jul 21 01:59:25.796326 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:25.796305    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-811ee7-7c98d5586d-gtw62"]
Jul 21 01:59:25.847255 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:25.847215    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:59:25.928532 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:25.928498    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xfnh\" (UniqueName: \"kubernetes.io/projected/593ac3fc-9f6b-427f-9d7c-b2a811bc79b6-kube-api-access-7xfnh\") pod \"maas-api-e2e-inf-a-811ee7-7c98d5586d-gtw62\" (UID: \"593ac3fc-9f6b-427f-9d7c-b2a811bc79b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-811ee7-7c98d5586d-gtw62"
Jul 21 01:59:25.928690 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:25.928541    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/593ac3fc-9f6b-427f-9d7c-b2a811bc79b6-maas-api-tls\") pod \"maas-api-e2e-inf-a-811ee7-7c98d5586d-gtw62\" (UID: \"593ac3fc-9f6b-427f-9d7c-b2a811bc79b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-811ee7-7c98d5586d-gtw62"
Jul 21 01:59:25.928690 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:25.928636    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/593ac3fc-9f6b-427f-9d7c-b2a811bc79b6-openshift-service-ca\") pod \"maas-api-e2e-inf-a-811ee7-7c98d5586d-gtw62\" (UID: \"593ac3fc-9f6b-427f-9d7c-b2a811bc79b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-811ee7-7c98d5586d-gtw62"
Jul 21 01:59:25.947373 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:25.947350    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:59:26.029218 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:26.029176    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xfnh\" (UniqueName: \"kubernetes.io/projected/593ac3fc-9f6b-427f-9d7c-b2a811bc79b6-kube-api-access-7xfnh\") pod \"maas-api-e2e-inf-a-811ee7-7c98d5586d-gtw62\" (UID: \"593ac3fc-9f6b-427f-9d7c-b2a811bc79b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-811ee7-7c98d5586d-gtw62"
Jul 21 01:59:26.029372 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:26.029258    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/593ac3fc-9f6b-427f-9d7c-b2a811bc79b6-maas-api-tls\") pod \"maas-api-e2e-inf-a-811ee7-7c98d5586d-gtw62\" (UID: \"593ac3fc-9f6b-427f-9d7c-b2a811bc79b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-811ee7-7c98d5586d-gtw62"
Jul 21 01:59:26.029372 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:26.029304    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/593ac3fc-9f6b-427f-9d7c-b2a811bc79b6-openshift-service-ca\") pod \"maas-api-e2e-inf-a-811ee7-7c98d5586d-gtw62\" (UID: \"593ac3fc-9f6b-427f-9d7c-b2a811bc79b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-811ee7-7c98d5586d-gtw62"
Jul 21 01:59:26.029864 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:26.029848    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/593ac3fc-9f6b-427f-9d7c-b2a811bc79b6-openshift-service-ca\") pod \"maas-api-e2e-inf-a-811ee7-7c98d5586d-gtw62\" (UID: \"593ac3fc-9f6b-427f-9d7c-b2a811bc79b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-811ee7-7c98d5586d-gtw62"
Jul 21 01:59:26.031934 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:26.031914    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/593ac3fc-9f6b-427f-9d7c-b2a811bc79b6-maas-api-tls\") pod \"maas-api-e2e-inf-a-811ee7-7c98d5586d-gtw62\" (UID: \"593ac3fc-9f6b-427f-9d7c-b2a811bc79b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-811ee7-7c98d5586d-gtw62"
Jul 21 01:59:26.038429 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:26.038397    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xfnh\" (UniqueName: \"kubernetes.io/projected/593ac3fc-9f6b-427f-9d7c-b2a811bc79b6-kube-api-access-7xfnh\") pod \"maas-api-e2e-inf-a-811ee7-7c98d5586d-gtw62\" (UID: \"593ac3fc-9f6b-427f-9d7c-b2a811bc79b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-811ee7-7c98d5586d-gtw62"
Jul 21 01:59:26.095040 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:26.095015    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-811ee7-7c98d5586d-gtw62"
Jul 21 01:59:26.225780 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:26.225756    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-811ee7-7c98d5586d-gtw62"]
Jul 21 01:59:26.228308 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:59:26.228282    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod593ac3fc_9f6b_427f_9d7c_b2a811bc79b6.slice/crio-f12aedfdf000279ed7476756e0a6a923db9d62adaa9a0131eaf0abf9f7a09361 WatchSource:0}: Error finding container f12aedfdf000279ed7476756e0a6a923db9d62adaa9a0131eaf0abf9f7a09361: Status 404 returned error can't find the container with id f12aedfdf000279ed7476756e0a6a923db9d62adaa9a0131eaf0abf9f7a09361
Jul 21 01:59:26.355181 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:26.355092    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:59:26.459324 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:26.459288    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:59:26.465379 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:26.465354    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-811ee7-7c98d5586d-gtw62" event={"ID":"593ac3fc-9f6b-427f-9d7c-b2a811bc79b6","Type":"ContainerStarted","Data":"f12aedfdf000279ed7476756e0a6a923db9d62adaa9a0131eaf0abf9f7a09361"}
Jul 21 01:59:27.471317 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:27.471286    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-811ee7-7c98d5586d-gtw62" event={"ID":"593ac3fc-9f6b-427f-9d7c-b2a811bc79b6","Type":"ContainerStarted","Data":"1038c5b35de30dfea97499d4690516ea4a5d77e0eb94f60fc37479ae79055130"}
Jul 21 01:59:27.471729 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:27.471395    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-811ee7-7c98d5586d-gtw62"
Jul 21 01:59:27.489073 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:27.489018    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-811ee7-7c98d5586d-gtw62" podStartSLOduration=2.07773792 podStartE2EDuration="2.489002812s" totalImagesPullingTime="411.264892ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:59:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:59:27.487814167 +0000 UTC m=+2237.218182836" watchObservedRunningTime="2026-07-21 01:59:27.489002812 +0000 UTC m=+2237.219371482"
Jul 21 01:59:30.265092 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:30.265055    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:59:30.635180 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:30.635149    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:59:30.985303 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:30.985219    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:59:31.700633 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:31.700539    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:59:33.480660 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:33.480630    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-811ee7-7c98d5586d-gtw62"
Jul 21 01:59:33.848651 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:33.848620    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:59:33.934213 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:33.934165    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f35db9-c949bc69-gljvt"]
Jul 21 01:59:33.937578 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:33.937554    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f35db9-c949bc69-gljvt"
Jul 21 01:59:33.941470 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:33.941446    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-f35db9-serving-cert\""
Jul 21 01:59:33.951159 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:33.951134    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f35db9-c949bc69-gljvt"]
Jul 21 01:59:33.966007 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:33.965985    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:59:33.997236 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:33.997182    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6c94\" (UniqueName: \"kubernetes.io/projected/525dee99-96b3-4e82-a4e8-d23c6ce46864-kube-api-access-j6c94\") pod \"maas-api-e2e-inf-b-f35db9-c949bc69-gljvt\" (UID: \"525dee99-96b3-4e82-a4e8-d23c6ce46864\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f35db9-c949bc69-gljvt"
Jul 21 01:59:33.997347 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:33.997251    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/525dee99-96b3-4e82-a4e8-d23c6ce46864-maas-api-tls\") pod \"maas-api-e2e-inf-b-f35db9-c949bc69-gljvt\" (UID: \"525dee99-96b3-4e82-a4e8-d23c6ce46864\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f35db9-c949bc69-gljvt"
Jul 21 01:59:33.997393 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:33.997351    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/525dee99-96b3-4e82-a4e8-d23c6ce46864-openshift-service-ca\") pod \"maas-api-e2e-inf-b-f35db9-c949bc69-gljvt\" (UID: \"525dee99-96b3-4e82-a4e8-d23c6ce46864\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f35db9-c949bc69-gljvt"
Jul 21 01:59:34.041289 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:34.041253    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:59:34.098383 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:34.098352    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/525dee99-96b3-4e82-a4e8-d23c6ce46864-maas-api-tls\") pod \"maas-api-e2e-inf-b-f35db9-c949bc69-gljvt\" (UID: \"525dee99-96b3-4e82-a4e8-d23c6ce46864\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f35db9-c949bc69-gljvt"
Jul 21 01:59:34.098550 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:34.098412    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/525dee99-96b3-4e82-a4e8-d23c6ce46864-openshift-service-ca\") pod \"maas-api-e2e-inf-b-f35db9-c949bc69-gljvt\" (UID: \"525dee99-96b3-4e82-a4e8-d23c6ce46864\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f35db9-c949bc69-gljvt"
Jul 21 01:59:34.098550 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:34.098468    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6c94\" (UniqueName: \"kubernetes.io/projected/525dee99-96b3-4e82-a4e8-d23c6ce46864-kube-api-access-j6c94\") pod \"maas-api-e2e-inf-b-f35db9-c949bc69-gljvt\" (UID: \"525dee99-96b3-4e82-a4e8-d23c6ce46864\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f35db9-c949bc69-gljvt"
Jul 21 01:59:34.098550 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:59:34.098531    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-f35db9-serving-cert: secret "maas-api-e2e-inf-b-f35db9-serving-cert" not found
Jul 21 01:59:34.098792 ip-10-0-128-147 kubenswrapper[2561]: E0721 01:59:34.098610    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/525dee99-96b3-4e82-a4e8-d23c6ce46864-maas-api-tls podName:525dee99-96b3-4e82-a4e8-d23c6ce46864 nodeName:}" failed. No retries permitted until 2026-07-21 01:59:34.59858807 +0000 UTC m=+2244.328956737 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/525dee99-96b3-4e82-a4e8-d23c6ce46864-maas-api-tls") pod "maas-api-e2e-inf-b-f35db9-c949bc69-gljvt" (UID: "525dee99-96b3-4e82-a4e8-d23c6ce46864") : secret "maas-api-e2e-inf-b-f35db9-serving-cert" not found
Jul 21 01:59:34.099086 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:34.099065    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/525dee99-96b3-4e82-a4e8-d23c6ce46864-openshift-service-ca\") pod \"maas-api-e2e-inf-b-f35db9-c949bc69-gljvt\" (UID: \"525dee99-96b3-4e82-a4e8-d23c6ce46864\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f35db9-c949bc69-gljvt"
Jul 21 01:59:34.107927 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:34.107898    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6c94\" (UniqueName: \"kubernetes.io/projected/525dee99-96b3-4e82-a4e8-d23c6ce46864-kube-api-access-j6c94\") pod \"maas-api-e2e-inf-b-f35db9-c949bc69-gljvt\" (UID: \"525dee99-96b3-4e82-a4e8-d23c6ce46864\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f35db9-c949bc69-gljvt"
Jul 21 01:59:34.476420 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:34.476318    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:59:34.601782 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:34.601746    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/525dee99-96b3-4e82-a4e8-d23c6ce46864-maas-api-tls\") pod \"maas-api-e2e-inf-b-f35db9-c949bc69-gljvt\" (UID: \"525dee99-96b3-4e82-a4e8-d23c6ce46864\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f35db9-c949bc69-gljvt"
Jul 21 01:59:34.604314 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:34.604294    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/525dee99-96b3-4e82-a4e8-d23c6ce46864-maas-api-tls\") pod \"maas-api-e2e-inf-b-f35db9-c949bc69-gljvt\" (UID: \"525dee99-96b3-4e82-a4e8-d23c6ce46864\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f35db9-c949bc69-gljvt"
Jul 21 01:59:34.614167 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:34.614141    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:59:34.719257 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:34.719177    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:59:34.847863 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:34.847834    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f35db9-c949bc69-gljvt"
Jul 21 01:59:34.986110 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:34.986088    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f35db9-c949bc69-gljvt"]
Jul 21 01:59:34.988037 ip-10-0-128-147 kubenswrapper[2561]: W0721 01:59:34.988003    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod525dee99_96b3_4e82_a4e8_d23c6ce46864.slice/crio-49a699797087c73a4089280ea6356646acc80f84d15b77ba1de47be22d1540e6 WatchSource:0}: Error finding container 49a699797087c73a4089280ea6356646acc80f84d15b77ba1de47be22d1540e6: Status 404 returned error can't find the container with id 49a699797087c73a4089280ea6356646acc80f84d15b77ba1de47be22d1540e6
Jul 21 01:59:35.506000 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:35.505970    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f35db9-c949bc69-gljvt" event={"ID":"525dee99-96b3-4e82-a4e8-d23c6ce46864","Type":"ContainerStarted","Data":"49a699797087c73a4089280ea6356646acc80f84d15b77ba1de47be22d1540e6"}
Jul 21 01:59:36.512210 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:36.512175    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f35db9-c949bc69-gljvt" event={"ID":"525dee99-96b3-4e82-a4e8-d23c6ce46864","Type":"ContainerStarted","Data":"ea77cc5985c17742b64682f4707e7858799bf4a32db5d72d6203fbe6770de6c2"}
Jul 21 01:59:36.512694 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:36.512305    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f35db9-c949bc69-gljvt"
Jul 21 01:59:36.528974 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:36.528926    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f35db9-c949bc69-gljvt" podStartSLOduration=3.073642387 podStartE2EDuration="3.528911049s" totalImagesPullingTime="455.268662ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:59:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:59:36.528093065 +0000 UTC m=+2246.258461735" watchObservedRunningTime="2026-07-21 01:59:36.528911049 +0000 UTC m=+2246.259279719"
Jul 21 01:59:38.392046 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:38.391993    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:59:42.522398 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:42.522363    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f35db9-c949bc69-gljvt"
Jul 21 01:59:47.123389 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:47.123348    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:59:47.223265 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:47.223216    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:59:55.345129 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:55.345092    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:59:55.452435 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:55.452398    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 01:59:57.203005 ip-10-0-128-147 kubenswrapper[2561]: I0721 01:59:57.202963    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:00:00.135613 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:00:00.135579    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-811ee7-29743320-76s65"]
Jul 21 02:00:00.138860 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:00:00.138843    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f35db9-29743320-2q2jw"]
Jul 21 02:00:00.138976 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:00:00.138957    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-811ee7-29743320-76s65"
Jul 21 02:00:00.141516 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:00:00.141497    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8wthr\""
Jul 21 02:00:00.141712 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:00:00.141699    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743320-cgnnv"]
Jul 21 02:00:00.141815 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:00:00.141803    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f35db9-29743320-2q2jw"
Jul 21 02:00:00.144666 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:00:00.144646    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743320-cgnnv"
Jul 21 02:00:00.146649 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:00:00.146047    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-811ee7-29743320-76s65"]
Jul 21 02:00:00.149218 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:00:00.149183    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f35db9-29743320-2q2jw"]
Jul 21 02:00:00.151089 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:00:00.151069    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-811ee7-29743320-76s65"
Jul 21 02:00:00.160897 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:00:00.160876    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743320-cgnnv"]
Jul 21 02:00:00.161791 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:00:00.161771    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f35db9-29743320-2q2jw"
Jul 21 02:00:00.191763 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:00:00.191740    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743320-cgnnv"
Jul 21 02:00:00.317949 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:00:00.317921    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-811ee7-29743320-76s65"]
Jul 21 02:00:00.320167 ip-10-0-128-147 kubenswrapper[2561]: W0721 02:00:00.320113    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9163f573_84ae_47e1_a4b4_c5df20bfb5f9.slice/crio-cc0ba1484c1fd4c60bc63cc7ff2895b808d4adb424a6fd7e078dee4ca1917f0a WatchSource:0}: Error finding container cc0ba1484c1fd4c60bc63cc7ff2895b808d4adb424a6fd7e078dee4ca1917f0a: Status 404 returned error can't find the container with id cc0ba1484c1fd4c60bc63cc7ff2895b808d4adb424a6fd7e078dee4ca1917f0a
Jul 21 02:00:00.333569 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:00:00.333031    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f35db9-29743320-2q2jw"]
Jul 21 02:00:00.337899 ip-10-0-128-147 kubenswrapper[2561]: W0721 02:00:00.337857    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadc448a8_8be8_40b4_9903_eacf7e7efca2.slice/crio-e9faf2482384503a43bd49d4b60365b0d6e2f97f248d84c58ae563b8c435442a WatchSource:0}: Error finding container e9faf2482384503a43bd49d4b60365b0d6e2f97f248d84c58ae563b8c435442a: Status 404 returned error can't find the container with id e9faf2482384503a43bd49d4b60365b0d6e2f97f248d84c58ae563b8c435442a
Jul 21 02:00:00.360456 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:00:00.360437    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743320-cgnnv"]
Jul 21 02:00:00.362309 ip-10-0-128-147 kubenswrapper[2561]: W0721 02:00:00.362290    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda44432c8_367e_466e_ad8a_9768a5114d9e.slice/crio-84ec078f0eddba99ed59ce1736662545b94e4d5954636b6b94f5c573a458389e WatchSource:0}: Error finding container 84ec078f0eddba99ed59ce1736662545b94e4d5954636b6b94f5c573a458389e: Status 404 returned error can't find the container with id 84ec078f0eddba99ed59ce1736662545b94e4d5954636b6b94f5c573a458389e
Jul 21 02:00:00.615661 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:00:00.615619    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f35db9-29743320-2q2jw" event={"ID":"adc448a8-8be8-40b4-9903-eacf7e7efca2","Type":"ContainerStarted","Data":"e9faf2482384503a43bd49d4b60365b0d6e2f97f248d84c58ae563b8c435442a"}
Jul 21 02:00:00.617127 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:00:00.617054    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743320-cgnnv" event={"ID":"a44432c8-367e-466e-ad8a-9768a5114d9e","Type":"ContainerStarted","Data":"84ec078f0eddba99ed59ce1736662545b94e4d5954636b6b94f5c573a458389e"}
Jul 21 02:00:00.618380 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:00:00.618354    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-811ee7-29743320-76s65" event={"ID":"9163f573-84ae-47e1-a4b4-c5df20bfb5f9","Type":"ContainerStarted","Data":"cc0ba1484c1fd4c60bc63cc7ff2895b808d4adb424a6fd7e078dee4ca1917f0a"}
Jul 21 02:00:01.623816 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:00:01.623785    2561 generic.go:356] "Generic (PLEG): container finished" podID="adc448a8-8be8-40b4-9903-eacf7e7efca2" containerID="f264b8b3ccac4805ad22a74933c2ca96efbda3c0f23029559ff0b4752760c20a" exitCode=0
Jul 21 02:00:01.624254 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:00:01.623872    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f35db9-29743320-2q2jw" event={"ID":"adc448a8-8be8-40b4-9903-eacf7e7efca2","Type":"ContainerDied","Data":"f264b8b3ccac4805ad22a74933c2ca96efbda3c0f23029559ff0b4752760c20a"}
Jul 21 02:00:01.625368 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:00:01.625344    2561 generic.go:356] "Generic (PLEG): container finished" podID="a44432c8-367e-466e-ad8a-9768a5114d9e" containerID="71ac0dec85d59a117f3d3bd43047b629445dc0de325cf3eef652bb6ce475f3fa" exitCode=0
Jul 21 02:00:01.625512 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:00:01.625428    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743320-cgnnv" event={"ID":"a44432c8-367e-466e-ad8a-9768a5114d9e","Type":"ContainerDied","Data":"71ac0dec85d59a117f3d3bd43047b629445dc0de325cf3eef652bb6ce475f3fa"}
Jul 21 02:00:01.626808 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:00:01.626785    2561 generic.go:356] "Generic (PLEG): container finished" podID="9163f573-84ae-47e1-a4b4-c5df20bfb5f9" containerID="81af54be47cd8a640900ebc82c16b7eba2af1612f31e6fb56dc1fbe15e5463c8" exitCode=0
Jul 21 02:00:01.626911 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:00:01.626820    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-811ee7-29743320-76s65" event={"ID":"9163f573-84ae-47e1-a4b4-c5df20bfb5f9","Type":"ContainerDied","Data":"81af54be47cd8a640900ebc82c16b7eba2af1612f31e6fb56dc1fbe15e5463c8"}
Jul 21 02:00:02.773885 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:00:02.773858    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-811ee7-29743320-76s65"
Jul 21 02:00:02.821273 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:00:02.821242    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743320-cgnnv"
Jul 21 02:00:02.823846 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:00:02.823826    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f35db9-29743320-2q2jw"
Jul 21 02:00:03.636785 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:00:03.636758    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f35db9-29743320-2q2jw"
Jul 21 02:00:03.636785 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:00:03.636765    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f35db9-29743320-2q2jw" event={"ID":"adc448a8-8be8-40b4-9903-eacf7e7efca2","Type":"ContainerDied","Data":"e9faf2482384503a43bd49d4b60365b0d6e2f97f248d84c58ae563b8c435442a"}
Jul 21 02:00:03.637039 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:00:03.636843    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e9faf2482384503a43bd49d4b60365b0d6e2f97f248d84c58ae563b8c435442a"
Jul 21 02:00:03.638016 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:00:03.637988    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743320-cgnnv"
Jul 21 02:00:03.638136 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:00:03.638043    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743320-cgnnv" event={"ID":"a44432c8-367e-466e-ad8a-9768a5114d9e","Type":"ContainerDied","Data":"84ec078f0eddba99ed59ce1736662545b94e4d5954636b6b94f5c573a458389e"}
Jul 21 02:00:03.638136 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:00:03.638094    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="84ec078f0eddba99ed59ce1736662545b94e4d5954636b6b94f5c573a458389e"
Jul 21 02:00:03.639360 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:00:03.639330    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-811ee7-29743320-76s65" event={"ID":"9163f573-84ae-47e1-a4b4-c5df20bfb5f9","Type":"ContainerDied","Data":"cc0ba1484c1fd4c60bc63cc7ff2895b808d4adb424a6fd7e078dee4ca1917f0a"}
Jul 21 02:00:03.639482 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:00:03.639360    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-811ee7-29743320-76s65"
Jul 21 02:00:03.639482 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:00:03.639372    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cc0ba1484c1fd4c60bc63cc7ff2895b808d4adb424a6fd7e078dee4ca1917f0a"
Jul 21 02:00:25.328388 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:00:25.328359    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:01:08.766253 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:08.766221    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:01:09.804152 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:09.804122    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-811ee7-fwnfk"]
Jul 21 02:01:09.804576 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:09.804439    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9163f573-84ae-47e1-a4b4-c5df20bfb5f9" containerName="cleanup"
Jul 21 02:01:09.804576 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:09.804450    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9163f573-84ae-47e1-a4b4-c5df20bfb5f9" containerName="cleanup"
Jul 21 02:01:09.804576 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:09.804461    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a44432c8-367e-466e-ad8a-9768a5114d9e" containerName="cleanup"
Jul 21 02:01:09.804576 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:09.804466    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a44432c8-367e-466e-ad8a-9768a5114d9e" containerName="cleanup"
Jul 21 02:01:09.804576 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:09.804474    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adc448a8-8be8-40b4-9903-eacf7e7efca2" containerName="cleanup"
Jul 21 02:01:09.804576 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:09.804480    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="adc448a8-8be8-40b4-9903-eacf7e7efca2" containerName="cleanup"
Jul 21 02:01:09.804576 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:09.804530    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a44432c8-367e-466e-ad8a-9768a5114d9e" containerName="cleanup"
Jul 21 02:01:09.804576 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:09.804538    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="adc448a8-8be8-40b4-9903-eacf7e7efca2" containerName="cleanup"
Jul 21 02:01:09.804576 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:09.804544    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9163f573-84ae-47e1-a4b4-c5df20bfb5f9" containerName="cleanup"
Jul 21 02:01:09.807600 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:09.807583    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-811ee7-fwnfk"
Jul 21 02:01:09.810060 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:09.810039    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8wthr\""
Jul 21 02:01:09.816364 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:09.816160    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-811ee7-fwnfk"]
Jul 21 02:01:09.924189 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:09.924157    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f218aa1-5ab1-4e68-962f-be2482cd1d1a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-811ee7-fwnfk\" (UID: \"0f218aa1-5ab1-4e68-962f-be2482cd1d1a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-811ee7-fwnfk"
Jul 21 02:01:10.024681 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:10.024637    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f218aa1-5ab1-4e68-962f-be2482cd1d1a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-811ee7-fwnfk\" (UID: \"0f218aa1-5ab1-4e68-962f-be2482cd1d1a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-811ee7-fwnfk"
Jul 21 02:01:10.025292 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:10.025272    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f218aa1-5ab1-4e68-962f-be2482cd1d1a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-811ee7-fwnfk\" (UID: \"0f218aa1-5ab1-4e68-962f-be2482cd1d1a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-811ee7-fwnfk"
Jul 21 02:01:10.118640 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:10.118555    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-811ee7-fwnfk"
Jul 21 02:01:10.124933 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:10.124904    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:01:10.249331 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:10.249305    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-811ee7-fwnfk"]
Jul 21 02:01:10.251153 ip-10-0-128-147 kubenswrapper[2561]: W0721 02:01:10.251125    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f218aa1_5ab1_4e68_962f_be2482cd1d1a.slice/crio-d03fdb57a2873576f4761ef500bd75d08b70a405551e2b80c11c8d4a5141322a WatchSource:0}: Error finding container d03fdb57a2873576f4761ef500bd75d08b70a405551e2b80c11c8d4a5141322a: Status 404 returned error can't find the container with id d03fdb57a2873576f4761ef500bd75d08b70a405551e2b80c11c8d4a5141322a
Jul 21 02:01:10.474953 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:10.474919    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:01:10.578952 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:10.578921    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:01:10.925501 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:10.925462    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-811ee7-fwnfk" event={"ID":"0f218aa1-5ab1-4e68-962f-be2482cd1d1a","Type":"ContainerStarted","Data":"c271e9c2fb4831f74d9111fddec53c1540abf48ca8fb78c077253115cf773acf"}
Jul 21 02:01:10.925882 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:10.925513    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-811ee7-fwnfk" event={"ID":"0f218aa1-5ab1-4e68-962f-be2482cd1d1a","Type":"ContainerStarted","Data":"d03fdb57a2873576f4761ef500bd75d08b70a405551e2b80c11c8d4a5141322a"}
Jul 21 02:01:10.942220 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:10.942152    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-811ee7-fwnfk" podStartSLOduration=1.942134816 podStartE2EDuration="1.942134816s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:01:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:01:10.941340251 +0000 UTC m=+2340.671708922" watchObservedRunningTime="2026-07-21 02:01:10.942134816 +0000 UTC m=+2340.672503485"
Jul 21 02:01:11.931650 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:11.931612    2561 generic.go:356] "Generic (PLEG): container finished" podID="0f218aa1-5ab1-4e68-962f-be2482cd1d1a" containerID="c271e9c2fb4831f74d9111fddec53c1540abf48ca8fb78c077253115cf773acf" exitCode=0
Jul 21 02:01:11.932045 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:11.931659    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-811ee7-fwnfk" event={"ID":"0f218aa1-5ab1-4e68-962f-be2482cd1d1a","Type":"ContainerDied","Data":"c271e9c2fb4831f74d9111fddec53c1540abf48ca8fb78c077253115cf773acf"}
Jul 21 02:01:13.062863 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:13.062830    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-811ee7-fwnfk"
Jul 21 02:01:13.149900 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:13.149867    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f218aa1-5ab1-4e68-962f-be2482cd1d1a-maas-api-service-ca\") pod \"0f218aa1-5ab1-4e68-962f-be2482cd1d1a\" (UID: \"0f218aa1-5ab1-4e68-962f-be2482cd1d1a\") "
Jul 21 02:01:13.150281 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:13.150262    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f218aa1-5ab1-4e68-962f-be2482cd1d1a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0f218aa1-5ab1-4e68-962f-be2482cd1d1a" (UID: "0f218aa1-5ab1-4e68-962f-be2482cd1d1a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 02:01:13.253303 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:13.251988    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f218aa1-5ab1-4e68-962f-be2482cd1d1a-maas-api-service-ca\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 02:01:13.941511 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:13.941473    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-811ee7-fwnfk"
Jul 21 02:01:13.941511 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:13.941496    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-811ee7-fwnfk" event={"ID":"0f218aa1-5ab1-4e68-962f-be2482cd1d1a","Type":"ContainerDied","Data":"d03fdb57a2873576f4761ef500bd75d08b70a405551e2b80c11c8d4a5141322a"}
Jul 21 02:01:13.941729 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:13.941543    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d03fdb57a2873576f4761ef500bd75d08b70a405551e2b80c11c8d4a5141322a"
Jul 21 02:01:20.232553 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:20.232515    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-811ee7-7c98d5586d-gtw62"]
Jul 21 02:01:20.233021 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:20.232754    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-811ee7-7c98d5586d-gtw62" podUID="593ac3fc-9f6b-427f-9d7c-b2a811bc79b6" containerName="maas-api" containerID="cri-o://1038c5b35de30dfea97499d4690516ea4a5d77e0eb94f60fc37479ae79055130" gracePeriod=30
Jul 21 02:01:20.243245 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:20.243218    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-811ee7-29743320-76s65"]
Jul 21 02:01:20.249829 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:20.249804    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-811ee7-29743320-76s65"]
Jul 21 02:01:20.252329 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:20.252307    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:01:20.476154 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:20.476131    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-811ee7-7c98d5586d-gtw62"
Jul 21 02:01:20.621947 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:20.621912    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xfnh\" (UniqueName: \"kubernetes.io/projected/593ac3fc-9f6b-427f-9d7c-b2a811bc79b6-kube-api-access-7xfnh\") pod \"593ac3fc-9f6b-427f-9d7c-b2a811bc79b6\" (UID: \"593ac3fc-9f6b-427f-9d7c-b2a811bc79b6\") "
Jul 21 02:01:20.622149 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:20.621983    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/593ac3fc-9f6b-427f-9d7c-b2a811bc79b6-openshift-service-ca\") pod \"593ac3fc-9f6b-427f-9d7c-b2a811bc79b6\" (UID: \"593ac3fc-9f6b-427f-9d7c-b2a811bc79b6\") "
Jul 21 02:01:20.622149 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:20.622005    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/593ac3fc-9f6b-427f-9d7c-b2a811bc79b6-maas-api-tls\") pod \"593ac3fc-9f6b-427f-9d7c-b2a811bc79b6\" (UID: \"593ac3fc-9f6b-427f-9d7c-b2a811bc79b6\") "
Jul 21 02:01:20.622388 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:20.622362    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/593ac3fc-9f6b-427f-9d7c-b2a811bc79b6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "593ac3fc-9f6b-427f-9d7c-b2a811bc79b6" (UID: "593ac3fc-9f6b-427f-9d7c-b2a811bc79b6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 02:01:20.624327 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:20.624309    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/593ac3fc-9f6b-427f-9d7c-b2a811bc79b6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "593ac3fc-9f6b-427f-9d7c-b2a811bc79b6" (UID: "593ac3fc-9f6b-427f-9d7c-b2a811bc79b6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 02:01:20.624444 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:20.624428    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/593ac3fc-9f6b-427f-9d7c-b2a811bc79b6-kube-api-access-7xfnh" (OuterVolumeSpecName: "kube-api-access-7xfnh") pod "593ac3fc-9f6b-427f-9d7c-b2a811bc79b6" (UID: "593ac3fc-9f6b-427f-9d7c-b2a811bc79b6"). InnerVolumeSpecName "kube-api-access-7xfnh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:01:20.719407 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:20.719376    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9163f573-84ae-47e1-a4b4-c5df20bfb5f9" path="/var/lib/kubelet/pods/9163f573-84ae-47e1-a4b4-c5df20bfb5f9/volumes"
Jul 21 02:01:20.722714 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:20.722698    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xfnh\" (UniqueName: \"kubernetes.io/projected/593ac3fc-9f6b-427f-9d7c-b2a811bc79b6-kube-api-access-7xfnh\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 02:01:20.722776 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:20.722717    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/593ac3fc-9f6b-427f-9d7c-b2a811bc79b6-openshift-service-ca\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 02:01:20.722776 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:20.722728    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/593ac3fc-9f6b-427f-9d7c-b2a811bc79b6-maas-api-tls\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 02:01:20.972072 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:20.971976    2561 generic.go:356] "Generic (PLEG): container finished" podID="593ac3fc-9f6b-427f-9d7c-b2a811bc79b6" containerID="1038c5b35de30dfea97499d4690516ea4a5d77e0eb94f60fc37479ae79055130" exitCode=0
Jul 21 02:01:20.972072 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:20.972047    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-811ee7-7c98d5586d-gtw62"
Jul 21 02:01:20.972347 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:20.972061    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-811ee7-7c98d5586d-gtw62" event={"ID":"593ac3fc-9f6b-427f-9d7c-b2a811bc79b6","Type":"ContainerDied","Data":"1038c5b35de30dfea97499d4690516ea4a5d77e0eb94f60fc37479ae79055130"}
Jul 21 02:01:20.972347 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:20.972124    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-811ee7-7c98d5586d-gtw62" event={"ID":"593ac3fc-9f6b-427f-9d7c-b2a811bc79b6","Type":"ContainerDied","Data":"f12aedfdf000279ed7476756e0a6a923db9d62adaa9a0131eaf0abf9f7a09361"}
Jul 21 02:01:20.972347 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:20.972147    2561 scope.go:117] "RemoveContainer" containerID="1038c5b35de30dfea97499d4690516ea4a5d77e0eb94f60fc37479ae79055130"
Jul 21 02:01:20.980572 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:20.980550    2561 scope.go:117] "RemoveContainer" containerID="1038c5b35de30dfea97499d4690516ea4a5d77e0eb94f60fc37479ae79055130"
Jul 21 02:01:20.980837 ip-10-0-128-147 kubenswrapper[2561]: E0721 02:01:20.980819    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1038c5b35de30dfea97499d4690516ea4a5d77e0eb94f60fc37479ae79055130\": container with ID starting with 1038c5b35de30dfea97499d4690516ea4a5d77e0eb94f60fc37479ae79055130 not found: ID does not exist" containerID="1038c5b35de30dfea97499d4690516ea4a5d77e0eb94f60fc37479ae79055130"
Jul 21 02:01:20.980885 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:20.980846    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1038c5b35de30dfea97499d4690516ea4a5d77e0eb94f60fc37479ae79055130"} err="failed to get container status \"1038c5b35de30dfea97499d4690516ea4a5d77e0eb94f60fc37479ae79055130\": rpc error: code = NotFound desc = could not find container \"1038c5b35de30dfea97499d4690516ea4a5d77e0eb94f60fc37479ae79055130\": container with ID starting with 1038c5b35de30dfea97499d4690516ea4a5d77e0eb94f60fc37479ae79055130 not found: ID does not exist"
Jul 21 02:01:20.989383 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:20.989362    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-811ee7-7c98d5586d-gtw62"]
Jul 21 02:01:20.995526 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:20.995502    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-811ee7-7c98d5586d-gtw62"]
Jul 21 02:01:22.714402 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:22.714370    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="593ac3fc-9f6b-427f-9d7c-b2a811bc79b6" path="/var/lib/kubelet/pods/593ac3fc-9f6b-427f-9d7c-b2a811bc79b6/volumes"
Jul 21 02:01:24.895067 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:24.895035    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:01:24.919060 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:24.919036    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-811ee7-fwnfk"]
Jul 21 02:01:24.924058 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:24.924036    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-811ee7-fwnfk"]
Jul 21 02:01:25.367363 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:25.367335    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:01:26.715079 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:26.715043    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f218aa1-5ab1-4e68-962f-be2482cd1d1a" path="/var/lib/kubelet/pods/0f218aa1-5ab1-4e68-962f-be2482cd1d1a/volumes"
Jul 21 02:01:31.154097 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:31.154062    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:01:31.254563 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:31.254533    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:01:31.430842 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:31.430751    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:01:33.457993 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:33.457959    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:01:33.524124 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:33.524094    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:01:42.441184 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:42.441151    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f35db9-c949bc69-gljvt"]
Jul 21 02:01:42.441671 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:42.441373    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f35db9-c949bc69-gljvt" podUID="525dee99-96b3-4e82-a4e8-d23c6ce46864" containerName="maas-api" containerID="cri-o://ea77cc5985c17742b64682f4707e7858799bf4a32db5d72d6203fbe6770de6c2" gracePeriod=30
Jul 21 02:01:42.475281 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:42.475256    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f35db9-29743320-2q2jw"]
Jul 21 02:01:42.475398 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:42.475328    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:01:42.481737 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:42.481712    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f35db9-29743320-2q2jw"]
Jul 21 02:01:42.517473 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:42.517410    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f35db9-c949bc69-gljvt" podUID="525dee99-96b3-4e82-a4e8-d23c6ce46864" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.35:8443/health\": dial tcp 10.133.0.35:8443: connect: connection refused"
Jul 21 02:01:42.688080 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:42.688053    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f35db9-c949bc69-gljvt"
Jul 21 02:01:42.716014 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:42.715921    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adc448a8-8be8-40b4-9903-eacf7e7efca2" path="/var/lib/kubelet/pods/adc448a8-8be8-40b4-9903-eacf7e7efca2/volumes"
Jul 21 02:01:42.816143 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:42.816107    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6c94\" (UniqueName: \"kubernetes.io/projected/525dee99-96b3-4e82-a4e8-d23c6ce46864-kube-api-access-j6c94\") pod \"525dee99-96b3-4e82-a4e8-d23c6ce46864\" (UID: \"525dee99-96b3-4e82-a4e8-d23c6ce46864\") "
Jul 21 02:01:42.816143 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:42.816152    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/525dee99-96b3-4e82-a4e8-d23c6ce46864-openshift-service-ca\") pod \"525dee99-96b3-4e82-a4e8-d23c6ce46864\" (UID: \"525dee99-96b3-4e82-a4e8-d23c6ce46864\") "
Jul 21 02:01:42.816403 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:42.816229    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/525dee99-96b3-4e82-a4e8-d23c6ce46864-maas-api-tls\") pod \"525dee99-96b3-4e82-a4e8-d23c6ce46864\" (UID: \"525dee99-96b3-4e82-a4e8-d23c6ce46864\") "
Jul 21 02:01:42.816621 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:42.816591    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/525dee99-96b3-4e82-a4e8-d23c6ce46864-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "525dee99-96b3-4e82-a4e8-d23c6ce46864" (UID: "525dee99-96b3-4e82-a4e8-d23c6ce46864"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 02:01:42.818482 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:42.818459    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/525dee99-96b3-4e82-a4e8-d23c6ce46864-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "525dee99-96b3-4e82-a4e8-d23c6ce46864" (UID: "525dee99-96b3-4e82-a4e8-d23c6ce46864"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 02:01:42.818576 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:42.818513    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/525dee99-96b3-4e82-a4e8-d23c6ce46864-kube-api-access-j6c94" (OuterVolumeSpecName: "kube-api-access-j6c94") pod "525dee99-96b3-4e82-a4e8-d23c6ce46864" (UID: "525dee99-96b3-4e82-a4e8-d23c6ce46864"). InnerVolumeSpecName "kube-api-access-j6c94". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:01:42.917489 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:42.917450    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6c94\" (UniqueName: \"kubernetes.io/projected/525dee99-96b3-4e82-a4e8-d23c6ce46864-kube-api-access-j6c94\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 02:01:42.917489 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:42.917485    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/525dee99-96b3-4e82-a4e8-d23c6ce46864-openshift-service-ca\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 02:01:42.917489 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:42.917496    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/525dee99-96b3-4e82-a4e8-d23c6ce46864-maas-api-tls\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 02:01:43.068352 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:43.068313    2561 generic.go:356] "Generic (PLEG): container finished" podID="525dee99-96b3-4e82-a4e8-d23c6ce46864" containerID="ea77cc5985c17742b64682f4707e7858799bf4a32db5d72d6203fbe6770de6c2" exitCode=0
Jul 21 02:01:43.068526 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:43.068361    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f35db9-c949bc69-gljvt"
Jul 21 02:01:43.068526 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:43.068376    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f35db9-c949bc69-gljvt" event={"ID":"525dee99-96b3-4e82-a4e8-d23c6ce46864","Type":"ContainerDied","Data":"ea77cc5985c17742b64682f4707e7858799bf4a32db5d72d6203fbe6770de6c2"}
Jul 21 02:01:43.068526 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:43.068430    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f35db9-c949bc69-gljvt" event={"ID":"525dee99-96b3-4e82-a4e8-d23c6ce46864","Type":"ContainerDied","Data":"49a699797087c73a4089280ea6356646acc80f84d15b77ba1de47be22d1540e6"}
Jul 21 02:01:43.068526 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:43.068461    2561 scope.go:117] "RemoveContainer" containerID="ea77cc5985c17742b64682f4707e7858799bf4a32db5d72d6203fbe6770de6c2"
Jul 21 02:01:43.077159 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:43.077141    2561 scope.go:117] "RemoveContainer" containerID="ea77cc5985c17742b64682f4707e7858799bf4a32db5d72d6203fbe6770de6c2"
Jul 21 02:01:43.077455 ip-10-0-128-147 kubenswrapper[2561]: E0721 02:01:43.077437    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea77cc5985c17742b64682f4707e7858799bf4a32db5d72d6203fbe6770de6c2\": container with ID starting with ea77cc5985c17742b64682f4707e7858799bf4a32db5d72d6203fbe6770de6c2 not found: ID does not exist" containerID="ea77cc5985c17742b64682f4707e7858799bf4a32db5d72d6203fbe6770de6c2"
Jul 21 02:01:43.077515 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:43.077465    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea77cc5985c17742b64682f4707e7858799bf4a32db5d72d6203fbe6770de6c2"} err="failed to get container status \"ea77cc5985c17742b64682f4707e7858799bf4a32db5d72d6203fbe6770de6c2\": rpc error: code = NotFound desc = could not find container \"ea77cc5985c17742b64682f4707e7858799bf4a32db5d72d6203fbe6770de6c2\": container with ID starting with ea77cc5985c17742b64682f4707e7858799bf4a32db5d72d6203fbe6770de6c2 not found: ID does not exist"
Jul 21 02:01:43.090779 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:43.090754    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f35db9-c949bc69-gljvt"]
Jul 21 02:01:43.094577 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:43.094549    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f35db9-c949bc69-gljvt"]
Jul 21 02:01:44.714983 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:44.714945    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="525dee99-96b3-4e82-a4e8-d23c6ce46864" path="/var/lib/kubelet/pods/525dee99-96b3-4e82-a4e8-d23c6ce46864/volumes"
Jul 21 02:01:46.928853 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:46.928822    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:01:47.367767 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:47.367734    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:01:53.480226 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:53.480171    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:01:53.578647 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:53.578598    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:01:53.750958 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:53.750863    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:01:54.051745 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:54.051716    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:01:54.374116 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:54.374017    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:01:54.733075 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:54.732983    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:01:55.163622 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:55.163578    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:01:57.752053 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:57.752017    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:01:57.861620 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:57.861589    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-450472-6c89fcd574-hmcn8"]
Jul 21 02:01:57.861907 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:57.861894    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f218aa1-5ab1-4e68-962f-be2482cd1d1a" containerName="revoke-keys"
Jul 21 02:01:57.861963 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:57.861909    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f218aa1-5ab1-4e68-962f-be2482cd1d1a" containerName="revoke-keys"
Jul 21 02:01:57.861963 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:57.861919    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="525dee99-96b3-4e82-a4e8-d23c6ce46864" containerName="maas-api"
Jul 21 02:01:57.861963 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:57.861925    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="525dee99-96b3-4e82-a4e8-d23c6ce46864" containerName="maas-api"
Jul 21 02:01:57.861963 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:57.861941    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="593ac3fc-9f6b-427f-9d7c-b2a811bc79b6" containerName="maas-api"
Jul 21 02:01:57.861963 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:57.861947    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="593ac3fc-9f6b-427f-9d7c-b2a811bc79b6" containerName="maas-api"
Jul 21 02:01:57.862110 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:57.862000    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="593ac3fc-9f6b-427f-9d7c-b2a811bc79b6" containerName="maas-api"
Jul 21 02:01:57.862110 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:57.862007    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="525dee99-96b3-4e82-a4e8-d23c6ce46864" containerName="maas-api"
Jul 21 02:01:57.862110 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:57.862012    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f218aa1-5ab1-4e68-962f-be2482cd1d1a" containerName="revoke-keys"
Jul 21 02:01:57.864791 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:57.864775    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-450472-6c89fcd574-hmcn8"
Jul 21 02:01:57.868222 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:57.868183    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-450472-serving-cert\""
Jul 21 02:01:57.885484 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:57.885457    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-450472-6c89fcd574-hmcn8"]
Jul 21 02:01:57.886775 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:57.886743    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:01:57.930226 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:57.930174    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b-maas-api-tls\") pod \"maas-api-e2e-api-a-450472-6c89fcd574-hmcn8\" (UID: \"2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-450472-6c89fcd574-hmcn8"
Jul 21 02:01:57.930392 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:57.930251    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gts2p\" (UniqueName: \"kubernetes.io/projected/2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b-kube-api-access-gts2p\") pod \"maas-api-e2e-api-a-450472-6c89fcd574-hmcn8\" (UID: \"2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-450472-6c89fcd574-hmcn8"
Jul 21 02:01:57.930392 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:57.930351    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b-openshift-service-ca\") pod \"maas-api-e2e-api-a-450472-6c89fcd574-hmcn8\" (UID: \"2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-450472-6c89fcd574-hmcn8"
Jul 21 02:01:58.010633 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:58.010546    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:01:58.031778 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:58.031743    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b-maas-api-tls\") pod \"maas-api-e2e-api-a-450472-6c89fcd574-hmcn8\" (UID: \"2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-450472-6c89fcd574-hmcn8"
Jul 21 02:01:58.031936 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:58.031789    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gts2p\" (UniqueName: \"kubernetes.io/projected/2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b-kube-api-access-gts2p\") pod \"maas-api-e2e-api-a-450472-6c89fcd574-hmcn8\" (UID: \"2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-450472-6c89fcd574-hmcn8"
Jul 21 02:01:58.031996 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:58.031958    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b-openshift-service-ca\") pod \"maas-api-e2e-api-a-450472-6c89fcd574-hmcn8\" (UID: \"2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-450472-6c89fcd574-hmcn8"
Jul 21 02:01:58.032694 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:58.032670    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b-openshift-service-ca\") pod \"maas-api-e2e-api-a-450472-6c89fcd574-hmcn8\" (UID: \"2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-450472-6c89fcd574-hmcn8"
Jul 21 02:01:58.035058 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:58.035033    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b-maas-api-tls\") pod \"maas-api-e2e-api-a-450472-6c89fcd574-hmcn8\" (UID: \"2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-450472-6c89fcd574-hmcn8"
Jul 21 02:01:58.047015 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:58.046991    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gts2p\" (UniqueName: \"kubernetes.io/projected/2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b-kube-api-access-gts2p\") pod \"maas-api-e2e-api-a-450472-6c89fcd574-hmcn8\" (UID: \"2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-450472-6c89fcd574-hmcn8"
Jul 21 02:01:58.174105 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:58.174069    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-450472-6c89fcd574-hmcn8"
Jul 21 02:01:58.182192 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:58.182156    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:01:58.314322 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:58.314298    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-450472-6c89fcd574-hmcn8"]
Jul 21 02:01:58.316571 ip-10-0-128-147 kubenswrapper[2561]: W0721 02:01:58.316533    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a6e4835_f8e2_4a16_8ba6_d137cecbfd8b.slice/crio-db586b06a926bd6caee0bd3ea254182f92ab8a0ee8bec80a0cfe85c4283572ed WatchSource:0}: Error finding container db586b06a926bd6caee0bd3ea254182f92ab8a0ee8bec80a0cfe85c4283572ed: Status 404 returned error can't find the container with id db586b06a926bd6caee0bd3ea254182f92ab8a0ee8bec80a0cfe85c4283572ed
Jul 21 02:01:58.317843 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:58.317818    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 02:01:58.820170 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:58.820145    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:01:58.915897 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:58.915849    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:01:59.145256 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:59.145142    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-450472-6c89fcd574-hmcn8" event={"ID":"2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b","Type":"ContainerStarted","Data":"c391af43242dfe11bc749cc0d6b5e7c0b88cdd8f5acf4678ad3a1c7ef24520e7"}
Jul 21 02:01:59.145417 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:59.145265    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-450472-6c89fcd574-hmcn8"
Jul 21 02:01:59.145417 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:59.145291    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-450472-6c89fcd574-hmcn8" event={"ID":"2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b","Type":"ContainerStarted","Data":"db586b06a926bd6caee0bd3ea254182f92ab8a0ee8bec80a0cfe85c4283572ed"}
Jul 21 02:01:59.180893 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:01:59.180832    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-450472-6c89fcd574-hmcn8" podStartSLOduration=1.689838502 podStartE2EDuration="2.180814999s" totalImagesPullingTime="490.976497ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:01:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:01:59.179418457 +0000 UTC m=+2388.909787148" watchObservedRunningTime="2026-07-21 02:01:59.180814999 +0000 UTC m=+2388.911183668"
Jul 21 02:02:02.239015 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:02.238974    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:02:02.750017 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:02.749985    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:02:03.127559 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:03.127527    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:02:03.364809 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:03.364773    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:02:05.155611 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:05.155582    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-450472-6c89fcd574-hmcn8"
Jul 21 02:02:05.881122 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:05.881092    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-50f51c-7bbf84f875-g2qcr"]
Jul 21 02:02:05.884448 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:05.884425    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50f51c-7bbf84f875-g2qcr"
Jul 21 02:02:05.887683 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:05.887657    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-50f51c-serving-cert\""
Jul 21 02:02:05.906271 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:05.906242    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-50f51c-7bbf84f875-g2qcr"]
Jul 21 02:02:06.003152 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:06.003118    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb9s4\" (UniqueName: \"kubernetes.io/projected/4922eef8-1df3-4e3c-8344-5806241c82c0-kube-api-access-wb9s4\") pod \"maas-api-e2e-api-b-50f51c-7bbf84f875-g2qcr\" (UID: \"4922eef8-1df3-4e3c-8344-5806241c82c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50f51c-7bbf84f875-g2qcr"
Jul 21 02:02:06.003329 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:06.003225    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4922eef8-1df3-4e3c-8344-5806241c82c0-openshift-service-ca\") pod \"maas-api-e2e-api-b-50f51c-7bbf84f875-g2qcr\" (UID: \"4922eef8-1df3-4e3c-8344-5806241c82c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50f51c-7bbf84f875-g2qcr"
Jul 21 02:02:06.003329 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:06.003254    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4922eef8-1df3-4e3c-8344-5806241c82c0-maas-api-tls\") pod \"maas-api-e2e-api-b-50f51c-7bbf84f875-g2qcr\" (UID: \"4922eef8-1df3-4e3c-8344-5806241c82c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50f51c-7bbf84f875-g2qcr"
Jul 21 02:02:06.104171 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:06.104138    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb9s4\" (UniqueName: \"kubernetes.io/projected/4922eef8-1df3-4e3c-8344-5806241c82c0-kube-api-access-wb9s4\") pod \"maas-api-e2e-api-b-50f51c-7bbf84f875-g2qcr\" (UID: \"4922eef8-1df3-4e3c-8344-5806241c82c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50f51c-7bbf84f875-g2qcr"
Jul 21 02:02:06.104398 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:06.104194    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4922eef8-1df3-4e3c-8344-5806241c82c0-openshift-service-ca\") pod \"maas-api-e2e-api-b-50f51c-7bbf84f875-g2qcr\" (UID: \"4922eef8-1df3-4e3c-8344-5806241c82c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50f51c-7bbf84f875-g2qcr"
Jul 21 02:02:06.104398 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:06.104239    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4922eef8-1df3-4e3c-8344-5806241c82c0-maas-api-tls\") pod \"maas-api-e2e-api-b-50f51c-7bbf84f875-g2qcr\" (UID: \"4922eef8-1df3-4e3c-8344-5806241c82c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50f51c-7bbf84f875-g2qcr"
Jul 21 02:02:06.104398 ip-10-0-128-147 kubenswrapper[2561]: E0721 02:02:06.104321    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-50f51c-serving-cert: secret "maas-api-e2e-api-b-50f51c-serving-cert" not found
Jul 21 02:02:06.104398 ip-10-0-128-147 kubenswrapper[2561]: E0721 02:02:06.104398    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4922eef8-1df3-4e3c-8344-5806241c82c0-maas-api-tls podName:4922eef8-1df3-4e3c-8344-5806241c82c0 nodeName:}" failed. No retries permitted until 2026-07-21 02:02:06.604380795 +0000 UTC m=+2396.334749442 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4922eef8-1df3-4e3c-8344-5806241c82c0-maas-api-tls") pod "maas-api-e2e-api-b-50f51c-7bbf84f875-g2qcr" (UID: "4922eef8-1df3-4e3c-8344-5806241c82c0") : secret "maas-api-e2e-api-b-50f51c-serving-cert" not found
Jul 21 02:02:06.105017 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:06.104992    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4922eef8-1df3-4e3c-8344-5806241c82c0-openshift-service-ca\") pod \"maas-api-e2e-api-b-50f51c-7bbf84f875-g2qcr\" (UID: \"4922eef8-1df3-4e3c-8344-5806241c82c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50f51c-7bbf84f875-g2qcr"
Jul 21 02:02:06.114564 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:06.114531    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb9s4\" (UniqueName: \"kubernetes.io/projected/4922eef8-1df3-4e3c-8344-5806241c82c0-kube-api-access-wb9s4\") pod \"maas-api-e2e-api-b-50f51c-7bbf84f875-g2qcr\" (UID: \"4922eef8-1df3-4e3c-8344-5806241c82c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50f51c-7bbf84f875-g2qcr"
Jul 21 02:02:06.609459 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:06.609425    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4922eef8-1df3-4e3c-8344-5806241c82c0-maas-api-tls\") pod \"maas-api-e2e-api-b-50f51c-7bbf84f875-g2qcr\" (UID: \"4922eef8-1df3-4e3c-8344-5806241c82c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50f51c-7bbf84f875-g2qcr"
Jul 21 02:02:06.612059 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:06.612024    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4922eef8-1df3-4e3c-8344-5806241c82c0-maas-api-tls\") pod \"maas-api-e2e-api-b-50f51c-7bbf84f875-g2qcr\" (UID: \"4922eef8-1df3-4e3c-8344-5806241c82c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50f51c-7bbf84f875-g2qcr"
Jul 21 02:02:06.797768 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:06.797724    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50f51c-7bbf84f875-g2qcr"
Jul 21 02:02:06.932722 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:06.932699    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-50f51c-7bbf84f875-g2qcr"]
Jul 21 02:02:06.935341 ip-10-0-128-147 kubenswrapper[2561]: W0721 02:02:06.935313    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4922eef8_1df3_4e3c_8344_5806241c82c0.slice/crio-6cd8c0a48c9a368b3b0a25a098549a04c38417de60556ce867aec7e25fe93772 WatchSource:0}: Error finding container 6cd8c0a48c9a368b3b0a25a098549a04c38417de60556ce867aec7e25fe93772: Status 404 returned error can't find the container with id 6cd8c0a48c9a368b3b0a25a098549a04c38417de60556ce867aec7e25fe93772
Jul 21 02:02:06.972697 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:06.972664    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:02:07.072741 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:07.072693    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:02:07.183134 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:07.183050    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50f51c-7bbf84f875-g2qcr" event={"ID":"4922eef8-1df3-4e3c-8344-5806241c82c0","Type":"ContainerStarted","Data":"6cd8c0a48c9a368b3b0a25a098549a04c38417de60556ce867aec7e25fe93772"}
Jul 21 02:02:08.189539 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:08.189506    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50f51c-7bbf84f875-g2qcr" event={"ID":"4922eef8-1df3-4e3c-8344-5806241c82c0","Type":"ContainerStarted","Data":"070e13211f0f17f25d17bb40037e7ad1fbb79e4f6a01deddb1968c64ddc4d3f5"}
Jul 21 02:02:08.189931 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:08.189569    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50f51c-7bbf84f875-g2qcr"
Jul 21 02:02:08.211241 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:08.211169    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50f51c-7bbf84f875-g2qcr" podStartSLOduration=2.861731006 podStartE2EDuration="3.211152426s" totalImagesPullingTime="349.42142ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:02:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:02:08.211064775 +0000 UTC m=+2397.941433444" watchObservedRunningTime="2026-07-21 02:02:08.211152426 +0000 UTC m=+2397.941521095"
Jul 21 02:02:10.301930 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:10.301894    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:02:10.754938 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:10.754855    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2p4wt_1701009a-d778-4d6d-b59f-e91ec4b13a60/ovn-acl-logging/0.log"
Jul 21 02:02:10.771707 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:10.771676    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2p4wt_1701009a-d778-4d6d-b59f-e91ec4b13a60/ovn-acl-logging/0.log"
Jul 21 02:02:14.198968 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:14.198942    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50f51c-7bbf84f875-g2qcr"
Jul 21 02:02:19.294071 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:19.294008    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:02:19.410145 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:19.410110    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:02:28.710609 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:28.710576    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:02:28.900362 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:28.900333    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:02:34.073722 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:34.073631    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-450472-6c89fcd574-hmcn8"]
Jul 21 02:02:34.074158 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:34.073908    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-450472-6c89fcd574-hmcn8" podUID="2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b" containerName="maas-api" containerID="cri-o://c391af43242dfe11bc749cc0d6b5e7c0b88cdd8f5acf4678ad3a1c7ef24520e7" gracePeriod=30
Jul 21 02:02:34.138924 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:34.138898    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:02:34.299636 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:34.299600    2561 generic.go:356] "Generic (PLEG): container finished" podID="2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b" containerID="c391af43242dfe11bc749cc0d6b5e7c0b88cdd8f5acf4678ad3a1c7ef24520e7" exitCode=0
Jul 21 02:02:34.299803 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:34.299672    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-450472-6c89fcd574-hmcn8" event={"ID":"2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b","Type":"ContainerDied","Data":"c391af43242dfe11bc749cc0d6b5e7c0b88cdd8f5acf4678ad3a1c7ef24520e7"}
Jul 21 02:02:34.327223 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:34.327131    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-450472-6c89fcd574-hmcn8"
Jul 21 02:02:34.349135 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:34.349100    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b-openshift-service-ca\") pod \"2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b\" (UID: \"2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b\") "
Jul 21 02:02:34.349292 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:34.349169    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gts2p\" (UniqueName: \"kubernetes.io/projected/2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b-kube-api-access-gts2p\") pod \"2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b\" (UID: \"2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b\") "
Jul 21 02:02:34.349292 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:34.349252    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b-maas-api-tls\") pod \"2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b\" (UID: \"2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b\") "
Jul 21 02:02:34.349498 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:34.349474    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b" (UID: "2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 02:02:34.351438 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:34.351412    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b-kube-api-access-gts2p" (OuterVolumeSpecName: "kube-api-access-gts2p") pod "2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b" (UID: "2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b"). InnerVolumeSpecName "kube-api-access-gts2p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:02:34.351613 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:34.351595    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b" (UID: "2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 02:02:34.450516 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:34.450488    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b-maas-api-tls\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 02:02:34.450516 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:34.450515    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b-openshift-service-ca\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 02:02:34.450516 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:34.450524    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gts2p\" (UniqueName: \"kubernetes.io/projected/2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b-kube-api-access-gts2p\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 02:02:35.305883 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:35.305849    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-450472-6c89fcd574-hmcn8" event={"ID":"2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b","Type":"ContainerDied","Data":"db586b06a926bd6caee0bd3ea254182f92ab8a0ee8bec80a0cfe85c4283572ed"}
Jul 21 02:02:35.305883 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:35.305880    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-450472-6c89fcd574-hmcn8"
Jul 21 02:02:35.306391 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:35.305910    2561 scope.go:117] "RemoveContainer" containerID="c391af43242dfe11bc749cc0d6b5e7c0b88cdd8f5acf4678ad3a1c7ef24520e7"
Jul 21 02:02:35.338700 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:35.338674    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-450472-6c89fcd574-hmcn8"]
Jul 21 02:02:35.347546 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:35.347524    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-450472-6c89fcd574-hmcn8"]
Jul 21 02:02:36.714381 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:36.714350    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b" path="/var/lib/kubelet/pods/2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b/volumes"
Jul 21 02:02:38.841527 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:38.841491    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:02:39.200104 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:39.200005    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:02:45.969066 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:45.969034    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:02:46.106391 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:46.106359    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:02:46.341091 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:46.341053    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:02:46.565067 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:46.565023    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:02:48.916531 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:02:48.916495    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:03:02.323730 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:02.323684    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-50f51c-7bbf84f875-g2qcr"]
Jul 21 02:03:02.324320 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:02.323944    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50f51c-7bbf84f875-g2qcr" podUID="4922eef8-1df3-4e3c-8344-5806241c82c0" containerName="maas-api" containerID="cri-o://070e13211f0f17f25d17bb40037e7ad1fbb79e4f6a01deddb1968c64ddc4d3f5" gracePeriod=30
Jul 21 02:03:02.357718 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:02.357688    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:03:02.572439 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:02.572412    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50f51c-7bbf84f875-g2qcr"
Jul 21 02:03:02.692353 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:02.692248    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4922eef8-1df3-4e3c-8344-5806241c82c0-maas-api-tls\") pod \"4922eef8-1df3-4e3c-8344-5806241c82c0\" (UID: \"4922eef8-1df3-4e3c-8344-5806241c82c0\") "
Jul 21 02:03:02.692531 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:02.692353    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4922eef8-1df3-4e3c-8344-5806241c82c0-openshift-service-ca\") pod \"4922eef8-1df3-4e3c-8344-5806241c82c0\" (UID: \"4922eef8-1df3-4e3c-8344-5806241c82c0\") "
Jul 21 02:03:02.692531 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:02.692383    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wb9s4\" (UniqueName: \"kubernetes.io/projected/4922eef8-1df3-4e3c-8344-5806241c82c0-kube-api-access-wb9s4\") pod \"4922eef8-1df3-4e3c-8344-5806241c82c0\" (UID: \"4922eef8-1df3-4e3c-8344-5806241c82c0\") "
Jul 21 02:03:02.692798 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:02.692755    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4922eef8-1df3-4e3c-8344-5806241c82c0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4922eef8-1df3-4e3c-8344-5806241c82c0" (UID: "4922eef8-1df3-4e3c-8344-5806241c82c0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 02:03:02.694485 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:02.694453    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4922eef8-1df3-4e3c-8344-5806241c82c0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4922eef8-1df3-4e3c-8344-5806241c82c0" (UID: "4922eef8-1df3-4e3c-8344-5806241c82c0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 02:03:02.694591 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:02.694515    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4922eef8-1df3-4e3c-8344-5806241c82c0-kube-api-access-wb9s4" (OuterVolumeSpecName: "kube-api-access-wb9s4") pod "4922eef8-1df3-4e3c-8344-5806241c82c0" (UID: "4922eef8-1df3-4e3c-8344-5806241c82c0"). InnerVolumeSpecName "kube-api-access-wb9s4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:03:02.793127 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:02.793086    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4922eef8-1df3-4e3c-8344-5806241c82c0-maas-api-tls\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 02:03:02.793127 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:02.793127    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4922eef8-1df3-4e3c-8344-5806241c82c0-openshift-service-ca\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 02:03:02.793395 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:02.793143    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wb9s4\" (UniqueName: \"kubernetes.io/projected/4922eef8-1df3-4e3c-8344-5806241c82c0-kube-api-access-wb9s4\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 02:03:03.431408 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:03.431374    2561 generic.go:356] "Generic (PLEG): container finished" podID="4922eef8-1df3-4e3c-8344-5806241c82c0" containerID="070e13211f0f17f25d17bb40037e7ad1fbb79e4f6a01deddb1968c64ddc4d3f5" exitCode=0
Jul 21 02:03:03.431829 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:03.431418    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50f51c-7bbf84f875-g2qcr"
Jul 21 02:03:03.431829 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:03.431459    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50f51c-7bbf84f875-g2qcr" event={"ID":"4922eef8-1df3-4e3c-8344-5806241c82c0","Type":"ContainerDied","Data":"070e13211f0f17f25d17bb40037e7ad1fbb79e4f6a01deddb1968c64ddc4d3f5"}
Jul 21 02:03:03.431829 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:03.431511    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50f51c-7bbf84f875-g2qcr" event={"ID":"4922eef8-1df3-4e3c-8344-5806241c82c0","Type":"ContainerDied","Data":"6cd8c0a48c9a368b3b0a25a098549a04c38417de60556ce867aec7e25fe93772"}
Jul 21 02:03:03.431829 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:03.431532    2561 scope.go:117] "RemoveContainer" containerID="070e13211f0f17f25d17bb40037e7ad1fbb79e4f6a01deddb1968c64ddc4d3f5"
Jul 21 02:03:03.440163 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:03.440135    2561 scope.go:117] "RemoveContainer" containerID="070e13211f0f17f25d17bb40037e7ad1fbb79e4f6a01deddb1968c64ddc4d3f5"
Jul 21 02:03:03.440441 ip-10-0-128-147 kubenswrapper[2561]: E0721 02:03:03.440422    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"070e13211f0f17f25d17bb40037e7ad1fbb79e4f6a01deddb1968c64ddc4d3f5\": container with ID starting with 070e13211f0f17f25d17bb40037e7ad1fbb79e4f6a01deddb1968c64ddc4d3f5 not found: ID does not exist" containerID="070e13211f0f17f25d17bb40037e7ad1fbb79e4f6a01deddb1968c64ddc4d3f5"
Jul 21 02:03:03.440505 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:03.440449    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"070e13211f0f17f25d17bb40037e7ad1fbb79e4f6a01deddb1968c64ddc4d3f5"} err="failed to get container status \"070e13211f0f17f25d17bb40037e7ad1fbb79e4f6a01deddb1968c64ddc4d3f5\": rpc error: code = NotFound desc = could not find container \"070e13211f0f17f25d17bb40037e7ad1fbb79e4f6a01deddb1968c64ddc4d3f5\": container with ID starting with 070e13211f0f17f25d17bb40037e7ad1fbb79e4f6a01deddb1968c64ddc4d3f5 not found: ID does not exist"
Jul 21 02:03:03.448374 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:03.448350    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-50f51c-7bbf84f875-g2qcr"]
Jul 21 02:03:03.454296 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:03.454275    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-50f51c-7bbf84f875-g2qcr"]
Jul 21 02:03:04.714796 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:04.714762    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4922eef8-1df3-4e3c-8344-5806241c82c0" path="/var/lib/kubelet/pods/4922eef8-1df3-4e3c-8344-5806241c82c0/volumes"
Jul 21 02:03:06.782803 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:06.782763    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:03:08.155802 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:08.155752    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:03:13.681436 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:13.681401    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:03:13.820114 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:13.820078    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:03:14.083411 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:14.083380    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:03:14.274573 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:14.274538    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:03:14.600924 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:14.600888    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:03:15.062503 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:15.062468    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:03:15.216963 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:15.216925    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:03:18.271667 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:18.271598    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:03:18.405990 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:18.405951    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0dfbd0-5cd69fd6c7-fbrcx"]
Jul 21 02:03:18.406291 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:18.406278    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4922eef8-1df3-4e3c-8344-5806241c82c0" containerName="maas-api"
Jul 21 02:03:18.406363 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:18.406292    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4922eef8-1df3-4e3c-8344-5806241c82c0" containerName="maas-api"
Jul 21 02:03:18.406363 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:18.406311    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b" containerName="maas-api"
Jul 21 02:03:18.406363 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:18.406317    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b" containerName="maas-api"
Jul 21 02:03:18.406524 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:18.406365    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a6e4835-f8e2-4a16-8ba6-d137cecbfd8b" containerName="maas-api"
Jul 21 02:03:18.406524 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:18.406373    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4922eef8-1df3-4e3c-8344-5806241c82c0" containerName="maas-api"
Jul 21 02:03:18.408997 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:18.408977    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0dfbd0-5cd69fd6c7-fbrcx"
Jul 21 02:03:18.414428 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:18.414409    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-0dfbd0-serving-cert\""
Jul 21 02:03:18.431966 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:18.431939    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0dfbd0-5cd69fd6c7-fbrcx"]
Jul 21 02:03:18.532136 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:18.532105    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89dd0fa8-2cdb-4cb9-992f-52779deaf1eb-maas-api-tls\") pod \"maas-api-e2e-shared-a-0dfbd0-5cd69fd6c7-fbrcx\" (UID: \"89dd0fa8-2cdb-4cb9-992f-52779deaf1eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0dfbd0-5cd69fd6c7-fbrcx"
Jul 21 02:03:18.532315 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:18.532150    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht6x4\" (UniqueName: \"kubernetes.io/projected/89dd0fa8-2cdb-4cb9-992f-52779deaf1eb-kube-api-access-ht6x4\") pod \"maas-api-e2e-shared-a-0dfbd0-5cd69fd6c7-fbrcx\" (UID: \"89dd0fa8-2cdb-4cb9-992f-52779deaf1eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0dfbd0-5cd69fd6c7-fbrcx"
Jul 21 02:03:18.532315 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:18.532283    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89dd0fa8-2cdb-4cb9-992f-52779deaf1eb-openshift-service-ca\") pod \"maas-api-e2e-shared-a-0dfbd0-5cd69fd6c7-fbrcx\" (UID: \"89dd0fa8-2cdb-4cb9-992f-52779deaf1eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0dfbd0-5cd69fd6c7-fbrcx"
Jul 21 02:03:18.606723 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:18.606686    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:03:18.632956 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:18.632925    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht6x4\" (UniqueName: \"kubernetes.io/projected/89dd0fa8-2cdb-4cb9-992f-52779deaf1eb-kube-api-access-ht6x4\") pod \"maas-api-e2e-shared-a-0dfbd0-5cd69fd6c7-fbrcx\" (UID: \"89dd0fa8-2cdb-4cb9-992f-52779deaf1eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0dfbd0-5cd69fd6c7-fbrcx"
Jul 21 02:03:18.633091 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:18.632976    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89dd0fa8-2cdb-4cb9-992f-52779deaf1eb-openshift-service-ca\") pod \"maas-api-e2e-shared-a-0dfbd0-5cd69fd6c7-fbrcx\" (UID: \"89dd0fa8-2cdb-4cb9-992f-52779deaf1eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0dfbd0-5cd69fd6c7-fbrcx"
Jul 21 02:03:18.633091 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:18.633022    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89dd0fa8-2cdb-4cb9-992f-52779deaf1eb-maas-api-tls\") pod \"maas-api-e2e-shared-a-0dfbd0-5cd69fd6c7-fbrcx\" (UID: \"89dd0fa8-2cdb-4cb9-992f-52779deaf1eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0dfbd0-5cd69fd6c7-fbrcx"
Jul 21 02:03:18.633721 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:18.633691    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89dd0fa8-2cdb-4cb9-992f-52779deaf1eb-openshift-service-ca\") pod \"maas-api-e2e-shared-a-0dfbd0-5cd69fd6c7-fbrcx\" (UID: \"89dd0fa8-2cdb-4cb9-992f-52779deaf1eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0dfbd0-5cd69fd6c7-fbrcx"
Jul 21 02:03:18.635636 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:18.635616    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89dd0fa8-2cdb-4cb9-992f-52779deaf1eb-maas-api-tls\") pod \"maas-api-e2e-shared-a-0dfbd0-5cd69fd6c7-fbrcx\" (UID: \"89dd0fa8-2cdb-4cb9-992f-52779deaf1eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0dfbd0-5cd69fd6c7-fbrcx"
Jul 21 02:03:18.663417 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:18.663396    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht6x4\" (UniqueName: \"kubernetes.io/projected/89dd0fa8-2cdb-4cb9-992f-52779deaf1eb-kube-api-access-ht6x4\") pod \"maas-api-e2e-shared-a-0dfbd0-5cd69fd6c7-fbrcx\" (UID: \"89dd0fa8-2cdb-4cb9-992f-52779deaf1eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0dfbd0-5cd69fd6c7-fbrcx"
Jul 21 02:03:18.718466 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:18.718440    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0dfbd0-5cd69fd6c7-fbrcx"
Jul 21 02:03:18.805784 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:18.805744    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:03:18.897436 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:18.897414    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0dfbd0-5cd69fd6c7-fbrcx"]
Jul 21 02:03:18.899670 ip-10-0-128-147 kubenswrapper[2561]: W0721 02:03:18.899646    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89dd0fa8_2cdb_4cb9_992f_52779deaf1eb.slice/crio-de2312a7c26b3b364d2a1dcd83afb35b9beadd0f1ff09bc626d7c386e93157a2 WatchSource:0}: Error finding container de2312a7c26b3b364d2a1dcd83afb35b9beadd0f1ff09bc626d7c386e93157a2: Status 404 returned error can't find the container with id de2312a7c26b3b364d2a1dcd83afb35b9beadd0f1ff09bc626d7c386e93157a2
Jul 21 02:03:19.504176 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:19.504147    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0dfbd0-5cd69fd6c7-fbrcx" event={"ID":"89dd0fa8-2cdb-4cb9-992f-52779deaf1eb","Type":"ContainerStarted","Data":"70909557539cef343676e1395ba0585ad5201ae67d52816acd3865b4bcd276c7"}
Jul 21 02:03:19.504528 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:19.504196    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0dfbd0-5cd69fd6c7-fbrcx" event={"ID":"89dd0fa8-2cdb-4cb9-992f-52779deaf1eb","Type":"ContainerStarted","Data":"de2312a7c26b3b364d2a1dcd83afb35b9beadd0f1ff09bc626d7c386e93157a2"}
Jul 21 02:03:19.504528 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:19.504236    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0dfbd0-5cd69fd6c7-fbrcx"
Jul 21 02:03:19.554511 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:19.554453    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0dfbd0-5cd69fd6c7-fbrcx" podStartSLOduration=1.061815578 podStartE2EDuration="1.554433601s" totalImagesPullingTime="492.618023ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:03:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:03:19.553739567 +0000 UTC m=+2469.284108249" watchObservedRunningTime="2026-07-21 02:03:19.554433601 +0000 UTC m=+2469.284802270"
Jul 21 02:03:19.660531 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:19.660451    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:03:19.880922 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:19.880891    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:03:22.846573 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:22.846540    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:03:23.186937 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:23.186845    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:03:23.708644 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:23.708613    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:03:23.872792 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:23.872758    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:03:25.514155 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:25.514124    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0dfbd0-5cd69fd6c7-fbrcx"
Jul 21 02:03:26.761623 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:26.761585    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:03:26.859816 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:26.859786    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a256ec-67b6454db6-4v88v"]
Jul 21 02:03:26.863187 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:26.863167    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a256ec-67b6454db6-4v88v"
Jul 21 02:03:26.865878 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:26.865856    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-a256ec-serving-cert\""
Jul 21 02:03:26.883495 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:26.883467    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a256ec-67b6454db6-4v88v"]
Jul 21 02:03:26.903975 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:26.903942    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/432749e9-9707-4ac5-a6d4-bed623505e54-maas-api-tls\") pod \"maas-api-e2e-shared-b-a256ec-67b6454db6-4v88v\" (UID: \"432749e9-9707-4ac5-a6d4-bed623505e54\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a256ec-67b6454db6-4v88v"
Jul 21 02:03:26.904116 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:26.903988    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sq8w4\" (UniqueName: \"kubernetes.io/projected/432749e9-9707-4ac5-a6d4-bed623505e54-kube-api-access-sq8w4\") pod \"maas-api-e2e-shared-b-a256ec-67b6454db6-4v88v\" (UID: \"432749e9-9707-4ac5-a6d4-bed623505e54\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a256ec-67b6454db6-4v88v"
Jul 21 02:03:26.904191 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:26.904163    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/432749e9-9707-4ac5-a6d4-bed623505e54-openshift-service-ca\") pod \"maas-api-e2e-shared-b-a256ec-67b6454db6-4v88v\" (UID: \"432749e9-9707-4ac5-a6d4-bed623505e54\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a256ec-67b6454db6-4v88v"
Jul 21 02:03:26.905792 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:26.905765    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:03:27.005157 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:27.005122    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/432749e9-9707-4ac5-a6d4-bed623505e54-openshift-service-ca\") pod \"maas-api-e2e-shared-b-a256ec-67b6454db6-4v88v\" (UID: \"432749e9-9707-4ac5-a6d4-bed623505e54\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a256ec-67b6454db6-4v88v"
Jul 21 02:03:27.005376 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:27.005163    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/432749e9-9707-4ac5-a6d4-bed623505e54-maas-api-tls\") pod \"maas-api-e2e-shared-b-a256ec-67b6454db6-4v88v\" (UID: \"432749e9-9707-4ac5-a6d4-bed623505e54\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a256ec-67b6454db6-4v88v"
Jul 21 02:03:27.005376 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:27.005195    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sq8w4\" (UniqueName: \"kubernetes.io/projected/432749e9-9707-4ac5-a6d4-bed623505e54-kube-api-access-sq8w4\") pod \"maas-api-e2e-shared-b-a256ec-67b6454db6-4v88v\" (UID: \"432749e9-9707-4ac5-a6d4-bed623505e54\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a256ec-67b6454db6-4v88v"
Jul 21 02:03:27.005376 ip-10-0-128-147 kubenswrapper[2561]: E0721 02:03:27.005308    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-a256ec-serving-cert: secret "maas-api-e2e-shared-b-a256ec-serving-cert" not found
Jul 21 02:03:27.005376 ip-10-0-128-147 kubenswrapper[2561]: E0721 02:03:27.005378    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/432749e9-9707-4ac5-a6d4-bed623505e54-maas-api-tls podName:432749e9-9707-4ac5-a6d4-bed623505e54 nodeName:}" failed. No retries permitted until 2026-07-21 02:03:27.505362202 +0000 UTC m=+2477.235730850 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/432749e9-9707-4ac5-a6d4-bed623505e54-maas-api-tls") pod "maas-api-e2e-shared-b-a256ec-67b6454db6-4v88v" (UID: "432749e9-9707-4ac5-a6d4-bed623505e54") : secret "maas-api-e2e-shared-b-a256ec-serving-cert" not found
Jul 21 02:03:27.005807 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:27.005788    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/432749e9-9707-4ac5-a6d4-bed623505e54-openshift-service-ca\") pod \"maas-api-e2e-shared-b-a256ec-67b6454db6-4v88v\" (UID: \"432749e9-9707-4ac5-a6d4-bed623505e54\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a256ec-67b6454db6-4v88v"
Jul 21 02:03:27.021046 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:27.020984    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sq8w4\" (UniqueName: \"kubernetes.io/projected/432749e9-9707-4ac5-a6d4-bed623505e54-kube-api-access-sq8w4\") pod \"maas-api-e2e-shared-b-a256ec-67b6454db6-4v88v\" (UID: \"432749e9-9707-4ac5-a6d4-bed623505e54\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a256ec-67b6454db6-4v88v"
Jul 21 02:03:27.509116 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:27.509080    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/432749e9-9707-4ac5-a6d4-bed623505e54-maas-api-tls\") pod \"maas-api-e2e-shared-b-a256ec-67b6454db6-4v88v\" (UID: \"432749e9-9707-4ac5-a6d4-bed623505e54\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a256ec-67b6454db6-4v88v"
Jul 21 02:03:27.511742 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:27.511720    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/432749e9-9707-4ac5-a6d4-bed623505e54-maas-api-tls\") pod \"maas-api-e2e-shared-b-a256ec-67b6454db6-4v88v\" (UID: \"432749e9-9707-4ac5-a6d4-bed623505e54\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a256ec-67b6454db6-4v88v"
Jul 21 02:03:27.773545 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:27.773441    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a256ec-67b6454db6-4v88v"
Jul 21 02:03:27.937918 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:27.937892    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a256ec-67b6454db6-4v88v"]
Jul 21 02:03:27.940580 ip-10-0-128-147 kubenswrapper[2561]: W0721 02:03:27.940544    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod432749e9_9707_4ac5_a6d4_bed623505e54.slice/crio-634caf0fd69930b0f9b5016cbd9834b46157725b0ff793f6918add994407964d WatchSource:0}: Error finding container 634caf0fd69930b0f9b5016cbd9834b46157725b0ff793f6918add994407964d: Status 404 returned error can't find the container with id 634caf0fd69930b0f9b5016cbd9834b46157725b0ff793f6918add994407964d
Jul 21 02:03:28.387240 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:28.387190    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:03:28.496406 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:28.496371    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:03:28.549388 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:28.549354    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a256ec-67b6454db6-4v88v" event={"ID":"432749e9-9707-4ac5-a6d4-bed623505e54","Type":"ContainerStarted","Data":"3cfe1f2c2f242d2dadd05502508ea108447191eb2c763e41be5ba9bcd0362429"}
Jul 21 02:03:28.549550 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:28.549406    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a256ec-67b6454db6-4v88v" event={"ID":"432749e9-9707-4ac5-a6d4-bed623505e54","Type":"ContainerStarted","Data":"634caf0fd69930b0f9b5016cbd9834b46157725b0ff793f6918add994407964d"}
Jul 21 02:03:28.549550 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:28.549458    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a256ec-67b6454db6-4v88v"
Jul 21 02:03:28.569178 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:28.569137    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a256ec-67b6454db6-4v88v" podStartSLOduration=2.178997728 podStartE2EDuration="2.569105336s" totalImagesPullingTime="390.107608ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:03:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:03:28.566907988 +0000 UTC m=+2478.297276659" watchObservedRunningTime="2026-07-21 02:03:28.569105336 +0000 UTC m=+2478.299474006"
Jul 21 02:03:31.082511 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:31.082474    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:03:32.042970 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:32.042919    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:03:32.143918 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:32.143886    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:03:34.558925 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:34.558892    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a256ec-67b6454db6-4v88v"
Jul 21 02:03:40.728465 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:40.728431    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:03:40.829475 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:40.829436    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:03:45.739244 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:45.739185    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:03:48.832013 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:48.831966    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:03:48.932987 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:48.932957    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:03:54.907431 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:03:54.907392    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:04:10.872052 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:04:10.872018    2561 scope.go:117] "RemoveContainer" containerID="859a2ca7045406397eb172c2ce98efa96fe6f4289fab3b0bb3d08737a9e9ec85"
Jul 21 02:04:11.076280 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:04:11.076241    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:04:54.855024 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:04:54.854993    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:06:10.896984 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:06:10.896952    2561 scope.go:117] "RemoveContainer" containerID="f264b8b3ccac4805ad22a74933c2ca96efbda3c0f23029559ff0b4752760c20a"
Jul 21 02:06:10.904697 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:06:10.904673    2561 scope.go:117] "RemoveContainer" containerID="81af54be47cd8a640900ebc82c16b7eba2af1612f31e6fb56dc1fbe15e5463c8"
Jul 21 02:06:16.160719 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:06:16.160678    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:06:18.066212 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:06:18.066138    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:06:42.405134 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:06:42.405090    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:06:43.394676 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:06:43.394638    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:07:00.932774 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:07:00.932727    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:07:10.776642 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:07:10.776616    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2p4wt_1701009a-d778-4d6d-b59f-e91ec4b13a60/ovn-acl-logging/0.log"
Jul 21 02:07:10.795115 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:07:10.795087    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2p4wt_1701009a-d778-4d6d-b59f-e91ec4b13a60/ovn-acl-logging/0.log"
Jul 21 02:07:10.923639 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:07:10.923607    2561 scope.go:117] "RemoveContainer" containerID="c271e9c2fb4831f74d9111fddec53c1540abf48ca8fb78c077253115cf773acf"
Jul 21 02:07:18.188624 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:07:18.188574    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:07:28.040056 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:07:28.040010    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:07:39.801833 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:07:39.801782    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:07:39.862992 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:07:39.862957    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:08:01.958400 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:08:01.958367    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:08:02.829817 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:08:02.829782    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:08:18.034342 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:08:18.034299    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:08:32.829771 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:08:32.829683    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:08:32.936399 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:08:32.936359    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:08:41.236797 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:08:41.236757    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:08:41.611675 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:08:41.611636    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:08:41.776365 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:08:41.776331    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:08:49.699597 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:08:49.699564    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:08:49.903227 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:08:49.899548    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:08:53.222447 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:08:53.222418    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:09:31.505593 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:09:31.505560    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:09:32.415303 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:09:32.415267    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:09:52.590541 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:09:52.590459    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:09:52.691192 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:09:52.691149    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:10:02.487526 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:02.487434    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0dfbd0-5cd69fd6c7-fbrcx"]
Jul 21 02:10:02.488097 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:02.487732    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0dfbd0-5cd69fd6c7-fbrcx" podUID="89dd0fa8-2cdb-4cb9-992f-52779deaf1eb" containerName="maas-api" containerID="cri-o://70909557539cef343676e1395ba0585ad5201ae67d52816acd3865b4bcd276c7" gracePeriod=30
Jul 21 02:10:02.511577 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:02.511553    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:10:02.739848 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:02.739779    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0dfbd0-5cd69fd6c7-fbrcx"
Jul 21 02:10:02.867550 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:02.867509    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89dd0fa8-2cdb-4cb9-992f-52779deaf1eb-maas-api-tls\") pod \"89dd0fa8-2cdb-4cb9-992f-52779deaf1eb\" (UID: \"89dd0fa8-2cdb-4cb9-992f-52779deaf1eb\") "
Jul 21 02:10:02.867550 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:02.867553    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89dd0fa8-2cdb-4cb9-992f-52779deaf1eb-openshift-service-ca\") pod \"89dd0fa8-2cdb-4cb9-992f-52779deaf1eb\" (UID: \"89dd0fa8-2cdb-4cb9-992f-52779deaf1eb\") "
Jul 21 02:10:02.867804 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:02.867594    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ht6x4\" (UniqueName: \"kubernetes.io/projected/89dd0fa8-2cdb-4cb9-992f-52779deaf1eb-kube-api-access-ht6x4\") pod \"89dd0fa8-2cdb-4cb9-992f-52779deaf1eb\" (UID: \"89dd0fa8-2cdb-4cb9-992f-52779deaf1eb\") "
Jul 21 02:10:02.867887 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:02.867864    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89dd0fa8-2cdb-4cb9-992f-52779deaf1eb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "89dd0fa8-2cdb-4cb9-992f-52779deaf1eb" (UID: "89dd0fa8-2cdb-4cb9-992f-52779deaf1eb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 02:10:02.869841 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:02.869816    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89dd0fa8-2cdb-4cb9-992f-52779deaf1eb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "89dd0fa8-2cdb-4cb9-992f-52779deaf1eb" (UID: "89dd0fa8-2cdb-4cb9-992f-52779deaf1eb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 02:10:02.869841 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:02.869830    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89dd0fa8-2cdb-4cb9-992f-52779deaf1eb-kube-api-access-ht6x4" (OuterVolumeSpecName: "kube-api-access-ht6x4") pod "89dd0fa8-2cdb-4cb9-992f-52779deaf1eb" (UID: "89dd0fa8-2cdb-4cb9-992f-52779deaf1eb"). InnerVolumeSpecName "kube-api-access-ht6x4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:10:02.968987 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:02.968947    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ht6x4\" (UniqueName: \"kubernetes.io/projected/89dd0fa8-2cdb-4cb9-992f-52779deaf1eb-kube-api-access-ht6x4\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 02:10:02.968987 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:02.968980    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89dd0fa8-2cdb-4cb9-992f-52779deaf1eb-maas-api-tls\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 02:10:02.968987 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:02.968989    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89dd0fa8-2cdb-4cb9-992f-52779deaf1eb-openshift-service-ca\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 02:10:03.211964 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:03.211930    2561 generic.go:356] "Generic (PLEG): container finished" podID="89dd0fa8-2cdb-4cb9-992f-52779deaf1eb" containerID="70909557539cef343676e1395ba0585ad5201ae67d52816acd3865b4bcd276c7" exitCode=0
Jul 21 02:10:03.212160 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:03.211984    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0dfbd0-5cd69fd6c7-fbrcx"
Jul 21 02:10:03.212160 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:03.211999    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0dfbd0-5cd69fd6c7-fbrcx" event={"ID":"89dd0fa8-2cdb-4cb9-992f-52779deaf1eb","Type":"ContainerDied","Data":"70909557539cef343676e1395ba0585ad5201ae67d52816acd3865b4bcd276c7"}
Jul 21 02:10:03.212160 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:03.212042    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0dfbd0-5cd69fd6c7-fbrcx" event={"ID":"89dd0fa8-2cdb-4cb9-992f-52779deaf1eb","Type":"ContainerDied","Data":"de2312a7c26b3b364d2a1dcd83afb35b9beadd0f1ff09bc626d7c386e93157a2"}
Jul 21 02:10:03.212160 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:03.212064    2561 scope.go:117] "RemoveContainer" containerID="70909557539cef343676e1395ba0585ad5201ae67d52816acd3865b4bcd276c7"
Jul 21 02:10:03.220959 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:03.220934    2561 scope.go:117] "RemoveContainer" containerID="70909557539cef343676e1395ba0585ad5201ae67d52816acd3865b4bcd276c7"
Jul 21 02:10:03.221239 ip-10-0-128-147 kubenswrapper[2561]: E0721 02:10:03.221215    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70909557539cef343676e1395ba0585ad5201ae67d52816acd3865b4bcd276c7\": container with ID starting with 70909557539cef343676e1395ba0585ad5201ae67d52816acd3865b4bcd276c7 not found: ID does not exist" containerID="70909557539cef343676e1395ba0585ad5201ae67d52816acd3865b4bcd276c7"
Jul 21 02:10:03.221307 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:03.221252    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70909557539cef343676e1395ba0585ad5201ae67d52816acd3865b4bcd276c7"} err="failed to get container status \"70909557539cef343676e1395ba0585ad5201ae67d52816acd3865b4bcd276c7\": rpc error: code = NotFound desc = could not find container \"70909557539cef343676e1395ba0585ad5201ae67d52816acd3865b4bcd276c7\": container with ID starting with 70909557539cef343676e1395ba0585ad5201ae67d52816acd3865b4bcd276c7 not found: ID does not exist"
Jul 21 02:10:03.236111 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:03.236084    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0dfbd0-5cd69fd6c7-fbrcx"]
Jul 21 02:10:03.240431 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:03.240406    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0dfbd0-5cd69fd6c7-fbrcx"]
Jul 21 02:10:04.715348 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:04.715319    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89dd0fa8-2cdb-4cb9-992f-52779deaf1eb" path="/var/lib/kubelet/pods/89dd0fa8-2cdb-4cb9-992f-52779deaf1eb/volumes"
Jul 21 02:10:07.090528 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:07.090478    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:10:07.522731 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:07.522649    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:10:13.481628 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:13.481586    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:10:13.555746 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:13.555713    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:10:13.778464 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:13.778439    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:10:14.017299 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:14.017268    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:10:14.794881 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:14.794839    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:10:14.900025 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:14.899992    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:10:15.362714 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:15.362676    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:10:24.540607 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:24.540563    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a256ec-67b6454db6-4v88v"]
Jul 21 02:10:24.541093 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:24.540831    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a256ec-67b6454db6-4v88v" podUID="432749e9-9707-4ac5-a6d4-bed623505e54" containerName="maas-api" containerID="cri-o://3cfe1f2c2f242d2dadd05502508ea108447191eb2c763e41be5ba9bcd0362429" gracePeriod=30
Jul 21 02:10:24.553865 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:24.553692    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a256ec-67b6454db6-4v88v" podUID="432749e9-9707-4ac5-a6d4-bed623505e54" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.43:8443/health\": dial tcp 10.133.0.43:8443: connect: connection refused"
Jul 21 02:10:24.567216 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:24.567177    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:10:24.787761 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:24.787735    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a256ec-67b6454db6-4v88v"
Jul 21 02:10:24.830382 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:24.830307    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/432749e9-9707-4ac5-a6d4-bed623505e54-maas-api-tls\") pod \"432749e9-9707-4ac5-a6d4-bed623505e54\" (UID: \"432749e9-9707-4ac5-a6d4-bed623505e54\") "
Jul 21 02:10:24.830526 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:24.830382    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/432749e9-9707-4ac5-a6d4-bed623505e54-openshift-service-ca\") pod \"432749e9-9707-4ac5-a6d4-bed623505e54\" (UID: \"432749e9-9707-4ac5-a6d4-bed623505e54\") "
Jul 21 02:10:24.830526 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:24.830458    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sq8w4\" (UniqueName: \"kubernetes.io/projected/432749e9-9707-4ac5-a6d4-bed623505e54-kube-api-access-sq8w4\") pod \"432749e9-9707-4ac5-a6d4-bed623505e54\" (UID: \"432749e9-9707-4ac5-a6d4-bed623505e54\") "
Jul 21 02:10:24.830721 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:24.830698    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/432749e9-9707-4ac5-a6d4-bed623505e54-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "432749e9-9707-4ac5-a6d4-bed623505e54" (UID: "432749e9-9707-4ac5-a6d4-bed623505e54"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 02:10:24.832571 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:24.832542    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/432749e9-9707-4ac5-a6d4-bed623505e54-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "432749e9-9707-4ac5-a6d4-bed623505e54" (UID: "432749e9-9707-4ac5-a6d4-bed623505e54"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 02:10:24.832677 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:24.832649    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/432749e9-9707-4ac5-a6d4-bed623505e54-kube-api-access-sq8w4" (OuterVolumeSpecName: "kube-api-access-sq8w4") pod "432749e9-9707-4ac5-a6d4-bed623505e54" (UID: "432749e9-9707-4ac5-a6d4-bed623505e54"). InnerVolumeSpecName "kube-api-access-sq8w4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:10:24.931279 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:24.931243    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/432749e9-9707-4ac5-a6d4-bed623505e54-openshift-service-ca\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 02:10:24.931279 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:24.931273    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sq8w4\" (UniqueName: \"kubernetes.io/projected/432749e9-9707-4ac5-a6d4-bed623505e54-kube-api-access-sq8w4\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 02:10:24.931279 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:24.931283    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/432749e9-9707-4ac5-a6d4-bed623505e54-maas-api-tls\") on node \"ip-10-0-128-147.ec2.internal\" DevicePath \"\""
Jul 21 02:10:25.306673 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:25.306646    2561 generic.go:356] "Generic (PLEG): container finished" podID="432749e9-9707-4ac5-a6d4-bed623505e54" containerID="3cfe1f2c2f242d2dadd05502508ea108447191eb2c763e41be5ba9bcd0362429" exitCode=0
Jul 21 02:10:25.306830 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:25.306690    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a256ec-67b6454db6-4v88v"
Jul 21 02:10:25.306830 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:25.306735    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a256ec-67b6454db6-4v88v" event={"ID":"432749e9-9707-4ac5-a6d4-bed623505e54","Type":"ContainerDied","Data":"3cfe1f2c2f242d2dadd05502508ea108447191eb2c763e41be5ba9bcd0362429"}
Jul 21 02:10:25.306830 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:25.306789    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a256ec-67b6454db6-4v88v" event={"ID":"432749e9-9707-4ac5-a6d4-bed623505e54","Type":"ContainerDied","Data":"634caf0fd69930b0f9b5016cbd9834b46157725b0ff793f6918add994407964d"}
Jul 21 02:10:25.306830 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:25.306812    2561 scope.go:117] "RemoveContainer" containerID="3cfe1f2c2f242d2dadd05502508ea108447191eb2c763e41be5ba9bcd0362429"
Jul 21 02:10:25.316056 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:25.316032    2561 scope.go:117] "RemoveContainer" containerID="3cfe1f2c2f242d2dadd05502508ea108447191eb2c763e41be5ba9bcd0362429"
Jul 21 02:10:25.316401 ip-10-0-128-147 kubenswrapper[2561]: E0721 02:10:25.316376    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cfe1f2c2f242d2dadd05502508ea108447191eb2c763e41be5ba9bcd0362429\": container with ID starting with 3cfe1f2c2f242d2dadd05502508ea108447191eb2c763e41be5ba9bcd0362429 not found: ID does not exist" containerID="3cfe1f2c2f242d2dadd05502508ea108447191eb2c763e41be5ba9bcd0362429"
Jul 21 02:10:25.316492 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:25.316415    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cfe1f2c2f242d2dadd05502508ea108447191eb2c763e41be5ba9bcd0362429"} err="failed to get container status \"3cfe1f2c2f242d2dadd05502508ea108447191eb2c763e41be5ba9bcd0362429\": rpc error: code = NotFound desc = could not find container \"3cfe1f2c2f242d2dadd05502508ea108447191eb2c763e41be5ba9bcd0362429\": container with ID starting with 3cfe1f2c2f242d2dadd05502508ea108447191eb2c763e41be5ba9bcd0362429 not found: ID does not exist"
Jul 21 02:10:25.329745 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:25.329723    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a256ec-67b6454db6-4v88v"]
Jul 21 02:10:25.335651 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:25.335630    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a256ec-67b6454db6-4v88v"]
Jul 21 02:10:26.715082 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:26.715052    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="432749e9-9707-4ac5-a6d4-bed623505e54" path="/var/lib/kubelet/pods/432749e9-9707-4ac5-a6d4-bed623505e54/volumes"
Jul 21 02:10:29.186694 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:29.186665    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:10:29.564741 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:29.564701    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:10:35.494911 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:35.494875    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:10:35.594582 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:35.594548    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:10:35.787000 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:35.786973    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:10:35.995030 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:35.994991    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:10:42.690130 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:42.690100    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74c7b5f9f-bx7mf_ec96e083-a540-4ac3-8899-c04e96d9225f/copy-manifests/0.log"
Jul 21 02:10:42.703437 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:42.703407    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74c7b5f9f-bx7mf_ec96e083-a540-4ac3-8899-c04e96d9225f/manager/0.log"
Jul 21 02:10:43.055372 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:43.055345    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7cdd5cf58c-4nw9v_82337c89-a0e9-4ff0-b602-e0fc5b2de031/maas-api/0.log"
Jul 21 02:10:43.178413 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:43.178386    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29743305-xbtvj_1628403a-342f-475c-807b-2258f10ad5ca/cleanup/0.log"
Jul 21 02:10:43.293282 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:43.293254    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29743320-cgnnv_a44432c8-367e-466e-ad8a-9768a5114d9e/cleanup/0.log"
Jul 21 02:10:43.416863 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:43.416793    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-kz4m4_65aaddf2-b288-4706-9c6e-51375ad564e4/postgres/0.log"
Jul 21 02:10:46.057596 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:46.057566    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-wzf5m_4c368a1b-8af1-4f86-84ee-1c46e4f49f9f/discovery/0.log"
Jul 21 02:10:46.533873 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:46.533845    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-tmj65_05cff6b0-bed4-4162-ae3c-83f1c75feb3d/payload-pre-processing/0.log"
Jul 21 02:10:47.246158 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:47.246127    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-rxlck_81bbfe1d-516a-46d7-a443-bf56959eee7f/main/0.log"
Jul 21 02:10:47.494351 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:47.494318    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqlg27_76c009af-d744-447f-b28d-352ec6186ea8/main/0.log"
Jul 21 02:10:53.325109 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:53.325072    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:10:53.425520 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:53.425489    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log" limit=1024
Jul 21 02:10:56.263164 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:56.263136    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-n4nls_2f652ed3-d73f-4b66-be66-dd7bdba8a027/global-pull-secret-syncer/0.log"
Jul 21 02:10:56.310502 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:56.310471    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bmr7r_941a0372-0f5c-4f67-a620-e1a1ee0de499/konnectivity-agent/0.log"
Jul 21 02:10:56.433895 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:10:56.433866    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-147.ec2.internal_cc1b51a7ee645186d00208039d5f8c77/haproxy/0.log"
Jul 21 02:11:04.196885 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:04.196855    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c7vb5_d2594a35-25ca-4d21-a2b4-df328fabd2b8/node-exporter/0.log"
Jul 21 02:11:04.214679 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:04.214654    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c7vb5_d2594a35-25ca-4d21-a2b4-df328fabd2b8/kube-rbac-proxy/0.log"
Jul 21 02:11:04.232753 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:04.232731    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c7vb5_d2594a35-25ca-4d21-a2b4-df328fabd2b8/init-textfile/0.log"
Jul 21 02:11:06.631871 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:06.631842    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-whjhw/perf-node-gather-daemonset-6ws2c"]
Jul 21 02:11:06.632486 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:06.632300    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="432749e9-9707-4ac5-a6d4-bed623505e54" containerName="maas-api"
Jul 21 02:11:06.632486 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:06.632322    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="432749e9-9707-4ac5-a6d4-bed623505e54" containerName="maas-api"
Jul 21 02:11:06.632486 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:06.632333    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89dd0fa8-2cdb-4cb9-992f-52779deaf1eb" containerName="maas-api"
Jul 21 02:11:06.632486 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:06.632343    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="89dd0fa8-2cdb-4cb9-992f-52779deaf1eb" containerName="maas-api"
Jul 21 02:11:06.632486 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:06.632433    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="89dd0fa8-2cdb-4cb9-992f-52779deaf1eb" containerName="maas-api"
Jul 21 02:11:06.632486 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:06.632447    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="432749e9-9707-4ac5-a6d4-bed623505e54" containerName="maas-api"
Jul 21 02:11:06.635452 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:06.635432    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-6ws2c"
Jul 21 02:11:06.638188 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:06.638167    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-whjhw\"/\"kube-root-ca.crt\""
Jul 21 02:11:06.639168 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:06.639148    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-whjhw\"/\"default-dockercfg-vdthq\""
Jul 21 02:11:06.639282 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:06.639153    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-whjhw\"/\"openshift-service-ca.crt\""
Jul 21 02:11:06.644421 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:06.644398    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-whjhw/perf-node-gather-daemonset-6ws2c"]
Jul 21 02:11:06.771537 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:06.771499    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49ac06b4-5965-41be-81f2-aef9dfd1e4b3-lib-modules\") pod \"perf-node-gather-daemonset-6ws2c\" (UID: \"49ac06b4-5965-41be-81f2-aef9dfd1e4b3\") " pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-6ws2c"
Jul 21 02:11:06.771537 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:06.771540    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdww9\" (UniqueName: \"kubernetes.io/projected/49ac06b4-5965-41be-81f2-aef9dfd1e4b3-kube-api-access-bdww9\") pod \"perf-node-gather-daemonset-6ws2c\" (UID: \"49ac06b4-5965-41be-81f2-aef9dfd1e4b3\") " pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-6ws2c"
Jul 21 02:11:06.771753 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:06.771561    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/49ac06b4-5965-41be-81f2-aef9dfd1e4b3-podres\") pod \"perf-node-gather-daemonset-6ws2c\" (UID: \"49ac06b4-5965-41be-81f2-aef9dfd1e4b3\") " pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-6ws2c"
Jul 21 02:11:06.771753 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:06.771589    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49ac06b4-5965-41be-81f2-aef9dfd1e4b3-sys\") pod \"perf-node-gather-daemonset-6ws2c\" (UID: \"49ac06b4-5965-41be-81f2-aef9dfd1e4b3\") " pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-6ws2c"
Jul 21 02:11:06.771753 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:06.771607    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/49ac06b4-5965-41be-81f2-aef9dfd1e4b3-proc\") pod \"perf-node-gather-daemonset-6ws2c\" (UID: \"49ac06b4-5965-41be-81f2-aef9dfd1e4b3\") " pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-6ws2c"
Jul 21 02:11:06.872709 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:06.872678    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49ac06b4-5965-41be-81f2-aef9dfd1e4b3-lib-modules\") pod \"perf-node-gather-daemonset-6ws2c\" (UID: \"49ac06b4-5965-41be-81f2-aef9dfd1e4b3\") " pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-6ws2c"
Jul 21 02:11:06.872881 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:06.872718    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdww9\" (UniqueName: \"kubernetes.io/projected/49ac06b4-5965-41be-81f2-aef9dfd1e4b3-kube-api-access-bdww9\") pod \"perf-node-gather-daemonset-6ws2c\" (UID: \"49ac06b4-5965-41be-81f2-aef9dfd1e4b3\") " pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-6ws2c"
Jul 21 02:11:06.872881 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:06.872740    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/49ac06b4-5965-41be-81f2-aef9dfd1e4b3-podres\") pod \"perf-node-gather-daemonset-6ws2c\" (UID: \"49ac06b4-5965-41be-81f2-aef9dfd1e4b3\") " pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-6ws2c"
Jul 21 02:11:06.872881 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:06.872853    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/49ac06b4-5965-41be-81f2-aef9dfd1e4b3-podres\") pod \"perf-node-gather-daemonset-6ws2c\" (UID: \"49ac06b4-5965-41be-81f2-aef9dfd1e4b3\") " pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-6ws2c"
Jul 21 02:11:06.872881 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:06.872859    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49ac06b4-5965-41be-81f2-aef9dfd1e4b3-sys\") pod \"perf-node-gather-daemonset-6ws2c\" (UID: \"49ac06b4-5965-41be-81f2-aef9dfd1e4b3\") " pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-6ws2c"
Jul 21 02:11:06.872881 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:06.872852    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49ac06b4-5965-41be-81f2-aef9dfd1e4b3-lib-modules\") pod \"perf-node-gather-daemonset-6ws2c\" (UID: \"49ac06b4-5965-41be-81f2-aef9dfd1e4b3\") " pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-6ws2c"
Jul 21 02:11:06.873119 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:06.872900    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/49ac06b4-5965-41be-81f2-aef9dfd1e4b3-proc\") pod \"perf-node-gather-daemonset-6ws2c\" (UID: \"49ac06b4-5965-41be-81f2-aef9dfd1e4b3\") " pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-6ws2c"
Jul 21 02:11:06.873119 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:06.872956    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49ac06b4-5965-41be-81f2-aef9dfd1e4b3-sys\") pod \"perf-node-gather-daemonset-6ws2c\" (UID: \"49ac06b4-5965-41be-81f2-aef9dfd1e4b3\") " pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-6ws2c"
Jul 21 02:11:06.873119 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:06.872970    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/49ac06b4-5965-41be-81f2-aef9dfd1e4b3-proc\") pod \"perf-node-gather-daemonset-6ws2c\" (UID: \"49ac06b4-5965-41be-81f2-aef9dfd1e4b3\") " pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-6ws2c"
Jul 21 02:11:06.881334 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:06.881310    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdww9\" (UniqueName: \"kubernetes.io/projected/49ac06b4-5965-41be-81f2-aef9dfd1e4b3-kube-api-access-bdww9\") pod \"perf-node-gather-daemonset-6ws2c\" (UID: \"49ac06b4-5965-41be-81f2-aef9dfd1e4b3\") " pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-6ws2c"
Jul 21 02:11:06.946640 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:06.946549    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-6ws2c"
Jul 21 02:11:07.077610 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:07.077584    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-whjhw/perf-node-gather-daemonset-6ws2c"]
Jul 21 02:11:07.080042 ip-10-0-128-147 kubenswrapper[2561]: W0721 02:11:07.080007    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod49ac06b4_5965_41be_81f2_aef9dfd1e4b3.slice/crio-5f3e182af30e6950f4260ba533085deba70d731226cf5dd2e7d9d93d5178cd3f WatchSource:0}: Error finding container 5f3e182af30e6950f4260ba533085deba70d731226cf5dd2e7d9d93d5178cd3f: Status 404 returned error can't find the container with id 5f3e182af30e6950f4260ba533085deba70d731226cf5dd2e7d9d93d5178cd3f
Jul 21 02:11:07.476991 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:07.476896    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-6ws2c" event={"ID":"49ac06b4-5965-41be-81f2-aef9dfd1e4b3","Type":"ContainerStarted","Data":"9e35769f8c5e5894561b8d839d4360eb69fad673edbbd5925ffe8add4710bf58"}
Jul 21 02:11:07.476991 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:07.476985    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-6ws2c" event={"ID":"49ac06b4-5965-41be-81f2-aef9dfd1e4b3","Type":"ContainerStarted","Data":"5f3e182af30e6950f4260ba533085deba70d731226cf5dd2e7d9d93d5178cd3f"}
Jul 21 02:11:07.477282 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:07.477030    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-6ws2c"
Jul 21 02:11:07.494519 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:07.494470    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-6ws2c" podStartSLOduration=1.494455745 podStartE2EDuration="1.494455745s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 02:11:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:11:07.493921897 +0000 UTC m=+2937.224290580" watchObservedRunningTime="2026-07-21 02:11:07.494455745 +0000 UTC m=+2937.224824411"
Jul 21 02:11:09.020484 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:09.020454    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qhbcs_098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd/dns/0.log"
Jul 21 02:11:09.039930 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:09.039904    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qhbcs_098fdc6d-6eb4-40e7-b29a-7ca1ad9cf4fd/kube-rbac-proxy/0.log"
Jul 21 02:11:09.154183 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:09.154152    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4zvd6_8ab4dce6-4fd1-4202-8c35-08253d62ae38/dns-node-resolver/0.log"
Jul 21 02:11:09.702421 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:09.702387    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-8ccddf454-2zz49_7a451f56-01d4-4ab3-af25-470792468eec/registry/0.log"
Jul 21 02:11:09.746247 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:09.746190    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cfqrc_f31b4061-dd8c-44fa-bd6c-601d8f373be2/node-ca/0.log"
Jul 21 02:11:10.811881 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:10.811847    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-wzf5m_4c368a1b-8af1-4f86-84ee-1c46e4f49f9f/discovery/0.log"
Jul 21 02:11:10.946902 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:10.946878    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-tmj65_05cff6b0-bed4-4162-ae3c-83f1c75feb3d/payload-pre-processing/0.log"
Jul 21 02:11:11.704761 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:11.704731    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kmmsr_9056ad83-0493-4340-9642-90030b3c4ad0/serve-healthcheck-canary/0.log"
Jul 21 02:11:12.264134 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:12.264104    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sfq2c_df3bdff2-1267-40ea-8f92-4e201393382f/kube-rbac-proxy/0.log"
Jul 21 02:11:12.281255 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:12.281224    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sfq2c_df3bdff2-1267-40ea-8f92-4e201393382f/exporter/0.log"
Jul 21 02:11:12.298455 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:12.298432    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sfq2c_df3bdff2-1267-40ea-8f92-4e201393382f/extractor/0.log"
Jul 21 02:11:13.491576 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:13.491547    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-whjhw/perf-node-gather-daemonset-6ws2c"
Jul 21 02:11:15.125909 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:15.125878    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74c7b5f9f-bx7mf_ec96e083-a540-4ac3-8899-c04e96d9225f/manager/0.log"
Jul 21 02:11:15.140745 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:15.140722    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74c7b5f9f-bx7mf_ec96e083-a540-4ac3-8899-c04e96d9225f/copy-manifests/0.log"
Jul 21 02:11:16.601843 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:16.601811    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7c984b598c-2hmct_ef6d1e0c-cf5b-4a58-a05c-bf6e60436c5f/manager/0.log"
Jul 21 02:11:17.507150 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:17.507118    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-wzf5m_4c368a1b-8af1-4f86-84ee-1c46e4f49f9f/discovery/0.log"
Jul 21 02:11:17.621436 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:17.621410    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-tmj65_05cff6b0-bed4-4162-ae3c-83f1c75feb3d/payload-pre-processing/0.log"
Jul 21 02:11:19.002102 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:19.002068    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-wzf5m_4c368a1b-8af1-4f86-84ee-1c46e4f49f9f/discovery/0.log"
Jul 21 02:11:19.105125 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:19.105092    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-tmj65_05cff6b0-bed4-4162-ae3c-83f1c75feb3d/payload-pre-processing/0.log"
Jul 21 02:11:21.666220 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:21.666179    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-lmh88_a5111c80-940a-4c22-8960-63f1ace7b1d4/migrator/0.log"
Jul 21 02:11:21.684468 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:21.684444    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-lmh88_a5111c80-940a-4c22-8960-63f1ace7b1d4/graceful-termination/0.log"
Jul 21 02:11:22.973633 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:22.973554    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-48xjv_48754e37-1055-42a7-9cc3-7c3b78735407/kube-multus/0.log"
Jul 21 02:11:22.994705 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:22.994685    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2gzwb_2ce45c65-d65b-4537-8de3-1bc541026538/kube-multus-additional-cni-plugins/0.log"
Jul 21 02:11:23.012888 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:23.012863    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2gzwb_2ce45c65-d65b-4537-8de3-1bc541026538/egress-router-binary-copy/0.log"
Jul 21 02:11:23.030416 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:23.030395    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2gzwb_2ce45c65-d65b-4537-8de3-1bc541026538/cni-plugins/0.log"
Jul 21 02:11:23.049884 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:23.049863    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2gzwb_2ce45c65-d65b-4537-8de3-1bc541026538/bond-cni-plugin/0.log"
Jul 21 02:11:23.076546 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:23.076516    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2gzwb_2ce45c65-d65b-4537-8de3-1bc541026538/routeoverride-cni/0.log"
Jul 21 02:11:23.095517 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:23.095492    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2gzwb_2ce45c65-d65b-4537-8de3-1bc541026538/whereabouts-cni-bincopy/0.log"
Jul 21 02:11:23.113603 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:23.113575    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2gzwb_2ce45c65-d65b-4537-8de3-1bc541026538/whereabouts-cni/0.log"
Jul 21 02:11:23.517312 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:23.517287    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6j8g9_8d45da68-d967-4df2-9623-2aec040ab204/network-metrics-daemon/0.log"
Jul 21 02:11:23.533144 ip-10-0-128-147 kubenswrapper[2561]: I0721 02:11:23.533117    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6j8g9_8d45da68-d967-4df2-9623-2aec040ab204/kube-rbac-proxy/0.log"