Jul 13 20:51:42.728091 ip-10-0-137-162 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 13 20:51:42.728103 ip-10-0-137-162 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 13 20:51:42.728110 ip-10-0-137-162 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 13 20:51:42.728355 ip-10-0-137-162 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 13 20:51:52.248223 ip-10-0-137-162 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found.
Jul 13 20:51:52.248240 ip-10-0-137-162 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 8d145cba0e4046fb88692e9e0d99fadc --
Jul 13 20:53:45.083453 ip-10-0-137-162 systemd[1]: Starting Kubernetes Kubelet...
Jul 13 20:53:47.355694 ip-10-0-137-162 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 20:53:47.355694 ip-10-0-137-162 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 13 20:53:47.355694 ip-10-0-137-162 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 20:53:47.355694 ip-10-0-137-162 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 13 20:53:47.355694 ip-10-0-137-162 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 20:53:47.356894 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.356791    2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 13 20:53:47.361024 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361008    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 20:53:47.361024 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361024    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 20:53:47.361090 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361028    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 20:53:47.361090 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361033    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 20:53:47.361090 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361038    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 20:53:47.361090 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361041    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 20:53:47.361090 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361045    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 20:53:47.361090 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361047    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 20:53:47.361090 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361050    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 20:53:47.361090 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361053    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 20:53:47.361090 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361056    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 20:53:47.361090 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361058    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 20:53:47.361090 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361061    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 20:53:47.361090 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361064    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 20:53:47.361090 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361070    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 20:53:47.361090 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361073    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 20:53:47.361090 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361076    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 20:53:47.361090 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361079    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 20:53:47.361090 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361081    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 20:53:47.361090 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361084    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 20:53:47.361090 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361086    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 20:53:47.361533 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361089    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 20:53:47.361533 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361092    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 20:53:47.361533 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361095    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 20:53:47.361533 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361098    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 20:53:47.361533 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361101    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 20:53:47.361533 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361104    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 20:53:47.361533 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361108    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 20:53:47.361533 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361111    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 20:53:47.361533 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361114    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 20:53:47.361533 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361118    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 20:53:47.361533 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361121    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 20:53:47.361533 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361123    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 20:53:47.361533 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361127    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 20:53:47.361533 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361129    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 20:53:47.361533 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361132    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 20:53:47.361533 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361134    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 20:53:47.361533 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361137    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 20:53:47.361533 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361139    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 20:53:47.361533 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361142    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 20:53:47.361533 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361144    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 20:53:47.362053 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361147    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 20:53:47.362053 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361150    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 20:53:47.362053 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361152    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 20:53:47.362053 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361156    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 20:53:47.362053 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361158    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 20:53:47.362053 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361161    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 20:53:47.362053 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361163    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 20:53:47.362053 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361166    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 20:53:47.362053 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361168    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 20:53:47.362053 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361171    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 20:53:47.362053 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361173    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 20:53:47.362053 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361176    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 20:53:47.362053 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361179    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 20:53:47.362053 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361182    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 20:53:47.362053 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361185    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 20:53:47.362053 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361187    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 20:53:47.362053 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361190    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 20:53:47.362053 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361193    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 20:53:47.362053 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361196    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 20:53:47.362053 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361198    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 20:53:47.362545 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361201    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 20:53:47.362545 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361204    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 20:53:47.362545 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361206    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 20:53:47.362545 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361209    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 20:53:47.362545 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361211    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 20:53:47.362545 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361215    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 20:53:47.362545 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361219    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 20:53:47.362545 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361221    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 20:53:47.362545 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361224    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 20:53:47.362545 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361227    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 20:53:47.362545 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361229    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 20:53:47.362545 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361232    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 20:53:47.362545 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361236    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 20:53:47.362545 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361238    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 20:53:47.362545 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361241    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 20:53:47.362545 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361243    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 20:53:47.362545 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361247    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 20:53:47.362545 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361250    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 20:53:47.362545 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361253    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 20:53:47.362545 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361255    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 20:53:47.363038 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361258    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 20:53:47.363038 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361260    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 20:53:47.363038 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361263    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 20:53:47.363038 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361266    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 20:53:47.363038 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361268    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 20:53:47.363038 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361272    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 20:53:47.363038 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361274    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 20:53:47.363038 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361277    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 20:53:47.363038 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361280    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 20:53:47.363038 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361283    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 20:53:47.363038 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361286    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 20:53:47.363038 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361288    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 20:53:47.363038 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361291    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 20:53:47.363038 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361294    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 20:53:47.363038 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361296    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 20:53:47.363038 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361299    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 20:53:47.363038 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361301    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 20:53:47.363038 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.361304    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 20:53:47.363038 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362024    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 20:53:47.363038 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362031    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 20:53:47.363521 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362034    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 20:53:47.363521 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362036    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 20:53:47.363521 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362039    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 20:53:47.363521 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362042    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 20:53:47.363521 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362045    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 20:53:47.363521 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362047    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 20:53:47.363521 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362050    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 20:53:47.363521 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362053    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 20:53:47.363521 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362063    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 20:53:47.363521 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362067    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 20:53:47.363521 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362070    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 20:53:47.363521 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362073    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 20:53:47.363521 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362076    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 20:53:47.363521 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362078    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 20:53:47.363521 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362081    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 20:53:47.363521 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362084    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 20:53:47.363521 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362088    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 20:53:47.363521 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362091    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 20:53:47.363521 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362094    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 20:53:47.363521 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362096    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 20:53:47.364036 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362101    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 20:53:47.364036 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362104    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 20:53:47.364036 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362108    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 20:53:47.364036 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362112    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 20:53:47.364036 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362115    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 20:53:47.364036 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362118    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 20:53:47.364036 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362122    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 20:53:47.364036 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362125    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 20:53:47.364036 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362127    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 20:53:47.364036 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362130    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 20:53:47.364036 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362132    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 20:53:47.364036 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362135    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 20:53:47.364036 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362137    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 20:53:47.364036 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362140    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 20:53:47.364036 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362143    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 20:53:47.364036 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362145    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 20:53:47.364036 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362148    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 20:53:47.364036 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362150    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 20:53:47.364036 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362153    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 20:53:47.364490 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362155    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 20:53:47.364490 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362158    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 20:53:47.364490 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362160    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 20:53:47.364490 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362164    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 20:53:47.364490 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362166    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 20:53:47.364490 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362169    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 20:53:47.364490 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362171    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 20:53:47.364490 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362174    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 20:53:47.364490 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362176    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 20:53:47.364490 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362180    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 20:53:47.364490 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362184    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 20:53:47.364490 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362188    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 20:53:47.364490 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362190    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 20:53:47.364490 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362193    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 20:53:47.364490 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362195    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 20:53:47.364490 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362198    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 20:53:47.364490 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362200    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 20:53:47.364490 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362203    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 20:53:47.364490 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362205    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 20:53:47.364490 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362208    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 20:53:47.365024 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362211    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 20:53:47.365024 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362213    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 20:53:47.365024 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362216    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 20:53:47.365024 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362218    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 20:53:47.365024 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362221    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 20:53:47.365024 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362223    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 20:53:47.365024 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362225    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 20:53:47.365024 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362228    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 20:53:47.365024 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362231    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 20:53:47.365024 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362235    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 20:53:47.365024 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362237    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 20:53:47.365024 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362240    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 20:53:47.365024 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362242    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 20:53:47.365024 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362245    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 20:53:47.365024 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362247    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 20:53:47.365024 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362250    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 20:53:47.365024 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362253    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 20:53:47.365024 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362256    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 20:53:47.365024 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362258    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 20:53:47.365024 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362261    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 20:53:47.365510 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362263    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 20:53:47.365510 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362266    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 20:53:47.365510 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362269    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 20:53:47.365510 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362272    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 20:53:47.365510 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362275    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 20:53:47.365510 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362277    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 20:53:47.365510 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362280    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 20:53:47.365510 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362283    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 20:53:47.365510 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362285    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 20:53:47.365510 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362288    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 20:53:47.365510 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362290    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 20:53:47.365510 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362293    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 20:53:47.365510 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362295    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 20:53:47.365510 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362298    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 20:53:47.365510 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362301    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 20:53:47.365510 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362303    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 20:53:47.365510 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362305    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 20:53:47.365510 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362308    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 20:53:47.365510 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362696    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 20:53:47.365510 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362702    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 20:53:47.366005 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362705    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 20:53:47.366005 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362708    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 20:53:47.366005 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362711    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 20:53:47.366005 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362714    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 20:53:47.366005 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362716    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 20:53:47.366005 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362719    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 20:53:47.366005 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362722    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 20:53:47.366005 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362725    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 20:53:47.366005 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362729    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 20:53:47.366005 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362732    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 20:53:47.366005 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362735    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 20:53:47.366005 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362738    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 20:53:47.366005 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362740    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 20:53:47.366005 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362744    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 20:53:47.366005 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362747    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 20:53:47.366005 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362750    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 20:53:47.366005 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362752    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 20:53:47.366005 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362755    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 20:53:47.366005 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362757    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 20:53:47.366005 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362760    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 20:53:47.366485 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362762    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 20:53:47.366485 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362765    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 20:53:47.366485 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362767    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 20:53:47.366485 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362770    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 20:53:47.366485 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362773    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 20:53:47.366485 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362775    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 20:53:47.366485 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362778    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 20:53:47.366485 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362780    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 20:53:47.366485 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362783    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 20:53:47.366485 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362785    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 20:53:47.366485 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362788    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 20:53:47.366485 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362790    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 20:53:47.366485 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362792    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 20:53:47.366485 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362795    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 20:53:47.366485 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362797    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 20:53:47.366485 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362800    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 20:53:47.366485 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362802    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 20:53:47.366485 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362804    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 20:53:47.366485 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362807    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 20:53:47.366485 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362824    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 20:53:47.367002 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362827    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 20:53:47.367002 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362836    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 20:53:47.367002 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362839    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 20:53:47.367002 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362841    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 20:53:47.367002 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362844    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 20:53:47.367002 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362849    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 20:53:47.367002 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362851    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 20:53:47.367002 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362854    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 20:53:47.367002 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362856    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 20:53:47.367002 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362859    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 20:53:47.367002 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362862    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 20:53:47.367002 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362864    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 20:53:47.367002 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362866    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 20:53:47.367002 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362869    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 20:53:47.367002 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362871    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 20:53:47.367002 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362874    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 20:53:47.367002 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362877    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 20:53:47.367002 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362881    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 20:53:47.367002 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362884    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 20:53:47.367450 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362887    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 20:53:47.367450 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362890    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 20:53:47.367450 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362892    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 20:53:47.367450 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362895    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 20:53:47.367450 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362898    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 20:53:47.367450 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362901    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 20:53:47.367450 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362903    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 20:53:47.367450 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362906    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 20:53:47.367450 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362908    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 20:53:47.367450 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362911    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 20:53:47.367450 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362913    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 20:53:47.367450 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362916    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 20:53:47.367450 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362918    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 20:53:47.367450 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362923    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 20:53:47.367450 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362926    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 20:53:47.367450 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362931    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 20:53:47.367450 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362933    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 20:53:47.367450 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362936    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 20:53:47.367450 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362941    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 20:53:47.367908 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362944    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 20:53:47.367908 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362947    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 20:53:47.367908 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362950    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 20:53:47.367908 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362952    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 20:53:47.367908 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362955    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 20:53:47.367908 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362958    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 20:53:47.367908 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362960    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 20:53:47.367908 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362963    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 20:53:47.367908 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362966    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 20:53:47.367908 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362968    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 20:53:47.367908 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362971    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 20:53:47.367908 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362973    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 20:53:47.367908 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362976    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 20:53:47.367908 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362980    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 20:53:47.367908 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362983    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 20:53:47.367908 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362986    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 20:53:47.367908 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362989    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 20:53:47.367908 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362992    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 20:53:47.367908 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.362994    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 20:53:47.368356 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363064    2561 flags.go:64] FLAG: --address="0.0.0.0"
Jul 13 20:53:47.368356 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363071    2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 13 20:53:47.368356 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363078    2561 flags.go:64] FLAG: --anonymous-auth="true"
Jul 13 20:53:47.368356 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363082    2561 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 13 20:53:47.368356 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363088    2561 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 13 20:53:47.368356 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363092    2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 13 20:53:47.368356 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363096    2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 13 20:53:47.368356 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363100    2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 13 20:53:47.368356 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363104    2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 13 20:53:47.368356 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363107    2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 13 20:53:47.368356 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363111    2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 13 20:53:47.368356 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363114    2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 13 20:53:47.368356 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363119    2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 13 20:53:47.368356 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363122    2561 flags.go:64] FLAG: --cgroup-root=""
Jul 13 20:53:47.368356 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363125    2561 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 13 20:53:47.368356 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363127    2561 flags.go:64] FLAG: --client-ca-file=""
Jul 13 20:53:47.368356 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363130    2561 flags.go:64] FLAG: --cloud-provider="external"
Jul 13 20:53:47.368356 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363133    2561 flags.go:64] FLAG: --cluster-dns="[]"
Jul 13 20:53:47.368356 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363137    2561 flags.go:64] FLAG: --cluster-domain=""
Jul 13 20:53:47.368356 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363140    2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 13 20:53:47.368356 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363143    2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 13 20:53:47.368356 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363146    2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 13 20:53:47.368356 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363149    2561 flags.go:64] FLAG: --container-log-max-files="5"
Jul 13 20:53:47.368356 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363153    2561 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 13 20:53:47.369043 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363156    2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 13 20:53:47.369043 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363159    2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 13 20:53:47.369043 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363162    2561 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 13 20:53:47.369043 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363165    2561 flags.go:64] FLAG: --contention-profiling="false"
Jul 13 20:53:47.369043 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363168    2561 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 13 20:53:47.369043 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363171    2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 13 20:53:47.369043 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363174    2561 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 13 20:53:47.369043 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363176    2561 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 13 20:53:47.369043 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363181    2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 13 20:53:47.369043 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363184    2561 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 13 20:53:47.369043 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363186    2561 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 13 20:53:47.369043 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363189    2561 flags.go:64] FLAG: --enable-load-reader="false"
Jul 13 20:53:47.369043 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363193    2561 flags.go:64] FLAG: --enable-server="true"
Jul 13 20:53:47.369043 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363196    2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 13 20:53:47.369043 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363201    2561 flags.go:64] FLAG: --event-burst="100"
Jul 13 20:53:47.369043 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363204    2561 flags.go:64] FLAG: --event-qps="50"
Jul 13 20:53:47.369043 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363207    2561 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 13 20:53:47.369043 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363210    2561 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 13 20:53:47.369043 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363213    2561 flags.go:64] FLAG: --eviction-hard=""
Jul 13 20:53:47.369043 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363220    2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 13 20:53:47.369043 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363225    2561 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 13 20:53:47.369043 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363229    2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 13 20:53:47.369043 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363232    2561 flags.go:64] FLAG: --eviction-soft=""
Jul 13 20:53:47.369043 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363235    2561 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 13 20:53:47.369043 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363238    2561 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 13 20:53:47.369690 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363241    2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 13 20:53:47.369690 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363243    2561 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 13 20:53:47.369690 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363246    2561 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 13 20:53:47.369690 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363249    2561 flags.go:64] FLAG: --fail-swap-on="true"
Jul 13 20:53:47.369690 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363252    2561 flags.go:64] FLAG: --feature-gates=""
Jul 13 20:53:47.369690 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363255    2561 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 13 20:53:47.369690 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363258    2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 13 20:53:47.369690 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363261    2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 13 20:53:47.369690 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363264    2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 13 20:53:47.369690 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363267    2561 flags.go:64] FLAG: --healthz-port="10248"
Jul 13 20:53:47.369690 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363270    2561 flags.go:64] FLAG: --help="false"
Jul 13 20:53:47.369690 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363273    2561 flags.go:64] FLAG: --hostname-override="ip-10-0-137-162.ec2.internal"
Jul 13 20:53:47.369690 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363276    2561 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 13 20:53:47.369690 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363278    2561 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 13 20:53:47.369690 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363281    2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 13 20:53:47.369690 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363285    2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 13 20:53:47.369690 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363288    2561 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 13 20:53:47.369690 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363291    2561 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 13 20:53:47.369690 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363294    2561 flags.go:64] FLAG: --image-service-endpoint=""
Jul 13 20:53:47.369690 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363298    2561 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 13 20:53:47.369690 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363301    2561 flags.go:64] FLAG: --kube-api-burst="100"
Jul 13 20:53:47.369690 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363304    2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 13 20:53:47.369690 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363306    2561 flags.go:64] FLAG: --kube-api-qps="50"
Jul 13 20:53:47.369690 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363309    2561 flags.go:64] FLAG: --kube-reserved=""
Jul 13 20:53:47.370337 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363312    2561 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 13 20:53:47.370337 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363315    2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 13 20:53:47.370337 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363318    2561 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 13 20:53:47.370337 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363328    2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 13 20:53:47.370337 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363331    2561 flags.go:64] FLAG: --lock-file=""
Jul 13 20:53:47.370337 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363334    2561 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 13 20:53:47.370337 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363337    2561 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 13 20:53:47.370337 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363340    2561 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 13 20:53:47.370337 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363346    2561 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 13 20:53:47.370337 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363349    2561 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 13 20:53:47.370337 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363351    2561 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 13 20:53:47.370337 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363354    2561 flags.go:64] FLAG: --logging-format="text"
Jul 13 20:53:47.370337 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363357    2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 13 20:53:47.370337 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363360    2561 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 13 20:53:47.370337 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363363    2561 flags.go:64] FLAG: --manifest-url=""
Jul 13 20:53:47.370337 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363366    2561 flags.go:64] FLAG: --manifest-url-header=""
Jul 13 20:53:47.370337 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363370    2561 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 13 20:53:47.370337 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363373    2561 flags.go:64] FLAG: --max-open-files="1000000"
Jul 13 20:53:47.370337 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363377    2561 flags.go:64] FLAG: --max-pods="110"
Jul 13 20:53:47.370337 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363380    2561 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 13 20:53:47.370337 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363383    2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 13 20:53:47.370337 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363386    2561 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 13 20:53:47.370337 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363389    2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 13 20:53:47.370337 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363392    2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 13 20:53:47.370337 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363395    2561 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 13 20:53:47.370968 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363398    2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 13 20:53:47.370968 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363405    2561 flags.go:64] FLAG: --node-status-max-images="50"
Jul 13 20:53:47.370968 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363409    2561 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 13 20:53:47.370968 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363412    2561 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 13 20:53:47.370968 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363415    2561 flags.go:64] FLAG: --pod-cidr=""
Jul 13 20:53:47.370968 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363418    2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 13 20:53:47.370968 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363423    2561 flags.go:64] FLAG: --pod-manifest-path=""
Jul 13 20:53:47.370968 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363426    2561 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 13 20:53:47.370968 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363429    2561 flags.go:64] FLAG: --pods-per-core="0"
Jul 13 20:53:47.370968 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363432    2561 flags.go:64] FLAG: --port="10250"
Jul 13 20:53:47.370968 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363435    2561 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 13 20:53:47.370968 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363445    2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0184a23ea1372cd1e"
Jul 13 20:53:47.370968 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363449    2561 flags.go:64] FLAG: --qos-reserved=""
Jul 13 20:53:47.370968 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363452    2561 flags.go:64] FLAG: --read-only-port="10255"
Jul 13 20:53:47.370968 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363455    2561 flags.go:64] FLAG: --register-node="true"
Jul 13 20:53:47.370968 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363458    2561 flags.go:64] FLAG: --register-with-taints=""
Jul 13 20:53:47.370968 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363461    2561 flags.go:64] FLAG: --registry-burst="10"
Jul 13 20:53:47.370968 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363464    2561 flags.go:64] FLAG: --registry-qps="5"
Jul 13 20:53:47.370968 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363467    2561 flags.go:64] FLAG: --reserved-cpus=""
Jul 13 20:53:47.370968 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363470    2561 flags.go:64] FLAG: --reserved-memory=""
Jul 13 20:53:47.370968 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363474    2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 13 20:53:47.370968 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363477    2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 13 20:53:47.370968 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363480    2561 flags.go:64] FLAG: --rotate-certificates="false"
Jul 13 20:53:47.370968 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363482    2561 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 13 20:53:47.370968 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363485    2561 flags.go:64] FLAG: --runonce="false"
Jul 13 20:53:47.371569 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363488    2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 13 20:53:47.371569 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363491    2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 13 20:53:47.371569 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363494    2561 flags.go:64] FLAG: --seccomp-default="false"
Jul 13 20:53:47.371569 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363496    2561 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 13 20:53:47.371569 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363499    2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 13 20:53:47.371569 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363502    2561 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 13 20:53:47.371569 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363505    2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 13 20:53:47.371569 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363508    2561 flags.go:64] FLAG: --storage-driver-password="root"
Jul 13 20:53:47.371569 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363511    2561 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 13 20:53:47.371569 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363515    2561 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 13 20:53:47.371569 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363518    2561 flags.go:64] FLAG: --storage-driver-user="root"
Jul 13 20:53:47.371569 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363520    2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 13 20:53:47.371569 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363523    2561 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 13 20:53:47.371569 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363534    2561 flags.go:64] FLAG: --system-cgroups=""
Jul 13 20:53:47.371569 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363537    2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 13 20:53:47.371569 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363542    2561 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 13 20:53:47.371569 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363545    2561 flags.go:64] FLAG: --tls-cert-file=""
Jul 13 20:53:47.371569 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363548    2561 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 13 20:53:47.371569 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363552    2561 flags.go:64] FLAG: --tls-min-version=""
Jul 13 20:53:47.371569 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363562    2561 flags.go:64] FLAG: --tls-private-key-file=""
Jul 13 20:53:47.371569 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363565    2561 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 13 20:53:47.371569 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363568    2561 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 13 20:53:47.371569 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363570    2561 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 13 20:53:47.371569 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363573    2561 flags.go:64] FLAG: --v="2"
Jul 13 20:53:47.371569 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363577    2561 flags.go:64] FLAG: --version="false"
Jul 13 20:53:47.372193 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363581    2561 flags.go:64] FLAG: --vmodule=""
Jul 13 20:53:47.372193 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363584    2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 13 20:53:47.372193 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.363587    2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 13 20:53:47.372193 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363707    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 20:53:47.372193 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363710    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 20:53:47.372193 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363713    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 20:53:47.372193 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363715    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 20:53:47.372193 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363718    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 20:53:47.372193 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363721    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 20:53:47.372193 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363724    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 20:53:47.372193 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363726    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 20:53:47.372193 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363729    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 20:53:47.372193 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363731    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 20:53:47.372193 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363734    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 20:53:47.372193 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363736    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 20:53:47.372193 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363739    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 20:53:47.372193 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363742    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 20:53:47.372193 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363745    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 20:53:47.372193 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363747    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 20:53:47.372193 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363750    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 20:53:47.372681 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363752    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 20:53:47.372681 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363755    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 20:53:47.372681 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363757    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 20:53:47.372681 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363761    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 20:53:47.372681 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363764    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 20:53:47.372681 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363767    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 20:53:47.372681 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363770    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 20:53:47.372681 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363774    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 20:53:47.372681 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363776    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 20:53:47.372681 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363779    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 20:53:47.372681 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363782    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 20:53:47.372681 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363785    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 20:53:47.372681 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363787    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 20:53:47.372681 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363790    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 20:53:47.372681 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363792    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 20:53:47.372681 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363795    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 20:53:47.372681 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363797    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 20:53:47.372681 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363800    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 20:53:47.372681 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363802    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 20:53:47.372681 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363805    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 20:53:47.373180 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363807    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 20:53:47.373180 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363823    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 20:53:47.373180 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363826    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 20:53:47.373180 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363828    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 20:53:47.373180 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363831    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 20:53:47.373180 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363834    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 20:53:47.373180 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363836    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 20:53:47.373180 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363839    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 20:53:47.373180 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363842    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 20:53:47.373180 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363845    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 20:53:47.373180 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363847    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 20:53:47.373180 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363850    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 20:53:47.373180 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363852    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 20:53:47.373180 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363855    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 20:53:47.373180 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363857    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 20:53:47.373180 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363860    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 20:53:47.373180 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363863    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 20:53:47.373180 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363865    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 20:53:47.373180 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363868    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 20:53:47.373180 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363870    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 20:53:47.373700 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363874    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 20:53:47.373700 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363876    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 20:53:47.373700 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363879    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 20:53:47.373700 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363881    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 20:53:47.373700 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363884    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 20:53:47.373700 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363886    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 20:53:47.373700 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363889    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 20:53:47.373700 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363891    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 20:53:47.373700 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363893    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 20:53:47.373700 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363896    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 20:53:47.373700 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363898    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 20:53:47.373700 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363901    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 20:53:47.373700 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363903    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 20:53:47.373700 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363906    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 20:53:47.373700 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363910    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 20:53:47.373700 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363913    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 20:53:47.373700 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363916    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 20:53:47.373700 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363918    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 20:53:47.373700 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363921    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 20:53:47.374178 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363923    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 20:53:47.374178 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363926    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 20:53:47.374178 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363929    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 20:53:47.374178 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363932    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 20:53:47.374178 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363936    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 20:53:47.374178 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363939    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 20:53:47.374178 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363942    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 20:53:47.374178 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363945    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 20:53:47.374178 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363948    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 20:53:47.374178 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363951    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 20:53:47.374178 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363953    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 20:53:47.374178 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363956    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 20:53:47.374178 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363959    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 20:53:47.374178 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363962    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 20:53:47.374178 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363965    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 20:53:47.374178 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363967    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 20:53:47.374178 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363970    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 20:53:47.374178 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363972    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 20:53:47.374178 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363975    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 20:53:47.374178 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363977    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 20:53:47.374659 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363980    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 20:53:47.374659 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363982    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 20:53:47.374659 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.363984    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 20:53:47.374659 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.364612    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 20:53:47.374659 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.372515    2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 13 20:53:47.374659 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.372531    2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 13 20:53:47.374659 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.372554    2561 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 13 20:53:47.374659 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.372560    2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 13 20:53:47.374659 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372615    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 20:53:47.374659 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372620    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 20:53:47.374659 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372623    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 20:53:47.374659 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372626    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 20:53:47.374659 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372629    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 20:53:47.374659 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372633    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 20:53:47.374659 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372636    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 20:53:47.375044 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372638    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 20:53:47.375044 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372641    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 20:53:47.375044 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372643    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 20:53:47.375044 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372646    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 20:53:47.375044 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372648    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 20:53:47.375044 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372651    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 20:53:47.375044 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372654    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 20:53:47.375044 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372656    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 20:53:47.375044 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372659    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 20:53:47.375044 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372662    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 20:53:47.375044 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372665    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 20:53:47.375044 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372669    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 20:53:47.375044 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372673    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 20:53:47.375044 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372676    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 20:53:47.375044 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372679    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 20:53:47.375044 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372682    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 20:53:47.375044 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372686    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 20:53:47.375044 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372689    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 20:53:47.375044 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372692    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 20:53:47.375499 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372695    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 20:53:47.375499 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372697    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 20:53:47.375499 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372700    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 20:53:47.375499 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372705    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 20:53:47.375499 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372708    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 20:53:47.375499 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372710    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 20:53:47.375499 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372713    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 20:53:47.375499 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372716    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 20:53:47.375499 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372718    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 20:53:47.375499 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372721    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 20:53:47.375499 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372723    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 20:53:47.375499 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372726    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 20:53:47.375499 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372728    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 20:53:47.375499 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372731    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 20:53:47.375499 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372734    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 20:53:47.375499 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372736    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 20:53:47.375499 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372740    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 20:53:47.375499 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372744    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 20:53:47.375499 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372747    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 20:53:47.375970 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372750    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 20:53:47.375970 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372754    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 20:53:47.375970 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372757    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 20:53:47.375970 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372760    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 20:53:47.375970 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372763    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 20:53:47.375970 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372765    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 20:53:47.375970 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372768    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 20:53:47.375970 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372770    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 20:53:47.375970 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372773    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 20:53:47.375970 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372775    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 20:53:47.375970 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372778    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 20:53:47.375970 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372781    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 20:53:47.375970 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372783    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 20:53:47.375970 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372786    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 20:53:47.375970 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372789    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 20:53:47.375970 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372791    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 20:53:47.375970 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372795    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 20:53:47.375970 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372798    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 20:53:47.375970 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372801    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 20:53:47.375970 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372803    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 20:53:47.376451 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372806    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 20:53:47.376451 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372825    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 20:53:47.376451 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372828    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 20:53:47.376451 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372832    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 20:53:47.376451 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372835    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 20:53:47.376451 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372838    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 20:53:47.376451 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372840    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 20:53:47.376451 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372843    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 20:53:47.376451 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372846    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 20:53:47.376451 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372848    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 20:53:47.376451 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372851    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 20:53:47.376451 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372853    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 20:53:47.376451 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372856    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 20:53:47.376451 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372858    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 20:53:47.376451 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372861    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 20:53:47.376451 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372864    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 20:53:47.376451 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372866    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 20:53:47.376451 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372869    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 20:53:47.376451 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372871    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 20:53:47.376451 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372874    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 20:53:47.376955 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372876    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 20:53:47.376955 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372879    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 20:53:47.376955 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372881    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 20:53:47.376955 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372883    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 20:53:47.376955 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372886    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 20:53:47.376955 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372889    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 20:53:47.376955 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372891    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 20:53:47.376955 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372894    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 20:53:47.376955 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372897    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 20:53:47.376955 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372900    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 20:53:47.376955 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372903    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 20:53:47.376955 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372906    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 20:53:47.376955 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372908    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 20:53:47.376955 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.372911    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 20:53:47.376955 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.372916    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 20:53:47.377316 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373047    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 20:53:47.377316 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373052    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 20:53:47.377316 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373055    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 20:53:47.377316 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373059    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 20:53:47.377316 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373063    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 20:53:47.377316 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373066    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 20:53:47.377316 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373069    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 20:53:47.377316 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373071    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 20:53:47.377316 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373074    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 20:53:47.377316 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373076    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 20:53:47.377316 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373079    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 20:53:47.377316 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373081    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 20:53:47.377316 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373084    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 20:53:47.377316 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373086    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 20:53:47.377316 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373089    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 20:53:47.377316 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373091    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 20:53:47.377316 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373094    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 20:53:47.377316 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373096    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 20:53:47.377316 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373099    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 20:53:47.377316 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373101    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 20:53:47.377792 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373103    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 20:53:47.377792 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373106    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 20:53:47.377792 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373108    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 20:53:47.377792 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373111    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 20:53:47.377792 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373114    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 20:53:47.377792 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373116    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 20:53:47.377792 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373119    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 20:53:47.377792 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373122    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 20:53:47.377792 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373129    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 20:53:47.377792 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373131    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 20:53:47.377792 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373134    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 20:53:47.377792 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373137    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 20:53:47.377792 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373141    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 20:53:47.377792 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373144    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 20:53:47.377792 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373146    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 20:53:47.377792 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373149    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 20:53:47.377792 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373151    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 20:53:47.377792 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373154    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 20:53:47.377792 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373156    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 20:53:47.377792 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373159    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 20:53:47.378378 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373161    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 20:53:47.378378 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373163    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 20:53:47.378378 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373166    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 20:53:47.378378 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373168    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 20:53:47.378378 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373171    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 20:53:47.378378 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373173    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 20:53:47.378378 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373175    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 20:53:47.378378 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373178    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 20:53:47.378378 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373181    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 20:53:47.378378 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373184    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 20:53:47.378378 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373186    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 20:53:47.378378 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373189    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 20:53:47.378378 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373192    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 20:53:47.378378 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373195    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 20:53:47.378378 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373197    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 20:53:47.378378 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373200    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 20:53:47.378378 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373202    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 20:53:47.378378 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373205    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 20:53:47.378378 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373208    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 20:53:47.378378 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373210    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 20:53:47.378865 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373213    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 20:53:47.378865 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373216    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 20:53:47.378865 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373219    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 20:53:47.378865 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373221    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 20:53:47.378865 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373224    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 20:53:47.378865 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373226    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 20:53:47.378865 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373229    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 20:53:47.378865 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373231    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 20:53:47.378865 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373234    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 20:53:47.378865 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373236    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 20:53:47.378865 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373239    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 20:53:47.378865 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373241    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 20:53:47.378865 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373244    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 20:53:47.378865 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373246    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 20:53:47.378865 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373249    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 20:53:47.378865 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373251    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 20:53:47.378865 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373254    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 20:53:47.378865 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373256    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 20:53:47.378865 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373259    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 20:53:47.378865 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373262    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 20:53:47.379519 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373264    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 20:53:47.379519 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373267    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 20:53:47.379519 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373269    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 20:53:47.379519 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373273    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 20:53:47.379519 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373276    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 20:53:47.379519 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373279    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 20:53:47.379519 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373282    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 20:53:47.379519 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373285    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 20:53:47.379519 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373287    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 20:53:47.379519 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373290    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 20:53:47.379519 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373294    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 20:53:47.379519 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373296    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 20:53:47.379519 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373299    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 20:53:47.379519 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373302    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 20:53:47.379519 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373305    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 20:53:47.379519 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373308    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 20:53:47.379519 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373311    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 20:53:47.379519 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373314    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 20:53:47.379519 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:47.373316    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 20:53:47.380258 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.373321    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 20:53:47.380258 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.373428    2561 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 13 20:53:47.380258 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.375508    2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 13 20:53:47.380258 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.376770    2561 server.go:1019] "Starting client certificate rotation"
Jul 13 20:53:47.380258 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.376873    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 13 20:53:47.380258 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.376911    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 13 20:53:47.381561 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.381543    2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 13 20:53:47.382699 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.382681    2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 13 20:53:47.392993 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.392972    2561 log.go:25] "Validated CRI v1 runtime API"
Jul 13 20:53:47.394924 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.394909    2561 log.go:25] "Validated CRI v1 image API"
Jul 13 20:53:47.395694 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.395678    2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 13 20:53:47.397993 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.397974    2561 fs.go:135] Filesystem UUIDs: map[6b708f16-e1a9-4175-b61b-b51ab4f0786d:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 def6b5f6-e9d0-473f-a6b1-809a4af05a5d:/dev/nvme0n1p3]
Jul 13 20:53:47.398039 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.397993    2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 13 20:53:47.401407 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.401391    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 13 20:53:47.403189 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.403086    2561 manager.go:216] Machine: {Timestamp:2026-07-13 20:53:47.401954746 +0000 UTC m=+0.396738160 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101238 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c08fa69cdcc8c45a9f2dac46c9564 SystemUUID:ec2c08fa-69cd-cc8c-45a9-f2dac46c9564 BootID:8d145cba-0e40-46fb-8869-2e9e0d99fadc Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5f:e4:bb:85:95 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5f:e4:bb:85:95 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:e1:34:42:4e:2d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 13 20:53:47.403189 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.403184    2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 13 20:53:47.403304 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.403266    2561 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 13 20:53:47.405959 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.405935    2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 13 20:53:47.406103 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.405961    2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-162.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 13 20:53:47.406560 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.406550    2561 topology_manager.go:138] "Creating topology manager with none policy"
Jul 13 20:53:47.406596 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.406562    2561 container_manager_linux.go:309] "Creating device plugin manager"
Jul 13 20:53:47.406596 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.406570    2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 13 20:53:47.407103 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.407092    2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 13 20:53:47.408217 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.408207    2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 13 20:53:47.411737 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.411725    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 13 20:53:47.411882 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.411873    2561 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 13 20:53:47.411920 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.411906    2561 kubelet.go:486] "Attempting to sync node with API server"
Jul 13 20:53:47.411950 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.411929    2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 13 20:53:47.411978 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.411952    2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 13 20:53:47.411978 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.411966    2561 kubelet.go:398] "Adding apiserver pod source"
Jul 13 20:53:47.412031 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.411978    2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 13 20:53:47.412382 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.412370    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 13 20:53:47.412424 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.412388    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 13 20:53:47.414685 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.414670    2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 13 20:53:47.417777 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.417757    2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 13 20:53:47.417855 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.417791    2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 13 20:53:47.418050 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.418038    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 13 20:53:47.418106 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.418064    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 13 20:53:47.418106 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.418072    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 13 20:53:47.418106 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.418078    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 13 20:53:47.418106 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.418088    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 13 20:53:47.418106 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.418094    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 13 20:53:47.418497 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.418488    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 13 20:53:47.418547 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.418500    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 13 20:53:47.418547 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.418509    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 13 20:53:47.418547 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.418515    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 13 20:53:47.418547 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.418524    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 13 20:53:47.418547 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.418532    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 13 20:53:47.418708 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.418556    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 13 20:53:47.418708 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.418561    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 13 20:53:47.421755 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.421736    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4s7jj"
Jul 13 20:53:47.422402 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.422380    2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-162.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 13 20:53:47.422537 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.422524    2561 server.go:1268] "Started kubelet"
Jul 13 20:53:47.422693 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.422637    2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 13 20:53:47.422762 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.422712    2561 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 13 20:53:47.422762 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:47.422746    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-162.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 13 20:53:47.422932 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.422885    2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 13 20:53:47.423180 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:47.422911    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 13 20:53:47.423604 ip-10-0-137-162 systemd[1]: Started Kubernetes Kubelet.
Jul 13 20:53:47.424079 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.424061    2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 13 20:53:47.425014 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.425000    2561 server.go:310] "Adding debug handlers to kubelet server"
Jul 13 20:53:47.428318 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:47.428293    2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 13 20:53:47.429788 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.429768    2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 13 20:53:47.429788 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.429776    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 13 20:53:47.429932 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:47.429896    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-162.ec2.internal\" not found"
Jul 13 20:53:47.429932 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.429920    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4s7jj"
Jul 13 20:53:47.430495 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.430428    2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 13 20:53:47.430495 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.430431    2561 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 13 20:53:47.430605 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.430505    2561 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 13 20:53:47.430704 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.430688    2561 reconstruct.go:97] "Volume reconstruction finished"
Jul 13 20:53:47.430807 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.430796    2561 reconciler.go:29] "Reconciler: start to sync state"
Jul 13 20:53:47.431095 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.431073    2561 factory.go:153] Registering CRI-O factory
Jul 13 20:53:47.431211 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.431101    2561 factory.go:223] Registration of the crio container factory successfully
Jul 13 20:53:47.431211 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.431151    2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 13 20:53:47.431211 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.431162    2561 factory.go:55] Registering systemd factory
Jul 13 20:53:47.431211 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.431171    2561 factory.go:223] Registration of the systemd container factory successfully
Jul 13 20:53:47.431211 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.431198    2561 factory.go:103] Registering Raw factory
Jul 13 20:53:47.431211 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.431210    2561 manager.go:1196] Started watching for new ooms in manager
Jul 13 20:53:47.431708 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:47.430670    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-162.ec2.internal.18c1f4beba5478fb  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-162.ec2.internal,UID:ip-10-0-137-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-162.ec2.internal,},FirstTimestamp:2026-07-13 20:53:47.422488827 +0000 UTC m=+0.417272241,LastTimestamp:2026-07-13 20:53:47.422488827 +0000 UTC m=+0.417272241,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-162.ec2.internal,}"
Jul 13 20:53:47.431842 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.431795    2561 manager.go:349] Starting recovery of all containers
Jul 13 20:53:47.436711 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.436689    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 20:53:47.439420 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:47.439390    2561 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-162.ec2.internal\" not found" node="ip-10-0-137-162.ec2.internal"
Jul 13 20:53:47.442777 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.442632    2561 manager.go:354] Recovery completed
Jul 13 20:53:47.448202 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.448188    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 20:53:47.450085 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.450069    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-162.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 20:53:47.450163 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.450103    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-162.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 20:53:47.450163 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.450117    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-162.ec2.internal" event="NodeHasSufficientPID"
Jul 13 20:53:47.450578 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.450565    2561 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 13 20:53:47.450578 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.450576    2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 13 20:53:47.450578 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.450578    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 20:53:47.450737 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.450593    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 13 20:53:47.451270 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.451258    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-162.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 20:53:47.451328 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.451286    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-162.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 20:53:47.451328 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.451300    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-162.ec2.internal" event="NodeHasSufficientPID"
Jul 13 20:53:47.451607 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.451596    2561 policy_none.go:49] "None policy: Start"
Jul 13 20:53:47.451648 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.451610    2561 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 13 20:53:47.451648 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.451621    2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 13 20:53:47.452783 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.452770    2561 policy_none.go:47] "Start"
Jul 13 20:53:47.480369 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.480351    2561 manager.go:337] "Starting Device Plugin manager"
Jul 13 20:53:47.480489 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:47.480389    2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 13 20:53:47.480489 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.480401    2561 server.go:87] "Starting device plugin registration server"
Jul 13 20:53:47.480661 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.480648    2561 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 13 20:53:47.480718 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.480663    2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 13 20:53:47.480801 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.480784    2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 13 20:53:47.480900 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.480876    2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 13 20:53:47.480900 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.480887    2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 13 20:53:47.481374 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:47.481348    2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 13 20:53:47.481474 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:47.481403    2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-162.ec2.internal\" not found"
Jul 13 20:53:47.569079 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.569047    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 13 20:53:47.570431 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.570407    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 13 20:53:47.570517 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.570445    2561 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 13 20:53:47.570517 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.570470    2561 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 13 20:53:47.570517 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:47.570510    2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 13 20:53:47.573038 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.573021    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 20:53:47.581069 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.581053    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 20:53:47.581844 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.581829    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-162.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 20:53:47.581934 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.581857    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-162.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 20:53:47.581934 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.581869    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-162.ec2.internal" event="NodeHasSufficientPID"
Jul 13 20:53:47.581934 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.581892    2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-162.ec2.internal"
Jul 13 20:53:47.587789 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.587774    2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-162.ec2.internal"
Jul 13 20:53:47.587877 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:47.587795    2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-162.ec2.internal\": node \"ip-10-0-137-162.ec2.internal\" not found"
Jul 13 20:53:47.601394 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:47.601378    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-162.ec2.internal\" not found"
Jul 13 20:53:47.670938 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.670796    2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-162.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-162.ec2.internal"]
Jul 13 20:53:47.670938 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.670926    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 20:53:47.671963 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.671947    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-162.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 20:53:47.672068 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.671981    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-162.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 20:53:47.672068 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.671997    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-162.ec2.internal" event="NodeHasSufficientPID"
Jul 13 20:53:47.673255 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.673240    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 20:53:47.673370 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.673354    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-162.ec2.internal"
Jul 13 20:53:47.673416 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.673384    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 20:53:47.674149 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.674133    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-162.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 20:53:47.674149 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.674143    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-162.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 20:53:47.674263 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.674163    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-162.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 20:53:47.674263 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.674175    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-162.ec2.internal" event="NodeHasSufficientPID"
Jul 13 20:53:47.674263 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.674162    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-162.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 20:53:47.674263 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.674224    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-162.ec2.internal" event="NodeHasSufficientPID"
Jul 13 20:53:47.675211 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.675198    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-162.ec2.internal"
Jul 13 20:53:47.675255 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.675222    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 20:53:47.675885 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.675867    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-162.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 20:53:47.675956 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.675897    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-162.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 20:53:47.675956 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.675913    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-162.ec2.internal" event="NodeHasSufficientPID"
Jul 13 20:53:47.700431 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:47.700410    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-162.ec2.internal\" not found" node="ip-10-0-137-162.ec2.internal"
Jul 13 20:53:47.702263 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:47.702249    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-162.ec2.internal\" not found"
Jul 13 20:53:47.704663 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:47.704649    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-162.ec2.internal\" not found" node="ip-10-0-137-162.ec2.internal"
Jul 13 20:53:47.732117 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.732091    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/02bd9a5046db92262a43fb17494a639b-config\") pod \"kube-apiserver-proxy-ip-10-0-137-162.ec2.internal\" (UID: \"02bd9a5046db92262a43fb17494a639b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-162.ec2.internal"
Jul 13 20:53:47.732225 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.732118    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bafdaf3cf8444548bf12fbd6ab238989-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-162.ec2.internal\" (UID: \"bafdaf3cf8444548bf12fbd6ab238989\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-162.ec2.internal"
Jul 13 20:53:47.732225 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.732143    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bafdaf3cf8444548bf12fbd6ab238989-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-162.ec2.internal\" (UID: \"bafdaf3cf8444548bf12fbd6ab238989\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-162.ec2.internal"
Jul 13 20:53:47.803055 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:47.803029    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-162.ec2.internal\" not found"
Jul 13 20:53:47.832353 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.832325    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bafdaf3cf8444548bf12fbd6ab238989-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-162.ec2.internal\" (UID: \"bafdaf3cf8444548bf12fbd6ab238989\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-162.ec2.internal"
Jul 13 20:53:47.832447 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.832360    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bafdaf3cf8444548bf12fbd6ab238989-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-162.ec2.internal\" (UID: \"bafdaf3cf8444548bf12fbd6ab238989\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-162.ec2.internal"
Jul 13 20:53:47.832447 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.832402    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bafdaf3cf8444548bf12fbd6ab238989-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-162.ec2.internal\" (UID: \"bafdaf3cf8444548bf12fbd6ab238989\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-162.ec2.internal"
Jul 13 20:53:47.832447 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.832436    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/02bd9a5046db92262a43fb17494a639b-config\") pod \"kube-apiserver-proxy-ip-10-0-137-162.ec2.internal\" (UID: \"02bd9a5046db92262a43fb17494a639b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-162.ec2.internal"
Jul 13 20:53:47.832544 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.832461    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/02bd9a5046db92262a43fb17494a639b-config\") pod \"kube-apiserver-proxy-ip-10-0-137-162.ec2.internal\" (UID: \"02bd9a5046db92262a43fb17494a639b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-162.ec2.internal"
Jul 13 20:53:47.832544 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:47.832496    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bafdaf3cf8444548bf12fbd6ab238989-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-162.ec2.internal\" (UID: \"bafdaf3cf8444548bf12fbd6ab238989\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-162.ec2.internal"
Jul 13 20:53:47.903541 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:47.903494    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-162.ec2.internal\" not found"
Jul 13 20:53:48.003159 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:48.003092    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-162.ec2.internal"
Jul 13 20:53:48.004148 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:48.004114    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-162.ec2.internal\" not found"
Jul 13 20:53:48.008289 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:48.008274    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-162.ec2.internal"
Jul 13 20:53:48.105064 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:48.105021    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-162.ec2.internal\" not found"
Jul 13 20:53:48.205522 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:48.205492    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-162.ec2.internal\" not found"
Jul 13 20:53:48.306062 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:48.305975    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-162.ec2.internal\" not found"
Jul 13 20:53:48.376472 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:48.376439    2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 13 20:53:48.377167 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:48.376598    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 13 20:53:48.377167 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:48.376616    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 13 20:53:48.406756 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:48.406728    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-162.ec2.internal\" not found"
Jul 13 20:53:48.433397 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:48.433339    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-12 20:48:47 +0000 UTC" deadline="2028-01-16 22:08:28.626382103 +0000 UTC"
Jul 13 20:53:48.433397 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:48.433396    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13249h14m40.192991532s"
Jul 13 20:53:48.507744 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:48.507715    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-162.ec2.internal\" not found"
Jul 13 20:53:48.527463 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:48.527429    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02bd9a5046db92262a43fb17494a639b.slice/crio-573ed5f2036a30a7be2e2f00cf6d8c9c06542b9981448ec176d874c9310a157c WatchSource:0}: Error finding container 573ed5f2036a30a7be2e2f00cf6d8c9c06542b9981448ec176d874c9310a157c: Status 404 returned error can't find the container with id 573ed5f2036a30a7be2e2f00cf6d8c9c06542b9981448ec176d874c9310a157c
Jul 13 20:53:48.527719 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:48.527705    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbafdaf3cf8444548bf12fbd6ab238989.slice/crio-816cd30848eba2c9ea1a2854bceb8888e91ba92ce512818b8475e1ab3f0eaefc WatchSource:0}: Error finding container 816cd30848eba2c9ea1a2854bceb8888e91ba92ce512818b8475e1ab3f0eaefc: Status 404 returned error can't find the container with id 816cd30848eba2c9ea1a2854bceb8888e91ba92ce512818b8475e1ab3f0eaefc
Jul 13 20:53:48.532652 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:48.532637    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 20:53:48.571027 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:48.570967    2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 20:53:48.574281 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:48.574242    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-162.ec2.internal" event={"ID":"02bd9a5046db92262a43fb17494a639b","Type":"ContainerStarted","Data":"573ed5f2036a30a7be2e2f00cf6d8c9c06542b9981448ec176d874c9310a157c"}
Jul 13 20:53:48.575271 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:48.575247    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-162.ec2.internal" event={"ID":"bafdaf3cf8444548bf12fbd6ab238989","Type":"ContainerStarted","Data":"816cd30848eba2c9ea1a2854bceb8888e91ba92ce512818b8475e1ab3f0eaefc"}
Jul 13 20:53:48.608472 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:48.608450    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-162.ec2.internal\" not found"
Jul 13 20:53:48.708971 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:48.708943    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-162.ec2.internal\" not found"
Jul 13 20:53:48.809394 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:48.809368    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-162.ec2.internal\" not found"
Jul 13 20:53:48.910074 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:48.909986    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-162.ec2.internal\" not found"
Jul 13 20:53:48.978775 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:48.978744    2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 20:53:49.030466 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.030434    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-162.ec2.internal"
Jul 13 20:53:49.041463 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.041433    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 13 20:53:49.042652 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.042629    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-162.ec2.internal"
Jul 13 20:53:49.049369 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.049346    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 13 20:53:49.413622 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.413584    2561 apiserver.go:52] "Watching apiserver"
Jul 13 20:53:49.425270 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.425240    2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 13 20:53:49.426513 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.426488    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4svs","openshift-cluster-node-tuning-operator/tuned-fc7tq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-162.ec2.internal","openshift-multus/multus-additional-cni-plugins-c5jdx","openshift-multus/multus-rb6b2","openshift-network-diagnostics/network-check-target-bkclr","openshift-network-operator/iptables-alerter-fwznz","kube-system/konnectivity-agent-7ll7x","kube-system/kube-apiserver-proxy-ip-10-0-137-162.ec2.internal","openshift-dns/node-resolver-sfjmb","openshift-image-registry/node-ca-4r78x","openshift-multus/network-metrics-daemon-zhvrj","openshift-ovn-kubernetes/ovnkube-node-jrpbd","kube-system/global-pull-secret-syncer-vb7lj"]
Jul 13 20:53:49.428231 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.428009    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fwznz"
Jul 13 20:53:49.429213 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.429192    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.430287 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.430271    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 13 20:53:49.430381 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.430300    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vb7lj"
Jul 13 20:53:49.430381 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:49.430365    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vb7lj" podUID="02682275-db9d-4f68-9b88-4e6f2e6f52f2"
Jul 13 20:53:49.431120 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.430917    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dv6bh\""
Jul 13 20:53:49.431120 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.430994    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 13 20:53:49.431120 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.431002    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 13 20:53:49.431120 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.431098    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 13 20:53:49.431933 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.431631    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c5jdx"
Jul 13 20:53:49.431933 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.431683    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 13 20:53:49.432388 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.432364    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 13 20:53:49.432479 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.432403    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 13 20:53:49.432479 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.432368    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 13 20:53:49.432744 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.432588    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-n8rlf\""
Jul 13 20:53:49.432744 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.432646    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 13 20:53:49.432744 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.432589    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 13 20:53:49.433244 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.433226    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.434077 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.434014    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 13 20:53:49.434170 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.434092    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-l6mpf\""
Jul 13 20:53:49.434585 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.434503    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 13 20:53:49.434672 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.434510    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkclr"
Jul 13 20:53:49.434735 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.434715    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 13 20:53:49.434735 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:49.434711    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkclr" podUID="29605f3e-f674-49cc-86b6-62bc9db78d33"
Jul 13 20:53:49.434887 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.434865    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 13 20:53:49.434983 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.434870    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 13 20:53:49.435512 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.435457    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-tkc2v\""
Jul 13 20:53:49.435863 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.435705    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 13 20:53:49.435960 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.435947    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7ll7x"
Jul 13 20:53:49.437762 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.437123    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4svs"
Jul 13 20:53:49.438665 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.438517    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-slbvw\""
Jul 13 20:53:49.438665 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.438604    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 13 20:53:49.438665 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.438629    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 13 20:53:49.438893 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.438778    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fc7tq"
Jul 13 20:53:49.439342 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.439306    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-host-kubelet\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.439342 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.439330    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-log-socket\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.439497 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.439346    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/02682275-db9d-4f68-9b88-4e6f2e6f52f2-kubelet-config\") pod \"global-pull-secret-syncer-vb7lj\" (UID: \"02682275-db9d-4f68-9b88-4e6f2e6f52f2\") " pod="kube-system/global-pull-secret-syncer-vb7lj"
Jul 13 20:53:49.439497 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.439369    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/df777e90-a19a-493a-9725-24c67196c62a-cnibin\") pod \"multus-additional-cni-plugins-c5jdx\" (UID: \"df777e90-a19a-493a-9725-24c67196c62a\") " pod="openshift-multus/multus-additional-cni-plugins-c5jdx"
Jul 13 20:53:49.439497 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.439392    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/df777e90-a19a-493a-9725-24c67196c62a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c5jdx\" (UID: \"df777e90-a19a-493a-9725-24c67196c62a\") " pod="openshift-multus/multus-additional-cni-plugins-c5jdx"
Jul 13 20:53:49.439497 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.439416    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/df777e90-a19a-493a-9725-24c67196c62a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c5jdx\" (UID: \"df777e90-a19a-493a-9725-24c67196c62a\") " pod="openshift-multus/multus-additional-cni-plugins-c5jdx"
Jul 13 20:53:49.439497 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.439427    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 13 20:53:49.439497 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.439439    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/df777e90-a19a-493a-9725-24c67196c62a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c5jdx\" (UID: \"df777e90-a19a-493a-9725-24c67196c62a\") " pod="openshift-multus/multus-additional-cni-plugins-c5jdx"
Jul 13 20:53:49.439497 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.439466    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-etc-openvswitch\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.439975 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.439514    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-ovn-node-metrics-cert\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.439975 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.439539    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-host-cni-netd\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.439975 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.439566    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.439975 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.439590    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/02682275-db9d-4f68-9b88-4e6f2e6f52f2-dbus\") pod \"global-pull-secret-syncer-vb7lj\" (UID: \"02682275-db9d-4f68-9b88-4e6f2e6f52f2\") " pod="kube-system/global-pull-secret-syncer-vb7lj"
Jul 13 20:53:49.439975 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.439617    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnc6v\" (UniqueName: \"kubernetes.io/projected/1adc049e-01d5-4383-975a-fc8e75ba43e1-kube-api-access-vnc6v\") pod \"iptables-alerter-fwznz\" (UID: \"1adc049e-01d5-4383-975a-fc8e75ba43e1\") " pod="openshift-network-operator/iptables-alerter-fwznz"
Jul 13 20:53:49.439975 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.439676    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-host-slash\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.439975 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.439730    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-ovnkube-script-lib\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.439975 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.439761    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-host-run-netns\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.439975 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.439787    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-run-systemd\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.439975 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.439794    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-g5b22\""
Jul 13 20:53:49.439975 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.439842    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 13 20:53:49.439975 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.439850    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-run-openvswitch\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.439975 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.439873    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 13 20:53:49.439975 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.439901    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-run-ovn\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.439975 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.439938    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1adc049e-01d5-4383-975a-fc8e75ba43e1-iptables-alerter-script\") pod \"iptables-alerter-fwznz\" (UID: \"1adc049e-01d5-4383-975a-fc8e75ba43e1\") " pod="openshift-network-operator/iptables-alerter-fwznz"
Jul 13 20:53:49.439975 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.439966    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-host-run-ovn-kubernetes\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.440739 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.440002    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-env-overrides\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.440739 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.440036    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/df777e90-a19a-493a-9725-24c67196c62a-system-cni-dir\") pod \"multus-additional-cni-plugins-c5jdx\" (UID: \"df777e90-a19a-493a-9725-24c67196c62a\") " pod="openshift-multus/multus-additional-cni-plugins-c5jdx"
Jul 13 20:53:49.440739 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.440072    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plsrr\" (UniqueName: \"kubernetes.io/projected/df777e90-a19a-493a-9725-24c67196c62a-kube-api-access-plsrr\") pod \"multus-additional-cni-plugins-c5jdx\" (UID: \"df777e90-a19a-493a-9725-24c67196c62a\") " pod="openshift-multus/multus-additional-cni-plugins-c5jdx"
Jul 13 20:53:49.440739 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.440103    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1adc049e-01d5-4383-975a-fc8e75ba43e1-host-slash\") pod \"iptables-alerter-fwznz\" (UID: \"1adc049e-01d5-4383-975a-fc8e75ba43e1\") " pod="openshift-network-operator/iptables-alerter-fwznz"
Jul 13 20:53:49.440739 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.440144    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-systemd-units\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.440739 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.440163    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-var-lib-openvswitch\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.440739 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.440190    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-node-log\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.440739 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.440212    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g94f\" (UniqueName: \"kubernetes.io/projected/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-kube-api-access-9g94f\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.440739 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.440248    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/02682275-db9d-4f68-9b88-4e6f2e6f52f2-original-pull-secret\") pod \"global-pull-secret-syncer-vb7lj\" (UID: \"02682275-db9d-4f68-9b88-4e6f2e6f52f2\") " pod="kube-system/global-pull-secret-syncer-vb7lj"
Jul 13 20:53:49.440739 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.440285    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-host-cni-bin\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.440739 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.440301    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sfjmb"
Jul 13 20:53:49.440739 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.440309    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-ovnkube-config\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.440739 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.440333    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/df777e90-a19a-493a-9725-24c67196c62a-os-release\") pod \"multus-additional-cni-plugins-c5jdx\" (UID: \"df777e90-a19a-493a-9725-24c67196c62a\") " pod="openshift-multus/multus-additional-cni-plugins-c5jdx"
Jul 13 20:53:49.440739 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.440355    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/df777e90-a19a-493a-9725-24c67196c62a-cni-binary-copy\") pod \"multus-additional-cni-plugins-c5jdx\" (UID: \"df777e90-a19a-493a-9725-24c67196c62a\") " pod="openshift-multus/multus-additional-cni-plugins-c5jdx"
Jul 13 20:53:49.441427 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.441374    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 13 20:53:49.441766 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.441686    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4r78x"
Jul 13 20:53:49.442457 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.442439    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-c9zsw\""
Jul 13 20:53:49.442545 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.442466    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 13 20:53:49.442878 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.442798    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 13 20:53:49.443207 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.443108    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-z9jmf\""
Jul 13 20:53:49.443370 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.443348    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhvrj"
Jul 13 20:53:49.443479 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.442826    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 13 20:53:49.444353 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:49.443781    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhvrj" podUID="8608f034-4011-42c3-b0ee-1369e8afa709"
Jul 13 20:53:49.444875 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.444856    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lp54v\""
Jul 13 20:53:49.445286 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.445271    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 13 20:53:49.445609 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.445595    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 13 20:53:49.445928 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.445913    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 13 20:53:49.446500 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.446480    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 13 20:53:49.462584 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.462563    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bvzn5"
Jul 13 20:53:49.465128 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.465082    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 20:53:49.470128 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.470105    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bvzn5"
Jul 13 20:53:49.532457 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.532436    2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 13 20:53:49.540675 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.540649    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-run-openvswitch\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.540804 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.540687    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/80d43145-0683-447c-b42c-132e6088f785-multus-socket-dir-parent\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.540804 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.540714    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-host-run-ovn-kubernetes\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.540804 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.540742    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-run-openvswitch\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.540804 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.540745    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-env-overrides\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.540804 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.540779    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-host-run-ovn-kubernetes\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.540804 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.540799    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80d43145-0683-447c-b42c-132e6088f785-cnibin\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.541178 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.540840    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80d43145-0683-447c-b42c-132e6088f785-multus-conf-dir\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.541178 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.540885    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34885618-690d-42f8-96c2-3af217da17a9-tmp-dir\") pod \"node-resolver-sfjmb\" (UID: \"34885618-690d-42f8-96c2-3af217da17a9\") " pod="openshift-dns/node-resolver-sfjmb"
Jul 13 20:53:49.541178 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.540926    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1adc049e-01d5-4383-975a-fc8e75ba43e1-host-slash\") pod \"iptables-alerter-fwznz\" (UID: \"1adc049e-01d5-4383-975a-fc8e75ba43e1\") " pod="openshift-network-operator/iptables-alerter-fwznz"
Jul 13 20:53:49.541178 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.540959    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9g94f\" (UniqueName: \"kubernetes.io/projected/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-kube-api-access-9g94f\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.541178 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.540984    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/02682275-db9d-4f68-9b88-4e6f2e6f52f2-original-pull-secret\") pod \"global-pull-secret-syncer-vb7lj\" (UID: \"02682275-db9d-4f68-9b88-4e6f2e6f52f2\") " pod="kube-system/global-pull-secret-syncer-vb7lj"
Jul 13 20:53:49.541178 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.540987    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1adc049e-01d5-4383-975a-fc8e75ba43e1-host-slash\") pod \"iptables-alerter-fwznz\" (UID: \"1adc049e-01d5-4383-975a-fc8e75ba43e1\") " pod="openshift-network-operator/iptables-alerter-fwznz"
Jul 13 20:53:49.541178 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.541010    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/80d43145-0683-447c-b42c-132e6088f785-host-var-lib-cni-bin\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.541178 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.541036    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c5c1f320-22e5-445f-8725-e6b11dc0ad1d-konnectivity-ca\") pod \"konnectivity-agent-7ll7x\" (UID: \"c5c1f320-22e5-445f-8725-e6b11dc0ad1d\") " pod="kube-system/konnectivity-agent-7ll7x"
Jul 13 20:53:49.541178 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.541060    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-host-cni-bin\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.541178 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:49.541080    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 20:53:49.541178 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.541101    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-ovnkube-config\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.541178 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.541126    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/df777e90-a19a-493a-9725-24c67196c62a-cni-binary-copy\") pod \"multus-additional-cni-plugins-c5jdx\" (UID: \"df777e90-a19a-493a-9725-24c67196c62a\") " pod="openshift-multus/multus-additional-cni-plugins-c5jdx"
Jul 13 20:53:49.541178 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:49.541144    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02682275-db9d-4f68-9b88-4e6f2e6f52f2-original-pull-secret podName:02682275-db9d-4f68-9b88-4e6f2e6f52f2 nodeName:}" failed. No retries permitted until 2026-07-13 20:53:50.041120218 +0000 UTC m=+3.035903635 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/02682275-db9d-4f68-9b88-4e6f2e6f52f2-original-pull-secret") pod "global-pull-secret-syncer-vb7lj" (UID: "02682275-db9d-4f68-9b88-4e6f2e6f52f2") : object "kube-system"/"original-pull-secret" not registered
Jul 13 20:53:49.541178 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.541173    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/80d43145-0683-447c-b42c-132e6088f785-host-var-lib-cni-multus\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.541924 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.541195    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/80d43145-0683-447c-b42c-132e6088f785-hostroot\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.541924 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.541215    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6ef685a0-9abc-4407-83e3-d3850d3f8c62-etc-systemd\") pod \"tuned-fc7tq\" (UID: \"6ef685a0-9abc-4407-83e3-d3850d3f8c62\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7tq"
Jul 13 20:53:49.541924 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.541235    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/34885618-690d-42f8-96c2-3af217da17a9-hosts-file\") pod \"node-resolver-sfjmb\" (UID: \"34885618-690d-42f8-96c2-3af217da17a9\") " pod="openshift-dns/node-resolver-sfjmb"
Jul 13 20:53:49.541924 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.541239    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-env-overrides\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.541924 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.541249    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7824m\" (UniqueName: \"kubernetes.io/projected/34885618-690d-42f8-96c2-3af217da17a9-kube-api-access-7824m\") pod \"node-resolver-sfjmb\" (UID: \"34885618-690d-42f8-96c2-3af217da17a9\") " pod="openshift-dns/node-resolver-sfjmb"
Jul 13 20:53:49.541924 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.541269    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-host-kubelet\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.541924 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.541297    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-host-kubelet\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.541924 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.541301    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-log-socket\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.541924 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.541332    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/02682275-db9d-4f68-9b88-4e6f2e6f52f2-kubelet-config\") pod \"global-pull-secret-syncer-vb7lj\" (UID: \"02682275-db9d-4f68-9b88-4e6f2e6f52f2\") " pod="kube-system/global-pull-secret-syncer-vb7lj"
Jul 13 20:53:49.541924 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.541349    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-host-cni-bin\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.541924 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.541358    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/df777e90-a19a-493a-9725-24c67196c62a-cnibin\") pod \"multus-additional-cni-plugins-c5jdx\" (UID: \"df777e90-a19a-493a-9725-24c67196c62a\") " pod="openshift-multus/multus-additional-cni-plugins-c5jdx"
Jul 13 20:53:49.541924 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.541387    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/df777e90-a19a-493a-9725-24c67196c62a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c5jdx\" (UID: \"df777e90-a19a-493a-9725-24c67196c62a\") " pod="openshift-multus/multus-additional-cni-plugins-c5jdx"
Jul 13 20:53:49.541924 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.541392    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-log-socket\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.541924 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.541427    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80d43145-0683-447c-b42c-132e6088f785-multus-cni-dir\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.541924 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.541457    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48rvg\" (UniqueName: \"kubernetes.io/projected/19714a14-ff22-4f3b-a5ea-011318891f0e-kube-api-access-48rvg\") pod \"aws-ebs-csi-driver-node-w4svs\" (UID: \"19714a14-ff22-4f3b-a5ea-011318891f0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4svs"
Jul 13 20:53:49.541924 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.541503    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/df777e90-a19a-493a-9725-24c67196c62a-cnibin\") pod \"multus-additional-cni-plugins-c5jdx\" (UID: \"df777e90-a19a-493a-9725-24c67196c62a\") " pod="openshift-multus/multus-additional-cni-plugins-c5jdx"
Jul 13 20:53:49.541924 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.541533    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6ef685a0-9abc-4407-83e3-d3850d3f8c62-etc-sysconfig\") pod \"tuned-fc7tq\" (UID: \"6ef685a0-9abc-4407-83e3-d3850d3f8c62\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7tq"
Jul 13 20:53:49.542721 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.541573    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-ovn-node-metrics-cert\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.542721 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.541618    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-472hg\" (UniqueName: \"kubernetes.io/projected/29605f3e-f674-49cc-86b6-62bc9db78d33-kube-api-access-472hg\") pod \"network-check-target-bkclr\" (UID: \"29605f3e-f674-49cc-86b6-62bc9db78d33\") " pod="openshift-network-diagnostics/network-check-target-bkclr"
Jul 13 20:53:49.542721 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.541645    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/19714a14-ff22-4f3b-a5ea-011318891f0e-registration-dir\") pod \"aws-ebs-csi-driver-node-w4svs\" (UID: \"19714a14-ff22-4f3b-a5ea-011318891f0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4svs"
Jul 13 20:53:49.542721 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.541665    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/df777e90-a19a-493a-9725-24c67196c62a-cni-binary-copy\") pod \"multus-additional-cni-plugins-c5jdx\" (UID: \"df777e90-a19a-493a-9725-24c67196c62a\") " pod="openshift-multus/multus-additional-cni-plugins-c5jdx"
Jul 13 20:53:49.542721 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.541671    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6ef685a0-9abc-4407-83e3-d3850d3f8c62-etc-sysctl-d\") pod \"tuned-fc7tq\" (UID: \"6ef685a0-9abc-4407-83e3-d3850d3f8c62\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7tq"
Jul 13 20:53:49.542721 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.541711    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ef685a0-9abc-4407-83e3-d3850d3f8c62-sys\") pod \"tuned-fc7tq\" (UID: \"6ef685a0-9abc-4407-83e3-d3850d3f8c62\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7tq"
Jul 13 20:53:49.542721 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.541739    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6ef685a0-9abc-4407-83e3-d3850d3f8c62-lib-modules\") pod \"tuned-fc7tq\" (UID: \"6ef685a0-9abc-4407-83e3-d3850d3f8c62\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7tq"
Jul 13 20:53:49.542721 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.541782    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6ef685a0-9abc-4407-83e3-d3850d3f8c62-etc-tuned\") pod \"tuned-fc7tq\" (UID: \"6ef685a0-9abc-4407-83e3-d3850d3f8c62\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7tq"
Jul 13 20:53:49.542721 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.541838    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5txh\" (UniqueName: \"kubernetes.io/projected/6ef685a0-9abc-4407-83e3-d3850d3f8c62-kube-api-access-q5txh\") pod \"tuned-fc7tq\" (UID: \"6ef685a0-9abc-4407-83e3-d3850d3f8c62\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7tq"
Jul 13 20:53:49.542721 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.541862    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/70606094-6a35-429c-b57d-2b236b88cc27-host\") pod \"node-ca-4r78x\" (UID: \"70606094-6a35-429c-b57d-2b236b88cc27\") " pod="openshift-image-registry/node-ca-4r78x"
Jul 13 20:53:49.542721 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.541890    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-host-slash\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.542721 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.541916    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-ovnkube-script-lib\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.542721 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.541918    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/df777e90-a19a-493a-9725-24c67196c62a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c5jdx\" (UID: \"df777e90-a19a-493a-9725-24c67196c62a\") " pod="openshift-multus/multus-additional-cni-plugins-c5jdx"
Jul 13 20:53:49.542721 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.541946    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4jxk\" (UniqueName: \"kubernetes.io/projected/8608f034-4011-42c3-b0ee-1369e8afa709-kube-api-access-x4jxk\") pod \"network-metrics-daemon-zhvrj\" (UID: \"8608f034-4011-42c3-b0ee-1369e8afa709\") " pod="openshift-multus/network-metrics-daemon-zhvrj"
Jul 13 20:53:49.542721 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.541981    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-ovnkube-config\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.542721 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.542030    2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 13 20:53:49.542721 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.542040    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-host-slash\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.543530 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.542079    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80d43145-0683-447c-b42c-132e6088f785-system-cni-dir\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.543530 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.542108    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6ef685a0-9abc-4407-83e3-d3850d3f8c62-run\") pod \"tuned-fc7tq\" (UID: \"6ef685a0-9abc-4407-83e3-d3850d3f8c62\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7tq"
Jul 13 20:53:49.543530 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.542125    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/02682275-db9d-4f68-9b88-4e6f2e6f52f2-kubelet-config\") pod \"global-pull-secret-syncer-vb7lj\" (UID: \"02682275-db9d-4f68-9b88-4e6f2e6f52f2\") " pod="kube-system/global-pull-secret-syncer-vb7lj"
Jul 13 20:53:49.543530 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.542159    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ef685a0-9abc-4407-83e3-d3850d3f8c62-var-lib-kubelet\") pod \"tuned-fc7tq\" (UID: \"6ef685a0-9abc-4407-83e3-d3850d3f8c62\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7tq"
Jul 13 20:53:49.543530 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.542218    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6ef685a0-9abc-4407-83e3-d3850d3f8c62-host\") pod \"tuned-fc7tq\" (UID: \"6ef685a0-9abc-4407-83e3-d3850d3f8c62\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7tq"
Jul 13 20:53:49.543530 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.542248    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-host-run-netns\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.543530 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.542289    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-host-run-netns\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.543530 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.542292    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-run-systemd\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.543530 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.542329    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-run-ovn\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.543530 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.542353    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/80d43145-0683-447c-b42c-132e6088f785-host-run-k8s-cni-cncf-io\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.543530 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.542398    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp76r\" (UniqueName: \"kubernetes.io/projected/80d43145-0683-447c-b42c-132e6088f785-kube-api-access-qp76r\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.543530 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.542398    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-run-systemd\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.543530 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.542405    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-run-ovn\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.543530 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.542420    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-ovnkube-script-lib\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.543530 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.542425    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1adc049e-01d5-4383-975a-fc8e75ba43e1-iptables-alerter-script\") pod \"iptables-alerter-fwznz\" (UID: \"1adc049e-01d5-4383-975a-fc8e75ba43e1\") " pod="openshift-network-operator/iptables-alerter-fwznz"
Jul 13 20:53:49.543530 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.542463    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/df777e90-a19a-493a-9725-24c67196c62a-system-cni-dir\") pod \"multus-additional-cni-plugins-c5jdx\" (UID: \"df777e90-a19a-493a-9725-24c67196c62a\") " pod="openshift-multus/multus-additional-cni-plugins-c5jdx"
Jul 13 20:53:49.543530 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.542489    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plsrr\" (UniqueName: \"kubernetes.io/projected/df777e90-a19a-493a-9725-24c67196c62a-kube-api-access-plsrr\") pod \"multus-additional-cni-plugins-c5jdx\" (UID: \"df777e90-a19a-493a-9725-24c67196c62a\") " pod="openshift-multus/multus-additional-cni-plugins-c5jdx"
Jul 13 20:53:49.544347 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.542513    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/80d43145-0683-447c-b42c-132e6088f785-host-run-multus-certs\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.544347 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.542548    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c5c1f320-22e5-445f-8725-e6b11dc0ad1d-agent-certs\") pod \"konnectivity-agent-7ll7x\" (UID: \"c5c1f320-22e5-445f-8725-e6b11dc0ad1d\") " pod="kube-system/konnectivity-agent-7ll7x"
Jul 13 20:53:49.544347 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.542554    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/df777e90-a19a-493a-9725-24c67196c62a-system-cni-dir\") pod \"multus-additional-cni-plugins-c5jdx\" (UID: \"df777e90-a19a-493a-9725-24c67196c62a\") " pod="openshift-multus/multus-additional-cni-plugins-c5jdx"
Jul 13 20:53:49.544347 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.542568    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/19714a14-ff22-4f3b-a5ea-011318891f0e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-w4svs\" (UID: \"19714a14-ff22-4f3b-a5ea-011318891f0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4svs"
Jul 13 20:53:49.544347 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.542588    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ef685a0-9abc-4407-83e3-d3850d3f8c62-tmp\") pod \"tuned-fc7tq\" (UID: \"6ef685a0-9abc-4407-83e3-d3850d3f8c62\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7tq"
Jul 13 20:53:49.544347 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.542617    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-systemd-units\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.544347 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.542646    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-var-lib-openvswitch\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.544347 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.542664    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-node-log\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.544347 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.542684    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/80d43145-0683-447c-b42c-132e6088f785-os-release\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.544347 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.542701    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-systemd-units\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.544347 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.542704    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/19714a14-ff22-4f3b-a5ea-011318891f0e-device-dir\") pod \"aws-ebs-csi-driver-node-w4svs\" (UID: \"19714a14-ff22-4f3b-a5ea-011318891f0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4svs"
Jul 13 20:53:49.544347 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.542745    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6ef685a0-9abc-4407-83e3-d3850d3f8c62-etc-modprobe-d\") pod \"tuned-fc7tq\" (UID: \"6ef685a0-9abc-4407-83e3-d3850d3f8c62\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7tq"
Jul 13 20:53:49.544347 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.542786    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-node-log\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.544347 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.542804    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-var-lib-openvswitch\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.544347 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.542841    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/df777e90-a19a-493a-9725-24c67196c62a-os-release\") pod \"multus-additional-cni-plugins-c5jdx\" (UID: \"df777e90-a19a-493a-9725-24c67196c62a\") " pod="openshift-multus/multus-additional-cni-plugins-c5jdx"
Jul 13 20:53:49.544347 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.542873    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/80d43145-0683-447c-b42c-132e6088f785-multus-daemon-config\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.544347 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.542899    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pckfz\" (UniqueName: \"kubernetes.io/projected/70606094-6a35-429c-b57d-2b236b88cc27-kube-api-access-pckfz\") pod \"node-ca-4r78x\" (UID: \"70606094-6a35-429c-b57d-2b236b88cc27\") " pod="openshift-image-registry/node-ca-4r78x"
Jul 13 20:53:49.545282 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.542929    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/df777e90-a19a-493a-9725-24c67196c62a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c5jdx\" (UID: \"df777e90-a19a-493a-9725-24c67196c62a\") " pod="openshift-multus/multus-additional-cni-plugins-c5jdx"
Jul 13 20:53:49.545282 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.542957    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/df777e90-a19a-493a-9725-24c67196c62a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c5jdx\" (UID: \"df777e90-a19a-493a-9725-24c67196c62a\") " pod="openshift-multus/multus-additional-cni-plugins-c5jdx"
Jul 13 20:53:49.545282 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.542985    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80d43145-0683-447c-b42c-132e6088f785-host-var-lib-kubelet\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.545282 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.542994    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1adc049e-01d5-4383-975a-fc8e75ba43e1-iptables-alerter-script\") pod \"iptables-alerter-fwznz\" (UID: \"1adc049e-01d5-4383-975a-fc8e75ba43e1\") " pod="openshift-network-operator/iptables-alerter-fwznz"
Jul 13 20:53:49.545282 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.543008    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/19714a14-ff22-4f3b-a5ea-011318891f0e-etc-selinux\") pod \"aws-ebs-csi-driver-node-w4svs\" (UID: \"19714a14-ff22-4f3b-a5ea-011318891f0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4svs"
Jul 13 20:53:49.545282 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.542959    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/df777e90-a19a-493a-9725-24c67196c62a-os-release\") pod \"multus-additional-cni-plugins-c5jdx\" (UID: \"df777e90-a19a-493a-9725-24c67196c62a\") " pod="openshift-multus/multus-additional-cni-plugins-c5jdx"
Jul 13 20:53:49.545282 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.543031    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6ef685a0-9abc-4407-83e3-d3850d3f8c62-etc-sysctl-conf\") pod \"tuned-fc7tq\" (UID: \"6ef685a0-9abc-4407-83e3-d3850d3f8c62\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7tq"
Jul 13 20:53:49.545282 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.543056    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-etc-openvswitch\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.545282 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.543073    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/df777e90-a19a-493a-9725-24c67196c62a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c5jdx\" (UID: \"df777e90-a19a-493a-9725-24c67196c62a\") " pod="openshift-multus/multus-additional-cni-plugins-c5jdx"
Jul 13 20:53:49.545282 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.543080    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8608f034-4011-42c3-b0ee-1369e8afa709-metrics-certs\") pod \"network-metrics-daemon-zhvrj\" (UID: \"8608f034-4011-42c3-b0ee-1369e8afa709\") " pod="openshift-multus/network-metrics-daemon-zhvrj"
Jul 13 20:53:49.545282 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.543106    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/19714a14-ff22-4f3b-a5ea-011318891f0e-sys-fs\") pod \"aws-ebs-csi-driver-node-w4svs\" (UID: \"19714a14-ff22-4f3b-a5ea-011318891f0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4svs"
Jul 13 20:53:49.545282 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.543120    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-etc-openvswitch\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.545282 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.543130    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-host-cni-netd\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.545282 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.543163    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-host-cni-netd\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.545282 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.543166    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.545282 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.543210    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/02682275-db9d-4f68-9b88-4e6f2e6f52f2-dbus\") pod \"global-pull-secret-syncer-vb7lj\" (UID: \"02682275-db9d-4f68-9b88-4e6f2e6f52f2\") " pod="kube-system/global-pull-secret-syncer-vb7lj"
Jul 13 20:53:49.546034 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.543237    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80d43145-0683-447c-b42c-132e6088f785-cni-binary-copy\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.546034 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.543259    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/80d43145-0683-447c-b42c-132e6088f785-host-run-netns\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.546034 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.543267    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.546034 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.543280    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/70606094-6a35-429c-b57d-2b236b88cc27-serviceca\") pod \"node-ca-4r78x\" (UID: \"70606094-6a35-429c-b57d-2b236b88cc27\") " pod="openshift-image-registry/node-ca-4r78x"
Jul 13 20:53:49.546034 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.543319    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnc6v\" (UniqueName: \"kubernetes.io/projected/1adc049e-01d5-4383-975a-fc8e75ba43e1-kube-api-access-vnc6v\") pod \"iptables-alerter-fwznz\" (UID: \"1adc049e-01d5-4383-975a-fc8e75ba43e1\") " pod="openshift-network-operator/iptables-alerter-fwznz"
Jul 13 20:53:49.546034 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.543341    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80d43145-0683-447c-b42c-132e6088f785-etc-kubernetes\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.546034 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.543360    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/19714a14-ff22-4f3b-a5ea-011318891f0e-socket-dir\") pod \"aws-ebs-csi-driver-node-w4svs\" (UID: \"19714a14-ff22-4f3b-a5ea-011318891f0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4svs"
Jul 13 20:53:49.546034 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.543379    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ef685a0-9abc-4407-83e3-d3850d3f8c62-etc-kubernetes\") pod \"tuned-fc7tq\" (UID: \"6ef685a0-9abc-4407-83e3-d3850d3f8c62\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7tq"
Jul 13 20:53:49.546034 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.543402    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/02682275-db9d-4f68-9b88-4e6f2e6f52f2-dbus\") pod \"global-pull-secret-syncer-vb7lj\" (UID: \"02682275-db9d-4f68-9b88-4e6f2e6f52f2\") " pod="kube-system/global-pull-secret-syncer-vb7lj"
Jul 13 20:53:49.546034 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.543970    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/df777e90-a19a-493a-9725-24c67196c62a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c5jdx\" (UID: \"df777e90-a19a-493a-9725-24c67196c62a\") " pod="openshift-multus/multus-additional-cni-plugins-c5jdx"
Jul 13 20:53:49.546466 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.546445    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-ovn-node-metrics-cert\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.552838 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.552756    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnc6v\" (UniqueName: \"kubernetes.io/projected/1adc049e-01d5-4383-975a-fc8e75ba43e1-kube-api-access-vnc6v\") pod \"iptables-alerter-fwznz\" (UID: \"1adc049e-01d5-4383-975a-fc8e75ba43e1\") " pod="openshift-network-operator/iptables-alerter-fwznz"
Jul 13 20:53:49.552930 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.552848    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g94f\" (UniqueName: \"kubernetes.io/projected/e730eed8-ff8a-4a54-b1cb-539d8f07e70b-kube-api-access-9g94f\") pod \"ovnkube-node-jrpbd\" (UID: \"e730eed8-ff8a-4a54-b1cb-539d8f07e70b\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.556002 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.555973    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plsrr\" (UniqueName: \"kubernetes.io/projected/df777e90-a19a-493a-9725-24c67196c62a-kube-api-access-plsrr\") pod \"multus-additional-cni-plugins-c5jdx\" (UID: \"df777e90-a19a-493a-9725-24c67196c62a\") " pod="openshift-multus/multus-additional-cni-plugins-c5jdx"
Jul 13 20:53:49.557603 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.557565    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 20:53:49.643943 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.643912    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/80d43145-0683-447c-b42c-132e6088f785-host-var-lib-cni-multus\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.644144 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.643951    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/80d43145-0683-447c-b42c-132e6088f785-hostroot\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.644144 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.643971    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6ef685a0-9abc-4407-83e3-d3850d3f8c62-etc-systemd\") pod \"tuned-fc7tq\" (UID: \"6ef685a0-9abc-4407-83e3-d3850d3f8c62\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7tq"
Jul 13 20:53:49.644144 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.643990    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/34885618-690d-42f8-96c2-3af217da17a9-hosts-file\") pod \"node-resolver-sfjmb\" (UID: \"34885618-690d-42f8-96c2-3af217da17a9\") " pod="openshift-dns/node-resolver-sfjmb"
Jul 13 20:53:49.644144 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644013    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7824m\" (UniqueName: \"kubernetes.io/projected/34885618-690d-42f8-96c2-3af217da17a9-kube-api-access-7824m\") pod \"node-resolver-sfjmb\" (UID: \"34885618-690d-42f8-96c2-3af217da17a9\") " pod="openshift-dns/node-resolver-sfjmb"
Jul 13 20:53:49.644144 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644038    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/80d43145-0683-447c-b42c-132e6088f785-hostroot\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.644144 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644041    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/80d43145-0683-447c-b42c-132e6088f785-host-var-lib-cni-multus\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.644144 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644041    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80d43145-0683-447c-b42c-132e6088f785-multus-cni-dir\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.644144 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644098    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6ef685a0-9abc-4407-83e3-d3850d3f8c62-etc-systemd\") pod \"tuned-fc7tq\" (UID: \"6ef685a0-9abc-4407-83e3-d3850d3f8c62\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7tq"
Jul 13 20:53:49.644144 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644102    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48rvg\" (UniqueName: \"kubernetes.io/projected/19714a14-ff22-4f3b-a5ea-011318891f0e-kube-api-access-48rvg\") pod \"aws-ebs-csi-driver-node-w4svs\" (UID: \"19714a14-ff22-4f3b-a5ea-011318891f0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4svs"
Jul 13 20:53:49.644144 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644145    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/34885618-690d-42f8-96c2-3af217da17a9-hosts-file\") pod \"node-resolver-sfjmb\" (UID: \"34885618-690d-42f8-96c2-3af217da17a9\") " pod="openshift-dns/node-resolver-sfjmb"
Jul 13 20:53:49.644629 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644144    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6ef685a0-9abc-4407-83e3-d3850d3f8c62-etc-sysconfig\") pod \"tuned-fc7tq\" (UID: \"6ef685a0-9abc-4407-83e3-d3850d3f8c62\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7tq"
Jul 13 20:53:49.644629 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644180    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6ef685a0-9abc-4407-83e3-d3850d3f8c62-etc-sysconfig\") pod \"tuned-fc7tq\" (UID: \"6ef685a0-9abc-4407-83e3-d3850d3f8c62\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7tq"
Jul 13 20:53:49.644629 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644189    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-472hg\" (UniqueName: \"kubernetes.io/projected/29605f3e-f674-49cc-86b6-62bc9db78d33-kube-api-access-472hg\") pod \"network-check-target-bkclr\" (UID: \"29605f3e-f674-49cc-86b6-62bc9db78d33\") " pod="openshift-network-diagnostics/network-check-target-bkclr"
Jul 13 20:53:49.644629 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644204    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80d43145-0683-447c-b42c-132e6088f785-multus-cni-dir\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.644629 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644214    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/19714a14-ff22-4f3b-a5ea-011318891f0e-registration-dir\") pod \"aws-ebs-csi-driver-node-w4svs\" (UID: \"19714a14-ff22-4f3b-a5ea-011318891f0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4svs"
Jul 13 20:53:49.644629 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644255    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/19714a14-ff22-4f3b-a5ea-011318891f0e-registration-dir\") pod \"aws-ebs-csi-driver-node-w4svs\" (UID: \"19714a14-ff22-4f3b-a5ea-011318891f0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4svs"
Jul 13 20:53:49.644629 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644260    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6ef685a0-9abc-4407-83e3-d3850d3f8c62-etc-sysctl-d\") pod \"tuned-fc7tq\" (UID: \"6ef685a0-9abc-4407-83e3-d3850d3f8c62\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7tq"
Jul 13 20:53:49.644629 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644290    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ef685a0-9abc-4407-83e3-d3850d3f8c62-sys\") pod \"tuned-fc7tq\" (UID: \"6ef685a0-9abc-4407-83e3-d3850d3f8c62\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7tq"
Jul 13 20:53:49.644629 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644314    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6ef685a0-9abc-4407-83e3-d3850d3f8c62-lib-modules\") pod \"tuned-fc7tq\" (UID: \"6ef685a0-9abc-4407-83e3-d3850d3f8c62\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7tq"
Jul 13 20:53:49.644629 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644338    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6ef685a0-9abc-4407-83e3-d3850d3f8c62-etc-tuned\") pod \"tuned-fc7tq\" (UID: \"6ef685a0-9abc-4407-83e3-d3850d3f8c62\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7tq"
Jul 13 20:53:49.644629 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644362    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5txh\" (UniqueName: \"kubernetes.io/projected/6ef685a0-9abc-4407-83e3-d3850d3f8c62-kube-api-access-q5txh\") pod \"tuned-fc7tq\" (UID: \"6ef685a0-9abc-4407-83e3-d3850d3f8c62\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7tq"
Jul 13 20:53:49.644629 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644372    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ef685a0-9abc-4407-83e3-d3850d3f8c62-sys\") pod \"tuned-fc7tq\" (UID: \"6ef685a0-9abc-4407-83e3-d3850d3f8c62\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7tq"
Jul 13 20:53:49.644629 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644387    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/70606094-6a35-429c-b57d-2b236b88cc27-host\") pod \"node-ca-4r78x\" (UID: \"70606094-6a35-429c-b57d-2b236b88cc27\") " pod="openshift-image-registry/node-ca-4r78x"
Jul 13 20:53:49.644629 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644396    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6ef685a0-9abc-4407-83e3-d3850d3f8c62-etc-sysctl-d\") pod \"tuned-fc7tq\" (UID: \"6ef685a0-9abc-4407-83e3-d3850d3f8c62\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7tq"
Jul 13 20:53:49.644629 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644416    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4jxk\" (UniqueName: \"kubernetes.io/projected/8608f034-4011-42c3-b0ee-1369e8afa709-kube-api-access-x4jxk\") pod \"network-metrics-daemon-zhvrj\" (UID: \"8608f034-4011-42c3-b0ee-1369e8afa709\") " pod="openshift-multus/network-metrics-daemon-zhvrj"
Jul 13 20:53:49.644629 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644441    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80d43145-0683-447c-b42c-132e6088f785-system-cni-dir\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.644629 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644462    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6ef685a0-9abc-4407-83e3-d3850d3f8c62-run\") pod \"tuned-fc7tq\" (UID: \"6ef685a0-9abc-4407-83e3-d3850d3f8c62\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7tq"
Jul 13 20:53:49.644629 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644469    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6ef685a0-9abc-4407-83e3-d3850d3f8c62-lib-modules\") pod \"tuned-fc7tq\" (UID: \"6ef685a0-9abc-4407-83e3-d3850d3f8c62\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7tq"
Jul 13 20:53:49.645480 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644485    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ef685a0-9abc-4407-83e3-d3850d3f8c62-var-lib-kubelet\") pod \"tuned-fc7tq\" (UID: \"6ef685a0-9abc-4407-83e3-d3850d3f8c62\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7tq"
Jul 13 20:53:49.645480 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644507    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6ef685a0-9abc-4407-83e3-d3850d3f8c62-host\") pod \"tuned-fc7tq\" (UID: \"6ef685a0-9abc-4407-83e3-d3850d3f8c62\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7tq"
Jul 13 20:53:49.645480 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644535    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/80d43145-0683-447c-b42c-132e6088f785-host-run-k8s-cni-cncf-io\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.645480 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644560    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp76r\" (UniqueName: \"kubernetes.io/projected/80d43145-0683-447c-b42c-132e6088f785-kube-api-access-qp76r\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.645480 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644596    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/80d43145-0683-447c-b42c-132e6088f785-host-run-multus-certs\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.645480 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644616    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ef685a0-9abc-4407-83e3-d3850d3f8c62-var-lib-kubelet\") pod \"tuned-fc7tq\" (UID: \"6ef685a0-9abc-4407-83e3-d3850d3f8c62\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7tq"
Jul 13 20:53:49.645480 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644620    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c5c1f320-22e5-445f-8725-e6b11dc0ad1d-agent-certs\") pod \"konnectivity-agent-7ll7x\" (UID: \"c5c1f320-22e5-445f-8725-e6b11dc0ad1d\") " pod="kube-system/konnectivity-agent-7ll7x"
Jul 13 20:53:49.645480 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644675    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/70606094-6a35-429c-b57d-2b236b88cc27-host\") pod \"node-ca-4r78x\" (UID: \"70606094-6a35-429c-b57d-2b236b88cc27\") " pod="openshift-image-registry/node-ca-4r78x"
Jul 13 20:53:49.645480 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644681    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6ef685a0-9abc-4407-83e3-d3850d3f8c62-run\") pod \"tuned-fc7tq\" (UID: \"6ef685a0-9abc-4407-83e3-d3850d3f8c62\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7tq"
Jul 13 20:53:49.645480 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644717    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/80d43145-0683-447c-b42c-132e6088f785-host-run-k8s-cni-cncf-io\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.645480 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644722    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6ef685a0-9abc-4407-83e3-d3850d3f8c62-host\") pod \"tuned-fc7tq\" (UID: \"6ef685a0-9abc-4407-83e3-d3850d3f8c62\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7tq"
Jul 13 20:53:49.645480 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644741    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/19714a14-ff22-4f3b-a5ea-011318891f0e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-w4svs\" (UID: \"19714a14-ff22-4f3b-a5ea-011318891f0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4svs"
Jul 13 20:53:49.645480 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644784    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ef685a0-9abc-4407-83e3-d3850d3f8c62-tmp\") pod \"tuned-fc7tq\" (UID: \"6ef685a0-9abc-4407-83e3-d3850d3f8c62\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7tq"
Jul 13 20:53:49.645480 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644830    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/80d43145-0683-447c-b42c-132e6088f785-os-release\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.645480 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644855    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/19714a14-ff22-4f3b-a5ea-011318891f0e-device-dir\") pod \"aws-ebs-csi-driver-node-w4svs\" (UID: \"19714a14-ff22-4f3b-a5ea-011318891f0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4svs"
Jul 13 20:53:49.645480 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644858    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80d43145-0683-447c-b42c-132e6088f785-system-cni-dir\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.645480 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644877    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6ef685a0-9abc-4407-83e3-d3850d3f8c62-etc-modprobe-d\") pod \"tuned-fc7tq\" (UID: \"6ef685a0-9abc-4407-83e3-d3850d3f8c62\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7tq"
Jul 13 20:53:49.645480 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644902    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/80d43145-0683-447c-b42c-132e6088f785-multus-daemon-config\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.646364 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644926    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pckfz\" (UniqueName: \"kubernetes.io/projected/70606094-6a35-429c-b57d-2b236b88cc27-kube-api-access-pckfz\") pod \"node-ca-4r78x\" (UID: \"70606094-6a35-429c-b57d-2b236b88cc27\") " pod="openshift-image-registry/node-ca-4r78x"
Jul 13 20:53:49.646364 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644951    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80d43145-0683-447c-b42c-132e6088f785-host-var-lib-kubelet\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.646364 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644983    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/19714a14-ff22-4f3b-a5ea-011318891f0e-etc-selinux\") pod \"aws-ebs-csi-driver-node-w4svs\" (UID: \"19714a14-ff22-4f3b-a5ea-011318891f0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4svs"
Jul 13 20:53:49.646364 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.645007    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6ef685a0-9abc-4407-83e3-d3850d3f8c62-etc-sysctl-conf\") pod \"tuned-fc7tq\" (UID: \"6ef685a0-9abc-4407-83e3-d3850d3f8c62\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7tq"
Jul 13 20:53:49.646364 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.645034    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8608f034-4011-42c3-b0ee-1369e8afa709-metrics-certs\") pod \"network-metrics-daemon-zhvrj\" (UID: \"8608f034-4011-42c3-b0ee-1369e8afa709\") " pod="openshift-multus/network-metrics-daemon-zhvrj"
Jul 13 20:53:49.646364 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.645055    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/19714a14-ff22-4f3b-a5ea-011318891f0e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-w4svs\" (UID: \"19714a14-ff22-4f3b-a5ea-011318891f0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4svs"
Jul 13 20:53:49.646364 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.645058    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/19714a14-ff22-4f3b-a5ea-011318891f0e-sys-fs\") pod \"aws-ebs-csi-driver-node-w4svs\" (UID: \"19714a14-ff22-4f3b-a5ea-011318891f0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4svs"
Jul 13 20:53:49.646364 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.645107    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/19714a14-ff22-4f3b-a5ea-011318891f0e-sys-fs\") pod \"aws-ebs-csi-driver-node-w4svs\" (UID: \"19714a14-ff22-4f3b-a5ea-011318891f0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4svs"
Jul 13 20:53:49.646364 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.645125    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80d43145-0683-447c-b42c-132e6088f785-cni-binary-copy\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.646364 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.645166    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/80d43145-0683-447c-b42c-132e6088f785-os-release\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.646364 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.645176    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/80d43145-0683-447c-b42c-132e6088f785-host-run-netns\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.646364 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.645203    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/70606094-6a35-429c-b57d-2b236b88cc27-serviceca\") pod \"node-ca-4r78x\" (UID: \"70606094-6a35-429c-b57d-2b236b88cc27\") " pod="openshift-image-registry/node-ca-4r78x"
Jul 13 20:53:49.646364 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.645213    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80d43145-0683-447c-b42c-132e6088f785-host-var-lib-kubelet\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.646364 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.645216    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/19714a14-ff22-4f3b-a5ea-011318891f0e-device-dir\") pod \"aws-ebs-csi-driver-node-w4svs\" (UID: \"19714a14-ff22-4f3b-a5ea-011318891f0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4svs"
Jul 13 20:53:49.646364 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.645265    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/80d43145-0683-447c-b42c-132e6088f785-host-run-netns\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.646364 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.645298    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/19714a14-ff22-4f3b-a5ea-011318891f0e-etc-selinux\") pod \"aws-ebs-csi-driver-node-w4svs\" (UID: \"19714a14-ff22-4f3b-a5ea-011318891f0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4svs"
Jul 13 20:53:49.646364 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.645387    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6ef685a0-9abc-4407-83e3-d3850d3f8c62-etc-modprobe-d\") pod \"tuned-fc7tq\" (UID: \"6ef685a0-9abc-4407-83e3-d3850d3f8c62\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7tq"
Jul 13 20:53:49.646364 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.645415    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6ef685a0-9abc-4407-83e3-d3850d3f8c62-etc-sysctl-conf\") pod \"tuned-fc7tq\" (UID: \"6ef685a0-9abc-4407-83e3-d3850d3f8c62\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7tq"
Jul 13 20:53:49.647069 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.645228    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80d43145-0683-447c-b42c-132e6088f785-etc-kubernetes\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.647069 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.645457    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/19714a14-ff22-4f3b-a5ea-011318891f0e-socket-dir\") pod \"aws-ebs-csi-driver-node-w4svs\" (UID: \"19714a14-ff22-4f3b-a5ea-011318891f0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4svs"
Jul 13 20:53:49.647069 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.645486    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ef685a0-9abc-4407-83e3-d3850d3f8c62-etc-kubernetes\") pod \"tuned-fc7tq\" (UID: \"6ef685a0-9abc-4407-83e3-d3850d3f8c62\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7tq"
Jul 13 20:53:49.647069 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:49.645494    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 20:53:49.647069 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.645513    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/80d43145-0683-447c-b42c-132e6088f785-multus-socket-dir-parent\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.647069 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.644744    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/80d43145-0683-447c-b42c-132e6088f785-host-run-multus-certs\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.647069 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:49.645547    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8608f034-4011-42c3-b0ee-1369e8afa709-metrics-certs podName:8608f034-4011-42c3-b0ee-1369e8afa709 nodeName:}" failed. No retries permitted until 2026-07-13 20:53:50.145528031 +0000 UTC m=+3.140311453 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8608f034-4011-42c3-b0ee-1369e8afa709-metrics-certs") pod "network-metrics-daemon-zhvrj" (UID: "8608f034-4011-42c3-b0ee-1369e8afa709") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 20:53:49.647069 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.645565    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80d43145-0683-447c-b42c-132e6088f785-cnibin\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.647069 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.645570    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/80d43145-0683-447c-b42c-132e6088f785-etc-kubernetes\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.647069 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.645584    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ef685a0-9abc-4407-83e3-d3850d3f8c62-etc-kubernetes\") pod \"tuned-fc7tq\" (UID: \"6ef685a0-9abc-4407-83e3-d3850d3f8c62\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7tq"
Jul 13 20:53:49.647069 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.645597    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80d43145-0683-447c-b42c-132e6088f785-multus-conf-dir\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.647069 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.645622    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34885618-690d-42f8-96c2-3af217da17a9-tmp-dir\") pod \"node-resolver-sfjmb\" (UID: \"34885618-690d-42f8-96c2-3af217da17a9\") " pod="openshift-dns/node-resolver-sfjmb"
Jul 13 20:53:49.647069 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.645632    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/80d43145-0683-447c-b42c-132e6088f785-multus-socket-dir-parent\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.647069 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.645666    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/80d43145-0683-447c-b42c-132e6088f785-host-var-lib-cni-bin\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.647069 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.645690    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c5c1f320-22e5-445f-8725-e6b11dc0ad1d-konnectivity-ca\") pod \"konnectivity-agent-7ll7x\" (UID: \"c5c1f320-22e5-445f-8725-e6b11dc0ad1d\") " pod="kube-system/konnectivity-agent-7ll7x"
Jul 13 20:53:49.647069 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.645702    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/70606094-6a35-429c-b57d-2b236b88cc27-serviceca\") pod \"node-ca-4r78x\" (UID: \"70606094-6a35-429c-b57d-2b236b88cc27\") " pod="openshift-image-registry/node-ca-4r78x"
Jul 13 20:53:49.647069 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.645757    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/80d43145-0683-447c-b42c-132e6088f785-host-var-lib-cni-bin\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.647069 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.645798    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80d43145-0683-447c-b42c-132e6088f785-multus-conf-dir\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.647847 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.645836    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/19714a14-ff22-4f3b-a5ea-011318891f0e-socket-dir\") pod \"aws-ebs-csi-driver-node-w4svs\" (UID: \"19714a14-ff22-4f3b-a5ea-011318891f0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4svs"
Jul 13 20:53:49.647847 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.645944    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80d43145-0683-447c-b42c-132e6088f785-cnibin\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.647847 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.645952    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80d43145-0683-447c-b42c-132e6088f785-cni-binary-copy\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.647847 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.645975    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34885618-690d-42f8-96c2-3af217da17a9-tmp-dir\") pod \"node-resolver-sfjmb\" (UID: \"34885618-690d-42f8-96c2-3af217da17a9\") " pod="openshift-dns/node-resolver-sfjmb"
Jul 13 20:53:49.647847 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.646361    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c5c1f320-22e5-445f-8725-e6b11dc0ad1d-konnectivity-ca\") pod \"konnectivity-agent-7ll7x\" (UID: \"c5c1f320-22e5-445f-8725-e6b11dc0ad1d\") " pod="kube-system/konnectivity-agent-7ll7x"
Jul 13 20:53:49.647847 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.646799    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/80d43145-0683-447c-b42c-132e6088f785-multus-daemon-config\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.648091 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.647915    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6ef685a0-9abc-4407-83e3-d3850d3f8c62-etc-tuned\") pod \"tuned-fc7tq\" (UID: \"6ef685a0-9abc-4407-83e3-d3850d3f8c62\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7tq"
Jul 13 20:53:49.648184 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.648163    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c5c1f320-22e5-445f-8725-e6b11dc0ad1d-agent-certs\") pod \"konnectivity-agent-7ll7x\" (UID: \"c5c1f320-22e5-445f-8725-e6b11dc0ad1d\") " pod="kube-system/konnectivity-agent-7ll7x"
Jul 13 20:53:49.648665 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.648629    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ef685a0-9abc-4407-83e3-d3850d3f8c62-tmp\") pod \"tuned-fc7tq\" (UID: \"6ef685a0-9abc-4407-83e3-d3850d3f8c62\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7tq"
Jul 13 20:53:49.651729 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:49.651438    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 20:53:49.651729 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:49.651461    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 20:53:49.651729 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:49.651473    2561 projected.go:196] Error preparing data for projected volume kube-api-access-472hg for pod openshift-network-diagnostics/network-check-target-bkclr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 20:53:49.651729 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:49.651527    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29605f3e-f674-49cc-86b6-62bc9db78d33-kube-api-access-472hg podName:29605f3e-f674-49cc-86b6-62bc9db78d33 nodeName:}" failed. No retries permitted until 2026-07-13 20:53:50.151512375 +0000 UTC m=+3.146295792 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-472hg" (UniqueName: "kubernetes.io/projected/29605f3e-f674-49cc-86b6-62bc9db78d33-kube-api-access-472hg") pod "network-check-target-bkclr" (UID: "29605f3e-f674-49cc-86b6-62bc9db78d33") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 20:53:49.654565 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.654541    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7824m\" (UniqueName: \"kubernetes.io/projected/34885618-690d-42f8-96c2-3af217da17a9-kube-api-access-7824m\") pod \"node-resolver-sfjmb\" (UID: \"34885618-690d-42f8-96c2-3af217da17a9\") " pod="openshift-dns/node-resolver-sfjmb"
Jul 13 20:53:49.655008 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.654968    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5txh\" (UniqueName: \"kubernetes.io/projected/6ef685a0-9abc-4407-83e3-d3850d3f8c62-kube-api-access-q5txh\") pod \"tuned-fc7tq\" (UID: \"6ef685a0-9abc-4407-83e3-d3850d3f8c62\") " pod="openshift-cluster-node-tuning-operator/tuned-fc7tq"
Jul 13 20:53:49.655253 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.655210    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48rvg\" (UniqueName: \"kubernetes.io/projected/19714a14-ff22-4f3b-a5ea-011318891f0e-kube-api-access-48rvg\") pod \"aws-ebs-csi-driver-node-w4svs\" (UID: \"19714a14-ff22-4f3b-a5ea-011318891f0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4svs"
Jul 13 20:53:49.655998 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.655974    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pckfz\" (UniqueName: \"kubernetes.io/projected/70606094-6a35-429c-b57d-2b236b88cc27-kube-api-access-pckfz\") pod \"node-ca-4r78x\" (UID: \"70606094-6a35-429c-b57d-2b236b88cc27\") " pod="openshift-image-registry/node-ca-4r78x"
Jul 13 20:53:49.656447 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.656427    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4jxk\" (UniqueName: \"kubernetes.io/projected/8608f034-4011-42c3-b0ee-1369e8afa709-kube-api-access-x4jxk\") pod \"network-metrics-daemon-zhvrj\" (UID: \"8608f034-4011-42c3-b0ee-1369e8afa709\") " pod="openshift-multus/network-metrics-daemon-zhvrj"
Jul 13 20:53:49.656959 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.656934    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp76r\" (UniqueName: \"kubernetes.io/projected/80d43145-0683-447c-b42c-132e6088f785-kube-api-access-qp76r\") pod \"multus-rb6b2\" (UID: \"80d43145-0683-447c-b42c-132e6088f785\") " pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.743079 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.743013    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fwznz"
Jul 13 20:53:49.751895 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.751877    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:53:49.761917 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.761893    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c5jdx"
Jul 13 20:53:49.767625 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.767608    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rb6b2"
Jul 13 20:53:49.775727 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.775710    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7ll7x"
Jul 13 20:53:49.782802 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.782783    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4svs"
Jul 13 20:53:49.789859 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.789842    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fc7tq"
Jul 13 20:53:49.797850 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.797834    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sfjmb"
Jul 13 20:53:49.804213 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:49.804195    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4r78x"
Jul 13 20:53:50.049396 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:50.049326    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/02682275-db9d-4f68-9b88-4e6f2e6f52f2-original-pull-secret\") pod \"global-pull-secret-syncer-vb7lj\" (UID: \"02682275-db9d-4f68-9b88-4e6f2e6f52f2\") " pod="kube-system/global-pull-secret-syncer-vb7lj"
Jul 13 20:53:50.049529 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:50.049496    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 20:53:50.049576 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:50.049556    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02682275-db9d-4f68-9b88-4e6f2e6f52f2-original-pull-secret podName:02682275-db9d-4f68-9b88-4e6f2e6f52f2 nodeName:}" failed. No retries permitted until 2026-07-13 20:53:51.049540595 +0000 UTC m=+4.044324025 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/02682275-db9d-4f68-9b88-4e6f2e6f52f2-original-pull-secret") pod "global-pull-secret-syncer-vb7lj" (UID: "02682275-db9d-4f68-9b88-4e6f2e6f52f2") : object "kube-system"/"original-pull-secret" not registered
Jul 13 20:53:50.149936 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:50.149906    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8608f034-4011-42c3-b0ee-1369e8afa709-metrics-certs\") pod \"network-metrics-daemon-zhvrj\" (UID: \"8608f034-4011-42c3-b0ee-1369e8afa709\") " pod="openshift-multus/network-metrics-daemon-zhvrj"
Jul 13 20:53:50.150144 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:50.150042    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 20:53:50.150144 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:50.150104    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8608f034-4011-42c3-b0ee-1369e8afa709-metrics-certs podName:8608f034-4011-42c3-b0ee-1369e8afa709 nodeName:}" failed. No retries permitted until 2026-07-13 20:53:51.150089207 +0000 UTC m=+4.144872623 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8608f034-4011-42c3-b0ee-1369e8afa709-metrics-certs") pod "network-metrics-daemon-zhvrj" (UID: "8608f034-4011-42c3-b0ee-1369e8afa709") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 20:53:50.250731 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:50.250695    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-472hg\" (UniqueName: \"kubernetes.io/projected/29605f3e-f674-49cc-86b6-62bc9db78d33-kube-api-access-472hg\") pod \"network-check-target-bkclr\" (UID: \"29605f3e-f674-49cc-86b6-62bc9db78d33\") " pod="openshift-network-diagnostics/network-check-target-bkclr"
Jul 13 20:53:50.250920 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:50.250900    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 20:53:50.250978 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:50.250928    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 20:53:50.250978 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:50.250941    2561 projected.go:196] Error preparing data for projected volume kube-api-access-472hg for pod openshift-network-diagnostics/network-check-target-bkclr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 20:53:50.251040 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:50.251006    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29605f3e-f674-49cc-86b6-62bc9db78d33-kube-api-access-472hg podName:29605f3e-f674-49cc-86b6-62bc9db78d33 nodeName:}" failed. No retries permitted until 2026-07-13 20:53:51.25098646 +0000 UTC m=+4.245769866 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-472hg" (UniqueName: "kubernetes.io/projected/29605f3e-f674-49cc-86b6-62bc9db78d33-kube-api-access-472hg") pod "network-check-target-bkclr" (UID: "29605f3e-f674-49cc-86b6-62bc9db78d33") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 20:53:50.363935 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:50.363906    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf777e90_a19a_493a_9725_24c67196c62a.slice/crio-517f3d990fd6db14250413e1bc323f2d9ab3068143f0faef12d7fbdb5105f53a WatchSource:0}: Error finding container 517f3d990fd6db14250413e1bc323f2d9ab3068143f0faef12d7fbdb5105f53a: Status 404 returned error can't find the container with id 517f3d990fd6db14250413e1bc323f2d9ab3068143f0faef12d7fbdb5105f53a
Jul 13 20:53:50.368302 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:50.368277    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1adc049e_01d5_4383_975a_fc8e75ba43e1.slice/crio-8327e43765dcf88351c4fc80340cea251c3635f5e11a48206eb797dbfc509443 WatchSource:0}: Error finding container 8327e43765dcf88351c4fc80340cea251c3635f5e11a48206eb797dbfc509443: Status 404 returned error can't find the container with id 8327e43765dcf88351c4fc80340cea251c3635f5e11a48206eb797dbfc509443
Jul 13 20:53:50.368938 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:50.368914    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5c1f320_22e5_445f_8725_e6b11dc0ad1d.slice/crio-c2bc5dfc961f033af83605b9f091256c4aed4d0816287ff7c0de5e9e45c1672b WatchSource:0}: Error finding container c2bc5dfc961f033af83605b9f091256c4aed4d0816287ff7c0de5e9e45c1672b: Status 404 returned error can't find the container with id c2bc5dfc961f033af83605b9f091256c4aed4d0816287ff7c0de5e9e45c1672b
Jul 13 20:53:50.369653 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:50.369632    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70606094_6a35_429c_b57d_2b236b88cc27.slice/crio-561eadfcf21310c140fe230a02d14690b4f4377565a0a2424d27567a87ad1360 WatchSource:0}: Error finding container 561eadfcf21310c140fe230a02d14690b4f4377565a0a2424d27567a87ad1360: Status 404 returned error can't find the container with id 561eadfcf21310c140fe230a02d14690b4f4377565a0a2424d27567a87ad1360
Jul 13 20:53:50.371175 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:50.371132    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode730eed8_ff8a_4a54_b1cb_539d8f07e70b.slice/crio-53936fc3d41995418f6eeb114b6640fda36e6cd907487cc5fa6382401ebcd2ba WatchSource:0}: Error finding container 53936fc3d41995418f6eeb114b6640fda36e6cd907487cc5fa6382401ebcd2ba: Status 404 returned error can't find the container with id 53936fc3d41995418f6eeb114b6640fda36e6cd907487cc5fa6382401ebcd2ba
Jul 13 20:53:50.372301 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:50.372277    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19714a14_ff22_4f3b_a5ea_011318891f0e.slice/crio-e6ae4a6d194fd57c546bd218cf3e1f45d07c4307ca71462647e9cca601c3bc81 WatchSource:0}: Error finding container e6ae4a6d194fd57c546bd218cf3e1f45d07c4307ca71462647e9cca601c3bc81: Status 404 returned error can't find the container with id e6ae4a6d194fd57c546bd218cf3e1f45d07c4307ca71462647e9cca601c3bc81
Jul 13 20:53:50.373953 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:50.373915    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80d43145_0683_447c_b42c_132e6088f785.slice/crio-48f1a570c944eba31b5c756e71aa18f46e1b50bdf705e54051ba4a52291778a4 WatchSource:0}: Error finding container 48f1a570c944eba31b5c756e71aa18f46e1b50bdf705e54051ba4a52291778a4: Status 404 returned error can't find the container with id 48f1a570c944eba31b5c756e71aa18f46e1b50bdf705e54051ba4a52291778a4
Jul 13 20:53:50.374742 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:50.374662    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34885618_690d_42f8_96c2_3af217da17a9.slice/crio-e2dbe5e1f3c5cef68ec049ab3333413c62fdb648b3b2180693b0d79000103a34 WatchSource:0}: Error finding container e2dbe5e1f3c5cef68ec049ab3333413c62fdb648b3b2180693b0d79000103a34: Status 404 returned error can't find the container with id e2dbe5e1f3c5cef68ec049ab3333413c62fdb648b3b2180693b0d79000103a34
Jul 13 20:53:50.377570 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:53:50.376780    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ef685a0_9abc_4407_83e3_d3850d3f8c62.slice/crio-96a08ee651f6aedc2c3d8a8766fc0037b4298a86fe08b171600e79d914ba5cde WatchSource:0}: Error finding container 96a08ee651f6aedc2c3d8a8766fc0037b4298a86fe08b171600e79d914ba5cde: Status 404 returned error can't find the container with id 96a08ee651f6aedc2c3d8a8766fc0037b4298a86fe08b171600e79d914ba5cde
Jul 13 20:53:50.472469 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:50.472254    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 20:48:49 +0000 UTC" deadline="2028-03-03 22:32:28.732199215 +0000 UTC"
Jul 13 20:53:50.472736 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:50.472471    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14377h38m38.259734527s"
Jul 13 20:53:50.571152 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:50.571124    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhvrj"
Jul 13 20:53:50.571305 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:50.571250    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkclr"
Jul 13 20:53:50.571305 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:50.571250    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhvrj" podUID="8608f034-4011-42c3-b0ee-1369e8afa709"
Jul 13 20:53:50.571371 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:50.571345    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkclr" podUID="29605f3e-f674-49cc-86b6-62bc9db78d33"
Jul 13 20:53:50.578693 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:50.578665    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fwznz" event={"ID":"1adc049e-01d5-4383-975a-fc8e75ba43e1","Type":"ContainerStarted","Data":"8327e43765dcf88351c4fc80340cea251c3635f5e11a48206eb797dbfc509443"}
Jul 13 20:53:50.579733 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:50.579712    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c5jdx" event={"ID":"df777e90-a19a-493a-9725-24c67196c62a","Type":"ContainerStarted","Data":"517f3d990fd6db14250413e1bc323f2d9ab3068143f0faef12d7fbdb5105f53a"}
Jul 13 20:53:50.581361 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:50.581343    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-162.ec2.internal" event={"ID":"bafdaf3cf8444548bf12fbd6ab238989","Type":"ContainerStarted","Data":"f8c0359cfb2a619c25cb87d68327cc498f63836f66529bc51db02e483dae28a9"}
Jul 13 20:53:50.582347 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:50.582317    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fc7tq" event={"ID":"6ef685a0-9abc-4407-83e3-d3850d3f8c62","Type":"ContainerStarted","Data":"96a08ee651f6aedc2c3d8a8766fc0037b4298a86fe08b171600e79d914ba5cde"}
Jul 13 20:53:50.583219 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:50.583200    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sfjmb" event={"ID":"34885618-690d-42f8-96c2-3af217da17a9","Type":"ContainerStarted","Data":"e2dbe5e1f3c5cef68ec049ab3333413c62fdb648b3b2180693b0d79000103a34"}
Jul 13 20:53:50.584136 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:50.584116    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rb6b2" event={"ID":"80d43145-0683-447c-b42c-132e6088f785","Type":"ContainerStarted","Data":"48f1a570c944eba31b5c756e71aa18f46e1b50bdf705e54051ba4a52291778a4"}
Jul 13 20:53:50.585140 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:50.585119    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd" event={"ID":"e730eed8-ff8a-4a54-b1cb-539d8f07e70b","Type":"ContainerStarted","Data":"53936fc3d41995418f6eeb114b6640fda36e6cd907487cc5fa6382401ebcd2ba"}
Jul 13 20:53:50.586189 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:50.586169    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4svs" event={"ID":"19714a14-ff22-4f3b-a5ea-011318891f0e","Type":"ContainerStarted","Data":"e6ae4a6d194fd57c546bd218cf3e1f45d07c4307ca71462647e9cca601c3bc81"}
Jul 13 20:53:50.587279 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:50.587257    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4r78x" event={"ID":"70606094-6a35-429c-b57d-2b236b88cc27","Type":"ContainerStarted","Data":"561eadfcf21310c140fe230a02d14690b4f4377565a0a2424d27567a87ad1360"}
Jul 13 20:53:50.588358 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:50.588339    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7ll7x" event={"ID":"c5c1f320-22e5-445f-8725-e6b11dc0ad1d","Type":"ContainerStarted","Data":"c2bc5dfc961f033af83605b9f091256c4aed4d0816287ff7c0de5e9e45c1672b"}
Jul 13 20:53:50.589764 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:50.589745    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-162.ec2.internal" event={"ID":"02bd9a5046db92262a43fb17494a639b","Type":"ContainerStarted","Data":"486333a1fa346a3535cdde5d8198ea86c0e5fa70d1b2bb3c4af1e5bc73a83bd0"}
Jul 13 20:53:50.608620 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:50.608533    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-162.ec2.internal" podStartSLOduration=1.608520447 podStartE2EDuration="1.608520447s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:53:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:53:50.607970181 +0000 UTC m=+3.602753604" watchObservedRunningTime="2026-07-13 20:53:50.608520447 +0000 UTC m=+3.603303870"
Jul 13 20:53:51.057276 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:51.057195    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/02682275-db9d-4f68-9b88-4e6f2e6f52f2-original-pull-secret\") pod \"global-pull-secret-syncer-vb7lj\" (UID: \"02682275-db9d-4f68-9b88-4e6f2e6f52f2\") " pod="kube-system/global-pull-secret-syncer-vb7lj"
Jul 13 20:53:51.057432 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:51.057320    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 20:53:51.057432 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:51.057403    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02682275-db9d-4f68-9b88-4e6f2e6f52f2-original-pull-secret podName:02682275-db9d-4f68-9b88-4e6f2e6f52f2 nodeName:}" failed. No retries permitted until 2026-07-13 20:53:53.057385276 +0000 UTC m=+6.052168677 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/02682275-db9d-4f68-9b88-4e6f2e6f52f2-original-pull-secret") pod "global-pull-secret-syncer-vb7lj" (UID: "02682275-db9d-4f68-9b88-4e6f2e6f52f2") : object "kube-system"/"original-pull-secret" not registered
Jul 13 20:53:51.157846 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:51.157797    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8608f034-4011-42c3-b0ee-1369e8afa709-metrics-certs\") pod \"network-metrics-daemon-zhvrj\" (UID: \"8608f034-4011-42c3-b0ee-1369e8afa709\") " pod="openshift-multus/network-metrics-daemon-zhvrj"
Jul 13 20:53:51.158039 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:51.158023    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 20:53:51.158111 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:51.158094    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8608f034-4011-42c3-b0ee-1369e8afa709-metrics-certs podName:8608f034-4011-42c3-b0ee-1369e8afa709 nodeName:}" failed. No retries permitted until 2026-07-13 20:53:53.158072584 +0000 UTC m=+6.152855987 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8608f034-4011-42c3-b0ee-1369e8afa709-metrics-certs") pod "network-metrics-daemon-zhvrj" (UID: "8608f034-4011-42c3-b0ee-1369e8afa709") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 20:53:51.259752 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:51.259131    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-472hg\" (UniqueName: \"kubernetes.io/projected/29605f3e-f674-49cc-86b6-62bc9db78d33-kube-api-access-472hg\") pod \"network-check-target-bkclr\" (UID: \"29605f3e-f674-49cc-86b6-62bc9db78d33\") " pod="openshift-network-diagnostics/network-check-target-bkclr"
Jul 13 20:53:51.259752 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:51.259323    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 20:53:51.259752 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:51.259342    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 20:53:51.259752 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:51.259355    2561 projected.go:196] Error preparing data for projected volume kube-api-access-472hg for pod openshift-network-diagnostics/network-check-target-bkclr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 20:53:51.259752 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:51.259413    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29605f3e-f674-49cc-86b6-62bc9db78d33-kube-api-access-472hg podName:29605f3e-f674-49cc-86b6-62bc9db78d33 nodeName:}" failed. No retries permitted until 2026-07-13 20:53:53.259395354 +0000 UTC m=+6.254178770 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-472hg" (UniqueName: "kubernetes.io/projected/29605f3e-f674-49cc-86b6-62bc9db78d33-kube-api-access-472hg") pod "network-check-target-bkclr" (UID: "29605f3e-f674-49cc-86b6-62bc9db78d33") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 20:53:51.472954 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:51.472885    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 20:48:49 +0000 UTC" deadline="2028-01-29 08:18:10.708238736 +0000 UTC"
Jul 13 20:53:51.472954 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:51.472950    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13547h24m19.235292953s"
Jul 13 20:53:51.572419 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:51.571935    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vb7lj"
Jul 13 20:53:51.572419 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:51.572065    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vb7lj" podUID="02682275-db9d-4f68-9b88-4e6f2e6f52f2"
Jul 13 20:53:51.602075 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:51.602028    2561 generic.go:356] "Generic (PLEG): container finished" podID="bafdaf3cf8444548bf12fbd6ab238989" containerID="f8c0359cfb2a619c25cb87d68327cc498f63836f66529bc51db02e483dae28a9" exitCode=0
Jul 13 20:53:51.602261 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:51.602130    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-162.ec2.internal" event={"ID":"bafdaf3cf8444548bf12fbd6ab238989","Type":"ContainerDied","Data":"f8c0359cfb2a619c25cb87d68327cc498f63836f66529bc51db02e483dae28a9"}
Jul 13 20:53:52.571444 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:52.571411    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhvrj"
Jul 13 20:53:52.571996 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:52.571556    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhvrj" podUID="8608f034-4011-42c3-b0ee-1369e8afa709"
Jul 13 20:53:52.571996 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:52.571620    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkclr"
Jul 13 20:53:52.571996 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:52.571684    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkclr" podUID="29605f3e-f674-49cc-86b6-62bc9db78d33"
Jul 13 20:53:52.624572 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:52.624528    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-162.ec2.internal" event={"ID":"bafdaf3cf8444548bf12fbd6ab238989","Type":"ContainerStarted","Data":"bdb7f5dfec5fd821d86ba822949eb04840fd694ddbf8aa7e93a8c30f2207f365"}
Jul 13 20:53:53.073459 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:53.073420    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/02682275-db9d-4f68-9b88-4e6f2e6f52f2-original-pull-secret\") pod \"global-pull-secret-syncer-vb7lj\" (UID: \"02682275-db9d-4f68-9b88-4e6f2e6f52f2\") " pod="kube-system/global-pull-secret-syncer-vb7lj"
Jul 13 20:53:53.073654 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:53.073588    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 20:53:53.073654 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:53.073655    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02682275-db9d-4f68-9b88-4e6f2e6f52f2-original-pull-secret podName:02682275-db9d-4f68-9b88-4e6f2e6f52f2 nodeName:}" failed. No retries permitted until 2026-07-13 20:53:57.073637019 +0000 UTC m=+10.068420427 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/02682275-db9d-4f68-9b88-4e6f2e6f52f2-original-pull-secret") pod "global-pull-secret-syncer-vb7lj" (UID: "02682275-db9d-4f68-9b88-4e6f2e6f52f2") : object "kube-system"/"original-pull-secret" not registered
Jul 13 20:53:53.174152 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:53.174080    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8608f034-4011-42c3-b0ee-1369e8afa709-metrics-certs\") pod \"network-metrics-daemon-zhvrj\" (UID: \"8608f034-4011-42c3-b0ee-1369e8afa709\") " pod="openshift-multus/network-metrics-daemon-zhvrj"
Jul 13 20:53:53.179030 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:53.179001    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 20:53:53.179191 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:53.179091    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8608f034-4011-42c3-b0ee-1369e8afa709-metrics-certs podName:8608f034-4011-42c3-b0ee-1369e8afa709 nodeName:}" failed. No retries permitted until 2026-07-13 20:53:57.179070257 +0000 UTC m=+10.173853686 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8608f034-4011-42c3-b0ee-1369e8afa709-metrics-certs") pod "network-metrics-daemon-zhvrj" (UID: "8608f034-4011-42c3-b0ee-1369e8afa709") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 20:53:53.275369 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:53.275328    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-472hg\" (UniqueName: \"kubernetes.io/projected/29605f3e-f674-49cc-86b6-62bc9db78d33-kube-api-access-472hg\") pod \"network-check-target-bkclr\" (UID: \"29605f3e-f674-49cc-86b6-62bc9db78d33\") " pod="openshift-network-diagnostics/network-check-target-bkclr"
Jul 13 20:53:53.275560 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:53.275539    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 20:53:53.275629 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:53.275571    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 20:53:53.275629 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:53.275584    2561 projected.go:196] Error preparing data for projected volume kube-api-access-472hg for pod openshift-network-diagnostics/network-check-target-bkclr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 20:53:53.275716 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:53.275648    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29605f3e-f674-49cc-86b6-62bc9db78d33-kube-api-access-472hg podName:29605f3e-f674-49cc-86b6-62bc9db78d33 nodeName:}" failed. No retries permitted until 2026-07-13 20:53:57.27562715 +0000 UTC m=+10.270410565 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-472hg" (UniqueName: "kubernetes.io/projected/29605f3e-f674-49cc-86b6-62bc9db78d33-kube-api-access-472hg") pod "network-check-target-bkclr" (UID: "29605f3e-f674-49cc-86b6-62bc9db78d33") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 20:53:53.571104 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:53.571022    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vb7lj"
Jul 13 20:53:53.571253 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:53.571193    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vb7lj" podUID="02682275-db9d-4f68-9b88-4e6f2e6f52f2"
Jul 13 20:53:54.570881 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:54.570847    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhvrj"
Jul 13 20:53:54.571384 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:54.570897    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkclr"
Jul 13 20:53:54.571384 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:54.570995    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhvrj" podUID="8608f034-4011-42c3-b0ee-1369e8afa709"
Jul 13 20:53:54.571384 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:54.571131    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkclr" podUID="29605f3e-f674-49cc-86b6-62bc9db78d33"
Jul 13 20:53:55.571555 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:55.571482    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vb7lj"
Jul 13 20:53:55.571905 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:55.571611    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vb7lj" podUID="02682275-db9d-4f68-9b88-4e6f2e6f52f2"
Jul 13 20:53:56.571132 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:56.571093    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhvrj"
Jul 13 20:53:56.571303 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:56.571093    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkclr"
Jul 13 20:53:56.571303 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:56.571251    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhvrj" podUID="8608f034-4011-42c3-b0ee-1369e8afa709"
Jul 13 20:53:56.571442 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:56.571301    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkclr" podUID="29605f3e-f674-49cc-86b6-62bc9db78d33"
Jul 13 20:53:57.111393 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:57.111357    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/02682275-db9d-4f68-9b88-4e6f2e6f52f2-original-pull-secret\") pod \"global-pull-secret-syncer-vb7lj\" (UID: \"02682275-db9d-4f68-9b88-4e6f2e6f52f2\") " pod="kube-system/global-pull-secret-syncer-vb7lj"
Jul 13 20:53:57.111882 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:57.111524    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 20:53:57.111882 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:57.111605    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02682275-db9d-4f68-9b88-4e6f2e6f52f2-original-pull-secret podName:02682275-db9d-4f68-9b88-4e6f2e6f52f2 nodeName:}" failed. No retries permitted until 2026-07-13 20:54:05.111581616 +0000 UTC m=+18.106365039 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/02682275-db9d-4f68-9b88-4e6f2e6f52f2-original-pull-secret") pod "global-pull-secret-syncer-vb7lj" (UID: "02682275-db9d-4f68-9b88-4e6f2e6f52f2") : object "kube-system"/"original-pull-secret" not registered
Jul 13 20:53:57.212411 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:57.212336    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8608f034-4011-42c3-b0ee-1369e8afa709-metrics-certs\") pod \"network-metrics-daemon-zhvrj\" (UID: \"8608f034-4011-42c3-b0ee-1369e8afa709\") " pod="openshift-multus/network-metrics-daemon-zhvrj"
Jul 13 20:53:57.212603 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:57.212530    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 20:53:57.212603 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:57.212593    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8608f034-4011-42c3-b0ee-1369e8afa709-metrics-certs podName:8608f034-4011-42c3-b0ee-1369e8afa709 nodeName:}" failed. No retries permitted until 2026-07-13 20:54:05.2125731 +0000 UTC m=+18.207356501 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8608f034-4011-42c3-b0ee-1369e8afa709-metrics-certs") pod "network-metrics-daemon-zhvrj" (UID: "8608f034-4011-42c3-b0ee-1369e8afa709") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 20:53:57.313472 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:57.313416    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-472hg\" (UniqueName: \"kubernetes.io/projected/29605f3e-f674-49cc-86b6-62bc9db78d33-kube-api-access-472hg\") pod \"network-check-target-bkclr\" (UID: \"29605f3e-f674-49cc-86b6-62bc9db78d33\") " pod="openshift-network-diagnostics/network-check-target-bkclr"
Jul 13 20:53:57.313619 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:57.313588    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 20:53:57.313619 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:57.313615    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 20:53:57.313696 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:57.313628    2561 projected.go:196] Error preparing data for projected volume kube-api-access-472hg for pod openshift-network-diagnostics/network-check-target-bkclr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 20:53:57.313696 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:57.313686    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29605f3e-f674-49cc-86b6-62bc9db78d33-kube-api-access-472hg podName:29605f3e-f674-49cc-86b6-62bc9db78d33 nodeName:}" failed. No retries permitted until 2026-07-13 20:54:05.313666021 +0000 UTC m=+18.308449424 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-472hg" (UniqueName: "kubernetes.io/projected/29605f3e-f674-49cc-86b6-62bc9db78d33-kube-api-access-472hg") pod "network-check-target-bkclr" (UID: "29605f3e-f674-49cc-86b6-62bc9db78d33") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 20:53:57.571799 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:57.571712    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vb7lj"
Jul 13 20:53:57.572008 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:57.571843    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vb7lj" podUID="02682275-db9d-4f68-9b88-4e6f2e6f52f2"
Jul 13 20:53:58.571934 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:58.571318    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhvrj"
Jul 13 20:53:58.571934 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:58.571458    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhvrj" podUID="8608f034-4011-42c3-b0ee-1369e8afa709"
Jul 13 20:53:58.571934 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:58.571539    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkclr"
Jul 13 20:53:58.571934 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:58.571610    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkclr" podUID="29605f3e-f674-49cc-86b6-62bc9db78d33"
Jul 13 20:53:59.571434 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:53:59.571400    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vb7lj"
Jul 13 20:53:59.571631 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:53:59.571545    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vb7lj" podUID="02682275-db9d-4f68-9b88-4e6f2e6f52f2"
Jul 13 20:54:00.571559 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:00.571529    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkclr"
Jul 13 20:54:00.572025 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:00.571567    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhvrj"
Jul 13 20:54:00.572025 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:00.571653    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkclr" podUID="29605f3e-f674-49cc-86b6-62bc9db78d33"
Jul 13 20:54:00.572025 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:00.571808    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhvrj" podUID="8608f034-4011-42c3-b0ee-1369e8afa709"
Jul 13 20:54:01.570992 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:01.570902    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vb7lj"
Jul 13 20:54:01.571156 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:01.571051    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vb7lj" podUID="02682275-db9d-4f68-9b88-4e6f2e6f52f2"
Jul 13 20:54:02.571205 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:02.571165    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhvrj"
Jul 13 20:54:02.571205 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:02.571186    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkclr"
Jul 13 20:54:02.571691 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:02.571306    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkclr" podUID="29605f3e-f674-49cc-86b6-62bc9db78d33"
Jul 13 20:54:02.571691 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:02.571452    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhvrj" podUID="8608f034-4011-42c3-b0ee-1369e8afa709"
Jul 13 20:54:03.570914 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:03.570876    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vb7lj"
Jul 13 20:54:03.571085 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:03.571036    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vb7lj" podUID="02682275-db9d-4f68-9b88-4e6f2e6f52f2"
Jul 13 20:54:04.571566 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:04.571530    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhvrj"
Jul 13 20:54:04.572108 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:04.571569    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkclr"
Jul 13 20:54:04.572108 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:04.571673    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhvrj" podUID="8608f034-4011-42c3-b0ee-1369e8afa709"
Jul 13 20:54:04.572108 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:04.571799    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkclr" podUID="29605f3e-f674-49cc-86b6-62bc9db78d33"
Jul 13 20:54:05.175089 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:05.175058    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/02682275-db9d-4f68-9b88-4e6f2e6f52f2-original-pull-secret\") pod \"global-pull-secret-syncer-vb7lj\" (UID: \"02682275-db9d-4f68-9b88-4e6f2e6f52f2\") " pod="kube-system/global-pull-secret-syncer-vb7lj"
Jul 13 20:54:05.175368 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:05.175179    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 20:54:05.175368 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:05.175248    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02682275-db9d-4f68-9b88-4e6f2e6f52f2-original-pull-secret podName:02682275-db9d-4f68-9b88-4e6f2e6f52f2 nodeName:}" failed. No retries permitted until 2026-07-13 20:54:21.175227917 +0000 UTC m=+34.170011318 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/02682275-db9d-4f68-9b88-4e6f2e6f52f2-original-pull-secret") pod "global-pull-secret-syncer-vb7lj" (UID: "02682275-db9d-4f68-9b88-4e6f2e6f52f2") : object "kube-system"/"original-pull-secret" not registered
Jul 13 20:54:05.275577 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:05.275542    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8608f034-4011-42c3-b0ee-1369e8afa709-metrics-certs\") pod \"network-metrics-daemon-zhvrj\" (UID: \"8608f034-4011-42c3-b0ee-1369e8afa709\") " pod="openshift-multus/network-metrics-daemon-zhvrj"
Jul 13 20:54:05.275728 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:05.275690    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 20:54:05.275769 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:05.275755    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8608f034-4011-42c3-b0ee-1369e8afa709-metrics-certs podName:8608f034-4011-42c3-b0ee-1369e8afa709 nodeName:}" failed. No retries permitted until 2026-07-13 20:54:21.275739641 +0000 UTC m=+34.270523041 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8608f034-4011-42c3-b0ee-1369e8afa709-metrics-certs") pod "network-metrics-daemon-zhvrj" (UID: "8608f034-4011-42c3-b0ee-1369e8afa709") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 20:54:05.376505 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:05.376471    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-472hg\" (UniqueName: \"kubernetes.io/projected/29605f3e-f674-49cc-86b6-62bc9db78d33-kube-api-access-472hg\") pod \"network-check-target-bkclr\" (UID: \"29605f3e-f674-49cc-86b6-62bc9db78d33\") " pod="openshift-network-diagnostics/network-check-target-bkclr"
Jul 13 20:54:05.376630 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:05.376606    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 20:54:05.376630 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:05.376622    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 20:54:05.376630 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:05.376631    2561 projected.go:196] Error preparing data for projected volume kube-api-access-472hg for pod openshift-network-diagnostics/network-check-target-bkclr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 20:54:05.376779 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:05.376681    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29605f3e-f674-49cc-86b6-62bc9db78d33-kube-api-access-472hg podName:29605f3e-f674-49cc-86b6-62bc9db78d33 nodeName:}" failed. No retries permitted until 2026-07-13 20:54:21.376665327 +0000 UTC m=+34.371448731 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-472hg" (UniqueName: "kubernetes.io/projected/29605f3e-f674-49cc-86b6-62bc9db78d33-kube-api-access-472hg") pod "network-check-target-bkclr" (UID: "29605f3e-f674-49cc-86b6-62bc9db78d33") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 20:54:05.571208 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:05.571120    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vb7lj"
Jul 13 20:54:05.571379 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:05.571267    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vb7lj" podUID="02682275-db9d-4f68-9b88-4e6f2e6f52f2"
Jul 13 20:54:06.570802 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:06.570764    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkclr"
Jul 13 20:54:06.570802 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:06.570797    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhvrj"
Jul 13 20:54:06.571317 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:06.570910    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkclr" podUID="29605f3e-f674-49cc-86b6-62bc9db78d33"
Jul 13 20:54:06.571317 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:06.571040    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhvrj" podUID="8608f034-4011-42c3-b0ee-1369e8afa709"
Jul 13 20:54:07.574018 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:07.573978    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vb7lj"
Jul 13 20:54:07.574416 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:07.574092    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vb7lj" podUID="02682275-db9d-4f68-9b88-4e6f2e6f52f2"
Jul 13 20:54:08.571502 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:08.571465    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhvrj"
Jul 13 20:54:08.571502 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:08.571506    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkclr"
Jul 13 20:54:08.571745 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:08.571608    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhvrj" podUID="8608f034-4011-42c3-b0ee-1369e8afa709"
Jul 13 20:54:08.571801 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:08.571749    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkclr" podUID="29605f3e-f674-49cc-86b6-62bc9db78d33"
Jul 13 20:54:09.573604 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:09.573225    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vb7lj"
Jul 13 20:54:09.573604 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:09.573531    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vb7lj" podUID="02682275-db9d-4f68-9b88-4e6f2e6f52f2"
Jul 13 20:54:09.659066 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:09.659033    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4svs" event={"ID":"19714a14-ff22-4f3b-a5ea-011318891f0e","Type":"ContainerStarted","Data":"dd24d2d75f04662fe796b7e3a78dbe8d4d5f21818958cf61ed11303fc8b46af2"}
Jul 13 20:54:09.660322 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:09.660300    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4r78x" event={"ID":"70606094-6a35-429c-b57d-2b236b88cc27","Type":"ContainerStarted","Data":"bb67221d30aeb5c20b1be39a6522b2b679de01c9cc83000d89c3be4288e40b9c"}
Jul 13 20:54:09.661640 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:09.661619    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7ll7x" event={"ID":"c5c1f320-22e5-445f-8725-e6b11dc0ad1d","Type":"ContainerStarted","Data":"a7070f4cd3bef0976cb3526228a79fcf096c43c5d06c75ddaed5a1ba801a1ff3"}
Jul 13 20:54:09.662973 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:09.662949    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c5jdx" event={"ID":"df777e90-a19a-493a-9725-24c67196c62a","Type":"ContainerStarted","Data":"a2a3d39a3954d9e1008ca89071c81d5c3d5a10a92936fe39acf2143f4d3dd439"}
Jul 13 20:54:09.664367 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:09.664344    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fc7tq" event={"ID":"6ef685a0-9abc-4407-83e3-d3850d3f8c62","Type":"ContainerStarted","Data":"4de42c2c0b7fbd8ecad84db37c75a1cf4b603af289a659bcbd132ca19e9ba1a6"}
Jul 13 20:54:09.665575 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:09.665556    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sfjmb" event={"ID":"34885618-690d-42f8-96c2-3af217da17a9","Type":"ContainerStarted","Data":"d8989128d6e106ccf4a2bf129e4e9db2aad097ad488122b6223515ec0ca30c97"}
Jul 13 20:54:09.666799 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:09.666781    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rb6b2" event={"ID":"80d43145-0683-447c-b42c-132e6088f785","Type":"ContainerStarted","Data":"17047b3bd4e6d5ffdf840a293f669f1716058186df2175aeb9b818ff92e14e07"}
Jul 13 20:54:09.674264 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:09.674227    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4r78x" podStartSLOduration=3.664650993 podStartE2EDuration="22.674216722s" totalImagesPullingTime="19.009565729s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:53:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:54:09.673878257 +0000 UTC m=+22.668661681" watchObservedRunningTime="2026-07-13 20:54:09.674216722 +0000 UTC m=+22.669000145"
Jul 13 20:54:09.674561 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:09.674544    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-162.ec2.internal" podStartSLOduration=20.674539387 podStartE2EDuration="20.674539387s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:53:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:53:52.656690717 +0000 UTC m=+5.651474142" watchObservedRunningTime="2026-07-13 20:54:09.674539387 +0000 UTC m=+22.669322809"
Jul 13 20:54:09.690239 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:09.690201    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rb6b2" podStartSLOduration=3.6514962300000002 podStartE2EDuration="22.690192384s" totalImagesPullingTime="19.038696154s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:53:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:54:09.689601308 +0000 UTC m=+22.684384732" watchObservedRunningTime="2026-07-13 20:54:09.690192384 +0000 UTC m=+22.684975807"
Jul 13 20:54:09.705772 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:09.705735    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fc7tq" podStartSLOduration=3.6890157070000003 podStartE2EDuration="22.705720789s" totalImagesPullingTime="19.016705082s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:53:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:54:09.705450166 +0000 UTC m=+22.700233588" watchObservedRunningTime="2026-07-13 20:54:09.705720789 +0000 UTC m=+22.700504212"
Jul 13 20:54:09.782283 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:09.782227    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7ll7x" podStartSLOduration=4.109391871 podStartE2EDuration="22.782209599s" totalImagesPullingTime="18.672817728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:53:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:54:09.782050735 +0000 UTC m=+22.776834158" watchObservedRunningTime="2026-07-13 20:54:09.782209599 +0000 UTC m=+22.776993023"
Jul 13 20:54:09.836075 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:09.836021    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-sfjmb" podStartSLOduration=3.813567832 podStartE2EDuration="22.836006008s" totalImagesPullingTime="19.022438176s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:53:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:54:09.835314029 +0000 UTC m=+22.830097443" watchObservedRunningTime="2026-07-13 20:54:09.836006008 +0000 UTC m=+22.830789430"
Jul 13 20:54:10.571450 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:10.571285    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhvrj"
Jul 13 20:54:10.571561 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:10.571334    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkclr"
Jul 13 20:54:10.571561 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:10.571538    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhvrj" podUID="8608f034-4011-42c3-b0ee-1369e8afa709"
Jul 13 20:54:10.571633 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:10.571602    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkclr" podUID="29605f3e-f674-49cc-86b6-62bc9db78d33"
Jul 13 20:54:10.672387 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:10.672353    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jrpbd_e730eed8-ff8a-4a54-b1cb-539d8f07e70b/ovn-acl-logging/0.log"
Jul 13 20:54:10.673129 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:10.672745    2561 generic.go:356] "Generic (PLEG): container finished" podID="e730eed8-ff8a-4a54-b1cb-539d8f07e70b" containerID="887ca05b35d6e2739f855d9691aa709f0ceba86a12e71885de2f03d9d3407db4" exitCode=1
Jul 13 20:54:10.673129 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:10.672800    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd" event={"ID":"e730eed8-ff8a-4a54-b1cb-539d8f07e70b","Type":"ContainerStarted","Data":"a2d8ba3dd7e34abb93e4ceccc14d50df80926187f67264c53e66e509b7f46e18"}
Jul 13 20:54:10.673129 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:10.672913    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd" event={"ID":"e730eed8-ff8a-4a54-b1cb-539d8f07e70b","Type":"ContainerStarted","Data":"d4f9dbeaec97df61968bbe4c36efa227044145a8c2c95a270b4553a88f9e3f11"}
Jul 13 20:54:10.673129 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:10.672952    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd" event={"ID":"e730eed8-ff8a-4a54-b1cb-539d8f07e70b","Type":"ContainerStarted","Data":"9f506b8621a9cb3997ddec02969014ca246e102a9bbf03ac0436ed81970ee118"}
Jul 13 20:54:10.673129 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:10.672991    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd" event={"ID":"e730eed8-ff8a-4a54-b1cb-539d8f07e70b","Type":"ContainerStarted","Data":"de5ef24e427436cbf6a9f85081754eb5cb899e31c394f59fc80dca93ffa75e29"}
Jul 13 20:54:10.673129 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:10.673039    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd" event={"ID":"e730eed8-ff8a-4a54-b1cb-539d8f07e70b","Type":"ContainerDied","Data":"887ca05b35d6e2739f855d9691aa709f0ceba86a12e71885de2f03d9d3407db4"}
Jul 13 20:54:10.673129 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:10.673089    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd" event={"ID":"e730eed8-ff8a-4a54-b1cb-539d8f07e70b","Type":"ContainerStarted","Data":"c725cf88d9f9271b67d3e645e0b29206e93c26ebbf25e3a289f3b09d952c3829"}
Jul 13 20:54:10.674511 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:10.674492    2561 generic.go:356] "Generic (PLEG): container finished" podID="df777e90-a19a-493a-9725-24c67196c62a" containerID="a2a3d39a3954d9e1008ca89071c81d5c3d5a10a92936fe39acf2143f4d3dd439" exitCode=0
Jul 13 20:54:10.674653 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:10.674586    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c5jdx" event={"ID":"df777e90-a19a-493a-9725-24c67196c62a","Type":"ContainerDied","Data":"a2a3d39a3954d9e1008ca89071c81d5c3d5a10a92936fe39acf2143f4d3dd439"}
Jul 13 20:54:11.045068 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:11.045042    2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 13 20:54:11.493867 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:11.493702    2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-13T20:54:11.045063347Z","UUID":"6b180426-3855-4c93-8303-6a4bf2470dbd","Handler":null,"Name":"","Endpoint":""}
Jul 13 20:54:11.495489 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:11.495467    2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 13 20:54:11.495641 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:11.495513    2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 13 20:54:11.571331 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:11.571287    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vb7lj"
Jul 13 20:54:11.571505 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:11.571426    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vb7lj" podUID="02682275-db9d-4f68-9b88-4e6f2e6f52f2"
Jul 13 20:54:11.678855 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:11.678794    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fwznz" event={"ID":"1adc049e-01d5-4383-975a-fc8e75ba43e1","Type":"ContainerStarted","Data":"37145e7798cb3f239d2629e880a79993d620087529cf2387521db061e1a54648"}
Jul 13 20:54:11.681185 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:11.681114    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4svs" event={"ID":"19714a14-ff22-4f3b-a5ea-011318891f0e","Type":"ContainerStarted","Data":"b93758dc2d3683eb9eaa7cce780d68147c5f2e1bb59304561dedd2e9f28cc1d9"}
Jul 13 20:54:11.693171 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:11.693117    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fwznz" podStartSLOduration=5.668811291 podStartE2EDuration="24.693099101s" totalImagesPullingTime="19.02428781s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:53:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:54:11.692701175 +0000 UTC m=+24.687484600" watchObservedRunningTime="2026-07-13 20:54:11.693099101 +0000 UTC m=+24.687882526"
Jul 13 20:54:12.571548 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:12.571365    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhvrj"
Jul 13 20:54:12.571763 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:12.571402    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkclr"
Jul 13 20:54:12.571763 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:12.571657    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhvrj" podUID="8608f034-4011-42c3-b0ee-1369e8afa709"
Jul 13 20:54:12.571763 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:12.571709    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkclr" podUID="29605f3e-f674-49cc-86b6-62bc9db78d33"
Jul 13 20:54:12.686176 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:12.686133    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4svs" event={"ID":"19714a14-ff22-4f3b-a5ea-011318891f0e","Type":"ContainerStarted","Data":"74b76ce0dce0b4598c2e0c0c3d69b753352841707b55a601193f45815b22d339"}
Jul 13 20:54:12.705683 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:12.705639    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4svs" podStartSLOduration=4.047744105 podStartE2EDuration="25.705619127s" totalImagesPullingTime="21.657875022s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:53:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:54:12.705060697 +0000 UTC m=+25.699844152" watchObservedRunningTime="2026-07-13 20:54:12.705619127 +0000 UTC m=+25.700402551"
Jul 13 20:54:13.424751 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:13.424719    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7ll7x"
Jul 13 20:54:13.425477 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:13.425456    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7ll7x"
Jul 13 20:54:13.571008 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:13.570978    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vb7lj"
Jul 13 20:54:13.571184 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:13.571100    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vb7lj" podUID="02682275-db9d-4f68-9b88-4e6f2e6f52f2"
Jul 13 20:54:13.691755 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:13.691689    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jrpbd_e730eed8-ff8a-4a54-b1cb-539d8f07e70b/ovn-acl-logging/0.log"
Jul 13 20:54:13.692299 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:13.692137    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd" event={"ID":"e730eed8-ff8a-4a54-b1cb-539d8f07e70b","Type":"ContainerStarted","Data":"8e76426459e48c95d1e8fb991c5678d265c029d189c89a932b267bc51e56af3d"}
Jul 13 20:54:13.692453 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:13.692428    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7ll7x"
Jul 13 20:54:13.692886 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:13.692862    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7ll7x"
Jul 13 20:54:14.571312 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:14.571276    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhvrj"
Jul 13 20:54:14.571501 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:14.571278    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkclr"
Jul 13 20:54:14.571501 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:14.571422    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhvrj" podUID="8608f034-4011-42c3-b0ee-1369e8afa709"
Jul 13 20:54:14.571620 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:14.571495    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkclr" podUID="29605f3e-f674-49cc-86b6-62bc9db78d33"
Jul 13 20:54:15.571872 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:15.571689    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vb7lj"
Jul 13 20:54:15.572468 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:15.571949    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vb7lj" podUID="02682275-db9d-4f68-9b88-4e6f2e6f52f2"
Jul 13 20:54:15.697626 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:15.697590    2561 generic.go:356] "Generic (PLEG): container finished" podID="df777e90-a19a-493a-9725-24c67196c62a" containerID="6e877e7184d63e7972c7c327234fb0b83aeade7e2c2974a21a724a2ae7873fc9" exitCode=0
Jul 13 20:54:15.697778 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:15.697659    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c5jdx" event={"ID":"df777e90-a19a-493a-9725-24c67196c62a","Type":"ContainerDied","Data":"6e877e7184d63e7972c7c327234fb0b83aeade7e2c2974a21a724a2ae7873fc9"}
Jul 13 20:54:15.704284 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:15.704264    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jrpbd_e730eed8-ff8a-4a54-b1cb-539d8f07e70b/ovn-acl-logging/0.log"
Jul 13 20:54:15.704628 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:15.704607    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd" event={"ID":"e730eed8-ff8a-4a54-b1cb-539d8f07e70b","Type":"ContainerStarted","Data":"2dbf28b2429790002d2bf11aee7591be8e0ba3c97f35e5b761402caac9b6a5a4"}
Jul 13 20:54:15.705086 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:15.705071    2561 scope.go:117] "RemoveContainer" containerID="887ca05b35d6e2739f855d9691aa709f0ceba86a12e71885de2f03d9d3407db4"
Jul 13 20:54:16.570973 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:16.570941    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhvrj"
Jul 13 20:54:16.571611 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:16.571095    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhvrj" podUID="8608f034-4011-42c3-b0ee-1369e8afa709"
Jul 13 20:54:16.571611 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:16.571168    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkclr"
Jul 13 20:54:16.571611 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:16.571284    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkclr" podUID="29605f3e-f674-49cc-86b6-62bc9db78d33"
Jul 13 20:54:16.710303 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:16.710148    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jrpbd_e730eed8-ff8a-4a54-b1cb-539d8f07e70b/ovn-acl-logging/0.log"
Jul 13 20:54:16.710752 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:16.710730    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd" event={"ID":"e730eed8-ff8a-4a54-b1cb-539d8f07e70b","Type":"ContainerStarted","Data":"4faef22779eb2e6e2d9d752bbeb4190b163a72dd0adccfe254027737b35e3545"}
Jul 13 20:54:16.711050 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:16.711031    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:54:16.711178 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:16.711108    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:54:16.711178 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:16.711157    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:54:16.725824 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:16.725786    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:54:16.726058 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:16.726043    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:54:16.738450 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:16.738412    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd" podStartSLOduration=10.211128239 podStartE2EDuration="29.73840042s" totalImagesPullingTime="19.527272181s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:53:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:54:16.738035342 +0000 UTC m=+29.732818764" watchObservedRunningTime="2026-07-13 20:54:16.73840042 +0000 UTC m=+29.733183844"
Jul 13 20:54:16.804664 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:16.804639    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vb7lj"]
Jul 13 20:54:16.804786 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:16.804765    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vb7lj"
Jul 13 20:54:16.805244 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:16.804891    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vb7lj" podUID="02682275-db9d-4f68-9b88-4e6f2e6f52f2"
Jul 13 20:54:16.809465 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:16.805971    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bkclr"]
Jul 13 20:54:16.809465 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:16.806132    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkclr"
Jul 13 20:54:16.809465 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:16.807687    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zhvrj"]
Jul 13 20:54:16.809465 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:16.807805    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhvrj"
Jul 13 20:54:16.809465 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:16.807990    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhvrj" podUID="8608f034-4011-42c3-b0ee-1369e8afa709"
Jul 13 20:54:16.809465 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:16.808289    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkclr" podUID="29605f3e-f674-49cc-86b6-62bc9db78d33"
Jul 13 20:54:17.715158 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:17.715124    2561 generic.go:356] "Generic (PLEG): container finished" podID="df777e90-a19a-493a-9725-24c67196c62a" containerID="4a02038ff24dfca2db57821deb386cf4523486b41d7dae4e3a710731d293709f" exitCode=0
Jul 13 20:54:17.715734 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:17.715210    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c5jdx" event={"ID":"df777e90-a19a-493a-9725-24c67196c62a","Type":"ContainerDied","Data":"4a02038ff24dfca2db57821deb386cf4523486b41d7dae4e3a710731d293709f"}
Jul 13 20:54:18.571360 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:18.571323    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vb7lj"
Jul 13 20:54:18.571360 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:18.571365    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkclr"
Jul 13 20:54:18.571595 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:18.571424    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhvrj"
Jul 13 20:54:18.571595 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:18.571440    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vb7lj" podUID="02682275-db9d-4f68-9b88-4e6f2e6f52f2"
Jul 13 20:54:18.571595 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:18.571502    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhvrj" podUID="8608f034-4011-42c3-b0ee-1369e8afa709"
Jul 13 20:54:18.571595 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:18.571550    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkclr" podUID="29605f3e-f674-49cc-86b6-62bc9db78d33"
Jul 13 20:54:19.721286 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:19.721203    2561 generic.go:356] "Generic (PLEG): container finished" podID="df777e90-a19a-493a-9725-24c67196c62a" containerID="e89d9b095567c438f6aedd18392275635e4e9ca32fe9966362ff423e412ae99e" exitCode=0
Jul 13 20:54:19.721286 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:19.721241    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c5jdx" event={"ID":"df777e90-a19a-493a-9725-24c67196c62a","Type":"ContainerDied","Data":"e89d9b095567c438f6aedd18392275635e4e9ca32fe9966362ff423e412ae99e"}
Jul 13 20:54:20.570713 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:20.570685    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vb7lj"
Jul 13 20:54:20.570896 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:20.570685    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkclr"
Jul 13 20:54:20.570896 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:20.570799    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vb7lj" podUID="02682275-db9d-4f68-9b88-4e6f2e6f52f2"
Jul 13 20:54:20.570896 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:20.570880    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkclr" podUID="29605f3e-f674-49cc-86b6-62bc9db78d33"
Jul 13 20:54:20.571028 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:20.570685    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhvrj"
Jul 13 20:54:20.571028 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:20.570999    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhvrj" podUID="8608f034-4011-42c3-b0ee-1369e8afa709"
Jul 13 20:54:21.197926 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:21.197892    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/02682275-db9d-4f68-9b88-4e6f2e6f52f2-original-pull-secret\") pod \"global-pull-secret-syncer-vb7lj\" (UID: \"02682275-db9d-4f68-9b88-4e6f2e6f52f2\") " pod="kube-system/global-pull-secret-syncer-vb7lj"
Jul 13 20:54:21.198425 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:21.198078    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 20:54:21.198425 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:21.198153    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02682275-db9d-4f68-9b88-4e6f2e6f52f2-original-pull-secret podName:02682275-db9d-4f68-9b88-4e6f2e6f52f2 nodeName:}" failed. No retries permitted until 2026-07-13 20:54:53.198132603 +0000 UTC m=+66.192916018 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/02682275-db9d-4f68-9b88-4e6f2e6f52f2-original-pull-secret") pod "global-pull-secret-syncer-vb7lj" (UID: "02682275-db9d-4f68-9b88-4e6f2e6f52f2") : object "kube-system"/"original-pull-secret" not registered
Jul 13 20:54:21.288802 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:21.288757    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:54:21.298640 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:21.298613    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8608f034-4011-42c3-b0ee-1369e8afa709-metrics-certs\") pod \"network-metrics-daemon-zhvrj\" (UID: \"8608f034-4011-42c3-b0ee-1369e8afa709\") " pod="openshift-multus/network-metrics-daemon-zhvrj"
Jul 13 20:54:21.298785 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:21.298766    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 20:54:21.298861 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:21.298849    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8608f034-4011-42c3-b0ee-1369e8afa709-metrics-certs podName:8608f034-4011-42c3-b0ee-1369e8afa709 nodeName:}" failed. No retries permitted until 2026-07-13 20:54:53.298830075 +0000 UTC m=+66.293613477 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8608f034-4011-42c3-b0ee-1369e8afa709-metrics-certs") pod "network-metrics-daemon-zhvrj" (UID: "8608f034-4011-42c3-b0ee-1369e8afa709") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 20:54:21.385702 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:21.385653    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:54:21.399621 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:21.399586    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-472hg\" (UniqueName: \"kubernetes.io/projected/29605f3e-f674-49cc-86b6-62bc9db78d33-kube-api-access-472hg\") pod \"network-check-target-bkclr\" (UID: \"29605f3e-f674-49cc-86b6-62bc9db78d33\") " pod="openshift-network-diagnostics/network-check-target-bkclr"
Jul 13 20:54:21.399779 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:21.399730    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 20:54:21.399779 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:21.399745    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 20:54:21.399779 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:21.399759    2561 projected.go:196] Error preparing data for projected volume kube-api-access-472hg for pod openshift-network-diagnostics/network-check-target-bkclr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 20:54:21.399964 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:21.399831    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29605f3e-f674-49cc-86b6-62bc9db78d33-kube-api-access-472hg podName:29605f3e-f674-49cc-86b6-62bc9db78d33 nodeName:}" failed. No retries permitted until 2026-07-13 20:54:53.399796445 +0000 UTC m=+66.394579849 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-472hg" (UniqueName: "kubernetes.io/projected/29605f3e-f674-49cc-86b6-62bc9db78d33-kube-api-access-472hg") pod "network-check-target-bkclr" (UID: "29605f3e-f674-49cc-86b6-62bc9db78d33") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 20:54:21.831015 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:21.830978    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:54:21.899529 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:21.899481    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:54:22.000418 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:22.000208    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:54:22.413073 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:22.413037    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:54:22.515922 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:22.515889    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:54:22.570734 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:22.570699    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhvrj"
Jul 13 20:54:22.570734 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:22.570719    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vb7lj"
Jul 13 20:54:22.570976 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:22.570720    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkclr"
Jul 13 20:54:22.570976 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:22.570871    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zhvrj" podUID="8608f034-4011-42c3-b0ee-1369e8afa709"
Jul 13 20:54:22.571089 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:22.570975    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vb7lj" podUID="02682275-db9d-4f68-9b88-4e6f2e6f52f2"
Jul 13 20:54:22.571089 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:22.571072    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkclr" podUID="29605f3e-f674-49cc-86b6-62bc9db78d33"
Jul 13 20:54:22.870175 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:22.870123    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:54:22.970629 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:22.970578    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:54:23.223344 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:23.223268    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-162.ec2.internal" event="NodeReady"
Jul 13 20:54:23.223487 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:23.223431    2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 13 20:54:23.270764 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:23.270733    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-g6djs"]
Jul 13 20:54:23.275992 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:23.275969    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dqqtb"]
Jul 13 20:54:23.276143 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:23.276063    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g6djs"
Jul 13 20:54:23.278727 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:23.278701    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-f67kb\""
Jul 13 20:54:23.278885 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:23.278776    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 13 20:54:23.279041 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:23.279021    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 13 20:54:23.279342 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:23.279323    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dqqtb"
Jul 13 20:54:23.281582 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:23.281565    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 13 20:54:23.281669 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:23.281565    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 13 20:54:23.281669 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:23.281642    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 13 20:54:23.281783 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:23.281687    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-q596p\""
Jul 13 20:54:23.283155 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:23.283135    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g6djs"]
Jul 13 20:54:23.286934 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:23.286914    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dqqtb"]
Jul 13 20:54:23.383222 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:23.383186    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:54:23.414196 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:23.414163    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d30568f7-82bc-4275-8448-bd730870d3c9-tmp-dir\") pod \"dns-default-g6djs\" (UID: \"d30568f7-82bc-4275-8448-bd730870d3c9\") " pod="openshift-dns/dns-default-g6djs"
Jul 13 20:54:23.414620 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:23.414233    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw6l6\" (UniqueName: \"kubernetes.io/projected/d00b98e8-2a0b-4cac-bdb9-4694daeb7e0a-kube-api-access-gw6l6\") pod \"ingress-canary-dqqtb\" (UID: \"d00b98e8-2a0b-4cac-bdb9-4694daeb7e0a\") " pod="openshift-ingress-canary/ingress-canary-dqqtb"
Jul 13 20:54:23.414620 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:23.414300    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d30568f7-82bc-4275-8448-bd730870d3c9-metrics-tls\") pod \"dns-default-g6djs\" (UID: \"d30568f7-82bc-4275-8448-bd730870d3c9\") " pod="openshift-dns/dns-default-g6djs"
Jul 13 20:54:23.414620 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:23.414316    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgxx7\" (UniqueName: \"kubernetes.io/projected/d30568f7-82bc-4275-8448-bd730870d3c9-kube-api-access-dgxx7\") pod \"dns-default-g6djs\" (UID: \"d30568f7-82bc-4275-8448-bd730870d3c9\") " pod="openshift-dns/dns-default-g6djs"
Jul 13 20:54:23.414620 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:23.414344    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d30568f7-82bc-4275-8448-bd730870d3c9-config-volume\") pod \"dns-default-g6djs\" (UID: \"d30568f7-82bc-4275-8448-bd730870d3c9\") " pod="openshift-dns/dns-default-g6djs"
Jul 13 20:54:23.414620 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:23.414365    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d00b98e8-2a0b-4cac-bdb9-4694daeb7e0a-cert\") pod \"ingress-canary-dqqtb\" (UID: \"d00b98e8-2a0b-4cac-bdb9-4694daeb7e0a\") " pod="openshift-ingress-canary/ingress-canary-dqqtb"
Jul 13 20:54:23.514918 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:23.514879    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d30568f7-82bc-4275-8448-bd730870d3c9-metrics-tls\") pod \"dns-default-g6djs\" (UID: \"d30568f7-82bc-4275-8448-bd730870d3c9\") " pod="openshift-dns/dns-default-g6djs"
Jul 13 20:54:23.514918 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:23.514916    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgxx7\" (UniqueName: \"kubernetes.io/projected/d30568f7-82bc-4275-8448-bd730870d3c9-kube-api-access-dgxx7\") pod \"dns-default-g6djs\" (UID: \"d30568f7-82bc-4275-8448-bd730870d3c9\") " pod="openshift-dns/dns-default-g6djs"
Jul 13 20:54:23.515146 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:23.514951    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d30568f7-82bc-4275-8448-bd730870d3c9-config-volume\") pod \"dns-default-g6djs\" (UID: \"d30568f7-82bc-4275-8448-bd730870d3c9\") " pod="openshift-dns/dns-default-g6djs"
Jul 13 20:54:23.515146 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:23.514983    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d00b98e8-2a0b-4cac-bdb9-4694daeb7e0a-cert\") pod \"ingress-canary-dqqtb\" (UID: \"d00b98e8-2a0b-4cac-bdb9-4694daeb7e0a\") " pod="openshift-ingress-canary/ingress-canary-dqqtb"
Jul 13 20:54:23.515146 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:23.515003    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d30568f7-82bc-4275-8448-bd730870d3c9-tmp-dir\") pod \"dns-default-g6djs\" (UID: \"d30568f7-82bc-4275-8448-bd730870d3c9\") " pod="openshift-dns/dns-default-g6djs"
Jul 13 20:54:23.515146 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:23.515051    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw6l6\" (UniqueName: \"kubernetes.io/projected/d00b98e8-2a0b-4cac-bdb9-4694daeb7e0a-kube-api-access-gw6l6\") pod \"ingress-canary-dqqtb\" (UID: \"d00b98e8-2a0b-4cac-bdb9-4694daeb7e0a\") " pod="openshift-ingress-canary/ingress-canary-dqqtb"
Jul 13 20:54:23.515146 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:23.515058    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 20:54:23.515146 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:23.515141    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d30568f7-82bc-4275-8448-bd730870d3c9-metrics-tls podName:d30568f7-82bc-4275-8448-bd730870d3c9 nodeName:}" failed. No retries permitted until 2026-07-13 20:54:24.015118405 +0000 UTC m=+37.009901823 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d30568f7-82bc-4275-8448-bd730870d3c9-metrics-tls") pod "dns-default-g6djs" (UID: "d30568f7-82bc-4275-8448-bd730870d3c9") : secret "dns-default-metrics-tls" not found
Jul 13 20:54:23.515521 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:23.515461    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d30568f7-82bc-4275-8448-bd730870d3c9-tmp-dir\") pod \"dns-default-g6djs\" (UID: \"d30568f7-82bc-4275-8448-bd730870d3c9\") " pod="openshift-dns/dns-default-g6djs"
Jul 13 20:54:23.515685 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:23.515666    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d30568f7-82bc-4275-8448-bd730870d3c9-config-volume\") pod \"dns-default-g6djs\" (UID: \"d30568f7-82bc-4275-8448-bd730870d3c9\") " pod="openshift-dns/dns-default-g6djs"
Jul 13 20:54:23.519905 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:23.519885    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d00b98e8-2a0b-4cac-bdb9-4694daeb7e0a-cert\") pod \"ingress-canary-dqqtb\" (UID: \"d00b98e8-2a0b-4cac-bdb9-4694daeb7e0a\") " pod="openshift-ingress-canary/ingress-canary-dqqtb"
Jul 13 20:54:23.525773 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:23.525751    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw6l6\" (UniqueName: \"kubernetes.io/projected/d00b98e8-2a0b-4cac-bdb9-4694daeb7e0a-kube-api-access-gw6l6\") pod \"ingress-canary-dqqtb\" (UID: \"d00b98e8-2a0b-4cac-bdb9-4694daeb7e0a\") " pod="openshift-ingress-canary/ingress-canary-dqqtb"
Jul 13 20:54:23.526595 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:23.526573    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgxx7\" (UniqueName: \"kubernetes.io/projected/d30568f7-82bc-4275-8448-bd730870d3c9-kube-api-access-dgxx7\") pod \"dns-default-g6djs\" (UID: \"d30568f7-82bc-4275-8448-bd730870d3c9\") " pod="openshift-dns/dns-default-g6djs"
Jul 13 20:54:23.594988 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:23.594952    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dqqtb"
Jul 13 20:54:24.020203 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:24.020176    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d30568f7-82bc-4275-8448-bd730870d3c9-metrics-tls\") pod \"dns-default-g6djs\" (UID: \"d30568f7-82bc-4275-8448-bd730870d3c9\") " pod="openshift-dns/dns-default-g6djs"
Jul 13 20:54:24.020370 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:24.020353    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 20:54:24.020447 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:24.020421    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d30568f7-82bc-4275-8448-bd730870d3c9-metrics-tls podName:d30568f7-82bc-4275-8448-bd730870d3c9 nodeName:}" failed. No retries permitted until 2026-07-13 20:54:25.020399946 +0000 UTC m=+38.015183364 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d30568f7-82bc-4275-8448-bd730870d3c9-metrics-tls") pod "dns-default-g6djs" (UID: "d30568f7-82bc-4275-8448-bd730870d3c9") : secret "dns-default-metrics-tls" not found
Jul 13 20:54:24.082459 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:24.082436    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dqqtb"]
Jul 13 20:54:24.085495 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:54:24.085469    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd00b98e8_2a0b_4cac_bdb9_4694daeb7e0a.slice/crio-8057845df291a1efc7e14da71ff3ce516a8960dc21f82b1a25edb0d228f37be5 WatchSource:0}: Error finding container 8057845df291a1efc7e14da71ff3ce516a8960dc21f82b1a25edb0d228f37be5: Status 404 returned error can't find the container with id 8057845df291a1efc7e14da71ff3ce516a8960dc21f82b1a25edb0d228f37be5
Jul 13 20:54:24.258424 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:24.258385    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:54:24.311828 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:24.311780    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:54:24.571502 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:24.571462    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkclr"
Jul 13 20:54:24.572004 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:24.571465    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vb7lj"
Jul 13 20:54:24.572004 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:24.571610    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhvrj"
Jul 13 20:54:24.574522 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:24.574499    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 13 20:54:24.575688 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:24.575473    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-plnw6\""
Jul 13 20:54:24.575688 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:24.575497    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 13 20:54:24.575688 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:24.575566    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 13 20:54:24.575688 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:24.575567    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 13 20:54:24.576256 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:24.576237    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-n7pmh\""
Jul 13 20:54:24.738877 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:24.738842    2561 generic.go:356] "Generic (PLEG): container finished" podID="df777e90-a19a-493a-9725-24c67196c62a" containerID="f03c15d5f5ef176bfcc350d8ec46d2256c17977f3a07f9acd9a4d0fd1da4d678" exitCode=0
Jul 13 20:54:24.739056 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:24.738930    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c5jdx" event={"ID":"df777e90-a19a-493a-9725-24c67196c62a","Type":"ContainerDied","Data":"f03c15d5f5ef176bfcc350d8ec46d2256c17977f3a07f9acd9a4d0fd1da4d678"}
Jul 13 20:54:24.740241 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:24.740216    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dqqtb" event={"ID":"d00b98e8-2a0b-4cac-bdb9-4694daeb7e0a","Type":"ContainerStarted","Data":"8057845df291a1efc7e14da71ff3ce516a8960dc21f82b1a25edb0d228f37be5"}
Jul 13 20:54:25.007715 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:25.007501    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:54:25.028489 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:25.028458    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d30568f7-82bc-4275-8448-bd730870d3c9-metrics-tls\") pod \"dns-default-g6djs\" (UID: \"d30568f7-82bc-4275-8448-bd730870d3c9\") " pod="openshift-dns/dns-default-g6djs"
Jul 13 20:54:25.028634 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:25.028597    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 20:54:25.028687 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:25.028659    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d30568f7-82bc-4275-8448-bd730870d3c9-metrics-tls podName:d30568f7-82bc-4275-8448-bd730870d3c9 nodeName:}" failed. No retries permitted until 2026-07-13 20:54:27.028639736 +0000 UTC m=+40.023423148 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d30568f7-82bc-4275-8448-bd730870d3c9-metrics-tls") pod "dns-default-g6djs" (UID: "d30568f7-82bc-4275-8448-bd730870d3c9") : secret "dns-default-metrics-tls" not found
Jul 13 20:54:25.106138 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:25.106039    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:54:25.166828 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:25.166778    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5978bb8dd5-74mq5"]
Jul 13 20:54:25.169884 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:25.169863    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5978bb8dd5-74mq5"
Jul 13 20:54:25.172426 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:25.172402    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 13 20:54:25.172426 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:25.172418    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 13 20:54:25.172578 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:25.172402    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 13 20:54:25.172841 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:25.172808    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 13 20:54:25.172937 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:25.172803    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 13 20:54:25.173358 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:25.173238    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 13 20:54:25.173458 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:25.173407    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 13 20:54:25.182632 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:25.182610    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5978bb8dd5-74mq5"]
Jul 13 20:54:25.311479 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:25.311445    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:54:25.331218 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:25.331190    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1d1323fd-a689-47b4-bace-abe7b5b7e602-hub\") pod \"cluster-proxy-proxy-agent-5978bb8dd5-74mq5\" (UID: \"1d1323fd-a689-47b4-bace-abe7b5b7e602\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5978bb8dd5-74mq5"
Jul 13 20:54:25.331218 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:25.331227    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1d1323fd-a689-47b4-bace-abe7b5b7e602-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5978bb8dd5-74mq5\" (UID: \"1d1323fd-a689-47b4-bace-abe7b5b7e602\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5978bb8dd5-74mq5"
Jul 13 20:54:25.331464 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:25.331278    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1d1323fd-a689-47b4-bace-abe7b5b7e602-ca\") pod \"cluster-proxy-proxy-agent-5978bb8dd5-74mq5\" (UID: \"1d1323fd-a689-47b4-bace-abe7b5b7e602\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5978bb8dd5-74mq5"
Jul 13 20:54:25.331464 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:25.331326    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1d1323fd-a689-47b4-bace-abe7b5b7e602-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5978bb8dd5-74mq5\" (UID: \"1d1323fd-a689-47b4-bace-abe7b5b7e602\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5978bb8dd5-74mq5"
Jul 13 20:54:25.331464 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:25.331380    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmpqm\" (UniqueName: \"kubernetes.io/projected/1d1323fd-a689-47b4-bace-abe7b5b7e602-kube-api-access-mmpqm\") pod \"cluster-proxy-proxy-agent-5978bb8dd5-74mq5\" (UID: \"1d1323fd-a689-47b4-bace-abe7b5b7e602\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5978bb8dd5-74mq5"
Jul 13 20:54:25.331464 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:25.331428    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d1323fd-a689-47b4-bace-abe7b5b7e602-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5978bb8dd5-74mq5\" (UID: \"1d1323fd-a689-47b4-bace-abe7b5b7e602\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5978bb8dd5-74mq5"
Jul 13 20:54:25.432059 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:25.431971    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1d1323fd-a689-47b4-bace-abe7b5b7e602-ca\") pod \"cluster-proxy-proxy-agent-5978bb8dd5-74mq5\" (UID: \"1d1323fd-a689-47b4-bace-abe7b5b7e602\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5978bb8dd5-74mq5"
Jul 13 20:54:25.432059 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:25.432019    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1d1323fd-a689-47b4-bace-abe7b5b7e602-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5978bb8dd5-74mq5\" (UID: \"1d1323fd-a689-47b4-bace-abe7b5b7e602\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5978bb8dd5-74mq5"
Jul 13 20:54:25.432242 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:25.432073    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmpqm\" (UniqueName: \"kubernetes.io/projected/1d1323fd-a689-47b4-bace-abe7b5b7e602-kube-api-access-mmpqm\") pod \"cluster-proxy-proxy-agent-5978bb8dd5-74mq5\" (UID: \"1d1323fd-a689-47b4-bace-abe7b5b7e602\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5978bb8dd5-74mq5"
Jul 13 20:54:25.432242 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:25.432113    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d1323fd-a689-47b4-bace-abe7b5b7e602-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5978bb8dd5-74mq5\" (UID: \"1d1323fd-a689-47b4-bace-abe7b5b7e602\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5978bb8dd5-74mq5"
Jul 13 20:54:25.432242 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:25.432187    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1d1323fd-a689-47b4-bace-abe7b5b7e602-hub\") pod \"cluster-proxy-proxy-agent-5978bb8dd5-74mq5\" (UID: \"1d1323fd-a689-47b4-bace-abe7b5b7e602\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5978bb8dd5-74mq5"
Jul 13 20:54:25.432242 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:25.432213    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1d1323fd-a689-47b4-bace-abe7b5b7e602-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5978bb8dd5-74mq5\" (UID: \"1d1323fd-a689-47b4-bace-abe7b5b7e602\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5978bb8dd5-74mq5"
Jul 13 20:54:25.433051 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:25.433022    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d1323fd-a689-47b4-bace-abe7b5b7e602-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5978bb8dd5-74mq5\" (UID: \"1d1323fd-a689-47b4-bace-abe7b5b7e602\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5978bb8dd5-74mq5"
Jul 13 20:54:25.436394 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:25.436347    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1d1323fd-a689-47b4-bace-abe7b5b7e602-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5978bb8dd5-74mq5\" (UID: \"1d1323fd-a689-47b4-bace-abe7b5b7e602\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5978bb8dd5-74mq5"
Jul 13 20:54:25.436508 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:25.436421    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1d1323fd-a689-47b4-bace-abe7b5b7e602-ca\") pod \"cluster-proxy-proxy-agent-5978bb8dd5-74mq5\" (UID: \"1d1323fd-a689-47b4-bace-abe7b5b7e602\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5978bb8dd5-74mq5"
Jul 13 20:54:25.436574 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:25.436515    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1d1323fd-a689-47b4-bace-abe7b5b7e602-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5978bb8dd5-74mq5\" (UID: \"1d1323fd-a689-47b4-bace-abe7b5b7e602\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5978bb8dd5-74mq5"
Jul 13 20:54:25.436635 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:25.436577    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1d1323fd-a689-47b4-bace-abe7b5b7e602-hub\") pod \"cluster-proxy-proxy-agent-5978bb8dd5-74mq5\" (UID: \"1d1323fd-a689-47b4-bace-abe7b5b7e602\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5978bb8dd5-74mq5"
Jul 13 20:54:25.441480 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:25.441456    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmpqm\" (UniqueName: \"kubernetes.io/projected/1d1323fd-a689-47b4-bace-abe7b5b7e602-kube-api-access-mmpqm\") pod \"cluster-proxy-proxy-agent-5978bb8dd5-74mq5\" (UID: \"1d1323fd-a689-47b4-bace-abe7b5b7e602\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5978bb8dd5-74mq5"
Jul 13 20:54:25.486526 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:25.486486    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5978bb8dd5-74mq5"
Jul 13 20:54:25.746623 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:25.746541    2561 generic.go:356] "Generic (PLEG): container finished" podID="df777e90-a19a-493a-9725-24c67196c62a" containerID="c00f9230a82f680c2d048e2ec8683f69f6298e415845a261bff7e760bf835dd4" exitCode=0
Jul 13 20:54:25.746623 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:25.746586    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c5jdx" event={"ID":"df777e90-a19a-493a-9725-24c67196c62a","Type":"ContainerDied","Data":"c00f9230a82f680c2d048e2ec8683f69f6298e415845a261bff7e760bf835dd4"}
Jul 13 20:54:26.306570 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:26.306544    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5978bb8dd5-74mq5"]
Jul 13 20:54:26.323304 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:54:26.323276    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d1323fd_a689_47b4_bace_abe7b5b7e602.slice/crio-bc239f19b60370822ce8679605f3a421323204514e968f253e9ec0cb5e0af64e WatchSource:0}: Error finding container bc239f19b60370822ce8679605f3a421323204514e968f253e9ec0cb5e0af64e: Status 404 returned error can't find the container with id bc239f19b60370822ce8679605f3a421323204514e968f253e9ec0cb5e0af64e
Jul 13 20:54:26.752533 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:26.752288    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c5jdx" event={"ID":"df777e90-a19a-493a-9725-24c67196c62a","Type":"ContainerStarted","Data":"dfffe80d306d797b7242f0a217e6da4279560994c8463aaf92886f7cb1485c66"}
Jul 13 20:54:26.753683 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:26.753662    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dqqtb" event={"ID":"d00b98e8-2a0b-4cac-bdb9-4694daeb7e0a","Type":"ContainerStarted","Data":"e146ed6e56d2103579af8c0fe67cfb52b250b70bd9851942a5695366543a17a1"}
Jul 13 20:54:26.754848 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:26.754807    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5978bb8dd5-74mq5" event={"ID":"1d1323fd-a689-47b4-bace-abe7b5b7e602","Type":"ContainerStarted","Data":"bc239f19b60370822ce8679605f3a421323204514e968f253e9ec0cb5e0af64e"}
Jul 13 20:54:26.777064 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:26.777011    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-c5jdx" podStartSLOduration=10.169725578 podStartE2EDuration="39.776996604s" totalImagesPullingTime="29.607271026s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:53:47 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:54:26.775256966 +0000 UTC m=+39.770040388" watchObservedRunningTime="2026-07-13 20:54:26.776996604 +0000 UTC m=+39.771780035"
Jul 13 20:54:26.796036 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:26.795994    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dqqtb" podStartSLOduration=1.547599463 podStartE2EDuration="3.795980905s" totalImagesPullingTime="2.248381442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:54:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:54:26.795493442 +0000 UTC m=+39.790276859" watchObservedRunningTime="2026-07-13 20:54:26.795980905 +0000 UTC m=+39.790764307"
Jul 13 20:54:26.903851 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:26.903792    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:54:26.961265 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:26.961229    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:54:27.046675 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:27.046646    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d30568f7-82bc-4275-8448-bd730870d3c9-metrics-tls\") pod \"dns-default-g6djs\" (UID: \"d30568f7-82bc-4275-8448-bd730870d3c9\") " pod="openshift-dns/dns-default-g6djs"
Jul 13 20:54:27.046799 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:27.046771    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 20:54:27.046875 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:27.046853    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d30568f7-82bc-4275-8448-bd730870d3c9-metrics-tls podName:d30568f7-82bc-4275-8448-bd730870d3c9 nodeName:}" failed. No retries permitted until 2026-07-13 20:54:31.046839663 +0000 UTC m=+44.041623064 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d30568f7-82bc-4275-8448-bd730870d3c9-metrics-tls") pod "dns-default-g6djs" (UID: "d30568f7-82bc-4275-8448-bd730870d3c9") : secret "dns-default-metrics-tls" not found
Jul 13 20:54:27.548775 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:27.548606    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:54:27.658324 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:27.658262    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:54:31.081605 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:31.081574    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d30568f7-82bc-4275-8448-bd730870d3c9-metrics-tls\") pod \"dns-default-g6djs\" (UID: \"d30568f7-82bc-4275-8448-bd730870d3c9\") " pod="openshift-dns/dns-default-g6djs"
Jul 13 20:54:31.081923 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:31.081690    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 20:54:31.081923 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:31.081740    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d30568f7-82bc-4275-8448-bd730870d3c9-metrics-tls podName:d30568f7-82bc-4275-8448-bd730870d3c9 nodeName:}" failed. No retries permitted until 2026-07-13 20:54:39.081727452 +0000 UTC m=+52.076510854 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d30568f7-82bc-4275-8448-bd730870d3c9-metrics-tls") pod "dns-default-g6djs" (UID: "d30568f7-82bc-4275-8448-bd730870d3c9") : secret "dns-default-metrics-tls" not found
Jul 13 20:54:31.769116 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:31.769083    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5978bb8dd5-74mq5" event={"ID":"1d1323fd-a689-47b4-bace-abe7b5b7e602","Type":"ContainerStarted","Data":"1bcf2676c6b3f1a2eb629b054ca4d04f2810bf59c7bdfa750fe43d205814a95a"}
Jul 13 20:54:31.769327 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:31.769126    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5978bb8dd5-74mq5" event={"ID":"1d1323fd-a689-47b4-bace-abe7b5b7e602","Type":"ContainerStarted","Data":"238ed317cc3c697d6dc6e2a29e22c6d3db05552c2d8552252597640e1276875e"}
Jul 13 20:54:31.769327 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:31.769141    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5978bb8dd5-74mq5" event={"ID":"1d1323fd-a689-47b4-bace-abe7b5b7e602","Type":"ContainerStarted","Data":"8a84cf6f390df3b7a4de6cdac390b8e41230ba68bdb94f3dc56adcff13c8d4b5"}
Jul 13 20:54:31.787414 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:31.787370    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5978bb8dd5-74mq5" podStartSLOduration=2.358368285 podStartE2EDuration="6.787354556s" totalImagesPullingTime="4.428986271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:54:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:54:31.786938654 +0000 UTC m=+44.781722089" watchObservedRunningTime="2026-07-13 20:54:31.787354556 +0000 UTC m=+44.782137979"
Jul 13 20:54:35.007959 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:35.007925    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:54:35.340836 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:35.340775    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:54:37.923639 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:37.923599    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:54:37.984396 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:37.984354    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:54:38.901275 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:38.901242    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:54:39.136875 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:39.136841    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d30568f7-82bc-4275-8448-bd730870d3c9-metrics-tls\") pod \"dns-default-g6djs\" (UID: \"d30568f7-82bc-4275-8448-bd730870d3c9\") " pod="openshift-dns/dns-default-g6djs"
Jul 13 20:54:39.137245 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:39.136948    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 20:54:39.137245 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:39.136999    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d30568f7-82bc-4275-8448-bd730870d3c9-metrics-tls podName:d30568f7-82bc-4275-8448-bd730870d3c9 nodeName:}" failed. No retries permitted until 2026-07-13 20:54:55.136986228 +0000 UTC m=+68.131769630 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d30568f7-82bc-4275-8448-bd730870d3c9-metrics-tls") pod "dns-default-g6djs" (UID: "d30568f7-82bc-4275-8448-bd730870d3c9") : secret "dns-default-metrics-tls" not found
Jul 13 20:54:45.243546 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:45.243499    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:54:45.299521 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:45.299493    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:54:48.729877 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:48.729842    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jrpbd"
Jul 13 20:54:48.881968 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:48.881935    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:54:48.940521 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:48.940483    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:54:53.238378 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:53.238344    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/02682275-db9d-4f68-9b88-4e6f2e6f52f2-original-pull-secret\") pod \"global-pull-secret-syncer-vb7lj\" (UID: \"02682275-db9d-4f68-9b88-4e6f2e6f52f2\") " pod="kube-system/global-pull-secret-syncer-vb7lj"
Jul 13 20:54:53.241198 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:53.241181    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 13 20:54:53.252294 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:53.252270    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/02682275-db9d-4f68-9b88-4e6f2e6f52f2-original-pull-secret\") pod \"global-pull-secret-syncer-vb7lj\" (UID: \"02682275-db9d-4f68-9b88-4e6f2e6f52f2\") " pod="kube-system/global-pull-secret-syncer-vb7lj"
Jul 13 20:54:53.338754 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:53.338721    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8608f034-4011-42c3-b0ee-1369e8afa709-metrics-certs\") pod \"network-metrics-daemon-zhvrj\" (UID: \"8608f034-4011-42c3-b0ee-1369e8afa709\") " pod="openshift-multus/network-metrics-daemon-zhvrj"
Jul 13 20:54:53.341563 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:53.341543    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 13 20:54:53.349596 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:53.349566    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 13 20:54:53.349658 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:53.349634    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8608f034-4011-42c3-b0ee-1369e8afa709-metrics-certs podName:8608f034-4011-42c3-b0ee-1369e8afa709 nodeName:}" failed. No retries permitted until 2026-07-13 20:55:57.349617498 +0000 UTC m=+130.344400912 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8608f034-4011-42c3-b0ee-1369e8afa709-metrics-certs") pod "network-metrics-daemon-zhvrj" (UID: "8608f034-4011-42c3-b0ee-1369e8afa709") : secret "metrics-daemon-secret" not found
Jul 13 20:54:53.390270 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:53.390247    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vb7lj"
Jul 13 20:54:53.439888 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:53.439853    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-472hg\" (UniqueName: \"kubernetes.io/projected/29605f3e-f674-49cc-86b6-62bc9db78d33-kube-api-access-472hg\") pod \"network-check-target-bkclr\" (UID: \"29605f3e-f674-49cc-86b6-62bc9db78d33\") " pod="openshift-network-diagnostics/network-check-target-bkclr"
Jul 13 20:54:53.443007 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:53.442983    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 13 20:54:53.452717 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:53.452689    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 13 20:54:53.463318 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:53.463291    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-472hg\" (UniqueName: \"kubernetes.io/projected/29605f3e-f674-49cc-86b6-62bc9db78d33-kube-api-access-472hg\") pod \"network-check-target-bkclr\" (UID: \"29605f3e-f674-49cc-86b6-62bc9db78d33\") " pod="openshift-network-diagnostics/network-check-target-bkclr"
Jul 13 20:54:53.510170 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:53.510092    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vb7lj"]
Jul 13 20:54:53.514536 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:54:53.514511    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02682275_db9d_4f68_9b88_4e6f2e6f52f2.slice/crio-6c4aa48b23c7c9e639673fd9634afbc8fd2f141c445e9ede07e6566745ccf3f2 WatchSource:0}: Error finding container 6c4aa48b23c7c9e639673fd9634afbc8fd2f141c445e9ede07e6566745ccf3f2: Status 404 returned error can't find the container with id 6c4aa48b23c7c9e639673fd9634afbc8fd2f141c445e9ede07e6566745ccf3f2
Jul 13 20:54:53.686909 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:53.686879    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-n7pmh\""
Jul 13 20:54:53.694436 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:53.694419    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkclr"
Jul 13 20:54:53.812958 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:53.812869    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bkclr"]
Jul 13 20:54:53.815338 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:54:53.815313    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29605f3e_f674_49cc_86b6_62bc9db78d33.slice/crio-ac302dc99605a57af0f88803d6a0fda70f055c738cbcf078837ff33d33f2809b WatchSource:0}: Error finding container ac302dc99605a57af0f88803d6a0fda70f055c738cbcf078837ff33d33f2809b: Status 404 returned error can't find the container with id ac302dc99605a57af0f88803d6a0fda70f055c738cbcf078837ff33d33f2809b
Jul 13 20:54:53.823487 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:53.823464    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bkclr" event={"ID":"29605f3e-f674-49cc-86b6-62bc9db78d33","Type":"ContainerStarted","Data":"ac302dc99605a57af0f88803d6a0fda70f055c738cbcf078837ff33d33f2809b"}
Jul 13 20:54:53.824510 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:53.824485    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vb7lj" event={"ID":"02682275-db9d-4f68-9b88-4e6f2e6f52f2","Type":"ContainerStarted","Data":"6c4aa48b23c7c9e639673fd9634afbc8fd2f141c445e9ede07e6566745ccf3f2"}
Jul 13 20:54:55.152302 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:55.152263    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d30568f7-82bc-4275-8448-bd730870d3c9-metrics-tls\") pod \"dns-default-g6djs\" (UID: \"d30568f7-82bc-4275-8448-bd730870d3c9\") " pod="openshift-dns/dns-default-g6djs"
Jul 13 20:54:55.152729 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:55.152444    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 20:54:55.152729 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:54:55.152555    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d30568f7-82bc-4275-8448-bd730870d3c9-metrics-tls podName:d30568f7-82bc-4275-8448-bd730870d3c9 nodeName:}" failed. No retries permitted until 2026-07-13 20:55:27.152531124 +0000 UTC m=+100.147314537 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d30568f7-82bc-4275-8448-bd730870d3c9-metrics-tls") pod "dns-default-g6djs" (UID: "d30568f7-82bc-4275-8448-bd730870d3c9") : secret "dns-default-metrics-tls" not found
Jul 13 20:54:58.840609 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:58.840575    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bkclr" event={"ID":"29605f3e-f674-49cc-86b6-62bc9db78d33","Type":"ContainerStarted","Data":"42dc4bcd8930b2280b488ac61e1b32a2d05413250b0fa5f7de638073de7124d9"}
Jul 13 20:54:58.841087 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:58.840701    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bkclr"
Jul 13 20:54:58.842180 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:58.842156    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vb7lj" event={"ID":"02682275-db9d-4f68-9b88-4e6f2e6f52f2","Type":"ContainerStarted","Data":"254aac7d0995baa0d8f53b13d735a302da57e421810b622adca7af2465e85c14"}
Jul 13 20:54:58.855603 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:58.855553    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bkclr" podStartSLOduration=67.405379164 podStartE2EDuration="1m11.855541608s" totalImagesPullingTime="4.450162444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:53:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:54:58.855299822 +0000 UTC m=+71.850083246" watchObservedRunningTime="2026-07-13 20:54:58.855541608 +0000 UTC m=+71.850325031"
Jul 13 20:54:58.870014 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:58.869974    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vb7lj" podStartSLOduration=67.115334505 podStartE2EDuration="1m11.869961052s" totalImagesPullingTime="4.754626547s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:53:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:54:58.869777796 +0000 UTC m=+71.864561220" watchObservedRunningTime="2026-07-13 20:54:58.869961052 +0000 UTC m=+71.864744474"
Jul 13 20:54:58.894498 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:58.894462    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:54:58.949933 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:58.949908    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:54:59.005961 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:54:59.005929    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:55:09.811331 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:55:09.811217    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:55:25.527340 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:55:25.527307    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:55:25.589004 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:55:25.588966    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:55:27.165537 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:55:27.165499    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d30568f7-82bc-4275-8448-bd730870d3c9-metrics-tls\") pod \"dns-default-g6djs\" (UID: \"d30568f7-82bc-4275-8448-bd730870d3c9\") " pod="openshift-dns/dns-default-g6djs"
Jul 13 20:55:27.165960 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:55:27.165655    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 20:55:27.165960 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:55:27.165719    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d30568f7-82bc-4275-8448-bd730870d3c9-metrics-tls podName:d30568f7-82bc-4275-8448-bd730870d3c9 nodeName:}" failed. No retries permitted until 2026-07-13 20:56:31.165702173 +0000 UTC m=+164.160485577 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d30568f7-82bc-4275-8448-bd730870d3c9-metrics-tls") pod "dns-default-g6djs" (UID: "d30568f7-82bc-4275-8448-bd730870d3c9") : secret "dns-default-metrics-tls" not found
Jul 13 20:55:29.848336 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:55:29.848303    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bkclr"
Jul 13 20:55:57.370764 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:55:57.370705    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8608f034-4011-42c3-b0ee-1369e8afa709-metrics-certs\") pod \"network-metrics-daemon-zhvrj\" (UID: \"8608f034-4011-42c3-b0ee-1369e8afa709\") " pod="openshift-multus/network-metrics-daemon-zhvrj"
Jul 13 20:55:57.371310 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:55:57.370874    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 13 20:55:57.371310 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:55:57.370952    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8608f034-4011-42c3-b0ee-1369e8afa709-metrics-certs podName:8608f034-4011-42c3-b0ee-1369e8afa709 nodeName:}" failed. No retries permitted until 2026-07-13 20:57:59.370935957 +0000 UTC m=+252.365719360 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8608f034-4011-42c3-b0ee-1369e8afa709-metrics-certs") pod "network-metrics-daemon-zhvrj" (UID: "8608f034-4011-42c3-b0ee-1369e8afa709") : secret "metrics-daemon-secret" not found
Jul 13 20:56:26.288851 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:56:26.288790    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-g6djs" podUID="d30568f7-82bc-4275-8448-bd730870d3c9"
Jul 13 20:56:27.086140 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:56:27.086105    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g6djs"
Jul 13 20:56:27.595993 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:56:27.595956    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-zhvrj" podUID="8608f034-4011-42c3-b0ee-1369e8afa709"
Jul 13 20:56:31.202136 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:56:31.202096    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d30568f7-82bc-4275-8448-bd730870d3c9-metrics-tls\") pod \"dns-default-g6djs\" (UID: \"d30568f7-82bc-4275-8448-bd730870d3c9\") " pod="openshift-dns/dns-default-g6djs"
Jul 13 20:56:31.202540 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:56:31.202234    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 20:56:31.202540 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:56:31.202306    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d30568f7-82bc-4275-8448-bd730870d3c9-metrics-tls podName:d30568f7-82bc-4275-8448-bd730870d3c9 nodeName:}" failed. No retries permitted until 2026-07-13 20:58:33.202289925 +0000 UTC m=+286.197073327 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d30568f7-82bc-4275-8448-bd730870d3c9-metrics-tls") pod "dns-default-g6djs" (UID: "d30568f7-82bc-4275-8448-bd730870d3c9") : secret "dns-default-metrics-tls" not found
Jul 13 20:56:38.571138 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:56:38.571103    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhvrj"
Jul 13 20:57:30.700122 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:57:30.700091    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:57:59.400152 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:57:59.400115    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8608f034-4011-42c3-b0ee-1369e8afa709-metrics-certs\") pod \"network-metrics-daemon-zhvrj\" (UID: \"8608f034-4011-42c3-b0ee-1369e8afa709\") " pod="openshift-multus/network-metrics-daemon-zhvrj"
Jul 13 20:57:59.400616 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:57:59.400218    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 13 20:57:59.400616 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:57:59.400281    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8608f034-4011-42c3-b0ee-1369e8afa709-metrics-certs podName:8608f034-4011-42c3-b0ee-1369e8afa709 nodeName:}" failed. No retries permitted until 2026-07-13 21:00:01.400264472 +0000 UTC m=+374.395047874 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8608f034-4011-42c3-b0ee-1369e8afa709-metrics-certs") pod "network-metrics-daemon-zhvrj" (UID: "8608f034-4011-42c3-b0ee-1369e8afa709") : secret "metrics-daemon-secret" not found
Jul 13 20:58:04.244210 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:04.244176    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-mfnxm"]
Jul 13 20:58:04.246987 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:04.246967    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-mfnxm"
Jul 13 20:58:04.249595 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:04.249575    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 13 20:58:04.249696 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:04.249607    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-ql6n4\""
Jul 13 20:58:04.250726 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:04.250690    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 13 20:58:04.250806 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:04.250778    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 13 20:58:04.252095 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:04.252080    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 13 20:58:04.260261 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:04.260242    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-mfnxm"]
Jul 13 20:58:04.420578 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:04.420545    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:04.433549 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:04.433529    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2de3328b-2c94-4b08-8b71-42d1afa5cfdf-serving-cert\") pod \"service-ca-operator-7695fc6c8c-mfnxm\" (UID: \"2de3328b-2c94-4b08-8b71-42d1afa5cfdf\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-mfnxm"
Jul 13 20:58:04.433615 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:04.433599    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvmmg\" (UniqueName: \"kubernetes.io/projected/2de3328b-2c94-4b08-8b71-42d1afa5cfdf-kube-api-access-jvmmg\") pod \"service-ca-operator-7695fc6c8c-mfnxm\" (UID: \"2de3328b-2c94-4b08-8b71-42d1afa5cfdf\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-mfnxm"
Jul 13 20:58:04.433651 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:04.433635    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2de3328b-2c94-4b08-8b71-42d1afa5cfdf-config\") pod \"service-ca-operator-7695fc6c8c-mfnxm\" (UID: \"2de3328b-2c94-4b08-8b71-42d1afa5cfdf\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-mfnxm"
Jul 13 20:58:04.521521 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:04.521486    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:04.534549 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:04.534523    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvmmg\" (UniqueName: \"kubernetes.io/projected/2de3328b-2c94-4b08-8b71-42d1afa5cfdf-kube-api-access-jvmmg\") pod \"service-ca-operator-7695fc6c8c-mfnxm\" (UID: \"2de3328b-2c94-4b08-8b71-42d1afa5cfdf\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-mfnxm"
Jul 13 20:58:04.534621 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:04.534567    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2de3328b-2c94-4b08-8b71-42d1afa5cfdf-config\") pod \"service-ca-operator-7695fc6c8c-mfnxm\" (UID: \"2de3328b-2c94-4b08-8b71-42d1afa5cfdf\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-mfnxm"
Jul 13 20:58:04.534621 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:04.534595    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2de3328b-2c94-4b08-8b71-42d1afa5cfdf-serving-cert\") pod \"service-ca-operator-7695fc6c8c-mfnxm\" (UID: \"2de3328b-2c94-4b08-8b71-42d1afa5cfdf\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-mfnxm"
Jul 13 20:58:04.535068 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:04.535050    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2de3328b-2c94-4b08-8b71-42d1afa5cfdf-config\") pod \"service-ca-operator-7695fc6c8c-mfnxm\" (UID: \"2de3328b-2c94-4b08-8b71-42d1afa5cfdf\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-mfnxm"
Jul 13 20:58:04.536783 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:04.536767    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2de3328b-2c94-4b08-8b71-42d1afa5cfdf-serving-cert\") pod \"service-ca-operator-7695fc6c8c-mfnxm\" (UID: \"2de3328b-2c94-4b08-8b71-42d1afa5cfdf\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-mfnxm"
Jul 13 20:58:04.543500 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:04.543477    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvmmg\" (UniqueName: \"kubernetes.io/projected/2de3328b-2c94-4b08-8b71-42d1afa5cfdf-kube-api-access-jvmmg\") pod \"service-ca-operator-7695fc6c8c-mfnxm\" (UID: \"2de3328b-2c94-4b08-8b71-42d1afa5cfdf\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-mfnxm"
Jul 13 20:58:04.555416 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:04.555396    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-mfnxm"
Jul 13 20:58:04.673722 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:04.673694    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-mfnxm"]
Jul 13 20:58:04.676559 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:58:04.676534    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2de3328b_2c94_4b08_8b71_42d1afa5cfdf.slice/crio-92e643477caa04197e7e226eaa88ca0bb8b7868c1ebcceae8ebbb4e9f34a02f3 WatchSource:0}: Error finding container 92e643477caa04197e7e226eaa88ca0bb8b7868c1ebcceae8ebbb4e9f34a02f3: Status 404 returned error can't find the container with id 92e643477caa04197e7e226eaa88ca0bb8b7868c1ebcceae8ebbb4e9f34a02f3
Jul 13 20:58:05.364723 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:05.364686    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-mfnxm" event={"ID":"2de3328b-2c94-4b08-8b71-42d1afa5cfdf","Type":"ContainerStarted","Data":"92e643477caa04197e7e226eaa88ca0bb8b7868c1ebcceae8ebbb4e9f34a02f3"}
Jul 13 20:58:07.373215 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:07.373181    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-mfnxm" event={"ID":"2de3328b-2c94-4b08-8b71-42d1afa5cfdf","Type":"ContainerStarted","Data":"7b1bec55491ac0fd359dda9f4a600b57968019f0f8b8732e29b767da571f3da6"}
Jul 13 20:58:07.388807 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:07.388764    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-mfnxm" podStartSLOduration=1.304747012 podStartE2EDuration="3.388749512s" totalImagesPullingTime="2.0840025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:58:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:58:07.388072077 +0000 UTC m=+260.382855501" watchObservedRunningTime="2026-07-13 20:58:07.388749512 +0000 UTC m=+260.383532951"
Jul 13 20:58:08.425553 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:08.425514    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:08.528583 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:08.528538    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:08.690709 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:08.690624    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:08.771402 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:08.771369    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:08.830687 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:08.830655    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:08.931274 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:08.931197    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:09.134692 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:09.134658    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mdp92"]
Jul 13 20:58:09.137542 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:09.137527    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mdp92"
Jul 13 20:58:09.140546 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:09.140513    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 13 20:58:09.141108 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:09.141088    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 13 20:58:09.141223 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:09.141122    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 13 20:58:09.141934 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:09.141915    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 13 20:58:09.142263 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:09.142246    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pgh4v\""
Jul 13 20:58:09.149307 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:09.149286    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mdp92"]
Jul 13 20:58:09.167123 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:09.167102    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mgpl\" (UniqueName: \"kubernetes.io/projected/9085d044-b096-4e63-b65f-cd39f4fa1c00-kube-api-access-7mgpl\") pod \"insights-runtime-extractor-mdp92\" (UID: \"9085d044-b096-4e63-b65f-cd39f4fa1c00\") " pod="openshift-insights/insights-runtime-extractor-mdp92"
Jul 13 20:58:09.167221 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:09.167129    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9085d044-b096-4e63-b65f-cd39f4fa1c00-crio-socket\") pod \"insights-runtime-extractor-mdp92\" (UID: \"9085d044-b096-4e63-b65f-cd39f4fa1c00\") " pod="openshift-insights/insights-runtime-extractor-mdp92"
Jul 13 20:58:09.167221 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:09.167148    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9085d044-b096-4e63-b65f-cd39f4fa1c00-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mdp92\" (UID: \"9085d044-b096-4e63-b65f-cd39f4fa1c00\") " pod="openshift-insights/insights-runtime-extractor-mdp92"
Jul 13 20:58:09.167303 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:09.167234    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9085d044-b096-4e63-b65f-cd39f4fa1c00-data-volume\") pod \"insights-runtime-extractor-mdp92\" (UID: \"9085d044-b096-4e63-b65f-cd39f4fa1c00\") " pod="openshift-insights/insights-runtime-extractor-mdp92"
Jul 13 20:58:09.167303 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:09.167252    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9085d044-b096-4e63-b65f-cd39f4fa1c00-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mdp92\" (UID: \"9085d044-b096-4e63-b65f-cd39f4fa1c00\") " pod="openshift-insights/insights-runtime-extractor-mdp92"
Jul 13 20:58:09.173221 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:09.173202    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:09.268360 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:09.268331    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9085d044-b096-4e63-b65f-cd39f4fa1c00-data-volume\") pod \"insights-runtime-extractor-mdp92\" (UID: \"9085d044-b096-4e63-b65f-cd39f4fa1c00\") " pod="openshift-insights/insights-runtime-extractor-mdp92"
Jul 13 20:58:09.268511 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:09.268367    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9085d044-b096-4e63-b65f-cd39f4fa1c00-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mdp92\" (UID: \"9085d044-b096-4e63-b65f-cd39f4fa1c00\") " pod="openshift-insights/insights-runtime-extractor-mdp92"
Jul 13 20:58:09.268511 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:09.268393    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mgpl\" (UniqueName: \"kubernetes.io/projected/9085d044-b096-4e63-b65f-cd39f4fa1c00-kube-api-access-7mgpl\") pod \"insights-runtime-extractor-mdp92\" (UID: \"9085d044-b096-4e63-b65f-cd39f4fa1c00\") " pod="openshift-insights/insights-runtime-extractor-mdp92"
Jul 13 20:58:09.268511 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:09.268442    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9085d044-b096-4e63-b65f-cd39f4fa1c00-crio-socket\") pod \"insights-runtime-extractor-mdp92\" (UID: \"9085d044-b096-4e63-b65f-cd39f4fa1c00\") " pod="openshift-insights/insights-runtime-extractor-mdp92"
Jul 13 20:58:09.268511 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:58:09.268457    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 20:58:09.268511 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:09.268487    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9085d044-b096-4e63-b65f-cd39f4fa1c00-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mdp92\" (UID: \"9085d044-b096-4e63-b65f-cd39f4fa1c00\") " pod="openshift-insights/insights-runtime-extractor-mdp92"
Jul 13 20:58:09.268729 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:58:09.268519    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9085d044-b096-4e63-b65f-cd39f4fa1c00-kube-rbac-proxy-cm podName:9085d044-b096-4e63-b65f-cd39f4fa1c00 nodeName:}" failed. No retries permitted until 2026-07-13 20:58:09.768499552 +0000 UTC m=+262.763282956 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9085d044-b096-4e63-b65f-cd39f4fa1c00-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mdp92" (UID: "9085d044-b096-4e63-b65f-cd39f4fa1c00") : configmap "kube-rbac-proxy" not found
Jul 13 20:58:09.268729 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:58:09.268570    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 20:58:09.268729 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:09.268575    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9085d044-b096-4e63-b65f-cd39f4fa1c00-crio-socket\") pod \"insights-runtime-extractor-mdp92\" (UID: \"9085d044-b096-4e63-b65f-cd39f4fa1c00\") " pod="openshift-insights/insights-runtime-extractor-mdp92"
Jul 13 20:58:09.268729 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:58:09.268628    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9085d044-b096-4e63-b65f-cd39f4fa1c00-insights-runtime-extractor-tls podName:9085d044-b096-4e63-b65f-cd39f4fa1c00 nodeName:}" failed. No retries permitted until 2026-07-13 20:58:09.768609845 +0000 UTC m=+262.763393259 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9085d044-b096-4e63-b65f-cd39f4fa1c00-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mdp92" (UID: "9085d044-b096-4e63-b65f-cd39f4fa1c00") : secret "insights-runtime-extractor-tls" not found
Jul 13 20:58:09.268890 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:09.268833    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9085d044-b096-4e63-b65f-cd39f4fa1c00-data-volume\") pod \"insights-runtime-extractor-mdp92\" (UID: \"9085d044-b096-4e63-b65f-cd39f4fa1c00\") " pod="openshift-insights/insights-runtime-extractor-mdp92"
Jul 13 20:58:09.278640 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:09.278617    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mgpl\" (UniqueName: \"kubernetes.io/projected/9085d044-b096-4e63-b65f-cd39f4fa1c00-kube-api-access-7mgpl\") pod \"insights-runtime-extractor-mdp92\" (UID: \"9085d044-b096-4e63-b65f-cd39f4fa1c00\") " pod="openshift-insights/insights-runtime-extractor-mdp92"
Jul 13 20:58:09.431700 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:09.431622    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:09.532173 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:09.532143    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:09.771870 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:09.771842    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9085d044-b096-4e63-b65f-cd39f4fa1c00-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mdp92\" (UID: \"9085d044-b096-4e63-b65f-cd39f4fa1c00\") " pod="openshift-insights/insights-runtime-extractor-mdp92"
Jul 13 20:58:09.772011 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:09.771903    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9085d044-b096-4e63-b65f-cd39f4fa1c00-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mdp92\" (UID: \"9085d044-b096-4e63-b65f-cd39f4fa1c00\") " pod="openshift-insights/insights-runtime-extractor-mdp92"
Jul 13 20:58:09.772011 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:58:09.771955    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 20:58:09.772083 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:58:09.772016    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9085d044-b096-4e63-b65f-cd39f4fa1c00-kube-rbac-proxy-cm podName:9085d044-b096-4e63-b65f-cd39f4fa1c00 nodeName:}" failed. No retries permitted until 2026-07-13 20:58:10.772001576 +0000 UTC m=+263.766784980 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9085d044-b096-4e63-b65f-cd39f4fa1c00-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mdp92" (UID: "9085d044-b096-4e63-b65f-cd39f4fa1c00") : configmap "kube-rbac-proxy" not found
Jul 13 20:58:09.772083 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:58:09.772055    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 20:58:09.772154 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:58:09.772126    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9085d044-b096-4e63-b65f-cd39f4fa1c00-insights-runtime-extractor-tls podName:9085d044-b096-4e63-b65f-cd39f4fa1c00 nodeName:}" failed. No retries permitted until 2026-07-13 20:58:10.772113262 +0000 UTC m=+263.766896664 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9085d044-b096-4e63-b65f-cd39f4fa1c00-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mdp92" (UID: "9085d044-b096-4e63-b65f-cd39f4fa1c00") : secret "insights-runtime-extractor-tls" not found
Jul 13 20:58:10.780538 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:10.780506    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9085d044-b096-4e63-b65f-cd39f4fa1c00-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mdp92\" (UID: \"9085d044-b096-4e63-b65f-cd39f4fa1c00\") " pod="openshift-insights/insights-runtime-extractor-mdp92"
Jul 13 20:58:10.780941 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:10.780554    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9085d044-b096-4e63-b65f-cd39f4fa1c00-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mdp92\" (UID: \"9085d044-b096-4e63-b65f-cd39f4fa1c00\") " pod="openshift-insights/insights-runtime-extractor-mdp92"
Jul 13 20:58:10.780941 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:58:10.780622    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 20:58:10.780941 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:58:10.780664    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 20:58:10.780941 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:58:10.780683    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9085d044-b096-4e63-b65f-cd39f4fa1c00-kube-rbac-proxy-cm podName:9085d044-b096-4e63-b65f-cd39f4fa1c00 nodeName:}" failed. No retries permitted until 2026-07-13 20:58:12.78066813 +0000 UTC m=+265.775451535 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9085d044-b096-4e63-b65f-cd39f4fa1c00-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mdp92" (UID: "9085d044-b096-4e63-b65f-cd39f4fa1c00") : configmap "kube-rbac-proxy" not found
Jul 13 20:58:10.780941 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:58:10.780711    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9085d044-b096-4e63-b65f-cd39f4fa1c00-insights-runtime-extractor-tls podName:9085d044-b096-4e63-b65f-cd39f4fa1c00 nodeName:}" failed. No retries permitted until 2026-07-13 20:58:12.780699807 +0000 UTC m=+265.775483208 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9085d044-b096-4e63-b65f-cd39f4fa1c00-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mdp92" (UID: "9085d044-b096-4e63-b65f-cd39f4fa1c00") : secret "insights-runtime-extractor-tls" not found
Jul 13 20:58:10.932834 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:10.932785    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:10.986559 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:10.986527    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-rvrqm"]
Jul 13 20:58:10.989379 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:10.989359    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-rvrqm"
Jul 13 20:58:10.991957 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:10.991937    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 13 20:58:10.991957 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:10.991951    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-zlvvx\""
Jul 13 20:58:10.992094 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:10.991951    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 13 20:58:10.992991 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:10.992972    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 13 20:58:10.993113 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:10.993046    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 13 20:58:10.998963 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:10.998944    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-rvrqm"]
Jul 13 20:58:11.027523 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:11.027502    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:11.082775 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:11.082716    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0ca12286-1218-4f0e-98a6-b934f51ef164-signing-cabundle\") pod \"service-ca-79f68b9f4f-rvrqm\" (UID: \"0ca12286-1218-4f0e-98a6-b934f51ef164\") " pod="openshift-service-ca/service-ca-79f68b9f4f-rvrqm"
Jul 13 20:58:11.082775 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:11.082760    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcq8d\" (UniqueName: \"kubernetes.io/projected/0ca12286-1218-4f0e-98a6-b934f51ef164-kube-api-access-dcq8d\") pod \"service-ca-79f68b9f4f-rvrqm\" (UID: \"0ca12286-1218-4f0e-98a6-b934f51ef164\") " pod="openshift-service-ca/service-ca-79f68b9f4f-rvrqm"
Jul 13 20:58:11.082920 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:11.082782    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0ca12286-1218-4f0e-98a6-b934f51ef164-signing-key\") pod \"service-ca-79f68b9f4f-rvrqm\" (UID: \"0ca12286-1218-4f0e-98a6-b934f51ef164\") " pod="openshift-service-ca/service-ca-79f68b9f4f-rvrqm"
Jul 13 20:58:11.138030 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:11.138005    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:11.183078 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:11.183038    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcq8d\" (UniqueName: \"kubernetes.io/projected/0ca12286-1218-4f0e-98a6-b934f51ef164-kube-api-access-dcq8d\") pod \"service-ca-79f68b9f4f-rvrqm\" (UID: \"0ca12286-1218-4f0e-98a6-b934f51ef164\") " pod="openshift-service-ca/service-ca-79f68b9f4f-rvrqm"
Jul 13 20:58:11.183201 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:11.183087    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0ca12286-1218-4f0e-98a6-b934f51ef164-signing-key\") pod \"service-ca-79f68b9f4f-rvrqm\" (UID: \"0ca12286-1218-4f0e-98a6-b934f51ef164\") " pod="openshift-service-ca/service-ca-79f68b9f4f-rvrqm"
Jul 13 20:58:11.183306 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:11.183285    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0ca12286-1218-4f0e-98a6-b934f51ef164-signing-cabundle\") pod \"service-ca-79f68b9f4f-rvrqm\" (UID: \"0ca12286-1218-4f0e-98a6-b934f51ef164\") " pod="openshift-service-ca/service-ca-79f68b9f4f-rvrqm"
Jul 13 20:58:11.183886 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:11.183869    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0ca12286-1218-4f0e-98a6-b934f51ef164-signing-cabundle\") pod \"service-ca-79f68b9f4f-rvrqm\" (UID: \"0ca12286-1218-4f0e-98a6-b934f51ef164\") " pod="openshift-service-ca/service-ca-79f68b9f4f-rvrqm"
Jul 13 20:58:11.185629 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:11.185608    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0ca12286-1218-4f0e-98a6-b934f51ef164-signing-key\") pod \"service-ca-79f68b9f4f-rvrqm\" (UID: \"0ca12286-1218-4f0e-98a6-b934f51ef164\") " pod="openshift-service-ca/service-ca-79f68b9f4f-rvrqm"
Jul 13 20:58:11.192978 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:11.192962    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcq8d\" (UniqueName: \"kubernetes.io/projected/0ca12286-1218-4f0e-98a6-b934f51ef164-kube-api-access-dcq8d\") pod \"service-ca-79f68b9f4f-rvrqm\" (UID: \"0ca12286-1218-4f0e-98a6-b934f51ef164\") " pod="openshift-service-ca/service-ca-79f68b9f4f-rvrqm"
Jul 13 20:58:11.298262 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:11.298235    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-rvrqm"
Jul 13 20:58:11.421215 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:11.421184    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-rvrqm"]
Jul 13 20:58:11.424085 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:58:11.424057    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ca12286_1218_4f0e_98a6_b934f51ef164.slice/crio-a6204d9bb126ec4e41c3a4b7c156a875841cbad6e74e4c4ae182782a7820a373 WatchSource:0}: Error finding container a6204d9bb126ec4e41c3a4b7c156a875841cbad6e74e4c4ae182782a7820a373: Status 404 returned error can't find the container with id a6204d9bb126ec4e41c3a4b7c156a875841cbad6e74e4c4ae182782a7820a373
Jul 13 20:58:11.916010 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:11.915977    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:11.932936 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:11.932908    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sfjmb_34885618-690d-42f8-96c2-3af217da17a9/dns-node-resolver/0.log"
Jul 13 20:58:12.388792 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:12.388755    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-rvrqm" event={"ID":"0ca12286-1218-4f0e-98a6-b934f51ef164","Type":"ContainerStarted","Data":"34dc9552ca19772c39faf23a546db840b611f287833348e10a0fc9b6fc4276a2"}
Jul 13 20:58:12.388991 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:12.388801    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-rvrqm" event={"ID":"0ca12286-1218-4f0e-98a6-b934f51ef164","Type":"ContainerStarted","Data":"a6204d9bb126ec4e41c3a4b7c156a875841cbad6e74e4c4ae182782a7820a373"}
Jul 13 20:58:12.408049 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:12.408003    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-rvrqm" podStartSLOduration=2.407987921 podStartE2EDuration="2.407987921s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:58:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:58:12.407005711 +0000 UTC m=+265.401789150" watchObservedRunningTime="2026-07-13 20:58:12.407987921 +0000 UTC m=+265.402771371"
Jul 13 20:58:12.653396 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:12.653310    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:12.729317 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:12.729289    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4r78x_70606094-6a35-429c-b57d-2b236b88cc27/node-ca/0.log"
Jul 13 20:58:12.795182 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:12.795141    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9085d044-b096-4e63-b65f-cd39f4fa1c00-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mdp92\" (UID: \"9085d044-b096-4e63-b65f-cd39f4fa1c00\") " pod="openshift-insights/insights-runtime-extractor-mdp92"
Jul 13 20:58:12.795342 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:12.795233    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9085d044-b096-4e63-b65f-cd39f4fa1c00-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mdp92\" (UID: \"9085d044-b096-4e63-b65f-cd39f4fa1c00\") " pod="openshift-insights/insights-runtime-extractor-mdp92"
Jul 13 20:58:12.795342 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:58:12.795324    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 20:58:12.795460 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:58:12.795382    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9085d044-b096-4e63-b65f-cd39f4fa1c00-kube-rbac-proxy-cm podName:9085d044-b096-4e63-b65f-cd39f4fa1c00 nodeName:}" failed. No retries permitted until 2026-07-13 20:58:16.795364192 +0000 UTC m=+269.790147608 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9085d044-b096-4e63-b65f-cd39f4fa1c00-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mdp92" (UID: "9085d044-b096-4e63-b65f-cd39f4fa1c00") : configmap "kube-rbac-proxy" not found
Jul 13 20:58:12.795685 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:58:12.795656    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 20:58:12.795849 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:58:12.795723    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9085d044-b096-4e63-b65f-cd39f4fa1c00-insights-runtime-extractor-tls podName:9085d044-b096-4e63-b65f-cd39f4fa1c00 nodeName:}" failed. No retries permitted until 2026-07-13 20:58:16.795702115 +0000 UTC m=+269.790485528 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9085d044-b096-4e63-b65f-cd39f4fa1c00-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mdp92" (UID: "9085d044-b096-4e63-b65f-cd39f4fa1c00") : secret "insights-runtime-extractor-tls" not found
Jul 13 20:58:12.861853 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:12.861822    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:13.036643 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:13.036607    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:13.136043 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:13.136014    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:13.248063 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:13.248023    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:13.348843 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:13.348744    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:13.927793 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:13.927763    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dqqtb_d00b98e8-2a0b-4cac-bdb9-4694daeb7e0a/serve-healthcheck-canary/0.log"
Jul 13 20:58:14.145765 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:14.145729    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:14.736047 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:14.736017    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:14.945061 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:14.945024    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:15.147156 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:15.147121    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:15.533048 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:15.533012    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:15.619656 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:15.619621    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:16.142564 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:16.142532    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:16.530907 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:16.530881    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:16.633038 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:16.633008    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:16.732805 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:16.732778    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:16.824721 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:16.824641    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9085d044-b096-4e63-b65f-cd39f4fa1c00-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mdp92\" (UID: \"9085d044-b096-4e63-b65f-cd39f4fa1c00\") " pod="openshift-insights/insights-runtime-extractor-mdp92"
Jul 13 20:58:16.824721 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:16.824688    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9085d044-b096-4e63-b65f-cd39f4fa1c00-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mdp92\" (UID: \"9085d044-b096-4e63-b65f-cd39f4fa1c00\") " pod="openshift-insights/insights-runtime-extractor-mdp92"
Jul 13 20:58:16.824928 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:58:16.824762    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 20:58:16.824928 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:58:16.824782    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 20:58:16.824928 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:58:16.824843    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9085d044-b096-4e63-b65f-cd39f4fa1c00-kube-rbac-proxy-cm podName:9085d044-b096-4e63-b65f-cd39f4fa1c00 nodeName:}" failed. No retries permitted until 2026-07-13 20:58:24.824809058 +0000 UTC m=+277.819610579 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9085d044-b096-4e63-b65f-cd39f4fa1c00-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mdp92" (UID: "9085d044-b096-4e63-b65f-cd39f4fa1c00") : configmap "kube-rbac-proxy" not found
Jul 13 20:58:16.824928 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:58:16.824859    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9085d044-b096-4e63-b65f-cd39f4fa1c00-insights-runtime-extractor-tls podName:9085d044-b096-4e63-b65f-cd39f4fa1c00 nodeName:}" failed. No retries permitted until 2026-07-13 20:58:24.824852165 +0000 UTC m=+277.819635565 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9085d044-b096-4e63-b65f-cd39f4fa1c00-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mdp92" (UID: "9085d044-b096-4e63-b65f-cd39f4fa1c00") : secret "insights-runtime-extractor-tls" not found
Jul 13 20:58:16.936380 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:16.936337    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:17.330195 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:17.330158    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:17.532568 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:17.532528    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:18.131728 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:18.131694    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:18.535802 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:18.535771    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:18.935047 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:18.934955    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:19.214773 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:19.214669    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:19.314750 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:19.314709    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:19.533876 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:19.533849    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:19.932160 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:19.932052    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:20.534520 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:20.534493    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:21.946542 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:21.946501    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:22.140142 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:22.140114    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:22.414495 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:22.414458    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:22.524735 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:22.524700    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:22.742127 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:22.742034    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:23.141015 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:23.140986    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:23.285468 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:23.285434    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:23.394906 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:23.394803    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:23.489982 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:23.489950    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:23.733304 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:23.733219    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:23.894632 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:23.894587    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:24.882333 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:24.882289    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9085d044-b096-4e63-b65f-cd39f4fa1c00-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mdp92\" (UID: \"9085d044-b096-4e63-b65f-cd39f4fa1c00\") " pod="openshift-insights/insights-runtime-extractor-mdp92"
Jul 13 20:58:24.882862 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:24.882368    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9085d044-b096-4e63-b65f-cd39f4fa1c00-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mdp92\" (UID: \"9085d044-b096-4e63-b65f-cd39f4fa1c00\") " pod="openshift-insights/insights-runtime-extractor-mdp92"
Jul 13 20:58:24.882862 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:24.882838    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9085d044-b096-4e63-b65f-cd39f4fa1c00-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mdp92\" (UID: \"9085d044-b096-4e63-b65f-cd39f4fa1c00\") " pod="openshift-insights/insights-runtime-extractor-mdp92"
Jul 13 20:58:24.884733 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:24.884699    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9085d044-b096-4e63-b65f-cd39f4fa1c00-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mdp92\" (UID: \"9085d044-b096-4e63-b65f-cd39f4fa1c00\") " pod="openshift-insights/insights-runtime-extractor-mdp92"
Jul 13 20:58:25.046802 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:25.046766    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mdp92"
Jul 13 20:58:25.170676 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:25.170651    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mdp92"]
Jul 13 20:58:25.173174 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:58:25.173143    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9085d044_b096_4e63_b65f_cd39f4fa1c00.slice/crio-a8adc2fab6832234f7d27c4dadfe53ecf84a23e228eec0b376dea3c0fc1d7db3 WatchSource:0}: Error finding container a8adc2fab6832234f7d27c4dadfe53ecf84a23e228eec0b376dea3c0fc1d7db3: Status 404 returned error can't find the container with id a8adc2fab6832234f7d27c4dadfe53ecf84a23e228eec0b376dea3c0fc1d7db3
Jul 13 20:58:25.426206 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:25.426125    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mdp92" event={"ID":"9085d044-b096-4e63-b65f-cd39f4fa1c00","Type":"ContainerStarted","Data":"a8adc2fab6832234f7d27c4dadfe53ecf84a23e228eec0b376dea3c0fc1d7db3"}
Jul 13 20:58:25.488352 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:25.488312    2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5978bb8dd5-74mq5" podUID="1d1323fd-a689-47b4-bace-abe7b5b7e602" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 13 20:58:29.440338 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:29.440303    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mdp92" event={"ID":"9085d044-b096-4e63-b65f-cd39f4fa1c00","Type":"ContainerStarted","Data":"a95ab4c6669aaaa78893a3882a68d87b6a1271fb79d341201922a403489a7e69"}
Jul 13 20:58:30.087419 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:58:30.087371    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-g6djs" podUID="d30568f7-82bc-4275-8448-bd730870d3c9"
Jul 13 20:58:30.205219 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:30.205180    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:30.306103 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:30.306056    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:30.365039 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:30.364948    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:30.445543 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:30.445511    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g6djs"
Jul 13 20:58:30.445543 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:30.445528    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mdp92" event={"ID":"9085d044-b096-4e63-b65f-cd39f4fa1c00","Type":"ContainerStarted","Data":"d65b6cba990a2a7d205ce221aa884165004034eecf99aab531f9291e074298bd"}
Jul 13 20:58:30.505166 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:30.505124    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:30.691763 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:30.691664    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:30.897482 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:30.897435    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:31.111395 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:31.111362    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:31.698272 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:31.698239    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:31.798436 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:31.798389    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:32.109684 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:32.109658    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:32.292299 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:32.292213    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:32.453495 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:32.453464    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mdp92" event={"ID":"9085d044-b096-4e63-b65f-cd39f4fa1c00","Type":"ContainerStarted","Data":"a651654a8586c7cabca773d9295825fd37c88940708120692c48d0d03a04669d"}
Jul 13 20:58:32.471150 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:32.471100    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mdp92" podStartSLOduration=16.720818536 podStartE2EDuration="23.471084203s" totalImagesPullingTime="6.750265667s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:58:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:58:32.469647073 +0000 UTC m=+285.464430497" watchObservedRunningTime="2026-07-13 20:58:32.471084203 +0000 UTC m=+285.465867625"
Jul 13 20:58:32.526806 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:32.526775    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:33.252144 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:33.252098    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d30568f7-82bc-4275-8448-bd730870d3c9-metrics-tls\") pod \"dns-default-g6djs\" (UID: \"d30568f7-82bc-4275-8448-bd730870d3c9\") " pod="openshift-dns/dns-default-g6djs"
Jul 13 20:58:33.254467 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:33.254448    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d30568f7-82bc-4275-8448-bd730870d3c9-metrics-tls\") pod \"dns-default-g6djs\" (UID: \"d30568f7-82bc-4275-8448-bd730870d3c9\") " pod="openshift-dns/dns-default-g6djs"
Jul 13 20:58:33.339746 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:33.339716    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:33.448719 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:33.448686    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-f67kb\""
Jul 13 20:58:33.456406 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:33.456384    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g6djs"
Jul 13 20:58:33.578668 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:33.578639    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g6djs"]
Jul 13 20:58:33.582743 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:58:33.582713    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd30568f7_82bc_4275_8448_bd730870d3c9.slice/crio-ac2861fc304f4b30b0ea039c01b87bb9eca663607ec8b354996259a33103681e WatchSource:0}: Error finding container ac2861fc304f4b30b0ea039c01b87bb9eca663607ec8b354996259a33103681e: Status 404 returned error can't find the container with id ac2861fc304f4b30b0ea039c01b87bb9eca663607ec8b354996259a33103681e
Jul 13 20:58:34.460716 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:34.460683    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g6djs" event={"ID":"d30568f7-82bc-4275-8448-bd730870d3c9","Type":"ContainerStarted","Data":"ac2861fc304f4b30b0ea039c01b87bb9eca663607ec8b354996259a33103681e"}
Jul 13 20:58:35.471932 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:35.471806    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g6djs" event={"ID":"d30568f7-82bc-4275-8448-bd730870d3c9","Type":"ContainerStarted","Data":"7b3854678f10ecae706ca65d653ed05ae6105e3867d2f332f6027c1a3d455b8f"}
Jul 13 20:58:35.471932 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:35.471917    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g6djs" event={"ID":"d30568f7-82bc-4275-8448-bd730870d3c9","Type":"ContainerStarted","Data":"f7a5044c95e82e5bcbfb29cca06ccd7406fb1353c08e64975f038b484b5465ca"}
Jul 13 20:58:35.472374 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:35.471958    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-g6djs"
Jul 13 20:58:35.487952 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:35.487926    2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5978bb8dd5-74mq5" podUID="1d1323fd-a689-47b4-bace-abe7b5b7e602" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 13 20:58:35.490148 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:35.490096    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-g6djs" podStartSLOduration=251.014340421 podStartE2EDuration="4m12.490079643s" totalImagesPullingTime="1.475739222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:54:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:58:35.489589677 +0000 UTC m=+288.484373097" watchObservedRunningTime="2026-07-13 20:58:35.490079643 +0000 UTC m=+288.484863045"
Jul 13 20:58:36.551209 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:36.551173    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7df4bb85c-kbm7x"]
Jul 13 20:58:36.553987 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:36.553969    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7df4bb85c-kbm7x"
Jul 13 20:58:36.558200 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:36.558172    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 13 20:58:36.558640 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:36.558620    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 13 20:58:36.558794 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:36.558780    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bwbzd\""
Jul 13 20:58:36.559444 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:36.559426    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 13 20:58:36.565787 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:36.565768    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 13 20:58:36.570438 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:36.570418    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7df4bb85c-kbm7x"]
Jul 13 20:58:36.586126 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:36.586105    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:36.670245 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:36.670214    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:36.678309 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:36.678283    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/349147c3-17c6-4597-9e59-2d21ba6dcf0e-registry-certificates\") pod \"image-registry-7df4bb85c-kbm7x\" (UID: \"349147c3-17c6-4597-9e59-2d21ba6dcf0e\") " pod="openshift-image-registry/image-registry-7df4bb85c-kbm7x"
Jul 13 20:58:36.678419 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:36.678318    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/349147c3-17c6-4597-9e59-2d21ba6dcf0e-image-registry-private-configuration\") pod \"image-registry-7df4bb85c-kbm7x\" (UID: \"349147c3-17c6-4597-9e59-2d21ba6dcf0e\") " pod="openshift-image-registry/image-registry-7df4bb85c-kbm7x"
Jul 13 20:58:36.678419 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:36.678336    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/349147c3-17c6-4597-9e59-2d21ba6dcf0e-bound-sa-token\") pod \"image-registry-7df4bb85c-kbm7x\" (UID: \"349147c3-17c6-4597-9e59-2d21ba6dcf0e\") " pod="openshift-image-registry/image-registry-7df4bb85c-kbm7x"
Jul 13 20:58:36.678419 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:36.678359    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9drb9\" (UniqueName: \"kubernetes.io/projected/349147c3-17c6-4597-9e59-2d21ba6dcf0e-kube-api-access-9drb9\") pod \"image-registry-7df4bb85c-kbm7x\" (UID: \"349147c3-17c6-4597-9e59-2d21ba6dcf0e\") " pod="openshift-image-registry/image-registry-7df4bb85c-kbm7x"
Jul 13 20:58:36.678593 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:36.678451    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/349147c3-17c6-4597-9e59-2d21ba6dcf0e-trusted-ca\") pod \"image-registry-7df4bb85c-kbm7x\" (UID: \"349147c3-17c6-4597-9e59-2d21ba6dcf0e\") " pod="openshift-image-registry/image-registry-7df4bb85c-kbm7x"
Jul 13 20:58:36.678593 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:36.678527    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/349147c3-17c6-4597-9e59-2d21ba6dcf0e-installation-pull-secrets\") pod \"image-registry-7df4bb85c-kbm7x\" (UID: \"349147c3-17c6-4597-9e59-2d21ba6dcf0e\") " pod="openshift-image-registry/image-registry-7df4bb85c-kbm7x"
Jul 13 20:58:36.678593 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:36.678560    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/349147c3-17c6-4597-9e59-2d21ba6dcf0e-registry-tls\") pod \"image-registry-7df4bb85c-kbm7x\" (UID: \"349147c3-17c6-4597-9e59-2d21ba6dcf0e\") " pod="openshift-image-registry/image-registry-7df4bb85c-kbm7x"
Jul 13 20:58:36.678593 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:36.678588    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/349147c3-17c6-4597-9e59-2d21ba6dcf0e-ca-trust-extracted\") pod \"image-registry-7df4bb85c-kbm7x\" (UID: \"349147c3-17c6-4597-9e59-2d21ba6dcf0e\") " pod="openshift-image-registry/image-registry-7df4bb85c-kbm7x"
Jul 13 20:58:36.779231 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:36.779204    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/349147c3-17c6-4597-9e59-2d21ba6dcf0e-installation-pull-secrets\") pod \"image-registry-7df4bb85c-kbm7x\" (UID: \"349147c3-17c6-4597-9e59-2d21ba6dcf0e\") " pod="openshift-image-registry/image-registry-7df4bb85c-kbm7x"
Jul 13 20:58:36.779395 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:36.779238    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/349147c3-17c6-4597-9e59-2d21ba6dcf0e-registry-tls\") pod \"image-registry-7df4bb85c-kbm7x\" (UID: \"349147c3-17c6-4597-9e59-2d21ba6dcf0e\") " pod="openshift-image-registry/image-registry-7df4bb85c-kbm7x"
Jul 13 20:58:36.779395 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:36.779263    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/349147c3-17c6-4597-9e59-2d21ba6dcf0e-ca-trust-extracted\") pod \"image-registry-7df4bb85c-kbm7x\" (UID: \"349147c3-17c6-4597-9e59-2d21ba6dcf0e\") " pod="openshift-image-registry/image-registry-7df4bb85c-kbm7x"
Jul 13 20:58:36.779395 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:36.779370    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/349147c3-17c6-4597-9e59-2d21ba6dcf0e-registry-certificates\") pod \"image-registry-7df4bb85c-kbm7x\" (UID: \"349147c3-17c6-4597-9e59-2d21ba6dcf0e\") " pod="openshift-image-registry/image-registry-7df4bb85c-kbm7x"
Jul 13 20:58:36.779550 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:36.779419    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/349147c3-17c6-4597-9e59-2d21ba6dcf0e-image-registry-private-configuration\") pod \"image-registry-7df4bb85c-kbm7x\" (UID: \"349147c3-17c6-4597-9e59-2d21ba6dcf0e\") " pod="openshift-image-registry/image-registry-7df4bb85c-kbm7x"
Jul 13 20:58:36.779550 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:36.779448    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/349147c3-17c6-4597-9e59-2d21ba6dcf0e-bound-sa-token\") pod \"image-registry-7df4bb85c-kbm7x\" (UID: \"349147c3-17c6-4597-9e59-2d21ba6dcf0e\") " pod="openshift-image-registry/image-registry-7df4bb85c-kbm7x"
Jul 13 20:58:36.779550 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:36.779486    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9drb9\" (UniqueName: \"kubernetes.io/projected/349147c3-17c6-4597-9e59-2d21ba6dcf0e-kube-api-access-9drb9\") pod \"image-registry-7df4bb85c-kbm7x\" (UID: \"349147c3-17c6-4597-9e59-2d21ba6dcf0e\") " pod="openshift-image-registry/image-registry-7df4bb85c-kbm7x"
Jul 13 20:58:36.779550 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:36.779530    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/349147c3-17c6-4597-9e59-2d21ba6dcf0e-trusted-ca\") pod \"image-registry-7df4bb85c-kbm7x\" (UID: \"349147c3-17c6-4597-9e59-2d21ba6dcf0e\") " pod="openshift-image-registry/image-registry-7df4bb85c-kbm7x"
Jul 13 20:58:36.779765 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:36.779613    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/349147c3-17c6-4597-9e59-2d21ba6dcf0e-ca-trust-extracted\") pod \"image-registry-7df4bb85c-kbm7x\" (UID: \"349147c3-17c6-4597-9e59-2d21ba6dcf0e\") " pod="openshift-image-registry/image-registry-7df4bb85c-kbm7x"
Jul 13 20:58:36.780280 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:36.780254    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/349147c3-17c6-4597-9e59-2d21ba6dcf0e-registry-certificates\") pod \"image-registry-7df4bb85c-kbm7x\" (UID: \"349147c3-17c6-4597-9e59-2d21ba6dcf0e\") " pod="openshift-image-registry/image-registry-7df4bb85c-kbm7x"
Jul 13 20:58:36.780652 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:36.780633    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/349147c3-17c6-4597-9e59-2d21ba6dcf0e-trusted-ca\") pod \"image-registry-7df4bb85c-kbm7x\" (UID: \"349147c3-17c6-4597-9e59-2d21ba6dcf0e\") " pod="openshift-image-registry/image-registry-7df4bb85c-kbm7x"
Jul 13 20:58:36.781770 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:36.781746    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/349147c3-17c6-4597-9e59-2d21ba6dcf0e-image-registry-private-configuration\") pod \"image-registry-7df4bb85c-kbm7x\" (UID: \"349147c3-17c6-4597-9e59-2d21ba6dcf0e\") " pod="openshift-image-registry/image-registry-7df4bb85c-kbm7x"
Jul 13 20:58:36.781770 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:36.781764    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/349147c3-17c6-4597-9e59-2d21ba6dcf0e-installation-pull-secrets\") pod \"image-registry-7df4bb85c-kbm7x\" (UID: \"349147c3-17c6-4597-9e59-2d21ba6dcf0e\") " pod="openshift-image-registry/image-registry-7df4bb85c-kbm7x"
Jul 13 20:58:36.781905 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:36.781799    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/349147c3-17c6-4597-9e59-2d21ba6dcf0e-registry-tls\") pod \"image-registry-7df4bb85c-kbm7x\" (UID: \"349147c3-17c6-4597-9e59-2d21ba6dcf0e\") " pod="openshift-image-registry/image-registry-7df4bb85c-kbm7x"
Jul 13 20:58:36.790120 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:36.790098    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/349147c3-17c6-4597-9e59-2d21ba6dcf0e-bound-sa-token\") pod \"image-registry-7df4bb85c-kbm7x\" (UID: \"349147c3-17c6-4597-9e59-2d21ba6dcf0e\") " pod="openshift-image-registry/image-registry-7df4bb85c-kbm7x"
Jul 13 20:58:36.790952 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:36.790932    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9drb9\" (UniqueName: \"kubernetes.io/projected/349147c3-17c6-4597-9e59-2d21ba6dcf0e-kube-api-access-9drb9\") pod \"image-registry-7df4bb85c-kbm7x\" (UID: \"349147c3-17c6-4597-9e59-2d21ba6dcf0e\") " pod="openshift-image-registry/image-registry-7df4bb85c-kbm7x"
Jul 13 20:58:36.863317 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:36.863251    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7df4bb85c-kbm7x"
Jul 13 20:58:36.990268 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:36.990235    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7df4bb85c-kbm7x"]
Jul 13 20:58:36.993788 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:58:36.993760    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod349147c3_17c6_4597_9e59_2d21ba6dcf0e.slice/crio-d1dc2426690eeb62362868031fb48b9e8bcd4df3e01c11f403bdf15b91a86d8c WatchSource:0}: Error finding container d1dc2426690eeb62362868031fb48b9e8bcd4df3e01c11f403bdf15b91a86d8c: Status 404 returned error can't find the container with id d1dc2426690eeb62362868031fb48b9e8bcd4df3e01c11f403bdf15b91a86d8c
Jul 13 20:58:37.479021 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:37.478990    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7df4bb85c-kbm7x" event={"ID":"349147c3-17c6-4597-9e59-2d21ba6dcf0e","Type":"ContainerStarted","Data":"b739d95edf699bfcf8ba671bca7f9e5f35af17eaad73099000f0b904054e9457"}
Jul 13 20:58:37.479185 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:37.479042    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7df4bb85c-kbm7x" event={"ID":"349147c3-17c6-4597-9e59-2d21ba6dcf0e","Type":"ContainerStarted","Data":"d1dc2426690eeb62362868031fb48b9e8bcd4df3e01c11f403bdf15b91a86d8c"}
Jul 13 20:58:37.479185 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:37.479128    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7df4bb85c-kbm7x"
Jul 13 20:58:37.518916 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:37.518872    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7df4bb85c-kbm7x" podStartSLOduration=1.518855119 podStartE2EDuration="1.518855119s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:58:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:58:37.517459912 +0000 UTC m=+290.512243334" watchObservedRunningTime="2026-07-13 20:58:37.518855119 +0000 UTC m=+290.513638541"
Jul 13 20:58:39.483828 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:39.483776    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:39.550956 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:39.550923    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:39.718330 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:39.718299    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:41.572311 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:58:41.572271    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-zhvrj" podUID="8608f034-4011-42c3-b0ee-1369e8afa709"
Jul 13 20:58:43.286680 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:43.286644    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:43.517282 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:43.517248    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:45.477620 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:45.477591    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-g6djs"
Jul 13 20:58:45.487677 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:45.487645    2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5978bb8dd5-74mq5" podUID="1d1323fd-a689-47b4-bace-abe7b5b7e602" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 13 20:58:45.487844 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:45.487720    2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5978bb8dd5-74mq5"
Jul 13 20:58:45.488229 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:45.488198    2561 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"1bcf2676c6b3f1a2eb629b054ca4d04f2810bf59c7bdfa750fe43d205814a95a"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5978bb8dd5-74mq5" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 13 20:58:45.488330 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:45.488254    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5978bb8dd5-74mq5" podUID="1d1323fd-a689-47b4-bace-abe7b5b7e602" containerName="service-proxy" containerID="cri-o://1bcf2676c6b3f1a2eb629b054ca4d04f2810bf59c7bdfa750fe43d205814a95a" gracePeriod=30
Jul 13 20:58:45.553979 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:45.553952    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:45.697030 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:45.696998    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:45.796030 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:45.796002    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:45.902447 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:45.902415    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:45.931850 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:45.931823    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kpdwn"]
Jul 13 20:58:45.938659 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:45.938631    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kpdwn"
Jul 13 20:58:45.939371 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:45.939344    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-m6p8g"]
Jul 13 20:58:45.942578 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:45.942559    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-m6p8g"
Jul 13 20:58:45.945653 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:45.945629    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 13 20:58:45.945763 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:45.945718    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 13 20:58:45.946365 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:45.946349    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 13 20:58:45.946523 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:45.946501    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-t6k5j\""
Jul 13 20:58:45.946751 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:45.946733    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 13 20:58:45.946997 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:45.946981    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 13 20:58:45.947239 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:45.946991    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 13 20:58:45.947239 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:45.947237    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 13 20:58:45.947358 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:45.947006    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gxcf2\""
Jul 13 20:58:45.947358 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:45.947027    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 13 20:58:45.947782 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:45.947765    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 13 20:58:45.961299 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:45.961281    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-m6p8g"]
Jul 13 20:58:45.996968 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:45.996937    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:46.044646 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.044623    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/19a42a98-1c5a-408c-ada9-b45208264b32-node-exporter-accelerators-collector-config\") pod \"node-exporter-kpdwn\" (UID: \"19a42a98-1c5a-408c-ada9-b45208264b32\") " pod="openshift-monitoring/node-exporter-kpdwn"
Jul 13 20:58:46.044774 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.044653    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/16addf4f-5be8-437c-b494-8cefd4c1b407-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-m6p8g\" (UID: \"16addf4f-5be8-437c-b494-8cefd4c1b407\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-m6p8g"
Jul 13 20:58:46.044774 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.044674    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19a42a98-1c5a-408c-ada9-b45208264b32-metrics-client-ca\") pod \"node-exporter-kpdwn\" (UID: \"19a42a98-1c5a-408c-ada9-b45208264b32\") " pod="openshift-monitoring/node-exporter-kpdwn"
Jul 13 20:58:46.044774 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.044693    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/19a42a98-1c5a-408c-ada9-b45208264b32-node-exporter-tls\") pod \"node-exporter-kpdwn\" (UID: \"19a42a98-1c5a-408c-ada9-b45208264b32\") " pod="openshift-monitoring/node-exporter-kpdwn"
Jul 13 20:58:46.044774 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.044758    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/19a42a98-1c5a-408c-ada9-b45208264b32-root\") pod \"node-exporter-kpdwn\" (UID: \"19a42a98-1c5a-408c-ada9-b45208264b32\") " pod="openshift-monitoring/node-exporter-kpdwn"
Jul 13 20:58:46.044966 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.044785    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16addf4f-5be8-437c-b494-8cefd4c1b407-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-m6p8g\" (UID: \"16addf4f-5be8-437c-b494-8cefd4c1b407\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-m6p8g"
Jul 13 20:58:46.044966 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.044847    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/16addf4f-5be8-437c-b494-8cefd4c1b407-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-m6p8g\" (UID: \"16addf4f-5be8-437c-b494-8cefd4c1b407\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-m6p8g"
Jul 13 20:58:46.044966 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.044874    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/19a42a98-1c5a-408c-ada9-b45208264b32-node-exporter-wtmp\") pod \"node-exporter-kpdwn\" (UID: \"19a42a98-1c5a-408c-ada9-b45208264b32\") " pod="openshift-monitoring/node-exporter-kpdwn"
Jul 13 20:58:46.044966 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.044904    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/19a42a98-1c5a-408c-ada9-b45208264b32-node-exporter-textfile\") pod \"node-exporter-kpdwn\" (UID: \"19a42a98-1c5a-408c-ada9-b45208264b32\") " pod="openshift-monitoring/node-exporter-kpdwn"
Jul 13 20:58:46.044966 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.044928    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/19a42a98-1c5a-408c-ada9-b45208264b32-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kpdwn\" (UID: \"19a42a98-1c5a-408c-ada9-b45208264b32\") " pod="openshift-monitoring/node-exporter-kpdwn"
Jul 13 20:58:46.045157 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.044987    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19a42a98-1c5a-408c-ada9-b45208264b32-sys\") pod \"node-exporter-kpdwn\" (UID: \"19a42a98-1c5a-408c-ada9-b45208264b32\") " pod="openshift-monitoring/node-exporter-kpdwn"
Jul 13 20:58:46.045157 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.045027    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p5z8\" (UniqueName: \"kubernetes.io/projected/19a42a98-1c5a-408c-ada9-b45208264b32-kube-api-access-9p5z8\") pod \"node-exporter-kpdwn\" (UID: \"19a42a98-1c5a-408c-ada9-b45208264b32\") " pod="openshift-monitoring/node-exporter-kpdwn"
Jul 13 20:58:46.045157 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.045082    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/16addf4f-5be8-437c-b494-8cefd4c1b407-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-m6p8g\" (UID: \"16addf4f-5be8-437c-b494-8cefd4c1b407\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-m6p8g"
Jul 13 20:58:46.045157 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.045105    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/16addf4f-5be8-437c-b494-8cefd4c1b407-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-m6p8g\" (UID: \"16addf4f-5be8-437c-b494-8cefd4c1b407\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-m6p8g"
Jul 13 20:58:46.045157 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.045122    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz7b7\" (UniqueName: \"kubernetes.io/projected/16addf4f-5be8-437c-b494-8cefd4c1b407-kube-api-access-vz7b7\") pod \"kube-state-metrics-785778ff74-m6p8g\" (UID: \"16addf4f-5be8-437c-b494-8cefd4c1b407\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-m6p8g"
Jul 13 20:58:46.096355 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.096291    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:46.145821 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.145793    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/19a42a98-1c5a-408c-ada9-b45208264b32-node-exporter-wtmp\") pod \"node-exporter-kpdwn\" (UID: \"19a42a98-1c5a-408c-ada9-b45208264b32\") " pod="openshift-monitoring/node-exporter-kpdwn"
Jul 13 20:58:46.145913 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.145846    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/19a42a98-1c5a-408c-ada9-b45208264b32-node-exporter-textfile\") pod \"node-exporter-kpdwn\" (UID: \"19a42a98-1c5a-408c-ada9-b45208264b32\") " pod="openshift-monitoring/node-exporter-kpdwn"
Jul 13 20:58:46.145913 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.145866    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/19a42a98-1c5a-408c-ada9-b45208264b32-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kpdwn\" (UID: \"19a42a98-1c5a-408c-ada9-b45208264b32\") " pod="openshift-monitoring/node-exporter-kpdwn"
Jul 13 20:58:46.145913 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.145896    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19a42a98-1c5a-408c-ada9-b45208264b32-sys\") pod \"node-exporter-kpdwn\" (UID: \"19a42a98-1c5a-408c-ada9-b45208264b32\") " pod="openshift-monitoring/node-exporter-kpdwn"
Jul 13 20:58:46.146054 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.145917    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p5z8\" (UniqueName: \"kubernetes.io/projected/19a42a98-1c5a-408c-ada9-b45208264b32-kube-api-access-9p5z8\") pod \"node-exporter-kpdwn\" (UID: \"19a42a98-1c5a-408c-ada9-b45208264b32\") " pod="openshift-monitoring/node-exporter-kpdwn"
Jul 13 20:58:46.146054 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.145950    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/19a42a98-1c5a-408c-ada9-b45208264b32-node-exporter-wtmp\") pod \"node-exporter-kpdwn\" (UID: \"19a42a98-1c5a-408c-ada9-b45208264b32\") " pod="openshift-monitoring/node-exporter-kpdwn"
Jul 13 20:58:46.146054 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.145955    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/16addf4f-5be8-437c-b494-8cefd4c1b407-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-m6p8g\" (UID: \"16addf4f-5be8-437c-b494-8cefd4c1b407\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-m6p8g"
Jul 13 20:58:46.146054 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.146001    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/16addf4f-5be8-437c-b494-8cefd4c1b407-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-m6p8g\" (UID: \"16addf4f-5be8-437c-b494-8cefd4c1b407\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-m6p8g"
Jul 13 20:58:46.146054 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.146010    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19a42a98-1c5a-408c-ada9-b45208264b32-sys\") pod \"node-exporter-kpdwn\" (UID: \"19a42a98-1c5a-408c-ada9-b45208264b32\") " pod="openshift-monitoring/node-exporter-kpdwn"
Jul 13 20:58:46.146054 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.146031    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz7b7\" (UniqueName: \"kubernetes.io/projected/16addf4f-5be8-437c-b494-8cefd4c1b407-kube-api-access-vz7b7\") pod \"kube-state-metrics-785778ff74-m6p8g\" (UID: \"16addf4f-5be8-437c-b494-8cefd4c1b407\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-m6p8g"
Jul 13 20:58:46.146347 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.146082    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/19a42a98-1c5a-408c-ada9-b45208264b32-node-exporter-accelerators-collector-config\") pod \"node-exporter-kpdwn\" (UID: \"19a42a98-1c5a-408c-ada9-b45208264b32\") " pod="openshift-monitoring/node-exporter-kpdwn"
Jul 13 20:58:46.146347 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.146108    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/16addf4f-5be8-437c-b494-8cefd4c1b407-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-m6p8g\" (UID: \"16addf4f-5be8-437c-b494-8cefd4c1b407\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-m6p8g"
Jul 13 20:58:46.146347 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.146143    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19a42a98-1c5a-408c-ada9-b45208264b32-metrics-client-ca\") pod \"node-exporter-kpdwn\" (UID: \"19a42a98-1c5a-408c-ada9-b45208264b32\") " pod="openshift-monitoring/node-exporter-kpdwn"
Jul 13 20:58:46.146347 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.146170    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/19a42a98-1c5a-408c-ada9-b45208264b32-node-exporter-tls\") pod \"node-exporter-kpdwn\" (UID: \"19a42a98-1c5a-408c-ada9-b45208264b32\") " pod="openshift-monitoring/node-exporter-kpdwn"
Jul 13 20:58:46.146347 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.146185    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/19a42a98-1c5a-408c-ada9-b45208264b32-node-exporter-textfile\") pod \"node-exporter-kpdwn\" (UID: \"19a42a98-1c5a-408c-ada9-b45208264b32\") " pod="openshift-monitoring/node-exporter-kpdwn"
Jul 13 20:58:46.146347 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.146206    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/19a42a98-1c5a-408c-ada9-b45208264b32-root\") pod \"node-exporter-kpdwn\" (UID: \"19a42a98-1c5a-408c-ada9-b45208264b32\") " pod="openshift-monitoring/node-exporter-kpdwn"
Jul 13 20:58:46.146347 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.146234    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16addf4f-5be8-437c-b494-8cefd4c1b407-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-m6p8g\" (UID: \"16addf4f-5be8-437c-b494-8cefd4c1b407\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-m6p8g"
Jul 13 20:58:46.146347 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.146261    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/16addf4f-5be8-437c-b494-8cefd4c1b407-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-m6p8g\" (UID: \"16addf4f-5be8-437c-b494-8cefd4c1b407\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-m6p8g"
Jul 13 20:58:46.146347 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.146289    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/16addf4f-5be8-437c-b494-8cefd4c1b407-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-m6p8g\" (UID: \"16addf4f-5be8-437c-b494-8cefd4c1b407\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-m6p8g"
Jul 13 20:58:46.146785 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.146358    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/19a42a98-1c5a-408c-ada9-b45208264b32-root\") pod \"node-exporter-kpdwn\" (UID: \"19a42a98-1c5a-408c-ada9-b45208264b32\") " pod="openshift-monitoring/node-exporter-kpdwn"
Jul 13 20:58:46.146860 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.146791    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19a42a98-1c5a-408c-ada9-b45208264b32-metrics-client-ca\") pod \"node-exporter-kpdwn\" (UID: \"19a42a98-1c5a-408c-ada9-b45208264b32\") " pod="openshift-monitoring/node-exporter-kpdwn"
Jul 13 20:58:46.147119 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.147094    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16addf4f-5be8-437c-b494-8cefd4c1b407-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-m6p8g\" (UID: \"16addf4f-5be8-437c-b494-8cefd4c1b407\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-m6p8g"
Jul 13 20:58:46.147199 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.147130    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/16addf4f-5be8-437c-b494-8cefd4c1b407-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-m6p8g\" (UID: \"16addf4f-5be8-437c-b494-8cefd4c1b407\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-m6p8g"
Jul 13 20:58:46.147253 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.147198    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/19a42a98-1c5a-408c-ada9-b45208264b32-node-exporter-accelerators-collector-config\") pod \"node-exporter-kpdwn\" (UID: \"19a42a98-1c5a-408c-ada9-b45208264b32\") " pod="openshift-monitoring/node-exporter-kpdwn"
Jul 13 20:58:46.148418 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.148398    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/19a42a98-1c5a-408c-ada9-b45208264b32-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kpdwn\" (UID: \"19a42a98-1c5a-408c-ada9-b45208264b32\") " pod="openshift-monitoring/node-exporter-kpdwn"
Jul 13 20:58:46.148613 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.148592    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/19a42a98-1c5a-408c-ada9-b45208264b32-node-exporter-tls\") pod \"node-exporter-kpdwn\" (UID: \"19a42a98-1c5a-408c-ada9-b45208264b32\") " pod="openshift-monitoring/node-exporter-kpdwn"
Jul 13 20:58:46.148844 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.148804    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/16addf4f-5be8-437c-b494-8cefd4c1b407-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-m6p8g\" (UID: \"16addf4f-5be8-437c-b494-8cefd4c1b407\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-m6p8g"
Jul 13 20:58:46.148844 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.148837    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/16addf4f-5be8-437c-b494-8cefd4c1b407-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-m6p8g\" (UID: \"16addf4f-5be8-437c-b494-8cefd4c1b407\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-m6p8g"
Jul 13 20:58:46.156007 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.155985    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz7b7\" (UniqueName: \"kubernetes.io/projected/16addf4f-5be8-437c-b494-8cefd4c1b407-kube-api-access-vz7b7\") pod \"kube-state-metrics-785778ff74-m6p8g\" (UID: \"16addf4f-5be8-437c-b494-8cefd4c1b407\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-m6p8g"
Jul 13 20:58:46.157097 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.157078    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p5z8\" (UniqueName: \"kubernetes.io/projected/19a42a98-1c5a-408c-ada9-b45208264b32-kube-api-access-9p5z8\") pod \"node-exporter-kpdwn\" (UID: \"19a42a98-1c5a-408c-ada9-b45208264b32\") " pod="openshift-monitoring/node-exporter-kpdwn"
Jul 13 20:58:46.193581 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.193556    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:46.249289 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.249262    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kpdwn"
Jul 13 20:58:46.255780 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.255757    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-m6p8g"
Jul 13 20:58:46.260867 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:58:46.260841    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19a42a98_1c5a_408c_ada9_b45208264b32.slice/crio-7a3dc86639142fd61c7617c9c59ddf8abbc280da7c5c3c4e153124db92ce9e7a WatchSource:0}: Error finding container 7a3dc86639142fd61c7617c9c59ddf8abbc280da7c5c3c4e153124db92ce9e7a: Status 404 returned error can't find the container with id 7a3dc86639142fd61c7617c9c59ddf8abbc280da7c5c3c4e153124db92ce9e7a
Jul 13 20:58:46.276420 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.276394    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:46.386738 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.386663    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-m6p8g"]
Jul 13 20:58:46.389972 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:58:46.389950    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16addf4f_5be8_437c_b494_8cefd4c1b407.slice/crio-77979c434c60777205c3d270caaf92c375fabc3428b4101cf91a6eaa16cf8296 WatchSource:0}: Error finding container 77979c434c60777205c3d270caaf92c375fabc3428b4101cf91a6eaa16cf8296: Status 404 returned error can't find the container with id 77979c434c60777205c3d270caaf92c375fabc3428b4101cf91a6eaa16cf8296
Jul 13 20:58:46.509517 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.509487    2561 generic.go:356] "Generic (PLEG): container finished" podID="1d1323fd-a689-47b4-bace-abe7b5b7e602" containerID="1bcf2676c6b3f1a2eb629b054ca4d04f2810bf59c7bdfa750fe43d205814a95a" exitCode=2
Jul 13 20:58:46.509970 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.509568    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5978bb8dd5-74mq5" event={"ID":"1d1323fd-a689-47b4-bace-abe7b5b7e602","Type":"ContainerDied","Data":"1bcf2676c6b3f1a2eb629b054ca4d04f2810bf59c7bdfa750fe43d205814a95a"}
Jul 13 20:58:46.509970 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.509623    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5978bb8dd5-74mq5" event={"ID":"1d1323fd-a689-47b4-bace-abe7b5b7e602","Type":"ContainerStarted","Data":"389411c4fd2dfe5e0ea9a71b058602b87bdb55e5c9cdd2d3c27c85b4dd145915"}
Jul 13 20:58:46.510771 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.510747    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-m6p8g" event={"ID":"16addf4f-5be8-437c-b494-8cefd4c1b407","Type":"ContainerStarted","Data":"77979c434c60777205c3d270caaf92c375fabc3428b4101cf91a6eaa16cf8296"}
Jul 13 20:58:46.511777 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.511756    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kpdwn" event={"ID":"19a42a98-1c5a-408c-ada9-b45208264b32","Type":"ContainerStarted","Data":"7a3dc86639142fd61c7617c9c59ddf8abbc280da7c5c3c4e153124db92ce9e7a"}
Jul 13 20:58:46.550052 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.550027    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:46.714775 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.714687    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:46.815253 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.815188    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:46.915184 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.915140    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:46.993113 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:46.993017    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:47.517399 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:47.517362    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kpdwn" event={"ID":"19a42a98-1c5a-408c-ada9-b45208264b32","Type":"ContainerStarted","Data":"62a32145f8fdcc0e5c7bf0638fde315949f9cfd6d7b905d294ce5167b648a511"}
Jul 13 20:58:47.654984 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:47.654961    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jrpbd_e730eed8-ff8a-4a54-b1cb-539d8f07e70b/ovn-acl-logging/0.log"
Jul 13 20:58:47.655125 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:47.655025    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jrpbd_e730eed8-ff8a-4a54-b1cb-539d8f07e70b/ovn-acl-logging/0.log"
Jul 13 20:58:47.664261 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:47.664242    2561 kubelet.go:1648] "Image garbage collection succeeded"
Jul 13 20:58:47.822066 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:47.822032    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:48.522386 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:48.522349    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-m6p8g" event={"ID":"16addf4f-5be8-437c-b494-8cefd4c1b407","Type":"ContainerStarted","Data":"1df5de993e91a831763c7d561136391d0ca770f4ec3afb34293cc94a3409c4f5"}
Jul 13 20:58:48.522856 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:48.522405    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-m6p8g" event={"ID":"16addf4f-5be8-437c-b494-8cefd4c1b407","Type":"ContainerStarted","Data":"177093e1561a5c83ce89fb232b12b569036be069f9b29db7b12ef435c7cf5370"}
Jul 13 20:58:48.522856 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:48.522425    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-m6p8g" event={"ID":"16addf4f-5be8-437c-b494-8cefd4c1b407","Type":"ContainerStarted","Data":"2a95393ff2420867de5470724a81e91fc97a7eabc9133435a34979311842e671"}
Jul 13 20:58:48.523733 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:48.523707    2561 generic.go:356] "Generic (PLEG): container finished" podID="19a42a98-1c5a-408c-ada9-b45208264b32" containerID="62a32145f8fdcc0e5c7bf0638fde315949f9cfd6d7b905d294ce5167b648a511" exitCode=0
Jul 13 20:58:48.523853 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:48.523757    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kpdwn" event={"ID":"19a42a98-1c5a-408c-ada9-b45208264b32","Type":"ContainerDied","Data":"62a32145f8fdcc0e5c7bf0638fde315949f9cfd6d7b905d294ce5167b648a511"}
Jul 13 20:58:48.540428 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:48.540384    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-m6p8g" podStartSLOduration=2.244905203 podStartE2EDuration="3.540367719s" totalImagesPullingTime="1.295462516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:58:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:58:48.539272387 +0000 UTC m=+301.534055810" watchObservedRunningTime="2026-07-13 20:58:48.540367719 +0000 UTC m=+301.535151137"
Jul 13 20:58:48.854206 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:48.854112    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:48.957387 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:48.957354    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:49.057986 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:49.057955    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:49.317318 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:49.317280    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:49.393952 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:49.393925    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:49.529602 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:49.529564    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kpdwn" event={"ID":"19a42a98-1c5a-408c-ada9-b45208264b32","Type":"ContainerStarted","Data":"0b7abbd6d8a67e4933d5b2b650ea426efad0feb1b355f53dd29a731ebac1d2a6"}
Jul 13 20:58:49.530112 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:49.529630    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kpdwn" event={"ID":"19a42a98-1c5a-408c-ada9-b45208264b32","Type":"ContainerStarted","Data":"f1204fd44970014cd221b4986ac0f5790439c440bb1399d6970dab52d9052923"}
Jul 13 20:58:49.552394 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:49.552338    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kpdwn" podStartSLOduration=3.53367641 podStartE2EDuration="4.552290574s" totalImagesPullingTime="949.185696ms" totalInitContainerRuntime="69.428468ms" isStatefulPod=true podCreationTimestamp="2026-07-13 20:58:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:58:49.551263937 +0000 UTC m=+302.546047370" watchObservedRunningTime="2026-07-13 20:58:49.552290574 +0000 UTC m=+302.547073999"
Jul 13 20:58:50.308026 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:50.307991    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-96c65986d-8wdjn"]
Jul 13 20:58:50.312226 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:50.312197    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-96c65986d-8wdjn"
Jul 13 20:58:50.315101 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:50.315078    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-8utcntl0ic10j\""
Jul 13 20:58:50.316400 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:50.316382    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 13 20:58:50.316517 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:50.316428    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 13 20:58:50.316517 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:50.316483    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 13 20:58:50.316646 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:50.316527    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 13 20:58:50.316765 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:50.316748    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-56ts2\""
Jul 13 20:58:50.321643 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:50.321619    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-96c65986d-8wdjn"]
Jul 13 20:58:50.336549 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:50.336527    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:50.388557 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:50.388528    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a89131c1-1724-4d27-b4d5-7e827e2f4159-secret-metrics-server-client-certs\") pod \"metrics-server-96c65986d-8wdjn\" (UID: \"a89131c1-1724-4d27-b4d5-7e827e2f4159\") " pod="openshift-monitoring/metrics-server-96c65986d-8wdjn"
Jul 13 20:58:50.388663 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:50.388577    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a89131c1-1724-4d27-b4d5-7e827e2f4159-metrics-server-audit-profiles\") pod \"metrics-server-96c65986d-8wdjn\" (UID: \"a89131c1-1724-4d27-b4d5-7e827e2f4159\") " pod="openshift-monitoring/metrics-server-96c65986d-8wdjn"
Jul 13 20:58:50.388663 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:50.388597    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a89131c1-1724-4d27-b4d5-7e827e2f4159-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-96c65986d-8wdjn\" (UID: \"a89131c1-1724-4d27-b4d5-7e827e2f4159\") " pod="openshift-monitoring/metrics-server-96c65986d-8wdjn"
Jul 13 20:58:50.388663 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:50.388646    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a89131c1-1724-4d27-b4d5-7e827e2f4159-secret-metrics-server-tls\") pod \"metrics-server-96c65986d-8wdjn\" (UID: \"a89131c1-1724-4d27-b4d5-7e827e2f4159\") " pod="openshift-monitoring/metrics-server-96c65986d-8wdjn"
Jul 13 20:58:50.388767 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:50.388668    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a89131c1-1724-4d27-b4d5-7e827e2f4159-audit-log\") pod \"metrics-server-96c65986d-8wdjn\" (UID: \"a89131c1-1724-4d27-b4d5-7e827e2f4159\") " pod="openshift-monitoring/metrics-server-96c65986d-8wdjn"
Jul 13 20:58:50.388767 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:50.388698    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98rw2\" (UniqueName: \"kubernetes.io/projected/a89131c1-1724-4d27-b4d5-7e827e2f4159-kube-api-access-98rw2\") pod \"metrics-server-96c65986d-8wdjn\" (UID: \"a89131c1-1724-4d27-b4d5-7e827e2f4159\") " pod="openshift-monitoring/metrics-server-96c65986d-8wdjn"
Jul 13 20:58:50.388767 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:50.388714    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a89131c1-1724-4d27-b4d5-7e827e2f4159-client-ca-bundle\") pod \"metrics-server-96c65986d-8wdjn\" (UID: \"a89131c1-1724-4d27-b4d5-7e827e2f4159\") " pod="openshift-monitoring/metrics-server-96c65986d-8wdjn"
Jul 13 20:58:50.437560 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:50.437535    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:50.489834 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:50.489784    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a89131c1-1724-4d27-b4d5-7e827e2f4159-audit-log\") pod \"metrics-server-96c65986d-8wdjn\" (UID: \"a89131c1-1724-4d27-b4d5-7e827e2f4159\") " pod="openshift-monitoring/metrics-server-96c65986d-8wdjn"
Jul 13 20:58:50.489950 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:50.489846    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98rw2\" (UniqueName: \"kubernetes.io/projected/a89131c1-1724-4d27-b4d5-7e827e2f4159-kube-api-access-98rw2\") pod \"metrics-server-96c65986d-8wdjn\" (UID: \"a89131c1-1724-4d27-b4d5-7e827e2f4159\") " pod="openshift-monitoring/metrics-server-96c65986d-8wdjn"
Jul 13 20:58:50.489950 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:50.489871    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a89131c1-1724-4d27-b4d5-7e827e2f4159-client-ca-bundle\") pod \"metrics-server-96c65986d-8wdjn\" (UID: \"a89131c1-1724-4d27-b4d5-7e827e2f4159\") " pod="openshift-monitoring/metrics-server-96c65986d-8wdjn"
Jul 13 20:58:50.489950 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:50.489899    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a89131c1-1724-4d27-b4d5-7e827e2f4159-secret-metrics-server-client-certs\") pod \"metrics-server-96c65986d-8wdjn\" (UID: \"a89131c1-1724-4d27-b4d5-7e827e2f4159\") " pod="openshift-monitoring/metrics-server-96c65986d-8wdjn"
Jul 13 20:58:50.489950 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:50.489932    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a89131c1-1724-4d27-b4d5-7e827e2f4159-metrics-server-audit-profiles\") pod \"metrics-server-96c65986d-8wdjn\" (UID: \"a89131c1-1724-4d27-b4d5-7e827e2f4159\") " pod="openshift-monitoring/metrics-server-96c65986d-8wdjn"
Jul 13 20:58:50.489950 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:50.489952    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a89131c1-1724-4d27-b4d5-7e827e2f4159-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-96c65986d-8wdjn\" (UID: \"a89131c1-1724-4d27-b4d5-7e827e2f4159\") " pod="openshift-monitoring/metrics-server-96c65986d-8wdjn"
Jul 13 20:58:50.490216 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:50.490067    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a89131c1-1724-4d27-b4d5-7e827e2f4159-secret-metrics-server-tls\") pod \"metrics-server-96c65986d-8wdjn\" (UID: \"a89131c1-1724-4d27-b4d5-7e827e2f4159\") " pod="openshift-monitoring/metrics-server-96c65986d-8wdjn"
Jul 13 20:58:50.490275 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:50.490251    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a89131c1-1724-4d27-b4d5-7e827e2f4159-audit-log\") pod \"metrics-server-96c65986d-8wdjn\" (UID: \"a89131c1-1724-4d27-b4d5-7e827e2f4159\") " pod="openshift-monitoring/metrics-server-96c65986d-8wdjn"
Jul 13 20:58:50.490765 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:50.490739    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a89131c1-1724-4d27-b4d5-7e827e2f4159-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-96c65986d-8wdjn\" (UID: \"a89131c1-1724-4d27-b4d5-7e827e2f4159\") " pod="openshift-monitoring/metrics-server-96c65986d-8wdjn"
Jul 13 20:58:50.491009 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:50.490991    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a89131c1-1724-4d27-b4d5-7e827e2f4159-metrics-server-audit-profiles\") pod \"metrics-server-96c65986d-8wdjn\" (UID: \"a89131c1-1724-4d27-b4d5-7e827e2f4159\") " pod="openshift-monitoring/metrics-server-96c65986d-8wdjn"
Jul 13 20:58:50.492440 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:50.492415    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a89131c1-1724-4d27-b4d5-7e827e2f4159-client-ca-bundle\") pod \"metrics-server-96c65986d-8wdjn\" (UID: \"a89131c1-1724-4d27-b4d5-7e827e2f4159\") " pod="openshift-monitoring/metrics-server-96c65986d-8wdjn"
Jul 13 20:58:50.492534 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:50.492448    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a89131c1-1724-4d27-b4d5-7e827e2f4159-secret-metrics-server-tls\") pod \"metrics-server-96c65986d-8wdjn\" (UID: \"a89131c1-1724-4d27-b4d5-7e827e2f4159\") " pod="openshift-monitoring/metrics-server-96c65986d-8wdjn"
Jul 13 20:58:50.492594 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:50.492562    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a89131c1-1724-4d27-b4d5-7e827e2f4159-secret-metrics-server-client-certs\") pod \"metrics-server-96c65986d-8wdjn\" (UID: \"a89131c1-1724-4d27-b4d5-7e827e2f4159\") " pod="openshift-monitoring/metrics-server-96c65986d-8wdjn"
Jul 13 20:58:50.497768 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:50.497746    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98rw2\" (UniqueName: \"kubernetes.io/projected/a89131c1-1724-4d27-b4d5-7e827e2f4159-kube-api-access-98rw2\") pod \"metrics-server-96c65986d-8wdjn\" (UID: \"a89131c1-1724-4d27-b4d5-7e827e2f4159\") " pod="openshift-monitoring/metrics-server-96c65986d-8wdjn"
Jul 13 20:58:50.622680 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:50.622593    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-96c65986d-8wdjn"
Jul 13 20:58:50.736276 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:50.736244    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:50.769422 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:50.769388    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-96c65986d-8wdjn"]
Jul 13 20:58:50.772469 ip-10-0-137-162 kubenswrapper[2561]: W0713 20:58:50.772441    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda89131c1_1724_4d27_b4d5_7e827e2f4159.slice/crio-9233d097967e737ffbfdfcfef0c808a58077e74b362f666aea3394d53b7e8511 WatchSource:0}: Error finding container 9233d097967e737ffbfdfcfef0c808a58077e74b362f666aea3394d53b7e8511: Status 404 returned error can't find the container with id 9233d097967e737ffbfdfcfef0c808a58077e74b362f666aea3394d53b7e8511
Jul 13 20:58:50.774993 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:50.774975    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 20:58:50.804393 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:50.804359    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:51.205478 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:51.205447    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:51.537536 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:51.537463    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-96c65986d-8wdjn" event={"ID":"a89131c1-1724-4d27-b4d5-7e827e2f4159","Type":"ContainerStarted","Data":"9233d097967e737ffbfdfcfef0c808a58077e74b362f666aea3394d53b7e8511"}
Jul 13 20:58:52.197360 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:52.197328    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:52.298774 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:52.298750    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:52.542127 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:52.542089    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-96c65986d-8wdjn" event={"ID":"a89131c1-1724-4d27-b4d5-7e827e2f4159","Type":"ContainerStarted","Data":"75640e3ded004ce304a50a9b6d1ab02025ee6595a0448f15e301bf89cf6fec53"}
Jul 13 20:58:52.561297 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:52.561235    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-96c65986d-8wdjn" podStartSLOduration=1.083675184 podStartE2EDuration="2.561215153s" totalImagesPullingTime="1.477539969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:58:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:58:52.560823976 +0000 UTC m=+305.555607391" watchObservedRunningTime="2026-07-13 20:58:52.561215153 +0000 UTC m=+305.555998576"
Jul 13 20:58:53.521114 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:53.521083    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:53.621902 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:53.621863    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:54.029225 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:54.029195    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:54.126941 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:54.126871    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:54.180703 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:54.180674    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:54.571534 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:54.571507    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhvrj"
Jul 13 20:58:58.486647 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:58.486607    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7df4bb85c-kbm7x"
Jul 13 20:58:58.618008 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:58.617959    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:58.670464 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:58:58.670434    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:59:01.729218 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:59:01.729177    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:59:01.829748 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:59:01.829711    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:59:06.517838 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:59:06.517788    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:59:06.571933 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:59:06.571880    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:59:10.623459 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:59:10.623426    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-96c65986d-8wdjn"
Jul 13 20:59:10.623858 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:59:10.623484    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-96c65986d-8wdjn"
Jul 13 20:59:11.972083 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:59:11.972049    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:59:12.073484 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:59:12.073454    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:59:15.404068 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:59:15.403999    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:59:15.469524 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:59:15.469489    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:59:18.205582 ip-10-0-137-162 kubenswrapper[2561]: E0713 20:59:18.205551    2561 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2de3328b_2c94_4b08_8b71_42d1afa5cfdf.slice/crio-7b1bec55491ac0fd359dda9f4a600b57968019f0f8b8732e29b767da571f3da6.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2de3328b_2c94_4b08_8b71_42d1afa5cfdf.slice/crio-conmon-7b1bec55491ac0fd359dda9f4a600b57968019f0f8b8732e29b767da571f3da6.scope\": RecentStats: unable to find data in memory cache]"
Jul 13 20:59:18.628741 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:59:18.628706    2561 generic.go:356] "Generic (PLEG): container finished" podID="2de3328b-2c94-4b08-8b71-42d1afa5cfdf" containerID="7b1bec55491ac0fd359dda9f4a600b57968019f0f8b8732e29b767da571f3da6" exitCode=0
Jul 13 20:59:18.628913 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:59:18.628757    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-mfnxm" event={"ID":"2de3328b-2c94-4b08-8b71-42d1afa5cfdf","Type":"ContainerDied","Data":"7b1bec55491ac0fd359dda9f4a600b57968019f0f8b8732e29b767da571f3da6"}
Jul 13 20:59:18.629086 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:59:18.629072    2561 scope.go:117] "RemoveContainer" containerID="7b1bec55491ac0fd359dda9f4a600b57968019f0f8b8732e29b767da571f3da6"
Jul 13 20:59:19.634191 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:59:19.634157    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-mfnxm" event={"ID":"2de3328b-2c94-4b08-8b71-42d1afa5cfdf","Type":"ContainerStarted","Data":"bc4668443a26579381931252ade68c69cb4fb667e82abdf8f08cc23535554be2"}
Jul 13 20:59:22.444024 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:59:22.443988    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:59:22.529266 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:59:22.529231    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:59:30.628503 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:59:30.628469    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-96c65986d-8wdjn"
Jul 13 20:59:30.632314 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:59:30.632290    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-96c65986d-8wdjn"
Jul 13 20:59:37.411013 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:59:37.410975    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:59:37.464432 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:59:37.464404    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:59:59.339010 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:59:59.338969    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 20:59:59.414426 ip-10-0-137-162 kubenswrapper[2561]: I0713 20:59:59.414391    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:00:01.403246 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:00:01.403215    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8608f034-4011-42c3-b0ee-1369e8afa709-metrics-certs\") pod \"network-metrics-daemon-zhvrj\" (UID: \"8608f034-4011-42c3-b0ee-1369e8afa709\") " pod="openshift-multus/network-metrics-daemon-zhvrj"
Jul 13 21:00:01.405578 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:00:01.405553    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8608f034-4011-42c3-b0ee-1369e8afa709-metrics-certs\") pod \"network-metrics-daemon-zhvrj\" (UID: \"8608f034-4011-42c3-b0ee-1369e8afa709\") " pod="openshift-multus/network-metrics-daemon-zhvrj"
Jul 13 21:00:01.475394 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:00:01.475367    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-plnw6\""
Jul 13 21:00:01.483692 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:00:01.483673    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zhvrj"
Jul 13 21:00:01.605770 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:00:01.605601    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zhvrj"]
Jul 13 21:00:01.608342 ip-10-0-137-162 kubenswrapper[2561]: W0713 21:00:01.608313    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8608f034_4011_42c3_b0ee_1369e8afa709.slice/crio-2b010df870b130efe61cad79c37bf3d66f176eb649e36be690aa782531265d3d WatchSource:0}: Error finding container 2b010df870b130efe61cad79c37bf3d66f176eb649e36be690aa782531265d3d: Status 404 returned error can't find the container with id 2b010df870b130efe61cad79c37bf3d66f176eb649e36be690aa782531265d3d
Jul 13 21:00:01.772300 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:00:01.772268    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zhvrj" event={"ID":"8608f034-4011-42c3-b0ee-1369e8afa709","Type":"ContainerStarted","Data":"2b010df870b130efe61cad79c37bf3d66f176eb649e36be690aa782531265d3d"}
Jul 13 21:00:03.780530 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:00:03.780494    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zhvrj" event={"ID":"8608f034-4011-42c3-b0ee-1369e8afa709","Type":"ContainerStarted","Data":"3b8a6c7e11594368547c11d6512af7ebd4fe82d17718567aef420dd0980cca8a"}
Jul 13 21:00:03.781056 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:00:03.780562    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zhvrj" event={"ID":"8608f034-4011-42c3-b0ee-1369e8afa709","Type":"ContainerStarted","Data":"e89d8d94e270d669f081280173fc8d88c40b6ea641cfc1000f1332704019a624"}
Jul 13 21:00:03.796920 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:00:03.796865    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zhvrj" podStartSLOduration=375.178736017 podStartE2EDuration="6m16.796848238s" totalImagesPullingTime="1.618112221s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:53:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:00:03.796428949 +0000 UTC m=+376.791212383" watchObservedRunningTime="2026-07-13 21:00:03.796848238 +0000 UTC m=+376.791631662"
Jul 13 21:00:03.878480 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:00:03.878443    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:00:03.932595 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:00:03.932529    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:00:05.139439 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:00:05.139390    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:00:05.340867 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:00:05.340836    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:00:14.880163 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:00:14.880124    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:00:14.929635 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:00:14.929593    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:00:15.027799 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:00:15.027767    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:00:15.080493 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:00:15.080445    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:00:15.624772 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:00:15.624739    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:00:15.726444 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:00:15.726405    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:00:16.009571 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:00:16.009495    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:00:16.110300 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:00:16.110274    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:00:26.106157 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:00:26.106114    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:00:26.161860 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:00:26.161797    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:00:26.403457 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:00:26.403375    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:00:54.468904 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:00:54.468869    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:00:54.520530 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:00:54.520497    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:01:20.457761 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:01:20.457724    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:01:20.530958 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:01:20.530926    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:01:20.936833 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:01:20.936787    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:01:30.515703 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:01:30.515670    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:01:30.581179 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:01:30.581147    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:01:32.372998 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:01:32.372961    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:01:32.432739 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:01:32.432713    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:01:37.417025 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:01:37.416979    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:01:37.517950 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:01:37.517917    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:01:37.726742 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:01:37.726650    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:01:39.003874 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:01:39.003835    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:01:41.621120 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:01:41.621085    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:01:41.724127 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:01:41.724095    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:02:38.742448 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:02:38.742418    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:02:38.841723 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:02:38.841695    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:03:05.756369 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:05.756340    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:03:07.223648 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:07.223615    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:03:09.587066 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:09.587033    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:03:09.687696 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:09.687659    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:03:11.090777 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:11.090744    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:03:11.297456 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:11.297422    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:03:11.826326 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:11.826296    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:03:12.068217 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:12.068181    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:03:15.277689 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:15.277658    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:03:15.362994 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:15.362960    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:03:16.335248 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:16.335206    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:03:16.462088 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:16.462050    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:03:20.002947 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:20.002910    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-kgcn6"]
Jul 13 21:03:20.004982 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:20.004960    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-kgcn6"
Jul 13 21:03:20.008457 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:20.008434    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-tjcp8\""
Jul 13 21:03:20.009391 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:20.009373    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 13 21:03:20.009442 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:20.009394    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 13 21:03:20.018653 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:20.018628    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-kgcn6"]
Jul 13 21:03:20.177455 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:20.177423    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b20d0bfd-f5e2-45bf-af48-2a95048b2b1c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-kgcn6\" (UID: \"b20d0bfd-f5e2-45bf-af48-2a95048b2b1c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kgcn6"
Jul 13 21:03:20.177625 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:20.177477    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npwzz\" (UniqueName: \"kubernetes.io/projected/b20d0bfd-f5e2-45bf-af48-2a95048b2b1c-kube-api-access-npwzz\") pod \"cert-manager-webhook-6486ffd997-kgcn6\" (UID: \"b20d0bfd-f5e2-45bf-af48-2a95048b2b1c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kgcn6"
Jul 13 21:03:20.278732 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:20.278706    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npwzz\" (UniqueName: \"kubernetes.io/projected/b20d0bfd-f5e2-45bf-af48-2a95048b2b1c-kube-api-access-npwzz\") pod \"cert-manager-webhook-6486ffd997-kgcn6\" (UID: \"b20d0bfd-f5e2-45bf-af48-2a95048b2b1c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kgcn6"
Jul 13 21:03:20.278877 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:20.278760    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b20d0bfd-f5e2-45bf-af48-2a95048b2b1c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-kgcn6\" (UID: \"b20d0bfd-f5e2-45bf-af48-2a95048b2b1c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kgcn6"
Jul 13 21:03:20.289324 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:20.289292    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b20d0bfd-f5e2-45bf-af48-2a95048b2b1c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-kgcn6\" (UID: \"b20d0bfd-f5e2-45bf-af48-2a95048b2b1c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kgcn6"
Jul 13 21:03:20.289435 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:20.289423    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npwzz\" (UniqueName: \"kubernetes.io/projected/b20d0bfd-f5e2-45bf-af48-2a95048b2b1c-kube-api-access-npwzz\") pod \"cert-manager-webhook-6486ffd997-kgcn6\" (UID: \"b20d0bfd-f5e2-45bf-af48-2a95048b2b1c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kgcn6"
Jul 13 21:03:20.313421 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:20.313399    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-kgcn6"
Jul 13 21:03:20.440346 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:20.440319    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-kgcn6"]
Jul 13 21:03:20.444685 ip-10-0-137-162 kubenswrapper[2561]: W0713 21:03:20.444658    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb20d0bfd_f5e2_45bf_af48_2a95048b2b1c.slice/crio-13e655d03f50530b7166a613e8c3a90a51709b85ea7afbcc3158151402263b79 WatchSource:0}: Error finding container 13e655d03f50530b7166a613e8c3a90a51709b85ea7afbcc3158151402263b79: Status 404 returned error can't find the container with id 13e655d03f50530b7166a613e8c3a90a51709b85ea7afbcc3158151402263b79
Jul 13 21:03:21.445519 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:21.445480    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-kgcn6" event={"ID":"b20d0bfd-f5e2-45bf-af48-2a95048b2b1c","Type":"ContainerStarted","Data":"13e655d03f50530b7166a613e8c3a90a51709b85ea7afbcc3158151402263b79"}
Jul 13 21:03:21.718698 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:21.718577    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:03:23.454206 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:23.454161    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-kgcn6" event={"ID":"b20d0bfd-f5e2-45bf-af48-2a95048b2b1c","Type":"ContainerStarted","Data":"94d33f7e1a4fa6cb4800dacd69252fc8cfd7b48d1316f27554305c6d33dd0119"}
Jul 13 21:03:23.454571 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:23.454278    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-kgcn6"
Jul 13 21:03:23.496231 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:23.496180    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-kgcn6" podStartSLOduration=1.56305761 podStartE2EDuration="4.496163698s" totalImagesPullingTime="2.933106088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:03:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:03:23.495976307 +0000 UTC m=+576.490759730" watchObservedRunningTime="2026-07-13 21:03:23.496163698 +0000 UTC m=+576.490947120"
Jul 13 21:03:23.653761 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:23.653674    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:03:27.741514 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:27.741484    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:03:29.459805 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:29.459772    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-kgcn6"
Jul 13 21:03:30.736099 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:30.736069    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:03:30.836964 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:30.836928    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:03:32.287462 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:32.287430    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:03:44.713108 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:44.713073    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:03:44.945678 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:44.945641    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:03:45.285041 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:45.285005    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:03:45.741476 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:45.741399    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:03:45.858376 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:45.858343    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:03:45.894920 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:45.894892    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fdc557c48-vjq6w"]
Jul 13 21:03:45.898415 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:45.898397    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6fdc557c48-vjq6w"
Jul 13 21:03:45.902513 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:45.902497    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 13 21:03:45.903005 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:45.902976    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 13 21:03:45.903106 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:45.903028    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6zt5p\""
Jul 13 21:03:45.903106 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:45.903017    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 13 21:03:45.903379 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:45.903366    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 13 21:03:45.924569 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:45.924548    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fdc557c48-vjq6w"]
Jul 13 21:03:45.970398 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:45.970371    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c051e6d4-4446-4d42-ab4c-fc87fea77233-manifests\") pod \"opendatahub-operator-controller-manager-6fdc557c48-vjq6w\" (UID: \"c051e6d4-4446-4d42-ab4c-fc87fea77233\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdc557c48-vjq6w"
Jul 13 21:03:45.970547 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:45.970435    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c051e6d4-4446-4d42-ab4c-fc87fea77233-tmp\") pod \"opendatahub-operator-controller-manager-6fdc557c48-vjq6w\" (UID: \"c051e6d4-4446-4d42-ab4c-fc87fea77233\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdc557c48-vjq6w"
Jul 13 21:03:45.970547 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:45.970489    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c051e6d4-4446-4d42-ab4c-fc87fea77233-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fdc557c48-vjq6w\" (UID: \"c051e6d4-4446-4d42-ab4c-fc87fea77233\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdc557c48-vjq6w"
Jul 13 21:03:45.970547 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:45.970517    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c051e6d4-4446-4d42-ab4c-fc87fea77233-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fdc557c48-vjq6w\" (UID: \"c051e6d4-4446-4d42-ab4c-fc87fea77233\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdc557c48-vjq6w"
Jul 13 21:03:45.970675 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:45.970565    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxjk9\" (UniqueName: \"kubernetes.io/projected/c051e6d4-4446-4d42-ab4c-fc87fea77233-kube-api-access-xxjk9\") pod \"opendatahub-operator-controller-manager-6fdc557c48-vjq6w\" (UID: \"c051e6d4-4446-4d42-ab4c-fc87fea77233\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdc557c48-vjq6w"
Jul 13 21:03:46.071315 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:46.071289    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxjk9\" (UniqueName: \"kubernetes.io/projected/c051e6d4-4446-4d42-ab4c-fc87fea77233-kube-api-access-xxjk9\") pod \"opendatahub-operator-controller-manager-6fdc557c48-vjq6w\" (UID: \"c051e6d4-4446-4d42-ab4c-fc87fea77233\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdc557c48-vjq6w"
Jul 13 21:03:46.071484 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:46.071327    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c051e6d4-4446-4d42-ab4c-fc87fea77233-manifests\") pod \"opendatahub-operator-controller-manager-6fdc557c48-vjq6w\" (UID: \"c051e6d4-4446-4d42-ab4c-fc87fea77233\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdc557c48-vjq6w"
Jul 13 21:03:46.071484 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:46.071361    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c051e6d4-4446-4d42-ab4c-fc87fea77233-tmp\") pod \"opendatahub-operator-controller-manager-6fdc557c48-vjq6w\" (UID: \"c051e6d4-4446-4d42-ab4c-fc87fea77233\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdc557c48-vjq6w"
Jul 13 21:03:46.071484 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:46.071386    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c051e6d4-4446-4d42-ab4c-fc87fea77233-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fdc557c48-vjq6w\" (UID: \"c051e6d4-4446-4d42-ab4c-fc87fea77233\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdc557c48-vjq6w"
Jul 13 21:03:46.071484 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:46.071410    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c051e6d4-4446-4d42-ab4c-fc87fea77233-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fdc557c48-vjq6w\" (UID: \"c051e6d4-4446-4d42-ab4c-fc87fea77233\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdc557c48-vjq6w"
Jul 13 21:03:46.071771 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:46.071747    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c051e6d4-4446-4d42-ab4c-fc87fea77233-manifests\") pod \"opendatahub-operator-controller-manager-6fdc557c48-vjq6w\" (UID: \"c051e6d4-4446-4d42-ab4c-fc87fea77233\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdc557c48-vjq6w"
Jul 13 21:03:46.073610 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:46.073579    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c051e6d4-4446-4d42-ab4c-fc87fea77233-tmp\") pod \"opendatahub-operator-controller-manager-6fdc557c48-vjq6w\" (UID: \"c051e6d4-4446-4d42-ab4c-fc87fea77233\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdc557c48-vjq6w"
Jul 13 21:03:46.073727 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:46.073704    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c051e6d4-4446-4d42-ab4c-fc87fea77233-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fdc557c48-vjq6w\" (UID: \"c051e6d4-4446-4d42-ab4c-fc87fea77233\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdc557c48-vjq6w"
Jul 13 21:03:46.073950 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:46.073930    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c051e6d4-4446-4d42-ab4c-fc87fea77233-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fdc557c48-vjq6w\" (UID: \"c051e6d4-4446-4d42-ab4c-fc87fea77233\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdc557c48-vjq6w"
Jul 13 21:03:46.084442 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:46.084425    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxjk9\" (UniqueName: \"kubernetes.io/projected/c051e6d4-4446-4d42-ab4c-fc87fea77233-kube-api-access-xxjk9\") pod \"opendatahub-operator-controller-manager-6fdc557c48-vjq6w\" (UID: \"c051e6d4-4446-4d42-ab4c-fc87fea77233\") " pod="opendatahub/opendatahub-operator-controller-manager-6fdc557c48-vjq6w"
Jul 13 21:03:46.187960 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:46.187930    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:03:46.208518 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:46.208494    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6fdc557c48-vjq6w"
Jul 13 21:03:46.343499 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:46.343421    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fdc557c48-vjq6w"]
Jul 13 21:03:46.346617 ip-10-0-137-162 kubenswrapper[2561]: W0713 21:03:46.346589    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc051e6d4_4446_4d42_ab4c_fc87fea77233.slice/crio-a617ae740ed57d09f6bc7e7d3326737e2c6106dc4da40cd4647d7fd5bb7d9fc0 WatchSource:0}: Error finding container a617ae740ed57d09f6bc7e7d3326737e2c6106dc4da40cd4647d7fd5bb7d9fc0: Status 404 returned error can't find the container with id a617ae740ed57d09f6bc7e7d3326737e2c6106dc4da40cd4647d7fd5bb7d9fc0
Jul 13 21:03:46.533063 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:46.533033    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fdc557c48-vjq6w" event={"ID":"c051e6d4-4446-4d42-ab4c-fc87fea77233","Type":"ContainerStarted","Data":"a617ae740ed57d09f6bc7e7d3326737e2c6106dc4da40cd4647d7fd5bb7d9fc0"}
Jul 13 21:03:46.913118 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:46.913086    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:03:46.990263 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:46.990236    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:03:47.685599 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:47.685496    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jrpbd_e730eed8-ff8a-4a54-b1cb-539d8f07e70b/ovn-acl-logging/0.log"
Jul 13 21:03:47.690808 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:47.686221    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jrpbd_e730eed8-ff8a-4a54-b1cb-539d8f07e70b/ovn-acl-logging/0.log"
Jul 13 21:03:49.546375 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:49.546347    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fdc557c48-vjq6w" event={"ID":"c051e6d4-4446-4d42-ab4c-fc87fea77233","Type":"ContainerStarted","Data":"22c24a1efb6b3851dcb1046bfae07eb307d61de8772f393462b82695c302bbdb"}
Jul 13 21:03:51.554480 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:51.554437    2561 generic.go:356] "Generic (PLEG): container finished" podID="c051e6d4-4446-4d42-ab4c-fc87fea77233" containerID="22c24a1efb6b3851dcb1046bfae07eb307d61de8772f393462b82695c302bbdb" exitCode=0
Jul 13 21:03:51.554885 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:51.554512    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fdc557c48-vjq6w" event={"ID":"c051e6d4-4446-4d42-ab4c-fc87fea77233","Type":"ContainerDied","Data":"22c24a1efb6b3851dcb1046bfae07eb307d61de8772f393462b82695c302bbdb"}
Jul 13 21:03:51.555123 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:51.555106    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 21:03:52.561440 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:52.561403    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fdc557c48-vjq6w" event={"ID":"c051e6d4-4446-4d42-ab4c-fc87fea77233","Type":"ContainerStarted","Data":"afe08eb6adebd8f2586d7f9ae32ee8dd168d77f555754b7299677419c3e86a15"}
Jul 13 21:03:52.561946 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:52.561643    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6fdc557c48-vjq6w"
Jul 13 21:03:52.586340 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:03:52.586296    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6fdc557c48-vjq6w" podStartSLOduration=3.146733466 podStartE2EDuration="7.586282039s" totalImagesPullingTime="3.414614412s" totalInitContainerRuntime="1.024934161s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:03:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:03:52.583877748 +0000 UTC m=+605.578661172" watchObservedRunningTime="2026-07-13 21:03:52.586282039 +0000 UTC m=+605.581065489"
Jul 13 21:04:03.567863 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:03.567830    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6fdc557c48-vjq6w"
Jul 13 21:04:04.301021 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:04.300986    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:04:04.359328 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:04.359292    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f779bff78-tc4pq"]
Jul 13 21:04:04.367804 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:04.367772    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5f779bff78-tc4pq"
Jul 13 21:04:04.370499 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:04.370456    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 13 21:04:04.371863 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:04.371846    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 13 21:04:04.371944 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:04.371806    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 13 21:04:04.371944 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:04.371893    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 13 21:04:04.371944 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:04.371852    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-8xzqm\""
Jul 13 21:04:04.371944 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:04.371852    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 13 21:04:04.376716 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:04.376696    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f779bff78-tc4pq"]
Jul 13 21:04:04.377101 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:04.377076    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:04:04.521569 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:04.521530    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/892c3f40-ff45-4748-a82d-6cff5ddbcf83-manager-config\") pod \"lws-controller-manager-5f779bff78-tc4pq\" (UID: \"892c3f40-ff45-4748-a82d-6cff5ddbcf83\") " pod="openshift-lws-operator/lws-controller-manager-5f779bff78-tc4pq"
Jul 13 21:04:04.521569 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:04.521569    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5gqk\" (UniqueName: \"kubernetes.io/projected/892c3f40-ff45-4748-a82d-6cff5ddbcf83-kube-api-access-n5gqk\") pod \"lws-controller-manager-5f779bff78-tc4pq\" (UID: \"892c3f40-ff45-4748-a82d-6cff5ddbcf83\") " pod="openshift-lws-operator/lws-controller-manager-5f779bff78-tc4pq"
Jul 13 21:04:04.521780 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:04.521605    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/892c3f40-ff45-4748-a82d-6cff5ddbcf83-metrics-cert\") pod \"lws-controller-manager-5f779bff78-tc4pq\" (UID: \"892c3f40-ff45-4748-a82d-6cff5ddbcf83\") " pod="openshift-lws-operator/lws-controller-manager-5f779bff78-tc4pq"
Jul 13 21:04:04.521780 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:04.521646    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/892c3f40-ff45-4748-a82d-6cff5ddbcf83-cert\") pod \"lws-controller-manager-5f779bff78-tc4pq\" (UID: \"892c3f40-ff45-4748-a82d-6cff5ddbcf83\") " pod="openshift-lws-operator/lws-controller-manager-5f779bff78-tc4pq"
Jul 13 21:04:04.622439 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:04.622353    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/892c3f40-ff45-4748-a82d-6cff5ddbcf83-metrics-cert\") pod \"lws-controller-manager-5f779bff78-tc4pq\" (UID: \"892c3f40-ff45-4748-a82d-6cff5ddbcf83\") " pod="openshift-lws-operator/lws-controller-manager-5f779bff78-tc4pq"
Jul 13 21:04:04.622439 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:04.622391    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/892c3f40-ff45-4748-a82d-6cff5ddbcf83-cert\") pod \"lws-controller-manager-5f779bff78-tc4pq\" (UID: \"892c3f40-ff45-4748-a82d-6cff5ddbcf83\") " pod="openshift-lws-operator/lws-controller-manager-5f779bff78-tc4pq"
Jul 13 21:04:04.622889 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:04.622457    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/892c3f40-ff45-4748-a82d-6cff5ddbcf83-manager-config\") pod \"lws-controller-manager-5f779bff78-tc4pq\" (UID: \"892c3f40-ff45-4748-a82d-6cff5ddbcf83\") " pod="openshift-lws-operator/lws-controller-manager-5f779bff78-tc4pq"
Jul 13 21:04:04.622889 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:04.622485    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5gqk\" (UniqueName: \"kubernetes.io/projected/892c3f40-ff45-4748-a82d-6cff5ddbcf83-kube-api-access-n5gqk\") pod \"lws-controller-manager-5f779bff78-tc4pq\" (UID: \"892c3f40-ff45-4748-a82d-6cff5ddbcf83\") " pod="openshift-lws-operator/lws-controller-manager-5f779bff78-tc4pq"
Jul 13 21:04:04.623201 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:04.623178    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/892c3f40-ff45-4748-a82d-6cff5ddbcf83-manager-config\") pod \"lws-controller-manager-5f779bff78-tc4pq\" (UID: \"892c3f40-ff45-4748-a82d-6cff5ddbcf83\") " pod="openshift-lws-operator/lws-controller-manager-5f779bff78-tc4pq"
Jul 13 21:04:04.624900 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:04.624882    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/892c3f40-ff45-4748-a82d-6cff5ddbcf83-metrics-cert\") pod \"lws-controller-manager-5f779bff78-tc4pq\" (UID: \"892c3f40-ff45-4748-a82d-6cff5ddbcf83\") " pod="openshift-lws-operator/lws-controller-manager-5f779bff78-tc4pq"
Jul 13 21:04:04.625006 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:04.624995    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/892c3f40-ff45-4748-a82d-6cff5ddbcf83-cert\") pod \"lws-controller-manager-5f779bff78-tc4pq\" (UID: \"892c3f40-ff45-4748-a82d-6cff5ddbcf83\") " pod="openshift-lws-operator/lws-controller-manager-5f779bff78-tc4pq"
Jul 13 21:04:04.630312 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:04.630292    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5gqk\" (UniqueName: \"kubernetes.io/projected/892c3f40-ff45-4748-a82d-6cff5ddbcf83-kube-api-access-n5gqk\") pod \"lws-controller-manager-5f779bff78-tc4pq\" (UID: \"892c3f40-ff45-4748-a82d-6cff5ddbcf83\") " pod="openshift-lws-operator/lws-controller-manager-5f779bff78-tc4pq"
Jul 13 21:04:04.678304 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:04.678279    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5f779bff78-tc4pq"
Jul 13 21:04:04.802994 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:04.802970    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f779bff78-tc4pq"]
Jul 13 21:04:04.805659 ip-10-0-137-162 kubenswrapper[2561]: W0713 21:04:04.805619    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod892c3f40_ff45_4748_a82d_6cff5ddbcf83.slice/crio-58fb1efa4e03be742ca8cd09db556c39320e016aae1de94de78162871c3c0a51 WatchSource:0}: Error finding container 58fb1efa4e03be742ca8cd09db556c39320e016aae1de94de78162871c3c0a51: Status 404 returned error can't find the container with id 58fb1efa4e03be742ca8cd09db556c39320e016aae1de94de78162871c3c0a51
Jul 13 21:04:05.607659 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:05.607588    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5f779bff78-tc4pq" event={"ID":"892c3f40-ff45-4748-a82d-6cff5ddbcf83","Type":"ContainerStarted","Data":"58fb1efa4e03be742ca8cd09db556c39320e016aae1de94de78162871c3c0a51"}
Jul 13 21:04:06.570158 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:06.570123    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:04:06.690507 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:06.690466    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:04:07.173643 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:07.173600    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:04:07.348683 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:07.348655    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:04:07.545326 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:07.545297    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:04:07.622566 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:07.622531    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5f779bff78-tc4pq" event={"ID":"892c3f40-ff45-4748-a82d-6cff5ddbcf83","Type":"ContainerStarted","Data":"3fe37ddb433bf21814f9ce80306c2b11a42e2b319215f56c8d7edcea615d13b4"}
Jul 13 21:04:07.623044 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:07.622654    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5f779bff78-tc4pq"
Jul 13 21:04:07.643762 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:07.643718    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5f779bff78-tc4pq" podStartSLOduration=1.186831428 podStartE2EDuration="3.643703561s" totalImagesPullingTime="2.456872133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:04:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:04:07.642400502 +0000 UTC m=+620.637183962" watchObservedRunningTime="2026-07-13 21:04:07.643703561 +0000 UTC m=+620.638486983"
Jul 13 21:04:07.648924 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:07.648902    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:04:07.754154 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:07.754117    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:04:07.849147 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:07.849066    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:04:08.376197 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:08.376170    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:04:08.787038 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:08.786992    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:04:08.857735 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:08.857702    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:04:09.172285 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:09.172176    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:04:09.792936 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:09.792903    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:04:14.655672 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:14.655640    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:04:14.755595 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:14.755561    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:04:15.303776 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:15.303741    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47x2rz"]
Jul 13 21:04:15.307177 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:15.307159    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47x2rz"
Jul 13 21:04:15.311604 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:15.311574    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-8fgsp\""
Jul 13 21:04:15.311604 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:15.311585    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 13 21:04:15.311775 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:15.311733    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 13 21:04:15.312782 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:15.312755    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 13 21:04:15.321956 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:15.321935    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47x2rz"]
Jul 13 21:04:15.331538 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:15.331514    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:04:15.413789 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:15.413758    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a391661d-64da-4614-abcb-c85464eeb57f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47x2rz\" (UID: \"a391661d-64da-4614-abcb-c85464eeb57f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47x2rz"
Jul 13 21:04:15.413789 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:15.413790    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a391661d-64da-4614-abcb-c85464eeb57f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47x2rz\" (UID: \"a391661d-64da-4614-abcb-c85464eeb57f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47x2rz"
Jul 13 21:04:15.414092 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:15.413836    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a391661d-64da-4614-abcb-c85464eeb57f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47x2rz\" (UID: \"a391661d-64da-4614-abcb-c85464eeb57f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47x2rz"
Jul 13 21:04:15.414092 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:15.413861    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kklzz\" (UniqueName: \"kubernetes.io/projected/a391661d-64da-4614-abcb-c85464eeb57f-kube-api-access-kklzz\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47x2rz\" (UID: \"a391661d-64da-4614-abcb-c85464eeb57f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47x2rz"
Jul 13 21:04:15.414092 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:15.413894    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a391661d-64da-4614-abcb-c85464eeb57f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47x2rz\" (UID: \"a391661d-64da-4614-abcb-c85464eeb57f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47x2rz"
Jul 13 21:04:15.414092 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:15.413949    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a391661d-64da-4614-abcb-c85464eeb57f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47x2rz\" (UID: \"a391661d-64da-4614-abcb-c85464eeb57f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47x2rz"
Jul 13 21:04:15.414092 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:15.413982    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a391661d-64da-4614-abcb-c85464eeb57f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47x2rz\" (UID: \"a391661d-64da-4614-abcb-c85464eeb57f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47x2rz"
Jul 13 21:04:15.414092 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:15.413996    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a391661d-64da-4614-abcb-c85464eeb57f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47x2rz\" (UID: \"a391661d-64da-4614-abcb-c85464eeb57f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47x2rz"
Jul 13 21:04:15.414092 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:15.414059    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a391661d-64da-4614-abcb-c85464eeb57f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47x2rz\" (UID: \"a391661d-64da-4614-abcb-c85464eeb57f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47x2rz"
Jul 13 21:04:15.515512 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:15.515475    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a391661d-64da-4614-abcb-c85464eeb57f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47x2rz\" (UID: \"a391661d-64da-4614-abcb-c85464eeb57f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47x2rz"
Jul 13 21:04:15.515512 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:15.515515    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a391661d-64da-4614-abcb-c85464eeb57f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47x2rz\" (UID: \"a391661d-64da-4614-abcb-c85464eeb57f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47x2rz"
Jul 13 21:04:15.515760 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:15.515648    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a391661d-64da-4614-abcb-c85464eeb57f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47x2rz\" (UID: \"a391661d-64da-4614-abcb-c85464eeb57f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47x2rz"
Jul 13 21:04:15.515760 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:15.515715    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a391661d-64da-4614-abcb-c85464eeb57f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47x2rz\" (UID: \"a391661d-64da-4614-abcb-c85464eeb57f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47x2rz"
Jul 13 21:04:15.515760 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:15.515737    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a391661d-64da-4614-abcb-c85464eeb57f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47x2rz\" (UID: \"a391661d-64da-4614-abcb-c85464eeb57f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47x2rz"
Jul 13 21:04:15.515946 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:15.515770    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a391661d-64da-4614-abcb-c85464eeb57f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47x2rz\" (UID: \"a391661d-64da-4614-abcb-c85464eeb57f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47x2rz"
Jul 13 21:04:15.515946 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:15.515795    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kklzz\" (UniqueName: \"kubernetes.io/projected/a391661d-64da-4614-abcb-c85464eeb57f-kube-api-access-kklzz\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47x2rz\" (UID: \"a391661d-64da-4614-abcb-c85464eeb57f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47x2rz"
Jul 13 21:04:15.515946 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:15.515846    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a391661d-64da-4614-abcb-c85464eeb57f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47x2rz\" (UID: \"a391661d-64da-4614-abcb-c85464eeb57f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47x2rz"
Jul 13 21:04:15.515946 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:15.515894    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a391661d-64da-4614-abcb-c85464eeb57f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47x2rz\" (UID: \"a391661d-64da-4614-abcb-c85464eeb57f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47x2rz"
Jul 13 21:04:15.516166 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:15.516098    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a391661d-64da-4614-abcb-c85464eeb57f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47x2rz\" (UID: \"a391661d-64da-4614-abcb-c85464eeb57f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47x2rz"
Jul 13 21:04:15.516166 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:15.516111    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a391661d-64da-4614-abcb-c85464eeb57f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47x2rz\" (UID: \"a391661d-64da-4614-abcb-c85464eeb57f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47x2rz"
Jul 13 21:04:15.516286 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:15.516198    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a391661d-64da-4614-abcb-c85464eeb57f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47x2rz\" (UID: \"a391661d-64da-4614-abcb-c85464eeb57f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47x2rz"
Jul 13 21:04:15.516351 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:15.516325    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a391661d-64da-4614-abcb-c85464eeb57f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47x2rz\" (UID: \"a391661d-64da-4614-abcb-c85464eeb57f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47x2rz"
Jul 13 21:04:15.516566 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:15.516542    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a391661d-64da-4614-abcb-c85464eeb57f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47x2rz\" (UID: \"a391661d-64da-4614-abcb-c85464eeb57f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47x2rz"
Jul 13 21:04:15.518645 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:15.518617    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a391661d-64da-4614-abcb-c85464eeb57f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47x2rz\" (UID: \"a391661d-64da-4614-abcb-c85464eeb57f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47x2rz"
Jul 13 21:04:15.518769 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:15.518753    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a391661d-64da-4614-abcb-c85464eeb57f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47x2rz\" (UID: \"a391661d-64da-4614-abcb-c85464eeb57f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47x2rz"
Jul 13 21:04:15.532508 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:15.532488    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a391661d-64da-4614-abcb-c85464eeb57f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47x2rz\" (UID: \"a391661d-64da-4614-abcb-c85464eeb57f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47x2rz"
Jul 13 21:04:15.532678 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:15.532661    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kklzz\" (UniqueName: \"kubernetes.io/projected/a391661d-64da-4614-abcb-c85464eeb57f-kube-api-access-kklzz\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47x2rz\" (UID: \"a391661d-64da-4614-abcb-c85464eeb57f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47x2rz"
Jul 13 21:04:15.617518 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:15.617432    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47x2rz"
Jul 13 21:04:15.652587 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:15.652556    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:04:15.776550 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:15.776518    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47x2rz"]
Jul 13 21:04:15.779679 ip-10-0-137-162 kubenswrapper[2561]: W0713 21:04:15.779651    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda391661d_64da_4614_abcb_c85464eeb57f.slice/crio-8218cc0b120f58a0a8a63292de6155869ae306b565d290ff1fc60db6eb0ece58 WatchSource:0}: Error finding container 8218cc0b120f58a0a8a63292de6155869ae306b565d290ff1fc60db6eb0ece58: Status 404 returned error can't find the container with id 8218cc0b120f58a0a8a63292de6155869ae306b565d290ff1fc60db6eb0ece58
Jul 13 21:04:15.797799 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:15.797777    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:04:16.078824 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:16.078779    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2rkqm"]
Jul 13 21:04:16.083474 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:16.083452    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2rkqm"
Jul 13 21:04:16.090068 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:16.090020    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 13 21:04:16.090661 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:16.090642    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 13 21:04:16.090764 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:16.090648    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 13 21:04:16.090988 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:16.090974    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-zk4hq\""
Jul 13 21:04:16.103277 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:16.103256    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2rkqm"]
Jul 13 21:04:16.221613 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:16.221579    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a68d1d1-3503-4a2f-8316-2c6da5c9a31b-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-2rkqm\" (UID: \"1a68d1d1-3503-4a2f-8316-2c6da5c9a31b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2rkqm"
Jul 13 21:04:16.221864 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:16.221642    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a68d1d1-3503-4a2f-8316-2c6da5c9a31b-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-2rkqm\" (UID: \"1a68d1d1-3503-4a2f-8316-2c6da5c9a31b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2rkqm"
Jul 13 21:04:16.221864 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:16.221664    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1a68d1d1-3503-4a2f-8316-2c6da5c9a31b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-2rkqm\" (UID: \"1a68d1d1-3503-4a2f-8316-2c6da5c9a31b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2rkqm"
Jul 13 21:04:16.221864 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:16.221687    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a68d1d1-3503-4a2f-8316-2c6da5c9a31b-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-2rkqm\" (UID: \"1a68d1d1-3503-4a2f-8316-2c6da5c9a31b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2rkqm"
Jul 13 21:04:16.221864 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:16.221717    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1a68d1d1-3503-4a2f-8316-2c6da5c9a31b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-2rkqm\" (UID: \"1a68d1d1-3503-4a2f-8316-2c6da5c9a31b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2rkqm"
Jul 13 21:04:16.221864 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:16.221771    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjj58\" (UniqueName: \"kubernetes.io/projected/1a68d1d1-3503-4a2f-8316-2c6da5c9a31b-kube-api-access-zjj58\") pod \"istiod-openshift-gateway-94bb8fbfd-2rkqm\" (UID: \"1a68d1d1-3503-4a2f-8316-2c6da5c9a31b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2rkqm"
Jul 13 21:04:16.222047 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:16.221873    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1a68d1d1-3503-4a2f-8316-2c6da5c9a31b-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-2rkqm\" (UID: \"1a68d1d1-3503-4a2f-8316-2c6da5c9a31b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2rkqm"
Jul 13 21:04:16.322546 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:16.322509    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a68d1d1-3503-4a2f-8316-2c6da5c9a31b-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-2rkqm\" (UID: \"1a68d1d1-3503-4a2f-8316-2c6da5c9a31b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2rkqm"
Jul 13 21:04:16.322740 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:16.322564    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a68d1d1-3503-4a2f-8316-2c6da5c9a31b-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-2rkqm\" (UID: \"1a68d1d1-3503-4a2f-8316-2c6da5c9a31b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2rkqm"
Jul 13 21:04:16.322740 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:16.322589    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1a68d1d1-3503-4a2f-8316-2c6da5c9a31b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-2rkqm\" (UID: \"1a68d1d1-3503-4a2f-8316-2c6da5c9a31b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2rkqm"
Jul 13 21:04:16.322740 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:16.322619    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a68d1d1-3503-4a2f-8316-2c6da5c9a31b-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-2rkqm\" (UID: \"1a68d1d1-3503-4a2f-8316-2c6da5c9a31b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2rkqm"
Jul 13 21:04:16.322740 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:16.322654    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1a68d1d1-3503-4a2f-8316-2c6da5c9a31b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-2rkqm\" (UID: \"1a68d1d1-3503-4a2f-8316-2c6da5c9a31b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2rkqm"
Jul 13 21:04:16.322740 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:16.322680    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjj58\" (UniqueName: \"kubernetes.io/projected/1a68d1d1-3503-4a2f-8316-2c6da5c9a31b-kube-api-access-zjj58\") pod \"istiod-openshift-gateway-94bb8fbfd-2rkqm\" (UID: \"1a68d1d1-3503-4a2f-8316-2c6da5c9a31b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2rkqm"
Jul 13 21:04:16.322740 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:16.322722    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1a68d1d1-3503-4a2f-8316-2c6da5c9a31b-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-2rkqm\" (UID: \"1a68d1d1-3503-4a2f-8316-2c6da5c9a31b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2rkqm"
Jul 13 21:04:16.323488 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:16.323464    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1a68d1d1-3503-4a2f-8316-2c6da5c9a31b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-2rkqm\" (UID: \"1a68d1d1-3503-4a2f-8316-2c6da5c9a31b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2rkqm"
Jul 13 21:04:16.324903 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:16.324885    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a68d1d1-3503-4a2f-8316-2c6da5c9a31b-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-2rkqm\" (UID: \"1a68d1d1-3503-4a2f-8316-2c6da5c9a31b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2rkqm"
Jul 13 21:04:16.325074 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:16.325058    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1a68d1d1-3503-4a2f-8316-2c6da5c9a31b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-2rkqm\" (UID: \"1a68d1d1-3503-4a2f-8316-2c6da5c9a31b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2rkqm"
Jul 13 21:04:16.325360 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:16.325336    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a68d1d1-3503-4a2f-8316-2c6da5c9a31b-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-2rkqm\" (UID: \"1a68d1d1-3503-4a2f-8316-2c6da5c9a31b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2rkqm"
Jul 13 21:04:16.325436 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:16.325400    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1a68d1d1-3503-4a2f-8316-2c6da5c9a31b-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-2rkqm\" (UID: \"1a68d1d1-3503-4a2f-8316-2c6da5c9a31b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2rkqm"
Jul 13 21:04:16.335257 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:16.335204    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a68d1d1-3503-4a2f-8316-2c6da5c9a31b-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-2rkqm\" (UID: \"1a68d1d1-3503-4a2f-8316-2c6da5c9a31b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2rkqm"
Jul 13 21:04:16.335772 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:16.335757    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjj58\" (UniqueName: \"kubernetes.io/projected/1a68d1d1-3503-4a2f-8316-2c6da5c9a31b-kube-api-access-zjj58\") pod \"istiod-openshift-gateway-94bb8fbfd-2rkqm\" (UID: \"1a68d1d1-3503-4a2f-8316-2c6da5c9a31b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2rkqm"
Jul 13 21:04:16.392978 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:16.392945    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2rkqm"
Jul 13 21:04:16.522008 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:16.521978    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2rkqm"]
Jul 13 21:04:16.525218 ip-10-0-137-162 kubenswrapper[2561]: W0713 21:04:16.525190    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a68d1d1_3503_4a2f_8316_2c6da5c9a31b.slice/crio-21a17af471a3bace4d9f3f6cbd59f798105e369ccae5ed159583f54def214e05 WatchSource:0}: Error finding container 21a17af471a3bace4d9f3f6cbd59f798105e369ccae5ed159583f54def214e05: Status 404 returned error can't find the container with id 21a17af471a3bace4d9f3f6cbd59f798105e369ccae5ed159583f54def214e05
Jul 13 21:04:16.655350 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:16.655257    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2rkqm" event={"ID":"1a68d1d1-3503-4a2f-8316-2c6da5c9a31b","Type":"ContainerStarted","Data":"21a17af471a3bace4d9f3f6cbd59f798105e369ccae5ed159583f54def214e05"}
Jul 13 21:04:16.656504 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:16.656469    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47x2rz" event={"ID":"a391661d-64da-4614-abcb-c85464eeb57f","Type":"ContainerStarted","Data":"8218cc0b120f58a0a8a63292de6155869ae306b565d290ff1fc60db6eb0ece58"}
Jul 13 21:04:18.628570 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:18.628536    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5f779bff78-tc4pq"
Jul 13 21:04:18.927433 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:18.927333    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:04:19.012390 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:19.012322    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:04:19.111712 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:19.111662    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:04:19.590191 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:19.590162    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:04:19.934885 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:19.934847    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 21:04:19.935261 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:19.934930    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 21:04:19.937420 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:19.937389    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 21:04:19.937515 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:19.937460    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 21:04:19.937515 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:19.937505    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 21:04:20.188285 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:20.188171    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:04:20.324564 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:20.324516    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:04:20.419256 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:20.419226    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:04:20.678502 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:20.678462    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2rkqm" event={"ID":"1a68d1d1-3503-4a2f-8316-2c6da5c9a31b","Type":"ContainerStarted","Data":"081fad7c10aa2d685575181ef43f1fa9f2acfacb2c3585f7f6528f769fcbdad7"}
Jul 13 21:04:20.678692 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:20.678525    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2rkqm"
Jul 13 21:04:20.680012 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:20.679986    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47x2rz" event={"ID":"a391661d-64da-4614-abcb-c85464eeb57f","Type":"ContainerStarted","Data":"34c8654a37e25a5098dfce53929f7e26272ba879146a8999d1675fcf987b4b50"}
Jul 13 21:04:20.680506 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:20.680485    2561 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-2rkqm container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 13 21:04:20.680579 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:20.680528    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2rkqm" podUID="1a68d1d1-3503-4a2f-8316-2c6da5c9a31b" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 21:04:20.701468 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:20.701422    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2rkqm" podStartSLOduration=1.2940504640000001 podStartE2EDuration="4.70140642s" totalImagesPullingTime="3.407355956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:04:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:04:20.700708853 +0000 UTC m=+633.695492275" watchObservedRunningTime="2026-07-13 21:04:20.70140642 +0000 UTC m=+633.696189843"
Jul 13 21:04:20.723860 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:20.723806    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47x2rz" podStartSLOduration=1.5683094359999998 podStartE2EDuration="5.723793505s" totalImagesPullingTime="4.155484069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:04:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:04:20.722655766 +0000 UTC m=+633.717439189" watchObservedRunningTime="2026-07-13 21:04:20.723793505 +0000 UTC m=+633.718576927"
Jul 13 21:04:21.618382 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:21.618355    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47x2rz"
Jul 13 21:04:21.622726 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:21.622703    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47x2rz"
Jul 13 21:04:21.683953 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:21.683926    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47x2rz"
Jul 13 21:04:21.684272 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:21.684251    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2rkqm"
Jul 13 21:04:21.684548 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:04:21.684533    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47x2rz"
Jul 13 21:05:02.605586 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:05:02.605547    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:05:02.656968 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:05:02.656935    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:05:08.055227 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:05:08.055188    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:05:08.156160 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:05:08.156130    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:05:08.255734 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:05:08.255699    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:05:09.005950 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:05:09.005922    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:05:11.071803 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:05:11.071757    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:05:20.470729 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:05:20.470693    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:05:20.604213 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:05:20.604178    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:05:20.660530 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:05:20.660494    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:05:21.211621 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:05:21.211585    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:05:21.312959 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:05:21.312930    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:05:31.694975 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:05:31.694932    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:05:31.796003 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:05:31.795969    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:05:36.442425 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:05:36.442389    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:05:37.098989 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:05:37.098956    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:05:38.084974 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:05:38.084927    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:05:38.180063 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:05:38.180028    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:05:41.658053 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:05:41.658023    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:05:44.455027 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:05:44.454990    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:05:44.681528 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:05:44.681492    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:05:46.899802 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:05:46.899765    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:05:47.077394 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:05:47.077353    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:05:49.499612 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:05:49.499576    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:05:52.041692 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:05:52.041657    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:05:52.149112 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:05:52.149079    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:05:52.257021 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:05:52.256986    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:05:52.370526 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:05:52.370437    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:05:55.886865 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:05:55.886829    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:05:55.987147 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:05:55.987113    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:05:59.856002 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:05:59.855961    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:05:59.959803 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:05:59.959768    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:06:00.886738 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:06:00.886703    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:06:01.226776 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:06:01.226701    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:06:03.401774 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:06:03.401745    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:06:03.502862 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:06:03.502831    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:06:11.272534 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:06:11.272496    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:06:11.394500 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:06:11.394472    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:06:11.861854 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:06:11.861801    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:06:11.961194 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:06:11.961161    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:06:14.321896 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:06:14.321862    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:06:14.414831 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:06:14.414780    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:06:19.440545 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:06:19.440510    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:06:19.542003 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:06:19.541969    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:06:22.122004 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:06:22.121975    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:06:22.222913 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:06:22.222856    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:06:30.209792 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:06:30.209758    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:06:30.311744 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:06:30.311711    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:06:40.333073 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:06:40.333038    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:06:40.465253 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:06:40.465217    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:06:51.992190 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:06:51.992156    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:06:52.114509 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:06:52.114474    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:06:52.324353 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:06:52.324320    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:06:52.800952 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:06:52.800920    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:06:52.901376 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:06:52.901344    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:07:06.645557 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:07:06.645522    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:07:06.696168 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:07:06.696137    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:07:11.297210 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:07:11.297110    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:07:11.395799 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:07:11.395761    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:07:11.815091 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:07:11.815058    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:07:24.466260 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:07:24.466214    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:07:24.736831 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:07:24.736734    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:07:30.956788 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:07:30.956753    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:07:31.047070 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:07:31.047036    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:07:31.120757 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:07:31.120727    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:07:31.126091 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:07:31.126067    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6f6dc4cf54-wjv6x"]
Jul 13 21:07:31.129182 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:07:31.129167    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f6dc4cf54-wjv6x"
Jul 13 21:07:31.133135 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:07:31.133114    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-k4bbc\""
Jul 13 21:07:31.133255 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:07:31.133115    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 13 21:07:31.133255 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:07:31.133185    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 13 21:07:31.140614 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:07:31.140593    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f6dc4cf54-wjv6x"]
Jul 13 21:07:31.275619 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:07:31.275593    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf6ps\" (UniqueName: \"kubernetes.io/projected/c4ae106a-d65c-4a3c-ab5e-b6215e3d9649-kube-api-access-rf6ps\") pod \"maas-controller-6f6dc4cf54-wjv6x\" (UID: \"c4ae106a-d65c-4a3c-ab5e-b6215e3d9649\") " pod="opendatahub/maas-controller-6f6dc4cf54-wjv6x"
Jul 13 21:07:31.275768 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:07:31.275676    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4ae106a-d65c-4a3c-ab5e-b6215e3d9649-webhook-cert\") pod \"maas-controller-6f6dc4cf54-wjv6x\" (UID: \"c4ae106a-d65c-4a3c-ab5e-b6215e3d9649\") " pod="opendatahub/maas-controller-6f6dc4cf54-wjv6x"
Jul 13 21:07:31.376367 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:07:31.376334    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4ae106a-d65c-4a3c-ab5e-b6215e3d9649-webhook-cert\") pod \"maas-controller-6f6dc4cf54-wjv6x\" (UID: \"c4ae106a-d65c-4a3c-ab5e-b6215e3d9649\") " pod="opendatahub/maas-controller-6f6dc4cf54-wjv6x"
Jul 13 21:07:31.376470 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:07:31.376380    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf6ps\" (UniqueName: \"kubernetes.io/projected/c4ae106a-d65c-4a3c-ab5e-b6215e3d9649-kube-api-access-rf6ps\") pod \"maas-controller-6f6dc4cf54-wjv6x\" (UID: \"c4ae106a-d65c-4a3c-ab5e-b6215e3d9649\") " pod="opendatahub/maas-controller-6f6dc4cf54-wjv6x"
Jul 13 21:07:31.378864 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:07:31.378833    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4ae106a-d65c-4a3c-ab5e-b6215e3d9649-webhook-cert\") pod \"maas-controller-6f6dc4cf54-wjv6x\" (UID: \"c4ae106a-d65c-4a3c-ab5e-b6215e3d9649\") " pod="opendatahub/maas-controller-6f6dc4cf54-wjv6x"
Jul 13 21:07:31.384769 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:07:31.384747    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf6ps\" (UniqueName: \"kubernetes.io/projected/c4ae106a-d65c-4a3c-ab5e-b6215e3d9649-kube-api-access-rf6ps\") pod \"maas-controller-6f6dc4cf54-wjv6x\" (UID: \"c4ae106a-d65c-4a3c-ab5e-b6215e3d9649\") " pod="opendatahub/maas-controller-6f6dc4cf54-wjv6x"
Jul 13 21:07:31.440024 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:07:31.439996    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f6dc4cf54-wjv6x"
Jul 13 21:07:31.569694 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:07:31.569619    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f6dc4cf54-wjv6x"]
Jul 13 21:07:31.574252 ip-10-0-137-162 kubenswrapper[2561]: W0713 21:07:31.574220    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4ae106a_d65c_4a3c_ab5e_b6215e3d9649.slice/crio-b7d1bf58933f9101b48bbb049b85beb70e77f1b32e80a7ea4047ba69d4983acd WatchSource:0}: Error finding container b7d1bf58933f9101b48bbb049b85beb70e77f1b32e80a7ea4047ba69d4983acd: Status 404 returned error can't find the container with id b7d1bf58933f9101b48bbb049b85beb70e77f1b32e80a7ea4047ba69d4983acd
Jul 13 21:07:32.441289 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:07:32.441247    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f6dc4cf54-wjv6x" event={"ID":"c4ae106a-d65c-4a3c-ab5e-b6215e3d9649","Type":"ContainerStarted","Data":"b7d1bf58933f9101b48bbb049b85beb70e77f1b32e80a7ea4047ba69d4983acd"}
Jul 13 21:07:33.811569 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:07:33.811522    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:07:33.900464 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:07:33.900385    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:07:34.451976 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:07:34.451943    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f6dc4cf54-wjv6x" event={"ID":"c4ae106a-d65c-4a3c-ab5e-b6215e3d9649","Type":"ContainerStarted","Data":"cafa4c68d7b41cb048a9e86e42c97f39562fca612a68596a503dc22e2f2718c6"}
Jul 13 21:07:34.452153 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:07:34.452060    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6f6dc4cf54-wjv6x"
Jul 13 21:07:34.473505 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:07:34.473449    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6f6dc4cf54-wjv6x" podStartSLOduration=1.407937163 podStartE2EDuration="3.47342439s" totalImagesPullingTime="2.065487227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:07:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:07:34.473124433 +0000 UTC m=+827.467907856" watchObservedRunningTime="2026-07-13 21:07:34.47342439 +0000 UTC m=+827.468207814"
Jul 13 21:07:45.460651 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:07:45.460622    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6f6dc4cf54-wjv6x"
Jul 13 21:08:04.582291 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:04.582253    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:08:04.680972 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:04.680940    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:08:05.141661 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:05.141628    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:08:05.697206 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:05.697170    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:08:05.801753 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:05.801717    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:08:06.750209 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:06.750174    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:08:18.412946 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:18.412905    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:08:18.522200 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:18.522138    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:08:25.158179 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:25.158125    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:08:26.056292 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:26.056256    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg"]
Jul 13 21:08:26.059423 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:26.059403    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg"
Jul 13 21:08:26.062524 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:26.062501    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fb5tw\""
Jul 13 21:08:26.062852 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:26.062833    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 13 21:08:26.062962 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:26.062941    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 13 21:08:26.063540 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:26.063525    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 13 21:08:26.077163 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:26.077136    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg"]
Jul 13 21:08:26.089531 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:26.089508    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:08:26.242277 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:26.242238    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9334614-32da-4333-87c8-0f939436b052-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg\" (UID: \"d9334614-32da-4333-87c8-0f939436b052\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg"
Jul 13 21:08:26.242662 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:26.242285    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9334614-32da-4333-87c8-0f939436b052-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg\" (UID: \"d9334614-32da-4333-87c8-0f939436b052\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg"
Jul 13 21:08:26.242662 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:26.242354    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9334614-32da-4333-87c8-0f939436b052-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg\" (UID: \"d9334614-32da-4333-87c8-0f939436b052\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg"
Jul 13 21:08:26.242662 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:26.242380    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w66d9\" (UniqueName: \"kubernetes.io/projected/d9334614-32da-4333-87c8-0f939436b052-kube-api-access-w66d9\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg\" (UID: \"d9334614-32da-4333-87c8-0f939436b052\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg"
Jul 13 21:08:26.242662 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:26.242403    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9334614-32da-4333-87c8-0f939436b052-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg\" (UID: \"d9334614-32da-4333-87c8-0f939436b052\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg"
Jul 13 21:08:26.242662 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:26.242433    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9334614-32da-4333-87c8-0f939436b052-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg\" (UID: \"d9334614-32da-4333-87c8-0f939436b052\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg"
Jul 13 21:08:26.343785 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:26.343685    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9334614-32da-4333-87c8-0f939436b052-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg\" (UID: \"d9334614-32da-4333-87c8-0f939436b052\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg"
Jul 13 21:08:26.343785 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:26.343735    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9334614-32da-4333-87c8-0f939436b052-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg\" (UID: \"d9334614-32da-4333-87c8-0f939436b052\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg"
Jul 13 21:08:26.344033 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:26.343822    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9334614-32da-4333-87c8-0f939436b052-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg\" (UID: \"d9334614-32da-4333-87c8-0f939436b052\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg"
Jul 13 21:08:26.344033 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:26.343848    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w66d9\" (UniqueName: \"kubernetes.io/projected/d9334614-32da-4333-87c8-0f939436b052-kube-api-access-w66d9\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg\" (UID: \"d9334614-32da-4333-87c8-0f939436b052\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg"
Jul 13 21:08:26.344033 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:26.343883    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9334614-32da-4333-87c8-0f939436b052-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg\" (UID: \"d9334614-32da-4333-87c8-0f939436b052\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg"
Jul 13 21:08:26.344033 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:26.343927    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9334614-32da-4333-87c8-0f939436b052-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg\" (UID: \"d9334614-32da-4333-87c8-0f939436b052\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg"
Jul 13 21:08:26.344259 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:26.344146    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9334614-32da-4333-87c8-0f939436b052-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg\" (UID: \"d9334614-32da-4333-87c8-0f939436b052\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg"
Jul 13 21:08:26.344259 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:26.344192    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9334614-32da-4333-87c8-0f939436b052-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg\" (UID: \"d9334614-32da-4333-87c8-0f939436b052\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg"
Jul 13 21:08:26.344353 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:26.344260    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9334614-32da-4333-87c8-0f939436b052-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg\" (UID: \"d9334614-32da-4333-87c8-0f939436b052\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg"
Jul 13 21:08:26.345947 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:26.345931    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9334614-32da-4333-87c8-0f939436b052-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg\" (UID: \"d9334614-32da-4333-87c8-0f939436b052\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg"
Jul 13 21:08:26.346342 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:26.346321    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9334614-32da-4333-87c8-0f939436b052-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg\" (UID: \"d9334614-32da-4333-87c8-0f939436b052\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg"
Jul 13 21:08:26.351544 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:26.351521    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w66d9\" (UniqueName: \"kubernetes.io/projected/d9334614-32da-4333-87c8-0f939436b052-kube-api-access-w66d9\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg\" (UID: \"d9334614-32da-4333-87c8-0f939436b052\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg"
Jul 13 21:08:26.371475 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:26.371444    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg"
Jul 13 21:08:26.504382 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:26.504350    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg"]
Jul 13 21:08:26.506846 ip-10-0-137-162 kubenswrapper[2561]: W0713 21:08:26.506806    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9334614_32da_4333_87c8_0f939436b052.slice/crio-1263117e908b3715fb41f56d7407573bc526d4f2b5372368de4081e38b59b251 WatchSource:0}: Error finding container 1263117e908b3715fb41f56d7407573bc526d4f2b5372368de4081e38b59b251: Status 404 returned error can't find the container with id 1263117e908b3715fb41f56d7407573bc526d4f2b5372368de4081e38b59b251
Jul 13 21:08:26.667160 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:26.667077    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg" event={"ID":"d9334614-32da-4333-87c8-0f939436b052","Type":"ContainerStarted","Data":"1263117e908b3715fb41f56d7407573bc526d4f2b5372368de4081e38b59b251"}
Jul 13 21:08:26.768010 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:26.767972    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:08:26.869005 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:26.868948    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:08:28.676001 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:28.675967    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg" event={"ID":"d9334614-32da-4333-87c8-0f939436b052","Type":"ContainerStarted","Data":"b087aa8c5b1ba651c142575a14e409658204584cce1414cd927082f96830ffd3"}
Jul 13 21:08:28.693568 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:28.693508    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg" podStartSLOduration=1.58103104 podStartE2EDuration="2.693489158s" totalImagesPullingTime="1.112458118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:08:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:08:28.693046198 +0000 UTC m=+881.687829625" watchObservedRunningTime="2026-07-13 21:08:28.693489158 +0000 UTC m=+881.688272581"
Jul 13 21:08:36.372459 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:36.372425    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg"
Jul 13 21:08:36.373000 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:36.372491    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg"
Jul 13 21:08:36.384759 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:36.384733    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg"
Jul 13 21:08:36.720022 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:36.719934    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg"
Jul 13 21:08:39.149349 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:39.149275    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:08:42.445427 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:42.445390    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-j6f6x"]
Jul 13 21:08:42.448734 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:42.448716    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j6f6x"
Jul 13 21:08:42.451663 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:42.451644    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 13 21:08:42.461090 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:42.461067    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-j6f6x"]
Jul 13 21:08:42.468638 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:42.468614    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d34676f4-52a0-4126-82db-f494e8f47205-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j6f6x\" (UID: \"d34676f4-52a0-4126-82db-f494e8f47205\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j6f6x"
Jul 13 21:08:42.468736 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:42.468681    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d34676f4-52a0-4126-82db-f494e8f47205-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j6f6x\" (UID: \"d34676f4-52a0-4126-82db-f494e8f47205\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j6f6x"
Jul 13 21:08:42.468774 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:42.468735    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq85l\" (UniqueName: \"kubernetes.io/projected/d34676f4-52a0-4126-82db-f494e8f47205-kube-api-access-tq85l\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j6f6x\" (UID: \"d34676f4-52a0-4126-82db-f494e8f47205\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j6f6x"
Jul 13 21:08:42.468774 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:42.468766    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d34676f4-52a0-4126-82db-f494e8f47205-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j6f6x\" (UID: \"d34676f4-52a0-4126-82db-f494e8f47205\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j6f6x"
Jul 13 21:08:42.468871 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:42.468834    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d34676f4-52a0-4126-82db-f494e8f47205-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j6f6x\" (UID: \"d34676f4-52a0-4126-82db-f494e8f47205\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j6f6x"
Jul 13 21:08:42.468911 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:42.468880    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d34676f4-52a0-4126-82db-f494e8f47205-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j6f6x\" (UID: \"d34676f4-52a0-4126-82db-f494e8f47205\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j6f6x"
Jul 13 21:08:42.570356 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:42.570322    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tq85l\" (UniqueName: \"kubernetes.io/projected/d34676f4-52a0-4126-82db-f494e8f47205-kube-api-access-tq85l\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j6f6x\" (UID: \"d34676f4-52a0-4126-82db-f494e8f47205\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j6f6x"
Jul 13 21:08:42.570356 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:42.570366    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d34676f4-52a0-4126-82db-f494e8f47205-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j6f6x\" (UID: \"d34676f4-52a0-4126-82db-f494e8f47205\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j6f6x"
Jul 13 21:08:42.570606 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:42.570417    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d34676f4-52a0-4126-82db-f494e8f47205-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j6f6x\" (UID: \"d34676f4-52a0-4126-82db-f494e8f47205\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j6f6x"
Jul 13 21:08:42.570606 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:42.570456    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d34676f4-52a0-4126-82db-f494e8f47205-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j6f6x\" (UID: \"d34676f4-52a0-4126-82db-f494e8f47205\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j6f6x"
Jul 13 21:08:42.570606 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:42.570506    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d34676f4-52a0-4126-82db-f494e8f47205-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j6f6x\" (UID: \"d34676f4-52a0-4126-82db-f494e8f47205\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j6f6x"
Jul 13 21:08:42.570759 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:42.570603    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d34676f4-52a0-4126-82db-f494e8f47205-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j6f6x\" (UID: \"d34676f4-52a0-4126-82db-f494e8f47205\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j6f6x"
Jul 13 21:08:42.570904 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:42.570883    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d34676f4-52a0-4126-82db-f494e8f47205-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j6f6x\" (UID: \"d34676f4-52a0-4126-82db-f494e8f47205\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j6f6x"
Jul 13 21:08:42.571011 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:42.570905    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d34676f4-52a0-4126-82db-f494e8f47205-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j6f6x\" (UID: \"d34676f4-52a0-4126-82db-f494e8f47205\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j6f6x"
Jul 13 21:08:42.571011 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:42.570958    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d34676f4-52a0-4126-82db-f494e8f47205-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j6f6x\" (UID: \"d34676f4-52a0-4126-82db-f494e8f47205\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j6f6x"
Jul 13 21:08:42.572685 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:42.572656    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d34676f4-52a0-4126-82db-f494e8f47205-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j6f6x\" (UID: \"d34676f4-52a0-4126-82db-f494e8f47205\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j6f6x"
Jul 13 21:08:42.573036 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:42.573004    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d34676f4-52a0-4126-82db-f494e8f47205-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j6f6x\" (UID: \"d34676f4-52a0-4126-82db-f494e8f47205\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j6f6x"
Jul 13 21:08:42.577965 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:42.577939    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:08:42.581469 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:42.581420    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq85l\" (UniqueName: \"kubernetes.io/projected/d34676f4-52a0-4126-82db-f494e8f47205-kube-api-access-tq85l\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j6f6x\" (UID: \"d34676f4-52a0-4126-82db-f494e8f47205\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j6f6x"
Jul 13 21:08:42.758798 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:42.758715    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j6f6x"
Jul 13 21:08:42.888348 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:42.888186    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-j6f6x"]
Jul 13 21:08:42.890963 ip-10-0-137-162 kubenswrapper[2561]: W0713 21:08:42.890937    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd34676f4_52a0_4126_82db_f494e8f47205.slice/crio-f7b053f931d74b326c4996db6d68ae4a56add988fdea08aa0261f94ffe0bf8ed WatchSource:0}: Error finding container f7b053f931d74b326c4996db6d68ae4a56add988fdea08aa0261f94ffe0bf8ed: Status 404 returned error can't find the container with id f7b053f931d74b326c4996db6d68ae4a56add988fdea08aa0261f94ffe0bf8ed
Jul 13 21:08:43.737174 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:43.737128    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j6f6x" event={"ID":"d34676f4-52a0-4126-82db-f494e8f47205","Type":"ContainerStarted","Data":"c842eb44f1520d2fab2d373c71d509a6babfdeca8e51814ff774663d9fa2f752"}
Jul 13 21:08:43.737549 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:43.737198    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j6f6x" event={"ID":"d34676f4-52a0-4126-82db-f494e8f47205","Type":"ContainerStarted","Data":"f7b053f931d74b326c4996db6d68ae4a56add988fdea08aa0261f94ffe0bf8ed"}
Jul 13 21:08:43.759464 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:43.759414    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j6f6x" podStartSLOduration=1.55587827 podStartE2EDuration="1.759397859s" totalImagesPullingTime="203.519589ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:08:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:08:43.758696195 +0000 UTC m=+896.753479619" watchObservedRunningTime="2026-07-13 21:08:43.759397859 +0000 UTC m=+896.754181281"
Jul 13 21:08:47.710627 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:47.710517    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jrpbd_e730eed8-ff8a-4a54-b1cb-539d8f07e70b/ovn-acl-logging/0.log"
Jul 13 21:08:47.725692 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:47.711737    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jrpbd_e730eed8-ff8a-4a54-b1cb-539d8f07e70b/ovn-acl-logging/0.log"
Jul 13 21:08:52.759739 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:52.759705    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j6f6x"
Jul 13 21:08:52.760218 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:52.759766    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j6f6x"
Jul 13 21:08:52.773066 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:52.773033    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j6f6x"
Jul 13 21:08:52.785187 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:52.785161    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j6f6x"
Jul 13 21:08:58.318752 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:08:58.318718    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:09:05.140065 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:09:05.140028    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-87fdn"]
Jul 13 21:09:05.143494 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:09:05.143475    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87fdn"
Jul 13 21:09:05.146201 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:09:05.146178    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 13 21:09:05.155584 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:09:05.155561    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-87fdn"]
Jul 13 21:09:05.243025 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:09:05.242992    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:09:05.273175 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:09:05.273144    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbaac0cd-539f-47e9-addb-b3b9596a1751-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-87fdn\" (UID: \"cbaac0cd-539f-47e9-addb-b3b9596a1751\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87fdn"
Jul 13 21:09:05.273345 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:09:05.273202    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbaac0cd-539f-47e9-addb-b3b9596a1751-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-87fdn\" (UID: \"cbaac0cd-539f-47e9-addb-b3b9596a1751\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87fdn"
Jul 13 21:09:05.273345 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:09:05.273222    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbaac0cd-539f-47e9-addb-b3b9596a1751-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-87fdn\" (UID: \"cbaac0cd-539f-47e9-addb-b3b9596a1751\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87fdn"
Jul 13 21:09:05.273345 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:09:05.273238    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brhpz\" (UniqueName: \"kubernetes.io/projected/cbaac0cd-539f-47e9-addb-b3b9596a1751-kube-api-access-brhpz\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-87fdn\" (UID: \"cbaac0cd-539f-47e9-addb-b3b9596a1751\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87fdn"
Jul 13 21:09:05.273345 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:09:05.273296    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbaac0cd-539f-47e9-addb-b3b9596a1751-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-87fdn\" (UID: \"cbaac0cd-539f-47e9-addb-b3b9596a1751\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87fdn"
Jul 13 21:09:05.273345 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:09:05.273345    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbaac0cd-539f-47e9-addb-b3b9596a1751-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-87fdn\" (UID: \"cbaac0cd-539f-47e9-addb-b3b9596a1751\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87fdn"
Jul 13 21:09:05.374178 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:09:05.374134    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbaac0cd-539f-47e9-addb-b3b9596a1751-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-87fdn\" (UID: \"cbaac0cd-539f-47e9-addb-b3b9596a1751\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87fdn"
Jul 13 21:09:05.374178 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:09:05.374175    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbaac0cd-539f-47e9-addb-b3b9596a1751-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-87fdn\" (UID: \"cbaac0cd-539f-47e9-addb-b3b9596a1751\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87fdn"
Jul 13 21:09:05.374375 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:09:05.374193    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brhpz\" (UniqueName: \"kubernetes.io/projected/cbaac0cd-539f-47e9-addb-b3b9596a1751-kube-api-access-brhpz\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-87fdn\" (UID: \"cbaac0cd-539f-47e9-addb-b3b9596a1751\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87fdn"
Jul 13 21:09:05.374375 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:09:05.374212    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbaac0cd-539f-47e9-addb-b3b9596a1751-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-87fdn\" (UID: \"cbaac0cd-539f-47e9-addb-b3b9596a1751\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87fdn"
Jul 13 21:09:05.374375 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:09:05.374248    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbaac0cd-539f-47e9-addb-b3b9596a1751-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-87fdn\" (UID: \"cbaac0cd-539f-47e9-addb-b3b9596a1751\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87fdn"
Jul 13 21:09:05.374375 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:09:05.374327    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbaac0cd-539f-47e9-addb-b3b9596a1751-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-87fdn\" (UID: \"cbaac0cd-539f-47e9-addb-b3b9596a1751\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87fdn"
Jul 13 21:09:05.374625 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:09:05.374602    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbaac0cd-539f-47e9-addb-b3b9596a1751-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-87fdn\" (UID: \"cbaac0cd-539f-47e9-addb-b3b9596a1751\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87fdn"
Jul 13 21:09:05.374664 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:09:05.374634    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbaac0cd-539f-47e9-addb-b3b9596a1751-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-87fdn\" (UID: \"cbaac0cd-539f-47e9-addb-b3b9596a1751\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87fdn"
Jul 13 21:09:05.374715 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:09:05.374694    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbaac0cd-539f-47e9-addb-b3b9596a1751-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-87fdn\" (UID: \"cbaac0cd-539f-47e9-addb-b3b9596a1751\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87fdn"
Jul 13 21:09:05.376486 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:09:05.376463    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbaac0cd-539f-47e9-addb-b3b9596a1751-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-87fdn\" (UID: \"cbaac0cd-539f-47e9-addb-b3b9596a1751\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87fdn"
Jul 13 21:09:05.376745 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:09:05.376727    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbaac0cd-539f-47e9-addb-b3b9596a1751-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-87fdn\" (UID: \"cbaac0cd-539f-47e9-addb-b3b9596a1751\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87fdn"
Jul 13 21:09:05.385074 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:09:05.385047    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brhpz\" (UniqueName: \"kubernetes.io/projected/cbaac0cd-539f-47e9-addb-b3b9596a1751-kube-api-access-brhpz\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-87fdn\" (UID: \"cbaac0cd-539f-47e9-addb-b3b9596a1751\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87fdn"
Jul 13 21:09:05.453243 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:09:05.453180    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87fdn"
Jul 13 21:09:05.582114 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:09:05.582081    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-87fdn"]
Jul 13 21:09:05.584548 ip-10-0-137-162 kubenswrapper[2561]: W0713 21:09:05.584526    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbaac0cd_539f_47e9_addb_b3b9596a1751.slice/crio-c14f85ada711f2d5a75e1f77445671befe4cfda1d870077c5ecc96209db3c070 WatchSource:0}: Error finding container c14f85ada711f2d5a75e1f77445671befe4cfda1d870077c5ecc96209db3c070: Status 404 returned error can't find the container with id c14f85ada711f2d5a75e1f77445671befe4cfda1d870077c5ecc96209db3c070
Jul 13 21:09:05.585866 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:09:05.585851    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 21:09:05.834102 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:09:05.834075    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87fdn" event={"ID":"cbaac0cd-539f-47e9-addb-b3b9596a1751","Type":"ContainerStarted","Data":"c14f85ada711f2d5a75e1f77445671befe4cfda1d870077c5ecc96209db3c070"}
Jul 13 21:09:06.839531 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:09:06.839495    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87fdn" event={"ID":"cbaac0cd-539f-47e9-addb-b3b9596a1751","Type":"ContainerStarted","Data":"127928505deb928e406cf4248cc7d9217b84f7e2a0dee735a19239a3d07a4e34"}
Jul 13 21:09:06.859407 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:09:06.859359    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87fdn" podStartSLOduration=1.651412561 podStartE2EDuration="1.859342813s" totalImagesPullingTime="207.930252ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:09:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:09:06.857924751 +0000 UTC m=+919.852708166" watchObservedRunningTime="2026-07-13 21:09:06.859342813 +0000 UTC m=+919.854126235"
Jul 13 21:09:10.780704 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:09:10.780668    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:09:15.453669 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:09:15.453631    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87fdn"
Jul 13 21:09:15.454130 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:09:15.453699    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87fdn"
Jul 13 21:09:15.466238 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:09:15.466210    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87fdn"
Jul 13 21:09:15.884711 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:09:15.884678    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87fdn"
Jul 13 21:10:09.046170 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:10:09.046082    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:10:09.134746 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:10:09.134700    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:10:10.249256 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:10:10.249209    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:10:10.351507 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:10:10.351465    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:10:18.888760 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:10:18.888729    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:10:29.935161 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:10:29.935114    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:11:11.825023 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:11:11.824982    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:11:12.970924 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:11:12.970894    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:11:13.040289 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:11:13.040259    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:11:22.016067 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:11:22.016033    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:11:22.115658 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:11:22.115624    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6f6dc4cf54-wjv6x"]
Jul 13 21:11:22.115863 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:11:22.115838    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6f6dc4cf54-wjv6x" podUID="c4ae106a-d65c-4a3c-ab5e-b6215e3d9649" containerName="manager" containerID="cri-o://cafa4c68d7b41cb048a9e86e42c97f39562fca612a68596a503dc22e2f2718c6" gracePeriod=30
Jul 13 21:11:22.364779 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:11:22.364755    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f6dc4cf54-wjv6x"
Jul 13 21:11:22.404503 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:11:22.404470    2561 generic.go:356] "Generic (PLEG): container finished" podID="c4ae106a-d65c-4a3c-ab5e-b6215e3d9649" containerID="cafa4c68d7b41cb048a9e86e42c97f39562fca612a68596a503dc22e2f2718c6" exitCode=0
Jul 13 21:11:22.404652 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:11:22.404514    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f6dc4cf54-wjv6x"
Jul 13 21:11:22.404652 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:11:22.404552    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f6dc4cf54-wjv6x" event={"ID":"c4ae106a-d65c-4a3c-ab5e-b6215e3d9649","Type":"ContainerDied","Data":"cafa4c68d7b41cb048a9e86e42c97f39562fca612a68596a503dc22e2f2718c6"}
Jul 13 21:11:22.404652 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:11:22.404609    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f6dc4cf54-wjv6x" event={"ID":"c4ae106a-d65c-4a3c-ab5e-b6215e3d9649","Type":"ContainerDied","Data":"b7d1bf58933f9101b48bbb049b85beb70e77f1b32e80a7ea4047ba69d4983acd"}
Jul 13 21:11:22.404652 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:11:22.404631    2561 scope.go:117] "RemoveContainer" containerID="cafa4c68d7b41cb048a9e86e42c97f39562fca612a68596a503dc22e2f2718c6"
Jul 13 21:11:22.412904 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:11:22.412881    2561 scope.go:117] "RemoveContainer" containerID="cafa4c68d7b41cb048a9e86e42c97f39562fca612a68596a503dc22e2f2718c6"
Jul 13 21:11:22.413193 ip-10-0-137-162 kubenswrapper[2561]: E0713 21:11:22.413174    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cafa4c68d7b41cb048a9e86e42c97f39562fca612a68596a503dc22e2f2718c6\": container with ID starting with cafa4c68d7b41cb048a9e86e42c97f39562fca612a68596a503dc22e2f2718c6 not found: ID does not exist" containerID="cafa4c68d7b41cb048a9e86e42c97f39562fca612a68596a503dc22e2f2718c6"
Jul 13 21:11:22.413266 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:11:22.413202    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cafa4c68d7b41cb048a9e86e42c97f39562fca612a68596a503dc22e2f2718c6"} err="failed to get container status \"cafa4c68d7b41cb048a9e86e42c97f39562fca612a68596a503dc22e2f2718c6\": rpc error: code = NotFound desc = could not find container \"cafa4c68d7b41cb048a9e86e42c97f39562fca612a68596a503dc22e2f2718c6\": container with ID starting with cafa4c68d7b41cb048a9e86e42c97f39562fca612a68596a503dc22e2f2718c6 not found: ID does not exist"
Jul 13 21:11:22.447548 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:11:22.447523    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4ae106a-d65c-4a3c-ab5e-b6215e3d9649-webhook-cert\") pod \"c4ae106a-d65c-4a3c-ab5e-b6215e3d9649\" (UID: \"c4ae106a-d65c-4a3c-ab5e-b6215e3d9649\") "
Jul 13 21:11:22.447649 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:11:22.447567    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rf6ps\" (UniqueName: \"kubernetes.io/projected/c4ae106a-d65c-4a3c-ab5e-b6215e3d9649-kube-api-access-rf6ps\") pod \"c4ae106a-d65c-4a3c-ab5e-b6215e3d9649\" (UID: \"c4ae106a-d65c-4a3c-ab5e-b6215e3d9649\") "
Jul 13 21:11:22.449613 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:11:22.449590    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4ae106a-d65c-4a3c-ab5e-b6215e3d9649-kube-api-access-rf6ps" (OuterVolumeSpecName: "kube-api-access-rf6ps") pod "c4ae106a-d65c-4a3c-ab5e-b6215e3d9649" (UID: "c4ae106a-d65c-4a3c-ab5e-b6215e3d9649"). InnerVolumeSpecName "kube-api-access-rf6ps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:11:22.449743 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:11:22.449722    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4ae106a-d65c-4a3c-ab5e-b6215e3d9649-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c4ae106a-d65c-4a3c-ab5e-b6215e3d9649" (UID: "c4ae106a-d65c-4a3c-ab5e-b6215e3d9649"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:11:22.548514 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:11:22.548438    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rf6ps\" (UniqueName: \"kubernetes.io/projected/c4ae106a-d65c-4a3c-ab5e-b6215e3d9649-kube-api-access-rf6ps\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:11:22.548514 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:11:22.548465    2561 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4ae106a-d65c-4a3c-ab5e-b6215e3d9649-webhook-cert\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:11:22.724788 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:11:22.724761    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6f6dc4cf54-wjv6x"]
Jul 13 21:11:22.728313 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:11:22.728291    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6f6dc4cf54-wjv6x"]
Jul 13 21:11:23.376833 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:11:23.376790    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:11:23.576340 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:11:23.576308    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4ae106a-d65c-4a3c-ab5e-b6215e3d9649" path="/var/lib/kubelet/pods/c4ae106a-d65c-4a3c-ab5e-b6215e3d9649/volumes"
Jul 13 21:12:07.085686 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:12:07.085651    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:12:07.190788 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:12:07.186502    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:12:07.286007 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:12:07.285970    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:12:13.130435 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:12:13.130397    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:12:13.197508 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:12:13.197478    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:12:13.283535 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:12:13.283503    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:12:13.398486 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:12:13.398409    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:12:13.544189 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:12:13.544158    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:12:19.270548 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:12:19.270514    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:12:19.334368 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:12:19.334341    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:13:38.791688 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:13:38.791654    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:13:47.732975 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:13:47.732860    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jrpbd_e730eed8-ff8a-4a54-b1cb-539d8f07e70b/ovn-acl-logging/0.log"
Jul 13 21:13:47.737034 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:13:47.735263    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jrpbd_e730eed8-ff8a-4a54-b1cb-539d8f07e70b/ovn-acl-logging/0.log"
Jul 13 21:16:03.331882 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:16:03.331848    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:16:04.890266 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:16:04.890227    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:17:39.149924 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:17:39.149844    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:17:39.208349 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:17:39.208320    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:17:53.981475 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:17:53.981436    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:18:47.759157 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:18:47.759066    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jrpbd_e730eed8-ff8a-4a54-b1cb-539d8f07e70b/ovn-acl-logging/0.log"
Jul 13 21:18:47.762253 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:18:47.762076    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jrpbd_e730eed8-ff8a-4a54-b1cb-539d8f07e70b/ovn-acl-logging/0.log"
Jul 13 21:19:50.676541 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:19:50.676498    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:20:02.987693 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:20:02.987657    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:23:06.114641 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:06.114593    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:23:13.500455 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:13.500413    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:23:21.755318 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:21.755284    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:23:26.844126 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:26.844095    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:23:29.769078 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:29.769006    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:23:29.852590 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:29.852557    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:23:30.182038 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:30.181972    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:23:36.132958 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:36.132924    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:23:36.210685 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:36.210657    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:23:36.373556 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:36.373519    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:23:36.466833 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:36.466734    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:23:37.568306 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:37.568265    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:23:37.628400 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:37.628374    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-19927e2d-696b4f595d-wwkgv"]
Jul 13 21:23:37.628677 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:37.628666    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4ae106a-d65c-4a3c-ab5e-b6215e3d9649" containerName="manager"
Jul 13 21:23:37.628716 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:37.628679    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4ae106a-d65c-4a3c-ab5e-b6215e3d9649" containerName="manager"
Jul 13 21:23:37.628748 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:37.628734    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4ae106a-d65c-4a3c-ab5e-b6215e3d9649" containerName="manager"
Jul 13 21:23:37.631720 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:37.631703    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-19927e2d-696b4f595d-wwkgv"
Jul 13 21:23:37.634663 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:37.634641    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 21:23:37.634912 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:37.634896    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-j4tgz\""
Jul 13 21:23:37.635894 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:37.635877    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-19927e2d-serving-cert\""
Jul 13 21:23:37.635958 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:37.635923    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 13 21:23:37.647783 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:37.647763    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-19927e2d-696b4f595d-wwkgv"]
Jul 13 21:23:37.660601 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:37.660576    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:23:37.765323 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:37.765292    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:23:37.784451 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:37.784423    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9s7lp\" (UniqueName: \"kubernetes.io/projected/cc49824b-9adb-4104-b929-fe5c7d492afa-kube-api-access-9s7lp\") pod \"maas-api-e2e-ait-19927e2d-696b4f595d-wwkgv\" (UID: \"cc49824b-9adb-4104-b929-fe5c7d492afa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-19927e2d-696b4f595d-wwkgv"
Jul 13 21:23:37.784562 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:37.784465    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc49824b-9adb-4104-b929-fe5c7d492afa-openshift-service-ca\") pod \"maas-api-e2e-ait-19927e2d-696b4f595d-wwkgv\" (UID: \"cc49824b-9adb-4104-b929-fe5c7d492afa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-19927e2d-696b4f595d-wwkgv"
Jul 13 21:23:37.784618 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:37.784560    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc49824b-9adb-4104-b929-fe5c7d492afa-maas-api-tls\") pod \"maas-api-e2e-ait-19927e2d-696b4f595d-wwkgv\" (UID: \"cc49824b-9adb-4104-b929-fe5c7d492afa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-19927e2d-696b4f595d-wwkgv"
Jul 13 21:23:37.885090 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:37.885012    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s7lp\" (UniqueName: \"kubernetes.io/projected/cc49824b-9adb-4104-b929-fe5c7d492afa-kube-api-access-9s7lp\") pod \"maas-api-e2e-ait-19927e2d-696b4f595d-wwkgv\" (UID: \"cc49824b-9adb-4104-b929-fe5c7d492afa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-19927e2d-696b4f595d-wwkgv"
Jul 13 21:23:37.885090 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:37.885056    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc49824b-9adb-4104-b929-fe5c7d492afa-openshift-service-ca\") pod \"maas-api-e2e-ait-19927e2d-696b4f595d-wwkgv\" (UID: \"cc49824b-9adb-4104-b929-fe5c7d492afa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-19927e2d-696b4f595d-wwkgv"
Jul 13 21:23:37.885295 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:37.885107    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc49824b-9adb-4104-b929-fe5c7d492afa-maas-api-tls\") pod \"maas-api-e2e-ait-19927e2d-696b4f595d-wwkgv\" (UID: \"cc49824b-9adb-4104-b929-fe5c7d492afa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-19927e2d-696b4f595d-wwkgv"
Jul 13 21:23:37.885295 ip-10-0-137-162 kubenswrapper[2561]: E0713 21:23:37.885234    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-19927e2d-serving-cert: secret "maas-api-e2e-ait-19927e2d-serving-cert" not found
Jul 13 21:23:37.885397 ip-10-0-137-162 kubenswrapper[2561]: E0713 21:23:37.885306    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc49824b-9adb-4104-b929-fe5c7d492afa-maas-api-tls podName:cc49824b-9adb-4104-b929-fe5c7d492afa nodeName:}" failed. No retries permitted until 2026-07-13 21:23:38.385284931 +0000 UTC m=+1791.380068349 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cc49824b-9adb-4104-b929-fe5c7d492afa-maas-api-tls") pod "maas-api-e2e-ait-19927e2d-696b4f595d-wwkgv" (UID: "cc49824b-9adb-4104-b929-fe5c7d492afa") : secret "maas-api-e2e-ait-19927e2d-serving-cert" not found
Jul 13 21:23:37.885825 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:37.885784    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc49824b-9adb-4104-b929-fe5c7d492afa-openshift-service-ca\") pod \"maas-api-e2e-ait-19927e2d-696b4f595d-wwkgv\" (UID: \"cc49824b-9adb-4104-b929-fe5c7d492afa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-19927e2d-696b4f595d-wwkgv"
Jul 13 21:23:37.895340 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:37.895315    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9s7lp\" (UniqueName: \"kubernetes.io/projected/cc49824b-9adb-4104-b929-fe5c7d492afa-kube-api-access-9s7lp\") pod \"maas-api-e2e-ait-19927e2d-696b4f595d-wwkgv\" (UID: \"cc49824b-9adb-4104-b929-fe5c7d492afa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-19927e2d-696b4f595d-wwkgv"
Jul 13 21:23:38.014971 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:38.014910    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:23:38.239383 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:38.239281    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:23:38.360731 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:38.360704    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:23:38.389614 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:38.389588    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc49824b-9adb-4104-b929-fe5c7d492afa-maas-api-tls\") pod \"maas-api-e2e-ait-19927e2d-696b4f595d-wwkgv\" (UID: \"cc49824b-9adb-4104-b929-fe5c7d492afa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-19927e2d-696b4f595d-wwkgv"
Jul 13 21:23:38.392203 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:38.392178    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc49824b-9adb-4104-b929-fe5c7d492afa-maas-api-tls\") pod \"maas-api-e2e-ait-19927e2d-696b4f595d-wwkgv\" (UID: \"cc49824b-9adb-4104-b929-fe5c7d492afa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-19927e2d-696b4f595d-wwkgv"
Jul 13 21:23:38.542396 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:38.542370    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-19927e2d-696b4f595d-wwkgv"
Jul 13 21:23:38.675015 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:38.674991    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-19927e2d-696b4f595d-wwkgv"]
Jul 13 21:23:38.676854 ip-10-0-137-162 kubenswrapper[2561]: W0713 21:23:38.676827    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc49824b_9adb_4104_b929_fe5c7d492afa.slice/crio-49e92001a03ebe2377f26dff4906c8f1e20ef8bbc9b434668435333aa3f2922b WatchSource:0}: Error finding container 49e92001a03ebe2377f26dff4906c8f1e20ef8bbc9b434668435333aa3f2922b: Status 404 returned error can't find the container with id 49e92001a03ebe2377f26dff4906c8f1e20ef8bbc9b434668435333aa3f2922b
Jul 13 21:23:38.678549 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:38.678534    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 21:23:39.124945 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:39.124917    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:23:39.399982 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:39.399912    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-19927e2d-696b4f595d-wwkgv" event={"ID":"cc49824b-9adb-4104-b929-fe5c7d492afa","Type":"ContainerStarted","Data":"49e92001a03ebe2377f26dff4906c8f1e20ef8bbc9b434668435333aa3f2922b"}
Jul 13 21:23:40.060224 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:40.060186    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:23:41.410736 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:41.410695    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-19927e2d-696b4f595d-wwkgv" event={"ID":"cc49824b-9adb-4104-b929-fe5c7d492afa","Type":"ContainerStarted","Data":"2647065e5072f54de2967ad7062e99c16e2145b8a1cd12edd0bc885a79cb34ec"}
Jul 13 21:23:41.411208 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:41.410776    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-19927e2d-696b4f595d-wwkgv"
Jul 13 21:23:41.430516 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:41.430474    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-19927e2d-696b4f595d-wwkgv" podStartSLOduration=2.621543593 podStartE2EDuration="4.430458794s" totalImagesPullingTime="1.808915201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:23:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:23:41.428796104 +0000 UTC m=+1794.423579524" watchObservedRunningTime="2026-07-13 21:23:41.430458794 +0000 UTC m=+1794.425242219"
Jul 13 21:23:47.420063 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:47.420033    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-19927e2d-696b4f595d-wwkgv"
Jul 13 21:23:47.783577 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:47.783556    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jrpbd_e730eed8-ff8a-4a54-b1cb-539d8f07e70b/ovn-acl-logging/0.log"
Jul 13 21:23:47.786219 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:23:47.786198    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jrpbd_e730eed8-ff8a-4a54-b1cb-539d8f07e70b/ovn-acl-logging/0.log"
Jul 13 21:24:25.091946 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:24:25.091914    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:24:25.169268 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:24:25.169243    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:24:53.164002 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:24:53.163971    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-19927e2d-696b4f595d-wwkgv"]
Jul 13 21:24:53.164445 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:24:53.164161    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-19927e2d-696b4f595d-wwkgv" podUID="cc49824b-9adb-4104-b929-fe5c7d492afa" containerName="maas-api" containerID="cri-o://2647065e5072f54de2967ad7062e99c16e2145b8a1cd12edd0bc885a79cb34ec" gracePeriod=30
Jul 13 21:24:53.190970 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:24:53.190937    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:24:53.409823 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:24:53.409791    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-19927e2d-696b4f595d-wwkgv"
Jul 13 21:24:53.492698 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:24:53.492639    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc49824b-9adb-4104-b929-fe5c7d492afa-maas-api-tls\") pod \"cc49824b-9adb-4104-b929-fe5c7d492afa\" (UID: \"cc49824b-9adb-4104-b929-fe5c7d492afa\") "
Jul 13 21:24:53.492698 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:24:53.492678    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc49824b-9adb-4104-b929-fe5c7d492afa-openshift-service-ca\") pod \"cc49824b-9adb-4104-b929-fe5c7d492afa\" (UID: \"cc49824b-9adb-4104-b929-fe5c7d492afa\") "
Jul 13 21:24:53.492874 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:24:53.492714    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9s7lp\" (UniqueName: \"kubernetes.io/projected/cc49824b-9adb-4104-b929-fe5c7d492afa-kube-api-access-9s7lp\") pod \"cc49824b-9adb-4104-b929-fe5c7d492afa\" (UID: \"cc49824b-9adb-4104-b929-fe5c7d492afa\") "
Jul 13 21:24:53.493088 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:24:53.493062    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc49824b-9adb-4104-b929-fe5c7d492afa-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cc49824b-9adb-4104-b929-fe5c7d492afa" (UID: "cc49824b-9adb-4104-b929-fe5c7d492afa"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:24:53.494856 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:24:53.494825    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc49824b-9adb-4104-b929-fe5c7d492afa-kube-api-access-9s7lp" (OuterVolumeSpecName: "kube-api-access-9s7lp") pod "cc49824b-9adb-4104-b929-fe5c7d492afa" (UID: "cc49824b-9adb-4104-b929-fe5c7d492afa"). InnerVolumeSpecName "kube-api-access-9s7lp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:24:53.494946 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:24:53.494866    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc49824b-9adb-4104-b929-fe5c7d492afa-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cc49824b-9adb-4104-b929-fe5c7d492afa" (UID: "cc49824b-9adb-4104-b929-fe5c7d492afa"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:24:53.593364 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:24:53.593335    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9s7lp\" (UniqueName: \"kubernetes.io/projected/cc49824b-9adb-4104-b929-fe5c7d492afa-kube-api-access-9s7lp\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:24:53.593364 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:24:53.593365    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc49824b-9adb-4104-b929-fe5c7d492afa-maas-api-tls\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:24:53.593491 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:24:53.593375    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc49824b-9adb-4104-b929-fe5c7d492afa-openshift-service-ca\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:24:53.695125 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:24:53.695094    2561 generic.go:356] "Generic (PLEG): container finished" podID="cc49824b-9adb-4104-b929-fe5c7d492afa" containerID="2647065e5072f54de2967ad7062e99c16e2145b8a1cd12edd0bc885a79cb34ec" exitCode=0
Jul 13 21:24:53.695224 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:24:53.695139    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-19927e2d-696b4f595d-wwkgv"
Jul 13 21:24:53.695224 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:24:53.695162    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-19927e2d-696b4f595d-wwkgv" event={"ID":"cc49824b-9adb-4104-b929-fe5c7d492afa","Type":"ContainerDied","Data":"2647065e5072f54de2967ad7062e99c16e2145b8a1cd12edd0bc885a79cb34ec"}
Jul 13 21:24:53.695224 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:24:53.695205    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-19927e2d-696b4f595d-wwkgv" event={"ID":"cc49824b-9adb-4104-b929-fe5c7d492afa","Type":"ContainerDied","Data":"49e92001a03ebe2377f26dff4906c8f1e20ef8bbc9b434668435333aa3f2922b"}
Jul 13 21:24:53.695390 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:24:53.695230    2561 scope.go:117] "RemoveContainer" containerID="2647065e5072f54de2967ad7062e99c16e2145b8a1cd12edd0bc885a79cb34ec"
Jul 13 21:24:53.703206 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:24:53.703189    2561 scope.go:117] "RemoveContainer" containerID="2647065e5072f54de2967ad7062e99c16e2145b8a1cd12edd0bc885a79cb34ec"
Jul 13 21:24:53.703486 ip-10-0-137-162 kubenswrapper[2561]: E0713 21:24:53.703465    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2647065e5072f54de2967ad7062e99c16e2145b8a1cd12edd0bc885a79cb34ec\": container with ID starting with 2647065e5072f54de2967ad7062e99c16e2145b8a1cd12edd0bc885a79cb34ec not found: ID does not exist" containerID="2647065e5072f54de2967ad7062e99c16e2145b8a1cd12edd0bc885a79cb34ec"
Jul 13 21:24:53.703546 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:24:53.703493    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2647065e5072f54de2967ad7062e99c16e2145b8a1cd12edd0bc885a79cb34ec"} err="failed to get container status \"2647065e5072f54de2967ad7062e99c16e2145b8a1cd12edd0bc885a79cb34ec\": rpc error: code = NotFound desc = could not find container \"2647065e5072f54de2967ad7062e99c16e2145b8a1cd12edd0bc885a79cb34ec\": container with ID starting with 2647065e5072f54de2967ad7062e99c16e2145b8a1cd12edd0bc885a79cb34ec not found: ID does not exist"
Jul 13 21:24:53.712029 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:24:53.712008    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-19927e2d-696b4f595d-wwkgv"]
Jul 13 21:24:53.715761 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:24:53.715743    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-19927e2d-696b4f595d-wwkgv"]
Jul 13 21:24:55.575648 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:24:55.575618    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc49824b-9adb-4104-b929-fe5c7d492afa" path="/var/lib/kubelet/pods/cc49824b-9adb-4104-b929-fe5c7d492afa/volumes"
Jul 13 21:24:57.687527 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:24:57.687485    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:25:03.383568 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:03.383534    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:25:03.450048 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:03.450015    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:25:07.882416 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:07.882381    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:25:08.262625 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:08.262534    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:25:08.356684 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:08.356633    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:25:08.477445 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:08.477408    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:25:09.697728 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:09.697656    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:25:09.773632 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:09.773605    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a6867856-6bc44bbc9c-jndbk"]
Jul 13 21:25:09.773919 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:09.773905    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc49824b-9adb-4104-b929-fe5c7d492afa" containerName="maas-api"
Jul 13 21:25:09.773919 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:09.773919    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc49824b-9adb-4104-b929-fe5c7d492afa" containerName="maas-api"
Jul 13 21:25:09.774041 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:09.773970    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc49824b-9adb-4104-b929-fe5c7d492afa" containerName="maas-api"
Jul 13 21:25:09.778484 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:09.778464    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a6867856-6bc44bbc9c-jndbk"
Jul 13 21:25:09.781228 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:09.781207    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 21:25:09.781350 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:09.781207    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-j4tgz\""
Jul 13 21:25:09.781350 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:09.781241    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-a6867856-serving-cert\""
Jul 13 21:25:09.782237 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:09.782218    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 13 21:25:09.788106 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:09.788085    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a6867856-6bc44bbc9c-jndbk"]
Jul 13 21:25:09.807157 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:09.807130    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:25:09.814373 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:09.814351    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vlrp\" (UniqueName: \"kubernetes.io/projected/0eff09a8-9a12-468e-8b69-089d84da80d3-kube-api-access-5vlrp\") pod \"maas-api-e2e-migrate-a6867856-6bc44bbc9c-jndbk\" (UID: \"0eff09a8-9a12-468e-8b69-089d84da80d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a6867856-6bc44bbc9c-jndbk"
Jul 13 21:25:09.814471 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:09.814396    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0eff09a8-9a12-468e-8b69-089d84da80d3-openshift-service-ca\") pod \"maas-api-e2e-migrate-a6867856-6bc44bbc9c-jndbk\" (UID: \"0eff09a8-9a12-468e-8b69-089d84da80d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a6867856-6bc44bbc9c-jndbk"
Jul 13 21:25:09.814471 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:09.814414    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0eff09a8-9a12-468e-8b69-089d84da80d3-maas-api-tls\") pod \"maas-api-e2e-migrate-a6867856-6bc44bbc9c-jndbk\" (UID: \"0eff09a8-9a12-468e-8b69-089d84da80d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a6867856-6bc44bbc9c-jndbk"
Jul 13 21:25:09.915142 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:09.915115    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vlrp\" (UniqueName: \"kubernetes.io/projected/0eff09a8-9a12-468e-8b69-089d84da80d3-kube-api-access-5vlrp\") pod \"maas-api-e2e-migrate-a6867856-6bc44bbc9c-jndbk\" (UID: \"0eff09a8-9a12-468e-8b69-089d84da80d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a6867856-6bc44bbc9c-jndbk"
Jul 13 21:25:09.915284 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:09.915170    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0eff09a8-9a12-468e-8b69-089d84da80d3-openshift-service-ca\") pod \"maas-api-e2e-migrate-a6867856-6bc44bbc9c-jndbk\" (UID: \"0eff09a8-9a12-468e-8b69-089d84da80d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a6867856-6bc44bbc9c-jndbk"
Jul 13 21:25:09.915284 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:09.915215    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0eff09a8-9a12-468e-8b69-089d84da80d3-maas-api-tls\") pod \"maas-api-e2e-migrate-a6867856-6bc44bbc9c-jndbk\" (UID: \"0eff09a8-9a12-468e-8b69-089d84da80d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a6867856-6bc44bbc9c-jndbk"
Jul 13 21:25:09.915860 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:09.915843    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0eff09a8-9a12-468e-8b69-089d84da80d3-openshift-service-ca\") pod \"maas-api-e2e-migrate-a6867856-6bc44bbc9c-jndbk\" (UID: \"0eff09a8-9a12-468e-8b69-089d84da80d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a6867856-6bc44bbc9c-jndbk"
Jul 13 21:25:09.917640 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:09.917619    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0eff09a8-9a12-468e-8b69-089d84da80d3-maas-api-tls\") pod \"maas-api-e2e-migrate-a6867856-6bc44bbc9c-jndbk\" (UID: \"0eff09a8-9a12-468e-8b69-089d84da80d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a6867856-6bc44bbc9c-jndbk"
Jul 13 21:25:09.925953 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:09.925935    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vlrp\" (UniqueName: \"kubernetes.io/projected/0eff09a8-9a12-468e-8b69-089d84da80d3-kube-api-access-5vlrp\") pod \"maas-api-e2e-migrate-a6867856-6bc44bbc9c-jndbk\" (UID: \"0eff09a8-9a12-468e-8b69-089d84da80d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a6867856-6bc44bbc9c-jndbk"
Jul 13 21:25:09.957892 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:09.957841    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:25:10.090735 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:10.090714    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a6867856-6bc44bbc9c-jndbk"
Jul 13 21:25:10.218872 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:10.218848    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a6867856-6bc44bbc9c-jndbk"]
Jul 13 21:25:10.221348 ip-10-0-137-162 kubenswrapper[2561]: W0713 21:25:10.221319    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eff09a8_9a12_468e_8b69_089d84da80d3.slice/crio-4e32085958f46ac46490949b1aa1adba0947a9afcd97a7c1a46332b857cc0955 WatchSource:0}: Error finding container 4e32085958f46ac46490949b1aa1adba0947a9afcd97a7c1a46332b857cc0955: Status 404 returned error can't find the container with id 4e32085958f46ac46490949b1aa1adba0947a9afcd97a7c1a46332b857cc0955
Jul 13 21:25:10.302677 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:10.302644    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:25:10.402087 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:10.402045    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:25:10.764799 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:10.764768    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a6867856-6bc44bbc9c-jndbk" event={"ID":"0eff09a8-9a12-468e-8b69-089d84da80d3","Type":"ContainerStarted","Data":"ff8b3b6b67906e2d6ab40bac38b7f2e37cde82dbfcf566d7f4877379209437c4"}
Jul 13 21:25:10.765213 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:10.764901    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a6867856-6bc44bbc9c-jndbk" event={"ID":"0eff09a8-9a12-468e-8b69-089d84da80d3","Type":"ContainerStarted","Data":"4e32085958f46ac46490949b1aa1adba0947a9afcd97a7c1a46332b857cc0955"}
Jul 13 21:25:10.765213 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:10.764937    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a6867856-6bc44bbc9c-jndbk"
Jul 13 21:25:10.787471 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:10.787427    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a6867856-6bc44bbc9c-jndbk" podStartSLOduration=1.32467521 podStartE2EDuration="1.787411334s" totalImagesPullingTime="462.736124ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:25:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:25:10.785979355 +0000 UTC m=+1883.780762778" watchObservedRunningTime="2026-07-13 21:25:10.787411334 +0000 UTC m=+1883.782194774"
Jul 13 21:25:14.205954 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:14.205919    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a6867856-mklfd"]
Jul 13 21:25:14.209183 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:14.209167    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a6867856-mklfd"
Jul 13 21:25:14.211902 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:14.211884    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rnndk\""
Jul 13 21:25:14.216936 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:14.216916    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a6867856-mklfd"]
Jul 13 21:25:14.252994 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:14.252933    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb011b4f-b7ff-4ccd-a034-c431b9519254-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a6867856-mklfd\" (UID: \"eb011b4f-b7ff-4ccd-a034-c431b9519254\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a6867856-mklfd"
Jul 13 21:25:14.353877 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:14.353851    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb011b4f-b7ff-4ccd-a034-c431b9519254-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a6867856-mklfd\" (UID: \"eb011b4f-b7ff-4ccd-a034-c431b9519254\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a6867856-mklfd"
Jul 13 21:25:14.354407 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:14.354389    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb011b4f-b7ff-4ccd-a034-c431b9519254-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a6867856-mklfd\" (UID: \"eb011b4f-b7ff-4ccd-a034-c431b9519254\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a6867856-mklfd"
Jul 13 21:25:14.460115 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:14.460077    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:25:14.521064 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:14.521026    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a6867856-mklfd"
Jul 13 21:25:14.564708 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:14.564673    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:25:14.649613 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:14.649587    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a6867856-mklfd"]
Jul 13 21:25:14.652446 ip-10-0-137-162 kubenswrapper[2561]: W0713 21:25:14.652422    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb011b4f_b7ff_4ccd_a034_c431b9519254.slice/crio-7f7a909ded0181f0203089f58346b2a723f9ffe22f621a107c00e5d7b79c7189 WatchSource:0}: Error finding container 7f7a909ded0181f0203089f58346b2a723f9ffe22f621a107c00e5d7b79c7189: Status 404 returned error can't find the container with id 7f7a909ded0181f0203089f58346b2a723f9ffe22f621a107c00e5d7b79c7189
Jul 13 21:25:14.783900 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:14.783808    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a6867856-mklfd" event={"ID":"eb011b4f-b7ff-4ccd-a034-c431b9519254","Type":"ContainerStarted","Data":"7f7a909ded0181f0203089f58346b2a723f9ffe22f621a107c00e5d7b79c7189"}
Jul 13 21:25:16.774929 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:16.774899    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a6867856-6bc44bbc9c-jndbk"
Jul 13 21:25:17.689832 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:17.689769    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:25:18.803027 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:18.802992    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a6867856-mklfd" event={"ID":"eb011b4f-b7ff-4ccd-a034-c431b9519254","Type":"ContainerStarted","Data":"69f7710ac6d604cbcaf1614df6183c8082ecbf13e98b48181171ec17bb84fed0"}
Jul 13 21:25:18.818255 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:18.818199    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a6867856-mklfd" podStartSLOduration=1.11176076 podStartE2EDuration="4.818181971s" totalImagesPullingTime="3.706421211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:25:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:25:18.817181541 +0000 UTC m=+1891.811964963" watchObservedRunningTime="2026-07-13 21:25:18.818181971 +0000 UTC m=+1891.812965393"
Jul 13 21:25:19.808656 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:19.808622    2561 generic.go:356] "Generic (PLEG): container finished" podID="eb011b4f-b7ff-4ccd-a034-c431b9519254" containerID="69f7710ac6d604cbcaf1614df6183c8082ecbf13e98b48181171ec17bb84fed0" exitCode=0
Jul 13 21:25:19.809077 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:19.808690    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a6867856-mklfd" event={"ID":"eb011b4f-b7ff-4ccd-a034-c431b9519254","Type":"ContainerDied","Data":"69f7710ac6d604cbcaf1614df6183c8082ecbf13e98b48181171ec17bb84fed0"}
Jul 13 21:25:20.941266 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:20.941244    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a6867856-mklfd"
Jul 13 21:25:21.008164 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:21.008135    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb011b4f-b7ff-4ccd-a034-c431b9519254-maas-api-service-ca\") pod \"eb011b4f-b7ff-4ccd-a034-c431b9519254\" (UID: \"eb011b4f-b7ff-4ccd-a034-c431b9519254\") "
Jul 13 21:25:21.008509 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:21.008491    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb011b4f-b7ff-4ccd-a034-c431b9519254-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "eb011b4f-b7ff-4ccd-a034-c431b9519254" (UID: "eb011b4f-b7ff-4ccd-a034-c431b9519254"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:25:21.109479 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:21.109418    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb011b4f-b7ff-4ccd-a034-c431b9519254-maas-api-service-ca\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:25:21.818392 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:21.818365    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a6867856-mklfd"
Jul 13 21:25:21.818392 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:21.818375    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a6867856-mklfd" event={"ID":"eb011b4f-b7ff-4ccd-a034-c431b9519254","Type":"ContainerDied","Data":"7f7a909ded0181f0203089f58346b2a723f9ffe22f621a107c00e5d7b79c7189"}
Jul 13 21:25:21.818559 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:21.818450    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7f7a909ded0181f0203089f58346b2a723f9ffe22f621a107c00e5d7b79c7189"
Jul 13 21:25:24.912663 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:24.912634    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a6867856-6bc44bbc9c-jndbk"]
Jul 13 21:25:24.913073 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:24.912860    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a6867856-6bc44bbc9c-jndbk" podUID="0eff09a8-9a12-468e-8b69-089d84da80d3" containerName="maas-api" containerID="cri-o://ff8b3b6b67906e2d6ab40bac38b7f2e37cde82dbfcf566d7f4877379209437c4" gracePeriod=30
Jul 13 21:25:24.935315 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:24.935293    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:25:25.167297 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:25.167244    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a6867856-6bc44bbc9c-jndbk"
Jul 13 21:25:25.243397 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:25.243366    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0eff09a8-9a12-468e-8b69-089d84da80d3-maas-api-tls\") pod \"0eff09a8-9a12-468e-8b69-089d84da80d3\" (UID: \"0eff09a8-9a12-468e-8b69-089d84da80d3\") "
Jul 13 21:25:25.243552 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:25.243438    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vlrp\" (UniqueName: \"kubernetes.io/projected/0eff09a8-9a12-468e-8b69-089d84da80d3-kube-api-access-5vlrp\") pod \"0eff09a8-9a12-468e-8b69-089d84da80d3\" (UID: \"0eff09a8-9a12-468e-8b69-089d84da80d3\") "
Jul 13 21:25:25.243552 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:25.243460    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0eff09a8-9a12-468e-8b69-089d84da80d3-openshift-service-ca\") pod \"0eff09a8-9a12-468e-8b69-089d84da80d3\" (UID: \"0eff09a8-9a12-468e-8b69-089d84da80d3\") "
Jul 13 21:25:25.243905 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:25.243882    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0eff09a8-9a12-468e-8b69-089d84da80d3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0eff09a8-9a12-468e-8b69-089d84da80d3" (UID: "0eff09a8-9a12-468e-8b69-089d84da80d3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:25:25.245599 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:25.245569    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0eff09a8-9a12-468e-8b69-089d84da80d3-kube-api-access-5vlrp" (OuterVolumeSpecName: "kube-api-access-5vlrp") pod "0eff09a8-9a12-468e-8b69-089d84da80d3" (UID: "0eff09a8-9a12-468e-8b69-089d84da80d3"). InnerVolumeSpecName "kube-api-access-5vlrp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:25:25.245703 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:25.245576    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0eff09a8-9a12-468e-8b69-089d84da80d3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0eff09a8-9a12-468e-8b69-089d84da80d3" (UID: "0eff09a8-9a12-468e-8b69-089d84da80d3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:25:25.344175 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:25.344149    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0eff09a8-9a12-468e-8b69-089d84da80d3-maas-api-tls\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:25:25.344175 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:25.344173    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vlrp\" (UniqueName: \"kubernetes.io/projected/0eff09a8-9a12-468e-8b69-089d84da80d3-kube-api-access-5vlrp\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:25:25.344340 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:25.344183    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0eff09a8-9a12-468e-8b69-089d84da80d3-openshift-service-ca\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:25:25.836294 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:25.836266    2561 generic.go:356] "Generic (PLEG): container finished" podID="0eff09a8-9a12-468e-8b69-089d84da80d3" containerID="ff8b3b6b67906e2d6ab40bac38b7f2e37cde82dbfcf566d7f4877379209437c4" exitCode=0
Jul 13 21:25:25.836441 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:25.836303    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a6867856-6bc44bbc9c-jndbk"
Jul 13 21:25:25.836441 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:25.836314    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a6867856-6bc44bbc9c-jndbk" event={"ID":"0eff09a8-9a12-468e-8b69-089d84da80d3","Type":"ContainerDied","Data":"ff8b3b6b67906e2d6ab40bac38b7f2e37cde82dbfcf566d7f4877379209437c4"}
Jul 13 21:25:25.836441 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:25.836379    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a6867856-6bc44bbc9c-jndbk" event={"ID":"0eff09a8-9a12-468e-8b69-089d84da80d3","Type":"ContainerDied","Data":"4e32085958f46ac46490949b1aa1adba0947a9afcd97a7c1a46332b857cc0955"}
Jul 13 21:25:25.836441 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:25.836405    2561 scope.go:117] "RemoveContainer" containerID="ff8b3b6b67906e2d6ab40bac38b7f2e37cde82dbfcf566d7f4877379209437c4"
Jul 13 21:25:25.844918 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:25.844899    2561 scope.go:117] "RemoveContainer" containerID="ff8b3b6b67906e2d6ab40bac38b7f2e37cde82dbfcf566d7f4877379209437c4"
Jul 13 21:25:25.845137 ip-10-0-137-162 kubenswrapper[2561]: E0713 21:25:25.845122    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff8b3b6b67906e2d6ab40bac38b7f2e37cde82dbfcf566d7f4877379209437c4\": container with ID starting with ff8b3b6b67906e2d6ab40bac38b7f2e37cde82dbfcf566d7f4877379209437c4 not found: ID does not exist" containerID="ff8b3b6b67906e2d6ab40bac38b7f2e37cde82dbfcf566d7f4877379209437c4"
Jul 13 21:25:25.845198 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:25.845143    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff8b3b6b67906e2d6ab40bac38b7f2e37cde82dbfcf566d7f4877379209437c4"} err="failed to get container status \"ff8b3b6b67906e2d6ab40bac38b7f2e37cde82dbfcf566d7f4877379209437c4\": rpc error: code = NotFound desc = could not find container \"ff8b3b6b67906e2d6ab40bac38b7f2e37cde82dbfcf566d7f4877379209437c4\": container with ID starting with ff8b3b6b67906e2d6ab40bac38b7f2e37cde82dbfcf566d7f4877379209437c4 not found: ID does not exist"
Jul 13 21:25:25.851981 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:25.851962    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a6867856-6bc44bbc9c-jndbk"]
Jul 13 21:25:25.855364 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:25.855342    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a6867856-6bc44bbc9c-jndbk"]
Jul 13 21:25:27.576250 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:27.576210    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0eff09a8-9a12-468e-8b69-089d84da80d3" path="/var/lib/kubelet/pods/0eff09a8-9a12-468e-8b69-089d84da80d3/volumes"
Jul 13 21:25:29.298168 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:29.298135    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:25:35.558578 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:35.558538    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:25:35.623961 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:35.623929    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:25:39.479902 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:39.479867    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:25:39.742512 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:39.742440    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck"]
Jul 13 21:25:39.742735 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:39.742724    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb011b4f-b7ff-4ccd-a034-c431b9519254" containerName="revoke-keys"
Jul 13 21:25:39.742775 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:39.742736    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb011b4f-b7ff-4ccd-a034-c431b9519254" containerName="revoke-keys"
Jul 13 21:25:39.742775 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:39.742753    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0eff09a8-9a12-468e-8b69-089d84da80d3" containerName="maas-api"
Jul 13 21:25:39.742775 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:39.742759    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0eff09a8-9a12-468e-8b69-089d84da80d3" containerName="maas-api"
Jul 13 21:25:39.742887 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:39.742804    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0eff09a8-9a12-468e-8b69-089d84da80d3" containerName="maas-api"
Jul 13 21:25:39.742887 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:39.742829    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb011b4f-b7ff-4ccd-a034-c431b9519254" containerName="revoke-keys"
Jul 13 21:25:39.747396 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:39.747373    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck"
Jul 13 21:25:39.750000 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:39.749977    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-74bf51e2-openshift-default-dockercfg-57rdg\""
Jul 13 21:25:39.758291 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:39.758267    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck"]
Jul 13 21:25:39.779982 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:39.779893    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:25:39.867456 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:39.867422    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e2854f9-8829-4783-9ef8-c8ed4157faa5-workload-certs\") pod \"e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck\" (UID: \"6e2854f9-8829-4783-9ef8-c8ed4157faa5\") " pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck"
Jul 13 21:25:39.867456 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:39.867457    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e2854f9-8829-4783-9ef8-c8ed4157faa5-workload-socket\") pod \"e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck\" (UID: \"6e2854f9-8829-4783-9ef8-c8ed4157faa5\") " pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck"
Jul 13 21:25:39.867645 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:39.867477    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rsmb\" (UniqueName: \"kubernetes.io/projected/6e2854f9-8829-4783-9ef8-c8ed4157faa5-kube-api-access-5rsmb\") pod \"e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck\" (UID: \"6e2854f9-8829-4783-9ef8-c8ed4157faa5\") " pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck"
Jul 13 21:25:39.867645 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:39.867547    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e2854f9-8829-4783-9ef8-c8ed4157faa5-istiod-ca-cert\") pod \"e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck\" (UID: \"6e2854f9-8829-4783-9ef8-c8ed4157faa5\") " pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck"
Jul 13 21:25:39.867645 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:39.867626    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e2854f9-8829-4783-9ef8-c8ed4157faa5-istio-podinfo\") pod \"e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck\" (UID: \"6e2854f9-8829-4783-9ef8-c8ed4157faa5\") " pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck"
Jul 13 21:25:39.867756 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:39.867654    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e2854f9-8829-4783-9ef8-c8ed4157faa5-credential-socket\") pod \"e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck\" (UID: \"6e2854f9-8829-4783-9ef8-c8ed4157faa5\") " pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck"
Jul 13 21:25:39.867756 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:39.867680    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e2854f9-8829-4783-9ef8-c8ed4157faa5-istio-data\") pod \"e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck\" (UID: \"6e2854f9-8829-4783-9ef8-c8ed4157faa5\") " pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck"
Jul 13 21:25:39.867756 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:39.867723    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e2854f9-8829-4783-9ef8-c8ed4157faa5-istio-envoy\") pod \"e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck\" (UID: \"6e2854f9-8829-4783-9ef8-c8ed4157faa5\") " pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck"
Jul 13 21:25:39.867756 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:39.867741    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e2854f9-8829-4783-9ef8-c8ed4157faa5-istio-token\") pod \"e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck\" (UID: \"6e2854f9-8829-4783-9ef8-c8ed4157faa5\") " pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck"
Jul 13 21:25:39.968173 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:39.968146    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e2854f9-8829-4783-9ef8-c8ed4157faa5-workload-certs\") pod \"e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck\" (UID: \"6e2854f9-8829-4783-9ef8-c8ed4157faa5\") " pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck"
Jul 13 21:25:39.968173 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:39.968175    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e2854f9-8829-4783-9ef8-c8ed4157faa5-workload-socket\") pod \"e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck\" (UID: \"6e2854f9-8829-4783-9ef8-c8ed4157faa5\") " pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck"
Jul 13 21:25:39.968344 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:39.968195    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rsmb\" (UniqueName: \"kubernetes.io/projected/6e2854f9-8829-4783-9ef8-c8ed4157faa5-kube-api-access-5rsmb\") pod \"e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck\" (UID: \"6e2854f9-8829-4783-9ef8-c8ed4157faa5\") " pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck"
Jul 13 21:25:39.968344 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:39.968307    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e2854f9-8829-4783-9ef8-c8ed4157faa5-istiod-ca-cert\") pod \"e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck\" (UID: \"6e2854f9-8829-4783-9ef8-c8ed4157faa5\") " pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck"
Jul 13 21:25:39.968453 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:39.968347    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e2854f9-8829-4783-9ef8-c8ed4157faa5-istio-podinfo\") pod \"e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck\" (UID: \"6e2854f9-8829-4783-9ef8-c8ed4157faa5\") " pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck"
Jul 13 21:25:39.968453 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:39.968364    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e2854f9-8829-4783-9ef8-c8ed4157faa5-credential-socket\") pod \"e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck\" (UID: \"6e2854f9-8829-4783-9ef8-c8ed4157faa5\") " pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck"
Jul 13 21:25:39.968453 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:39.968387    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e2854f9-8829-4783-9ef8-c8ed4157faa5-istio-data\") pod \"e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck\" (UID: \"6e2854f9-8829-4783-9ef8-c8ed4157faa5\") " pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck"
Jul 13 21:25:39.968620 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:39.968513    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e2854f9-8829-4783-9ef8-c8ed4157faa5-workload-socket\") pod \"e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck\" (UID: \"6e2854f9-8829-4783-9ef8-c8ed4157faa5\") " pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck"
Jul 13 21:25:39.968620 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:39.968574    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e2854f9-8829-4783-9ef8-c8ed4157faa5-workload-certs\") pod \"e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck\" (UID: \"6e2854f9-8829-4783-9ef8-c8ed4157faa5\") " pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck"
Jul 13 21:25:39.968620 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:39.968590    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e2854f9-8829-4783-9ef8-c8ed4157faa5-istio-envoy\") pod \"e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck\" (UID: \"6e2854f9-8829-4783-9ef8-c8ed4157faa5\") " pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck"
Jul 13 21:25:39.968757 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:39.968632    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e2854f9-8829-4783-9ef8-c8ed4157faa5-istio-token\") pod \"e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck\" (UID: \"6e2854f9-8829-4783-9ef8-c8ed4157faa5\") " pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck"
Jul 13 21:25:39.968757 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:39.968676    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e2854f9-8829-4783-9ef8-c8ed4157faa5-istio-data\") pod \"e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck\" (UID: \"6e2854f9-8829-4783-9ef8-c8ed4157faa5\") " pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck"
Jul 13 21:25:39.968757 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:39.968711    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e2854f9-8829-4783-9ef8-c8ed4157faa5-credential-socket\") pod \"e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck\" (UID: \"6e2854f9-8829-4783-9ef8-c8ed4157faa5\") " pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck"
Jul 13 21:25:39.969034 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:39.969015    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e2854f9-8829-4783-9ef8-c8ed4157faa5-istiod-ca-cert\") pod \"e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck\" (UID: \"6e2854f9-8829-4783-9ef8-c8ed4157faa5\") " pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck"
Jul 13 21:25:39.970615 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:39.970594    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e2854f9-8829-4783-9ef8-c8ed4157faa5-istio-envoy\") pod \"e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck\" (UID: \"6e2854f9-8829-4783-9ef8-c8ed4157faa5\") " pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck"
Jul 13 21:25:39.970837 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:39.970805    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e2854f9-8829-4783-9ef8-c8ed4157faa5-istio-podinfo\") pod \"e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck\" (UID: \"6e2854f9-8829-4783-9ef8-c8ed4157faa5\") " pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck"
Jul 13 21:25:39.976620 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:39.976598    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e2854f9-8829-4783-9ef8-c8ed4157faa5-istio-token\") pod \"e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck\" (UID: \"6e2854f9-8829-4783-9ef8-c8ed4157faa5\") " pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck"
Jul 13 21:25:39.977062 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:39.977037    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rsmb\" (UniqueName: \"kubernetes.io/projected/6e2854f9-8829-4783-9ef8-c8ed4157faa5-kube-api-access-5rsmb\") pod \"e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck\" (UID: \"6e2854f9-8829-4783-9ef8-c8ed4157faa5\") " pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck"
Jul 13 21:25:40.058193 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:40.058160    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck"
Jul 13 21:25:40.195137 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:40.194998    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck"]
Jul 13 21:25:40.197239 ip-10-0-137-162 kubenswrapper[2561]: W0713 21:25:40.197202    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e2854f9_8829_4783_9ef8_c8ed4157faa5.slice/crio-5a3d1c44d51324ef0d98c9002dfdf1b9a2059bf935c1b3dfe02ade1c03abd2d3 WatchSource:0}: Error finding container 5a3d1c44d51324ef0d98c9002dfdf1b9a2059bf935c1b3dfe02ade1c03abd2d3: Status 404 returned error can't find the container with id 5a3d1c44d51324ef0d98c9002dfdf1b9a2059bf935c1b3dfe02ade1c03abd2d3
Jul 13 21:25:40.199486 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:40.199455    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 21:25:40.199564 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:40.199519    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 21:25:40.199564 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:40.199551    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 21:25:40.901987 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:40.901951    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:25:40.902427 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:40.902345    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck" event={"ID":"6e2854f9-8829-4783-9ef8-c8ed4157faa5","Type":"ContainerStarted","Data":"84036b574280fb493e9c382402abc6c377d0a3bf4de22e95d11058df84f81a08"}
Jul 13 21:25:40.902427 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:40.902395    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck" event={"ID":"6e2854f9-8829-4783-9ef8-c8ed4157faa5","Type":"ContainerStarted","Data":"5a3d1c44d51324ef0d98c9002dfdf1b9a2059bf935c1b3dfe02ade1c03abd2d3"}
Jul 13 21:25:40.932943 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:40.932891    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck" podStartSLOduration=1.9328747210000001 podStartE2EDuration="1.932874721s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:25:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:25:40.932734848 +0000 UTC m=+1913.927518283" watchObservedRunningTime="2026-07-13 21:25:40.932874721 +0000 UTC m=+1913.927658197"
Jul 13 21:25:40.989057 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:40.989020    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-74bf51e2-57669bfc55-lkgc7"]
Jul 13 21:25:40.991132 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:40.991109    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:25:40.992741 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:40.992721    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-74bf51e2-57669bfc55-lkgc7"
Jul 13 21:25:40.995514 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:40.995492    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-74bf51e2-serving-cert\""
Jul 13 21:25:40.995642 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:40.995531    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 21:25:40.995642 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:40.995547    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-j4tgz\""
Jul 13 21:25:40.995841 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:40.995801    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 13 21:25:41.004875 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:41.004844    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-74bf51e2-57669bfc55-lkgc7"]
Jul 13 21:25:41.058869 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:41.058838    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck"
Jul 13 21:25:41.063467 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:41.063439    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck"
Jul 13 21:25:41.077843 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:41.077803    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvhtr\" (UniqueName: \"kubernetes.io/projected/9b8b0500-ac0e-404c-9656-8004fbdd1d36-kube-api-access-hvhtr\") pod \"maas-api-e2e-ait-74bf51e2-57669bfc55-lkgc7\" (UID: \"9b8b0500-ac0e-404c-9656-8004fbdd1d36\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-74bf51e2-57669bfc55-lkgc7"
Jul 13 21:25:41.077990 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:41.077884    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b8b0500-ac0e-404c-9656-8004fbdd1d36-openshift-service-ca\") pod \"maas-api-e2e-ait-74bf51e2-57669bfc55-lkgc7\" (UID: \"9b8b0500-ac0e-404c-9656-8004fbdd1d36\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-74bf51e2-57669bfc55-lkgc7"
Jul 13 21:25:41.077990 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:41.077956    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b8b0500-ac0e-404c-9656-8004fbdd1d36-maas-api-tls\") pod \"maas-api-e2e-ait-74bf51e2-57669bfc55-lkgc7\" (UID: \"9b8b0500-ac0e-404c-9656-8004fbdd1d36\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-74bf51e2-57669bfc55-lkgc7"
Jul 13 21:25:41.129388 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:41.129359    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:25:41.178597 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:41.178521    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvhtr\" (UniqueName: \"kubernetes.io/projected/9b8b0500-ac0e-404c-9656-8004fbdd1d36-kube-api-access-hvhtr\") pod \"maas-api-e2e-ait-74bf51e2-57669bfc55-lkgc7\" (UID: \"9b8b0500-ac0e-404c-9656-8004fbdd1d36\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-74bf51e2-57669bfc55-lkgc7"
Jul 13 21:25:41.178597 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:41.178578    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b8b0500-ac0e-404c-9656-8004fbdd1d36-openshift-service-ca\") pod \"maas-api-e2e-ait-74bf51e2-57669bfc55-lkgc7\" (UID: \"9b8b0500-ac0e-404c-9656-8004fbdd1d36\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-74bf51e2-57669bfc55-lkgc7"
Jul 13 21:25:41.178762 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:41.178604    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b8b0500-ac0e-404c-9656-8004fbdd1d36-maas-api-tls\") pod \"maas-api-e2e-ait-74bf51e2-57669bfc55-lkgc7\" (UID: \"9b8b0500-ac0e-404c-9656-8004fbdd1d36\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-74bf51e2-57669bfc55-lkgc7"
Jul 13 21:25:41.178798 ip-10-0-137-162 kubenswrapper[2561]: E0713 21:25:41.178770    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-74bf51e2-serving-cert: secret "maas-api-e2e-ait-74bf51e2-serving-cert" not found
Jul 13 21:25:41.178893 ip-10-0-137-162 kubenswrapper[2561]: E0713 21:25:41.178882    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b8b0500-ac0e-404c-9656-8004fbdd1d36-maas-api-tls podName:9b8b0500-ac0e-404c-9656-8004fbdd1d36 nodeName:}" failed. No retries permitted until 2026-07-13 21:25:41.678859404 +0000 UTC m=+1914.673642810 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9b8b0500-ac0e-404c-9656-8004fbdd1d36-maas-api-tls") pod "maas-api-e2e-ait-74bf51e2-57669bfc55-lkgc7" (UID: "9b8b0500-ac0e-404c-9656-8004fbdd1d36") : secret "maas-api-e2e-ait-74bf51e2-serving-cert" not found
Jul 13 21:25:41.179235 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:41.179217    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b8b0500-ac0e-404c-9656-8004fbdd1d36-openshift-service-ca\") pod \"maas-api-e2e-ait-74bf51e2-57669bfc55-lkgc7\" (UID: \"9b8b0500-ac0e-404c-9656-8004fbdd1d36\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-74bf51e2-57669bfc55-lkgc7"
Jul 13 21:25:41.189995 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:41.189973    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvhtr\" (UniqueName: \"kubernetes.io/projected/9b8b0500-ac0e-404c-9656-8004fbdd1d36-kube-api-access-hvhtr\") pod \"maas-api-e2e-ait-74bf51e2-57669bfc55-lkgc7\" (UID: \"9b8b0500-ac0e-404c-9656-8004fbdd1d36\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-74bf51e2-57669bfc55-lkgc7"
Jul 13 21:25:41.446049 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:41.445970    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:25:41.548968 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:41.548925    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:25:41.683586 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:41.683554    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b8b0500-ac0e-404c-9656-8004fbdd1d36-maas-api-tls\") pod \"maas-api-e2e-ait-74bf51e2-57669bfc55-lkgc7\" (UID: \"9b8b0500-ac0e-404c-9656-8004fbdd1d36\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-74bf51e2-57669bfc55-lkgc7"
Jul 13 21:25:41.685780 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:41.685763    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b8b0500-ac0e-404c-9656-8004fbdd1d36-maas-api-tls\") pod \"maas-api-e2e-ait-74bf51e2-57669bfc55-lkgc7\" (UID: \"9b8b0500-ac0e-404c-9656-8004fbdd1d36\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-74bf51e2-57669bfc55-lkgc7"
Jul 13 21:25:41.687593 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:41.687574    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:25:41.906190 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:41.906164    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-74bf51e2-57669bfc55-lkgc7"
Jul 13 21:25:41.907184 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:41.907164    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck"
Jul 13 21:25:41.908097 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:41.908075    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck"
Jul 13 21:25:42.046343 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:42.046316    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-74bf51e2-57669bfc55-lkgc7"]
Jul 13 21:25:42.048426 ip-10-0-137-162 kubenswrapper[2561]: W0713 21:25:42.048390    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b8b0500_ac0e_404c_9656_8004fbdd1d36.slice/crio-1a33253b0c5035d4b6eff5cc193454fa717595dc20c891334fd319e10f913b2e WatchSource:0}: Error finding container 1a33253b0c5035d4b6eff5cc193454fa717595dc20c891334fd319e10f913b2e: Status 404 returned error can't find the container with id 1a33253b0c5035d4b6eff5cc193454fa717595dc20c891334fd319e10f913b2e
Jul 13 21:25:42.912584 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:42.912549    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-74bf51e2-57669bfc55-lkgc7" event={"ID":"9b8b0500-ac0e-404c-9656-8004fbdd1d36","Type":"ContainerStarted","Data":"fdcaa7cf6883559b66072275bc264478122f88756dc8579f2965dbde32057e8f"}
Jul 13 21:25:42.912986 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:42.912745    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-74bf51e2-57669bfc55-lkgc7"
Jul 13 21:25:42.912986 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:42.912790    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-74bf51e2-57669bfc55-lkgc7" event={"ID":"9b8b0500-ac0e-404c-9656-8004fbdd1d36","Type":"ContainerStarted","Data":"1a33253b0c5035d4b6eff5cc193454fa717595dc20c891334fd319e10f913b2e"}
Jul 13 21:25:42.931021 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:42.930980    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-74bf51e2-57669bfc55-lkgc7" podStartSLOduration=2.485953013 podStartE2EDuration="2.930966787s" totalImagesPullingTime="445.013774ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:25:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:25:42.928708446 +0000 UTC m=+1915.923491869" watchObservedRunningTime="2026-07-13 21:25:42.930966787 +0000 UTC m=+1915.925750251"
Jul 13 21:25:45.759227 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:45.759173    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:25:45.860154 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:45.860106    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:25:48.924117 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:48.924082    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-74bf51e2-57669bfc55-lkgc7"
Jul 13 21:25:49.135240 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:49.135200    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:25:51.952755 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:51.952724    2561 generic.go:356] "Generic (PLEG): container finished" podID="6e2854f9-8829-4783-9ef8-c8ed4157faa5" containerID="84036b574280fb493e9c382402abc6c377d0a3bf4de22e95d11058df84f81a08" exitCode=0
Jul 13 21:25:51.953260 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:51.952798    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck" event={"ID":"6e2854f9-8829-4783-9ef8-c8ed4157faa5","Type":"ContainerDied","Data":"84036b574280fb493e9c382402abc6c377d0a3bf4de22e95d11058df84f81a08"}
Jul 13 21:25:51.953260 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:51.953252    2561 scope.go:117] "RemoveContainer" containerID="84036b574280fb493e9c382402abc6c377d0a3bf4de22e95d11058df84f81a08"
Jul 13 21:25:51.954245 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:51.954217    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 21:25:51.954342 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:51.954282    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 21:25:51.954342 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:51.954314    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 21:25:52.959543 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:52.959509    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck" event={"ID":"6e2854f9-8829-4783-9ef8-c8ed4157faa5","Type":"ContainerStarted","Data":"ad812057f2070cc304902e2f47f75d08529174d2e6efee0e7b08f4426ae65d31"}
Jul 13 21:25:53.058856 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:53.058804    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck"
Jul 13 21:25:53.059788 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:53.059765    2561 patch_prober.go:28] interesting pod/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body=
Jul 13 21:25:53.059890 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:53.059863    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck" podUID="6e2854f9-8829-4783-9ef8-c8ed4157faa5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused"
Jul 13 21:25:54.059021 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:54.058988    2561 patch_prober.go:28] interesting pod/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body=
Jul 13 21:25:54.059380 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:54.059037    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck" podUID="6e2854f9-8829-4783-9ef8-c8ed4157faa5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused"
Jul 13 21:25:55.059488 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:55.059456    2561 patch_prober.go:28] interesting pod/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body=
Jul 13 21:25:55.059879 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:55.059505    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck" podUID="6e2854f9-8829-4783-9ef8-c8ed4157faa5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused"
Jul 13 21:25:56.058974 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:56.058937    2561 patch_prober.go:28] interesting pod/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body=
Jul 13 21:25:56.059174 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:56.059007    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck" podUID="6e2854f9-8829-4783-9ef8-c8ed4157faa5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused"
Jul 13 21:25:56.907312 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:56.907276    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck"
Jul 13 21:25:57.062252 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:57.062225    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck"
Jul 13 21:25:57.063141 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:25:57.063121    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck"
Jul 13 21:26:46.632778 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:26:46.632702    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:26:46.735157 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:26:46.735088    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:26:47.379527 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:26:47.379476    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:26:47.540342 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:26:47.540296    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:26:56.537595 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:26:56.537561    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-74bf51e2-57669bfc55-lkgc7"]
Jul 13 21:26:56.538110 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:26:56.537779    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-74bf51e2-57669bfc55-lkgc7" podUID="9b8b0500-ac0e-404c-9656-8004fbdd1d36" containerName="maas-api" containerID="cri-o://fdcaa7cf6883559b66072275bc264478122f88756dc8579f2965dbde32057e8f" gracePeriod=30
Jul 13 21:26:56.565474 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:26:56.565450    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:26:56.781682 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:26:56.781660    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-74bf51e2-57669bfc55-lkgc7"
Jul 13 21:26:56.787702 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:26:56.787662    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvhtr\" (UniqueName: \"kubernetes.io/projected/9b8b0500-ac0e-404c-9656-8004fbdd1d36-kube-api-access-hvhtr\") pod \"9b8b0500-ac0e-404c-9656-8004fbdd1d36\" (UID: \"9b8b0500-ac0e-404c-9656-8004fbdd1d36\") "
Jul 13 21:26:56.787767 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:26:56.787709    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b8b0500-ac0e-404c-9656-8004fbdd1d36-openshift-service-ca\") pod \"9b8b0500-ac0e-404c-9656-8004fbdd1d36\" (UID: \"9b8b0500-ac0e-404c-9656-8004fbdd1d36\") "
Jul 13 21:26:56.787767 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:26:56.787738    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b8b0500-ac0e-404c-9656-8004fbdd1d36-maas-api-tls\") pod \"9b8b0500-ac0e-404c-9656-8004fbdd1d36\" (UID: \"9b8b0500-ac0e-404c-9656-8004fbdd1d36\") "
Jul 13 21:26:56.788078 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:26:56.788057    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b8b0500-ac0e-404c-9656-8004fbdd1d36-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9b8b0500-ac0e-404c-9656-8004fbdd1d36" (UID: "9b8b0500-ac0e-404c-9656-8004fbdd1d36"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:26:56.789599 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:26:56.789580    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b8b0500-ac0e-404c-9656-8004fbdd1d36-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9b8b0500-ac0e-404c-9656-8004fbdd1d36" (UID: "9b8b0500-ac0e-404c-9656-8004fbdd1d36"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:26:56.789665 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:26:56.789585    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b8b0500-ac0e-404c-9656-8004fbdd1d36-kube-api-access-hvhtr" (OuterVolumeSpecName: "kube-api-access-hvhtr") pod "9b8b0500-ac0e-404c-9656-8004fbdd1d36" (UID: "9b8b0500-ac0e-404c-9656-8004fbdd1d36"). InnerVolumeSpecName "kube-api-access-hvhtr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:26:56.888374 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:26:56.888353    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b8b0500-ac0e-404c-9656-8004fbdd1d36-maas-api-tls\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:26:56.888374 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:26:56.888373    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvhtr\" (UniqueName: \"kubernetes.io/projected/9b8b0500-ac0e-404c-9656-8004fbdd1d36-kube-api-access-hvhtr\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:26:56.888503 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:26:56.888383    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b8b0500-ac0e-404c-9656-8004fbdd1d36-openshift-service-ca\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:26:57.237461 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:26:57.237386    2561 generic.go:356] "Generic (PLEG): container finished" podID="9b8b0500-ac0e-404c-9656-8004fbdd1d36" containerID="fdcaa7cf6883559b66072275bc264478122f88756dc8579f2965dbde32057e8f" exitCode=0
Jul 13 21:26:57.237461 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:26:57.237426    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-74bf51e2-57669bfc55-lkgc7"
Jul 13 21:26:57.237613 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:26:57.237466    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-74bf51e2-57669bfc55-lkgc7" event={"ID":"9b8b0500-ac0e-404c-9656-8004fbdd1d36","Type":"ContainerDied","Data":"fdcaa7cf6883559b66072275bc264478122f88756dc8579f2965dbde32057e8f"}
Jul 13 21:26:57.237613 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:26:57.237511    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-74bf51e2-57669bfc55-lkgc7" event={"ID":"9b8b0500-ac0e-404c-9656-8004fbdd1d36","Type":"ContainerDied","Data":"1a33253b0c5035d4b6eff5cc193454fa717595dc20c891334fd319e10f913b2e"}
Jul 13 21:26:57.237613 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:26:57.237532    2561 scope.go:117] "RemoveContainer" containerID="fdcaa7cf6883559b66072275bc264478122f88756dc8579f2965dbde32057e8f"
Jul 13 21:26:57.246574 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:26:57.246559    2561 scope.go:117] "RemoveContainer" containerID="fdcaa7cf6883559b66072275bc264478122f88756dc8579f2965dbde32057e8f"
Jul 13 21:26:57.246788 ip-10-0-137-162 kubenswrapper[2561]: E0713 21:26:57.246773    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdcaa7cf6883559b66072275bc264478122f88756dc8579f2965dbde32057e8f\": container with ID starting with fdcaa7cf6883559b66072275bc264478122f88756dc8579f2965dbde32057e8f not found: ID does not exist" containerID="fdcaa7cf6883559b66072275bc264478122f88756dc8579f2965dbde32057e8f"
Jul 13 21:26:57.246890 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:26:57.246795    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdcaa7cf6883559b66072275bc264478122f88756dc8579f2965dbde32057e8f"} err="failed to get container status \"fdcaa7cf6883559b66072275bc264478122f88756dc8579f2965dbde32057e8f\": rpc error: code = NotFound desc = could not find container \"fdcaa7cf6883559b66072275bc264478122f88756dc8579f2965dbde32057e8f\": container with ID starting with fdcaa7cf6883559b66072275bc264478122f88756dc8579f2965dbde32057e8f not found: ID does not exist"
Jul 13 21:26:57.259049 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:26:57.259028    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-74bf51e2-57669bfc55-lkgc7"]
Jul 13 21:26:57.263514 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:26:57.263493    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-74bf51e2-57669bfc55-lkgc7"]
Jul 13 21:26:57.576531 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:26:57.576498    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b8b0500-ac0e-404c-9656-8004fbdd1d36" path="/var/lib/kubelet/pods/9b8b0500-ac0e-404c-9656-8004fbdd1d36/volumes"
Jul 13 21:27:01.216439 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:01.216407    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:27:07.101721 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:07.101691    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:27:07.186699 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:07.186669    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:27:12.198146 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:12.198109    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck"]
Jul 13 21:27:12.198551 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:12.198322    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck" podUID="6e2854f9-8829-4783-9ef8-c8ed4157faa5" containerName="istio-proxy" containerID="cri-o://ad812057f2070cc304902e2f47f75d08529174d2e6efee0e7b08f4426ae65d31" gracePeriod=30
Jul 13 21:27:12.221495 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:12.221468    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:27:12.516744 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:12.516716    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:27:13.624179 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:13.624147    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:27:13.722294 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:13.722261    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:27:13.857296 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:13.857261    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f555b378-6d758ff565-dwjb7"]
Jul 13 21:27:13.857829 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:13.857673    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b8b0500-ac0e-404c-9656-8004fbdd1d36" containerName="maas-api"
Jul 13 21:27:13.857829 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:13.857690    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b8b0500-ac0e-404c-9656-8004fbdd1d36" containerName="maas-api"
Jul 13 21:27:13.857829 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:13.857781    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b8b0500-ac0e-404c-9656-8004fbdd1d36" containerName="maas-api"
Jul 13 21:27:13.862214 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:13.862193    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f555b378-6d758ff565-dwjb7"
Jul 13 21:27:13.865106 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:13.865067    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-f555b378-serving-cert\""
Jul 13 21:27:13.865216 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:13.865174    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-j4tgz\""
Jul 13 21:27:13.865280 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:13.865075    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 21:27:13.866076 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:13.866059    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 13 21:27:13.871052 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:13.871031    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f555b378-6d758ff565-dwjb7"]
Jul 13 21:27:13.891724 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:13.891646    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:27:13.908862 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:13.908841    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xfck\" (UniqueName: \"kubernetes.io/projected/67b8c347-2d72-40e2-877a-4af683bb17f4-kube-api-access-7xfck\") pod \"maas-api-e2e-derive-f555b378-6d758ff565-dwjb7\" (UID: \"67b8c347-2d72-40e2-877a-4af683bb17f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f555b378-6d758ff565-dwjb7"
Jul 13 21:27:13.908971 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:13.908905    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67b8c347-2d72-40e2-877a-4af683bb17f4-maas-api-tls\") pod \"maas-api-e2e-derive-f555b378-6d758ff565-dwjb7\" (UID: \"67b8c347-2d72-40e2-877a-4af683bb17f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f555b378-6d758ff565-dwjb7"
Jul 13 21:27:13.908971 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:13.908947    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67b8c347-2d72-40e2-877a-4af683bb17f4-openshift-service-ca\") pod \"maas-api-e2e-derive-f555b378-6d758ff565-dwjb7\" (UID: \"67b8c347-2d72-40e2-877a-4af683bb17f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f555b378-6d758ff565-dwjb7"
Jul 13 21:27:14.010436 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:14.010401    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xfck\" (UniqueName: \"kubernetes.io/projected/67b8c347-2d72-40e2-877a-4af683bb17f4-kube-api-access-7xfck\") pod \"maas-api-e2e-derive-f555b378-6d758ff565-dwjb7\" (UID: \"67b8c347-2d72-40e2-877a-4af683bb17f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f555b378-6d758ff565-dwjb7"
Jul 13 21:27:14.010574 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:14.010456    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67b8c347-2d72-40e2-877a-4af683bb17f4-maas-api-tls\") pod \"maas-api-e2e-derive-f555b378-6d758ff565-dwjb7\" (UID: \"67b8c347-2d72-40e2-877a-4af683bb17f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f555b378-6d758ff565-dwjb7"
Jul 13 21:27:14.010574 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:14.010481    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67b8c347-2d72-40e2-877a-4af683bb17f4-openshift-service-ca\") pod \"maas-api-e2e-derive-f555b378-6d758ff565-dwjb7\" (UID: \"67b8c347-2d72-40e2-877a-4af683bb17f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f555b378-6d758ff565-dwjb7"
Jul 13 21:27:14.011088 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:14.011061    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67b8c347-2d72-40e2-877a-4af683bb17f4-openshift-service-ca\") pod \"maas-api-e2e-derive-f555b378-6d758ff565-dwjb7\" (UID: \"67b8c347-2d72-40e2-877a-4af683bb17f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f555b378-6d758ff565-dwjb7"
Jul 13 21:27:14.019355 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:14.019329    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67b8c347-2d72-40e2-877a-4af683bb17f4-maas-api-tls\") pod \"maas-api-e2e-derive-f555b378-6d758ff565-dwjb7\" (UID: \"67b8c347-2d72-40e2-877a-4af683bb17f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f555b378-6d758ff565-dwjb7"
Jul 13 21:27:14.020183 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:14.020158    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:27:14.021577 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:14.021552    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xfck\" (UniqueName: \"kubernetes.io/projected/67b8c347-2d72-40e2-877a-4af683bb17f4-kube-api-access-7xfck\") pod \"maas-api-e2e-derive-f555b378-6d758ff565-dwjb7\" (UID: \"67b8c347-2d72-40e2-877a-4af683bb17f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f555b378-6d758ff565-dwjb7"
Jul 13 21:27:14.174276 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:14.174187    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f555b378-6d758ff565-dwjb7"
Jul 13 21:27:14.300863 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:14.300836    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f555b378-6d758ff565-dwjb7"]
Jul 13 21:27:14.303314 ip-10-0-137-162 kubenswrapper[2561]: W0713 21:27:14.303287    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67b8c347_2d72_40e2_877a_4af683bb17f4.slice/crio-f844cf61f70098683ea0521bc1cf43dbf4985083efa6d4e616a518a8f989e2dc WatchSource:0}: Error finding container f844cf61f70098683ea0521bc1cf43dbf4985083efa6d4e616a518a8f989e2dc: Status 404 returned error can't find the container with id f844cf61f70098683ea0521bc1cf43dbf4985083efa6d4e616a518a8f989e2dc
Jul 13 21:27:14.311942 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:14.311914    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f555b378-6d758ff565-dwjb7" event={"ID":"67b8c347-2d72-40e2-877a-4af683bb17f4","Type":"ContainerStarted","Data":"f844cf61f70098683ea0521bc1cf43dbf4985083efa6d4e616a518a8f989e2dc"}
Jul 13 21:27:14.369087 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:14.369051    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:27:14.470007 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:14.469931    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:27:15.317931 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:15.317901    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f555b378-6d758ff565-dwjb7" event={"ID":"67b8c347-2d72-40e2-877a-4af683bb17f4","Type":"ContainerStarted","Data":"662860b5991b6604a2949383399cc0629f544440a9682a79d357b32b0a3676c6"}
Jul 13 21:27:15.318316 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:15.318006    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f555b378-6d758ff565-dwjb7"
Jul 13 21:27:15.334548 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:15.334500    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f555b378-6d758ff565-dwjb7" podStartSLOduration=2.000362497 podStartE2EDuration="2.334486288s" totalImagesPullingTime="334.123791ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:27:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:27:15.333523305 +0000 UTC m=+2008.328306729" watchObservedRunningTime="2026-07-13 21:27:15.334486288 +0000 UTC m=+2008.329269711"
Jul 13 21:27:17.328635 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:17.328608    2561 generic.go:356] "Generic (PLEG): container finished" podID="6e2854f9-8829-4783-9ef8-c8ed4157faa5" containerID="ad812057f2070cc304902e2f47f75d08529174d2e6efee0e7b08f4426ae65d31" exitCode=0
Jul 13 21:27:17.328993 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:17.328684    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck" event={"ID":"6e2854f9-8829-4783-9ef8-c8ed4157faa5","Type":"ContainerDied","Data":"ad812057f2070cc304902e2f47f75d08529174d2e6efee0e7b08f4426ae65d31"}
Jul 13 21:27:17.328993 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:17.328743    2561 scope.go:117] "RemoveContainer" containerID="84036b574280fb493e9c382402abc6c377d0a3bf4de22e95d11058df84f81a08"
Jul 13 21:27:17.439485 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:17.439465    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck"
Jul 13 21:27:17.543383 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:17.543359    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rsmb\" (UniqueName: \"kubernetes.io/projected/6e2854f9-8829-4783-9ef8-c8ed4157faa5-kube-api-access-5rsmb\") pod \"6e2854f9-8829-4783-9ef8-c8ed4157faa5\" (UID: \"6e2854f9-8829-4783-9ef8-c8ed4157faa5\") "
Jul 13 21:27:17.543519 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:17.543393    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e2854f9-8829-4783-9ef8-c8ed4157faa5-credential-socket\") pod \"6e2854f9-8829-4783-9ef8-c8ed4157faa5\" (UID: \"6e2854f9-8829-4783-9ef8-c8ed4157faa5\") "
Jul 13 21:27:17.543519 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:17.543411    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e2854f9-8829-4783-9ef8-c8ed4157faa5-istio-data\") pod \"6e2854f9-8829-4783-9ef8-c8ed4157faa5\" (UID: \"6e2854f9-8829-4783-9ef8-c8ed4157faa5\") "
Jul 13 21:27:17.543519 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:17.543430    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e2854f9-8829-4783-9ef8-c8ed4157faa5-istio-token\") pod \"6e2854f9-8829-4783-9ef8-c8ed4157faa5\" (UID: \"6e2854f9-8829-4783-9ef8-c8ed4157faa5\") "
Jul 13 21:27:17.543519 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:17.543472    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e2854f9-8829-4783-9ef8-c8ed4157faa5-workload-socket\") pod \"6e2854f9-8829-4783-9ef8-c8ed4157faa5\" (UID: \"6e2854f9-8829-4783-9ef8-c8ed4157faa5\") "
Jul 13 21:27:17.543519 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:17.543497    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e2854f9-8829-4783-9ef8-c8ed4157faa5-istiod-ca-cert\") pod \"6e2854f9-8829-4783-9ef8-c8ed4157faa5\" (UID: \"6e2854f9-8829-4783-9ef8-c8ed4157faa5\") "
Jul 13 21:27:17.543748 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:17.543524    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e2854f9-8829-4783-9ef8-c8ed4157faa5-istio-podinfo\") pod \"6e2854f9-8829-4783-9ef8-c8ed4157faa5\" (UID: \"6e2854f9-8829-4783-9ef8-c8ed4157faa5\") "
Jul 13 21:27:17.543748 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:17.543553    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e2854f9-8829-4783-9ef8-c8ed4157faa5-istio-envoy\") pod \"6e2854f9-8829-4783-9ef8-c8ed4157faa5\" (UID: \"6e2854f9-8829-4783-9ef8-c8ed4157faa5\") "
Jul 13 21:27:17.543748 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:17.543579    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e2854f9-8829-4783-9ef8-c8ed4157faa5-workload-certs\") pod \"6e2854f9-8829-4783-9ef8-c8ed4157faa5\" (UID: \"6e2854f9-8829-4783-9ef8-c8ed4157faa5\") "
Jul 13 21:27:17.543748 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:17.543692    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e2854f9-8829-4783-9ef8-c8ed4157faa5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6e2854f9-8829-4783-9ef8-c8ed4157faa5" (UID: "6e2854f9-8829-4783-9ef8-c8ed4157faa5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:27:17.544064 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:17.543846    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e2854f9-8829-4783-9ef8-c8ed4157faa5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6e2854f9-8829-4783-9ef8-c8ed4157faa5" (UID: "6e2854f9-8829-4783-9ef8-c8ed4157faa5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:27:17.544064 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:17.543896    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e2854f9-8829-4783-9ef8-c8ed4157faa5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6e2854f9-8829-4783-9ef8-c8ed4157faa5" (UID: "6e2854f9-8829-4783-9ef8-c8ed4157faa5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:27:17.544064 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:17.543924    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e2854f9-8829-4783-9ef8-c8ed4157faa5-credential-socket\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:27:17.544064 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:17.543943    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e2854f9-8829-4783-9ef8-c8ed4157faa5-workload-socket\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:27:17.544310 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:17.544284    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e2854f9-8829-4783-9ef8-c8ed4157faa5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6e2854f9-8829-4783-9ef8-c8ed4157faa5" (UID: "6e2854f9-8829-4783-9ef8-c8ed4157faa5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:27:17.544681 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:17.544642    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e2854f9-8829-4783-9ef8-c8ed4157faa5-istio-data" (OuterVolumeSpecName: "istio-data") pod "6e2854f9-8829-4783-9ef8-c8ed4157faa5" (UID: "6e2854f9-8829-4783-9ef8-c8ed4157faa5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:27:17.546265 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:17.546219    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e2854f9-8829-4783-9ef8-c8ed4157faa5-kube-api-access-5rsmb" (OuterVolumeSpecName: "kube-api-access-5rsmb") pod "6e2854f9-8829-4783-9ef8-c8ed4157faa5" (UID: "6e2854f9-8829-4783-9ef8-c8ed4157faa5"). InnerVolumeSpecName "kube-api-access-5rsmb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:27:17.546363 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:17.546273    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e2854f9-8829-4783-9ef8-c8ed4157faa5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6e2854f9-8829-4783-9ef8-c8ed4157faa5" (UID: "6e2854f9-8829-4783-9ef8-c8ed4157faa5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:27:17.546363 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:17.546278    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e2854f9-8829-4783-9ef8-c8ed4157faa5-istio-token" (OuterVolumeSpecName: "istio-token") pod "6e2854f9-8829-4783-9ef8-c8ed4157faa5" (UID: "6e2854f9-8829-4783-9ef8-c8ed4157faa5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:27:17.546363 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:17.546343    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6e2854f9-8829-4783-9ef8-c8ed4157faa5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6e2854f9-8829-4783-9ef8-c8ed4157faa5" (UID: "6e2854f9-8829-4783-9ef8-c8ed4157faa5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 21:27:17.645195 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:17.645173    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rsmb\" (UniqueName: \"kubernetes.io/projected/6e2854f9-8829-4783-9ef8-c8ed4157faa5-kube-api-access-5rsmb\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:27:17.645303 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:17.645198    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e2854f9-8829-4783-9ef8-c8ed4157faa5-istio-data\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:27:17.645303 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:17.645211    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e2854f9-8829-4783-9ef8-c8ed4157faa5-istio-token\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:27:17.645303 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:17.645222    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e2854f9-8829-4783-9ef8-c8ed4157faa5-istiod-ca-cert\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:27:17.645303 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:17.645232    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e2854f9-8829-4783-9ef8-c8ed4157faa5-istio-podinfo\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:27:17.645303 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:17.645243    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e2854f9-8829-4783-9ef8-c8ed4157faa5-istio-envoy\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:27:17.645303 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:17.645256    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e2854f9-8829-4783-9ef8-c8ed4157faa5-workload-certs\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:27:18.044597 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:18.044565    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f555b378-bkzqq"]
Jul 13 21:27:18.044888 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:18.044876    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e2854f9-8829-4783-9ef8-c8ed4157faa5" containerName="istio-proxy"
Jul 13 21:27:18.044936 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:18.044890    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e2854f9-8829-4783-9ef8-c8ed4157faa5" containerName="istio-proxy"
Jul 13 21:27:18.044936 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:18.044900    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e2854f9-8829-4783-9ef8-c8ed4157faa5" containerName="istio-proxy"
Jul 13 21:27:18.044936 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:18.044905    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e2854f9-8829-4783-9ef8-c8ed4157faa5" containerName="istio-proxy"
Jul 13 21:27:18.045045 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:18.044961    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e2854f9-8829-4783-9ef8-c8ed4157faa5" containerName="istio-proxy"
Jul 13 21:27:18.045045 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:18.044969    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e2854f9-8829-4783-9ef8-c8ed4157faa5" containerName="istio-proxy"
Jul 13 21:27:18.048157 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:18.048141    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f555b378-bkzqq"
Jul 13 21:27:18.050666 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:18.050649    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rnndk\""
Jul 13 21:27:18.054682 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:18.054660    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f555b378-bkzqq"]
Jul 13 21:27:18.149190 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:18.149156    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb3e6172-4da0-4f96-a02b-276bcf0054d4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f555b378-bkzqq\" (UID: \"bb3e6172-4da0-4f96-a02b-276bcf0054d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f555b378-bkzqq"
Jul 13 21:27:18.250219 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:18.250187    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb3e6172-4da0-4f96-a02b-276bcf0054d4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f555b378-bkzqq\" (UID: \"bb3e6172-4da0-4f96-a02b-276bcf0054d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f555b378-bkzqq"
Jul 13 21:27:18.250752 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:18.250735    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb3e6172-4da0-4f96-a02b-276bcf0054d4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f555b378-bkzqq\" (UID: \"bb3e6172-4da0-4f96-a02b-276bcf0054d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f555b378-bkzqq"
Jul 13 21:27:18.333828 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:18.333757    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck" event={"ID":"6e2854f9-8829-4783-9ef8-c8ed4157faa5","Type":"ContainerDied","Data":"5a3d1c44d51324ef0d98c9002dfdf1b9a2059bf935c1b3dfe02ade1c03abd2d3"}
Jul 13 21:27:18.333828 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:18.333786    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck"
Jul 13 21:27:18.334232 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:18.333830    2561 scope.go:117] "RemoveContainer" containerID="ad812057f2070cc304902e2f47f75d08529174d2e6efee0e7b08f4426ae65d31"
Jul 13 21:27:18.358538 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:18.358510    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck"]
Jul 13 21:27:18.359451 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:18.359431    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f555b378-bkzqq"
Jul 13 21:27:18.360211 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:18.360192    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-74bf51e2-openshift-default-9f87865f5-sppck"]
Jul 13 21:27:18.480436 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:18.480411    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f555b378-bkzqq"]
Jul 13 21:27:18.482852 ip-10-0-137-162 kubenswrapper[2561]: W0713 21:27:18.482804    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb3e6172_4da0_4f96_a02b_276bcf0054d4.slice/crio-5bda005641ea2bf12434d3bc9e23a2c98ea7effb4acaa9ca6ef2702632fd2d43 WatchSource:0}: Error finding container 5bda005641ea2bf12434d3bc9e23a2c98ea7effb4acaa9ca6ef2702632fd2d43: Status 404 returned error can't find the container with id 5bda005641ea2bf12434d3bc9e23a2c98ea7effb4acaa9ca6ef2702632fd2d43
Jul 13 21:27:18.541451 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:18.541426    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:27:18.597198 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:18.597136    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:27:19.340314 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:19.340249    2561 generic.go:356] "Generic (PLEG): container finished" podID="bb3e6172-4da0-4f96-a02b-276bcf0054d4" containerID="51877fed1310bd9e7694717b115d84992f2256171f68e9bd8d11f585a3715d43" exitCode=7
Jul 13 21:27:19.340605 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:19.340337    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f555b378-bkzqq" event={"ID":"bb3e6172-4da0-4f96-a02b-276bcf0054d4","Type":"ContainerDied","Data":"51877fed1310bd9e7694717b115d84992f2256171f68e9bd8d11f585a3715d43"}
Jul 13 21:27:19.340605 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:19.340382    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f555b378-bkzqq" event={"ID":"bb3e6172-4da0-4f96-a02b-276bcf0054d4","Type":"ContainerStarted","Data":"5bda005641ea2bf12434d3bc9e23a2c98ea7effb4acaa9ca6ef2702632fd2d43"}
Jul 13 21:27:19.340605 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:19.340472    2561 scope.go:117] "RemoveContainer" containerID="51877fed1310bd9e7694717b115d84992f2256171f68e9bd8d11f585a3715d43"
Jul 13 21:27:19.576147 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:19.576110    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e2854f9-8829-4783-9ef8-c8ed4157faa5" path="/var/lib/kubelet/pods/6e2854f9-8829-4783-9ef8-c8ed4157faa5/volumes"
Jul 13 21:27:20.346251 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:20.346218    2561 generic.go:356] "Generic (PLEG): container finished" podID="bb3e6172-4da0-4f96-a02b-276bcf0054d4" containerID="96f3b474f4443f4061b3a6ebca5add74ddc045103c5954a693c457b450e68d90" exitCode=7
Jul 13 21:27:20.346682 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:20.346303    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f555b378-bkzqq" event={"ID":"bb3e6172-4da0-4f96-a02b-276bcf0054d4","Type":"ContainerDied","Data":"96f3b474f4443f4061b3a6ebca5add74ddc045103c5954a693c457b450e68d90"}
Jul 13 21:27:20.346682 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:20.346358    2561 scope.go:117] "RemoveContainer" containerID="51877fed1310bd9e7694717b115d84992f2256171f68e9bd8d11f585a3715d43"
Jul 13 21:27:20.346682 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:20.346588    2561 scope.go:117] "RemoveContainer" containerID="96f3b474f4443f4061b3a6ebca5add74ddc045103c5954a693c457b450e68d90"
Jul 13 21:27:20.346879 ip-10-0-137-162 kubenswrapper[2561]: E0713 21:27:20.346854    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-f555b378-bkzqq_odh-ai-gateway-infra(bb3e6172-4da0-4f96-a02b-276bcf0054d4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f555b378-bkzqq" podUID="bb3e6172-4da0-4f96-a02b-276bcf0054d4"
Jul 13 21:27:21.328044 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:21.328019    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f555b378-6d758ff565-dwjb7"
Jul 13 21:27:21.353535 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:21.353513    2561 scope.go:117] "RemoveContainer" containerID="96f3b474f4443f4061b3a6ebca5add74ddc045103c5954a693c457b450e68d90"
Jul 13 21:27:21.353881 ip-10-0-137-162 kubenswrapper[2561]: E0713 21:27:21.353660    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-f555b378-bkzqq_odh-ai-gateway-infra(bb3e6172-4da0-4f96-a02b-276bcf0054d4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f555b378-bkzqq" podUID="bb3e6172-4da0-4f96-a02b-276bcf0054d4"
Jul 13 21:27:22.305369 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:22.305340    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:27:34.571675 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:34.571648    2561 scope.go:117] "RemoveContainer" containerID="96f3b474f4443f4061b3a6ebca5add74ddc045103c5954a693c457b450e68d90"
Jul 13 21:27:35.415386 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:35.415340    2561 generic.go:356] "Generic (PLEG): container finished" podID="bb3e6172-4da0-4f96-a02b-276bcf0054d4" containerID="458416c5311dc6ac47e6c07f1a6135622078083fcf8bb1b03407fe229d470e66" exitCode=0
Jul 13 21:27:35.415492 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:35.415407    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f555b378-bkzqq" event={"ID":"bb3e6172-4da0-4f96-a02b-276bcf0054d4","Type":"ContainerDied","Data":"458416c5311dc6ac47e6c07f1a6135622078083fcf8bb1b03407fe229d470e66"}
Jul 13 21:27:35.415492 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:35.415463    2561 scope.go:117] "RemoveContainer" containerID="96f3b474f4443f4061b3a6ebca5add74ddc045103c5954a693c457b450e68d90"
Jul 13 21:27:36.451957 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:36.451857    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f555b378-bkzqq"]
Jul 13 21:27:36.549991 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:36.549968    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f555b378-bkzqq"
Jul 13 21:27:36.698658 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:36.698578    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb3e6172-4da0-4f96-a02b-276bcf0054d4-maas-api-service-ca\") pod \"bb3e6172-4da0-4f96-a02b-276bcf0054d4\" (UID: \"bb3e6172-4da0-4f96-a02b-276bcf0054d4\") "
Jul 13 21:27:36.698976 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:36.698949    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb3e6172-4da0-4f96-a02b-276bcf0054d4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bb3e6172-4da0-4f96-a02b-276bcf0054d4" (UID: "bb3e6172-4da0-4f96-a02b-276bcf0054d4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:27:36.804585 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:36.804549    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb3e6172-4da0-4f96-a02b-276bcf0054d4-maas-api-service-ca\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:27:37.427996 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:37.427966    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f555b378-bkzqq"
Jul 13 21:27:37.428187 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:37.428000    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f555b378-bkzqq" event={"ID":"bb3e6172-4da0-4f96-a02b-276bcf0054d4","Type":"ContainerDied","Data":"5bda005641ea2bf12434d3bc9e23a2c98ea7effb4acaa9ca6ef2702632fd2d43"}
Jul 13 21:27:37.428187 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:37.428069    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5bda005641ea2bf12434d3bc9e23a2c98ea7effb4acaa9ca6ef2702632fd2d43"
Jul 13 21:27:37.460880 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:37.460854    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f555b378-bkzqq"]
Jul 13 21:27:37.462871 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:37.462850    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f555b378-bkzqq"]
Jul 13 21:27:37.576147 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:37.576121    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb3e6172-4da0-4f96-a02b-276bcf0054d4" path="/var/lib/kubelet/pods/bb3e6172-4da0-4f96-a02b-276bcf0054d4/volumes"
Jul 13 21:27:42.231081 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:27:42.231049    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:28:08.084531 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:08.084493    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f555b378-7sfhv"]
Jul 13 21:28:08.085111 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:08.084935    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb3e6172-4da0-4f96-a02b-276bcf0054d4" containerName="revoke-keys"
Jul 13 21:28:08.085111 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:08.084954    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb3e6172-4da0-4f96-a02b-276bcf0054d4" containerName="revoke-keys"
Jul 13 21:28:08.085111 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:08.084979    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb3e6172-4da0-4f96-a02b-276bcf0054d4" containerName="revoke-keys"
Jul 13 21:28:08.085111 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:08.084987    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb3e6172-4da0-4f96-a02b-276bcf0054d4" containerName="revoke-keys"
Jul 13 21:28:08.085111 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:08.085004    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb3e6172-4da0-4f96-a02b-276bcf0054d4" containerName="revoke-keys"
Jul 13 21:28:08.085111 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:08.085013    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb3e6172-4da0-4f96-a02b-276bcf0054d4" containerName="revoke-keys"
Jul 13 21:28:08.085111 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:08.085092    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb3e6172-4da0-4f96-a02b-276bcf0054d4" containerName="revoke-keys"
Jul 13 21:28:08.085111 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:08.085102    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb3e6172-4da0-4f96-a02b-276bcf0054d4" containerName="revoke-keys"
Jul 13 21:28:08.085111 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:08.085113    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb3e6172-4da0-4f96-a02b-276bcf0054d4" containerName="revoke-keys"
Jul 13 21:28:08.088102 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:08.088083    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f555b378-7sfhv"
Jul 13 21:28:08.090623 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:08.090599    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rnndk\""
Jul 13 21:28:08.095629 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:08.095533    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f555b378-7sfhv"]
Jul 13 21:28:08.131693 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:08.131673    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/422d7179-e252-4e2e-9882-582b1da9e4b3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f555b378-7sfhv\" (UID: \"422d7179-e252-4e2e-9882-582b1da9e4b3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f555b378-7sfhv"
Jul 13 21:28:08.232489 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:08.232467    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/422d7179-e252-4e2e-9882-582b1da9e4b3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f555b378-7sfhv\" (UID: \"422d7179-e252-4e2e-9882-582b1da9e4b3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f555b378-7sfhv"
Jul 13 21:28:08.233070 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:08.233053    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/422d7179-e252-4e2e-9882-582b1da9e4b3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f555b378-7sfhv\" (UID: \"422d7179-e252-4e2e-9882-582b1da9e4b3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f555b378-7sfhv"
Jul 13 21:28:08.399947 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:08.399880    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f555b378-7sfhv"
Jul 13 21:28:08.528114 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:08.528055    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f555b378-7sfhv"]
Jul 13 21:28:08.530207 ip-10-0-137-162 kubenswrapper[2561]: W0713 21:28:08.530175    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod422d7179_e252_4e2e_9882_582b1da9e4b3.slice/crio-413066f5f03348f137f4f823b4f5677ec6dc39feb7290288cc41485f78059bcd WatchSource:0}: Error finding container 413066f5f03348f137f4f823b4f5677ec6dc39feb7290288cc41485f78059bcd: Status 404 returned error can't find the container with id 413066f5f03348f137f4f823b4f5677ec6dc39feb7290288cc41485f78059bcd
Jul 13 21:28:08.561675 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:08.561649    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f555b378-7sfhv" event={"ID":"422d7179-e252-4e2e-9882-582b1da9e4b3","Type":"ContainerStarted","Data":"413066f5f03348f137f4f823b4f5677ec6dc39feb7290288cc41485f78059bcd"}
Jul 13 21:28:09.567648 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:09.567617    2561 generic.go:356] "Generic (PLEG): container finished" podID="422d7179-e252-4e2e-9882-582b1da9e4b3" containerID="2b7e050049b5106b1ec0d32bf08d65656a710bd70fccfc4af4ea1c43898ff34c" exitCode=0
Jul 13 21:28:09.567997 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:09.567701    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f555b378-7sfhv" event={"ID":"422d7179-e252-4e2e-9882-582b1da9e4b3","Type":"ContainerDied","Data":"2b7e050049b5106b1ec0d32bf08d65656a710bd70fccfc4af4ea1c43898ff34c"}
Jul 13 21:28:10.697804 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:10.697778    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f555b378-7sfhv"
Jul 13 21:28:10.751846 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:10.751805    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/422d7179-e252-4e2e-9882-582b1da9e4b3-maas-api-service-ca\") pod \"422d7179-e252-4e2e-9882-582b1da9e4b3\" (UID: \"422d7179-e252-4e2e-9882-582b1da9e4b3\") "
Jul 13 21:28:10.752151 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:10.752120    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/422d7179-e252-4e2e-9882-582b1da9e4b3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "422d7179-e252-4e2e-9882-582b1da9e4b3" (UID: "422d7179-e252-4e2e-9882-582b1da9e4b3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:28:10.852535 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:10.852481    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/422d7179-e252-4e2e-9882-582b1da9e4b3-maas-api-service-ca\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:28:11.577539 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:11.577513    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f555b378-7sfhv"
Jul 13 21:28:11.577684 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:11.577505    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f555b378-7sfhv" event={"ID":"422d7179-e252-4e2e-9882-582b1da9e4b3","Type":"ContainerDied","Data":"413066f5f03348f137f4f823b4f5677ec6dc39feb7290288cc41485f78059bcd"}
Jul 13 21:28:11.577684 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:11.577625    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="413066f5f03348f137f4f823b4f5677ec6dc39feb7290288cc41485f78059bcd"
Jul 13 21:28:18.637538 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:18.637495    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f555b378-6d758ff565-dwjb7"]
Jul 13 21:28:18.637999 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:18.637709    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f555b378-6d758ff565-dwjb7" podUID="67b8c347-2d72-40e2-877a-4af683bb17f4" containerName="maas-api" containerID="cri-o://662860b5991b6604a2949383399cc0629f544440a9682a79d357b32b0a3676c6" gracePeriod=30
Jul 13 21:28:18.664860 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:18.664834    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:28:18.881873 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:18.881851    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f555b378-6d758ff565-dwjb7"
Jul 13 21:28:18.913422 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:18.913358    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67b8c347-2d72-40e2-877a-4af683bb17f4-openshift-service-ca\") pod \"67b8c347-2d72-40e2-877a-4af683bb17f4\" (UID: \"67b8c347-2d72-40e2-877a-4af683bb17f4\") "
Jul 13 21:28:18.913511 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:18.913422    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xfck\" (UniqueName: \"kubernetes.io/projected/67b8c347-2d72-40e2-877a-4af683bb17f4-kube-api-access-7xfck\") pod \"67b8c347-2d72-40e2-877a-4af683bb17f4\" (UID: \"67b8c347-2d72-40e2-877a-4af683bb17f4\") "
Jul 13 21:28:18.913511 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:18.913473    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67b8c347-2d72-40e2-877a-4af683bb17f4-maas-api-tls\") pod \"67b8c347-2d72-40e2-877a-4af683bb17f4\" (UID: \"67b8c347-2d72-40e2-877a-4af683bb17f4\") "
Jul 13 21:28:18.913746 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:18.913721    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67b8c347-2d72-40e2-877a-4af683bb17f4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "67b8c347-2d72-40e2-877a-4af683bb17f4" (UID: "67b8c347-2d72-40e2-877a-4af683bb17f4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:28:18.915416 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:18.915387    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67b8c347-2d72-40e2-877a-4af683bb17f4-kube-api-access-7xfck" (OuterVolumeSpecName: "kube-api-access-7xfck") pod "67b8c347-2d72-40e2-877a-4af683bb17f4" (UID: "67b8c347-2d72-40e2-877a-4af683bb17f4"). InnerVolumeSpecName "kube-api-access-7xfck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:28:18.915526 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:18.915441    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67b8c347-2d72-40e2-877a-4af683bb17f4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "67b8c347-2d72-40e2-877a-4af683bb17f4" (UID: "67b8c347-2d72-40e2-877a-4af683bb17f4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:28:19.014684 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:19.014658    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67b8c347-2d72-40e2-877a-4af683bb17f4-openshift-service-ca\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:28:19.014684 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:19.014683    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xfck\" (UniqueName: \"kubernetes.io/projected/67b8c347-2d72-40e2-877a-4af683bb17f4-kube-api-access-7xfck\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:28:19.014843 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:19.014693    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67b8c347-2d72-40e2-877a-4af683bb17f4-maas-api-tls\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:28:19.610967 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:19.610940    2561 generic.go:356] "Generic (PLEG): container finished" podID="67b8c347-2d72-40e2-877a-4af683bb17f4" containerID="662860b5991b6604a2949383399cc0629f544440a9682a79d357b32b0a3676c6" exitCode=0
Jul 13 21:28:19.611107 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:19.610990    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f555b378-6d758ff565-dwjb7"
Jul 13 21:28:19.611107 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:19.611024    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f555b378-6d758ff565-dwjb7" event={"ID":"67b8c347-2d72-40e2-877a-4af683bb17f4","Type":"ContainerDied","Data":"662860b5991b6604a2949383399cc0629f544440a9682a79d357b32b0a3676c6"}
Jul 13 21:28:19.611107 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:19.611073    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f555b378-6d758ff565-dwjb7" event={"ID":"67b8c347-2d72-40e2-877a-4af683bb17f4","Type":"ContainerDied","Data":"f844cf61f70098683ea0521bc1cf43dbf4985083efa6d4e616a518a8f989e2dc"}
Jul 13 21:28:19.611107 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:19.611094    2561 scope.go:117] "RemoveContainer" containerID="662860b5991b6604a2949383399cc0629f544440a9682a79d357b32b0a3676c6"
Jul 13 21:28:19.618967 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:19.618948    2561 scope.go:117] "RemoveContainer" containerID="662860b5991b6604a2949383399cc0629f544440a9682a79d357b32b0a3676c6"
Jul 13 21:28:19.619230 ip-10-0-137-162 kubenswrapper[2561]: E0713 21:28:19.619211    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"662860b5991b6604a2949383399cc0629f544440a9682a79d357b32b0a3676c6\": container with ID starting with 662860b5991b6604a2949383399cc0629f544440a9682a79d357b32b0a3676c6 not found: ID does not exist" containerID="662860b5991b6604a2949383399cc0629f544440a9682a79d357b32b0a3676c6"
Jul 13 21:28:19.619282 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:19.619240    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"662860b5991b6604a2949383399cc0629f544440a9682a79d357b32b0a3676c6"} err="failed to get container status \"662860b5991b6604a2949383399cc0629f544440a9682a79d357b32b0a3676c6\": rpc error: code = NotFound desc = could not find container \"662860b5991b6604a2949383399cc0629f544440a9682a79d357b32b0a3676c6\": container with ID starting with 662860b5991b6604a2949383399cc0629f544440a9682a79d357b32b0a3676c6 not found: ID does not exist"
Jul 13 21:28:19.626772 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:19.626751    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f555b378-6d758ff565-dwjb7"]
Jul 13 21:28:19.637061 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:19.632798    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f555b378-6d758ff565-dwjb7"]
Jul 13 21:28:21.576348 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:21.576315    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67b8c347-2d72-40e2-877a-4af683bb17f4" path="/var/lib/kubelet/pods/67b8c347-2d72-40e2-877a-4af683bb17f4/volumes"
Jul 13 21:28:23.171244 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:23.171210    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:28:28.848741 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:28.848708    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:28:28.946723 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:28.946692    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:28:33.355398 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:33.355364    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:28:33.942266 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:33.942227    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:28:34.044756 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:34.044722    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:28:34.144574 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:34.144546    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:28:35.611472 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:35.611438    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:28:39.665385 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:39.665351    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:28:41.707135 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:41.707103    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:28:41.775065 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:41.775035    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:28:41.859197 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:41.859173    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:28:41.959453 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:41.959387    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:28:42.059723 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:42.059699    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:28:42.474600 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:42.474577    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:28:47.809041 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:47.809017    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jrpbd_e730eed8-ff8a-4a54-b1cb-539d8f07e70b/ovn-acl-logging/0.log"
Jul 13 21:28:47.812932 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:28:47.812911    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jrpbd_e730eed8-ff8a-4a54-b1cb-539d8f07e70b/ovn-acl-logging/0.log"
Jul 13 21:29:08.419546 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:29:08.419503    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:29:14.124677 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:29:14.124641    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:29:14.185889 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:29:14.185860    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:29:14.278419 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:29:14.278376    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:29:14.375239 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:29:14.375154    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:29:30.186760 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:29:30.186709    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:29:33.567848 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:29:33.567795    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:29:33.623190 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:29:33.623143    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:29:34.361642 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:29:34.361609    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:29:34.413122 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:29:34.413096    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:29:36.354565 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:29:36.354532    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:29:36.422985 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:29:36.422951    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:29:36.515093 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:29:36.515057    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:29:47.103305 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:29:47.103262    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:29:47.886940 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:29:47.886907    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:29:53.608167 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:29:53.608132    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:29:53.714648 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:29:53.714605    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:29:53.816824 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:29:53.816791    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:29:53.909262 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:29:53.909196    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:29:54.632948 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:29:54.632911    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:29:54.731010 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:29:54.730977    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:29:54.830575 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:29:54.830543    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:29:56.407874 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:29:56.407841    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:30:00.141348 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:00.141317    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29732970-h2d2t"]
Jul 13 21:30:00.141709 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:00.141596    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67b8c347-2d72-40e2-877a-4af683bb17f4" containerName="maas-api"
Jul 13 21:30:00.141709 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:00.141607    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="67b8c347-2d72-40e2-877a-4af683bb17f4" containerName="maas-api"
Jul 13 21:30:00.141709 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:00.141618    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="422d7179-e252-4e2e-9882-582b1da9e4b3" containerName="revoke-keys"
Jul 13 21:30:00.141709 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:00.141624    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="422d7179-e252-4e2e-9882-582b1da9e4b3" containerName="revoke-keys"
Jul 13 21:30:00.141709 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:00.141672    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="422d7179-e252-4e2e-9882-582b1da9e4b3" containerName="revoke-keys"
Jul 13 21:30:00.141709 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:00.141683    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="67b8c347-2d72-40e2-877a-4af683bb17f4" containerName="maas-api"
Jul 13 21:30:00.144423 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:00.144406    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732970-h2d2t"
Jul 13 21:30:00.147033 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:00.147013    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rnndk\""
Jul 13 21:30:00.152388 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:00.152367    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29732970-h2d2t"]
Jul 13 21:30:00.154316 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:00.154298    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732970-h2d2t"
Jul 13 21:30:00.280190 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:00.280167    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29732970-h2d2t"]
Jul 13 21:30:00.282042 ip-10-0-137-162 kubenswrapper[2561]: W0713 21:30:00.282012    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2c0e244_b6c7_4f82_a816_844f9883954e.slice/crio-4c94107b5e9b642ea5bb156a64f53e600c6636616525f29292ccf2a847734690 WatchSource:0}: Error finding container 4c94107b5e9b642ea5bb156a64f53e600c6636616525f29292ccf2a847734690: Status 404 returned error can't find the container with id 4c94107b5e9b642ea5bb156a64f53e600c6636616525f29292ccf2a847734690
Jul 13 21:30:01.021463 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:01.021430    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732970-h2d2t" event={"ID":"a2c0e244-b6c7-4f82-a816-844f9883954e","Type":"ContainerStarted","Data":"a5c5279ce40e305e9f44c64944ebcf329a848df07a87ca81d20e22e5f37cbc2d"}
Jul 13 21:30:01.021607 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:01.021482    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732970-h2d2t" event={"ID":"a2c0e244-b6c7-4f82-a816-844f9883954e","Type":"ContainerStarted","Data":"4c94107b5e9b642ea5bb156a64f53e600c6636616525f29292ccf2a847734690"}
Jul 13 21:30:01.038061 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:01.038009    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732970-h2d2t" podStartSLOduration=1.037992859 podStartE2EDuration="1.037992859s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:30:01.036680074 +0000 UTC m=+2174.031463497" watchObservedRunningTime="2026-07-13 21:30:01.037992859 +0000 UTC m=+2174.032776281"
Jul 13 21:30:02.026685 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:02.026652    2561 generic.go:356] "Generic (PLEG): container finished" podID="a2c0e244-b6c7-4f82-a816-844f9883954e" containerID="a5c5279ce40e305e9f44c64944ebcf329a848df07a87ca81d20e22e5f37cbc2d" exitCode=0
Jul 13 21:30:02.026685 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:02.026688    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732970-h2d2t" event={"ID":"a2c0e244-b6c7-4f82-a816-844f9883954e","Type":"ContainerDied","Data":"a5c5279ce40e305e9f44c64944ebcf329a848df07a87ca81d20e22e5f37cbc2d"}
Jul 13 21:30:02.525503 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:02.525472    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:30:02.625529 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:02.625499    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:30:02.995854 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:02.995761    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:30:03.152918 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:03.152898    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732970-h2d2t"
Jul 13 21:30:04.035892 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:04.035865    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732970-h2d2t"
Jul 13 21:30:04.036054 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:04.035894    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732970-h2d2t" event={"ID":"a2c0e244-b6c7-4f82-a816-844f9883954e","Type":"ContainerDied","Data":"4c94107b5e9b642ea5bb156a64f53e600c6636616525f29292ccf2a847734690"}
Jul 13 21:30:04.036054 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:04.035934    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c94107b5e9b642ea5bb156a64f53e600c6636616525f29292ccf2a847734690"
Jul 13 21:30:09.001330 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:09.001302    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:30:09.063656 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:09.063633    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:30:09.238410 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:09.238379    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:30:09.539983 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:09.539950    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:30:09.757342 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:09.757306    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:30:12.259694 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:12.259665    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:30:12.333628 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:12.333598    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:30:12.340591 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:12.340564    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-543f558f-6fc58bcf9b-ftclj"]
Jul 13 21:30:12.341034 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:12.341018    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2c0e244-b6c7-4f82-a816-844f9883954e" containerName="cleanup"
Jul 13 21:30:12.341107 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:12.341036    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2c0e244-b6c7-4f82-a816-844f9883954e" containerName="cleanup"
Jul 13 21:30:12.341107 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:12.341104    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2c0e244-b6c7-4f82-a816-844f9883954e" containerName="cleanup"
Jul 13 21:30:12.344170 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:12.344151    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-543f558f-6fc58bcf9b-ftclj"
Jul 13 21:30:12.347511 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:12.347299    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 13 21:30:12.347511 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:12.347393    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-j4tgz\""
Jul 13 21:30:12.348576 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:12.348552    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 21:30:12.348684 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:12.348563    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-543f558f-serving-cert\""
Jul 13 21:30:12.354400 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:12.354375    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-543f558f-6fc58bcf9b-ftclj"]
Jul 13 21:30:12.410461 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:12.410438    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:30:12.446893 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:12.446866    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbqnh\" (UniqueName: \"kubernetes.io/projected/36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d-kube-api-access-cbqnh\") pod \"maas-api-e2e-mt-543f558f-6fc58bcf9b-ftclj\" (UID: \"36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-543f558f-6fc58bcf9b-ftclj"
Jul 13 21:30:12.447009 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:12.446902    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d-openshift-service-ca\") pod \"maas-api-e2e-mt-543f558f-6fc58bcf9b-ftclj\" (UID: \"36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-543f558f-6fc58bcf9b-ftclj"
Jul 13 21:30:12.447009 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:12.447003    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d-maas-api-tls\") pod \"maas-api-e2e-mt-543f558f-6fc58bcf9b-ftclj\" (UID: \"36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-543f558f-6fc58bcf9b-ftclj"
Jul 13 21:30:12.547899 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:12.547878    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbqnh\" (UniqueName: \"kubernetes.io/projected/36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d-kube-api-access-cbqnh\") pod \"maas-api-e2e-mt-543f558f-6fc58bcf9b-ftclj\" (UID: \"36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-543f558f-6fc58bcf9b-ftclj"
Jul 13 21:30:12.548006 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:12.547906    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d-openshift-service-ca\") pod \"maas-api-e2e-mt-543f558f-6fc58bcf9b-ftclj\" (UID: \"36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-543f558f-6fc58bcf9b-ftclj"
Jul 13 21:30:12.548006 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:12.547945    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d-maas-api-tls\") pod \"maas-api-e2e-mt-543f558f-6fc58bcf9b-ftclj\" (UID: \"36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-543f558f-6fc58bcf9b-ftclj"
Jul 13 21:30:12.548091 ip-10-0-137-162 kubenswrapper[2561]: E0713 21:30:12.548036    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-543f558f-serving-cert: secret "maas-api-e2e-mt-543f558f-serving-cert" not found
Jul 13 21:30:12.548132 ip-10-0-137-162 kubenswrapper[2561]: E0713 21:30:12.548099    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d-maas-api-tls podName:36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d nodeName:}" failed. No retries permitted until 2026-07-13 21:30:13.048080587 +0000 UTC m=+2186.042863996 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d-maas-api-tls") pod "maas-api-e2e-mt-543f558f-6fc58bcf9b-ftclj" (UID: "36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d") : secret "maas-api-e2e-mt-543f558f-serving-cert" not found
Jul 13 21:30:12.548598 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:12.548577    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d-openshift-service-ca\") pod \"maas-api-e2e-mt-543f558f-6fc58bcf9b-ftclj\" (UID: \"36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-543f558f-6fc58bcf9b-ftclj"
Jul 13 21:30:12.558985 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:12.558962    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbqnh\" (UniqueName: \"kubernetes.io/projected/36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d-kube-api-access-cbqnh\") pod \"maas-api-e2e-mt-543f558f-6fc58bcf9b-ftclj\" (UID: \"36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-543f558f-6fc58bcf9b-ftclj"
Jul 13 21:30:12.610726 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:12.610698    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:30:12.957567 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:12.957494    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:30:13.053208 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:13.053174    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d-maas-api-tls\") pod \"maas-api-e2e-mt-543f558f-6fc58bcf9b-ftclj\" (UID: \"36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-543f558f-6fc58bcf9b-ftclj"
Jul 13 21:30:13.055427 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:13.055397    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:30:13.055587 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:13.055573    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d-maas-api-tls\") pod \"maas-api-e2e-mt-543f558f-6fc58bcf9b-ftclj\" (UID: \"36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-543f558f-6fc58bcf9b-ftclj"
Jul 13 21:30:13.257277 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:13.257204    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-543f558f-6fc58bcf9b-ftclj"
Jul 13 21:30:13.397503 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:13.397481    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-543f558f-6fc58bcf9b-ftclj"]
Jul 13 21:30:13.399494 ip-10-0-137-162 kubenswrapper[2561]: W0713 21:30:13.399471    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36bfd3d9_4fc8_4cc1_a4db_7026f6aa619d.slice/crio-5e1262faba68b3f25ac02b88c17fb0ed7cb9c2ad4b17c8e71fa3b46b7c5e8a2e WatchSource:0}: Error finding container 5e1262faba68b3f25ac02b88c17fb0ed7cb9c2ad4b17c8e71fa3b46b7c5e8a2e: Status 404 returned error can't find the container with id 5e1262faba68b3f25ac02b88c17fb0ed7cb9c2ad4b17c8e71fa3b46b7c5e8a2e
Jul 13 21:30:13.401212 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:13.401191    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 21:30:14.080168 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:14.080080    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-543f558f-6fc58bcf9b-ftclj" event={"ID":"36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d","Type":"ContainerStarted","Data":"ecaf42d8469adce2d8f5466130e125c382819f7a73a070a16a5782958a7ab21e"}
Jul 13 21:30:14.080168 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:14.080129    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-543f558f-6fc58bcf9b-ftclj" event={"ID":"36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d","Type":"ContainerStarted","Data":"5e1262faba68b3f25ac02b88c17fb0ed7cb9c2ad4b17c8e71fa3b46b7c5e8a2e"}
Jul 13 21:30:14.080390 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:14.080167    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-543f558f-6fc58bcf9b-ftclj"
Jul 13 21:30:14.098445 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:14.098188    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-543f558f-6fc58bcf9b-ftclj" podStartSLOduration=1.69030502 podStartE2EDuration="2.09816972s" totalImagesPullingTime="407.8647ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:30:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:30:14.096759236 +0000 UTC m=+2187.091542658" watchObservedRunningTime="2026-07-13 21:30:14.09816972 +0000 UTC m=+2187.092953136"
Jul 13 21:30:16.762801 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:16.762767    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:30:17.407740 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:17.407707    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:30:17.505340 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:17.505310    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:30:17.826292 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:17.826261    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:30:20.090455 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:20.090428    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-543f558f-6fc58bcf9b-ftclj"
Jul 13 21:30:23.392690 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:23.392660    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:30:23.453802 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:23.453776    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:30:23.768566 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:23.768533    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-543f558f-xnkpt"]
Jul 13 21:30:23.771670 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:23.771654    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-543f558f-xnkpt"
Jul 13 21:30:23.774337 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:23.774315    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rnndk\""
Jul 13 21:30:23.779777 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:23.779758    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-543f558f-xnkpt"]
Jul 13 21:30:23.835230 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:23.835206    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/23f0a056-0e8b-4ad7-8037-c31c308ec951-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-543f558f-xnkpt\" (UID: \"23f0a056-0e8b-4ad7-8037-c31c308ec951\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-543f558f-xnkpt"
Jul 13 21:30:23.936385 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:23.936353    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/23f0a056-0e8b-4ad7-8037-c31c308ec951-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-543f558f-xnkpt\" (UID: \"23f0a056-0e8b-4ad7-8037-c31c308ec951\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-543f558f-xnkpt"
Jul 13 21:30:23.936970 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:23.936953    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/23f0a056-0e8b-4ad7-8037-c31c308ec951-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-543f558f-xnkpt\" (UID: \"23f0a056-0e8b-4ad7-8037-c31c308ec951\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-543f558f-xnkpt"
Jul 13 21:30:24.083237 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:24.083172    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-543f558f-xnkpt"
Jul 13 21:30:24.206752 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:24.206729    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-543f558f-xnkpt"]
Jul 13 21:30:24.208559 ip-10-0-137-162 kubenswrapper[2561]: W0713 21:30:24.208531    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23f0a056_0e8b_4ad7_8037_c31c308ec951.slice/crio-00b952744e6e2e6feeca92949cd197c9de15264cdc94faf41e759add5d56031e WatchSource:0}: Error finding container 00b952744e6e2e6feeca92949cd197c9de15264cdc94faf41e759add5d56031e: Status 404 returned error can't find the container with id 00b952744e6e2e6feeca92949cd197c9de15264cdc94faf41e759add5d56031e
Jul 13 21:30:25.128689 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:25.128605    2561 generic.go:356] "Generic (PLEG): container finished" podID="23f0a056-0e8b-4ad7-8037-c31c308ec951" containerID="2ce5a984f99cc6f5184a4c037971a53fc9b1dd9c7124e59f76297dedb97ac512" exitCode=0
Jul 13 21:30:25.129068 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:25.128694    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-543f558f-xnkpt" event={"ID":"23f0a056-0e8b-4ad7-8037-c31c308ec951","Type":"ContainerDied","Data":"2ce5a984f99cc6f5184a4c037971a53fc9b1dd9c7124e59f76297dedb97ac512"}
Jul 13 21:30:25.129068 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:25.128757    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-543f558f-xnkpt" event={"ID":"23f0a056-0e8b-4ad7-8037-c31c308ec951","Type":"ContainerStarted","Data":"00b952744e6e2e6feeca92949cd197c9de15264cdc94faf41e759add5d56031e"}
Jul 13 21:30:26.258409 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:26.258389    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-543f558f-xnkpt"
Jul 13 21:30:26.355494 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:26.355469    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/23f0a056-0e8b-4ad7-8037-c31c308ec951-maas-api-service-ca\") pod \"23f0a056-0e8b-4ad7-8037-c31c308ec951\" (UID: \"23f0a056-0e8b-4ad7-8037-c31c308ec951\") "
Jul 13 21:30:26.355836 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:26.355794    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23f0a056-0e8b-4ad7-8037-c31c308ec951-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "23f0a056-0e8b-4ad7-8037-c31c308ec951" (UID: "23f0a056-0e8b-4ad7-8037-c31c308ec951"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:30:26.456586 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:26.456513    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/23f0a056-0e8b-4ad7-8037-c31c308ec951-maas-api-service-ca\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:30:27.142040 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:27.142005    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-543f558f-xnkpt" event={"ID":"23f0a056-0e8b-4ad7-8037-c31c308ec951","Type":"ContainerDied","Data":"00b952744e6e2e6feeca92949cd197c9de15264cdc94faf41e759add5d56031e"}
Jul 13 21:30:27.142040 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:27.142032    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-543f558f-xnkpt"
Jul 13 21:30:27.142268 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:27.142066    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="00b952744e6e2e6feeca92949cd197c9de15264cdc94faf41e759add5d56031e"
Jul 13 21:30:34.228396 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:34.228367    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-543f558f-6fc58bcf9b-ftclj"]
Jul 13 21:30:34.228830 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:34.228570    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-543f558f-6fc58bcf9b-ftclj" podUID="36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d" containerName="maas-api" containerID="cri-o://ecaf42d8469adce2d8f5466130e125c382819f7a73a070a16a5782958a7ab21e" gracePeriod=30
Jul 13 21:30:34.260439 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:34.260407    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:30:34.467804 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:34.467783    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-543f558f-6fc58bcf9b-ftclj"
Jul 13 21:30:34.622071 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:34.622041    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d-maas-api-tls\") pod \"36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d\" (UID: \"36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d\") "
Jul 13 21:30:34.622233 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:34.622111    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbqnh\" (UniqueName: \"kubernetes.io/projected/36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d-kube-api-access-cbqnh\") pod \"36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d\" (UID: \"36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d\") "
Jul 13 21:30:34.622233 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:34.622133    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d-openshift-service-ca\") pod \"36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d\" (UID: \"36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d\") "
Jul 13 21:30:34.622464 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:34.622434    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d" (UID: "36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:30:34.624159 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:34.624139    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d-kube-api-access-cbqnh" (OuterVolumeSpecName: "kube-api-access-cbqnh") pod "36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d" (UID: "36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d"). InnerVolumeSpecName "kube-api-access-cbqnh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:30:34.624159 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:34.624149    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d" (UID: "36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:30:34.723568 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:34.723530    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d-maas-api-tls\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:30:34.723568 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:34.723567    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbqnh\" (UniqueName: \"kubernetes.io/projected/36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d-kube-api-access-cbqnh\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:30:34.723742 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:34.723582    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d-openshift-service-ca\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:30:35.174979 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:35.174951    2561 generic.go:356] "Generic (PLEG): container finished" podID="36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d" containerID="ecaf42d8469adce2d8f5466130e125c382819f7a73a070a16a5782958a7ab21e" exitCode=0
Jul 13 21:30:35.175125 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:35.174996    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-543f558f-6fc58bcf9b-ftclj"
Jul 13 21:30:35.175125 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:35.175009    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-543f558f-6fc58bcf9b-ftclj" event={"ID":"36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d","Type":"ContainerDied","Data":"ecaf42d8469adce2d8f5466130e125c382819f7a73a070a16a5782958a7ab21e"}
Jul 13 21:30:35.175125 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:35.175052    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-543f558f-6fc58bcf9b-ftclj" event={"ID":"36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d","Type":"ContainerDied","Data":"5e1262faba68b3f25ac02b88c17fb0ed7cb9c2ad4b17c8e71fa3b46b7c5e8a2e"}
Jul 13 21:30:35.175125 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:35.175080    2561 scope.go:117] "RemoveContainer" containerID="ecaf42d8469adce2d8f5466130e125c382819f7a73a070a16a5782958a7ab21e"
Jul 13 21:30:35.183387 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:35.183363    2561 scope.go:117] "RemoveContainer" containerID="ecaf42d8469adce2d8f5466130e125c382819f7a73a070a16a5782958a7ab21e"
Jul 13 21:30:35.183615 ip-10-0-137-162 kubenswrapper[2561]: E0713 21:30:35.183596    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ecaf42d8469adce2d8f5466130e125c382819f7a73a070a16a5782958a7ab21e\": container with ID starting with ecaf42d8469adce2d8f5466130e125c382819f7a73a070a16a5782958a7ab21e not found: ID does not exist" containerID="ecaf42d8469adce2d8f5466130e125c382819f7a73a070a16a5782958a7ab21e"
Jul 13 21:30:35.183676 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:35.183627    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecaf42d8469adce2d8f5466130e125c382819f7a73a070a16a5782958a7ab21e"} err="failed to get container status \"ecaf42d8469adce2d8f5466130e125c382819f7a73a070a16a5782958a7ab21e\": rpc error: code = NotFound desc = could not find container \"ecaf42d8469adce2d8f5466130e125c382819f7a73a070a16a5782958a7ab21e\": container with ID starting with ecaf42d8469adce2d8f5466130e125c382819f7a73a070a16a5782958a7ab21e not found: ID does not exist"
Jul 13 21:30:35.197124 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:35.197101    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-543f558f-6fc58bcf9b-ftclj"]
Jul 13 21:30:35.201636 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:35.201618    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-543f558f-6fc58bcf9b-ftclj"]
Jul 13 21:30:35.576509 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:35.576477    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d" path="/var/lib/kubelet/pods/36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d/volumes"
Jul 13 21:30:38.857524 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:38.857494    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:30:44.755831 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:44.755796    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:30:44.857132 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:44.857100    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:30:49.542406 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:49.542347    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:30:49.768183 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:49.768146    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:30:49.892923 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:49.892839    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:30:49.982468 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:49.982440    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:30:50.089371 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:50.089341    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:30:55.854758 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:55.854725    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:30:55.916941 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:55.916914    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:30:56.012284 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:56.012256    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:30:56.107239 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:56.107176    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:30:56.212054 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:30:56.212027    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:31:02.057486 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:02.057448    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:31:02.157239 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:02.157211    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:31:08.873395 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:08.873360    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:31:09.277145 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:09.277112    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:31:09.685707 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:09.685629    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:31:12.540510 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:12.540479    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:31:12.641020 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:12.640990    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:31:12.645663 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:12.645626    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-11bd6c7a-6c56f74b9f-6r7rg"]
Jul 13 21:31:12.645981 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:12.645968    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23f0a056-0e8b-4ad7-8037-c31c308ec951" containerName="revoke-keys"
Jul 13 21:31:12.646068 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:12.645985    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="23f0a056-0e8b-4ad7-8037-c31c308ec951" containerName="revoke-keys"
Jul 13 21:31:12.646068 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:12.646003    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d" containerName="maas-api"
Jul 13 21:31:12.646068 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:12.646009    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d" containerName="maas-api"
Jul 13 21:31:12.646253 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:12.646072    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="36bfd3d9-4fc8-4cc1-a4db-7026f6aa619d" containerName="maas-api"
Jul 13 21:31:12.646253 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:12.646081    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="23f0a056-0e8b-4ad7-8037-c31c308ec951" containerName="revoke-keys"
Jul 13 21:31:12.649096 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:12.649079    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-11bd6c7a-6c56f74b9f-6r7rg"
Jul 13 21:31:12.651951 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:12.651929    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-j4tgz\""
Jul 13 21:31:12.652048 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:12.652002    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 21:31:12.652901 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:12.652883    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-11bd6c7a-serving-cert\""
Jul 13 21:31:12.652901 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:12.652897    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 13 21:31:12.661487 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:12.661464    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-11bd6c7a-6c56f74b9f-6r7rg"]
Jul 13 21:31:12.701709 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:12.701682    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bd2699f-a579-4c5a-954f-0951dc5dd771-maas-api-tls\") pod \"maas-api-e2e-mt-11bd6c7a-6c56f74b9f-6r7rg\" (UID: \"1bd2699f-a579-4c5a-954f-0951dc5dd771\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-11bd6c7a-6c56f74b9f-6r7rg"
Jul 13 21:31:12.701844 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:12.701715    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8wbq\" (UniqueName: \"kubernetes.io/projected/1bd2699f-a579-4c5a-954f-0951dc5dd771-kube-api-access-v8wbq\") pod \"maas-api-e2e-mt-11bd6c7a-6c56f74b9f-6r7rg\" (UID: \"1bd2699f-a579-4c5a-954f-0951dc5dd771\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-11bd6c7a-6c56f74b9f-6r7rg"
Jul 13 21:31:12.701844 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:12.701737    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bd2699f-a579-4c5a-954f-0951dc5dd771-openshift-service-ca\") pod \"maas-api-e2e-mt-11bd6c7a-6c56f74b9f-6r7rg\" (UID: \"1bd2699f-a579-4c5a-954f-0951dc5dd771\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-11bd6c7a-6c56f74b9f-6r7rg"
Jul 13 21:31:12.737936 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:12.737914    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:31:12.803003 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:12.802932    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8wbq\" (UniqueName: \"kubernetes.io/projected/1bd2699f-a579-4c5a-954f-0951dc5dd771-kube-api-access-v8wbq\") pod \"maas-api-e2e-mt-11bd6c7a-6c56f74b9f-6r7rg\" (UID: \"1bd2699f-a579-4c5a-954f-0951dc5dd771\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-11bd6c7a-6c56f74b9f-6r7rg"
Jul 13 21:31:12.803003 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:12.802966    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bd2699f-a579-4c5a-954f-0951dc5dd771-openshift-service-ca\") pod \"maas-api-e2e-mt-11bd6c7a-6c56f74b9f-6r7rg\" (UID: \"1bd2699f-a579-4c5a-954f-0951dc5dd771\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-11bd6c7a-6c56f74b9f-6r7rg"
Jul 13 21:31:12.803191 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:12.803045    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bd2699f-a579-4c5a-954f-0951dc5dd771-maas-api-tls\") pod \"maas-api-e2e-mt-11bd6c7a-6c56f74b9f-6r7rg\" (UID: \"1bd2699f-a579-4c5a-954f-0951dc5dd771\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-11bd6c7a-6c56f74b9f-6r7rg"
Jul 13 21:31:12.803191 ip-10-0-137-162 kubenswrapper[2561]: E0713 21:31:12.803129    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-11bd6c7a-serving-cert: secret "maas-api-e2e-mt-11bd6c7a-serving-cert" not found
Jul 13 21:31:12.803191 ip-10-0-137-162 kubenswrapper[2561]: E0713 21:31:12.803191    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bd2699f-a579-4c5a-954f-0951dc5dd771-maas-api-tls podName:1bd2699f-a579-4c5a-954f-0951dc5dd771 nodeName:}" failed. No retries permitted until 2026-07-13 21:31:13.303173706 +0000 UTC m=+2246.297957130 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1bd2699f-a579-4c5a-954f-0951dc5dd771-maas-api-tls") pod "maas-api-e2e-mt-11bd6c7a-6c56f74b9f-6r7rg" (UID: "1bd2699f-a579-4c5a-954f-0951dc5dd771") : secret "maas-api-e2e-mt-11bd6c7a-serving-cert" not found
Jul 13 21:31:12.803586 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:12.803568    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bd2699f-a579-4c5a-954f-0951dc5dd771-openshift-service-ca\") pod \"maas-api-e2e-mt-11bd6c7a-6c56f74b9f-6r7rg\" (UID: \"1bd2699f-a579-4c5a-954f-0951dc5dd771\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-11bd6c7a-6c56f74b9f-6r7rg"
Jul 13 21:31:12.822924 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:12.822895    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8wbq\" (UniqueName: \"kubernetes.io/projected/1bd2699f-a579-4c5a-954f-0951dc5dd771-kube-api-access-v8wbq\") pod \"maas-api-e2e-mt-11bd6c7a-6c56f74b9f-6r7rg\" (UID: \"1bd2699f-a579-4c5a-954f-0951dc5dd771\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-11bd6c7a-6c56f74b9f-6r7rg"
Jul 13 21:31:13.128045 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:13.127966    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:31:13.249894 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:13.249869    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:31:13.306911 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:13.306887    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bd2699f-a579-4c5a-954f-0951dc5dd771-maas-api-tls\") pod \"maas-api-e2e-mt-11bd6c7a-6c56f74b9f-6r7rg\" (UID: \"1bd2699f-a579-4c5a-954f-0951dc5dd771\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-11bd6c7a-6c56f74b9f-6r7rg"
Jul 13 21:31:13.309129 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:13.309108    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bd2699f-a579-4c5a-954f-0951dc5dd771-maas-api-tls\") pod \"maas-api-e2e-mt-11bd6c7a-6c56f74b9f-6r7rg\" (UID: \"1bd2699f-a579-4c5a-954f-0951dc5dd771\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-11bd6c7a-6c56f74b9f-6r7rg"
Jul 13 21:31:13.351364 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:13.351341    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:31:13.560096 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:13.560072    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-11bd6c7a-6c56f74b9f-6r7rg"
Jul 13 21:31:13.683099 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:13.683074    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-11bd6c7a-6c56f74b9f-6r7rg"]
Jul 13 21:31:13.684843 ip-10-0-137-162 kubenswrapper[2561]: W0713 21:31:13.684806    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bd2699f_a579_4c5a_954f_0951dc5dd771.slice/crio-7dfb14f2310029568be9711661fcc85758eea28d96ba830e092e071972fa9b23 WatchSource:0}: Error finding container 7dfb14f2310029568be9711661fcc85758eea28d96ba830e092e071972fa9b23: Status 404 returned error can't find the container with id 7dfb14f2310029568be9711661fcc85758eea28d96ba830e092e071972fa9b23
Jul 13 21:31:14.340960 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:14.340928    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-11bd6c7a-6c56f74b9f-6r7rg" event={"ID":"1bd2699f-a579-4c5a-954f-0951dc5dd771","Type":"ContainerStarted","Data":"0a649499a2a228d53505abf3c5ab1742a86dcc6fe499ef042691510d2c73e10e"}
Jul 13 21:31:14.341163 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:14.340978    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-11bd6c7a-6c56f74b9f-6r7rg" event={"ID":"1bd2699f-a579-4c5a-954f-0951dc5dd771","Type":"ContainerStarted","Data":"7dfb14f2310029568be9711661fcc85758eea28d96ba830e092e071972fa9b23"}
Jul 13 21:31:14.341163 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:14.341006    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-11bd6c7a-6c56f74b9f-6r7rg"
Jul 13 21:31:14.357606 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:14.357553    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-11bd6c7a-6c56f74b9f-6r7rg" podStartSLOduration=1.863110425 podStartE2EDuration="2.357535306s" totalImagesPullingTime="494.424881ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:31:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:31:14.356887493 +0000 UTC m=+2247.351670917" watchObservedRunningTime="2026-07-13 21:31:14.357535306 +0000 UTC m=+2247.352318730"
Jul 13 21:31:17.031325 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:17.031287    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:31:20.351077 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:20.351047    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-11bd6c7a-6c56f74b9f-6r7rg"
Jul 13 21:31:24.840276 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:24.840237    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:31:47.504961 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:47.504925    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:31:47.606373 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:47.606336    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:31:55.276313 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:55.276274    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-11bd6c7a-hng9f"]
Jul 13 21:31:55.279425 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:55.279407    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-11bd6c7a-hng9f"
Jul 13 21:31:55.282116 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:55.282096    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rnndk\""
Jul 13 21:31:55.286252 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:55.286226    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-11bd6c7a-hng9f"]
Jul 13 21:31:55.339251 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:55.339215    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8629ed67-1535-44d4-ba0f-3d52180fc1e3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-11bd6c7a-hng9f\" (UID: \"8629ed67-1535-44d4-ba0f-3d52180fc1e3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-11bd6c7a-hng9f"
Jul 13 21:31:55.439948 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:55.439918    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8629ed67-1535-44d4-ba0f-3d52180fc1e3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-11bd6c7a-hng9f\" (UID: \"8629ed67-1535-44d4-ba0f-3d52180fc1e3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-11bd6c7a-hng9f"
Jul 13 21:31:55.440516 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:55.440492    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8629ed67-1535-44d4-ba0f-3d52180fc1e3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-11bd6c7a-hng9f\" (UID: \"8629ed67-1535-44d4-ba0f-3d52180fc1e3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-11bd6c7a-hng9f"
Jul 13 21:31:55.591294 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:55.591225    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-11bd6c7a-hng9f"
Jul 13 21:31:55.713493 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:55.713465    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-11bd6c7a-hng9f"]
Jul 13 21:31:55.715644 ip-10-0-137-162 kubenswrapper[2561]: W0713 21:31:55.715606    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8629ed67_1535_44d4_ba0f_3d52180fc1e3.slice/crio-a971763831e21214c5ed9d1a0cfa1b8a9ef7be7b03ec75aefb36129c17204f97 WatchSource:0}: Error finding container a971763831e21214c5ed9d1a0cfa1b8a9ef7be7b03ec75aefb36129c17204f97: Status 404 returned error can't find the container with id a971763831e21214c5ed9d1a0cfa1b8a9ef7be7b03ec75aefb36129c17204f97
Jul 13 21:31:55.896064 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:55.896022    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:31:56.000956 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:56.000920    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:31:56.524666 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:56.524630    2561 generic.go:356] "Generic (PLEG): container finished" podID="8629ed67-1535-44d4-ba0f-3d52180fc1e3" containerID="00bfc0ea6d92ef51373cdda6420c55c6c726f53090297b243391ce3cc87a04a7" exitCode=0
Jul 13 21:31:56.525136 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:56.524713    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-11bd6c7a-hng9f" event={"ID":"8629ed67-1535-44d4-ba0f-3d52180fc1e3","Type":"ContainerDied","Data":"00bfc0ea6d92ef51373cdda6420c55c6c726f53090297b243391ce3cc87a04a7"}
Jul 13 21:31:56.525136 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:56.524785    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-11bd6c7a-hng9f" event={"ID":"8629ed67-1535-44d4-ba0f-3d52180fc1e3","Type":"ContainerStarted","Data":"a971763831e21214c5ed9d1a0cfa1b8a9ef7be7b03ec75aefb36129c17204f97"}
Jul 13 21:31:57.655372 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:57.655350    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-11bd6c7a-hng9f"
Jul 13 21:31:57.660573 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:57.660554    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8629ed67-1535-44d4-ba0f-3d52180fc1e3-maas-api-service-ca\") pod \"8629ed67-1535-44d4-ba0f-3d52180fc1e3\" (UID: \"8629ed67-1535-44d4-ba0f-3d52180fc1e3\") "
Jul 13 21:31:57.660885 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:57.660862    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8629ed67-1535-44d4-ba0f-3d52180fc1e3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8629ed67-1535-44d4-ba0f-3d52180fc1e3" (UID: "8629ed67-1535-44d4-ba0f-3d52180fc1e3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:31:57.761535 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:57.761509    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8629ed67-1535-44d4-ba0f-3d52180fc1e3-maas-api-service-ca\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:31:58.534029 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:58.534005    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-11bd6c7a-hng9f"
Jul 13 21:31:58.534206 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:58.534043    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-11bd6c7a-hng9f" event={"ID":"8629ed67-1535-44d4-ba0f-3d52180fc1e3","Type":"ContainerDied","Data":"a971763831e21214c5ed9d1a0cfa1b8a9ef7be7b03ec75aefb36129c17204f97"}
Jul 13 21:31:58.534206 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:31:58.534095    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a971763831e21214c5ed9d1a0cfa1b8a9ef7be7b03ec75aefb36129c17204f97"
Jul 13 21:32:05.744017 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:32:05.743984    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-11bd6c7a-6c56f74b9f-6r7rg"]
Jul 13 21:32:05.744424 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:32:05.744182    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-11bd6c7a-6c56f74b9f-6r7rg" podUID="1bd2699f-a579-4c5a-954f-0951dc5dd771" containerName="maas-api" containerID="cri-o://0a649499a2a228d53505abf3c5ab1742a86dcc6fe499ef042691510d2c73e10e" gracePeriod=30
Jul 13 21:32:05.775919 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:32:05.775857    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:32:05.990910 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:32:05.990887    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-11bd6c7a-6c56f74b9f-6r7rg"
Jul 13 21:32:06.031532 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:32:06.031503    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bd2699f-a579-4c5a-954f-0951dc5dd771-openshift-service-ca\") pod \"1bd2699f-a579-4c5a-954f-0951dc5dd771\" (UID: \"1bd2699f-a579-4c5a-954f-0951dc5dd771\") "
Jul 13 21:32:06.031699 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:32:06.031583    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8wbq\" (UniqueName: \"kubernetes.io/projected/1bd2699f-a579-4c5a-954f-0951dc5dd771-kube-api-access-v8wbq\") pod \"1bd2699f-a579-4c5a-954f-0951dc5dd771\" (UID: \"1bd2699f-a579-4c5a-954f-0951dc5dd771\") "
Jul 13 21:32:06.031699 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:32:06.031629    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bd2699f-a579-4c5a-954f-0951dc5dd771-maas-api-tls\") pod \"1bd2699f-a579-4c5a-954f-0951dc5dd771\" (UID: \"1bd2699f-a579-4c5a-954f-0951dc5dd771\") "
Jul 13 21:32:06.031971 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:32:06.031941    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bd2699f-a579-4c5a-954f-0951dc5dd771-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1bd2699f-a579-4c5a-954f-0951dc5dd771" (UID: "1bd2699f-a579-4c5a-954f-0951dc5dd771"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:32:06.033718 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:32:06.033696    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bd2699f-a579-4c5a-954f-0951dc5dd771-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1bd2699f-a579-4c5a-954f-0951dc5dd771" (UID: "1bd2699f-a579-4c5a-954f-0951dc5dd771"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:32:06.033832 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:32:06.033793    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bd2699f-a579-4c5a-954f-0951dc5dd771-kube-api-access-v8wbq" (OuterVolumeSpecName: "kube-api-access-v8wbq") pod "1bd2699f-a579-4c5a-954f-0951dc5dd771" (UID: "1bd2699f-a579-4c5a-954f-0951dc5dd771"). InnerVolumeSpecName "kube-api-access-v8wbq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:32:06.132982 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:32:06.132946    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8wbq\" (UniqueName: \"kubernetes.io/projected/1bd2699f-a579-4c5a-954f-0951dc5dd771-kube-api-access-v8wbq\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:32:06.132982 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:32:06.132975    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bd2699f-a579-4c5a-954f-0951dc5dd771-maas-api-tls\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:32:06.132982 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:32:06.132984    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bd2699f-a579-4c5a-954f-0951dc5dd771-openshift-service-ca\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:32:06.570683 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:32:06.570650    2561 generic.go:356] "Generic (PLEG): container finished" podID="1bd2699f-a579-4c5a-954f-0951dc5dd771" containerID="0a649499a2a228d53505abf3c5ab1742a86dcc6fe499ef042691510d2c73e10e" exitCode=0
Jul 13 21:32:06.570910 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:32:06.570691    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-11bd6c7a-6c56f74b9f-6r7rg"
Jul 13 21:32:06.570910 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:32:06.570742    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-11bd6c7a-6c56f74b9f-6r7rg" event={"ID":"1bd2699f-a579-4c5a-954f-0951dc5dd771","Type":"ContainerDied","Data":"0a649499a2a228d53505abf3c5ab1742a86dcc6fe499ef042691510d2c73e10e"}
Jul 13 21:32:06.570910 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:32:06.570794    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-11bd6c7a-6c56f74b9f-6r7rg" event={"ID":"1bd2699f-a579-4c5a-954f-0951dc5dd771","Type":"ContainerDied","Data":"7dfb14f2310029568be9711661fcc85758eea28d96ba830e092e071972fa9b23"}
Jul 13 21:32:06.570910 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:32:06.570848    2561 scope.go:117] "RemoveContainer" containerID="0a649499a2a228d53505abf3c5ab1742a86dcc6fe499ef042691510d2c73e10e"
Jul 13 21:32:06.579806 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:32:06.579790    2561 scope.go:117] "RemoveContainer" containerID="0a649499a2a228d53505abf3c5ab1742a86dcc6fe499ef042691510d2c73e10e"
Jul 13 21:32:06.580098 ip-10-0-137-162 kubenswrapper[2561]: E0713 21:32:06.580079    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a649499a2a228d53505abf3c5ab1742a86dcc6fe499ef042691510d2c73e10e\": container with ID starting with 0a649499a2a228d53505abf3c5ab1742a86dcc6fe499ef042691510d2c73e10e not found: ID does not exist" containerID="0a649499a2a228d53505abf3c5ab1742a86dcc6fe499ef042691510d2c73e10e"
Jul 13 21:32:06.580157 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:32:06.580108    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a649499a2a228d53505abf3c5ab1742a86dcc6fe499ef042691510d2c73e10e"} err="failed to get container status \"0a649499a2a228d53505abf3c5ab1742a86dcc6fe499ef042691510d2c73e10e\": rpc error: code = NotFound desc = could not find container \"0a649499a2a228d53505abf3c5ab1742a86dcc6fe499ef042691510d2c73e10e\": container with ID starting with 0a649499a2a228d53505abf3c5ab1742a86dcc6fe499ef042691510d2c73e10e not found: ID does not exist"
Jul 13 21:32:06.592512 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:32:06.592485    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-11bd6c7a-6c56f74b9f-6r7rg"]
Jul 13 21:32:06.595127 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:32:06.595108    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-11bd6c7a-6c56f74b9f-6r7rg"]
Jul 13 21:32:07.579134 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:32:07.579092    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bd2699f-a579-4c5a-954f-0951dc5dd771" path="/var/lib/kubelet/pods/1bd2699f-a579-4c5a-954f-0951dc5dd771/volumes"
Jul 13 21:32:10.371227 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:32:10.371193    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:32:15.446105 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:32:15.446068    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:32:51.625975 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:32:51.625947    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:32:52.466800 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:32:52.466770    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:32:57.983992 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:32:57.983957    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:33:11.924159 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:33:11.924125    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:33:12.020992 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:33:12.020966    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:33:22.670292 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:33:22.670264    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:33:23.797742 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:33:23.797708    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:33:23.959543 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:33:23.959503    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:33:24.048858 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:33:24.048759    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:33:24.903455 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:33:24.903423    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:33:24.994748 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:33:24.994720    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:33:26.375396 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:33:26.375360    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:33:32.269047 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:33:32.269014    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:33:32.369276 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:33:32.369247    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:33:32.930766 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:33:32.930732    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:33:38.759955 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:33:38.759925    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:33:38.824194 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:33:38.824167    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:33:38.910536 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:33:38.910510    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:33:39.007368 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:33:39.007327    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:33:47.685703 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:33:47.685675    2561 scope.go:117] "RemoveContainer" containerID="458416c5311dc6ac47e6c07f1a6135622078083fcf8bb1b03407fe229d470e66"
Jul 13 21:33:47.832771 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:33:47.832749    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jrpbd_e730eed8-ff8a-4a54-b1cb-539d8f07e70b/ovn-acl-logging/0.log"
Jul 13 21:33:47.838283 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:33:47.838269    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jrpbd_e730eed8-ff8a-4a54-b1cb-539d8f07e70b/ovn-acl-logging/0.log"
Jul 13 21:33:49.498521 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:33:49.498488    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:33:49.819743 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:33:49.819715    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:34:10.784223 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:10.784127    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:34:16.649445 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:16.649410    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:34:16.704456 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:16.704429    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:34:17.000530 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:17.000453    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:34:17.357269 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:17.357238    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:34:17.658992 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:17.658911    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:34:20.588669 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:20.588637    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:34:20.680808 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:20.680777    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-613d27-7dd6c88557-kb7hq"]
Jul 13 21:34:20.681203 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:20.681189    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8629ed67-1535-44d4-ba0f-3d52180fc1e3" containerName="revoke-keys"
Jul 13 21:34:20.681246 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:20.681206    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8629ed67-1535-44d4-ba0f-3d52180fc1e3" containerName="revoke-keys"
Jul 13 21:34:20.681246 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:20.681228    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bd2699f-a579-4c5a-954f-0951dc5dd771" containerName="maas-api"
Jul 13 21:34:20.681246 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:20.681236    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bd2699f-a579-4c5a-954f-0951dc5dd771" containerName="maas-api"
Jul 13 21:34:20.681338 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:20.681312    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bd2699f-a579-4c5a-954f-0951dc5dd771" containerName="maas-api"
Jul 13 21:34:20.681338 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:20.681324    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8629ed67-1535-44d4-ba0f-3d52180fc1e3" containerName="revoke-keys"
Jul 13 21:34:20.684798 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:20.684780    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-613d27-7dd6c88557-kb7hq"
Jul 13 21:34:20.687837 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:20.687797    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-j4tgz\""
Jul 13 21:34:20.687979 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:20.687880    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 21:34:20.687979 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:20.687922    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-613d27-serving-cert\""
Jul 13 21:34:20.689036 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:20.689020    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 13 21:34:20.693047 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:20.693015    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:34:20.694647 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:20.694626    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-613d27-7dd6c88557-kb7hq"]
Jul 13 21:34:20.789549 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:20.789504    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:34:20.799550 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:20.799521    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfdm8\" (UniqueName: \"kubernetes.io/projected/e62e9f12-c366-4d29-aed7-740dd2108253-kube-api-access-rfdm8\") pod \"maas-api-e2e-inf-a-613d27-7dd6c88557-kb7hq\" (UID: \"e62e9f12-c366-4d29-aed7-740dd2108253\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-613d27-7dd6c88557-kb7hq"
Jul 13 21:34:20.799676 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:20.799652    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e62e9f12-c366-4d29-aed7-740dd2108253-openshift-service-ca\") pod \"maas-api-e2e-inf-a-613d27-7dd6c88557-kb7hq\" (UID: \"e62e9f12-c366-4d29-aed7-740dd2108253\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-613d27-7dd6c88557-kb7hq"
Jul 13 21:34:20.799738 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:20.799691    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e62e9f12-c366-4d29-aed7-740dd2108253-maas-api-tls\") pod \"maas-api-e2e-inf-a-613d27-7dd6c88557-kb7hq\" (UID: \"e62e9f12-c366-4d29-aed7-740dd2108253\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-613d27-7dd6c88557-kb7hq"
Jul 13 21:34:20.900194 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:20.900135    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e62e9f12-c366-4d29-aed7-740dd2108253-openshift-service-ca\") pod \"maas-api-e2e-inf-a-613d27-7dd6c88557-kb7hq\" (UID: \"e62e9f12-c366-4d29-aed7-740dd2108253\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-613d27-7dd6c88557-kb7hq"
Jul 13 21:34:20.900194 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:20.900163    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e62e9f12-c366-4d29-aed7-740dd2108253-maas-api-tls\") pod \"maas-api-e2e-inf-a-613d27-7dd6c88557-kb7hq\" (UID: \"e62e9f12-c366-4d29-aed7-740dd2108253\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-613d27-7dd6c88557-kb7hq"
Jul 13 21:34:20.900194 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:20.900187    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfdm8\" (UniqueName: \"kubernetes.io/projected/e62e9f12-c366-4d29-aed7-740dd2108253-kube-api-access-rfdm8\") pod \"maas-api-e2e-inf-a-613d27-7dd6c88557-kb7hq\" (UID: \"e62e9f12-c366-4d29-aed7-740dd2108253\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-613d27-7dd6c88557-kb7hq"
Jul 13 21:34:20.900774 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:20.900754    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e62e9f12-c366-4d29-aed7-740dd2108253-openshift-service-ca\") pod \"maas-api-e2e-inf-a-613d27-7dd6c88557-kb7hq\" (UID: \"e62e9f12-c366-4d29-aed7-740dd2108253\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-613d27-7dd6c88557-kb7hq"
Jul 13 21:34:20.902641 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:20.902621    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e62e9f12-c366-4d29-aed7-740dd2108253-maas-api-tls\") pod \"maas-api-e2e-inf-a-613d27-7dd6c88557-kb7hq\" (UID: \"e62e9f12-c366-4d29-aed7-740dd2108253\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-613d27-7dd6c88557-kb7hq"
Jul 13 21:34:20.912466 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:20.912447    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfdm8\" (UniqueName: \"kubernetes.io/projected/e62e9f12-c366-4d29-aed7-740dd2108253-kube-api-access-rfdm8\") pod \"maas-api-e2e-inf-a-613d27-7dd6c88557-kb7hq\" (UID: \"e62e9f12-c366-4d29-aed7-740dd2108253\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-613d27-7dd6c88557-kb7hq"
Jul 13 21:34:20.937414 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:20.937391    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:34:20.995930 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:20.995912    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-613d27-7dd6c88557-kb7hq"
Jul 13 21:34:21.123874 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:21.123847    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-613d27-7dd6c88557-kb7hq"]
Jul 13 21:34:21.125828 ip-10-0-137-162 kubenswrapper[2561]: W0713 21:34:21.125792    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode62e9f12_c366_4d29_aed7_740dd2108253.slice/crio-010fea656c4445ece8c62ab046f5fdc3bc3a72b6bd92fed0dea7b39a55fd65de WatchSource:0}: Error finding container 010fea656c4445ece8c62ab046f5fdc3bc3a72b6bd92fed0dea7b39a55fd65de: Status 404 returned error can't find the container with id 010fea656c4445ece8c62ab046f5fdc3bc3a72b6bd92fed0dea7b39a55fd65de
Jul 13 21:34:21.151464 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:21.151404    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-613d27-7dd6c88557-kb7hq" event={"ID":"e62e9f12-c366-4d29-aed7-740dd2108253","Type":"ContainerStarted","Data":"010fea656c4445ece8c62ab046f5fdc3bc3a72b6bd92fed0dea7b39a55fd65de"}
Jul 13 21:34:21.242635 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:21.242605    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:34:21.343365 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:21.343338    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:34:22.157556 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:22.157524    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-613d27-7dd6c88557-kb7hq" event={"ID":"e62e9f12-c366-4d29-aed7-740dd2108253","Type":"ContainerStarted","Data":"af53d9c6a477e05d03c9b78463d1379d3ec7da1adb972048e8fc2a02d2a65384"}
Jul 13 21:34:22.157944 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:22.157649    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-613d27-7dd6c88557-kb7hq"
Jul 13 21:34:22.177763 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:22.177710    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-613d27-7dd6c88557-kb7hq" podStartSLOduration=1.7471155569999999 podStartE2EDuration="2.177698164s" totalImagesPullingTime="430.582607ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:34:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:34:22.175525732 +0000 UTC m=+2435.170309155" watchObservedRunningTime="2026-07-13 21:34:22.177698164 +0000 UTC m=+2435.172481585"
Jul 13 21:34:25.085867 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:25.085832    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:34:25.391514 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:25.391434    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:34:25.698411 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:25.698332    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd"]
Jul 13 21:34:25.701497 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:25.701478    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd"
Jul 13 21:34:25.704470 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:25.704448    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-2a506c-openshift-default-dockercfg-m6svs\""
Jul 13 21:34:25.721069 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:25.721048    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd"]
Jul 13 21:34:25.818062 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:25.818018    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:34:25.841142 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:25.841117    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86f69394-2509-47a3-808f-0c44a753458a-istiod-ca-cert\") pod \"e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd\" (UID: \"86f69394-2509-47a3-808f-0c44a753458a\") " pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd"
Jul 13 21:34:25.841280 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:25.841148    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86f69394-2509-47a3-808f-0c44a753458a-workload-socket\") pod \"e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd\" (UID: \"86f69394-2509-47a3-808f-0c44a753458a\") " pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd"
Jul 13 21:34:25.841280 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:25.841189    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86f69394-2509-47a3-808f-0c44a753458a-credential-socket\") pod \"e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd\" (UID: \"86f69394-2509-47a3-808f-0c44a753458a\") " pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd"
Jul 13 21:34:25.841280 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:25.841205    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86f69394-2509-47a3-808f-0c44a753458a-istio-data\") pod \"e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd\" (UID: \"86f69394-2509-47a3-808f-0c44a753458a\") " pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd"
Jul 13 21:34:25.841442 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:25.841297    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86f69394-2509-47a3-808f-0c44a753458a-workload-certs\") pod \"e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd\" (UID: \"86f69394-2509-47a3-808f-0c44a753458a\") " pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd"
Jul 13 21:34:25.841442 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:25.841334    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86f69394-2509-47a3-808f-0c44a753458a-istio-token\") pod \"e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd\" (UID: \"86f69394-2509-47a3-808f-0c44a753458a\") " pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd"
Jul 13 21:34:25.841442 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:25.841397    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g5hb\" (UniqueName: \"kubernetes.io/projected/86f69394-2509-47a3-808f-0c44a753458a-kube-api-access-4g5hb\") pod \"e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd\" (UID: \"86f69394-2509-47a3-808f-0c44a753458a\") " pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd"
Jul 13 21:34:25.841573 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:25.841449    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86f69394-2509-47a3-808f-0c44a753458a-istio-podinfo\") pod \"e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd\" (UID: \"86f69394-2509-47a3-808f-0c44a753458a\") " pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd"
Jul 13 21:34:25.841573 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:25.841484    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86f69394-2509-47a3-808f-0c44a753458a-istio-envoy\") pod \"e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd\" (UID: \"86f69394-2509-47a3-808f-0c44a753458a\") " pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd"
Jul 13 21:34:25.923304 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:25.923240    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:34:25.942429 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:25.942400    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86f69394-2509-47a3-808f-0c44a753458a-istiod-ca-cert\") pod \"e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd\" (UID: \"86f69394-2509-47a3-808f-0c44a753458a\") " pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd"
Jul 13 21:34:25.942571 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:25.942432    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86f69394-2509-47a3-808f-0c44a753458a-workload-socket\") pod \"e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd\" (UID: \"86f69394-2509-47a3-808f-0c44a753458a\") " pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd"
Jul 13 21:34:25.942571 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:25.942474    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86f69394-2509-47a3-808f-0c44a753458a-credential-socket\") pod \"e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd\" (UID: \"86f69394-2509-47a3-808f-0c44a753458a\") " pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd"
Jul 13 21:34:25.942571 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:25.942497    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86f69394-2509-47a3-808f-0c44a753458a-istio-data\") pod \"e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd\" (UID: \"86f69394-2509-47a3-808f-0c44a753458a\") " pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd"
Jul 13 21:34:25.942571 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:25.942541    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86f69394-2509-47a3-808f-0c44a753458a-workload-certs\") pod \"e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd\" (UID: \"86f69394-2509-47a3-808f-0c44a753458a\") " pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd"
Jul 13 21:34:25.942571 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:25.942565    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86f69394-2509-47a3-808f-0c44a753458a-istio-token\") pod \"e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd\" (UID: \"86f69394-2509-47a3-808f-0c44a753458a\") " pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd"
Jul 13 21:34:25.942861 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:25.942604    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g5hb\" (UniqueName: \"kubernetes.io/projected/86f69394-2509-47a3-808f-0c44a753458a-kube-api-access-4g5hb\") pod \"e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd\" (UID: \"86f69394-2509-47a3-808f-0c44a753458a\") " pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd"
Jul 13 21:34:25.942861 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:25.942654    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86f69394-2509-47a3-808f-0c44a753458a-istio-podinfo\") pod \"e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd\" (UID: \"86f69394-2509-47a3-808f-0c44a753458a\") " pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd"
Jul 13 21:34:25.942861 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:25.942704    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86f69394-2509-47a3-808f-0c44a753458a-istio-envoy\") pod \"e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd\" (UID: \"86f69394-2509-47a3-808f-0c44a753458a\") " pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd"
Jul 13 21:34:25.943024 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:25.942924    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86f69394-2509-47a3-808f-0c44a753458a-workload-socket\") pod \"e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd\" (UID: \"86f69394-2509-47a3-808f-0c44a753458a\") " pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd"
Jul 13 21:34:25.943024 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:25.942975    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86f69394-2509-47a3-808f-0c44a753458a-istio-data\") pod \"e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd\" (UID: \"86f69394-2509-47a3-808f-0c44a753458a\") " pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd"
Jul 13 21:34:25.943024 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:25.942992    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86f69394-2509-47a3-808f-0c44a753458a-credential-socket\") pod \"e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd\" (UID: \"86f69394-2509-47a3-808f-0c44a753458a\") " pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd"
Jul 13 21:34:25.943218 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:25.943200    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86f69394-2509-47a3-808f-0c44a753458a-workload-certs\") pod \"e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd\" (UID: \"86f69394-2509-47a3-808f-0c44a753458a\") " pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd"
Jul 13 21:34:25.943268 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:25.943230    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86f69394-2509-47a3-808f-0c44a753458a-istiod-ca-cert\") pod \"e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd\" (UID: \"86f69394-2509-47a3-808f-0c44a753458a\") " pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd"
Jul 13 21:34:25.944856 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:25.944838    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86f69394-2509-47a3-808f-0c44a753458a-istio-envoy\") pod \"e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd\" (UID: \"86f69394-2509-47a3-808f-0c44a753458a\") " pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd"
Jul 13 21:34:25.945192 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:25.945175    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86f69394-2509-47a3-808f-0c44a753458a-istio-podinfo\") pod \"e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd\" (UID: \"86f69394-2509-47a3-808f-0c44a753458a\") " pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd"
Jul 13 21:34:25.951189 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:25.951133    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86f69394-2509-47a3-808f-0c44a753458a-istio-token\") pod \"e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd\" (UID: \"86f69394-2509-47a3-808f-0c44a753458a\") " pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd"
Jul 13 21:34:25.951375 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:25.951354    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g5hb\" (UniqueName: \"kubernetes.io/projected/86f69394-2509-47a3-808f-0c44a753458a-kube-api-access-4g5hb\") pod \"e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd\" (UID: \"86f69394-2509-47a3-808f-0c44a753458a\") " pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd"
Jul 13 21:34:26.014311 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:26.014284    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd"
Jul 13 21:34:26.141255 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:26.141233    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd"]
Jul 13 21:34:26.143754 ip-10-0-137-162 kubenswrapper[2561]: W0713 21:34:26.143723    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86f69394_2509_47a3_808f_0c44a753458a.slice/crio-e345bb696bdd5d0cb810069f1290d3c634e47816038e36690db04c3a714d9d94 WatchSource:0}: Error finding container e345bb696bdd5d0cb810069f1290d3c634e47816038e36690db04c3a714d9d94: Status 404 returned error can't find the container with id e345bb696bdd5d0cb810069f1290d3c634e47816038e36690db04c3a714d9d94
Jul 13 21:34:26.145787 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:26.145754    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 21:34:26.145888 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:26.145846    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 21:34:26.145888 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:26.145877    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 21:34:26.175629 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:26.175609    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd" event={"ID":"86f69394-2509-47a3-808f-0c44a753458a","Type":"ContainerStarted","Data":"e345bb696bdd5d0cb810069f1290d3c634e47816038e36690db04c3a714d9d94"}
Jul 13 21:34:27.183609 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:27.183571    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd" event={"ID":"86f69394-2509-47a3-808f-0c44a753458a","Type":"ContainerStarted","Data":"c4b1b3789ef7d983da4f02cb23d7d3d6aa1c6917d77bf7d2f7f158ef9d2fc8e1"}
Jul 13 21:34:27.208261 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:27.208216    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd" podStartSLOduration=2.208201054 podStartE2EDuration="2.208201054s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:34:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:34:27.206229152 +0000 UTC m=+2440.201012588" watchObservedRunningTime="2026-07-13 21:34:27.208201054 +0000 UTC m=+2440.202984476"
Jul 13 21:34:28.015441 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:28.015410    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd"
Jul 13 21:34:28.020007 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:28.019985    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd"
Jul 13 21:34:28.166564 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:28.166540    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-613d27-7dd6c88557-kb7hq"
Jul 13 21:34:28.187983 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:28.187956    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd"
Jul 13 21:34:28.188799 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:28.188781    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd"
Jul 13 21:34:29.116889 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:29.116768    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:34:29.196980 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:29.196952    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2a506c-7bfc64f748-4g2q8"]
Jul 13 21:34:29.200850 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:29.200828    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a506c-7bfc64f748-4g2q8"
Jul 13 21:34:29.204517 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:29.204491    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:34:29.204653 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:29.204638    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-2a506c-serving-cert\""
Jul 13 21:34:29.211947 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:29.211928    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2a506c-7bfc64f748-4g2q8"]
Jul 13 21:34:29.273048 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:29.273026    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5305f113-06ce-4791-944b-34ebd9b857b3-maas-api-tls\") pod \"maas-api-e2e-inf-b-2a506c-7bfc64f748-4g2q8\" (UID: \"5305f113-06ce-4791-944b-34ebd9b857b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a506c-7bfc64f748-4g2q8"
Jul 13 21:34:29.273155 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:29.273054    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5305f113-06ce-4791-944b-34ebd9b857b3-openshift-service-ca\") pod \"maas-api-e2e-inf-b-2a506c-7bfc64f748-4g2q8\" (UID: \"5305f113-06ce-4791-944b-34ebd9b857b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a506c-7bfc64f748-4g2q8"
Jul 13 21:34:29.273155 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:29.273128    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwpd9\" (UniqueName: \"kubernetes.io/projected/5305f113-06ce-4791-944b-34ebd9b857b3-kube-api-access-qwpd9\") pod \"maas-api-e2e-inf-b-2a506c-7bfc64f748-4g2q8\" (UID: \"5305f113-06ce-4791-944b-34ebd9b857b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a506c-7bfc64f748-4g2q8"
Jul 13 21:34:29.273852 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:29.273832    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:34:29.373891 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:29.373795    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwpd9\" (UniqueName: \"kubernetes.io/projected/5305f113-06ce-4791-944b-34ebd9b857b3-kube-api-access-qwpd9\") pod \"maas-api-e2e-inf-b-2a506c-7bfc64f748-4g2q8\" (UID: \"5305f113-06ce-4791-944b-34ebd9b857b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a506c-7bfc64f748-4g2q8"
Jul 13 21:34:29.374048 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:29.373937    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5305f113-06ce-4791-944b-34ebd9b857b3-maas-api-tls\") pod \"maas-api-e2e-inf-b-2a506c-7bfc64f748-4g2q8\" (UID: \"5305f113-06ce-4791-944b-34ebd9b857b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a506c-7bfc64f748-4g2q8"
Jul 13 21:34:29.374048 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:29.373967    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5305f113-06ce-4791-944b-34ebd9b857b3-openshift-service-ca\") pod \"maas-api-e2e-inf-b-2a506c-7bfc64f748-4g2q8\" (UID: \"5305f113-06ce-4791-944b-34ebd9b857b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a506c-7bfc64f748-4g2q8"
Jul 13 21:34:29.374195 ip-10-0-137-162 kubenswrapper[2561]: E0713 21:34:29.374078    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-2a506c-serving-cert: secret "maas-api-e2e-inf-b-2a506c-serving-cert" not found
Jul 13 21:34:29.374195 ip-10-0-137-162 kubenswrapper[2561]: E0713 21:34:29.374159    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5305f113-06ce-4791-944b-34ebd9b857b3-maas-api-tls podName:5305f113-06ce-4791-944b-34ebd9b857b3 nodeName:}" failed. No retries permitted until 2026-07-13 21:34:29.87414108 +0000 UTC m=+2442.868924482 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5305f113-06ce-4791-944b-34ebd9b857b3-maas-api-tls") pod "maas-api-e2e-inf-b-2a506c-7bfc64f748-4g2q8" (UID: "5305f113-06ce-4791-944b-34ebd9b857b3") : secret "maas-api-e2e-inf-b-2a506c-serving-cert" not found
Jul 13 21:34:29.374707 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:29.374684    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5305f113-06ce-4791-944b-34ebd9b857b3-openshift-service-ca\") pod \"maas-api-e2e-inf-b-2a506c-7bfc64f748-4g2q8\" (UID: \"5305f113-06ce-4791-944b-34ebd9b857b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a506c-7bfc64f748-4g2q8"
Jul 13 21:34:29.384621 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:29.384598    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwpd9\" (UniqueName: \"kubernetes.io/projected/5305f113-06ce-4791-944b-34ebd9b857b3-kube-api-access-qwpd9\") pod \"maas-api-e2e-inf-b-2a506c-7bfc64f748-4g2q8\" (UID: \"5305f113-06ce-4791-944b-34ebd9b857b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a506c-7bfc64f748-4g2q8"
Jul 13 21:34:29.657050 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:29.656991    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:34:29.770578 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:29.770555    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:34:29.868560 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:29.868529    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:34:29.876939 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:29.876923    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5305f113-06ce-4791-944b-34ebd9b857b3-maas-api-tls\") pod \"maas-api-e2e-inf-b-2a506c-7bfc64f748-4g2q8\" (UID: \"5305f113-06ce-4791-944b-34ebd9b857b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a506c-7bfc64f748-4g2q8"
Jul 13 21:34:29.879281 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:29.879260    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5305f113-06ce-4791-944b-34ebd9b857b3-maas-api-tls\") pod \"maas-api-e2e-inf-b-2a506c-7bfc64f748-4g2q8\" (UID: \"5305f113-06ce-4791-944b-34ebd9b857b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a506c-7bfc64f748-4g2q8"
Jul 13 21:34:30.112746 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:30.112716    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a506c-7bfc64f748-4g2q8"
Jul 13 21:34:30.240637 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:30.240614    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2a506c-7bfc64f748-4g2q8"]
Jul 13 21:34:30.242340 ip-10-0-137-162 kubenswrapper[2561]: W0713 21:34:30.242311    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5305f113_06ce_4791_944b_34ebd9b857b3.slice/crio-852b6804e31136fc324161161ac2774d9bdadeb9fbfe2746e0cc6d16d9c531a7 WatchSource:0}: Error finding container 852b6804e31136fc324161161ac2774d9bdadeb9fbfe2746e0cc6d16d9c531a7: Status 404 returned error can't find the container with id 852b6804e31136fc324161161ac2774d9bdadeb9fbfe2746e0cc6d16d9c531a7
Jul 13 21:34:31.204577 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:31.204539    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a506c-7bfc64f748-4g2q8" event={"ID":"5305f113-06ce-4791-944b-34ebd9b857b3","Type":"ContainerStarted","Data":"adf131c4df4382974c40094db75d6fd7ed5a885c57d0f567b18d672144844b86"}
Jul 13 21:34:31.204750 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:31.204600    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a506c-7bfc64f748-4g2q8" event={"ID":"5305f113-06ce-4791-944b-34ebd9b857b3","Type":"ContainerStarted","Data":"852b6804e31136fc324161161ac2774d9bdadeb9fbfe2746e0cc6d16d9c531a7"}
Jul 13 21:34:31.204750 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:31.204671    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a506c-7bfc64f748-4g2q8"
Jul 13 21:34:31.224005 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:31.223960    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a506c-7bfc64f748-4g2q8" podStartSLOduration=1.83757049 podStartE2EDuration="2.223945325s" totalImagesPullingTime="386.374835ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:34:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:34:31.222441186 +0000 UTC m=+2444.217224612" watchObservedRunningTime="2026-07-13 21:34:31.223945325 +0000 UTC m=+2444.218728777"
Jul 13 21:34:33.605975 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:33.605938    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:34:37.215979 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:37.215948    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a506c-7bfc64f748-4g2q8"
Jul 13 21:34:42.116072 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:42.116009    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:34:42.217021 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:42.216956    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:34:43.284800 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:43.284765    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:34:44.229983 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:44.229944    2561 patch_prober.go:28] interesting pod/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 13 21:34:44.230205 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:44.230005    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd" podUID="86f69394-2509-47a3-808f-0c44a753458a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 13 21:34:45.275762 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:45.275728    2561 generic.go:356] "Generic (PLEG): container finished" podID="86f69394-2509-47a3-808f-0c44a753458a" containerID="c4b1b3789ef7d983da4f02cb23d7d3d6aa1c6917d77bf7d2f7f158ef9d2fc8e1" exitCode=0
Jul 13 21:34:45.276241 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:45.275805    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd" event={"ID":"86f69394-2509-47a3-808f-0c44a753458a","Type":"ContainerDied","Data":"c4b1b3789ef7d983da4f02cb23d7d3d6aa1c6917d77bf7d2f7f158ef9d2fc8e1"}
Jul 13 21:34:45.276241 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:45.276226    2561 scope.go:117] "RemoveContainer" containerID="c4b1b3789ef7d983da4f02cb23d7d3d6aa1c6917d77bf7d2f7f158ef9d2fc8e1"
Jul 13 21:34:45.277183 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:45.277158    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 21:34:45.277235 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:45.277227    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 21:34:45.277273 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:45.277257    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 21:34:46.285205 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:46.285166    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd" event={"ID":"86f69394-2509-47a3-808f-0c44a753458a","Type":"ContainerStarted","Data":"0c5e59b52de616d8cf018d22b40202e2e25521ad7a84b40d5c67b0fa345c5531"}
Jul 13 21:34:47.015265 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:47.015233    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd"
Jul 13 21:34:47.015497 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:47.015464    2561 patch_prober.go:28] interesting pod/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 13 21:34:47.015612 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:47.015523    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd" podUID="86f69394-2509-47a3-808f-0c44a753458a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 13 21:34:48.015272 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:48.015238    2561 patch_prober.go:28] interesting pod/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 13 21:34:48.015755 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:48.015317    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd" podUID="86f69394-2509-47a3-808f-0c44a753458a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 13 21:34:49.015226 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:49.015191    2561 patch_prober.go:28] interesting pod/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 13 21:34:49.015419 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:49.015243    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd" podUID="86f69394-2509-47a3-808f-0c44a753458a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 13 21:34:50.036095 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:50.036053    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd"
Jul 13 21:34:50.036943 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:50.036919    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd"
Jul 13 21:34:50.042608 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:50.042566    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd"
Jul 13 21:34:50.777266 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:50.777240    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:34:50.877398 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:34:50.877355    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:35:14.252447 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:35:14.252390    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:35:18.554069 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:35:18.554016    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:35:32.154914 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:35:32.154878    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:35:33.180214 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:35:33.180177    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:35:33.871963 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:35:33.871933    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:35:33.950926 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:35:33.950903    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:35:43.683257 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:35:43.683172    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-613d27-7dd6c88557-kb7hq"]
Jul 13 21:35:43.683715 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:35:43.683387    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-613d27-7dd6c88557-kb7hq" podUID="e62e9f12-c366-4d29-aed7-740dd2108253" containerName="maas-api" containerID="cri-o://af53d9c6a477e05d03c9b78463d1379d3ec7da1adb972048e8fc2a02d2a65384" gracePeriod=30
Jul 13 21:35:43.713508 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:35:43.713457    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:35:44.120980 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:35:44.120957    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-613d27-7dd6c88557-kb7hq"
Jul 13 21:35:44.262496 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:35:44.262425    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e62e9f12-c366-4d29-aed7-740dd2108253-maas-api-tls\") pod \"e62e9f12-c366-4d29-aed7-740dd2108253\" (UID: \"e62e9f12-c366-4d29-aed7-740dd2108253\") "
Jul 13 21:35:44.262496 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:35:44.262492    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfdm8\" (UniqueName: \"kubernetes.io/projected/e62e9f12-c366-4d29-aed7-740dd2108253-kube-api-access-rfdm8\") pod \"e62e9f12-c366-4d29-aed7-740dd2108253\" (UID: \"e62e9f12-c366-4d29-aed7-740dd2108253\") "
Jul 13 21:35:44.262716 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:35:44.262523    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e62e9f12-c366-4d29-aed7-740dd2108253-openshift-service-ca\") pod \"e62e9f12-c366-4d29-aed7-740dd2108253\" (UID: \"e62e9f12-c366-4d29-aed7-740dd2108253\") "
Jul 13 21:35:44.262964 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:35:44.262941    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e62e9f12-c366-4d29-aed7-740dd2108253-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e62e9f12-c366-4d29-aed7-740dd2108253" (UID: "e62e9f12-c366-4d29-aed7-740dd2108253"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:35:44.264457 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:35:44.264432    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e62e9f12-c366-4d29-aed7-740dd2108253-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e62e9f12-c366-4d29-aed7-740dd2108253" (UID: "e62e9f12-c366-4d29-aed7-740dd2108253"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:35:44.264549 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:35:44.264532    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e62e9f12-c366-4d29-aed7-740dd2108253-kube-api-access-rfdm8" (OuterVolumeSpecName: "kube-api-access-rfdm8") pod "e62e9f12-c366-4d29-aed7-740dd2108253" (UID: "e62e9f12-c366-4d29-aed7-740dd2108253"). InnerVolumeSpecName "kube-api-access-rfdm8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:35:44.363541 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:35:44.363511    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfdm8\" (UniqueName: \"kubernetes.io/projected/e62e9f12-c366-4d29-aed7-740dd2108253-kube-api-access-rfdm8\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:35:44.363541 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:35:44.363539    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e62e9f12-c366-4d29-aed7-740dd2108253-openshift-service-ca\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:35:44.363541 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:35:44.363549    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e62e9f12-c366-4d29-aed7-740dd2108253-maas-api-tls\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:35:44.550247 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:35:44.550220    2561 generic.go:356] "Generic (PLEG): container finished" podID="e62e9f12-c366-4d29-aed7-740dd2108253" containerID="af53d9c6a477e05d03c9b78463d1379d3ec7da1adb972048e8fc2a02d2a65384" exitCode=0
Jul 13 21:35:44.550340 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:35:44.550268    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-613d27-7dd6c88557-kb7hq"
Jul 13 21:35:44.550428 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:35:44.550266    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-613d27-7dd6c88557-kb7hq" event={"ID":"e62e9f12-c366-4d29-aed7-740dd2108253","Type":"ContainerDied","Data":"af53d9c6a477e05d03c9b78463d1379d3ec7da1adb972048e8fc2a02d2a65384"}
Jul 13 21:35:44.550428 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:35:44.550390    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-613d27-7dd6c88557-kb7hq" event={"ID":"e62e9f12-c366-4d29-aed7-740dd2108253","Type":"ContainerDied","Data":"010fea656c4445ece8c62ab046f5fdc3bc3a72b6bd92fed0dea7b39a55fd65de"}
Jul 13 21:35:44.550428 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:35:44.550417    2561 scope.go:117] "RemoveContainer" containerID="af53d9c6a477e05d03c9b78463d1379d3ec7da1adb972048e8fc2a02d2a65384"
Jul 13 21:35:44.558701 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:35:44.558687    2561 scope.go:117] "RemoveContainer" containerID="af53d9c6a477e05d03c9b78463d1379d3ec7da1adb972048e8fc2a02d2a65384"
Jul 13 21:35:44.558977 ip-10-0-137-162 kubenswrapper[2561]: E0713 21:35:44.558955    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af53d9c6a477e05d03c9b78463d1379d3ec7da1adb972048e8fc2a02d2a65384\": container with ID starting with af53d9c6a477e05d03c9b78463d1379d3ec7da1adb972048e8fc2a02d2a65384 not found: ID does not exist" containerID="af53d9c6a477e05d03c9b78463d1379d3ec7da1adb972048e8fc2a02d2a65384"
Jul 13 21:35:44.559059 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:35:44.558982    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af53d9c6a477e05d03c9b78463d1379d3ec7da1adb972048e8fc2a02d2a65384"} err="failed to get container status \"af53d9c6a477e05d03c9b78463d1379d3ec7da1adb972048e8fc2a02d2a65384\": rpc error: code = NotFound desc = could not find container \"af53d9c6a477e05d03c9b78463d1379d3ec7da1adb972048e8fc2a02d2a65384\": container with ID starting with af53d9c6a477e05d03c9b78463d1379d3ec7da1adb972048e8fc2a02d2a65384 not found: ID does not exist"
Jul 13 21:35:44.570588 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:35:44.570569    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-613d27-7dd6c88557-kb7hq"]
Jul 13 21:35:44.574200 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:35:44.574182    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-613d27-7dd6c88557-kb7hq"]
Jul 13 21:35:45.576442 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:35:45.576411    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e62e9f12-c366-4d29-aed7-740dd2108253" path="/var/lib/kubelet/pods/e62e9f12-c366-4d29-aed7-740dd2108253/volumes"
Jul 13 21:35:48.371480 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:35:48.371446    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:35:50.909337 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:35:50.909294    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:35:50.972043 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:35:50.972018    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:35:54.152839 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:35:54.152794    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:35:54.256132 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:35:54.256103    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:35:59.078279 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:35:59.078230    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:35:59.295019 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:35:59.294983    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:36:00.108671 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:00.108633    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:36:00.204606 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:00.204575    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:36:09.828656 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:09.828627    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2a506c-7bfc64f748-4g2q8"]
Jul 13 21:36:09.829113 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:09.828853    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a506c-7bfc64f748-4g2q8" podUID="5305f113-06ce-4791-944b-34ebd9b857b3" containerName="maas-api" containerID="cri-o://adf131c4df4382974c40094db75d6fd7ed5a885c57d0f567b18d672144844b86" gracePeriod=30
Jul 13 21:36:09.859980 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:09.859952    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:36:10.072378 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:10.072354    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a506c-7bfc64f748-4g2q8"
Jul 13 21:36:10.154966 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:10.154895    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5305f113-06ce-4791-944b-34ebd9b857b3-maas-api-tls\") pod \"5305f113-06ce-4791-944b-34ebd9b857b3\" (UID: \"5305f113-06ce-4791-944b-34ebd9b857b3\") "
Jul 13 21:36:10.154966 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:10.154929    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5305f113-06ce-4791-944b-34ebd9b857b3-openshift-service-ca\") pod \"5305f113-06ce-4791-944b-34ebd9b857b3\" (UID: \"5305f113-06ce-4791-944b-34ebd9b857b3\") "
Jul 13 21:36:10.155167 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:10.155011    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qwpd9\" (UniqueName: \"kubernetes.io/projected/5305f113-06ce-4791-944b-34ebd9b857b3-kube-api-access-qwpd9\") pod \"5305f113-06ce-4791-944b-34ebd9b857b3\" (UID: \"5305f113-06ce-4791-944b-34ebd9b857b3\") "
Jul 13 21:36:10.155326 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:10.155304    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5305f113-06ce-4791-944b-34ebd9b857b3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5305f113-06ce-4791-944b-34ebd9b857b3" (UID: "5305f113-06ce-4791-944b-34ebd9b857b3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:36:10.156927 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:10.156902    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5305f113-06ce-4791-944b-34ebd9b857b3-kube-api-access-qwpd9" (OuterVolumeSpecName: "kube-api-access-qwpd9") pod "5305f113-06ce-4791-944b-34ebd9b857b3" (UID: "5305f113-06ce-4791-944b-34ebd9b857b3"). InnerVolumeSpecName "kube-api-access-qwpd9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:36:10.156995 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:10.156947    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5305f113-06ce-4791-944b-34ebd9b857b3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5305f113-06ce-4791-944b-34ebd9b857b3" (UID: "5305f113-06ce-4791-944b-34ebd9b857b3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:36:10.256352 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:10.256323    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwpd9\" (UniqueName: \"kubernetes.io/projected/5305f113-06ce-4791-944b-34ebd9b857b3-kube-api-access-qwpd9\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:36:10.256352 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:10.256349    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5305f113-06ce-4791-944b-34ebd9b857b3-maas-api-tls\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:36:10.256352 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:10.256358    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5305f113-06ce-4791-944b-34ebd9b857b3-openshift-service-ca\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:36:10.670571 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:10.670539    2561 generic.go:356] "Generic (PLEG): container finished" podID="5305f113-06ce-4791-944b-34ebd9b857b3" containerID="adf131c4df4382974c40094db75d6fd7ed5a885c57d0f567b18d672144844b86" exitCode=0
Jul 13 21:36:10.670733 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:10.670583    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a506c-7bfc64f748-4g2q8"
Jul 13 21:36:10.670733 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:10.670627    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a506c-7bfc64f748-4g2q8" event={"ID":"5305f113-06ce-4791-944b-34ebd9b857b3","Type":"ContainerDied","Data":"adf131c4df4382974c40094db75d6fd7ed5a885c57d0f567b18d672144844b86"}
Jul 13 21:36:10.670733 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:10.670679    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2a506c-7bfc64f748-4g2q8" event={"ID":"5305f113-06ce-4791-944b-34ebd9b857b3","Type":"ContainerDied","Data":"852b6804e31136fc324161161ac2774d9bdadeb9fbfe2746e0cc6d16d9c531a7"}
Jul 13 21:36:10.670733 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:10.670699    2561 scope.go:117] "RemoveContainer" containerID="adf131c4df4382974c40094db75d6fd7ed5a885c57d0f567b18d672144844b86"
Jul 13 21:36:10.679341 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:10.679323    2561 scope.go:117] "RemoveContainer" containerID="adf131c4df4382974c40094db75d6fd7ed5a885c57d0f567b18d672144844b86"
Jul 13 21:36:10.679586 ip-10-0-137-162 kubenswrapper[2561]: E0713 21:36:10.679569    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adf131c4df4382974c40094db75d6fd7ed5a885c57d0f567b18d672144844b86\": container with ID starting with adf131c4df4382974c40094db75d6fd7ed5a885c57d0f567b18d672144844b86 not found: ID does not exist" containerID="adf131c4df4382974c40094db75d6fd7ed5a885c57d0f567b18d672144844b86"
Jul 13 21:36:10.679647 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:10.679596    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adf131c4df4382974c40094db75d6fd7ed5a885c57d0f567b18d672144844b86"} err="failed to get container status \"adf131c4df4382974c40094db75d6fd7ed5a885c57d0f567b18d672144844b86\": rpc error: code = NotFound desc = could not find container \"adf131c4df4382974c40094db75d6fd7ed5a885c57d0f567b18d672144844b86\": container with ID starting with adf131c4df4382974c40094db75d6fd7ed5a885c57d0f567b18d672144844b86 not found: ID does not exist"
Jul 13 21:36:10.702187 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:10.702163    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2a506c-7bfc64f748-4g2q8"]
Jul 13 21:36:10.705311 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:10.705288    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2a506c-7bfc64f748-4g2q8"]
Jul 13 21:36:11.576476 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:11.576449    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5305f113-06ce-4791-944b-34ebd9b857b3" path="/var/lib/kubelet/pods/5305f113-06ce-4791-944b-34ebd9b857b3/volumes"
Jul 13 21:36:14.566314 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:14.566281    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:36:20.421907 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:20.421872    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:36:20.525319 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:20.525284    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:36:25.181225 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:25.181192    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd"]
Jul 13 21:36:25.181723 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:25.181394    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd" podUID="86f69394-2509-47a3-808f-0c44a753458a" containerName="istio-proxy" containerID="cri-o://0c5e59b52de616d8cf018d22b40202e2e25521ad7a84b40d5c67b0fa345c5531" gracePeriod=30
Jul 13 21:36:25.197242 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:25.197217    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:36:25.447179 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:25.447098    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:36:25.784731 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:25.784702    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:36:26.107663 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:26.107580    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:36:26.276278 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:26.276243    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:36:29.315088 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:29.315052    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:36:29.398324 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:29.398288    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:36:29.558409 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:29.558383    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-eb35a4-5d55f79c6c-95mgx"]
Jul 13 21:36:29.558825 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:29.558782    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5305f113-06ce-4791-944b-34ebd9b857b3" containerName="maas-api"
Jul 13 21:36:29.558825 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:29.558806    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5305f113-06ce-4791-944b-34ebd9b857b3" containerName="maas-api"
Jul 13 21:36:29.559037 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:29.558846    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e62e9f12-c366-4d29-aed7-740dd2108253" containerName="maas-api"
Jul 13 21:36:29.559037 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:29.558852    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e62e9f12-c366-4d29-aed7-740dd2108253" containerName="maas-api"
Jul 13 21:36:29.559037 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:29.558951    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5305f113-06ce-4791-944b-34ebd9b857b3" containerName="maas-api"
Jul 13 21:36:29.559037 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:29.558969    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e62e9f12-c366-4d29-aed7-740dd2108253" containerName="maas-api"
Jul 13 21:36:29.560861 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:29.560836    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-eb35a4-5d55f79c6c-95mgx"
Jul 13 21:36:29.563451 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:29.563433    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-eb35a4-serving-cert\""
Jul 13 21:36:29.563576 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:29.563456    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-j4tgz\""
Jul 13 21:36:29.563576 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:29.563513    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 13 21:36:29.564415 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:29.564399    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 21:36:29.578948 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:29.578930    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-eb35a4-5d55f79c6c-95mgx"]
Jul 13 21:36:29.601877 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:29.601850    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7fhs\" (UniqueName: \"kubernetes.io/projected/e231ea03-6099-4434-92d7-c94b69472cce-kube-api-access-d7fhs\") pod \"maas-api-e2e-api-a-eb35a4-5d55f79c6c-95mgx\" (UID: \"e231ea03-6099-4434-92d7-c94b69472cce\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-eb35a4-5d55f79c6c-95mgx"
Jul 13 21:36:29.601979 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:29.601909    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e231ea03-6099-4434-92d7-c94b69472cce-maas-api-tls\") pod \"maas-api-e2e-api-a-eb35a4-5d55f79c6c-95mgx\" (UID: \"e231ea03-6099-4434-92d7-c94b69472cce\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-eb35a4-5d55f79c6c-95mgx"
Jul 13 21:36:29.601979 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:29.601932    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e231ea03-6099-4434-92d7-c94b69472cce-openshift-service-ca\") pod \"maas-api-e2e-api-a-eb35a4-5d55f79c6c-95mgx\" (UID: \"e231ea03-6099-4434-92d7-c94b69472cce\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-eb35a4-5d55f79c6c-95mgx"
Jul 13 21:36:29.602454 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:29.602438    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:36:29.702533 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:29.702506    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7fhs\" (UniqueName: \"kubernetes.io/projected/e231ea03-6099-4434-92d7-c94b69472cce-kube-api-access-d7fhs\") pod \"maas-api-e2e-api-a-eb35a4-5d55f79c6c-95mgx\" (UID: \"e231ea03-6099-4434-92d7-c94b69472cce\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-eb35a4-5d55f79c6c-95mgx"
Jul 13 21:36:29.702663 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:29.702545    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e231ea03-6099-4434-92d7-c94b69472cce-maas-api-tls\") pod \"maas-api-e2e-api-a-eb35a4-5d55f79c6c-95mgx\" (UID: \"e231ea03-6099-4434-92d7-c94b69472cce\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-eb35a4-5d55f79c6c-95mgx"
Jul 13 21:36:29.702663 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:29.702564    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e231ea03-6099-4434-92d7-c94b69472cce-openshift-service-ca\") pod \"maas-api-e2e-api-a-eb35a4-5d55f79c6c-95mgx\" (UID: \"e231ea03-6099-4434-92d7-c94b69472cce\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-eb35a4-5d55f79c6c-95mgx"
Jul 13 21:36:29.702749 ip-10-0-137-162 kubenswrapper[2561]: E0713 21:36:29.702667    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-eb35a4-serving-cert: secret "maas-api-e2e-api-a-eb35a4-serving-cert" not found
Jul 13 21:36:29.702749 ip-10-0-137-162 kubenswrapper[2561]: E0713 21:36:29.702733    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e231ea03-6099-4434-92d7-c94b69472cce-maas-api-tls podName:e231ea03-6099-4434-92d7-c94b69472cce nodeName:}" failed. No retries permitted until 2026-07-13 21:36:30.202713565 +0000 UTC m=+2563.197496971 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e231ea03-6099-4434-92d7-c94b69472cce-maas-api-tls") pod "maas-api-e2e-api-a-eb35a4-5d55f79c6c-95mgx" (UID: "e231ea03-6099-4434-92d7-c94b69472cce") : secret "maas-api-e2e-api-a-eb35a4-serving-cert" not found
Jul 13 21:36:29.703119 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:29.703102    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e231ea03-6099-4434-92d7-c94b69472cce-openshift-service-ca\") pod \"maas-api-e2e-api-a-eb35a4-5d55f79c6c-95mgx\" (UID: \"e231ea03-6099-4434-92d7-c94b69472cce\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-eb35a4-5d55f79c6c-95mgx"
Jul 13 21:36:29.710724 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:29.710702    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7fhs\" (UniqueName: \"kubernetes.io/projected/e231ea03-6099-4434-92d7-c94b69472cce-kube-api-access-d7fhs\") pod \"maas-api-e2e-api-a-eb35a4-5d55f79c6c-95mgx\" (UID: \"e231ea03-6099-4434-92d7-c94b69472cce\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-eb35a4-5d55f79c6c-95mgx"
Jul 13 21:36:29.791588 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:29.791566    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:36:30.058417 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.058382    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:36:30.159800 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.159773    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:36:30.206030 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.206001    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e231ea03-6099-4434-92d7-c94b69472cce-maas-api-tls\") pod \"maas-api-e2e-api-a-eb35a4-5d55f79c6c-95mgx\" (UID: \"e231ea03-6099-4434-92d7-c94b69472cce\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-eb35a4-5d55f79c6c-95mgx"
Jul 13 21:36:30.208456 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.208428    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e231ea03-6099-4434-92d7-c94b69472cce-maas-api-tls\") pod \"maas-api-e2e-api-a-eb35a4-5d55f79c6c-95mgx\" (UID: \"e231ea03-6099-4434-92d7-c94b69472cce\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-eb35a4-5d55f79c6c-95mgx"
Jul 13 21:36:30.429928 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.429907    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd"
Jul 13 21:36:30.473016 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.472987    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-eb35a4-5d55f79c6c-95mgx"
Jul 13 21:36:30.508789 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.508753    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86f69394-2509-47a3-808f-0c44a753458a-credential-socket\") pod \"86f69394-2509-47a3-808f-0c44a753458a\" (UID: \"86f69394-2509-47a3-808f-0c44a753458a\") "
Jul 13 21:36:30.508942 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.508821    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86f69394-2509-47a3-808f-0c44a753458a-workload-socket\") pod \"86f69394-2509-47a3-808f-0c44a753458a\" (UID: \"86f69394-2509-47a3-808f-0c44a753458a\") "
Jul 13 21:36:30.508942 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.508846    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86f69394-2509-47a3-808f-0c44a753458a-istio-token\") pod \"86f69394-2509-47a3-808f-0c44a753458a\" (UID: \"86f69394-2509-47a3-808f-0c44a753458a\") "
Jul 13 21:36:30.508942 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.508866    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86f69394-2509-47a3-808f-0c44a753458a-istio-data\") pod \"86f69394-2509-47a3-808f-0c44a753458a\" (UID: \"86f69394-2509-47a3-808f-0c44a753458a\") "
Jul 13 21:36:30.508942 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.508889    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86f69394-2509-47a3-808f-0c44a753458a-istio-podinfo\") pod \"86f69394-2509-47a3-808f-0c44a753458a\" (UID: \"86f69394-2509-47a3-808f-0c44a753458a\") "
Jul 13 21:36:30.508942 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.508928    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86f69394-2509-47a3-808f-0c44a753458a-workload-certs\") pod \"86f69394-2509-47a3-808f-0c44a753458a\" (UID: \"86f69394-2509-47a3-808f-0c44a753458a\") "
Jul 13 21:36:30.509209 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.508957    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4g5hb\" (UniqueName: \"kubernetes.io/projected/86f69394-2509-47a3-808f-0c44a753458a-kube-api-access-4g5hb\") pod \"86f69394-2509-47a3-808f-0c44a753458a\" (UID: \"86f69394-2509-47a3-808f-0c44a753458a\") "
Jul 13 21:36:30.509209 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.508992    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86f69394-2509-47a3-808f-0c44a753458a-istiod-ca-cert\") pod \"86f69394-2509-47a3-808f-0c44a753458a\" (UID: \"86f69394-2509-47a3-808f-0c44a753458a\") "
Jul 13 21:36:30.509209 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.509045    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86f69394-2509-47a3-808f-0c44a753458a-istio-envoy\") pod \"86f69394-2509-47a3-808f-0c44a753458a\" (UID: \"86f69394-2509-47a3-808f-0c44a753458a\") "
Jul 13 21:36:30.509209 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.509051    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86f69394-2509-47a3-808f-0c44a753458a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "86f69394-2509-47a3-808f-0c44a753458a" (UID: "86f69394-2509-47a3-808f-0c44a753458a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:36:30.509209 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.509160    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86f69394-2509-47a3-808f-0c44a753458a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "86f69394-2509-47a3-808f-0c44a753458a" (UID: "86f69394-2509-47a3-808f-0c44a753458a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:36:30.509461 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.509299    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86f69394-2509-47a3-808f-0c44a753458a-credential-socket\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:36:30.509461 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.509319    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86f69394-2509-47a3-808f-0c44a753458a-workload-socket\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:36:30.509565 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.509508    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86f69394-2509-47a3-808f-0c44a753458a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "86f69394-2509-47a3-808f-0c44a753458a" (UID: "86f69394-2509-47a3-808f-0c44a753458a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:36:30.509627 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.509566    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86f69394-2509-47a3-808f-0c44a753458a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "86f69394-2509-47a3-808f-0c44a753458a" (UID: "86f69394-2509-47a3-808f-0c44a753458a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:36:30.509869 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.509806    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86f69394-2509-47a3-808f-0c44a753458a-istio-data" (OuterVolumeSpecName: "istio-data") pod "86f69394-2509-47a3-808f-0c44a753458a" (UID: "86f69394-2509-47a3-808f-0c44a753458a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:36:30.511076 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.511051    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/86f69394-2509-47a3-808f-0c44a753458a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "86f69394-2509-47a3-808f-0c44a753458a" (UID: "86f69394-2509-47a3-808f-0c44a753458a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 21:36:30.511337 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.511298    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86f69394-2509-47a3-808f-0c44a753458a-kube-api-access-4g5hb" (OuterVolumeSpecName: "kube-api-access-4g5hb") pod "86f69394-2509-47a3-808f-0c44a753458a" (UID: "86f69394-2509-47a3-808f-0c44a753458a"). InnerVolumeSpecName "kube-api-access-4g5hb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:36:30.512603 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.512579    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86f69394-2509-47a3-808f-0c44a753458a-istio-token" (OuterVolumeSpecName: "istio-token") pod "86f69394-2509-47a3-808f-0c44a753458a" (UID: "86f69394-2509-47a3-808f-0c44a753458a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:36:30.512685 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.512647    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86f69394-2509-47a3-808f-0c44a753458a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "86f69394-2509-47a3-808f-0c44a753458a" (UID: "86f69394-2509-47a3-808f-0c44a753458a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:36:30.600252 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.600228    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-eb35a4-5d55f79c6c-95mgx"]
Jul 13 21:36:30.602060 ip-10-0-137-162 kubenswrapper[2561]: W0713 21:36:30.602029    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode231ea03_6099_4434_92d7_c94b69472cce.slice/crio-c583427c7a0f5827268a7ed26562632295c09729fc5ddeedff56dd860af132bd WatchSource:0}: Error finding container c583427c7a0f5827268a7ed26562632295c09729fc5ddeedff56dd860af132bd: Status 404 returned error can't find the container with id c583427c7a0f5827268a7ed26562632295c09729fc5ddeedff56dd860af132bd
Jul 13 21:36:30.603280 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.603258    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 21:36:30.610540 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.610515    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86f69394-2509-47a3-808f-0c44a753458a-istio-token\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:36:30.610650 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.610543    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86f69394-2509-47a3-808f-0c44a753458a-istio-data\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:36:30.610650 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.610557    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86f69394-2509-47a3-808f-0c44a753458a-istio-podinfo\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:36:30.610650 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.610570    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86f69394-2509-47a3-808f-0c44a753458a-workload-certs\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:36:30.610650 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.610584    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4g5hb\" (UniqueName: \"kubernetes.io/projected/86f69394-2509-47a3-808f-0c44a753458a-kube-api-access-4g5hb\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:36:30.610650 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.610597    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86f69394-2509-47a3-808f-0c44a753458a-istiod-ca-cert\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:36:30.610650 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.610610    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86f69394-2509-47a3-808f-0c44a753458a-istio-envoy\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:36:30.757070 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.757047    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-eb35a4-5d55f79c6c-95mgx" event={"ID":"e231ea03-6099-4434-92d7-c94b69472cce","Type":"ContainerStarted","Data":"c583427c7a0f5827268a7ed26562632295c09729fc5ddeedff56dd860af132bd"}
Jul 13 21:36:30.758643 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.758615    2561 generic.go:356] "Generic (PLEG): container finished" podID="86f69394-2509-47a3-808f-0c44a753458a" containerID="0c5e59b52de616d8cf018d22b40202e2e25521ad7a84b40d5c67b0fa345c5531" exitCode=0
Jul 13 21:36:30.758741 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.758661    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd"
Jul 13 21:36:30.758741 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.758699    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd" event={"ID":"86f69394-2509-47a3-808f-0c44a753458a","Type":"ContainerDied","Data":"0c5e59b52de616d8cf018d22b40202e2e25521ad7a84b40d5c67b0fa345c5531"}
Jul 13 21:36:30.758844 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.758748    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd" event={"ID":"86f69394-2509-47a3-808f-0c44a753458a","Type":"ContainerDied","Data":"e345bb696bdd5d0cb810069f1290d3c634e47816038e36690db04c3a714d9d94"}
Jul 13 21:36:30.758844 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.758776    2561 scope.go:117] "RemoveContainer" containerID="0c5e59b52de616d8cf018d22b40202e2e25521ad7a84b40d5c67b0fa345c5531"
Jul 13 21:36:30.767112 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.767093    2561 scope.go:117] "RemoveContainer" containerID="c4b1b3789ef7d983da4f02cb23d7d3d6aa1c6917d77bf7d2f7f158ef9d2fc8e1"
Jul 13 21:36:30.775886 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.775858    2561 scope.go:117] "RemoveContainer" containerID="0c5e59b52de616d8cf018d22b40202e2e25521ad7a84b40d5c67b0fa345c5531"
Jul 13 21:36:30.776289 ip-10-0-137-162 kubenswrapper[2561]: E0713 21:36:30.776268    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c5e59b52de616d8cf018d22b40202e2e25521ad7a84b40d5c67b0fa345c5531\": container with ID starting with 0c5e59b52de616d8cf018d22b40202e2e25521ad7a84b40d5c67b0fa345c5531 not found: ID does not exist" containerID="0c5e59b52de616d8cf018d22b40202e2e25521ad7a84b40d5c67b0fa345c5531"
Jul 13 21:36:30.776370 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.776298    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c5e59b52de616d8cf018d22b40202e2e25521ad7a84b40d5c67b0fa345c5531"} err="failed to get container status \"0c5e59b52de616d8cf018d22b40202e2e25521ad7a84b40d5c67b0fa345c5531\": rpc error: code = NotFound desc = could not find container \"0c5e59b52de616d8cf018d22b40202e2e25521ad7a84b40d5c67b0fa345c5531\": container with ID starting with 0c5e59b52de616d8cf018d22b40202e2e25521ad7a84b40d5c67b0fa345c5531 not found: ID does not exist"
Jul 13 21:36:30.776370 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.776320    2561 scope.go:117] "RemoveContainer" containerID="c4b1b3789ef7d983da4f02cb23d7d3d6aa1c6917d77bf7d2f7f158ef9d2fc8e1"
Jul 13 21:36:30.776575 ip-10-0-137-162 kubenswrapper[2561]: E0713 21:36:30.776556    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4b1b3789ef7d983da4f02cb23d7d3d6aa1c6917d77bf7d2f7f158ef9d2fc8e1\": container with ID starting with c4b1b3789ef7d983da4f02cb23d7d3d6aa1c6917d77bf7d2f7f158ef9d2fc8e1 not found: ID does not exist" containerID="c4b1b3789ef7d983da4f02cb23d7d3d6aa1c6917d77bf7d2f7f158ef9d2fc8e1"
Jul 13 21:36:30.776644 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.776581    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4b1b3789ef7d983da4f02cb23d7d3d6aa1c6917d77bf7d2f7f158ef9d2fc8e1"} err="failed to get container status \"c4b1b3789ef7d983da4f02cb23d7d3d6aa1c6917d77bf7d2f7f158ef9d2fc8e1\": rpc error: code = NotFound desc = could not find container \"c4b1b3789ef7d983da4f02cb23d7d3d6aa1c6917d77bf7d2f7f158ef9d2fc8e1\": container with ID starting with c4b1b3789ef7d983da4f02cb23d7d3d6aa1c6917d77bf7d2f7f158ef9d2fc8e1 not found: ID does not exist"
Jul 13 21:36:30.780032 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.780013    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd"]
Jul 13 21:36:30.786579 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:30.786557    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-2a506c-openshift-default-c8c85d88f-r4pvd"]
Jul 13 21:36:31.576562 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:31.576529    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86f69394-2509-47a3-808f-0c44a753458a" path="/var/lib/kubelet/pods/86f69394-2509-47a3-808f-0c44a753458a/volumes"
Jul 13 21:36:31.764801 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:31.764761    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-eb35a4-5d55f79c6c-95mgx" event={"ID":"e231ea03-6099-4434-92d7-c94b69472cce","Type":"ContainerStarted","Data":"efd23d497e6eaf866c64ebd6dc8e6a1d115b4ea20f60a824a9cc8bdec16301bc"}
Jul 13 21:36:31.765002 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:31.764919    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-eb35a4-5d55f79c6c-95mgx"
Jul 13 21:36:31.783983 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:31.783934    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-eb35a4-5d55f79c6c-95mgx" podStartSLOduration=2.220206413 podStartE2EDuration="2.783920894s" totalImagesPullingTime="563.714481ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:36:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:36:31.783376542 +0000 UTC m=+2564.778159964" watchObservedRunningTime="2026-07-13 21:36:31.783920894 +0000 UTC m=+2564.778704315"
Jul 13 21:36:33.785947 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:33.785904    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:36:34.330059 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:34.329992    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:36:34.579937 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:34.579876    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:36:34.833512 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:34.833486    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:36:37.394369 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:37.394300    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:36:37.505317 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:37.505286    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c6c469-7c47cbdffc-6p96d"]
Jul 13 21:36:37.505733 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:37.505700    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86f69394-2509-47a3-808f-0c44a753458a" containerName="istio-proxy"
Jul 13 21:36:37.505733 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:37.505722    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="86f69394-2509-47a3-808f-0c44a753458a" containerName="istio-proxy"
Jul 13 21:36:37.505962 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:37.505746    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86f69394-2509-47a3-808f-0c44a753458a" containerName="istio-proxy"
Jul 13 21:36:37.505962 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:37.505754    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="86f69394-2509-47a3-808f-0c44a753458a" containerName="istio-proxy"
Jul 13 21:36:37.505962 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:37.505858    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="86f69394-2509-47a3-808f-0c44a753458a" containerName="istio-proxy"
Jul 13 21:36:37.508033 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:37.508014    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c6c469-7c47cbdffc-6p96d"
Jul 13 21:36:37.510755 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:37.510728    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-c6c469-serving-cert\""
Jul 13 21:36:37.521100 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:37.521079    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c6c469-7c47cbdffc-6p96d"]
Jul 13 21:36:37.560585 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:37.560562    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:36:37.566733 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:37.566708    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzbj6\" (UniqueName: \"kubernetes.io/projected/e7b1bbad-9887-4738-81df-3354074a9366-kube-api-access-qzbj6\") pod \"maas-api-e2e-api-b-c6c469-7c47cbdffc-6p96d\" (UID: \"e7b1bbad-9887-4738-81df-3354074a9366\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c6c469-7c47cbdffc-6p96d"
Jul 13 21:36:37.566858 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:37.566759    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7b1bbad-9887-4738-81df-3354074a9366-maas-api-tls\") pod \"maas-api-e2e-api-b-c6c469-7c47cbdffc-6p96d\" (UID: \"e7b1bbad-9887-4738-81df-3354074a9366\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c6c469-7c47cbdffc-6p96d"
Jul 13 21:36:37.566858 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:37.566836    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7b1bbad-9887-4738-81df-3354074a9366-openshift-service-ca\") pod \"maas-api-e2e-api-b-c6c469-7c47cbdffc-6p96d\" (UID: \"e7b1bbad-9887-4738-81df-3354074a9366\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c6c469-7c47cbdffc-6p96d"
Jul 13 21:36:37.661401 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:37.661330    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:36:37.667622 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:37.667599    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7b1bbad-9887-4738-81df-3354074a9366-maas-api-tls\") pod \"maas-api-e2e-api-b-c6c469-7c47cbdffc-6p96d\" (UID: \"e7b1bbad-9887-4738-81df-3354074a9366\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c6c469-7c47cbdffc-6p96d"
Jul 13 21:36:37.667753 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:37.667637    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7b1bbad-9887-4738-81df-3354074a9366-openshift-service-ca\") pod \"maas-api-e2e-api-b-c6c469-7c47cbdffc-6p96d\" (UID: \"e7b1bbad-9887-4738-81df-3354074a9366\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c6c469-7c47cbdffc-6p96d"
Jul 13 21:36:37.667753 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:37.667705    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzbj6\" (UniqueName: \"kubernetes.io/projected/e7b1bbad-9887-4738-81df-3354074a9366-kube-api-access-qzbj6\") pod \"maas-api-e2e-api-b-c6c469-7c47cbdffc-6p96d\" (UID: \"e7b1bbad-9887-4738-81df-3354074a9366\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c6c469-7c47cbdffc-6p96d"
Jul 13 21:36:37.668365 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:37.668338    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7b1bbad-9887-4738-81df-3354074a9366-openshift-service-ca\") pod \"maas-api-e2e-api-b-c6c469-7c47cbdffc-6p96d\" (UID: \"e7b1bbad-9887-4738-81df-3354074a9366\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c6c469-7c47cbdffc-6p96d"
Jul 13 21:36:37.669985 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:37.669968    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7b1bbad-9887-4738-81df-3354074a9366-maas-api-tls\") pod \"maas-api-e2e-api-b-c6c469-7c47cbdffc-6p96d\" (UID: \"e7b1bbad-9887-4738-81df-3354074a9366\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c6c469-7c47cbdffc-6p96d"
Jul 13 21:36:37.676282 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:37.676259    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzbj6\" (UniqueName: \"kubernetes.io/projected/e7b1bbad-9887-4738-81df-3354074a9366-kube-api-access-qzbj6\") pod \"maas-api-e2e-api-b-c6c469-7c47cbdffc-6p96d\" (UID: \"e7b1bbad-9887-4738-81df-3354074a9366\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c6c469-7c47cbdffc-6p96d"
Jul 13 21:36:37.758370 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:37.758340    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:36:37.776250 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:37.776232    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-eb35a4-5d55f79c6c-95mgx"
Jul 13 21:36:37.821905 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:37.821877    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c6c469-7c47cbdffc-6p96d"
Jul 13 21:36:37.962670 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:37.962578    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c6c469-7c47cbdffc-6p96d"]
Jul 13 21:36:37.965738 ip-10-0-137-162 kubenswrapper[2561]: W0713 21:36:37.965710    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7b1bbad_9887_4738_81df_3354074a9366.slice/crio-62b0ebfde4ef22b612911b455d5ad510b70ba6f2084c8dd8f00f3277812be39a WatchSource:0}: Error finding container 62b0ebfde4ef22b612911b455d5ad510b70ba6f2084c8dd8f00f3277812be39a: Status 404 returned error can't find the container with id 62b0ebfde4ef22b612911b455d5ad510b70ba6f2084c8dd8f00f3277812be39a
Jul 13 21:36:38.180860 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:38.180803    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:36:38.286845 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:38.286797    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:36:38.796845 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:38.796799    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c6c469-7c47cbdffc-6p96d" event={"ID":"e7b1bbad-9887-4738-81df-3354074a9366","Type":"ContainerStarted","Data":"512bb538209ab2aa34071ac8012974540b785783a67b549ad7431f8461594231"}
Jul 13 21:36:38.797227 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:38.796859    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c6c469-7c47cbdffc-6p96d" event={"ID":"e7b1bbad-9887-4738-81df-3354074a9366","Type":"ContainerStarted","Data":"62b0ebfde4ef22b612911b455d5ad510b70ba6f2084c8dd8f00f3277812be39a"}
Jul 13 21:36:38.797227 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:38.796922    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c6c469-7c47cbdffc-6p96d"
Jul 13 21:36:38.820075 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:38.820036    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c6c469-7c47cbdffc-6p96d" podStartSLOduration=1.488225069 podStartE2EDuration="1.820022652s" totalImagesPullingTime="331.797583ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:36:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:36:38.817968222 +0000 UTC m=+2571.812751644" watchObservedRunningTime="2026-07-13 21:36:38.820022652 +0000 UTC m=+2571.814806103"
Jul 13 21:36:41.844058 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:41.844029    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:36:44.807574 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:44.807544    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c6c469-7c47cbdffc-6p96d"
Jul 13 21:36:48.293882 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:48.293831    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:36:48.398761 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:48.398719    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:36:49.845494 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:49.845468    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-eb35a4-ffp6b"]
Jul 13 21:36:49.845911 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:49.845862    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="86f69394-2509-47a3-808f-0c44a753458a" containerName="istio-proxy"
Jul 13 21:36:49.848755 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:49.848737    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-eb35a4-ffp6b"
Jul 13 21:36:49.851311 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:49.851277    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rnndk\""
Jul 13 21:36:49.856878 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:49.856858    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-eb35a4-ffp6b"]
Jul 13 21:36:49.969185 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:49.969154    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/23778213-200f-42f4-8139-58958d2e2ac9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-eb35a4-ffp6b\" (UID: \"23778213-200f-42f4-8139-58958d2e2ac9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-eb35a4-ffp6b"
Jul 13 21:36:50.070062 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:50.070025    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/23778213-200f-42f4-8139-58958d2e2ac9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-eb35a4-ffp6b\" (UID: \"23778213-200f-42f4-8139-58958d2e2ac9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-eb35a4-ffp6b"
Jul 13 21:36:50.070634 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:50.070617    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/23778213-200f-42f4-8139-58958d2e2ac9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-eb35a4-ffp6b\" (UID: \"23778213-200f-42f4-8139-58958d2e2ac9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-eb35a4-ffp6b"
Jul 13 21:36:50.158758 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:50.158699    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-eb35a4-ffp6b"
Jul 13 21:36:50.285579 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:50.285555    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-eb35a4-ffp6b"]
Jul 13 21:36:50.287718 ip-10-0-137-162 kubenswrapper[2561]: W0713 21:36:50.287683    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23778213_200f_42f4_8139_58958d2e2ac9.slice/crio-0fe08727cd25c54bd41ff35f38aef39b0849870e9aa648f2438d4b44cae1ea40 WatchSource:0}: Error finding container 0fe08727cd25c54bd41ff35f38aef39b0849870e9aa648f2438d4b44cae1ea40: Status 404 returned error can't find the container with id 0fe08727cd25c54bd41ff35f38aef39b0849870e9aa648f2438d4b44cae1ea40
Jul 13 21:36:50.351820 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:50.351791    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:36:50.454974 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:50.454879    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:36:50.855595 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:50.855562    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-eb35a4-ffp6b" event={"ID":"23778213-200f-42f4-8139-58958d2e2ac9","Type":"ContainerStarted","Data":"79a3e9aa36ed6eb0f8421757547322439691e181abad61272bb38e7d3b8c5387"}
Jul 13 21:36:50.855980 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:50.855609    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-eb35a4-ffp6b" event={"ID":"23778213-200f-42f4-8139-58958d2e2ac9","Type":"ContainerStarted","Data":"0fe08727cd25c54bd41ff35f38aef39b0849870e9aa648f2438d4b44cae1ea40"}
Jul 13 21:36:50.872970 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:50.872926    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-eb35a4-ffp6b" podStartSLOduration=1.872911344 podStartE2EDuration="1.872911344s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:36:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:36:50.871477621 +0000 UTC m=+2583.866261044" watchObservedRunningTime="2026-07-13 21:36:50.872911344 +0000 UTC m=+2583.867694765"
Jul 13 21:36:51.861864 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:51.861829    2561 generic.go:356] "Generic (PLEG): container finished" podID="23778213-200f-42f4-8139-58958d2e2ac9" containerID="79a3e9aa36ed6eb0f8421757547322439691e181abad61272bb38e7d3b8c5387" exitCode=0
Jul 13 21:36:51.862258 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:51.861904    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-eb35a4-ffp6b" event={"ID":"23778213-200f-42f4-8139-58958d2e2ac9","Type":"ContainerDied","Data":"79a3e9aa36ed6eb0f8421757547322439691e181abad61272bb38e7d3b8c5387"}
Jul 13 21:36:53.008700 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:53.008673    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-eb35a4-ffp6b"
Jul 13 21:36:53.091765 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:53.091725    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/23778213-200f-42f4-8139-58958d2e2ac9-maas-api-service-ca\") pod \"23778213-200f-42f4-8139-58958d2e2ac9\" (UID: \"23778213-200f-42f4-8139-58958d2e2ac9\") "
Jul 13 21:36:53.092102 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:53.092077    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23778213-200f-42f4-8139-58958d2e2ac9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "23778213-200f-42f4-8139-58958d2e2ac9" (UID: "23778213-200f-42f4-8139-58958d2e2ac9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:36:53.193074 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:53.193011    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/23778213-200f-42f4-8139-58958d2e2ac9-maas-api-service-ca\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:36:53.872331 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:53.872252    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-eb35a4-ffp6b"
Jul 13 21:36:53.872331 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:53.872292    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-eb35a4-ffp6b" event={"ID":"23778213-200f-42f4-8139-58958d2e2ac9","Type":"ContainerDied","Data":"0fe08727cd25c54bd41ff35f38aef39b0849870e9aa648f2438d4b44cae1ea40"}
Jul 13 21:36:53.872500 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:53.872339    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0fe08727cd25c54bd41ff35f38aef39b0849870e9aa648f2438d4b44cae1ea40"
Jul 13 21:36:58.984121 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:58.984084    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:36:59.085351 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:36:59.085325    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:37:00.388639 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:00.388603    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:37:00.489211 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:00.489186    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:37:00.632669 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:00.632635    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-eb35a4-5d55f79c6c-95mgx"]
Jul 13 21:37:00.632913 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:00.632883    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-eb35a4-5d55f79c6c-95mgx" podUID="e231ea03-6099-4434-92d7-c94b69472cce" containerName="maas-api" containerID="cri-o://efd23d497e6eaf866c64ebd6dc8e6a1d115b4ea20f60a824a9cc8bdec16301bc" gracePeriod=30
Jul 13 21:37:00.668352 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:00.668328    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:37:00.878776 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:00.878754    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-eb35a4-5d55f79c6c-95mgx"
Jul 13 21:37:00.906227 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:00.906155    2561 generic.go:356] "Generic (PLEG): container finished" podID="e231ea03-6099-4434-92d7-c94b69472cce" containerID="efd23d497e6eaf866c64ebd6dc8e6a1d115b4ea20f60a824a9cc8bdec16301bc" exitCode=0
Jul 13 21:37:00.906227 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:00.906199    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-eb35a4-5d55f79c6c-95mgx"
Jul 13 21:37:00.906372 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:00.906195    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-eb35a4-5d55f79c6c-95mgx" event={"ID":"e231ea03-6099-4434-92d7-c94b69472cce","Type":"ContainerDied","Data":"efd23d497e6eaf866c64ebd6dc8e6a1d115b4ea20f60a824a9cc8bdec16301bc"}
Jul 13 21:37:00.906372 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:00.906337    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-eb35a4-5d55f79c6c-95mgx" event={"ID":"e231ea03-6099-4434-92d7-c94b69472cce","Type":"ContainerDied","Data":"c583427c7a0f5827268a7ed26562632295c09729fc5ddeedff56dd860af132bd"}
Jul 13 21:37:00.906491 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:00.906372    2561 scope.go:117] "RemoveContainer" containerID="efd23d497e6eaf866c64ebd6dc8e6a1d115b4ea20f60a824a9cc8bdec16301bc"
Jul 13 21:37:00.915807 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:00.915792    2561 scope.go:117] "RemoveContainer" containerID="efd23d497e6eaf866c64ebd6dc8e6a1d115b4ea20f60a824a9cc8bdec16301bc"
Jul 13 21:37:00.916098 ip-10-0-137-162 kubenswrapper[2561]: E0713 21:37:00.916079    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efd23d497e6eaf866c64ebd6dc8e6a1d115b4ea20f60a824a9cc8bdec16301bc\": container with ID starting with efd23d497e6eaf866c64ebd6dc8e6a1d115b4ea20f60a824a9cc8bdec16301bc not found: ID does not exist" containerID="efd23d497e6eaf866c64ebd6dc8e6a1d115b4ea20f60a824a9cc8bdec16301bc"
Jul 13 21:37:00.916155 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:00.916106    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efd23d497e6eaf866c64ebd6dc8e6a1d115b4ea20f60a824a9cc8bdec16301bc"} err="failed to get container status \"efd23d497e6eaf866c64ebd6dc8e6a1d115b4ea20f60a824a9cc8bdec16301bc\": rpc error: code = NotFound desc = could not find container \"efd23d497e6eaf866c64ebd6dc8e6a1d115b4ea20f60a824a9cc8bdec16301bc\": container with ID starting with efd23d497e6eaf866c64ebd6dc8e6a1d115b4ea20f60a824a9cc8bdec16301bc not found: ID does not exist"
Jul 13 21:37:01.054264 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:01.054237    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7fhs\" (UniqueName: \"kubernetes.io/projected/e231ea03-6099-4434-92d7-c94b69472cce-kube-api-access-d7fhs\") pod \"e231ea03-6099-4434-92d7-c94b69472cce\" (UID: \"e231ea03-6099-4434-92d7-c94b69472cce\") "
Jul 13 21:37:01.054389 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:01.054297    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e231ea03-6099-4434-92d7-c94b69472cce-openshift-service-ca\") pod \"e231ea03-6099-4434-92d7-c94b69472cce\" (UID: \"e231ea03-6099-4434-92d7-c94b69472cce\") "
Jul 13 21:37:01.054389 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:01.054338    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e231ea03-6099-4434-92d7-c94b69472cce-maas-api-tls\") pod \"e231ea03-6099-4434-92d7-c94b69472cce\" (UID: \"e231ea03-6099-4434-92d7-c94b69472cce\") "
Jul 13 21:37:01.054720 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:01.054696    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e231ea03-6099-4434-92d7-c94b69472cce-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e231ea03-6099-4434-92d7-c94b69472cce" (UID: "e231ea03-6099-4434-92d7-c94b69472cce"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:37:01.056282 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:01.056254    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e231ea03-6099-4434-92d7-c94b69472cce-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e231ea03-6099-4434-92d7-c94b69472cce" (UID: "e231ea03-6099-4434-92d7-c94b69472cce"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:37:01.056282 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:01.056257    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e231ea03-6099-4434-92d7-c94b69472cce-kube-api-access-d7fhs" (OuterVolumeSpecName: "kube-api-access-d7fhs") pod "e231ea03-6099-4434-92d7-c94b69472cce" (UID: "e231ea03-6099-4434-92d7-c94b69472cce"). InnerVolumeSpecName "kube-api-access-d7fhs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:37:01.155485 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:01.155463    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7fhs\" (UniqueName: \"kubernetes.io/projected/e231ea03-6099-4434-92d7-c94b69472cce-kube-api-access-d7fhs\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:37:01.155485 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:01.155484    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e231ea03-6099-4434-92d7-c94b69472cce-openshift-service-ca\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:37:01.155608 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:01.155493    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e231ea03-6099-4434-92d7-c94b69472cce-maas-api-tls\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:37:01.228281 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:01.228260    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-eb35a4-5d55f79c6c-95mgx"]
Jul 13 21:37:01.232414 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:01.232396    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-eb35a4-5d55f79c6c-95mgx"]
Jul 13 21:37:01.576458 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:01.576426    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e231ea03-6099-4434-92d7-c94b69472cce" path="/var/lib/kubelet/pods/e231ea03-6099-4434-92d7-c94b69472cce/volumes"
Jul 13 21:37:04.936016 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:04.935964    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:37:10.882272 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:10.882160    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:37:10.983093 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:10.983054    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:37:15.648858 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:15.648792    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:37:15.862827 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:15.862790    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:37:15.976279 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:15.976202    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c6c469-4j29q"]
Jul 13 21:37:15.976516 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:15.976504    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e231ea03-6099-4434-92d7-c94b69472cce" containerName="maas-api"
Jul 13 21:37:15.976564 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:15.976517    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e231ea03-6099-4434-92d7-c94b69472cce" containerName="maas-api"
Jul 13 21:37:15.976564 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:15.976529    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23778213-200f-42f4-8139-58958d2e2ac9" containerName="revoke-keys"
Jul 13 21:37:15.976564 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:15.976536    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="23778213-200f-42f4-8139-58958d2e2ac9" containerName="revoke-keys"
Jul 13 21:37:15.976715 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:15.976587    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="23778213-200f-42f4-8139-58958d2e2ac9" containerName="revoke-keys"
Jul 13 21:37:15.976715 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:15.976596    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e231ea03-6099-4434-92d7-c94b69472cce" containerName="maas-api"
Jul 13 21:37:15.980823 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:15.980793    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c6c469-4j29q"
Jul 13 21:37:15.983354 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:15.983334    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rnndk\""
Jul 13 21:37:15.987341 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:15.987319    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c6c469-4j29q"]
Jul 13 21:37:16.066701 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:16.066669    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d70d14e-e1d5-463a-87a0-409e36645871-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-c6c469-4j29q\" (UID: \"7d70d14e-e1d5-463a-87a0-409e36645871\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c6c469-4j29q"
Jul 13 21:37:16.167097 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:16.167068    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d70d14e-e1d5-463a-87a0-409e36645871-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-c6c469-4j29q\" (UID: \"7d70d14e-e1d5-463a-87a0-409e36645871\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c6c469-4j29q"
Jul 13 21:37:16.167641 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:16.167621    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d70d14e-e1d5-463a-87a0-409e36645871-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-c6c469-4j29q\" (UID: \"7d70d14e-e1d5-463a-87a0-409e36645871\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c6c469-4j29q"
Jul 13 21:37:16.291959 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:16.291930    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c6c469-4j29q"
Jul 13 21:37:16.414835 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:16.414782    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c6c469-4j29q"]
Jul 13 21:37:16.417441 ip-10-0-137-162 kubenswrapper[2561]: W0713 21:37:16.417417    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d70d14e_e1d5_463a_87a0_409e36645871.slice/crio-116ad08f316f626cc854bdfd409fa9c0350cda6c0968decfcd450b61acc3fba1 WatchSource:0}: Error finding container 116ad08f316f626cc854bdfd409fa9c0350cda6c0968decfcd450b61acc3fba1: Status 404 returned error can't find the container with id 116ad08f316f626cc854bdfd409fa9c0350cda6c0968decfcd450b61acc3fba1
Jul 13 21:37:16.601307 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:16.601267    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:37:16.701913 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:16.701885    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:37:16.979443 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:16.979352    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c6c469-4j29q" event={"ID":"7d70d14e-e1d5-463a-87a0-409e36645871","Type":"ContainerStarted","Data":"8426229159e9ec1ca7cc78f9e32e36e0089b51fd121a93236561b5130d78c224"}
Jul 13 21:37:16.979443 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:16.979400    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c6c469-4j29q" event={"ID":"7d70d14e-e1d5-463a-87a0-409e36645871","Type":"ContainerStarted","Data":"116ad08f316f626cc854bdfd409fa9c0350cda6c0968decfcd450b61acc3fba1"}
Jul 13 21:37:16.997542 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:16.997495    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c6c469-4j29q" podStartSLOduration=1.997481467 podStartE2EDuration="1.997481467s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:37:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:37:16.995593264 +0000 UTC m=+2609.990376686" watchObservedRunningTime="2026-07-13 21:37:16.997481467 +0000 UTC m=+2609.992264928"
Jul 13 21:37:17.984878 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:17.984849    2561 generic.go:356] "Generic (PLEG): container finished" podID="7d70d14e-e1d5-463a-87a0-409e36645871" containerID="8426229159e9ec1ca7cc78f9e32e36e0089b51fd121a93236561b5130d78c224" exitCode=0
Jul 13 21:37:17.985242 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:17.984924    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c6c469-4j29q" event={"ID":"7d70d14e-e1d5-463a-87a0-409e36645871","Type":"ContainerDied","Data":"8426229159e9ec1ca7cc78f9e32e36e0089b51fd121a93236561b5130d78c224"}
Jul 13 21:37:19.109797 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:19.109774    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c6c469-4j29q"
Jul 13 21:37:19.186577 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:19.186554    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d70d14e-e1d5-463a-87a0-409e36645871-maas-api-service-ca\") pod \"7d70d14e-e1d5-463a-87a0-409e36645871\" (UID: \"7d70d14e-e1d5-463a-87a0-409e36645871\") "
Jul 13 21:37:19.186885 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:19.186866    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d70d14e-e1d5-463a-87a0-409e36645871-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7d70d14e-e1d5-463a-87a0-409e36645871" (UID: "7d70d14e-e1d5-463a-87a0-409e36645871"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:37:19.287032 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:19.287010    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d70d14e-e1d5-463a-87a0-409e36645871-maas-api-service-ca\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:37:19.994589 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:19.994506    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c6c469-4j29q" event={"ID":"7d70d14e-e1d5-463a-87a0-409e36645871","Type":"ContainerDied","Data":"116ad08f316f626cc854bdfd409fa9c0350cda6c0968decfcd450b61acc3fba1"}
Jul 13 21:37:19.994589 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:19.994533    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c6c469-4j29q"
Jul 13 21:37:19.994589 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:19.994553    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="116ad08f316f626cc854bdfd409fa9c0350cda6c0968decfcd450b61acc3fba1"
Jul 13 21:37:26.511700 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:26.511663    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c6c469-7c47cbdffc-6p96d"]
Jul 13 21:37:26.512167 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:26.511964    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c6c469-7c47cbdffc-6p96d" podUID="e7b1bbad-9887-4738-81df-3354074a9366" containerName="maas-api" containerID="cri-o://512bb538209ab2aa34071ac8012974540b785783a67b549ad7431f8461594231" gracePeriod=30
Jul 13 21:37:26.534969 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:26.534944    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:37:26.757389 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:26.757368    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c6c469-7c47cbdffc-6p96d"
Jul 13 21:37:26.844392 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:26.844359    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7b1bbad-9887-4738-81df-3354074a9366-openshift-service-ca\") pod \"e7b1bbad-9887-4738-81df-3354074a9366\" (UID: \"e7b1bbad-9887-4738-81df-3354074a9366\") "
Jul 13 21:37:26.844567 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:26.844451    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7b1bbad-9887-4738-81df-3354074a9366-maas-api-tls\") pod \"e7b1bbad-9887-4738-81df-3354074a9366\" (UID: \"e7b1bbad-9887-4738-81df-3354074a9366\") "
Jul 13 21:37:26.844567 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:26.844487    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzbj6\" (UniqueName: \"kubernetes.io/projected/e7b1bbad-9887-4738-81df-3354074a9366-kube-api-access-qzbj6\") pod \"e7b1bbad-9887-4738-81df-3354074a9366\" (UID: \"e7b1bbad-9887-4738-81df-3354074a9366\") "
Jul 13 21:37:26.844766 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:26.844746    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7b1bbad-9887-4738-81df-3354074a9366-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e7b1bbad-9887-4738-81df-3354074a9366" (UID: "e7b1bbad-9887-4738-81df-3354074a9366"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:37:26.846515 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:26.846491    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7b1bbad-9887-4738-81df-3354074a9366-kube-api-access-qzbj6" (OuterVolumeSpecName: "kube-api-access-qzbj6") pod "e7b1bbad-9887-4738-81df-3354074a9366" (UID: "e7b1bbad-9887-4738-81df-3354074a9366"). InnerVolumeSpecName "kube-api-access-qzbj6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:37:26.846729 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:26.846516    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7b1bbad-9887-4738-81df-3354074a9366-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e7b1bbad-9887-4738-81df-3354074a9366" (UID: "e7b1bbad-9887-4738-81df-3354074a9366"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:37:26.945291 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:26.945266    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7b1bbad-9887-4738-81df-3354074a9366-maas-api-tls\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:37:26.945291 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:26.945287    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzbj6\" (UniqueName: \"kubernetes.io/projected/e7b1bbad-9887-4738-81df-3354074a9366-kube-api-access-qzbj6\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:37:26.945429 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:26.945297    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7b1bbad-9887-4738-81df-3354074a9366-openshift-service-ca\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:37:27.026503 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:27.026474    2561 generic.go:356] "Generic (PLEG): container finished" podID="e7b1bbad-9887-4738-81df-3354074a9366" containerID="512bb538209ab2aa34071ac8012974540b785783a67b549ad7431f8461594231" exitCode=0
Jul 13 21:37:27.026627 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:27.026513    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c6c469-7c47cbdffc-6p96d" event={"ID":"e7b1bbad-9887-4738-81df-3354074a9366","Type":"ContainerDied","Data":"512bb538209ab2aa34071ac8012974540b785783a67b549ad7431f8461594231"}
Jul 13 21:37:27.026627 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:27.026519    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c6c469-7c47cbdffc-6p96d"
Jul 13 21:37:27.026627 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:27.026550    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c6c469-7c47cbdffc-6p96d" event={"ID":"e7b1bbad-9887-4738-81df-3354074a9366","Type":"ContainerDied","Data":"62b0ebfde4ef22b612911b455d5ad510b70ba6f2084c8dd8f00f3277812be39a"}
Jul 13 21:37:27.026627 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:27.026575    2561 scope.go:117] "RemoveContainer" containerID="512bb538209ab2aa34071ac8012974540b785783a67b549ad7431f8461594231"
Jul 13 21:37:27.035230 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:27.035214    2561 scope.go:117] "RemoveContainer" containerID="512bb538209ab2aa34071ac8012974540b785783a67b549ad7431f8461594231"
Jul 13 21:37:27.035471 ip-10-0-137-162 kubenswrapper[2561]: E0713 21:37:27.035448    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"512bb538209ab2aa34071ac8012974540b785783a67b549ad7431f8461594231\": container with ID starting with 512bb538209ab2aa34071ac8012974540b785783a67b549ad7431f8461594231 not found: ID does not exist" containerID="512bb538209ab2aa34071ac8012974540b785783a67b549ad7431f8461594231"
Jul 13 21:37:27.035537 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:27.035478    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"512bb538209ab2aa34071ac8012974540b785783a67b549ad7431f8461594231"} err="failed to get container status \"512bb538209ab2aa34071ac8012974540b785783a67b549ad7431f8461594231\": rpc error: code = NotFound desc = could not find container \"512bb538209ab2aa34071ac8012974540b785783a67b549ad7431f8461594231\": container with ID starting with 512bb538209ab2aa34071ac8012974540b785783a67b549ad7431f8461594231 not found: ID does not exist"
Jul 13 21:37:27.048335 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:27.048311    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c6c469-7c47cbdffc-6p96d"]
Jul 13 21:37:27.056593 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:27.053233    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c6c469-7c47cbdffc-6p96d"]
Jul 13 21:37:27.576662 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:27.576627    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7b1bbad-9887-4738-81df-3354074a9366" path="/var/lib/kubelet/pods/e7b1bbad-9887-4738-81df-3354074a9366/volumes"
Jul 13 21:37:30.647155 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:30.647123    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:37:31.078436 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:31.078404    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:37:36.723222 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:36.723178    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:37:36.784835 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:36.784775    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:37:41.752131 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:41.752091    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:37:41.963089 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:41.963052    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:37:42.299458 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:42.299421    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:37:42.601777 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:42.601691    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb"]
Jul 13 21:37:42.602024 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:42.602011    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7b1bbad-9887-4738-81df-3354074a9366" containerName="maas-api"
Jul 13 21:37:42.602088 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:42.602025    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7b1bbad-9887-4738-81df-3354074a9366" containerName="maas-api"
Jul 13 21:37:42.602088 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:42.602042    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d70d14e-e1d5-463a-87a0-409e36645871" containerName="revoke-keys"
Jul 13 21:37:42.602088 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:42.602048    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d70d14e-e1d5-463a-87a0-409e36645871" containerName="revoke-keys"
Jul 13 21:37:42.602192 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:42.602106    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d70d14e-e1d5-463a-87a0-409e36645871" containerName="revoke-keys"
Jul 13 21:37:42.602192 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:42.602114    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7b1bbad-9887-4738-81df-3354074a9366" containerName="maas-api"
Jul 13 21:37:42.606389 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:42.606372    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb"
Jul 13 21:37:42.609137 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:42.609116    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-0e15bb-openshift-default-dockercfg-xfspq\""
Jul 13 21:37:42.618267 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:42.618247    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb"]
Jul 13 21:37:42.630160 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:42.630134    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:37:42.663698 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:42.663672    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/697f4ec0-8b50-420e-80d6-b29bef945725-istiod-ca-cert\") pod \"e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb\" (UID: \"697f4ec0-8b50-420e-80d6-b29bef945725\") " pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb"
Jul 13 21:37:42.663834 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:42.663752    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/697f4ec0-8b50-420e-80d6-b29bef945725-workload-certs\") pod \"e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb\" (UID: \"697f4ec0-8b50-420e-80d6-b29bef945725\") " pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb"
Jul 13 21:37:42.663834 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:42.663798    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/697f4ec0-8b50-420e-80d6-b29bef945725-istio-data\") pod \"e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb\" (UID: \"697f4ec0-8b50-420e-80d6-b29bef945725\") " pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb"
Jul 13 21:37:42.663951 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:42.663838    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/697f4ec0-8b50-420e-80d6-b29bef945725-istio-podinfo\") pod \"e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb\" (UID: \"697f4ec0-8b50-420e-80d6-b29bef945725\") " pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb"
Jul 13 21:37:42.663951 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:42.663899    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/697f4ec0-8b50-420e-80d6-b29bef945725-istio-envoy\") pod \"e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb\" (UID: \"697f4ec0-8b50-420e-80d6-b29bef945725\") " pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb"
Jul 13 21:37:42.664035 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:42.663994    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/697f4ec0-8b50-420e-80d6-b29bef945725-istio-token\") pod \"e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb\" (UID: \"697f4ec0-8b50-420e-80d6-b29bef945725\") " pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb"
Jul 13 21:37:42.664035 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:42.664026    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/697f4ec0-8b50-420e-80d6-b29bef945725-credential-socket\") pod \"e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb\" (UID: \"697f4ec0-8b50-420e-80d6-b29bef945725\") " pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb"
Jul 13 21:37:42.664123 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:42.664052    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j57mc\" (UniqueName: \"kubernetes.io/projected/697f4ec0-8b50-420e-80d6-b29bef945725-kube-api-access-j57mc\") pod \"e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb\" (UID: \"697f4ec0-8b50-420e-80d6-b29bef945725\") " pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb"
Jul 13 21:37:42.664170 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:42.664126    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/697f4ec0-8b50-420e-80d6-b29bef945725-workload-socket\") pod \"e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb\" (UID: \"697f4ec0-8b50-420e-80d6-b29bef945725\") " pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb"
Jul 13 21:37:42.764853 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:42.764807    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/697f4ec0-8b50-420e-80d6-b29bef945725-workload-certs\") pod \"e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb\" (UID: \"697f4ec0-8b50-420e-80d6-b29bef945725\") " pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb"
Jul 13 21:37:42.764853 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:42.764859    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/697f4ec0-8b50-420e-80d6-b29bef945725-istio-data\") pod \"e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb\" (UID: \"697f4ec0-8b50-420e-80d6-b29bef945725\") " pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb"
Jul 13 21:37:42.765411 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:42.764881    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/697f4ec0-8b50-420e-80d6-b29bef945725-istio-podinfo\") pod \"e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb\" (UID: \"697f4ec0-8b50-420e-80d6-b29bef945725\") " pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb"
Jul 13 21:37:42.765411 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:42.764910    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/697f4ec0-8b50-420e-80d6-b29bef945725-istio-envoy\") pod \"e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb\" (UID: \"697f4ec0-8b50-420e-80d6-b29bef945725\") " pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb"
Jul 13 21:37:42.765411 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:42.764955    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/697f4ec0-8b50-420e-80d6-b29bef945725-istio-token\") pod \"e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb\" (UID: \"697f4ec0-8b50-420e-80d6-b29bef945725\") " pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb"
Jul 13 21:37:42.765411 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:42.764996    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/697f4ec0-8b50-420e-80d6-b29bef945725-credential-socket\") pod \"e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb\" (UID: \"697f4ec0-8b50-420e-80d6-b29bef945725\") " pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb"
Jul 13 21:37:42.765411 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:42.765018    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j57mc\" (UniqueName: \"kubernetes.io/projected/697f4ec0-8b50-420e-80d6-b29bef945725-kube-api-access-j57mc\") pod \"e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb\" (UID: \"697f4ec0-8b50-420e-80d6-b29bef945725\") " pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb"
Jul 13 21:37:42.765411 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:42.765272    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/697f4ec0-8b50-420e-80d6-b29bef945725-workload-certs\") pod \"e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb\" (UID: \"697f4ec0-8b50-420e-80d6-b29bef945725\") " pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb"
Jul 13 21:37:42.765411 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:42.765345    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/697f4ec0-8b50-420e-80d6-b29bef945725-workload-socket\") pod \"e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb\" (UID: \"697f4ec0-8b50-420e-80d6-b29bef945725\") " pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb"
Jul 13 21:37:42.765788 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:42.765525    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/697f4ec0-8b50-420e-80d6-b29bef945725-credential-socket\") pod \"e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb\" (UID: \"697f4ec0-8b50-420e-80d6-b29bef945725\") " pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb"
Jul 13 21:37:42.765788 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:42.765625    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/697f4ec0-8b50-420e-80d6-b29bef945725-istiod-ca-cert\") pod \"e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb\" (UID: \"697f4ec0-8b50-420e-80d6-b29bef945725\") " pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb"
Jul 13 21:37:42.765788 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:42.765656    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/697f4ec0-8b50-420e-80d6-b29bef945725-workload-socket\") pod \"e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb\" (UID: \"697f4ec0-8b50-420e-80d6-b29bef945725\") " pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb"
Jul 13 21:37:42.766042 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:42.766021    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/697f4ec0-8b50-420e-80d6-b29bef945725-istio-data\") pod \"e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb\" (UID: \"697f4ec0-8b50-420e-80d6-b29bef945725\") " pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb"
Jul 13 21:37:42.766319 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:42.766296    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/697f4ec0-8b50-420e-80d6-b29bef945725-istiod-ca-cert\") pod \"e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb\" (UID: \"697f4ec0-8b50-420e-80d6-b29bef945725\") " pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb"
Jul 13 21:37:42.767548 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:42.767528    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/697f4ec0-8b50-420e-80d6-b29bef945725-istio-envoy\") pod \"e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb\" (UID: \"697f4ec0-8b50-420e-80d6-b29bef945725\") " pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb"
Jul 13 21:37:42.767657 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:42.767638    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/697f4ec0-8b50-420e-80d6-b29bef945725-istio-podinfo\") pod \"e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb\" (UID: \"697f4ec0-8b50-420e-80d6-b29bef945725\") " pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb"
Jul 13 21:37:42.772713 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:42.772685    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j57mc\" (UniqueName: \"kubernetes.io/projected/697f4ec0-8b50-420e-80d6-b29bef945725-kube-api-access-j57mc\") pod \"e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb\" (UID: \"697f4ec0-8b50-420e-80d6-b29bef945725\") " pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb"
Jul 13 21:37:42.772793 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:42.772715    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/697f4ec0-8b50-420e-80d6-b29bef945725-istio-token\") pod \"e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb\" (UID: \"697f4ec0-8b50-420e-80d6-b29bef945725\") " pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb"
Jul 13 21:37:42.917286 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:42.917216    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb"
Jul 13 21:37:43.045148 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:43.045115    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:37:43.054226 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:43.054205    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb"]
Jul 13 21:37:43.055970 ip-10-0-137-162 kubenswrapper[2561]: W0713 21:37:43.055946    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod697f4ec0_8b50_420e_80d6_b29bef945725.slice/crio-55e4a173cac91920e15c32e117e8e256b24f21d0b89cacdc8e22843149fd9a24 WatchSource:0}: Error finding container 55e4a173cac91920e15c32e117e8e256b24f21d0b89cacdc8e22843149fd9a24: Status 404 returned error can't find the container with id 55e4a173cac91920e15c32e117e8e256b24f21d0b89cacdc8e22843149fd9a24
Jul 13 21:37:43.057952 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:43.057918    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 21:37:43.058041 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:43.057983    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 21:37:43.058041 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:43.058014    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 21:37:43.104384 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:43.104359    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb" event={"ID":"697f4ec0-8b50-420e-80d6-b29bef945725","Type":"ContainerStarted","Data":"55e4a173cac91920e15c32e117e8e256b24f21d0b89cacdc8e22843149fd9a24"}
Jul 13 21:37:44.110257 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:44.110225    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb" event={"ID":"697f4ec0-8b50-420e-80d6-b29bef945725","Type":"ContainerStarted","Data":"327fd1f8e47c31f8a8a2a91522777ccf7c1991bd484b73a13fed25b22c4ee58a"}
Jul 13 21:37:44.132012 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:44.131967    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb" podStartSLOduration=2.131951536 podStartE2EDuration="2.131951536s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:37:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:37:44.129612073 +0000 UTC m=+2637.124395522" watchObservedRunningTime="2026-07-13 21:37:44.131951536 +0000 UTC m=+2637.126734959"
Jul 13 21:37:44.917479 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:44.917449    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb"
Jul 13 21:37:44.922587 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:44.922557    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb"
Jul 13 21:37:45.114715 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:45.114686    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb"
Jul 13 21:37:45.115732 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:45.115714    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb"
Jul 13 21:37:46.127544 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:46.127509    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:37:46.229669 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:46.229637    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:37:46.237998 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:46.237974    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0e15bb-6cbc496bc5-g64qb"]
Jul 13 21:37:46.241338 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:46.241316    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0e15bb-6cbc496bc5-g64qb"
Jul 13 21:37:46.245156 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:46.245089    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 13 21:37:46.245156 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:46.245096    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 21:37:46.245156 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:46.245107    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-0e15bb-serving-cert\""
Jul 13 21:37:46.246170 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:46.246152    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-j4tgz\""
Jul 13 21:37:46.253940 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:46.253921    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0e15bb-6cbc496bc5-g64qb"]
Jul 13 21:37:46.294866 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:46.294842    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d9989b5-99a7-40c0-8e88-ebda1fc6a67e-maas-api-tls\") pod \"maas-api-e2e-shared-a-0e15bb-6cbc496bc5-g64qb\" (UID: \"6d9989b5-99a7-40c0-8e88-ebda1fc6a67e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0e15bb-6cbc496bc5-g64qb"
Jul 13 21:37:46.294959 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:46.294889    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nljtc\" (UniqueName: \"kubernetes.io/projected/6d9989b5-99a7-40c0-8e88-ebda1fc6a67e-kube-api-access-nljtc\") pod \"maas-api-e2e-shared-a-0e15bb-6cbc496bc5-g64qb\" (UID: \"6d9989b5-99a7-40c0-8e88-ebda1fc6a67e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0e15bb-6cbc496bc5-g64qb"
Jul 13 21:37:46.295004 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:46.294982    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d9989b5-99a7-40c0-8e88-ebda1fc6a67e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-0e15bb-6cbc496bc5-g64qb\" (UID: \"6d9989b5-99a7-40c0-8e88-ebda1fc6a67e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0e15bb-6cbc496bc5-g64qb"
Jul 13 21:37:46.327018 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:46.326995    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:37:46.396453 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:46.396374    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d9989b5-99a7-40c0-8e88-ebda1fc6a67e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-0e15bb-6cbc496bc5-g64qb\" (UID: \"6d9989b5-99a7-40c0-8e88-ebda1fc6a67e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0e15bb-6cbc496bc5-g64qb"
Jul 13 21:37:46.396599 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:46.396452    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d9989b5-99a7-40c0-8e88-ebda1fc6a67e-maas-api-tls\") pod \"maas-api-e2e-shared-a-0e15bb-6cbc496bc5-g64qb\" (UID: \"6d9989b5-99a7-40c0-8e88-ebda1fc6a67e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0e15bb-6cbc496bc5-g64qb"
Jul 13 21:37:46.396599 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:46.396486    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nljtc\" (UniqueName: \"kubernetes.io/projected/6d9989b5-99a7-40c0-8e88-ebda1fc6a67e-kube-api-access-nljtc\") pod \"maas-api-e2e-shared-a-0e15bb-6cbc496bc5-g64qb\" (UID: \"6d9989b5-99a7-40c0-8e88-ebda1fc6a67e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0e15bb-6cbc496bc5-g64qb"
Jul 13 21:37:46.396712 ip-10-0-137-162 kubenswrapper[2561]: E0713 21:37:46.396593    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-0e15bb-serving-cert: secret "maas-api-e2e-shared-a-0e15bb-serving-cert" not found
Jul 13 21:37:46.396712 ip-10-0-137-162 kubenswrapper[2561]: E0713 21:37:46.396659    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d9989b5-99a7-40c0-8e88-ebda1fc6a67e-maas-api-tls podName:6d9989b5-99a7-40c0-8e88-ebda1fc6a67e nodeName:}" failed. No retries permitted until 2026-07-13 21:37:46.896644341 +0000 UTC m=+2639.891427742 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6d9989b5-99a7-40c0-8e88-ebda1fc6a67e-maas-api-tls") pod "maas-api-e2e-shared-a-0e15bb-6cbc496bc5-g64qb" (UID: "6d9989b5-99a7-40c0-8e88-ebda1fc6a67e") : secret "maas-api-e2e-shared-a-0e15bb-serving-cert" not found
Jul 13 21:37:46.397043 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:46.397025    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d9989b5-99a7-40c0-8e88-ebda1fc6a67e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-0e15bb-6cbc496bc5-g64qb\" (UID: \"6d9989b5-99a7-40c0-8e88-ebda1fc6a67e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0e15bb-6cbc496bc5-g64qb"
Jul 13 21:37:46.409324 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:46.409299    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nljtc\" (UniqueName: \"kubernetes.io/projected/6d9989b5-99a7-40c0-8e88-ebda1fc6a67e-kube-api-access-nljtc\") pod \"maas-api-e2e-shared-a-0e15bb-6cbc496bc5-g64qb\" (UID: \"6d9989b5-99a7-40c0-8e88-ebda1fc6a67e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0e15bb-6cbc496bc5-g64qb"
Jul 13 21:37:46.776131 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:46.776085    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:37:46.878179 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:46.878144    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:37:46.901576 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:46.901553    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d9989b5-99a7-40c0-8e88-ebda1fc6a67e-maas-api-tls\") pod \"maas-api-e2e-shared-a-0e15bb-6cbc496bc5-g64qb\" (UID: \"6d9989b5-99a7-40c0-8e88-ebda1fc6a67e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0e15bb-6cbc496bc5-g64qb"
Jul 13 21:37:46.904028 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:46.904009    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d9989b5-99a7-40c0-8e88-ebda1fc6a67e-maas-api-tls\") pod \"maas-api-e2e-shared-a-0e15bb-6cbc496bc5-g64qb\" (UID: \"6d9989b5-99a7-40c0-8e88-ebda1fc6a67e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0e15bb-6cbc496bc5-g64qb"
Jul 13 21:37:46.976776 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:46.976742    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:37:47.153187 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:47.153110    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0e15bb-6cbc496bc5-g64qb"
Jul 13 21:37:47.322677 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:47.322645    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0e15bb-6cbc496bc5-g64qb"]
Jul 13 21:37:47.325572 ip-10-0-137-162 kubenswrapper[2561]: W0713 21:37:47.325543    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d9989b5_99a7_40c0_8e88_ebda1fc6a67e.slice/crio-ef97ead0b886e08d435694027b41d1849f15cf225f56f097e3c26422afd515fa WatchSource:0}: Error finding container ef97ead0b886e08d435694027b41d1849f15cf225f56f097e3c26422afd515fa: Status 404 returned error can't find the container with id ef97ead0b886e08d435694027b41d1849f15cf225f56f097e3c26422afd515fa
Jul 13 21:37:48.129478 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:48.129442    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0e15bb-6cbc496bc5-g64qb" event={"ID":"6d9989b5-99a7-40c0-8e88-ebda1fc6a67e","Type":"ContainerStarted","Data":"d9e33b9466fb76edbc0086becb645ea15892bfd9533bd12f429f33d8d2c563b5"}
Jul 13 21:37:48.129672 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:48.129496    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0e15bb-6cbc496bc5-g64qb" event={"ID":"6d9989b5-99a7-40c0-8e88-ebda1fc6a67e","Type":"ContainerStarted","Data":"ef97ead0b886e08d435694027b41d1849f15cf225f56f097e3c26422afd515fa"}
Jul 13 21:37:48.129672 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:48.129589    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0e15bb-6cbc496bc5-g64qb"
Jul 13 21:37:48.148877 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:48.148834    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0e15bb-6cbc496bc5-g64qb" podStartSLOduration=1.7769556720000002 podStartE2EDuration="2.148793706s" totalImagesPullingTime="371.838034ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:37:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:37:48.14791044 +0000 UTC m=+2641.142693864" watchObservedRunningTime="2026-07-13 21:37:48.148793706 +0000 UTC m=+2641.143577165"
Jul 13 21:37:50.533120 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:50.533088    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:37:50.865728 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:50.865630    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:37:51.189374 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:51.189292    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:37:51.326101 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:51.326061    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:37:53.752219 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:53.752187    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:37:53.850692 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:53.850659    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:37:53.892086 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:53.892057    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-18e186-78f8f956cb-lfxw5"]
Jul 13 21:37:53.895587 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:53.895566    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-18e186-78f8f956cb-lfxw5"
Jul 13 21:37:53.898015 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:53.897997    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-18e186-serving-cert\""
Jul 13 21:37:53.907263 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:53.907242    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-18e186-78f8f956cb-lfxw5"]
Jul 13 21:37:53.952721 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:53.952697    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:37:53.972832 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:53.959933    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80f98c3d-0722-4100-87e4-916fd157413a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-18e186-78f8f956cb-lfxw5\" (UID: \"80f98c3d-0722-4100-87e4-916fd157413a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-18e186-78f8f956cb-lfxw5"
Jul 13 21:37:53.972832 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:53.959995    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkgwt\" (UniqueName: \"kubernetes.io/projected/80f98c3d-0722-4100-87e4-916fd157413a-kube-api-access-wkgwt\") pod \"maas-api-e2e-shared-b-18e186-78f8f956cb-lfxw5\" (UID: \"80f98c3d-0722-4100-87e4-916fd157413a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-18e186-78f8f956cb-lfxw5"
Jul 13 21:37:53.972832 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:53.960026    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80f98c3d-0722-4100-87e4-916fd157413a-maas-api-tls\") pod \"maas-api-e2e-shared-b-18e186-78f8f956cb-lfxw5\" (UID: \"80f98c3d-0722-4100-87e4-916fd157413a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-18e186-78f8f956cb-lfxw5"
Jul 13 21:37:54.060892 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:54.060862    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80f98c3d-0722-4100-87e4-916fd157413a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-18e186-78f8f956cb-lfxw5\" (UID: \"80f98c3d-0722-4100-87e4-916fd157413a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-18e186-78f8f956cb-lfxw5"
Jul 13 21:37:54.061898 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:54.061877    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkgwt\" (UniqueName: \"kubernetes.io/projected/80f98c3d-0722-4100-87e4-916fd157413a-kube-api-access-wkgwt\") pod \"maas-api-e2e-shared-b-18e186-78f8f956cb-lfxw5\" (UID: \"80f98c3d-0722-4100-87e4-916fd157413a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-18e186-78f8f956cb-lfxw5"
Jul 13 21:37:54.062401 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:54.062382    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80f98c3d-0722-4100-87e4-916fd157413a-maas-api-tls\") pod \"maas-api-e2e-shared-b-18e186-78f8f956cb-lfxw5\" (UID: \"80f98c3d-0722-4100-87e4-916fd157413a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-18e186-78f8f956cb-lfxw5"
Jul 13 21:37:54.062732 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:54.061782    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80f98c3d-0722-4100-87e4-916fd157413a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-18e186-78f8f956cb-lfxw5\" (UID: \"80f98c3d-0722-4100-87e4-916fd157413a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-18e186-78f8f956cb-lfxw5"
Jul 13 21:37:54.062923 ip-10-0-137-162 kubenswrapper[2561]: E0713 21:37:54.062584    2561 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-18e186-serving-cert: secret "maas-api-e2e-shared-b-18e186-serving-cert" not found
Jul 13 21:37:54.063079 ip-10-0-137-162 kubenswrapper[2561]: E0713 21:37:54.063069    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80f98c3d-0722-4100-87e4-916fd157413a-maas-api-tls podName:80f98c3d-0722-4100-87e4-916fd157413a nodeName:}" failed. No retries permitted until 2026-07-13 21:37:54.563047942 +0000 UTC m=+2647.557831358 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/80f98c3d-0722-4100-87e4-916fd157413a-maas-api-tls") pod "maas-api-e2e-shared-b-18e186-78f8f956cb-lfxw5" (UID: "80f98c3d-0722-4100-87e4-916fd157413a") : secret "maas-api-e2e-shared-b-18e186-serving-cert" not found
Jul 13 21:37:54.071662 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:54.071639    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkgwt\" (UniqueName: \"kubernetes.io/projected/80f98c3d-0722-4100-87e4-916fd157413a-kube-api-access-wkgwt\") pod \"maas-api-e2e-shared-b-18e186-78f8f956cb-lfxw5\" (UID: \"80f98c3d-0722-4100-87e4-916fd157413a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-18e186-78f8f956cb-lfxw5"
Jul 13 21:37:54.140283 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:54.140264    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0e15bb-6cbc496bc5-g64qb"
Jul 13 21:37:54.248729 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:54.248694    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:37:54.506179 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:54.506096    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:37:54.570622 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:54.570588    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80f98c3d-0722-4100-87e4-916fd157413a-maas-api-tls\") pod \"maas-api-e2e-shared-b-18e186-78f8f956cb-lfxw5\" (UID: \"80f98c3d-0722-4100-87e4-916fd157413a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-18e186-78f8f956cb-lfxw5"
Jul 13 21:37:54.573964 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:54.573914    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80f98c3d-0722-4100-87e4-916fd157413a-maas-api-tls\") pod \"maas-api-e2e-shared-b-18e186-78f8f956cb-lfxw5\" (UID: \"80f98c3d-0722-4100-87e4-916fd157413a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-18e186-78f8f956cb-lfxw5"
Jul 13 21:37:54.594996 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:54.594957    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:37:54.809100 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:54.809072    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-18e186-78f8f956cb-lfxw5"
Jul 13 21:37:54.980848 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:54.960259    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-18e186-78f8f956cb-lfxw5"]
Jul 13 21:37:54.986960 ip-10-0-137-162 kubenswrapper[2561]: W0713 21:37:54.986927    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80f98c3d_0722_4100_87e4_916fd157413a.slice/crio-c8711ef5e51a312f115ad13f6ab2c819f262ee4daf164b90d5cde8ce4aec57d9 WatchSource:0}: Error finding container c8711ef5e51a312f115ad13f6ab2c819f262ee4daf164b90d5cde8ce4aec57d9: Status 404 returned error can't find the container with id c8711ef5e51a312f115ad13f6ab2c819f262ee4daf164b90d5cde8ce4aec57d9
Jul 13 21:37:55.174828 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:55.174710    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-18e186-78f8f956cb-lfxw5" event={"ID":"80f98c3d-0722-4100-87e4-916fd157413a","Type":"ContainerStarted","Data":"c8711ef5e51a312f115ad13f6ab2c819f262ee4daf164b90d5cde8ce4aec57d9"}
Jul 13 21:37:56.184359 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:56.184296    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-18e186-78f8f956cb-lfxw5" event={"ID":"80f98c3d-0722-4100-87e4-916fd157413a","Type":"ContainerStarted","Data":"3de16ac6cc60b88cf06099a4f20a608b352f315836c3e0a17e512a1c4abc3511"}
Jul 13 21:37:56.205946 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:56.205895    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-18e186-78f8f956cb-lfxw5" podStartSLOduration=2.751456419 podStartE2EDuration="3.205881216s" totalImagesPullingTime="454.424797ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:37:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:37:56.203598667 +0000 UTC m=+2649.198382103" watchObservedRunningTime="2026-07-13 21:37:56.205881216 +0000 UTC m=+2649.200664638"
Jul 13 21:37:57.188981 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:57.188938    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-18e186-78f8f956cb-lfxw5"
Jul 13 21:37:58.221003 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:58.220960    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:37:59.198439 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:59.198341    2561 generic.go:356] "Generic (PLEG): container finished" podID="697f4ec0-8b50-420e-80d6-b29bef945725" containerID="327fd1f8e47c31f8a8a2a91522777ccf7c1991bd484b73a13fed25b22c4ee58a" exitCode=0
Jul 13 21:37:59.198439 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:59.198422    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb" event={"ID":"697f4ec0-8b50-420e-80d6-b29bef945725","Type":"ContainerDied","Data":"327fd1f8e47c31f8a8a2a91522777ccf7c1991bd484b73a13fed25b22c4ee58a"}
Jul 13 21:37:59.198808 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:59.198795    2561 scope.go:117] "RemoveContainer" containerID="327fd1f8e47c31f8a8a2a91522777ccf7c1991bd484b73a13fed25b22c4ee58a"
Jul 13 21:37:59.199797 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:59.199770    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 21:37:59.199874 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:59.199857    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 21:37:59.199919 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:59.199892    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 21:37:59.854115 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:59.854080    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:37:59.909917 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:37:59.909893    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:38:00.115120 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:38:00.115041    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb"
Jul 13 21:38:00.205144 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:38:00.205111    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb" event={"ID":"697f4ec0-8b50-420e-80d6-b29bef945725","Type":"ContainerStarted","Data":"afaa0860af6ee0eaaaf287dec3d1726b85f400d708c6292bebf6b25ec2a5cd2e"}
Jul 13 21:38:00.917823 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:38:00.917781    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb"
Jul 13 21:38:00.919000 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:38:00.918972    2561 patch_prober.go:28] interesting pod/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 13 21:38:00.919130 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:38:00.919020    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb" podUID="697f4ec0-8b50-420e-80d6-b29bef945725" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 13 21:38:01.918563 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:38:01.918526    2561 patch_prober.go:28] interesting pod/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 13 21:38:01.918992 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:38:01.918580    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb" podUID="697f4ec0-8b50-420e-80d6-b29bef945725" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 13 21:38:02.918000 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:38:02.917964    2561 patch_prober.go:28] interesting pod/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 13 21:38:02.918173 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:38:02.918015    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb" podUID="697f4ec0-8b50-420e-80d6-b29bef945725" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 13 21:38:03.198179 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:38:03.198091    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-18e186-78f8f956cb-lfxw5"
Jul 13 21:38:03.917895 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:38:03.917857    2561 patch_prober.go:28] interesting pod/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 13 21:38:03.918089 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:38:03.917914    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb" podUID="697f4ec0-8b50-420e-80d6-b29bef945725" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 13 21:38:04.921929 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:38:04.921899    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb"
Jul 13 21:38:04.922310 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:38:04.922255    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb"
Jul 13 21:38:04.922858 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:38:04.922842    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb"
Jul 13 21:38:08.082400 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:38:08.082363    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:38:08.748974 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:38:08.748932    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:38:08.850955 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:38:08.850920    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:38:15.264698 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:38:15.264648    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:38:15.370350 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:38:15.370319    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:38:47.859437 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:38:47.859408    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jrpbd_e730eed8-ff8a-4a54-b1cb-539d8f07e70b/ovn-acl-logging/0.log"
Jul 13 21:38:47.864796 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:38:47.864777    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jrpbd_e730eed8-ff8a-4a54-b1cb-539d8f07e70b/ovn-acl-logging/0.log"
Jul 13 21:39:06.574606 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:39:06.574569    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:39:19.955778 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:39:19.955746    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:39:20.012270 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:39:20.012236    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:40:27.307108 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:40:27.307068    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:40:27.362989 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:40:27.362963    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:41:12.776451 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:41:12.776418    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:41:13.844785 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:41:13.844736    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:41:24.864786 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:41:24.864751    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:41:46.976757 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:41:46.976722    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:41:49.164129 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:41:49.164096    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:41:49.264024 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:41:49.263992    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:42:24.649465 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:42:24.649435    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:42:25.476073 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:42:25.476037    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:42:33.873105 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:42:33.873057    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:42:55.057783 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:42:55.057752    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:43:09.589568 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:43:09.589496    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:43:09.691998 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:43:09.691965    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:43:16.279680 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:43:16.279647    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:43:16.380319 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:43:16.380289    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:43:41.580727 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:43:41.580698    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:43:42.448106 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:43:42.448070    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:43:47.884798 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:43:47.884772    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jrpbd_e730eed8-ff8a-4a54-b1cb-539d8f07e70b/ovn-acl-logging/0.log"
Jul 13 21:43:47.891355 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:43:47.891337    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jrpbd_e730eed8-ff8a-4a54-b1cb-539d8f07e70b/ovn-acl-logging/0.log"
Jul 13 21:44:02.082705 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:02.082667    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:44:02.182674 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:02.182644    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:44:12.034972 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:12.034940    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0e15bb-6cbc496bc5-g64qb"]
Jul 13 21:44:12.035483 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:12.035152    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0e15bb-6cbc496bc5-g64qb" podUID="6d9989b5-99a7-40c0-8e88-ebda1fc6a67e" containerName="maas-api" containerID="cri-o://d9e33b9466fb76edbc0086becb645ea15892bfd9533bd12f429f33d8d2c563b5" gracePeriod=30
Jul 13 21:44:12.072756 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:12.072720    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:44:12.472612 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:12.472589    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0e15bb-6cbc496bc5-g64qb"
Jul 13 21:44:12.512329 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:12.512306    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nljtc\" (UniqueName: \"kubernetes.io/projected/6d9989b5-99a7-40c0-8e88-ebda1fc6a67e-kube-api-access-nljtc\") pod \"6d9989b5-99a7-40c0-8e88-ebda1fc6a67e\" (UID: \"6d9989b5-99a7-40c0-8e88-ebda1fc6a67e\") "
Jul 13 21:44:12.512446 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:12.512378    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d9989b5-99a7-40c0-8e88-ebda1fc6a67e-openshift-service-ca\") pod \"6d9989b5-99a7-40c0-8e88-ebda1fc6a67e\" (UID: \"6d9989b5-99a7-40c0-8e88-ebda1fc6a67e\") "
Jul 13 21:44:12.512446 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:12.512406    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d9989b5-99a7-40c0-8e88-ebda1fc6a67e-maas-api-tls\") pod \"6d9989b5-99a7-40c0-8e88-ebda1fc6a67e\" (UID: \"6d9989b5-99a7-40c0-8e88-ebda1fc6a67e\") "
Jul 13 21:44:12.512712 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:12.512688    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d9989b5-99a7-40c0-8e88-ebda1fc6a67e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6d9989b5-99a7-40c0-8e88-ebda1fc6a67e" (UID: "6d9989b5-99a7-40c0-8e88-ebda1fc6a67e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:44:12.514512 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:12.514480    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d9989b5-99a7-40c0-8e88-ebda1fc6a67e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6d9989b5-99a7-40c0-8e88-ebda1fc6a67e" (UID: "6d9989b5-99a7-40c0-8e88-ebda1fc6a67e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:44:12.514512 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:12.514498    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d9989b5-99a7-40c0-8e88-ebda1fc6a67e-kube-api-access-nljtc" (OuterVolumeSpecName: "kube-api-access-nljtc") pod "6d9989b5-99a7-40c0-8e88-ebda1fc6a67e" (UID: "6d9989b5-99a7-40c0-8e88-ebda1fc6a67e"). InnerVolumeSpecName "kube-api-access-nljtc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:44:12.613534 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:12.613471    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d9989b5-99a7-40c0-8e88-ebda1fc6a67e-openshift-service-ca\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:44:12.613534 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:12.613493    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d9989b5-99a7-40c0-8e88-ebda1fc6a67e-maas-api-tls\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:44:12.613534 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:12.613503    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nljtc\" (UniqueName: \"kubernetes.io/projected/6d9989b5-99a7-40c0-8e88-ebda1fc6a67e-kube-api-access-nljtc\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:44:12.879478 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:12.879402    2561 generic.go:356] "Generic (PLEG): container finished" podID="6d9989b5-99a7-40c0-8e88-ebda1fc6a67e" containerID="d9e33b9466fb76edbc0086becb645ea15892bfd9533bd12f429f33d8d2c563b5" exitCode=0
Jul 13 21:44:12.879478 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:12.879451    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0e15bb-6cbc496bc5-g64qb"
Jul 13 21:44:12.879715 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:12.879488    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0e15bb-6cbc496bc5-g64qb" event={"ID":"6d9989b5-99a7-40c0-8e88-ebda1fc6a67e","Type":"ContainerDied","Data":"d9e33b9466fb76edbc0086becb645ea15892bfd9533bd12f429f33d8d2c563b5"}
Jul 13 21:44:12.879715 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:12.879536    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0e15bb-6cbc496bc5-g64qb" event={"ID":"6d9989b5-99a7-40c0-8e88-ebda1fc6a67e","Type":"ContainerDied","Data":"ef97ead0b886e08d435694027b41d1849f15cf225f56f097e3c26422afd515fa"}
Jul 13 21:44:12.879715 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:12.879557    2561 scope.go:117] "RemoveContainer" containerID="d9e33b9466fb76edbc0086becb645ea15892bfd9533bd12f429f33d8d2c563b5"
Jul 13 21:44:12.888209 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:12.888194    2561 scope.go:117] "RemoveContainer" containerID="d9e33b9466fb76edbc0086becb645ea15892bfd9533bd12f429f33d8d2c563b5"
Jul 13 21:44:12.888446 ip-10-0-137-162 kubenswrapper[2561]: E0713 21:44:12.888429    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9e33b9466fb76edbc0086becb645ea15892bfd9533bd12f429f33d8d2c563b5\": container with ID starting with d9e33b9466fb76edbc0086becb645ea15892bfd9533bd12f429f33d8d2c563b5 not found: ID does not exist" containerID="d9e33b9466fb76edbc0086becb645ea15892bfd9533bd12f429f33d8d2c563b5"
Jul 13 21:44:12.888495 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:12.888454    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9e33b9466fb76edbc0086becb645ea15892bfd9533bd12f429f33d8d2c563b5"} err="failed to get container status \"d9e33b9466fb76edbc0086becb645ea15892bfd9533bd12f429f33d8d2c563b5\": rpc error: code = NotFound desc = could not find container \"d9e33b9466fb76edbc0086becb645ea15892bfd9533bd12f429f33d8d2c563b5\": container with ID starting with d9e33b9466fb76edbc0086becb645ea15892bfd9533bd12f429f33d8d2c563b5 not found: ID does not exist"
Jul 13 21:44:12.901244 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:12.901222    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0e15bb-6cbc496bc5-g64qb"]
Jul 13 21:44:12.906975 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:12.906950    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0e15bb-6cbc496bc5-g64qb"]
Jul 13 21:44:13.575992 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:13.575959    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d9989b5-99a7-40c0-8e88-ebda1fc6a67e" path="/var/lib/kubelet/pods/6d9989b5-99a7-40c0-8e88-ebda1fc6a67e/volumes"
Jul 13 21:44:16.693174 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:16.693130    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:44:22.584745 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:22.584712    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:44:22.650497 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:22.650466    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:44:27.335476 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:27.335437    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb"]
Jul 13 21:44:27.335954 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:27.335703    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb" podUID="697f4ec0-8b50-420e-80d6-b29bef945725" containerName="istio-proxy" containerID="cri-o://afaa0860af6ee0eaaaf287dec3d1726b85f400d708c6292bebf6b25ec2a5cd2e" gracePeriod=30
Jul 13 21:44:27.353020 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:27.352993    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:44:27.616226 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:27.616141    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:44:28.341201 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:28.341156    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:44:28.441067 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:28.441039    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:44:32.587026 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:32.587003    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb"
Jul 13 21:44:32.671085 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:32.671025    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/697f4ec0-8b50-420e-80d6-b29bef945725-istiod-ca-cert\") pod \"697f4ec0-8b50-420e-80d6-b29bef945725\" (UID: \"697f4ec0-8b50-420e-80d6-b29bef945725\") "
Jul 13 21:44:32.671085 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:32.671057    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/697f4ec0-8b50-420e-80d6-b29bef945725-credential-socket\") pod \"697f4ec0-8b50-420e-80d6-b29bef945725\" (UID: \"697f4ec0-8b50-420e-80d6-b29bef945725\") "
Jul 13 21:44:32.671255 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:32.671093    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/697f4ec0-8b50-420e-80d6-b29bef945725-workload-socket\") pod \"697f4ec0-8b50-420e-80d6-b29bef945725\" (UID: \"697f4ec0-8b50-420e-80d6-b29bef945725\") "
Jul 13 21:44:32.671255 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:32.671113    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/697f4ec0-8b50-420e-80d6-b29bef945725-istio-envoy\") pod \"697f4ec0-8b50-420e-80d6-b29bef945725\" (UID: \"697f4ec0-8b50-420e-80d6-b29bef945725\") "
Jul 13 21:44:32.671255 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:32.671132    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j57mc\" (UniqueName: \"kubernetes.io/projected/697f4ec0-8b50-420e-80d6-b29bef945725-kube-api-access-j57mc\") pod \"697f4ec0-8b50-420e-80d6-b29bef945725\" (UID: \"697f4ec0-8b50-420e-80d6-b29bef945725\") "
Jul 13 21:44:32.671255 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:32.671149    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/697f4ec0-8b50-420e-80d6-b29bef945725-istio-data\") pod \"697f4ec0-8b50-420e-80d6-b29bef945725\" (UID: \"697f4ec0-8b50-420e-80d6-b29bef945725\") "
Jul 13 21:44:32.671255 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:32.671216    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/697f4ec0-8b50-420e-80d6-b29bef945725-istio-podinfo\") pod \"697f4ec0-8b50-420e-80d6-b29bef945725\" (UID: \"697f4ec0-8b50-420e-80d6-b29bef945725\") "
Jul 13 21:44:32.671255 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:32.671242    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/697f4ec0-8b50-420e-80d6-b29bef945725-workload-certs\") pod \"697f4ec0-8b50-420e-80d6-b29bef945725\" (UID: \"697f4ec0-8b50-420e-80d6-b29bef945725\") "
Jul 13 21:44:32.671570 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:32.671272    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/697f4ec0-8b50-420e-80d6-b29bef945725-istio-token\") pod \"697f4ec0-8b50-420e-80d6-b29bef945725\" (UID: \"697f4ec0-8b50-420e-80d6-b29bef945725\") "
Jul 13 21:44:32.671570 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:32.671314    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/697f4ec0-8b50-420e-80d6-b29bef945725-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "697f4ec0-8b50-420e-80d6-b29bef945725" (UID: "697f4ec0-8b50-420e-80d6-b29bef945725"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:44:32.671570 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:32.671400    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/697f4ec0-8b50-420e-80d6-b29bef945725-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "697f4ec0-8b50-420e-80d6-b29bef945725" (UID: "697f4ec0-8b50-420e-80d6-b29bef945725"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:44:32.671723 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:32.671625    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/697f4ec0-8b50-420e-80d6-b29bef945725-workload-socket\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:44:32.671723 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:32.671651    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/697f4ec0-8b50-420e-80d6-b29bef945725-credential-socket\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:44:32.671856 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:32.671738    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/697f4ec0-8b50-420e-80d6-b29bef945725-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "697f4ec0-8b50-420e-80d6-b29bef945725" (UID: "697f4ec0-8b50-420e-80d6-b29bef945725"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:44:32.671966 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:32.671941    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/697f4ec0-8b50-420e-80d6-b29bef945725-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "697f4ec0-8b50-420e-80d6-b29bef945725" (UID: "697f4ec0-8b50-420e-80d6-b29bef945725"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:44:32.672098 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:32.672073    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/697f4ec0-8b50-420e-80d6-b29bef945725-istio-data" (OuterVolumeSpecName: "istio-data") pod "697f4ec0-8b50-420e-80d6-b29bef945725" (UID: "697f4ec0-8b50-420e-80d6-b29bef945725"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:44:32.673342 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:32.673317    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/697f4ec0-8b50-420e-80d6-b29bef945725-istio-token" (OuterVolumeSpecName: "istio-token") pod "697f4ec0-8b50-420e-80d6-b29bef945725" (UID: "697f4ec0-8b50-420e-80d6-b29bef945725"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:44:32.673438 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:32.673383    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/697f4ec0-8b50-420e-80d6-b29bef945725-kube-api-access-j57mc" (OuterVolumeSpecName: "kube-api-access-j57mc") pod "697f4ec0-8b50-420e-80d6-b29bef945725" (UID: "697f4ec0-8b50-420e-80d6-b29bef945725"). InnerVolumeSpecName "kube-api-access-j57mc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:44:32.673594 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:32.673573    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/697f4ec0-8b50-420e-80d6-b29bef945725-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "697f4ec0-8b50-420e-80d6-b29bef945725" (UID: "697f4ec0-8b50-420e-80d6-b29bef945725"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:44:32.673780 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:32.673759    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/697f4ec0-8b50-420e-80d6-b29bef945725-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "697f4ec0-8b50-420e-80d6-b29bef945725" (UID: "697f4ec0-8b50-420e-80d6-b29bef945725"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 21:44:32.772705 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:32.772686    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/697f4ec0-8b50-420e-80d6-b29bef945725-istio-envoy\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:44:32.772705 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:32.772707    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j57mc\" (UniqueName: \"kubernetes.io/projected/697f4ec0-8b50-420e-80d6-b29bef945725-kube-api-access-j57mc\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:44:32.772855 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:32.772718    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/697f4ec0-8b50-420e-80d6-b29bef945725-istio-data\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:44:32.772855 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:32.772727    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/697f4ec0-8b50-420e-80d6-b29bef945725-istio-podinfo\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:44:32.772855 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:32.772735    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/697f4ec0-8b50-420e-80d6-b29bef945725-workload-certs\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:44:32.772855 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:32.772743    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/697f4ec0-8b50-420e-80d6-b29bef945725-istio-token\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:44:32.772855 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:32.772750    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/697f4ec0-8b50-420e-80d6-b29bef945725-istiod-ca-cert\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:44:32.970207 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:32.970144    2561 generic.go:356] "Generic (PLEG): container finished" podID="697f4ec0-8b50-420e-80d6-b29bef945725" containerID="afaa0860af6ee0eaaaf287dec3d1726b85f400d708c6292bebf6b25ec2a5cd2e" exitCode=0
Jul 13 21:44:32.970207 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:32.970187    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb"
Jul 13 21:44:32.970207 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:32.970202    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb" event={"ID":"697f4ec0-8b50-420e-80d6-b29bef945725","Type":"ContainerDied","Data":"afaa0860af6ee0eaaaf287dec3d1726b85f400d708c6292bebf6b25ec2a5cd2e"}
Jul 13 21:44:32.970361 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:32.970241    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb" event={"ID":"697f4ec0-8b50-420e-80d6-b29bef945725","Type":"ContainerDied","Data":"55e4a173cac91920e15c32e117e8e256b24f21d0b89cacdc8e22843149fd9a24"}
Jul 13 21:44:32.970361 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:32.970262    2561 scope.go:117] "RemoveContainer" containerID="afaa0860af6ee0eaaaf287dec3d1726b85f400d708c6292bebf6b25ec2a5cd2e"
Jul 13 21:44:32.979331 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:32.979315    2561 scope.go:117] "RemoveContainer" containerID="327fd1f8e47c31f8a8a2a91522777ccf7c1991bd484b73a13fed25b22c4ee58a"
Jul 13 21:44:32.986613 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:32.986598    2561 scope.go:117] "RemoveContainer" containerID="afaa0860af6ee0eaaaf287dec3d1726b85f400d708c6292bebf6b25ec2a5cd2e"
Jul 13 21:44:32.986883 ip-10-0-137-162 kubenswrapper[2561]: E0713 21:44:32.986864    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afaa0860af6ee0eaaaf287dec3d1726b85f400d708c6292bebf6b25ec2a5cd2e\": container with ID starting with afaa0860af6ee0eaaaf287dec3d1726b85f400d708c6292bebf6b25ec2a5cd2e not found: ID does not exist" containerID="afaa0860af6ee0eaaaf287dec3d1726b85f400d708c6292bebf6b25ec2a5cd2e"
Jul 13 21:44:32.986933 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:32.986891    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afaa0860af6ee0eaaaf287dec3d1726b85f400d708c6292bebf6b25ec2a5cd2e"} err="failed to get container status \"afaa0860af6ee0eaaaf287dec3d1726b85f400d708c6292bebf6b25ec2a5cd2e\": rpc error: code = NotFound desc = could not find container \"afaa0860af6ee0eaaaf287dec3d1726b85f400d708c6292bebf6b25ec2a5cd2e\": container with ID starting with afaa0860af6ee0eaaaf287dec3d1726b85f400d708c6292bebf6b25ec2a5cd2e not found: ID does not exist"
Jul 13 21:44:32.986933 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:32.986910    2561 scope.go:117] "RemoveContainer" containerID="327fd1f8e47c31f8a8a2a91522777ccf7c1991bd484b73a13fed25b22c4ee58a"
Jul 13 21:44:32.987154 ip-10-0-137-162 kubenswrapper[2561]: E0713 21:44:32.987137    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"327fd1f8e47c31f8a8a2a91522777ccf7c1991bd484b73a13fed25b22c4ee58a\": container with ID starting with 327fd1f8e47c31f8a8a2a91522777ccf7c1991bd484b73a13fed25b22c4ee58a not found: ID does not exist" containerID="327fd1f8e47c31f8a8a2a91522777ccf7c1991bd484b73a13fed25b22c4ee58a"
Jul 13 21:44:32.987188 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:32.987159    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"327fd1f8e47c31f8a8a2a91522777ccf7c1991bd484b73a13fed25b22c4ee58a"} err="failed to get container status \"327fd1f8e47c31f8a8a2a91522777ccf7c1991bd484b73a13fed25b22c4ee58a\": rpc error: code = NotFound desc = could not find container \"327fd1f8e47c31f8a8a2a91522777ccf7c1991bd484b73a13fed25b22c4ee58a\": container with ID starting with 327fd1f8e47c31f8a8a2a91522777ccf7c1991bd484b73a13fed25b22c4ee58a not found: ID does not exist"
Jul 13 21:44:32.992298 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:32.992278    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb"]
Jul 13 21:44:32.996407 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:32.996388    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-0e15bb-openshift-default-6cdb45ff99-pv2hb"]
Jul 13 21:44:33.575793 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:33.575758    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="697f4ec0-8b50-420e-80d6-b29bef945725" path="/var/lib/kubelet/pods/697f4ec0-8b50-420e-80d6-b29bef945725/volumes"
Jul 13 21:44:36.854710 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:36.854674    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:44:38.257049 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:38.257014    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-18e186-78f8f956cb-lfxw5"]
Jul 13 21:44:38.257545 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:38.257255    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-18e186-78f8f956cb-lfxw5" podUID="80f98c3d-0722-4100-87e4-916fd157413a" containerName="maas-api" containerID="cri-o://3de16ac6cc60b88cf06099a4f20a608b352f315836c3e0a17e512a1c4abc3511" gracePeriod=30
Jul 13 21:44:38.284499 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:38.284467    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:44:38.691808 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:38.691787    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-18e186-78f8f956cb-lfxw5"
Jul 13 21:44:38.820080 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:38.820010    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wkgwt\" (UniqueName: \"kubernetes.io/projected/80f98c3d-0722-4100-87e4-916fd157413a-kube-api-access-wkgwt\") pod \"80f98c3d-0722-4100-87e4-916fd157413a\" (UID: \"80f98c3d-0722-4100-87e4-916fd157413a\") "
Jul 13 21:44:38.820080 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:38.820055    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80f98c3d-0722-4100-87e4-916fd157413a-maas-api-tls\") pod \"80f98c3d-0722-4100-87e4-916fd157413a\" (UID: \"80f98c3d-0722-4100-87e4-916fd157413a\") "
Jul 13 21:44:38.820243 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:38.820100    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80f98c3d-0722-4100-87e4-916fd157413a-openshift-service-ca\") pod \"80f98c3d-0722-4100-87e4-916fd157413a\" (UID: \"80f98c3d-0722-4100-87e4-916fd157413a\") "
Jul 13 21:44:38.820498 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:38.820470    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80f98c3d-0722-4100-87e4-916fd157413a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "80f98c3d-0722-4100-87e4-916fd157413a" (UID: "80f98c3d-0722-4100-87e4-916fd157413a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:44:38.822023 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:38.822002    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80f98c3d-0722-4100-87e4-916fd157413a-kube-api-access-wkgwt" (OuterVolumeSpecName: "kube-api-access-wkgwt") pod "80f98c3d-0722-4100-87e4-916fd157413a" (UID: "80f98c3d-0722-4100-87e4-916fd157413a"). InnerVolumeSpecName "kube-api-access-wkgwt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:44:38.822114 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:38.822033    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80f98c3d-0722-4100-87e4-916fd157413a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "80f98c3d-0722-4100-87e4-916fd157413a" (UID: "80f98c3d-0722-4100-87e4-916fd157413a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:44:38.921314 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:38.921267    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80f98c3d-0722-4100-87e4-916fd157413a-maas-api-tls\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:44:38.921314 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:38.921289    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80f98c3d-0722-4100-87e4-916fd157413a-openshift-service-ca\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:44:38.921314 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:38.921299    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wkgwt\" (UniqueName: \"kubernetes.io/projected/80f98c3d-0722-4100-87e4-916fd157413a-kube-api-access-wkgwt\") on node \"ip-10-0-137-162.ec2.internal\" DevicePath \"\""
Jul 13 21:44:38.999754 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:38.999728    2561 generic.go:356] "Generic (PLEG): container finished" podID="80f98c3d-0722-4100-87e4-916fd157413a" containerID="3de16ac6cc60b88cf06099a4f20a608b352f315836c3e0a17e512a1c4abc3511" exitCode=0
Jul 13 21:44:38.999868 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:38.999776    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-18e186-78f8f956cb-lfxw5"
Jul 13 21:44:38.999868 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:38.999825    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-18e186-78f8f956cb-lfxw5" event={"ID":"80f98c3d-0722-4100-87e4-916fd157413a","Type":"ContainerDied","Data":"3de16ac6cc60b88cf06099a4f20a608b352f315836c3e0a17e512a1c4abc3511"}
Jul 13 21:44:38.999963 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:38.999873    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-18e186-78f8f956cb-lfxw5" event={"ID":"80f98c3d-0722-4100-87e4-916fd157413a","Type":"ContainerDied","Data":"c8711ef5e51a312f115ad13f6ab2c819f262ee4daf164b90d5cde8ce4aec57d9"}
Jul 13 21:44:38.999963 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:38.999896    2561 scope.go:117] "RemoveContainer" containerID="3de16ac6cc60b88cf06099a4f20a608b352f315836c3e0a17e512a1c4abc3511"
Jul 13 21:44:39.008154 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:39.008140    2561 scope.go:117] "RemoveContainer" containerID="3de16ac6cc60b88cf06099a4f20a608b352f315836c3e0a17e512a1c4abc3511"
Jul 13 21:44:39.008416 ip-10-0-137-162 kubenswrapper[2561]: E0713 21:44:39.008393    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3de16ac6cc60b88cf06099a4f20a608b352f315836c3e0a17e512a1c4abc3511\": container with ID starting with 3de16ac6cc60b88cf06099a4f20a608b352f315836c3e0a17e512a1c4abc3511 not found: ID does not exist" containerID="3de16ac6cc60b88cf06099a4f20a608b352f315836c3e0a17e512a1c4abc3511"
Jul 13 21:44:39.008506 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:39.008420    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3de16ac6cc60b88cf06099a4f20a608b352f315836c3e0a17e512a1c4abc3511"} err="failed to get container status \"3de16ac6cc60b88cf06099a4f20a608b352f315836c3e0a17e512a1c4abc3511\": rpc error: code = NotFound desc = could not find container \"3de16ac6cc60b88cf06099a4f20a608b352f315836c3e0a17e512a1c4abc3511\": container with ID starting with 3de16ac6cc60b88cf06099a4f20a608b352f315836c3e0a17e512a1c4abc3511 not found: ID does not exist"
Jul 13 21:44:39.020101 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:39.020082    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-18e186-78f8f956cb-lfxw5"]
Jul 13 21:44:39.023746 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:39.023722    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-18e186-78f8f956cb-lfxw5"]
Jul 13 21:44:39.576486 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:39.576452    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80f98c3d-0722-4100-87e4-916fd157413a" path="/var/lib/kubelet/pods/80f98c3d-0722-4100-87e4-916fd157413a/volumes"
Jul 13 21:44:42.818169 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:42.818135    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:44:48.700597 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:48.700567    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:44:48.764245 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:48.764207    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:44:53.477451 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:53.477419    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:44:53.711833 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:53.711777    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:44:59.945475 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:59.945440    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fdc557c48-vjq6w_c051e6d4-4446-4d42-ab4c-fc87fea77233/manager/0.log"
Jul 13 21:44:59.951493 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:44:59.951473    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fdc557c48-vjq6w_c051e6d4-4446-4d42-ab4c-fc87fea77233/copy-manifests/0.log"
Jul 13 21:45:00.137609 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:00.137576    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29732985-t6sgn"]
Jul 13 21:45:00.137882 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:00.137870    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d9989b5-99a7-40c0-8e88-ebda1fc6a67e" containerName="maas-api"
Jul 13 21:45:00.137931 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:00.137885    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d9989b5-99a7-40c0-8e88-ebda1fc6a67e" containerName="maas-api"
Jul 13 21:45:00.137931 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:00.137895    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="697f4ec0-8b50-420e-80d6-b29bef945725" containerName="istio-proxy"
Jul 13 21:45:00.137931 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:00.137901    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="697f4ec0-8b50-420e-80d6-b29bef945725" containerName="istio-proxy"
Jul 13 21:45:00.137931 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:00.137908    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80f98c3d-0722-4100-87e4-916fd157413a" containerName="maas-api"
Jul 13 21:45:00.137931 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:00.137914    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="80f98c3d-0722-4100-87e4-916fd157413a" containerName="maas-api"
Jul 13 21:45:00.137931 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:00.137921    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="697f4ec0-8b50-420e-80d6-b29bef945725" containerName="istio-proxy"
Jul 13 21:45:00.137931 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:00.137928    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="697f4ec0-8b50-420e-80d6-b29bef945725" containerName="istio-proxy"
Jul 13 21:45:00.138152 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:00.137983    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="80f98c3d-0722-4100-87e4-916fd157413a" containerName="maas-api"
Jul 13 21:45:00.138152 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:00.137992    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d9989b5-99a7-40c0-8e88-ebda1fc6a67e" containerName="maas-api"
Jul 13 21:45:00.138152 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:00.137998    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="697f4ec0-8b50-420e-80d6-b29bef945725" containerName="istio-proxy"
Jul 13 21:45:00.138152 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:00.138004    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="697f4ec0-8b50-420e-80d6-b29bef945725" containerName="istio-proxy"
Jul 13 21:45:00.140746 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:00.140730    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732985-t6sgn"
Jul 13 21:45:00.143481 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:00.143460    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rnndk\""
Jul 13 21:45:00.148342 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:00.148319    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29732985-t6sgn"]
Jul 13 21:45:00.151520 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:00.151503    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732985-t6sgn"
Jul 13 21:45:00.278897 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:00.278871    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29732985-t6sgn"]
Jul 13 21:45:00.281144 ip-10-0-137-162 kubenswrapper[2561]: W0713 21:45:00.281119    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dbd2547_8859_4426_ab9f_7fcb3e266a8f.slice/crio-0d4f8b2919079193f674121bddbea825be253c93046573900276b25c4b1def05 WatchSource:0}: Error finding container 0d4f8b2919079193f674121bddbea825be253c93046573900276b25c4b1def05: Status 404 returned error can't find the container with id 0d4f8b2919079193f674121bddbea825be253c93046573900276b25c4b1def05
Jul 13 21:45:00.665237 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:00.665215    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29732970-h2d2t_a2c0e244-b6c7-4f82-a816-844f9883954e/cleanup/0.log"
Jul 13 21:45:01.099887 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:01.099858    2561 generic.go:356] "Generic (PLEG): container finished" podID="3dbd2547-8859-4426-ab9f-7fcb3e266a8f" containerID="d2e194d1aa16a2b01e4e278bd7e6896f7e1b465a51ab80ce46866684734a7f19" exitCode=0
Jul 13 21:45:01.100216 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:01.099911    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732985-t6sgn" event={"ID":"3dbd2547-8859-4426-ab9f-7fcb3e266a8f","Type":"ContainerDied","Data":"d2e194d1aa16a2b01e4e278bd7e6896f7e1b465a51ab80ce46866684734a7f19"}
Jul 13 21:45:01.100216 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:01.099960    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732985-t6sgn" event={"ID":"3dbd2547-8859-4426-ab9f-7fcb3e266a8f","Type":"ContainerStarted","Data":"0d4f8b2919079193f674121bddbea825be253c93046573900276b25c4b1def05"}
Jul 13 21:45:01.116822 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:01.116791    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-a-eb35a4-ffp6b_23778213-200f-42f4-8139-58958d2e2ac9/revoke-keys/0.log"
Jul 13 21:45:01.222140 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:01.222118    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-b-c6c469-4j29q_7d70d14e-e1d5-463a-87a0-409e36645871/revoke-keys/0.log"
Jul 13 21:45:01.335059 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:01.334988    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-derive-f555b378-7sfhv_422d7179-e252-4e2e-9882-582b1da9e4b3/revoke-keys/0.log"
Jul 13 21:45:01.668907 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:01.668831    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-migrate-a6867856-mklfd_eb011b4f-b7ff-4ccd-a034-c431b9519254/revoke-keys/0.log"
Jul 13 21:45:01.785180 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:01.785156    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-11bd6c7a-hng9f_8629ed67-1535-44d4-ba0f-3d52180fc1e3/revoke-keys/0.log"
Jul 13 21:45:01.891176 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:01.891152    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-543f558f-xnkpt_23f0a056-0e8b-4ad7-8037-c31c308ec951/revoke-keys/0.log"
Jul 13 21:45:02.231006 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:02.230985    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732985-t6sgn"
Jul 13 21:45:03.109856 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:03.109826    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732985-t6sgn"
Jul 13 21:45:03.109856 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:03.109850    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732985-t6sgn" event={"ID":"3dbd2547-8859-4426-ab9f-7fcb3e266a8f","Type":"ContainerDied","Data":"0d4f8b2919079193f674121bddbea825be253c93046573900276b25c4b1def05"}
Jul 13 21:45:03.110100 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:03.109900    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0d4f8b2919079193f674121bddbea825be253c93046573900276b25c4b1def05"
Jul 13 21:45:04.642363 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:04.642338    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf47x2rz_a391661d-64da-4614-abcb-c85464eeb57f/istio-proxy/0.log"
Jul 13 21:45:04.757580 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:04.757553    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-2rkqm_1a68d1d1-3503-4a2f-8316-2c6da5c9a31b/discovery/0.log"
Jul 13 21:45:05.806897 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:05.806870    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-qx2gg_d9334614-32da-4333-87c8-0f939436b052/main/0.log"
Jul 13 21:45:06.029613 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:06.029587    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-j6f6x_d34676f4-52a0-4126-82db-f494e8f47205/main/0.log"
Jul 13 21:45:06.254418 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:06.254352    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-87fdn_cbaac0cd-539f-47e9-addb-b3b9596a1751/main/0.log"
Jul 13 21:45:10.165594 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:10.165560    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:45:10.235686 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:10.235647    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:45:10.849008 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:10.848970    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:45:13.153933 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:13.153895    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vb7lj_02682275-db9d-4f68-9b88-4e6f2e6f52f2/global-pull-secret-syncer/0.log"
Jul 13 21:45:13.197200 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:13.197177    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log"
Jul 13 21:45:13.310372 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:13.310351    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-162.ec2.internal_02bd9a5046db92262a43fb17494a639b/haproxy/0.log"
Jul 13 21:45:15.671186 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:15.671150    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:45:15.728690 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:15.728669    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ll7x_c5c1f320-22e5-445f-8725-e6b11dc0ad1d/konnectivity-agent/0.log" limit=1024
Jul 13 21:45:20.014181 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:20.014151    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-m6p8g_16addf4f-5be8-437c-b494-8cefd4c1b407/kube-state-metrics/0.log"
Jul 13 21:45:20.031599 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:20.031570    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-m6p8g_16addf4f-5be8-437c-b494-8cefd4c1b407/kube-rbac-proxy-main/0.log"
Jul 13 21:45:20.051761 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:20.051741    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-m6p8g_16addf4f-5be8-437c-b494-8cefd4c1b407/kube-rbac-proxy-self/0.log"
Jul 13 21:45:20.080019 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:20.080000    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-96c65986d-8wdjn_a89131c1-1724-4d27-b4d5-7e827e2f4159/metrics-server/0.log"
Jul 13 21:45:20.257539 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:20.257511    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kpdwn_19a42a98-1c5a-408c-ada9-b45208264b32/node-exporter/0.log"
Jul 13 21:45:20.287984 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:20.287958    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kpdwn_19a42a98-1c5a-408c-ada9-b45208264b32/kube-rbac-proxy/0.log"
Jul 13 21:45:20.310919 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:20.310897    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kpdwn_19a42a98-1c5a-408c-ada9-b45208264b32/init-textfile/0.log"
Jul 13 21:45:23.261559 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:23.261526    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sxm8t/perf-node-gather-daemonset-tstfj"]
Jul 13 21:45:23.261939 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:23.261856    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dbd2547-8859-4426-ab9f-7fcb3e266a8f" containerName="cleanup"
Jul 13 21:45:23.261939 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:23.261869    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dbd2547-8859-4426-ab9f-7fcb3e266a8f" containerName="cleanup"
Jul 13 21:45:23.261939 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:23.261926    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3dbd2547-8859-4426-ab9f-7fcb3e266a8f" containerName="cleanup"
Jul 13 21:45:23.265086 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:23.265066    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sxm8t/perf-node-gather-daemonset-tstfj"
Jul 13 21:45:23.267627 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:23.267606    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sxm8t\"/\"kube-root-ca.crt\""
Jul 13 21:45:23.268963 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:23.268943    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sxm8t\"/\"openshift-service-ca.crt\""
Jul 13 21:45:23.269061 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:23.268988    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sxm8t\"/\"default-dockercfg-4dwcg\""
Jul 13 21:45:23.273469 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:23.273448    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sxm8t/perf-node-gather-daemonset-tstfj"]
Jul 13 21:45:23.354287 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:23.354254    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b8c8d511-e23b-4f89-8a3d-a01d1f8e5902-proc\") pod \"perf-node-gather-daemonset-tstfj\" (UID: \"b8c8d511-e23b-4f89-8a3d-a01d1f8e5902\") " pod="openshift-must-gather-sxm8t/perf-node-gather-daemonset-tstfj"
Jul 13 21:45:23.354437 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:23.354309    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b8c8d511-e23b-4f89-8a3d-a01d1f8e5902-lib-modules\") pod \"perf-node-gather-daemonset-tstfj\" (UID: \"b8c8d511-e23b-4f89-8a3d-a01d1f8e5902\") " pod="openshift-must-gather-sxm8t/perf-node-gather-daemonset-tstfj"
Jul 13 21:45:23.354437 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:23.354353    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b8c8d511-e23b-4f89-8a3d-a01d1f8e5902-podres\") pod \"perf-node-gather-daemonset-tstfj\" (UID: \"b8c8d511-e23b-4f89-8a3d-a01d1f8e5902\") " pod="openshift-must-gather-sxm8t/perf-node-gather-daemonset-tstfj"
Jul 13 21:45:23.354558 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:23.354435    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4lz6\" (UniqueName: \"kubernetes.io/projected/b8c8d511-e23b-4f89-8a3d-a01d1f8e5902-kube-api-access-f4lz6\") pod \"perf-node-gather-daemonset-tstfj\" (UID: \"b8c8d511-e23b-4f89-8a3d-a01d1f8e5902\") " pod="openshift-must-gather-sxm8t/perf-node-gather-daemonset-tstfj"
Jul 13 21:45:23.354558 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:23.354494    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b8c8d511-e23b-4f89-8a3d-a01d1f8e5902-sys\") pod \"perf-node-gather-daemonset-tstfj\" (UID: \"b8c8d511-e23b-4f89-8a3d-a01d1f8e5902\") " pod="openshift-must-gather-sxm8t/perf-node-gather-daemonset-tstfj"
Jul 13 21:45:23.455009 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:23.454978    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4lz6\" (UniqueName: \"kubernetes.io/projected/b8c8d511-e23b-4f89-8a3d-a01d1f8e5902-kube-api-access-f4lz6\") pod \"perf-node-gather-daemonset-tstfj\" (UID: \"b8c8d511-e23b-4f89-8a3d-a01d1f8e5902\") " pod="openshift-must-gather-sxm8t/perf-node-gather-daemonset-tstfj"
Jul 13 21:45:23.455146 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:23.455038    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b8c8d511-e23b-4f89-8a3d-a01d1f8e5902-sys\") pod \"perf-node-gather-daemonset-tstfj\" (UID: \"b8c8d511-e23b-4f89-8a3d-a01d1f8e5902\") " pod="openshift-must-gather-sxm8t/perf-node-gather-daemonset-tstfj"
Jul 13 21:45:23.455146 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:23.455084    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b8c8d511-e23b-4f89-8a3d-a01d1f8e5902-proc\") pod \"perf-node-gather-daemonset-tstfj\" (UID: \"b8c8d511-e23b-4f89-8a3d-a01d1f8e5902\") " pod="openshift-must-gather-sxm8t/perf-node-gather-daemonset-tstfj"
Jul 13 21:45:23.455259 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:23.455147    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b8c8d511-e23b-4f89-8a3d-a01d1f8e5902-lib-modules\") pod \"perf-node-gather-daemonset-tstfj\" (UID: \"b8c8d511-e23b-4f89-8a3d-a01d1f8e5902\") " pod="openshift-must-gather-sxm8t/perf-node-gather-daemonset-tstfj"
Jul 13 21:45:23.455259 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:23.455174    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b8c8d511-e23b-4f89-8a3d-a01d1f8e5902-proc\") pod \"perf-node-gather-daemonset-tstfj\" (UID: \"b8c8d511-e23b-4f89-8a3d-a01d1f8e5902\") " pod="openshift-must-gather-sxm8t/perf-node-gather-daemonset-tstfj"
Jul 13 21:45:23.455259 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:23.455192    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b8c8d511-e23b-4f89-8a3d-a01d1f8e5902-podres\") pod \"perf-node-gather-daemonset-tstfj\" (UID: \"b8c8d511-e23b-4f89-8a3d-a01d1f8e5902\") " pod="openshift-must-gather-sxm8t/perf-node-gather-daemonset-tstfj"
Jul 13 21:45:23.455259 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:23.455251    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b8c8d511-e23b-4f89-8a3d-a01d1f8e5902-sys\") pod \"perf-node-gather-daemonset-tstfj\" (UID: \"b8c8d511-e23b-4f89-8a3d-a01d1f8e5902\") " pod="openshift-must-gather-sxm8t/perf-node-gather-daemonset-tstfj"
Jul 13 21:45:23.455419 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:23.455289    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b8c8d511-e23b-4f89-8a3d-a01d1f8e5902-podres\") pod \"perf-node-gather-daemonset-tstfj\" (UID: \"b8c8d511-e23b-4f89-8a3d-a01d1f8e5902\") " pod="openshift-must-gather-sxm8t/perf-node-gather-daemonset-tstfj"
Jul 13 21:45:23.455419 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:23.455307    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b8c8d511-e23b-4f89-8a3d-a01d1f8e5902-lib-modules\") pod \"perf-node-gather-daemonset-tstfj\" (UID: \"b8c8d511-e23b-4f89-8a3d-a01d1f8e5902\") " pod="openshift-must-gather-sxm8t/perf-node-gather-daemonset-tstfj"
Jul 13 21:45:23.463654 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:23.463626    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4lz6\" (UniqueName: \"kubernetes.io/projected/b8c8d511-e23b-4f89-8a3d-a01d1f8e5902-kube-api-access-f4lz6\") pod \"perf-node-gather-daemonset-tstfj\" (UID: \"b8c8d511-e23b-4f89-8a3d-a01d1f8e5902\") " pod="openshift-must-gather-sxm8t/perf-node-gather-daemonset-tstfj"
Jul 13 21:45:23.575536 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:23.575513    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sxm8t/perf-node-gather-daemonset-tstfj"
Jul 13 21:45:23.702308 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:23.702277    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sxm8t/perf-node-gather-daemonset-tstfj"]
Jul 13 21:45:23.705118 ip-10-0-137-162 kubenswrapper[2561]: W0713 21:45:23.705086    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb8c8d511_e23b_4f89_8a3d_a01d1f8e5902.slice/crio-97ccd19e35a4697a23d76d6ce9b4b26fd0ea85727d830004d2f8fb4536c1d953 WatchSource:0}: Error finding container 97ccd19e35a4697a23d76d6ce9b4b26fd0ea85727d830004d2f8fb4536c1d953: Status 404 returned error can't find the container with id 97ccd19e35a4697a23d76d6ce9b4b26fd0ea85727d830004d2f8fb4536c1d953
Jul 13 21:45:24.202404 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:24.202374    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sxm8t/perf-node-gather-daemonset-tstfj" event={"ID":"b8c8d511-e23b-4f89-8a3d-a01d1f8e5902","Type":"ContainerStarted","Data":"28f7e4696fb2b8a32468d06c0af2fd48fb75e3a7775833ad1651ca373626ad61"}
Jul 13 21:45:24.202601 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:24.202422    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sxm8t/perf-node-gather-daemonset-tstfj" event={"ID":"b8c8d511-e23b-4f89-8a3d-a01d1f8e5902","Type":"ContainerStarted","Data":"97ccd19e35a4697a23d76d6ce9b4b26fd0ea85727d830004d2f8fb4536c1d953"}
Jul 13 21:45:24.202601 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:24.202462    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sxm8t/perf-node-gather-daemonset-tstfj"
Jul 13 21:45:24.217897 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:24.217853    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sxm8t/perf-node-gather-daemonset-tstfj" podStartSLOduration=1.217838006 podStartE2EDuration="1.217838006s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:45:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:45:24.217029743 +0000 UTC m=+3097.211813162" watchObservedRunningTime="2026-07-13 21:45:24.217838006 +0000 UTC m=+3097.212621425"
Jul 13 21:45:25.315886 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:25.315860    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g6djs_d30568f7-82bc-4275-8448-bd730870d3c9/dns/0.log"
Jul 13 21:45:25.334944 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:25.334924    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g6djs_d30568f7-82bc-4275-8448-bd730870d3c9/kube-rbac-proxy/0.log"
Jul 13 21:45:25.378512 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:25.378490    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sfjmb_34885618-690d-42f8-96c2-3af217da17a9/dns-node-resolver/0.log"
Jul 13 21:45:25.950375 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:25.950342    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7df4bb85c-kbm7x_349147c3-17c6-4597-9e59-2d21ba6dcf0e/registry/0.log"
Jul 13 21:45:25.970152 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:25.970131    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4r78x_70606094-6a35-429c-b57d-2b236b88cc27/node-ca/0.log"
Jul 13 21:45:26.958695 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:26.958660    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf47x2rz_a391661d-64da-4614-abcb-c85464eeb57f/istio-proxy/0.log"
Jul 13 21:45:27.073165 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:27.073133    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-2rkqm_1a68d1d1-3503-4a2f-8316-2c6da5c9a31b/discovery/0.log"
Jul 13 21:45:28.039617 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:28.039582    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dqqtb_d00b98e8-2a0b-4cac-bdb9-4694daeb7e0a/serve-healthcheck-canary/0.log"
Jul 13 21:45:28.598043 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:28.598016    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mdp92_9085d044-b096-4e63-b65f-cd39f4fa1c00/kube-rbac-proxy/0.log"
Jul 13 21:45:28.617524 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:28.617492    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mdp92_9085d044-b096-4e63-b65f-cd39f4fa1c00/exporter/0.log"
Jul 13 21:45:28.638260 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:28.638226    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mdp92_9085d044-b096-4e63-b65f-cd39f4fa1c00/extractor/0.log"
Jul 13 21:45:30.216869 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:30.216841    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sxm8t/perf-node-gather-daemonset-tstfj"
Jul 13 21:45:31.298833 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:31.298794    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fdc557c48-vjq6w_c051e6d4-4446-4d42-ab4c-fc87fea77233/manager/0.log"
Jul 13 21:45:31.322146 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:31.322118    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fdc557c48-vjq6w_c051e6d4-4446-4d42-ab4c-fc87fea77233/copy-manifests/0.log"
Jul 13 21:45:32.783807 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:32.783777    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5f779bff78-tc4pq_892c3f40-ff45-4748-a82d-6cff5ddbcf83/manager/0.log"
Jul 13 21:45:33.645176 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:33.645147    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf47x2rz_a391661d-64da-4614-abcb-c85464eeb57f/istio-proxy/0.log"
Jul 13 21:45:33.758622 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:33.758542    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-2rkqm_1a68d1d1-3503-4a2f-8316-2c6da5c9a31b/discovery/0.log"
Jul 13 21:45:35.182480 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:35.182401    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf47x2rz_a391661d-64da-4614-abcb-c85464eeb57f/istio-proxy/0.log"
Jul 13 21:45:35.293279 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:35.290836    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-2rkqm_1a68d1d1-3503-4a2f-8316-2c6da5c9a31b/discovery/0.log"
Jul 13 21:45:39.444956 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:39.444930    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c5jdx_df777e90-a19a-493a-9725-24c67196c62a/kube-multus-additional-cni-plugins/0.log"
Jul 13 21:45:39.464861 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:39.464835    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c5jdx_df777e90-a19a-493a-9725-24c67196c62a/egress-router-binary-copy/0.log"
Jul 13 21:45:39.483514 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:39.483483    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c5jdx_df777e90-a19a-493a-9725-24c67196c62a/cni-plugins/0.log"
Jul 13 21:45:39.502984 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:39.502965    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c5jdx_df777e90-a19a-493a-9725-24c67196c62a/bond-cni-plugin/0.log"
Jul 13 21:45:39.522519 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:39.522494    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c5jdx_df777e90-a19a-493a-9725-24c67196c62a/routeoverride-cni/0.log"
Jul 13 21:45:39.541108 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:39.541086    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c5jdx_df777e90-a19a-493a-9725-24c67196c62a/whereabouts-cni-bincopy/0.log"
Jul 13 21:45:39.559497 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:39.559475    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c5jdx_df777e90-a19a-493a-9725-24c67196c62a/whereabouts-cni/0.log"
Jul 13 21:45:39.931149 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:39.931118    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rb6b2_80d43145-0683-447c-b42c-132e6088f785/kube-multus/0.log"
Jul 13 21:45:40.070091 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:40.070065    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zhvrj_8608f034-4011-42c3-b0ee-1369e8afa709/network-metrics-daemon/0.log"
Jul 13 21:45:40.088329 ip-10-0-137-162 kubenswrapper[2561]: I0713 21:45:40.088304    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zhvrj_8608f034-4011-42c3-b0ee-1369e8afa709/kube-rbac-proxy/0.log"