Jul 13 15:23:32.340753 ip-10-0-137-93 systemd[1]: Starting Kubernetes Kubelet...
Jul 13 15:23:32.821025 ip-10-0-137-93 kubenswrapper[2555]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 15:23:32.821025 ip-10-0-137-93 kubenswrapper[2555]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 13 15:23:32.821025 ip-10-0-137-93 kubenswrapper[2555]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 15:23:32.821025 ip-10-0-137-93 kubenswrapper[2555]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 13 15:23:32.821025 ip-10-0-137-93 kubenswrapper[2555]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 15:23:32.821025 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.819187    2555 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 13 15:23:32.837110 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824026    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 15:23:32.837110 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824037    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 15:23:32.837110 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824041    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 15:23:32.837110 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824044    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 15:23:32.837110 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824047    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 15:23:32.837110 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824050    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 15:23:32.837110 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824053    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 15:23:32.837110 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824056    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 15:23:32.837110 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824059    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 15:23:32.837110 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824062    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 15:23:32.837110 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824065    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 15:23:32.837110 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824067    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 15:23:32.837110 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824070    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 15:23:32.837110 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824073    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 15:23:32.837110 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824076    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 15:23:32.837110 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824079    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 15:23:32.837110 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824086    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 15:23:32.837110 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824089    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 15:23:32.837110 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824091    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 15:23:32.837110 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824094    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 15:23:32.851448 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824096    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 15:23:32.851448 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824099    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 15:23:32.851448 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824102    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 15:23:32.851448 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824104    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 15:23:32.851448 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824107    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 15:23:32.851448 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824109    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 15:23:32.851448 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824112    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 15:23:32.851448 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824114    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 15:23:32.851448 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824116    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 15:23:32.851448 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824119    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 15:23:32.851448 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824121    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 15:23:32.851448 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824124    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 15:23:32.851448 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824127    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 15:23:32.851448 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824130    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 15:23:32.851448 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824132    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 15:23:32.851448 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824135    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 15:23:32.851448 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824140    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 15:23:32.851448 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824144    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 15:23:32.851448 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824147    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 15:23:32.853666 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824150    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 15:23:32.853666 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824153    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 15:23:32.853666 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824156    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 15:23:32.853666 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824159    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 15:23:32.853666 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824162    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 15:23:32.853666 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824165    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 15:23:32.853666 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824167    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 15:23:32.853666 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824171    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 15:23:32.853666 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824176    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 15:23:32.853666 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824186    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 15:23:32.853666 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824189    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 15:23:32.853666 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824192    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 15:23:32.853666 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824195    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 15:23:32.853666 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824198    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 15:23:32.853666 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824201    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 15:23:32.853666 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824204    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 15:23:32.853666 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824207    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 15:23:32.853666 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824209    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 15:23:32.853666 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824212    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 15:23:32.855769 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824216    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 15:23:32.855769 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824219    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 15:23:32.855769 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824222    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 15:23:32.855769 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824225    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 15:23:32.855769 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824228    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 15:23:32.855769 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824231    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 15:23:32.855769 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824234    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 15:23:32.855769 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824238    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 15:23:32.855769 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824241    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 15:23:32.855769 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824244    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 15:23:32.855769 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824247    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 15:23:32.855769 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824249    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 15:23:32.855769 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824252    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 15:23:32.855769 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824254    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 15:23:32.855769 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824257    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 15:23:32.855769 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824259    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 15:23:32.855769 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824262    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 15:23:32.855769 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824265    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 15:23:32.855769 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824267    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 15:23:32.858105 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824270    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 15:23:32.858105 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824272    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 15:23:32.858105 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824275    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 15:23:32.858105 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824278    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 15:23:32.858105 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824281    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 15:23:32.858105 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824285    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 15:23:32.858105 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824289    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 15:23:32.858105 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824292    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 15:23:32.858105 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824295    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 15:23:32.858105 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824297    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 15:23:32.858105 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824299    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 15:23:32.858105 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824302    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 15:23:32.858105 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824305    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 15:23:32.858105 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824308    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 15:23:32.858105 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824311    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 15:23:32.858105 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824313    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 15:23:32.858105 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824316    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 15:23:32.858105 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824318    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 15:23:32.858105 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824321    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 15:23:32.858105 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824323    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 15:23:32.860065 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824327    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 15:23:32.860065 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.824330    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 15:23:32.860065 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825083    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 15:23:32.860065 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825092    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 15:23:32.860065 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825097    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 15:23:32.860065 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825100    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 15:23:32.860065 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825103    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 15:23:32.860065 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825105    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 15:23:32.860065 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825108    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 15:23:32.860065 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825111    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 15:23:32.860065 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825113    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 15:23:32.860065 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825116    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 15:23:32.860065 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825119    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 15:23:32.860065 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825122    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 15:23:32.860065 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825124    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 15:23:32.860065 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825127    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 15:23:32.860065 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825131    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 15:23:32.860065 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825134    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 15:23:32.860065 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825136    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 15:23:32.862389 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825139    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 15:23:32.862389 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825142    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 15:23:32.862389 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825144    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 15:23:32.862389 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825147    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 15:23:32.862389 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825149    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 15:23:32.862389 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825152    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 15:23:32.862389 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825155    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 15:23:32.862389 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825158    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 15:23:32.862389 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825162    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 15:23:32.862389 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825166    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 15:23:32.862389 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825169    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 15:23:32.862389 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825172    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 15:23:32.862389 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825175    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 15:23:32.862389 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825177    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 15:23:32.862389 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825180    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 15:23:32.862389 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825182    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 15:23:32.862389 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825185    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 15:23:32.862389 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825189    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 15:23:32.862389 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825191    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 15:23:32.862389 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825194    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 15:23:32.864287 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825197    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 15:23:32.864287 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825199    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 15:23:32.864287 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825201    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 15:23:32.864287 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825205    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 15:23:32.864287 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825208    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 15:23:32.864287 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825210    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 15:23:32.864287 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825213    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 15:23:32.864287 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825215    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 15:23:32.864287 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825217    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 15:23:32.864287 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825220    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 15:23:32.864287 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825223    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 15:23:32.864287 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825226    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 15:23:32.864287 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825229    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 15:23:32.864287 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825231    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 15:23:32.864287 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825234    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 15:23:32.864287 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825237    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 15:23:32.864287 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825239    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 15:23:32.864287 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825242    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 15:23:32.864287 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825244    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 15:23:32.864287 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825247    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 15:23:32.866665 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825249    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 15:23:32.866665 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825252    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 15:23:32.866665 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825254    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 15:23:32.866665 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825256    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 15:23:32.866665 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825260    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 15:23:32.866665 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825262    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 15:23:32.866665 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825265    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 15:23:32.866665 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825268    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 15:23:32.866665 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825272    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 15:23:32.866665 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825275    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 15:23:32.866665 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825278    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 15:23:32.866665 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825280    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 15:23:32.866665 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825283    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 15:23:32.866665 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825286    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 15:23:32.866665 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825288    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 15:23:32.866665 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825291    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 15:23:32.866665 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825294    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 15:23:32.866665 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825297    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 15:23:32.866665 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825300    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 15:23:32.964474 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825303    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 15:23:32.964474 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825305    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 15:23:32.964474 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825308    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 15:23:32.964474 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825311    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 15:23:32.964474 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825314    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 15:23:32.964474 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825317    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 15:23:32.964474 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825319    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 15:23:32.964474 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825322    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 15:23:32.964474 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825325    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 15:23:32.964474 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825327    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 15:23:32.964474 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825330    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 15:23:32.964474 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825332    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 15:23:32.964474 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825335    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 15:23:32.964474 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825338    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 15:23:32.964474 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825340    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 15:23:32.964474 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825343    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 15:23:32.964474 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825345    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 15:23:32.964474 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825348    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 15:23:32.964474 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825351    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 15:23:32.964474 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825353    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 15:23:32.895554 ip-10-0-137-93 systemd[1]: Started Kubernetes Kubelet.
Jul 13 15:23:33.116337 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825355    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 15:23:33.116337 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825358    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 15:23:33.116337 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825361    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 15:23:33.116337 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825779    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 15:23:33.116337 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825785    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 15:23:33.116337 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825788    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 15:23:33.116337 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825791    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 15:23:33.116337 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825794    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 15:23:33.116337 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825797    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 15:23:33.116337 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825799    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 15:23:33.116337 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825802    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 15:23:33.116337 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825804    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 15:23:33.116337 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825807    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 15:23:33.116337 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825810    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 15:23:33.116337 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825813    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 15:23:33.116337 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825815    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 15:23:33.116337 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825818    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 15:23:33.116337 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825822    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 15:23:33.116337 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825826    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 15:23:33.120056 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825829    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 15:23:33.120056 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825832    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 15:23:33.120056 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825835    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 15:23:33.120056 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825838    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 15:23:33.120056 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825840    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 15:23:33.120056 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825843    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 15:23:33.120056 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825845    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 15:23:33.120056 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825849    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 15:23:33.120056 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825852    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 15:23:33.120056 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825856    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 15:23:33.120056 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825858    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 15:23:33.120056 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825861    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 15:23:33.120056 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825864    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 15:23:33.120056 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825866    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 15:23:33.120056 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825872    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 15:23:33.120056 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825874    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 15:23:33.120056 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825877    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 15:23:33.120056 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825880    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 15:23:33.120056 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825882    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 15:23:33.120056 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825886    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 15:23:33.120757 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825888    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 15:23:33.120757 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825891    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 15:23:33.120757 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825893    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 15:23:33.120757 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825896    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 15:23:33.120757 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825898    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 15:23:33.120757 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825901    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 15:23:33.120757 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825903    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 15:23:33.120757 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825906    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 15:23:33.120757 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825909    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 15:23:33.120757 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825911    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 15:23:33.120757 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825915    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 15:23:33.120757 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825917    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 15:23:33.120757 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825920    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 15:23:33.120757 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825923    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 15:23:33.120757 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825927    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 15:23:33.120757 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825929    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 15:23:33.120757 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825932    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 15:23:33.120757 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825934    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 15:23:33.120757 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825937    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 15:23:33.120757 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825939    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 15:23:33.121600 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825942    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 15:23:33.121600 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825944    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 15:23:33.121600 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825947    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 15:23:33.121600 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825950    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 15:23:33.121600 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825952    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 15:23:33.121600 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825954    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 15:23:33.121600 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825960    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 15:23:33.121600 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825963    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 15:23:33.121600 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825965    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 15:23:33.121600 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825968    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 15:23:33.121600 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825970    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 15:23:33.121600 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825973    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 15:23:33.121600 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825975    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 15:23:33.121600 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825978    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 15:23:33.121600 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825980    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 15:23:33.121600 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825983    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 15:23:33.121600 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825985    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 15:23:33.121600 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825988    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 15:23:33.121600 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825991    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 15:23:33.122310 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825993    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 15:23:33.122310 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825995    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 15:23:33.122310 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.825998    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 15:23:33.122310 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826000    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 15:23:33.122310 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826005    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 15:23:33.122310 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826008    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 15:23:33.122310 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826011    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 15:23:33.122310 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826014    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 15:23:33.122310 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826017    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 15:23:33.122310 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826020    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 15:23:33.122310 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826022    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 15:23:33.122310 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826025    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 15:23:33.122310 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826027    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 15:23:33.122310 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826030    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 15:23:33.122310 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826032    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 15:23:33.122310 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826035    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 15:23:33.122310 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826037    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 15:23:33.122310 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826040    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 15:23:33.122310 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826042    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 15:23:33.122310 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826047    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 15:23:33.123001 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826050    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 15:23:33.123001 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826052    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 15:23:33.123001 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826055    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 15:23:33.123001 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826057    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 15:23:33.123001 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826131    2555 flags.go:64] FLAG: --address="0.0.0.0"
Jul 13 15:23:33.123001 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826139    2555 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 13 15:23:33.123001 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826147    2555 flags.go:64] FLAG: --anonymous-auth="true"
Jul 13 15:23:33.123001 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826154    2555 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 13 15:23:33.123001 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826160    2555 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 13 15:23:33.123001 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826165    2555 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 13 15:23:33.123001 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826171    2555 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 13 15:23:33.123001 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826176    2555 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 13 15:23:33.123001 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826180    2555 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 13 15:23:33.123001 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826182    2555 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 13 15:23:33.123001 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826186    2555 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 13 15:23:33.123001 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826189    2555 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 13 15:23:33.123001 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826192    2555 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 13 15:23:33.123001 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826196    2555 flags.go:64] FLAG: --cgroup-root=""
Jul 13 15:23:33.123001 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826199    2555 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 13 15:23:33.123001 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826202    2555 flags.go:64] FLAG: --client-ca-file=""
Jul 13 15:23:33.123001 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826205    2555 flags.go:64] FLAG: --cloud-provider="external"
Jul 13 15:23:33.123001 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826208    2555 flags.go:64] FLAG: --cluster-dns="[]"
Jul 13 15:23:33.123001 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826217    2555 flags.go:64] FLAG: --cluster-domain=""
Jul 13 15:23:33.123001 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826220    2555 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 13 15:23:33.123796 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826223    2555 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 13 15:23:33.123796 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826226    2555 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 13 15:23:33.123796 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826229    2555 flags.go:64] FLAG: --container-log-max-files="5"
Jul 13 15:23:33.123796 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826233    2555 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 13 15:23:33.123796 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826236    2555 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 13 15:23:33.123796 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826240    2555 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 13 15:23:33.123796 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826243    2555 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 13 15:23:33.123796 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826248    2555 flags.go:64] FLAG: --contention-profiling="false"
Jul 13 15:23:33.123796 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826251    2555 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 13 15:23:33.123796 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826254    2555 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 13 15:23:33.123796 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826257    2555 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 13 15:23:33.123796 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826260    2555 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 13 15:23:33.123796 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826264    2555 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 13 15:23:33.123796 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826267    2555 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 13 15:23:33.123796 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826270    2555 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 13 15:23:33.123796 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826273    2555 flags.go:64] FLAG: --enable-load-reader="false"
Jul 13 15:23:33.123796 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826276    2555 flags.go:64] FLAG: --enable-server="true"
Jul 13 15:23:33.123796 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826279    2555 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 13 15:23:33.123796 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826288    2555 flags.go:64] FLAG: --event-burst="100"
Jul 13 15:23:33.123796 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826291    2555 flags.go:64] FLAG: --event-qps="50"
Jul 13 15:23:33.123796 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826294    2555 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 13 15:23:33.123796 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826297    2555 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 13 15:23:33.123796 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826300    2555 flags.go:64] FLAG: --eviction-hard=""
Jul 13 15:23:33.123796 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826304    2555 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 13 15:23:33.124619 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826307    2555 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 13 15:23:33.124619 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826311    2555 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 13 15:23:33.124619 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826319    2555 flags.go:64] FLAG: --eviction-soft=""
Jul 13 15:23:33.124619 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826322    2555 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 13 15:23:33.124619 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826326    2555 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 13 15:23:33.124619 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826328    2555 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 13 15:23:33.124619 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826331    2555 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 13 15:23:33.124619 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826334    2555 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 13 15:23:33.124619 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826337    2555 flags.go:64] FLAG: --fail-swap-on="true"
Jul 13 15:23:33.124619 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826340    2555 flags.go:64] FLAG: --feature-gates=""
Jul 13 15:23:33.124619 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826344    2555 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 13 15:23:33.124619 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826347    2555 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 13 15:23:33.124619 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826350    2555 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 13 15:23:33.124619 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826353    2555 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 13 15:23:33.124619 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826356    2555 flags.go:64] FLAG: --healthz-port="10248"
Jul 13 15:23:33.124619 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826362    2555 flags.go:64] FLAG: --help="false"
Jul 13 15:23:33.124619 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826365    2555 flags.go:64] FLAG: --hostname-override="ip-10-0-137-93.ec2.internal"
Jul 13 15:23:33.124619 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826368    2555 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 13 15:23:33.124619 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826371    2555 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 13 15:23:33.124619 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826374    2555 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 13 15:23:33.124619 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826377    2555 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 13 15:23:33.124619 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826381    2555 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 13 15:23:33.124619 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826384    2555 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 13 15:23:33.124619 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826387    2555 flags.go:64] FLAG: --image-service-endpoint=""
Jul 13 15:23:33.125577 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826389    2555 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 13 15:23:33.125577 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826392    2555 flags.go:64] FLAG: --kube-api-burst="100"
Jul 13 15:23:33.125577 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826395    2555 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 13 15:23:33.125577 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826398    2555 flags.go:64] FLAG: --kube-api-qps="50"
Jul 13 15:23:33.125577 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826401    2555 flags.go:64] FLAG: --kube-reserved=""
Jul 13 15:23:33.125577 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826404    2555 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 13 15:23:33.125577 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826407    2555 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 13 15:23:33.125577 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826410    2555 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 13 15:23:33.125577 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826413    2555 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 13 15:23:33.125577 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826416    2555 flags.go:64] FLAG: --lock-file=""
Jul 13 15:23:33.125577 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826419    2555 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 13 15:23:33.125577 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826427    2555 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 13 15:23:33.125577 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826442    2555 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 13 15:23:33.125577 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826448    2555 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 13 15:23:33.125577 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826451    2555 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 13 15:23:33.125577 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826453    2555 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 13 15:23:33.125577 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826456    2555 flags.go:64] FLAG: --logging-format="text"
Jul 13 15:23:33.125577 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826459    2555 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 13 15:23:33.125577 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826462    2555 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 13 15:23:33.125577 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826465    2555 flags.go:64] FLAG: --manifest-url=""
Jul 13 15:23:33.125577 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826468    2555 flags.go:64] FLAG: --manifest-url-header=""
Jul 13 15:23:33.125577 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826472    2555 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 13 15:23:33.125577 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826475    2555 flags.go:64] FLAG: --max-open-files="1000000"
Jul 13 15:23:33.125577 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826482    2555 flags.go:64] FLAG: --max-pods="110"
Jul 13 15:23:33.125577 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826485    2555 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 13 15:23:33.126305 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826488    2555 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 13 15:23:33.126305 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826491    2555 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 13 15:23:33.126305 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826494    2555 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 13 15:23:33.126305 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826497    2555 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 13 15:23:33.126305 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826500    2555 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 13 15:23:33.126305 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826503    2555 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 13 15:23:33.126305 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826511    2555 flags.go:64] FLAG: --node-status-max-images="50"
Jul 13 15:23:33.126305 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826513    2555 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 13 15:23:33.126305 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826517    2555 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 13 15:23:33.126305 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826520    2555 flags.go:64] FLAG: --pod-cidr=""
Jul 13 15:23:33.126305 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826522    2555 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 13 15:23:33.126305 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826528    2555 flags.go:64] FLAG: --pod-manifest-path=""
Jul 13 15:23:33.126305 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826531    2555 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 13 15:23:33.126305 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826534    2555 flags.go:64] FLAG: --pods-per-core="0"
Jul 13 15:23:33.126305 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826537    2555 flags.go:64] FLAG: --port="10250"
Jul 13 15:23:33.126305 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826540    2555 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 13 15:23:33.126305 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826543    2555 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08a515cfefb4198b5"
Jul 13 15:23:33.126305 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826546    2555 flags.go:64] FLAG: --qos-reserved=""
Jul 13 15:23:33.126305 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826549    2555 flags.go:64] FLAG: --read-only-port="10255"
Jul 13 15:23:33.126305 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826558    2555 flags.go:64] FLAG: --register-node="true"
Jul 13 15:23:33.126305 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826561    2555 flags.go:64] FLAG: --register-with-taints=""
Jul 13 15:23:33.126305 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826564    2555 flags.go:64] FLAG: --registry-burst="10"
Jul 13 15:23:33.126305 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826567    2555 flags.go:64] FLAG: --registry-qps="5"
Jul 13 15:23:33.126305 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826570    2555 flags.go:64] FLAG: --reserved-cpus=""
Jul 13 15:23:33.127147 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826573    2555 flags.go:64] FLAG: --reserved-memory=""
Jul 13 15:23:33.127147 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826579    2555 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 13 15:23:33.127147 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826582    2555 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 13 15:23:33.127147 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826585    2555 flags.go:64] FLAG: --rotate-certificates="false"
Jul 13 15:23:33.127147 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826588    2555 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 13 15:23:33.127147 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826591    2555 flags.go:64] FLAG: --runonce="false"
Jul 13 15:23:33.127147 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826596    2555 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 13 15:23:33.127147 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826601    2555 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 13 15:23:33.127147 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826604    2555 flags.go:64] FLAG: --seccomp-default="false"
Jul 13 15:23:33.127147 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826607    2555 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 13 15:23:33.127147 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826609    2555 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 13 15:23:33.127147 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826612    2555 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 13 15:23:33.127147 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826616    2555 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 13 15:23:33.127147 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826619    2555 flags.go:64] FLAG: --storage-driver-password="root"
Jul 13 15:23:33.127147 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826622    2555 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 13 15:23:33.127147 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826625    2555 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 13 15:23:33.127147 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826628    2555 flags.go:64] FLAG: --storage-driver-user="root"
Jul 13 15:23:33.127147 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826630    2555 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 13 15:23:33.127147 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826633    2555 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 13 15:23:33.127147 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826636    2555 flags.go:64] FLAG: --system-cgroups=""
Jul 13 15:23:33.127147 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826639    2555 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 13 15:23:33.127147 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826644    2555 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 13 15:23:33.127147 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826647    2555 flags.go:64] FLAG: --tls-cert-file=""
Jul 13 15:23:33.127147 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826650    2555 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 13 15:23:33.127147 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826697    2555 flags.go:64] FLAG: --tls-min-version=""
Jul 13 15:23:33.127883 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826701    2555 flags.go:64] FLAG: --tls-private-key-file=""
Jul 13 15:23:33.127883 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826704    2555 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 13 15:23:33.127883 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826707    2555 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 13 15:23:33.127883 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826711    2555 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 13 15:23:33.127883 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826714    2555 flags.go:64] FLAG: --v="2"
Jul 13 15:23:33.127883 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826718    2555 flags.go:64] FLAG: --version="false"
Jul 13 15:23:33.127883 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826722    2555 flags.go:64] FLAG: --vmodule=""
Jul 13 15:23:33.127883 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826725    2555 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 13 15:23:33.127883 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.826728    2555 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 13 15:23:33.127883 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826842    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 15:23:33.127883 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826845    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 15:23:33.127883 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826849    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 15:23:33.127883 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826851    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 15:23:33.127883 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826856    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 15:23:33.127883 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826860    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 15:23:33.127883 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826863    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 15:23:33.127883 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826866    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 15:23:33.127883 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826868    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 15:23:33.127883 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826871    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 15:23:33.127883 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826874    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 15:23:33.127883 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826877    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 15:23:33.127883 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826879    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 15:23:33.128567 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826882    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 15:23:33.128567 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826884    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 15:23:33.128567 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826887    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 15:23:33.128567 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826890    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 15:23:33.128567 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826893    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 15:23:33.128567 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826895    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 15:23:33.128567 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826898    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 15:23:33.128567 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826900    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 15:23:33.128567 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826903    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 15:23:33.128567 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826905    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 15:23:33.128567 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826908    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 15:23:33.128567 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826911    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 15:23:33.128567 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826913    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 15:23:33.128567 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826916    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 15:23:33.128567 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826919    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 15:23:33.128567 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826921    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 15:23:33.128567 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826924    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 15:23:33.128567 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826927    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 15:23:33.128567 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826929    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 15:23:33.128567 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826932    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 15:23:33.129102 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826934    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 15:23:33.129102 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826937    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 15:23:33.129102 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826940    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 15:23:33.129102 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826944    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 15:23:33.129102 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826948    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 15:23:33.129102 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826951    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 15:23:33.129102 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826953    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 15:23:33.129102 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826956    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 15:23:33.129102 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826958    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 15:23:33.129102 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826961    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 15:23:33.129102 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826963    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 15:23:33.129102 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826966    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 15:23:33.129102 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826969    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 15:23:33.129102 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826971    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 15:23:33.129102 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826975    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 15:23:33.129102 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826979    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 15:23:33.129102 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826982    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 15:23:33.129102 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826985    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 15:23:33.129102 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826988    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 15:23:33.129102 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826991    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 15:23:33.129799 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826993    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 15:23:33.129799 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.826997    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 15:23:33.129799 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.827001    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 15:23:33.129799 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.827004    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 15:23:33.129799 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.827007    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 15:23:33.129799 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.827010    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 15:23:33.129799 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.827012    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 15:23:33.129799 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.827022    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 15:23:33.129799 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.827025    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 15:23:33.129799 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.827028    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 15:23:33.129799 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.827030    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 15:23:33.129799 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.827033    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 15:23:33.129799 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.827036    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 15:23:33.129799 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.827038    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 15:23:33.129799 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.827041    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 15:23:33.129799 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.827045    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 15:23:33.129799 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.827049    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 15:23:33.129799 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.827052    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 15:23:33.129799 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.827054    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 15:23:33.130400 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.827057    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 15:23:33.130400 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.827059    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 15:23:33.130400 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.827062    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 15:23:33.130400 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.827064    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 15:23:33.130400 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.827067    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 15:23:33.130400 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.827069    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 15:23:33.130400 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.827072    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 15:23:33.130400 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.827074    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 15:23:33.130400 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.827077    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 15:23:33.130400 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.827080    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 15:23:33.130400 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.827082    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 15:23:33.130400 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.827085    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 15:23:33.130400 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.827087    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 15:23:33.130400 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.827090    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 15:23:33.130400 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.827092    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 15:23:33.130400 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.827095    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 15:23:33.130400 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.827097    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 15:23:33.130400 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.827101    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 15:23:33.130400 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.827105    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 15:23:33.326467 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.827107    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 15:23:33.326467 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.827110    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 15:23:33.326467 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.827113    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 15:23:33.326467 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.827116    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 15:23:33.326467 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.827118    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 15:23:33.326467 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.827121    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 15:23:33.326467 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.827123    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 15:23:33.326467 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.827126    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 15:23:33.326467 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.827348    2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 15:23:33.326467 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.834748    2555 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 13 15:23:33.326467 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.834767    2555 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 13 15:23:33.326467 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.834787    2555 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 13 15:23:33.326467 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.834801    2555 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 13 15:23:33.326467 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.834898    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 15:23:33.327007 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.834906    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 15:23:33.327007 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.834911    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 15:23:33.327007 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.834914    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 15:23:33.327007 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.834918    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 15:23:33.327007 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.834922    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 15:23:33.327007 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.834926    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 15:23:33.327007 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.834930    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 15:23:33.327007 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.834934    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 15:23:33.327007 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.834938    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 15:23:33.327007 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.834942    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 15:23:33.327007 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.834945    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 15:23:33.327007 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.834950    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 15:23:33.327007 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.834954    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 15:23:33.327007 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.834958    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 15:23:33.327007 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.834961    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 15:23:33.327007 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.834965    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 15:23:33.327007 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.834972    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 15:23:33.327007 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.834978    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 15:23:33.327007 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.834985    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 15:23:33.327640 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.834990    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 15:23:33.327640 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.834996    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 15:23:33.327640 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835001    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 15:23:33.327640 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835005    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 15:23:33.327640 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835008    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 15:23:33.327640 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835013    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 15:23:33.327640 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835016    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 15:23:33.327640 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835020    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 15:23:33.327640 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835024    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 15:23:33.327640 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835028    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 15:23:33.327640 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835032    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 15:23:33.327640 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835036    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 15:23:33.327640 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835040    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 15:23:33.327640 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835044    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 15:23:33.327640 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835047    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 15:23:33.327640 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835051    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 15:23:33.327640 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835055    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 15:23:33.327640 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835059    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 15:23:33.327640 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835062    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 15:23:33.328141 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835066    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 15:23:33.328141 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835070    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 15:23:33.328141 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835074    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 15:23:33.328141 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835077    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 15:23:33.328141 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835081    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 15:23:33.328141 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835085    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 15:23:33.328141 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835088    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 15:23:33.328141 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835092    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 15:23:33.328141 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835096    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 15:23:33.328141 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835100    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 15:23:33.328141 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835103    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 15:23:33.328141 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835107    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 15:23:33.328141 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835114    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 15:23:33.328141 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835119    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 15:23:33.328141 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835123    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 15:23:33.328141 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835126    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 15:23:33.328141 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835130    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 15:23:33.328141 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835134    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 15:23:33.328141 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835137    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 15:23:33.328141 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835141    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 15:23:33.328724 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835145    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 15:23:33.328724 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835149    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 15:23:33.328724 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835153    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 15:23:33.328724 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835158    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 15:23:33.328724 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835162    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 15:23:33.328724 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835168    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 15:23:33.328724 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835173    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 15:23:33.328724 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835178    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 15:23:33.328724 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835182    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 15:23:33.328724 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835187    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 15:23:33.328724 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835191    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 15:23:33.328724 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835194    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 15:23:33.328724 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835198    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 15:23:33.328724 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835203    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 15:23:33.328724 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835206    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 15:23:33.328724 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835210    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 15:23:33.328724 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835216    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 15:23:33.328724 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835220    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 15:23:33.328724 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835223    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 15:23:33.328724 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835227    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 15:23:33.329565 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835230    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 15:23:33.329565 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835234    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 15:23:33.329565 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835238    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 15:23:33.329565 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835242    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 15:23:33.329565 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835247    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 15:23:33.329565 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835251    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 15:23:33.329565 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835254    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 15:23:33.329565 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835257    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 15:23:33.329565 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835259    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 15:23:33.329565 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835262    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 15:23:33.329565 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835265    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 15:23:33.329565 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835267    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 15:23:33.329565 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835270    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 15:23:33.329565 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835273    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 15:23:33.329565 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835275    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 15:23:33.329565 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835278    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 15:23:33.329565 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835282    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 15:23:33.329565 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835284    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 15:23:33.329565 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835287    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 15:23:33.329565 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835289    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 15:23:33.330131 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.835294    2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 15:23:33.330131 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835404    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 15:23:33.330131 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835410    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 15:23:33.330131 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835413    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 15:23:33.330131 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835416    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 15:23:33.330131 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835419    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 15:23:33.330131 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835422    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 15:23:33.330131 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835425    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 15:23:33.330131 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835429    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 15:23:33.330131 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835452    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 15:23:33.330131 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835458    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 15:23:33.330131 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835463    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 15:23:33.330131 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835469    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 15:23:33.330131 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835473    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 15:23:33.569060 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835478    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 15:23:33.569060 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835482    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 15:23:33.569060 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835487    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 15:23:33.569060 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835493    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 15:23:33.569060 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835497    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 15:23:33.569060 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835501    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 15:23:33.569060 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835505    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 15:23:33.569060 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835508    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 15:23:33.569060 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835512    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 15:23:33.569060 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835517    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 15:23:33.569060 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835521    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 15:23:33.569060 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835525    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 15:23:33.569060 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835529    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 15:23:33.569060 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835532    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 15:23:33.569060 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835536    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 15:23:33.569060 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835541    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 15:23:33.569060 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835545    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 15:23:33.569060 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835549    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 15:23:33.569060 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835552    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 15:23:33.569060 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835556    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 15:23:33.570392 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835560    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 15:23:33.570392 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835564    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 15:23:33.570392 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835568    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 15:23:33.570392 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835572    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 15:23:33.570392 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835575    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 15:23:33.570392 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835579    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 15:23:33.570392 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835584    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 15:23:33.570392 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835588    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 15:23:33.570392 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835592    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 15:23:33.570392 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835595    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 15:23:33.570392 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835599    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 15:23:33.570392 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835603    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 15:23:33.570392 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835606    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 15:23:33.570392 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835610    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 15:23:33.570392 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835614    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 15:23:33.570392 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835619    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 15:23:33.570392 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835623    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 15:23:33.570392 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835627    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 15:23:33.570392 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835630    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 15:23:33.570392 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835634    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 15:23:33.570966 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835638    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 15:23:33.570966 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835642    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 15:23:33.570966 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835645    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 15:23:33.570966 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835649    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 15:23:33.570966 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835653    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 15:23:33.570966 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835657    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 15:23:33.570966 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835660    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 15:23:33.570966 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835665    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 15:23:33.570966 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835669    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 15:23:33.570966 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835675    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 15:23:33.570966 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835680    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 15:23:33.570966 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835682    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 15:23:33.570966 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835685    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 15:23:33.570966 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835689    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 15:23:33.570966 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835693    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 15:23:33.570966 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835697    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 15:23:33.570966 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835701    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 15:23:33.570966 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835705    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 15:23:33.570966 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835712    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 15:23:33.570966 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835716    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 15:23:33.571575 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835720    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 15:23:33.571575 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835723    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 15:23:33.571575 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835727    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 15:23:33.571575 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835730    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 15:23:33.571575 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835734    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 15:23:33.571575 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835738    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 15:23:33.571575 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835742    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 15:23:33.571575 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835747    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 15:23:33.571575 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835750    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 15:23:33.571575 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835755    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 15:23:33.571575 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835758    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 15:23:33.571575 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835762    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 15:23:33.571575 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835766    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 15:23:33.571575 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835770    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 15:23:33.571575 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835773    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 15:23:33.571575 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835777    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 15:23:33.571575 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835781    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 15:23:33.571575 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835784    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 15:23:33.571575 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835788    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 15:23:33.571575 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835792    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 15:23:33.572102 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835796    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 15:23:33.572102 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835800    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 15:23:33.572102 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835804    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 15:23:33.572102 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835807    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 15:23:33.572102 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835811    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 15:23:33.572102 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:32.835815    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 15:23:33.572102 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.835821    2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 15:23:33.572102 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.835953    2555 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 13 15:23:33.572102 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.839416    2555 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 13 15:23:33.572102 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.841191    2555 server.go:1019] "Starting client certificate rotation"
Jul 13 15:23:33.572102 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.841292    2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 13 15:23:33.572102 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.841325    2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 13 15:23:33.572102 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.844065    2555 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 13 15:23:33.572516 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.845206    2555 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 13 15:23:33.572516 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.859455    2555 log.go:25] "Validated CRI v1 runtime API"
Jul 13 15:23:33.572516 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.862448    2555 log.go:25] "Validated CRI v1 image API"
Jul 13 15:23:33.572516 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.863469    2555 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 13 15:23:33.572516 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.866226    2555 fs.go:135] Filesystem UUIDs: map[1f4a5cf1-45ac-4121-8f99-777922336e53:/dev/nvme0n1p3 784f20de-7731-4ef2-a45a-9bfb59635175:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 13 15:23:33.572516 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.866243    2555 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 13 15:23:33.572789 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.870961    2555 manager.go:216] Machine: {Timestamp:2026-07-13 15:23:32.870412745 +0000 UTC m=+0.377286157 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3089084 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec236618ae372e48908837ce8b41fb95 SystemUUID:ec236618-ae37-2e48-9088-37ce8b41fb95 BootID:8fdefb0f-f3bc-46c9-87e6-46e67e034ac7 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:63:bb:3e:71:db Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:63:bb:3e:71:db Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d6:25:73:e4:d7:66 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 13 15:23:33.572789 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.871070    2555 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 13 15:23:33.572789 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.871161    2555 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 13 15:23:33.572789 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.874555    2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 13 15:23:33.572789 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.875111    2555 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 13 15:23:33.572789 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.875143    2555 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-93.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 13 15:23:33.572789 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.875992    2555 topology_manager.go:138] "Creating topology manager with none policy"
Jul 13 15:23:33.572789 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.876003    2555 container_manager_linux.go:309] "Creating device plugin manager"
Jul 13 15:23:33.572789 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.876011    2555 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 13 15:23:33.572789 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.876858    2555 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 13 15:23:33.572789 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.878796    2555 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 13 15:23:33.572789 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.883821    2555 state_mem.go:36] "Initialized new in-memory state store"
Jul 13 15:23:33.572789 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.883960    2555 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 13 15:23:33.572789 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.883992    2555 kubelet.go:486] "Attempting to sync node with API server"
Jul 13 15:23:33.572789 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.884004    2555 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 13 15:23:33.572789 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.884019    2555 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 13 15:23:33.572789 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.884028    2555 kubelet.go:398] "Adding apiserver pod source"
Jul 13 15:23:33.573329 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.884036    2555 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 13 15:23:33.573329 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.884405    2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 13 15:23:33.573329 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.884420    2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 13 15:23:33.573329 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.887209    2555 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 13 15:23:33.573329 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.889552    2555 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 13 15:23:33.573329 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.889581    2555 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 13 15:23:33.573329 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.889757    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 13 15:23:33.573329 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.889770    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 13 15:23:33.573329 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.889784    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 13 15:23:33.573329 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.889794    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 13 15:23:33.573329 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.889806    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 13 15:23:33.573329 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.889813    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 13 15:23:33.573329 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.890380    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 13 15:23:33.573329 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.890388    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 13 15:23:33.573329 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.890394    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 13 15:23:33.573329 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.890400    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 13 15:23:33.573329 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.890418    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 13 15:23:33.573329 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.890426    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 13 15:23:33.573329 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.891380    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 13 15:23:33.573329 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.891387    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 13 15:23:33.573329 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.894658    2555 server.go:1268] "Started kubelet"
Jul 13 15:23:33.573329 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.894867    2555 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 13 15:23:33.573329 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.894949    2555 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 13 15:23:33.573329 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.895161    2555 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 13 15:23:33.573329 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:32.896662    2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 13 15:23:33.573329 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:32.896795    2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-93.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 13 15:23:33.573329 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.896969    2555 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-93.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 13 15:23:33.573329 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.897475    2555 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 13 15:23:33.573329 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.897819    2555 server.go:310] "Adding debug handlers to kubelet server"
Jul 13 15:23:33.573329 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:32.903289    2555 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 13 15:23:33.573329 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.904852    2555 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 13 15:23:33.573329 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.904863    2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 13 15:23:33.573329 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:32.904975    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-93.ec2.internal\" not found"
Jul 13 15:23:33.573329 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:32.904360    2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-93.ec2.internal.18c1e2b94c6f8772  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-93.ec2.internal,UID:ip-10-0-137-93.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-93.ec2.internal,},FirstTimestamp:2026-07-13 15:23:32.894631794 +0000 UTC m=+0.401505207,LastTimestamp:2026-07-13 15:23:32.894631794 +0000 UTC m=+0.401505207,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-93.ec2.internal,}"
Jul 13 15:23:33.573329 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.905633    2555 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 13 15:23:33.573329 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.905645    2555 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 13 15:23:33.573329 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.905664    2555 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 13 15:23:33.573329 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.905748    2555 reconstruct.go:97] "Volume reconstruction finished"
Jul 13 15:23:33.573329 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.905758    2555 reconciler.go:29] "Reconciler: start to sync state"
Jul 13 15:23:33.573329 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.905759    2555 factory.go:55] Registering systemd factory
Jul 13 15:23:33.573329 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.905776    2555 factory.go:223] Registration of the systemd container factory successfully
Jul 13 15:23:33.574511 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.906010    2555 factory.go:153] Registering CRI-O factory
Jul 13 15:23:33.574511 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.906024    2555 factory.go:223] Registration of the crio container factory successfully
Jul 13 15:23:33.574511 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.906077    2555 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 13 15:23:33.574511 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.906099    2555 factory.go:103] Registering Raw factory
Jul 13 15:23:33.574511 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.906123    2555 manager.go:1196] Started watching for new ooms in manager
Jul 13 15:23:33.574511 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.906645    2555 manager.go:349] Starting recovery of all containers
Jul 13 15:23:33.574511 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:32.908674    2555 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-93.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 13 15:23:33.574511 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:32.908761    2555 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 13 15:23:33.574511 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.916293    2555 manager.go:354] Recovery completed
Jul 13 15:23:33.574511 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.921110    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 15:23:33.574511 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.922788    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 15:23:33.574511 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.922819    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 15:23:33.574511 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.922833    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientPID"
Jul 13 15:23:33.574511 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.923320    2555 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 13 15:23:33.574511 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.923328    2555 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 13 15:23:33.574511 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.923343    2555 state_mem.go:36] "Initialized new in-memory state store"
Jul 13 15:23:33.574511 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.923374    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 15:23:33.574511 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.924066    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 15:23:33.574511 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.924089    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 15:23:33.574511 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.924099    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientPID"
Jul 13 15:23:33.574511 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:32.925002    2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-93.ec2.internal.18c1e2b94e1d5c22  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-93.ec2.internal,UID:ip-10-0-137-93.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-93.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-93.ec2.internal,},FirstTimestamp:2026-07-13 15:23:32.922801186 +0000 UTC m=+0.429674598,LastTimestamp:2026-07-13 15:23:32.922801186 +0000 UTC m=+0.429674598,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-93.ec2.internal,}"
Jul 13 15:23:33.574511 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.925646    2555 policy_none.go:49] "None policy: Start"
Jul 13 15:23:33.574511 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.925659    2555 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 13 15:23:33.574511 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.925669    2555 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 13 15:23:33.574511 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.928164    2555 policy_none.go:47] "Start"
Jul 13 15:23:33.574511 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:32.933297    2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-93.ec2.internal.18c1e2b94e1dc097  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-93.ec2.internal,UID:ip-10-0-137-93.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-93.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-93.ec2.internal,},FirstTimestamp:2026-07-13 15:23:32.922826903 +0000 UTC m=+0.429700316,LastTimestamp:2026-07-13 15:23:32.922826903 +0000 UTC m=+0.429700316,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-93.ec2.internal,}"
Jul 13 15:23:33.574511 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.937726    2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nc62m"
Jul 13 15:23:33.574511 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.945109    2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nc62m"
Jul 13 15:23:33.575278 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:32.947379    2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-93.ec2.internal.18c1e2b94e1de90f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-93.ec2.internal,UID:ip-10-0-137-93.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-137-93.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-137-93.ec2.internal,},FirstTimestamp:2026-07-13 15:23:32.922837263 +0000 UTC m=+0.429710676,LastTimestamp:2026-07-13 15:23:32.922837263 +0000 UTC m=+0.429710676,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-93.ec2.internal,}"
Jul 13 15:23:33.575278 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.986128    2555 manager.go:337] "Starting Device Plugin manager"
Jul 13 15:23:33.575278 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:32.986359    2555 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 13 15:23:33.575278 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.986374    2555 server.go:87] "Starting device plugin registration server"
Jul 13 15:23:33.575278 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.986596    2555 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 13 15:23:33.575278 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.986606    2555 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 13 15:23:33.575278 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.986701    2555 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 13 15:23:33.575278 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.986811    2555 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 13 15:23:33.575278 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:32.986821    2555 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 13 15:23:33.575278 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:32.987310    2555 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 13 15:23:33.575278 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:32.987357    2555 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-93.ec2.internal\" not found"
Jul 13 15:23:33.575278 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:33.012987    2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 13 15:23:33.575278 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:33.014239    2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 13 15:23:33.575278 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:33.014282    2555 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 13 15:23:33.575278 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:33.014313    2555 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 13 15:23:33.575278 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:33.014359    2555 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 13 15:23:33.575278 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:33.017098    2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 15:23:33.575278 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:33.087423    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 15:23:33.575278 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:33.089967    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 15:23:33.575278 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:33.089996    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 15:23:33.575278 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:33.090007    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientPID"
Jul 13 15:23:33.575278 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:33.090033    2555 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-93.ec2.internal"
Jul 13 15:23:33.575278 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:33.100879    2555 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-93.ec2.internal"
Jul 13 15:23:33.575278 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:33.100901    2555 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-93.ec2.internal\": node \"ip-10-0-137-93.ec2.internal\" not found"
Jul 13 15:23:33.575278 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:33.114680    2555 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-93.ec2.internal"]
Jul 13 15:23:33.575278 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:33.114743    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 15:23:33.575278 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:33.115619    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 15:23:33.575278 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:33.115649    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 15:23:33.575278 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:33.115658    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientPID"
Jul 13 15:23:33.575278 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:33.120866    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 15:23:33.575278 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:33.121037    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal"
Jul 13 15:23:33.575278 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:33.121071    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 15:23:33.575278 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:33.121707    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 15:23:33.575278 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:33.121717    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 15:23:33.575278 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:33.121739    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 15:23:33.575278 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:33.121745    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 15:23:33.575278 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:33.121752    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientPID"
Jul 13 15:23:33.576283 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:33.121758    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientPID"
Jul 13 15:23:33.576283 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:33.123908    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-93.ec2.internal"
Jul 13 15:23:33.576283 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:33.123932    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 15:23:33.576283 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:33.124615    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 15:23:33.576283 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:33.124642    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 15:23:33.576283 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:33.124656    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientPID"
Jul 13 15:23:33.576283 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:33.133707    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-93.ec2.internal\" not found"
Jul 13 15:23:33.576283 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:33.159013    2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-93.ec2.internal\" not found" node="ip-10-0-137-93.ec2.internal"
Jul 13 15:23:33.576283 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:33.165262    2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-93.ec2.internal\" not found" node="ip-10-0-137-93.ec2.internal"
Jul 13 15:23:33.576283 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:33.208630    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/be909fcc1006eb3f5b3a01699bb59d5e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal\" (UID: \"be909fcc1006eb3f5b3a01699bb59d5e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal"
Jul 13 15:23:33.576283 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:33.208662    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be909fcc1006eb3f5b3a01699bb59d5e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal\" (UID: \"be909fcc1006eb3f5b3a01699bb59d5e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal"
Jul 13 15:23:33.576283 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:33.208686    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eda63208df358e0e9bf9d712ad8f74a0-config\") pod \"kube-apiserver-proxy-ip-10-0-137-93.ec2.internal\" (UID: \"eda63208df358e0e9bf9d712ad8f74a0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-93.ec2.internal"
Jul 13 15:23:33.576283 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:33.234704    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-93.ec2.internal\" not found"
Jul 13 15:23:33.576283 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:33.309102    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be909fcc1006eb3f5b3a01699bb59d5e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal\" (UID: \"be909fcc1006eb3f5b3a01699bb59d5e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal"
Jul 13 15:23:33.576283 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:33.309129    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eda63208df358e0e9bf9d712ad8f74a0-config\") pod \"kube-apiserver-proxy-ip-10-0-137-93.ec2.internal\" (UID: \"eda63208df358e0e9bf9d712ad8f74a0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-93.ec2.internal"
Jul 13 15:23:33.576283 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:33.309145    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/be909fcc1006eb3f5b3a01699bb59d5e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal\" (UID: \"be909fcc1006eb3f5b3a01699bb59d5e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal"
Jul 13 15:23:33.576283 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:33.309191    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/be909fcc1006eb3f5b3a01699bb59d5e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal\" (UID: \"be909fcc1006eb3f5b3a01699bb59d5e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal"
Jul 13 15:23:33.576283 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:33.309221    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be909fcc1006eb3f5b3a01699bb59d5e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal\" (UID: \"be909fcc1006eb3f5b3a01699bb59d5e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal"
Jul 13 15:23:33.576283 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:33.309221    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eda63208df358e0e9bf9d712ad8f74a0-config\") pod \"kube-apiserver-proxy-ip-10-0-137-93.ec2.internal\" (UID: \"eda63208df358e0e9bf9d712ad8f74a0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-93.ec2.internal"
Jul 13 15:23:33.576283 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:33.335212    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-93.ec2.internal\" not found"
Jul 13 15:23:33.576283 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:33.435951    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-93.ec2.internal\" not found"
Jul 13 15:23:33.576283 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:33.461151    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal"
Jul 13 15:23:33.576283 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:33.468156    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-93.ec2.internal"
Jul 13 15:23:33.576283 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:33.536997    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-93.ec2.internal\" not found"
Jul 13 15:23:35.042999 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:34.819700    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-93.ec2.internal\" not found"
Jul 13 15:23:35.042999 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:34.920301    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-93.ec2.internal\" not found"
Jul 13 15:23:35.042999 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:34.940165    2555 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 15:23:35.042999 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:35.020943    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-93.ec2.internal\" not found"
Jul 13 15:23:35.042999 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:35.022029    2555 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 13 15:23:35.042999 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:35.022192    2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 13 15:23:35.042999 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:35.022216    2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 13 15:23:35.183514 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:35.121530    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-93.ec2.internal\" not found"
Jul 13 15:23:35.183514 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:35.133559    2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-12 15:18:34 +0000 UTC" deadline="2028-03-01 23:37:45.197133172 +0000 UTC"
Jul 13 15:23:35.183514 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:35.134101    2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14336h14m10.06303576s"
Jul 13 15:23:35.455757 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:35.221650    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-93.ec2.internal\" not found"
Jul 13 15:23:35.455757 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:35.222083    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe909fcc1006eb3f5b3a01699bb59d5e.slice/crio-4763d72c08e7099daf6b629a06a094b1c3d7b741fd48071d2f72971301617da7 WatchSource:0}: Error finding container 4763d72c08e7099daf6b629a06a094b1c3d7b741fd48071d2f72971301617da7: Status 404 returned error can't find the container with id 4763d72c08e7099daf6b629a06a094b1c3d7b741fd48071d2f72971301617da7
Jul 13 15:23:35.455757 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:35.222701    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeda63208df358e0e9bf9d712ad8f74a0.slice/crio-6b1e60dd91ca2b0886d131e61ee05e7fdcc86426a647e9167642a485653f6463 WatchSource:0}: Error finding container 6b1e60dd91ca2b0886d131e61ee05e7fdcc86426a647e9167642a485653f6463: Status 404 returned error can't find the container with id 6b1e60dd91ca2b0886d131e61ee05e7fdcc86426a647e9167642a485653f6463
Jul 13 15:23:35.455757 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:35.226675    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 15:23:35.455757 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:35.253478    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 15:23:35.455757 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:35.255046    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 15:23:35.455757 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:35.255074    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 15:23:35.455757 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:35.255084    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeHasSufficientPID"
Jul 13 15:23:35.455757 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:35.276004    2555 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 15:23:35.455757 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:35.303247    2555 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 15:23:35.455757 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:35.387625    2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal"
Jul 13 15:23:35.455757 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:35.404103    2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 13 15:23:35.455757 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:35.405008    2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-93.ec2.internal"
Jul 13 15:23:35.455757 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:35.418990    2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 13 15:23:36.082292 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.068142    2555 apiserver.go:52] "Watching apiserver"
Jul 13 15:23:36.082292 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.076115    2555 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 13 15:23:36.082292 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.076611    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-vjmns","openshift-network-diagnostics/network-check-target-jfg9j","openshift-network-operator/iptables-alerter-qjpll","openshift-ovn-kubernetes/ovnkube-node-x8g52","kube-system/global-pull-secret-syncer-hdgtx","kube-system/konnectivity-agent-474qm","kube-system/kube-apiserver-proxy-ip-10-0-137-93.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbfjb","openshift-cluster-node-tuning-operator/tuned-9zjxw","openshift-dns/node-resolver-msf42","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal","openshift-multus/network-metrics-daemon-5bv64","openshift-image-registry/node-ca-gndtt","openshift-multus/multus-82fdm"]
Jul 13 15:23:36.082292 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.079344    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-msf42"
Jul 13 15:23:36.164012 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.086088    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 13 15:23:36.164012 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.086162    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 13 15:23:36.164012 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.086414    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gndtt"
Jul 13 15:23:36.164012 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.088421    2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 13 15:23:36.164012 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.088929    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-km94k\""
Jul 13 15:23:36.164012 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.091085    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 13 15:23:36.164012 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.091392    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lkpzc\""
Jul 13 15:23:36.164012 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.091392    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 13 15:23:36.164012 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.092778    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qjpll"
Jul 13 15:23:36.164012 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.093166    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 13 15:23:36.164012 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.094964    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.164012 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.095140    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 13 15:23:36.164012 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.095412    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pd4m2\""
Jul 13 15:23:36.164012 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.095679    2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 15:23:36.164012 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.095890    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 13 15:23:36.164012 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.095927    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 13 15:23:36.164012 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.097269    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hdgtx"
Jul 13 15:23:36.164012 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:36.097369    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hdgtx" podUID="1f78133a-9d4f-47fb-8253-2220a6139ab9"
Jul 13 15:23:36.164012 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.097858    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 13 15:23:36.164012 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.097858    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-64glw\""
Jul 13 15:23:36.164012 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.098915    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 13 15:23:36.164012 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.099117    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 13 15:23:36.164012 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.099162    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 13 15:23:36.164012 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.099174    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 13 15:23:36.164012 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.099326    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 13 15:23:36.164012 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.099463    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9ede2cce-055c-4a8d-a4f2-aaed0d7c818d-hosts-file\") pod \"node-resolver-msf42\" (UID: \"9ede2cce-055c-4a8d-a4f2-aaed0d7c818d\") " pod="openshift-dns/node-resolver-msf42"
Jul 13 15:23:36.164012 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.099497    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ede2cce-055c-4a8d-a4f2-aaed0d7c818d-tmp-dir\") pod \"node-resolver-msf42\" (UID: \"9ede2cce-055c-4a8d-a4f2-aaed0d7c818d\") " pod="openshift-dns/node-resolver-msf42"
Jul 13 15:23:36.164012 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.099552    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzkmr\" (UniqueName: \"kubernetes.io/projected/9ede2cce-055c-4a8d-a4f2-aaed0d7c818d-kube-api-access-gzkmr\") pod \"node-resolver-msf42\" (UID: \"9ede2cce-055c-4a8d-a4f2-aaed0d7c818d\") " pod="openshift-dns/node-resolver-msf42"
Jul 13 15:23:36.164012 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.099578    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0d9e5461-c76c-4666-92dd-6c8eadd6b6d7-serviceca\") pod \"node-ca-gndtt\" (UID: \"0d9e5461-c76c-4666-92dd-6c8eadd6b6d7\") " pod="openshift-image-registry/node-ca-gndtt"
Jul 13 15:23:36.164012 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.099618    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4tg5\" (UniqueName: \"kubernetes.io/projected/0d9e5461-c76c-4666-92dd-6c8eadd6b6d7-kube-api-access-v4tg5\") pod \"node-ca-gndtt\" (UID: \"0d9e5461-c76c-4666-92dd-6c8eadd6b6d7\") " pod="openshift-image-registry/node-ca-gndtt"
Jul 13 15:23:36.165955 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.099639    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0d9e5461-c76c-4666-92dd-6c8eadd6b6d7-host\") pod \"node-ca-gndtt\" (UID: \"0d9e5461-c76c-4666-92dd-6c8eadd6b6d7\") " pod="openshift-image-registry/node-ca-gndtt"
Jul 13 15:23:36.165955 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.099680    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4f2ad453-3791-4e3a-9f4a-66ebbb2b5891-iptables-alerter-script\") pod \"iptables-alerter-qjpll\" (UID: \"4f2ad453-3791-4e3a-9f4a-66ebbb2b5891\") " pod="openshift-network-operator/iptables-alerter-qjpll"
Jul 13 15:23:36.165955 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.099712    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4f2ad453-3791-4e3a-9f4a-66ebbb2b5891-host-slash\") pod \"iptables-alerter-qjpll\" (UID: \"4f2ad453-3791-4e3a-9f4a-66ebbb2b5891\") " pod="openshift-network-operator/iptables-alerter-qjpll"
Jul 13 15:23:36.165955 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.099738    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrnzk\" (UniqueName: \"kubernetes.io/projected/4f2ad453-3791-4e3a-9f4a-66ebbb2b5891-kube-api-access-vrnzk\") pod \"iptables-alerter-qjpll\" (UID: \"4f2ad453-3791-4e3a-9f4a-66ebbb2b5891\") " pod="openshift-network-operator/iptables-alerter-qjpll"
Jul 13 15:23:36.165955 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.100731    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-474qm"
Jul 13 15:23:36.165955 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.102938    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 13 15:23:36.165955 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.102985    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 13 15:23:36.165955 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.103144    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9mdmd\""
Jul 13 15:23:36.165955 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.103500    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9zjxw"
Jul 13 15:23:36.165955 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.106023    2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 13 15:23:36.165955 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.106187    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 13 15:23:36.165955 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.106245    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mn9k5\""
Jul 13 15:23:36.165955 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.107474    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 13 15:23:36.165955 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.108069    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.165955 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.110311    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 13 15:23:36.165955 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.110676    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 13 15:23:36.165955 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.110971    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 13 15:23:36.165955 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.111176    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 13 15:23:36.165955 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.111381    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xt9r9\""
Jul 13 15:23:36.165955 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.113114    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfg9j"
Jul 13 15:23:36.165955 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:36.113187    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfg9j" podUID="d349b31c-c0a7-4dfb-b91d-62e55ef016b6"
Jul 13 15:23:36.165955 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.115101    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vjmns"
Jul 13 15:23:36.165955 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.117399    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-d69xj\""
Jul 13 15:23:36.165955 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.117461    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 13 15:23:36.165955 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.117647    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 13 15:23:36.165955 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.118459    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbfjb"
Jul 13 15:23:36.165955 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.120620    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 13 15:23:36.165955 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.120895    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bv64"
Jul 13 15:23:36.165955 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.120914    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bbsfr\""
Jul 13 15:23:36.167533 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:36.120957    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bv64" podUID="d500cafe-37f3-4c98-8bef-63ba985b79fa"
Jul 13 15:23:36.167533 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.121060    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 13 15:23:36.167533 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.121224    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 13 15:23:36.167533 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.136702    2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8fhrj"
Jul 13 15:23:36.167533 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.146729    2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8fhrj"
Jul 13 15:23:36.309366 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.189039    2555 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 13 15:23:36.309366 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.201100    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ede2cce-055c-4a8d-a4f2-aaed0d7c818d-tmp-dir\") pod \"node-resolver-msf42\" (UID: \"9ede2cce-055c-4a8d-a4f2-aaed0d7c818d\") " pod="openshift-dns/node-resolver-msf42"
Jul 13 15:23:36.309366 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.201136    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzkmr\" (UniqueName: \"kubernetes.io/projected/9ede2cce-055c-4a8d-a4f2-aaed0d7c818d-kube-api-access-gzkmr\") pod \"node-resolver-msf42\" (UID: \"9ede2cce-055c-4a8d-a4f2-aaed0d7c818d\") " pod="openshift-dns/node-resolver-msf42"
Jul 13 15:23:36.309366 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.201172    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-host-kubelet\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.309366 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.201201    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-host-run-netns\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.309366 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.201238    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-host-cni-netd\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.309366 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.201267    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/77127f7b-f478-42a2-9972-255956e53070-multus-daemon-config\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.309366 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.201291    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f78133a-9d4f-47fb-8253-2220a6139ab9-original-pull-secret\") pod \"global-pull-secret-syncer-hdgtx\" (UID: \"1f78133a-9d4f-47fb-8253-2220a6139ab9\") " pod="kube-system/global-pull-secret-syncer-hdgtx"
Jul 13 15:23:36.309366 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.201321    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebcda597-80a9-4a20-99fc-0e254e2cb977-etc-kubernetes\") pod \"tuned-9zjxw\" (UID: \"ebcda597-80a9-4a20-99fc-0e254e2cb977\") " pod="openshift-cluster-node-tuning-operator/tuned-9zjxw"
Jul 13 15:23:36.309366 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.201350    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ebcda597-80a9-4a20-99fc-0e254e2cb977-etc-sysctl-d\") pod \"tuned-9zjxw\" (UID: \"ebcda597-80a9-4a20-99fc-0e254e2cb977\") " pod="openshift-cluster-node-tuning-operator/tuned-9zjxw"
Jul 13 15:23:36.309366 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.201390    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4tg5\" (UniqueName: \"kubernetes.io/projected/0d9e5461-c76c-4666-92dd-6c8eadd6b6d7-kube-api-access-v4tg5\") pod \"node-ca-gndtt\" (UID: \"0d9e5461-c76c-4666-92dd-6c8eadd6b6d7\") " pod="openshift-image-registry/node-ca-gndtt"
Jul 13 15:23:36.309366 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.201436    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4f2ad453-3791-4e3a-9f4a-66ebbb2b5891-host-slash\") pod \"iptables-alerter-qjpll\" (UID: \"4f2ad453-3791-4e3a-9f4a-66ebbb2b5891\") " pod="openshift-network-operator/iptables-alerter-qjpll"
Jul 13 15:23:36.309366 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.201463    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebcda597-80a9-4a20-99fc-0e254e2cb977-var-lib-kubelet\") pod \"tuned-9zjxw\" (UID: \"ebcda597-80a9-4a20-99fc-0e254e2cb977\") " pod="openshift-cluster-node-tuning-operator/tuned-9zjxw"
Jul 13 15:23:36.309366 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.201502    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/05b20951-a055-47c0-b70a-780e99535ad1-socket-dir\") pod \"aws-ebs-csi-driver-node-kbfjb\" (UID: \"05b20951-a055-47c0-b70a-780e99535ad1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbfjb"
Jul 13 15:23:36.309366 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.201535    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrnzk\" (UniqueName: \"kubernetes.io/projected/4f2ad453-3791-4e3a-9f4a-66ebbb2b5891-kube-api-access-vrnzk\") pod \"iptables-alerter-qjpll\" (UID: \"4f2ad453-3791-4e3a-9f4a-66ebbb2b5891\") " pod="openshift-network-operator/iptables-alerter-qjpll"
Jul 13 15:23:36.309366 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.201577    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ebcda597-80a9-4a20-99fc-0e254e2cb977-lib-modules\") pod \"tuned-9zjxw\" (UID: \"ebcda597-80a9-4a20-99fc-0e254e2cb977\") " pod="openshift-cluster-node-tuning-operator/tuned-9zjxw"
Jul 13 15:23:36.309366 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.201631    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/25a82f60-2fa2-49cb-b7fc-84496432841f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vjmns\" (UID: \"25a82f60-2fa2-49cb-b7fc-84496432841f\") " pod="openshift-multus/multus-additional-cni-plugins-vjmns"
Jul 13 15:23:36.311019 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.201655    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/05b20951-a055-47c0-b70a-780e99535ad1-device-dir\") pod \"aws-ebs-csi-driver-node-kbfjb\" (UID: \"05b20951-a055-47c0-b70a-780e99535ad1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbfjb"
Jul 13 15:23:36.311019 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.201698    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqhxh\" (UniqueName: \"kubernetes.io/projected/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-kube-api-access-bqhxh\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.311019 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.201733    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/77127f7b-f478-42a2-9972-255956e53070-multus-cni-dir\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.311019 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.201759    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/77127f7b-f478-42a2-9972-255956e53070-host-var-lib-cni-bin\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.311019 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.201786    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/77127f7b-f478-42a2-9972-255956e53070-host-var-lib-kubelet\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.311019 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.201823    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/18dbbb96-8987-4ae8-bdf7-1ecee7120b97-agent-certs\") pod \"konnectivity-agent-474qm\" (UID: \"18dbbb96-8987-4ae8-bdf7-1ecee7120b97\") " pod="kube-system/konnectivity-agent-474qm"
Jul 13 15:23:36.311019 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.201848    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0d9e5461-c76c-4666-92dd-6c8eadd6b6d7-host\") pod \"node-ca-gndtt\" (UID: \"0d9e5461-c76c-4666-92dd-6c8eadd6b6d7\") " pod="openshift-image-registry/node-ca-gndtt"
Jul 13 15:23:36.311019 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.201876    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ebcda597-80a9-4a20-99fc-0e254e2cb977-etc-modprobe-d\") pod \"tuned-9zjxw\" (UID: \"ebcda597-80a9-4a20-99fc-0e254e2cb977\") " pod="openshift-cluster-node-tuning-operator/tuned-9zjxw"
Jul 13 15:23:36.311019 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.201915    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/05b20951-a055-47c0-b70a-780e99535ad1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kbfjb\" (UID: \"05b20951-a055-47c0-b70a-780e99535ad1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbfjb"
Jul 13 15:23:36.311019 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.201953    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/05b20951-a055-47c0-b70a-780e99535ad1-etc-selinux\") pod \"aws-ebs-csi-driver-node-kbfjb\" (UID: \"05b20951-a055-47c0-b70a-780e99535ad1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbfjb"
Jul 13 15:23:36.311019 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.202038    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d500cafe-37f3-4c98-8bef-63ba985b79fa-metrics-certs\") pod \"network-metrics-daemon-5bv64\" (UID: \"d500cafe-37f3-4c98-8bef-63ba985b79fa\") " pod="openshift-multus/network-metrics-daemon-5bv64"
Jul 13 15:23:36.311019 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.202064    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-run-openvswitch\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.311019 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.202092    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-host-cni-bin\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.311019 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.202120    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/77127f7b-f478-42a2-9972-255956e53070-host-run-k8s-cni-cncf-io\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.311019 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.202164    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ebcda597-80a9-4a20-99fc-0e254e2cb977-etc-systemd\") pod \"tuned-9zjxw\" (UID: \"ebcda597-80a9-4a20-99fc-0e254e2cb977\") " pod="openshift-cluster-node-tuning-operator/tuned-9zjxw"
Jul 13 15:23:36.311019 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.202193    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ebcda597-80a9-4a20-99fc-0e254e2cb977-run\") pod \"tuned-9zjxw\" (UID: \"ebcda597-80a9-4a20-99fc-0e254e2cb977\") " pod="openshift-cluster-node-tuning-operator/tuned-9zjxw"
Jul 13 15:23:36.311019 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.202219    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ebcda597-80a9-4a20-99fc-0e254e2cb977-host\") pod \"tuned-9zjxw\" (UID: \"ebcda597-80a9-4a20-99fc-0e254e2cb977\") " pod="openshift-cluster-node-tuning-operator/tuned-9zjxw"
Jul 13 15:23:36.314420 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.202247    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcx47\" (UniqueName: \"kubernetes.io/projected/05b20951-a055-47c0-b70a-780e99535ad1-kube-api-access-rcx47\") pod \"aws-ebs-csi-driver-node-kbfjb\" (UID: \"05b20951-a055-47c0-b70a-780e99535ad1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbfjb"
Jul 13 15:23:36.314420 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.202311    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-run-systemd\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.314420 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.202337    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-run-ovn\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.314420 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.202364    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-node-log\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.314420 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.202390    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-host-run-ovn-kubernetes\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.314420 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.202434    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/25a82f60-2fa2-49cb-b7fc-84496432841f-system-cni-dir\") pod \"multus-additional-cni-plugins-vjmns\" (UID: \"25a82f60-2fa2-49cb-b7fc-84496432841f\") " pod="openshift-multus/multus-additional-cni-plugins-vjmns"
Jul 13 15:23:36.314420 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.202476    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/25a82f60-2fa2-49cb-b7fc-84496432841f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vjmns\" (UID: \"25a82f60-2fa2-49cb-b7fc-84496432841f\") " pod="openshift-multus/multus-additional-cni-plugins-vjmns"
Jul 13 15:23:36.314420 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.202514    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r2vx\" (UniqueName: \"kubernetes.io/projected/d500cafe-37f3-4c98-8bef-63ba985b79fa-kube-api-access-9r2vx\") pod \"network-metrics-daemon-5bv64\" (UID: \"d500cafe-37f3-4c98-8bef-63ba985b79fa\") " pod="openshift-multus/network-metrics-daemon-5bv64"
Jul 13 15:23:36.314420 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.202542    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-host-slash\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.314420 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.202648    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/77127f7b-f478-42a2-9972-255956e53070-system-cni-dir\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.314420 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.202702    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/77127f7b-f478-42a2-9972-255956e53070-host-run-netns\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.314420 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.202748    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1f78133a-9d4f-47fb-8253-2220a6139ab9-kubelet-config\") pod \"global-pull-secret-syncer-hdgtx\" (UID: \"1f78133a-9d4f-47fb-8253-2220a6139ab9\") " pod="kube-system/global-pull-secret-syncer-hdgtx"
Jul 13 15:23:36.314420 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.202780    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0d9e5461-c76c-4666-92dd-6c8eadd6b6d7-serviceca\") pod \"node-ca-gndtt\" (UID: \"0d9e5461-c76c-4666-92dd-6c8eadd6b6d7\") " pod="openshift-image-registry/node-ca-gndtt"
Jul 13 15:23:36.314420 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.202816    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/25a82f60-2fa2-49cb-b7fc-84496432841f-cnibin\") pod \"multus-additional-cni-plugins-vjmns\" (UID: \"25a82f60-2fa2-49cb-b7fc-84496432841f\") " pod="openshift-multus/multus-additional-cni-plugins-vjmns"
Jul 13 15:23:36.314420 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.202862    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/25a82f60-2fa2-49cb-b7fc-84496432841f-os-release\") pod \"multus-additional-cni-plugins-vjmns\" (UID: \"25a82f60-2fa2-49cb-b7fc-84496432841f\") " pod="openshift-multus/multus-additional-cni-plugins-vjmns"
Jul 13 15:23:36.314420 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.202902    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfkl7\" (UniqueName: \"kubernetes.io/projected/25a82f60-2fa2-49cb-b7fc-84496432841f-kube-api-access-kfkl7\") pod \"multus-additional-cni-plugins-vjmns\" (UID: \"25a82f60-2fa2-49cb-b7fc-84496432841f\") " pod="openshift-multus/multus-additional-cni-plugins-vjmns"
Jul 13 15:23:36.315423 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.202950    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/77127f7b-f478-42a2-9972-255956e53070-cnibin\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.315423 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.203057    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4f2ad453-3791-4e3a-9f4a-66ebbb2b5891-host-slash\") pod \"iptables-alerter-qjpll\" (UID: \"4f2ad453-3791-4e3a-9f4a-66ebbb2b5891\") " pod="openshift-network-operator/iptables-alerter-qjpll"
Jul 13 15:23:36.315423 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.203464    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/77127f7b-f478-42a2-9972-255956e53070-multus-conf-dir\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.315423 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.203556    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0d9e5461-c76c-4666-92dd-6c8eadd6b6d7-host\") pod \"node-ca-gndtt\" (UID: \"0d9e5461-c76c-4666-92dd-6c8eadd6b6d7\") " pod="openshift-image-registry/node-ca-gndtt"
Jul 13 15:23:36.315423 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.203922    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ede2cce-055c-4a8d-a4f2-aaed0d7c818d-tmp-dir\") pod \"node-resolver-msf42\" (UID: \"9ede2cce-055c-4a8d-a4f2-aaed0d7c818d\") " pod="openshift-dns/node-resolver-msf42"
Jul 13 15:23:36.315423 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.204218    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5c6d\" (UniqueName: \"kubernetes.io/projected/d349b31c-c0a7-4dfb-b91d-62e55ef016b6-kube-api-access-b5c6d\") pod \"network-check-target-jfg9j\" (UID: \"d349b31c-c0a7-4dfb-b91d-62e55ef016b6\") " pod="openshift-network-diagnostics/network-check-target-jfg9j"
Jul 13 15:23:36.315423 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.204436    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-systemd-units\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.315423 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.204511    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.315423 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.204569    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77127f7b-f478-42a2-9972-255956e53070-etc-kubernetes\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.315423 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.204626    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ebcda597-80a9-4a20-99fc-0e254e2cb977-etc-sysconfig\") pod \"tuned-9zjxw\" (UID: \"ebcda597-80a9-4a20-99fc-0e254e2cb977\") " pod="openshift-cluster-node-tuning-operator/tuned-9zjxw"
Jul 13 15:23:36.315423 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.204657    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vkd2\" (UniqueName: \"kubernetes.io/projected/ebcda597-80a9-4a20-99fc-0e254e2cb977-kube-api-access-9vkd2\") pod \"tuned-9zjxw\" (UID: \"ebcda597-80a9-4a20-99fc-0e254e2cb977\") " pod="openshift-cluster-node-tuning-operator/tuned-9zjxw"
Jul 13 15:23:36.315423 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.204699    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-etc-openvswitch\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.315423 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.204732    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-ovnkube-config\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.315423 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.204758    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-ovn-node-metrics-cert\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.315423 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.204819    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ebcda597-80a9-4a20-99fc-0e254e2cb977-sys\") pod \"tuned-9zjxw\" (UID: \"ebcda597-80a9-4a20-99fc-0e254e2cb977\") " pod="openshift-cluster-node-tuning-operator/tuned-9zjxw"
Jul 13 15:23:36.315423 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.204944    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0d9e5461-c76c-4666-92dd-6c8eadd6b6d7-serviceca\") pod \"node-ca-gndtt\" (UID: \"0d9e5461-c76c-4666-92dd-6c8eadd6b6d7\") " pod="openshift-image-registry/node-ca-gndtt"
Jul 13 15:23:36.315423 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.205124    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ebcda597-80a9-4a20-99fc-0e254e2cb977-etc-tuned\") pod \"tuned-9zjxw\" (UID: \"ebcda597-80a9-4a20-99fc-0e254e2cb977\") " pod="openshift-cluster-node-tuning-operator/tuned-9zjxw"
Jul 13 15:23:36.318567 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.205257    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/25a82f60-2fa2-49cb-b7fc-84496432841f-cni-binary-copy\") pod \"multus-additional-cni-plugins-vjmns\" (UID: \"25a82f60-2fa2-49cb-b7fc-84496432841f\") " pod="openshift-multus/multus-additional-cni-plugins-vjmns"
Jul 13 15:23:36.318567 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.205305    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/25a82f60-2fa2-49cb-b7fc-84496432841f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vjmns\" (UID: \"25a82f60-2fa2-49cb-b7fc-84496432841f\") " pod="openshift-multus/multus-additional-cni-plugins-vjmns"
Jul 13 15:23:36.318567 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.205352    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-ovnkube-script-lib\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.318567 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.205408    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9ede2cce-055c-4a8d-a4f2-aaed0d7c818d-hosts-file\") pod \"node-resolver-msf42\" (UID: \"9ede2cce-055c-4a8d-a4f2-aaed0d7c818d\") " pod="openshift-dns/node-resolver-msf42"
Jul 13 15:23:36.318567 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.205477    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ebcda597-80a9-4a20-99fc-0e254e2cb977-etc-sysctl-conf\") pod \"tuned-9zjxw\" (UID: \"ebcda597-80a9-4a20-99fc-0e254e2cb977\") " pod="openshift-cluster-node-tuning-operator/tuned-9zjxw"
Jul 13 15:23:36.318567 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.205522    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9ede2cce-055c-4a8d-a4f2-aaed0d7c818d-hosts-file\") pod \"node-resolver-msf42\" (UID: \"9ede2cce-055c-4a8d-a4f2-aaed0d7c818d\") " pod="openshift-dns/node-resolver-msf42"
Jul 13 15:23:36.318567 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.205551    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ebcda597-80a9-4a20-99fc-0e254e2cb977-tmp\") pod \"tuned-9zjxw\" (UID: \"ebcda597-80a9-4a20-99fc-0e254e2cb977\") " pod="openshift-cluster-node-tuning-operator/tuned-9zjxw"
Jul 13 15:23:36.318567 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.205679    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-var-lib-openvswitch\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.318567 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.205731    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/18dbbb96-8987-4ae8-bdf7-1ecee7120b97-konnectivity-ca\") pod \"konnectivity-agent-474qm\" (UID: \"18dbbb96-8987-4ae8-bdf7-1ecee7120b97\") " pod="kube-system/konnectivity-agent-474qm"
Jul 13 15:23:36.318567 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.205786    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/05b20951-a055-47c0-b70a-780e99535ad1-sys-fs\") pod \"aws-ebs-csi-driver-node-kbfjb\" (UID: \"05b20951-a055-47c0-b70a-780e99535ad1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbfjb"
Jul 13 15:23:36.318567 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.205820    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/77127f7b-f478-42a2-9972-255956e53070-host-var-lib-cni-multus\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.318567 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.205852    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx8dw\" (UniqueName: \"kubernetes.io/projected/77127f7b-f478-42a2-9972-255956e53070-kube-api-access-jx8dw\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.318567 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.206271    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4f2ad453-3791-4e3a-9f4a-66ebbb2b5891-iptables-alerter-script\") pod \"iptables-alerter-qjpll\" (UID: \"4f2ad453-3791-4e3a-9f4a-66ebbb2b5891\") " pod="openshift-network-operator/iptables-alerter-qjpll"
Jul 13 15:23:36.318567 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.206310    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/77127f7b-f478-42a2-9972-255956e53070-multus-socket-dir-parent\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.318567 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.206335    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/77127f7b-f478-42a2-9972-255956e53070-hostroot\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.318567 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.206355    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/77127f7b-f478-42a2-9972-255956e53070-host-run-multus-certs\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.318567 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.206377    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1f78133a-9d4f-47fb-8253-2220a6139ab9-dbus\") pod \"global-pull-secret-syncer-hdgtx\" (UID: \"1f78133a-9d4f-47fb-8253-2220a6139ab9\") " pod="kube-system/global-pull-secret-syncer-hdgtx"
Jul 13 15:23:36.319431 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.206399    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/05b20951-a055-47c0-b70a-780e99535ad1-registration-dir\") pod \"aws-ebs-csi-driver-node-kbfjb\" (UID: \"05b20951-a055-47c0-b70a-780e99535ad1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbfjb"
Jul 13 15:23:36.319431 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.206419    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-log-socket\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.319431 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.206439    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-env-overrides\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.319431 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.206460    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/77127f7b-f478-42a2-9972-255956e53070-os-release\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.319431 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.206506    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/77127f7b-f478-42a2-9972-255956e53070-cni-binary-copy\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.319431 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.206813    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4f2ad453-3791-4e3a-9f4a-66ebbb2b5891-iptables-alerter-script\") pod \"iptables-alerter-qjpll\" (UID: \"4f2ad453-3791-4e3a-9f4a-66ebbb2b5891\") " pod="openshift-network-operator/iptables-alerter-qjpll"
Jul 13 15:23:36.319431 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.207772    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal" event={"ID":"be909fcc1006eb3f5b3a01699bb59d5e","Type":"ContainerStarted","Data":"4763d72c08e7099daf6b629a06a094b1c3d7b741fd48071d2f72971301617da7"}
Jul 13 15:23:36.319431 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.209741    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-93.ec2.internal" event={"ID":"eda63208df358e0e9bf9d712ad8f74a0","Type":"ContainerStarted","Data":"6b1e60dd91ca2b0886d131e61ee05e7fdcc86426a647e9167642a485653f6463"}
Jul 13 15:23:36.319431 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.211341    2555 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 13 15:23:36.319431 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.215826    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4tg5\" (UniqueName: \"kubernetes.io/projected/0d9e5461-c76c-4666-92dd-6c8eadd6b6d7-kube-api-access-v4tg5\") pod \"node-ca-gndtt\" (UID: \"0d9e5461-c76c-4666-92dd-6c8eadd6b6d7\") " pod="openshift-image-registry/node-ca-gndtt"
Jul 13 15:23:36.319431 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.215840    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzkmr\" (UniqueName: \"kubernetes.io/projected/9ede2cce-055c-4a8d-a4f2-aaed0d7c818d-kube-api-access-gzkmr\") pod \"node-resolver-msf42\" (UID: \"9ede2cce-055c-4a8d-a4f2-aaed0d7c818d\") " pod="openshift-dns/node-resolver-msf42"
Jul 13 15:23:36.319431 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.216238    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrnzk\" (UniqueName: \"kubernetes.io/projected/4f2ad453-3791-4e3a-9f4a-66ebbb2b5891-kube-api-access-vrnzk\") pod \"iptables-alerter-qjpll\" (UID: \"4f2ad453-3791-4e3a-9f4a-66ebbb2b5891\") " pod="openshift-network-operator/iptables-alerter-qjpll"
Jul 13 15:23:36.319431 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.307393    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/05b20951-a055-47c0-b70a-780e99535ad1-etc-selinux\") pod \"aws-ebs-csi-driver-node-kbfjb\" (UID: \"05b20951-a055-47c0-b70a-780e99535ad1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbfjb"
Jul 13 15:23:36.319431 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.307443    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d500cafe-37f3-4c98-8bef-63ba985b79fa-metrics-certs\") pod \"network-metrics-daemon-5bv64\" (UID: \"d500cafe-37f3-4c98-8bef-63ba985b79fa\") " pod="openshift-multus/network-metrics-daemon-5bv64"
Jul 13 15:23:36.319431 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.307466    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-run-openvswitch\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.319431 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.307518    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-run-openvswitch\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.319431 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.307549    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-host-cni-bin\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.319431 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.307575    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/77127f7b-f478-42a2-9972-255956e53070-host-run-k8s-cni-cncf-io\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.322523 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:36.307598    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 15:23:36.322523 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.307614    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ebcda597-80a9-4a20-99fc-0e254e2cb977-etc-systemd\") pod \"tuned-9zjxw\" (UID: \"ebcda597-80a9-4a20-99fc-0e254e2cb977\") " pod="openshift-cluster-node-tuning-operator/tuned-9zjxw"
Jul 13 15:23:36.322523 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.307624    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-host-cni-bin\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.322523 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.307638    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ebcda597-80a9-4a20-99fc-0e254e2cb977-run\") pod \"tuned-9zjxw\" (UID: \"ebcda597-80a9-4a20-99fc-0e254e2cb977\") " pod="openshift-cluster-node-tuning-operator/tuned-9zjxw"
Jul 13 15:23:36.322523 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.307662    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ebcda597-80a9-4a20-99fc-0e254e2cb977-host\") pod \"tuned-9zjxw\" (UID: \"ebcda597-80a9-4a20-99fc-0e254e2cb977\") " pod="openshift-cluster-node-tuning-operator/tuned-9zjxw"
Jul 13 15:23:36.322523 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.307667    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/77127f7b-f478-42a2-9972-255956e53070-host-run-k8s-cni-cncf-io\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.322523 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.307701    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ebcda597-80a9-4a20-99fc-0e254e2cb977-host\") pod \"tuned-9zjxw\" (UID: \"ebcda597-80a9-4a20-99fc-0e254e2cb977\") " pod="openshift-cluster-node-tuning-operator/tuned-9zjxw"
Jul 13 15:23:36.322523 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:36.307705    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d500cafe-37f3-4c98-8bef-63ba985b79fa-metrics-certs podName:d500cafe-37f3-4c98-8bef-63ba985b79fa nodeName:}" failed. No retries permitted until 2026-07-13 15:23:36.807668091 +0000 UTC m=+3.132389991 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d500cafe-37f3-4c98-8bef-63ba985b79fa-metrics-certs") pod "network-metrics-daemon-5bv64" (UID: "d500cafe-37f3-4c98-8bef-63ba985b79fa") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 15:23:36.322523 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.307576    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/05b20951-a055-47c0-b70a-780e99535ad1-etc-selinux\") pod \"aws-ebs-csi-driver-node-kbfjb\" (UID: \"05b20951-a055-47c0-b70a-780e99535ad1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbfjb"
Jul 13 15:23:36.322523 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.307743    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcx47\" (UniqueName: \"kubernetes.io/projected/05b20951-a055-47c0-b70a-780e99535ad1-kube-api-access-rcx47\") pod \"aws-ebs-csi-driver-node-kbfjb\" (UID: \"05b20951-a055-47c0-b70a-780e99535ad1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbfjb"
Jul 13 15:23:36.322523 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.307768    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-run-systemd\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.322523 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.307779    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ebcda597-80a9-4a20-99fc-0e254e2cb977-run\") pod \"tuned-9zjxw\" (UID: \"ebcda597-80a9-4a20-99fc-0e254e2cb977\") " pod="openshift-cluster-node-tuning-operator/tuned-9zjxw"
Jul 13 15:23:36.322523 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.307792    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-run-ovn\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.322523 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.307817    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-node-log\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.322523 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.307821    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ebcda597-80a9-4a20-99fc-0e254e2cb977-etc-systemd\") pod \"tuned-9zjxw\" (UID: \"ebcda597-80a9-4a20-99fc-0e254e2cb977\") " pod="openshift-cluster-node-tuning-operator/tuned-9zjxw"
Jul 13 15:23:36.322523 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.307839    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-host-run-ovn-kubernetes\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.322523 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.307867    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/25a82f60-2fa2-49cb-b7fc-84496432841f-system-cni-dir\") pod \"multus-additional-cni-plugins-vjmns\" (UID: \"25a82f60-2fa2-49cb-b7fc-84496432841f\") " pod="openshift-multus/multus-additional-cni-plugins-vjmns"
Jul 13 15:23:36.323832 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.307872    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-run-systemd\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.323832 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.307909    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/25a82f60-2fa2-49cb-b7fc-84496432841f-system-cni-dir\") pod \"multus-additional-cni-plugins-vjmns\" (UID: \"25a82f60-2fa2-49cb-b7fc-84496432841f\") " pod="openshift-multus/multus-additional-cni-plugins-vjmns"
Jul 13 15:23:36.323832 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.307914    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-node-log\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.323832 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.307945    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-host-run-ovn-kubernetes\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.323832 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.307972    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-run-ovn\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.323832 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.308051    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/25a82f60-2fa2-49cb-b7fc-84496432841f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vjmns\" (UID: \"25a82f60-2fa2-49cb-b7fc-84496432841f\") " pod="openshift-multus/multus-additional-cni-plugins-vjmns"
Jul 13 15:23:36.323832 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.308091    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r2vx\" (UniqueName: \"kubernetes.io/projected/d500cafe-37f3-4c98-8bef-63ba985b79fa-kube-api-access-9r2vx\") pod \"network-metrics-daemon-5bv64\" (UID: \"d500cafe-37f3-4c98-8bef-63ba985b79fa\") " pod="openshift-multus/network-metrics-daemon-5bv64"
Jul 13 15:23:36.323832 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.308116    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-host-slash\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.323832 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.308140    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/77127f7b-f478-42a2-9972-255956e53070-system-cni-dir\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.323832 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.308200    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/77127f7b-f478-42a2-9972-255956e53070-system-cni-dir\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.323832 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.308245    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-host-slash\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.323832 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.308347    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/77127f7b-f478-42a2-9972-255956e53070-host-run-netns\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.323832 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.308376    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1f78133a-9d4f-47fb-8253-2220a6139ab9-kubelet-config\") pod \"global-pull-secret-syncer-hdgtx\" (UID: \"1f78133a-9d4f-47fb-8253-2220a6139ab9\") " pod="kube-system/global-pull-secret-syncer-hdgtx"
Jul 13 15:23:36.323832 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.308413    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/25a82f60-2fa2-49cb-b7fc-84496432841f-cnibin\") pod \"multus-additional-cni-plugins-vjmns\" (UID: \"25a82f60-2fa2-49cb-b7fc-84496432841f\") " pod="openshift-multus/multus-additional-cni-plugins-vjmns"
Jul 13 15:23:36.323832 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.308438    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/25a82f60-2fa2-49cb-b7fc-84496432841f-os-release\") pod \"multus-additional-cni-plugins-vjmns\" (UID: \"25a82f60-2fa2-49cb-b7fc-84496432841f\") " pod="openshift-multus/multus-additional-cni-plugins-vjmns"
Jul 13 15:23:36.323832 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.308450    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/77127f7b-f478-42a2-9972-255956e53070-host-run-netns\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.323832 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.308460    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1f78133a-9d4f-47fb-8253-2220a6139ab9-kubelet-config\") pod \"global-pull-secret-syncer-hdgtx\" (UID: \"1f78133a-9d4f-47fb-8253-2220a6139ab9\") " pod="kube-system/global-pull-secret-syncer-hdgtx"
Jul 13 15:23:36.326558 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.308530    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/25a82f60-2fa2-49cb-b7fc-84496432841f-os-release\") pod \"multus-additional-cni-plugins-vjmns\" (UID: \"25a82f60-2fa2-49cb-b7fc-84496432841f\") " pod="openshift-multus/multus-additional-cni-plugins-vjmns"
Jul 13 15:23:36.326558 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.308464    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfkl7\" (UniqueName: \"kubernetes.io/projected/25a82f60-2fa2-49cb-b7fc-84496432841f-kube-api-access-kfkl7\") pod \"multus-additional-cni-plugins-vjmns\" (UID: \"25a82f60-2fa2-49cb-b7fc-84496432841f\") " pod="openshift-multus/multus-additional-cni-plugins-vjmns"
Jul 13 15:23:36.326558 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.308566    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/77127f7b-f478-42a2-9972-255956e53070-cnibin\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.326558 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.308616    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/77127f7b-f478-42a2-9972-255956e53070-cnibin\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.326558 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.308644    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/25a82f60-2fa2-49cb-b7fc-84496432841f-cnibin\") pod \"multus-additional-cni-plugins-vjmns\" (UID: \"25a82f60-2fa2-49cb-b7fc-84496432841f\") " pod="openshift-multus/multus-additional-cni-plugins-vjmns"
Jul 13 15:23:36.326558 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.308673    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/77127f7b-f478-42a2-9972-255956e53070-multus-conf-dir\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.326558 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.308713    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5c6d\" (UniqueName: \"kubernetes.io/projected/d349b31c-c0a7-4dfb-b91d-62e55ef016b6-kube-api-access-b5c6d\") pod \"network-check-target-jfg9j\" (UID: \"d349b31c-c0a7-4dfb-b91d-62e55ef016b6\") " pod="openshift-network-diagnostics/network-check-target-jfg9j"
Jul 13 15:23:36.326558 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.308715    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/25a82f60-2fa2-49cb-b7fc-84496432841f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vjmns\" (UID: \"25a82f60-2fa2-49cb-b7fc-84496432841f\") " pod="openshift-multus/multus-additional-cni-plugins-vjmns"
Jul 13 15:23:36.326558 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.308740    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-systemd-units\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.326558 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.308769    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.326558 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.308809    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77127f7b-f478-42a2-9972-255956e53070-etc-kubernetes\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.326558 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.308833    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ebcda597-80a9-4a20-99fc-0e254e2cb977-etc-sysconfig\") pod \"tuned-9zjxw\" (UID: \"ebcda597-80a9-4a20-99fc-0e254e2cb977\") " pod="openshift-cluster-node-tuning-operator/tuned-9zjxw"
Jul 13 15:23:36.326558 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.308842    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-systemd-units\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.326558 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.308856    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vkd2\" (UniqueName: \"kubernetes.io/projected/ebcda597-80a9-4a20-99fc-0e254e2cb977-kube-api-access-9vkd2\") pod \"tuned-9zjxw\" (UID: \"ebcda597-80a9-4a20-99fc-0e254e2cb977\") " pod="openshift-cluster-node-tuning-operator/tuned-9zjxw"
Jul 13 15:23:36.326558 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.308883    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-etc-openvswitch\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.326558 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.308888    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.326558 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.308900    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77127f7b-f478-42a2-9972-255956e53070-etc-kubernetes\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.327556 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.308929    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/77127f7b-f478-42a2-9972-255956e53070-multus-conf-dir\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.327556 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.308944    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-etc-openvswitch\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.327556 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.308934    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-ovnkube-config\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.327556 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.308978    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ebcda597-80a9-4a20-99fc-0e254e2cb977-etc-sysconfig\") pod \"tuned-9zjxw\" (UID: \"ebcda597-80a9-4a20-99fc-0e254e2cb977\") " pod="openshift-cluster-node-tuning-operator/tuned-9zjxw"
Jul 13 15:23:36.327556 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.308993    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-ovn-node-metrics-cert\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.327556 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.309017    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ebcda597-80a9-4a20-99fc-0e254e2cb977-sys\") pod \"tuned-9zjxw\" (UID: \"ebcda597-80a9-4a20-99fc-0e254e2cb977\") " pod="openshift-cluster-node-tuning-operator/tuned-9zjxw"
Jul 13 15:23:36.327556 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.309038    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ebcda597-80a9-4a20-99fc-0e254e2cb977-etc-tuned\") pod \"tuned-9zjxw\" (UID: \"ebcda597-80a9-4a20-99fc-0e254e2cb977\") " pod="openshift-cluster-node-tuning-operator/tuned-9zjxw"
Jul 13 15:23:36.327556 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.309066    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/25a82f60-2fa2-49cb-b7fc-84496432841f-cni-binary-copy\") pod \"multus-additional-cni-plugins-vjmns\" (UID: \"25a82f60-2fa2-49cb-b7fc-84496432841f\") " pod="openshift-multus/multus-additional-cni-plugins-vjmns"
Jul 13 15:23:36.327556 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.309089    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/25a82f60-2fa2-49cb-b7fc-84496432841f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vjmns\" (UID: \"25a82f60-2fa2-49cb-b7fc-84496432841f\") " pod="openshift-multus/multus-additional-cni-plugins-vjmns"
Jul 13 15:23:36.327556 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.309111    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-ovnkube-script-lib\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.327556 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.309135    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ebcda597-80a9-4a20-99fc-0e254e2cb977-etc-sysctl-conf\") pod \"tuned-9zjxw\" (UID: \"ebcda597-80a9-4a20-99fc-0e254e2cb977\") " pod="openshift-cluster-node-tuning-operator/tuned-9zjxw"
Jul 13 15:23:36.327556 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.309155    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ebcda597-80a9-4a20-99fc-0e254e2cb977-tmp\") pod \"tuned-9zjxw\" (UID: \"ebcda597-80a9-4a20-99fc-0e254e2cb977\") " pod="openshift-cluster-node-tuning-operator/tuned-9zjxw"
Jul 13 15:23:36.327556 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.309193    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-var-lib-openvswitch\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.327556 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.309220    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/18dbbb96-8987-4ae8-bdf7-1ecee7120b97-konnectivity-ca\") pod \"konnectivity-agent-474qm\" (UID: \"18dbbb96-8987-4ae8-bdf7-1ecee7120b97\") " pod="kube-system/konnectivity-agent-474qm"
Jul 13 15:23:36.327556 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.309280    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ebcda597-80a9-4a20-99fc-0e254e2cb977-sys\") pod \"tuned-9zjxw\" (UID: \"ebcda597-80a9-4a20-99fc-0e254e2cb977\") " pod="openshift-cluster-node-tuning-operator/tuned-9zjxw"
Jul 13 15:23:36.327556 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.309327    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/05b20951-a055-47c0-b70a-780e99535ad1-sys-fs\") pod \"aws-ebs-csi-driver-node-kbfjb\" (UID: \"05b20951-a055-47c0-b70a-780e99535ad1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbfjb"
Jul 13 15:23:36.327556 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.309359    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/77127f7b-f478-42a2-9972-255956e53070-host-var-lib-cni-multus\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.330696 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.309384    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx8dw\" (UniqueName: \"kubernetes.io/projected/77127f7b-f478-42a2-9972-255956e53070-kube-api-access-jx8dw\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.330696 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.309409    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/77127f7b-f478-42a2-9972-255956e53070-multus-socket-dir-parent\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.330696 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.309434    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/77127f7b-f478-42a2-9972-255956e53070-hostroot\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.330696 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.309458    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/77127f7b-f478-42a2-9972-255956e53070-host-run-multus-certs\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.330696 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.309481    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1f78133a-9d4f-47fb-8253-2220a6139ab9-dbus\") pod \"global-pull-secret-syncer-hdgtx\" (UID: \"1f78133a-9d4f-47fb-8253-2220a6139ab9\") " pod="kube-system/global-pull-secret-syncer-hdgtx"
Jul 13 15:23:36.330696 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.309519    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/05b20951-a055-47c0-b70a-780e99535ad1-registration-dir\") pod \"aws-ebs-csi-driver-node-kbfjb\" (UID: \"05b20951-a055-47c0-b70a-780e99535ad1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbfjb"
Jul 13 15:23:36.330696 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.309542    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-log-socket\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.330696 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.309564    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-env-overrides\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.330696 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.309602    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/77127f7b-f478-42a2-9972-255956e53070-os-release\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.330696 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.309626    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/77127f7b-f478-42a2-9972-255956e53070-cni-binary-copy\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.330696 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.309654    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-host-kubelet\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.330696 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.309676    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-host-run-netns\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.330696 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.309701    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-host-cni-netd\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.330696 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.309725    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/77127f7b-f478-42a2-9972-255956e53070-multus-daemon-config\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.330696 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.309749    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f78133a-9d4f-47fb-8253-2220a6139ab9-original-pull-secret\") pod \"global-pull-secret-syncer-hdgtx\" (UID: \"1f78133a-9d4f-47fb-8253-2220a6139ab9\") " pod="kube-system/global-pull-secret-syncer-hdgtx"
Jul 13 15:23:36.330696 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.309770    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/25a82f60-2fa2-49cb-b7fc-84496432841f-cni-binary-copy\") pod \"multus-additional-cni-plugins-vjmns\" (UID: \"25a82f60-2fa2-49cb-b7fc-84496432841f\") " pod="openshift-multus/multus-additional-cni-plugins-vjmns"
Jul 13 15:23:36.330696 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.309774    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebcda597-80a9-4a20-99fc-0e254e2cb977-etc-kubernetes\") pod \"tuned-9zjxw\" (UID: \"ebcda597-80a9-4a20-99fc-0e254e2cb977\") " pod="openshift-cluster-node-tuning-operator/tuned-9zjxw"
Jul 13 15:23:36.331533 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.309812    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ebcda597-80a9-4a20-99fc-0e254e2cb977-etc-sysctl-d\") pod \"tuned-9zjxw\" (UID: \"ebcda597-80a9-4a20-99fc-0e254e2cb977\") " pod="openshift-cluster-node-tuning-operator/tuned-9zjxw"
Jul 13 15:23:36.331533 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.309833    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/25a82f60-2fa2-49cb-b7fc-84496432841f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vjmns\" (UID: \"25a82f60-2fa2-49cb-b7fc-84496432841f\") " pod="openshift-multus/multus-additional-cni-plugins-vjmns"
Jul 13 15:23:36.331533 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.309841    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/18dbbb96-8987-4ae8-bdf7-1ecee7120b97-konnectivity-ca\") pod \"konnectivity-agent-474qm\" (UID: \"18dbbb96-8987-4ae8-bdf7-1ecee7120b97\") " pod="kube-system/konnectivity-agent-474qm"
Jul 13 15:23:36.331533 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.309896    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/05b20951-a055-47c0-b70a-780e99535ad1-sys-fs\") pod \"aws-ebs-csi-driver-node-kbfjb\" (UID: \"05b20951-a055-47c0-b70a-780e99535ad1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbfjb"
Jul 13 15:23:36.331533 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.309896    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebcda597-80a9-4a20-99fc-0e254e2cb977-var-lib-kubelet\") pod \"tuned-9zjxw\" (UID: \"ebcda597-80a9-4a20-99fc-0e254e2cb977\") " pod="openshift-cluster-node-tuning-operator/tuned-9zjxw"
Jul 13 15:23:36.331533 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.309840    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebcda597-80a9-4a20-99fc-0e254e2cb977-var-lib-kubelet\") pod \"tuned-9zjxw\" (UID: \"ebcda597-80a9-4a20-99fc-0e254e2cb977\") " pod="openshift-cluster-node-tuning-operator/tuned-9zjxw"
Jul 13 15:23:36.331533 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.309941    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/05b20951-a055-47c0-b70a-780e99535ad1-socket-dir\") pod \"aws-ebs-csi-driver-node-kbfjb\" (UID: \"05b20951-a055-47c0-b70a-780e99535ad1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbfjb"
Jul 13 15:23:36.331533 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.309950    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/77127f7b-f478-42a2-9972-255956e53070-hostroot\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.331533 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.309967    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ebcda597-80a9-4a20-99fc-0e254e2cb977-lib-modules\") pod \"tuned-9zjxw\" (UID: \"ebcda597-80a9-4a20-99fc-0e254e2cb977\") " pod="openshift-cluster-node-tuning-operator/tuned-9zjxw"
Jul 13 15:23:36.331533 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.309998    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/25a82f60-2fa2-49cb-b7fc-84496432841f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vjmns\" (UID: \"25a82f60-2fa2-49cb-b7fc-84496432841f\") " pod="openshift-multus/multus-additional-cni-plugins-vjmns"
Jul 13 15:23:36.331533 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.310005    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/77127f7b-f478-42a2-9972-255956e53070-host-var-lib-cni-multus\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.331533 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.310024    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/05b20951-a055-47c0-b70a-780e99535ad1-device-dir\") pod \"aws-ebs-csi-driver-node-kbfjb\" (UID: \"05b20951-a055-47c0-b70a-780e99535ad1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbfjb"
Jul 13 15:23:36.331533 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.310049    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqhxh\" (UniqueName: \"kubernetes.io/projected/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-kube-api-access-bqhxh\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.331533 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.310080    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/77127f7b-f478-42a2-9972-255956e53070-multus-cni-dir\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.331533 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.310106    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/77127f7b-f478-42a2-9972-255956e53070-host-var-lib-cni-bin\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.331533 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.310123    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-ovnkube-config\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.331533 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.310182    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/77127f7b-f478-42a2-9972-255956e53070-host-var-lib-kubelet\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.332732 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.310189    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/77127f7b-f478-42a2-9972-255956e53070-os-release\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.332732 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.310129    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/77127f7b-f478-42a2-9972-255956e53070-host-var-lib-kubelet\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.332732 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.310230    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/18dbbb96-8987-4ae8-bdf7-1ecee7120b97-agent-certs\") pod \"konnectivity-agent-474qm\" (UID: \"18dbbb96-8987-4ae8-bdf7-1ecee7120b97\") " pod="kube-system/konnectivity-agent-474qm"
Jul 13 15:23:36.332732 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.310245    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-env-overrides\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.332732 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.310256    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ebcda597-80a9-4a20-99fc-0e254e2cb977-etc-modprobe-d\") pod \"tuned-9zjxw\" (UID: \"ebcda597-80a9-4a20-99fc-0e254e2cb977\") " pod="openshift-cluster-node-tuning-operator/tuned-9zjxw"
Jul 13 15:23:36.332732 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.310279    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/05b20951-a055-47c0-b70a-780e99535ad1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kbfjb\" (UID: \"05b20951-a055-47c0-b70a-780e99535ad1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbfjb"
Jul 13 15:23:36.332732 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.310293    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/77127f7b-f478-42a2-9972-255956e53070-multus-socket-dir-parent\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.332732 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.310303    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/77127f7b-f478-42a2-9972-255956e53070-host-run-multus-certs\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.332732 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.309999    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ebcda597-80a9-4a20-99fc-0e254e2cb977-etc-sysctl-conf\") pod \"tuned-9zjxw\" (UID: \"ebcda597-80a9-4a20-99fc-0e254e2cb977\") " pod="openshift-cluster-node-tuning-operator/tuned-9zjxw"
Jul 13 15:23:36.332732 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:36.310423    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 15:23:36.332732 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.310438    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/05b20951-a055-47c0-b70a-780e99535ad1-device-dir\") pod \"aws-ebs-csi-driver-node-kbfjb\" (UID: \"05b20951-a055-47c0-b70a-780e99535ad1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbfjb"
Jul 13 15:23:36.332732 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.310440    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebcda597-80a9-4a20-99fc-0e254e2cb977-etc-kubernetes\") pod \"tuned-9zjxw\" (UID: \"ebcda597-80a9-4a20-99fc-0e254e2cb977\") " pod="openshift-cluster-node-tuning-operator/tuned-9zjxw"
Jul 13 15:23:36.332732 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:36.310491    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f78133a-9d4f-47fb-8253-2220a6139ab9-original-pull-secret podName:1f78133a-9d4f-47fb-8253-2220a6139ab9 nodeName:}" failed. No retries permitted until 2026-07-13 15:23:36.810473599 +0000 UTC m=+3.135195480 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f78133a-9d4f-47fb-8253-2220a6139ab9-original-pull-secret") pod "global-pull-secret-syncer-hdgtx" (UID: "1f78133a-9d4f-47fb-8253-2220a6139ab9") : object "kube-system"/"original-pull-secret" not registered
Jul 13 15:23:36.332732 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.310506    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/77127f7b-f478-42a2-9972-255956e53070-multus-cni-dir\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.332732 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.310532    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-host-kubelet\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.332732 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.310548    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1f78133a-9d4f-47fb-8253-2220a6139ab9-dbus\") pod \"global-pull-secret-syncer-hdgtx\" (UID: \"1f78133a-9d4f-47fb-8253-2220a6139ab9\") " pod="kube-system/global-pull-secret-syncer-hdgtx"
Jul 13 15:23:36.332732 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.310564    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ebcda597-80a9-4a20-99fc-0e254e2cb977-etc-sysctl-d\") pod \"tuned-9zjxw\" (UID: \"ebcda597-80a9-4a20-99fc-0e254e2cb977\") " pod="openshift-cluster-node-tuning-operator/tuned-9zjxw"
Jul 13 15:23:36.333570 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.310609    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/05b20951-a055-47c0-b70a-780e99535ad1-registration-dir\") pod \"aws-ebs-csi-driver-node-kbfjb\" (UID: \"05b20951-a055-47c0-b70a-780e99535ad1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbfjb"
Jul 13 15:23:36.333570 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.310643    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-var-lib-openvswitch\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.333570 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.310666    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/25a82f60-2fa2-49cb-b7fc-84496432841f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vjmns\" (UID: \"25a82f60-2fa2-49cb-b7fc-84496432841f\") " pod="openshift-multus/multus-additional-cni-plugins-vjmns"
Jul 13 15:23:36.333570 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.310676    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-log-socket\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.333570 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.310680    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ebcda597-80a9-4a20-99fc-0e254e2cb977-lib-modules\") pod \"tuned-9zjxw\" (UID: \"ebcda597-80a9-4a20-99fc-0e254e2cb977\") " pod="openshift-cluster-node-tuning-operator/tuned-9zjxw"
Jul 13 15:23:36.333570 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.310698    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-host-cni-netd\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.333570 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.310718    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-host-run-netns\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.333570 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.310718    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/77127f7b-f478-42a2-9972-255956e53070-cni-binary-copy\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.333570 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.310753    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ebcda597-80a9-4a20-99fc-0e254e2cb977-etc-modprobe-d\") pod \"tuned-9zjxw\" (UID: \"ebcda597-80a9-4a20-99fc-0e254e2cb977\") " pod="openshift-cluster-node-tuning-operator/tuned-9zjxw"
Jul 13 15:23:36.333570 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.310771    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/77127f7b-f478-42a2-9972-255956e53070-host-var-lib-cni-bin\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.333570 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.310799    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/05b20951-a055-47c0-b70a-780e99535ad1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kbfjb\" (UID: \"05b20951-a055-47c0-b70a-780e99535ad1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbfjb"
Jul 13 15:23:36.333570 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.310925    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/05b20951-a055-47c0-b70a-780e99535ad1-socket-dir\") pod \"aws-ebs-csi-driver-node-kbfjb\" (UID: \"05b20951-a055-47c0-b70a-780e99535ad1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbfjb"
Jul 13 15:23:36.333570 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.311022    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-ovnkube-script-lib\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.333570 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.311181    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/77127f7b-f478-42a2-9972-255956e53070-multus-daemon-config\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.333570 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.312773    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-ovn-node-metrics-cert\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.333570 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.313351    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/18dbbb96-8987-4ae8-bdf7-1ecee7120b97-agent-certs\") pod \"konnectivity-agent-474qm\" (UID: \"18dbbb96-8987-4ae8-bdf7-1ecee7120b97\") " pod="kube-system/konnectivity-agent-474qm"
Jul 13 15:23:36.333570 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.314047    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ebcda597-80a9-4a20-99fc-0e254e2cb977-etc-tuned\") pod \"tuned-9zjxw\" (UID: \"ebcda597-80a9-4a20-99fc-0e254e2cb977\") " pod="openshift-cluster-node-tuning-operator/tuned-9zjxw"
Jul 13 15:23:36.333570 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.314233    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ebcda597-80a9-4a20-99fc-0e254e2cb977-tmp\") pod \"tuned-9zjxw\" (UID: \"ebcda597-80a9-4a20-99fc-0e254e2cb977\") " pod="openshift-cluster-node-tuning-operator/tuned-9zjxw"
Jul 13 15:23:36.334354 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:36.321051    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 15:23:36.334354 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:36.321069    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 15:23:36.334354 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:36.321081    2555 projected.go:196] Error preparing data for projected volume kube-api-access-b5c6d for pod openshift-network-diagnostics/network-check-target-jfg9j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 15:23:36.334354 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:36.321139    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d349b31c-c0a7-4dfb-b91d-62e55ef016b6-kube-api-access-b5c6d podName:d349b31c-c0a7-4dfb-b91d-62e55ef016b6 nodeName:}" failed. No retries permitted until 2026-07-13 15:23:36.821122605 +0000 UTC m=+3.145844495 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-b5c6d" (UniqueName: "kubernetes.io/projected/d349b31c-c0a7-4dfb-b91d-62e55ef016b6-kube-api-access-b5c6d") pod "network-check-target-jfg9j" (UID: "d349b31c-c0a7-4dfb-b91d-62e55ef016b6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 15:23:36.334354 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.323732    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r2vx\" (UniqueName: \"kubernetes.io/projected/d500cafe-37f3-4c98-8bef-63ba985b79fa-kube-api-access-9r2vx\") pod \"network-metrics-daemon-5bv64\" (UID: \"d500cafe-37f3-4c98-8bef-63ba985b79fa\") " pod="openshift-multus/network-metrics-daemon-5bv64"
Jul 13 15:23:36.334354 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.324471    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfkl7\" (UniqueName: \"kubernetes.io/projected/25a82f60-2fa2-49cb-b7fc-84496432841f-kube-api-access-kfkl7\") pod \"multus-additional-cni-plugins-vjmns\" (UID: \"25a82f60-2fa2-49cb-b7fc-84496432841f\") " pod="openshift-multus/multus-additional-cni-plugins-vjmns"
Jul 13 15:23:36.334354 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.324471    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vkd2\" (UniqueName: \"kubernetes.io/projected/ebcda597-80a9-4a20-99fc-0e254e2cb977-kube-api-access-9vkd2\") pod \"tuned-9zjxw\" (UID: \"ebcda597-80a9-4a20-99fc-0e254e2cb977\") " pod="openshift-cluster-node-tuning-operator/tuned-9zjxw"
Jul 13 15:23:36.334354 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.325143    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcx47\" (UniqueName: \"kubernetes.io/projected/05b20951-a055-47c0-b70a-780e99535ad1-kube-api-access-rcx47\") pod \"aws-ebs-csi-driver-node-kbfjb\" (UID: \"05b20951-a055-47c0-b70a-780e99535ad1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbfjb"
Jul 13 15:23:36.334354 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.326513    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqhxh\" (UniqueName: \"kubernetes.io/projected/f4724159-d88b-4ed1-a5fc-956a4d1e3fe8-kube-api-access-bqhxh\") pod \"ovnkube-node-x8g52\" (UID: \"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.334354 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.326967    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx8dw\" (UniqueName: \"kubernetes.io/projected/77127f7b-f478-42a2-9972-255956e53070-kube-api-access-jx8dw\") pod \"multus-82fdm\" (UID: \"77127f7b-f478-42a2-9972-255956e53070\") " pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.567052 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.401166    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-msf42"
Jul 13 15:23:36.567052 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.410266    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gndtt"
Jul 13 15:23:36.567052 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.427083    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qjpll"
Jul 13 15:23:36.567052 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.434013    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:23:36.567052 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.444482    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-474qm"
Jul 13 15:23:36.567052 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.488190    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9zjxw"
Jul 13 15:23:36.567052 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.518499    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-82fdm"
Jul 13 15:23:36.567052 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.530622    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vjmns"
Jul 13 15:23:36.567052 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.536964    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbfjb"
Jul 13 15:23:36.814525 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.814486    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f78133a-9d4f-47fb-8253-2220a6139ab9-original-pull-secret\") pod \"global-pull-secret-syncer-hdgtx\" (UID: \"1f78133a-9d4f-47fb-8253-2220a6139ab9\") " pod="kube-system/global-pull-secret-syncer-hdgtx"
Jul 13 15:23:36.814712 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.814548    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d500cafe-37f3-4c98-8bef-63ba985b79fa-metrics-certs\") pod \"network-metrics-daemon-5bv64\" (UID: \"d500cafe-37f3-4c98-8bef-63ba985b79fa\") " pod="openshift-multus/network-metrics-daemon-5bv64"
Jul 13 15:23:36.814712 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:36.814651    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 15:23:36.814712 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:36.814682    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 15:23:36.814858 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:36.814721    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f78133a-9d4f-47fb-8253-2220a6139ab9-original-pull-secret podName:1f78133a-9d4f-47fb-8253-2220a6139ab9 nodeName:}" failed. No retries permitted until 2026-07-13 15:23:37.814704767 +0000 UTC m=+4.139426641 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f78133a-9d4f-47fb-8253-2220a6139ab9-original-pull-secret") pod "global-pull-secret-syncer-hdgtx" (UID: "1f78133a-9d4f-47fb-8253-2220a6139ab9") : object "kube-system"/"original-pull-secret" not registered
Jul 13 15:23:36.814858 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:36.814738    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d500cafe-37f3-4c98-8bef-63ba985b79fa-metrics-certs podName:d500cafe-37f3-4c98-8bef-63ba985b79fa nodeName:}" failed. No retries permitted until 2026-07-13 15:23:37.814730101 +0000 UTC m=+4.139451977 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d500cafe-37f3-4c98-8bef-63ba985b79fa-metrics-certs") pod "network-metrics-daemon-5bv64" (UID: "d500cafe-37f3-4c98-8bef-63ba985b79fa") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 15:23:36.915998 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:36.915911    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5c6d\" (UniqueName: \"kubernetes.io/projected/d349b31c-c0a7-4dfb-b91d-62e55ef016b6-kube-api-access-b5c6d\") pod \"network-check-target-jfg9j\" (UID: \"d349b31c-c0a7-4dfb-b91d-62e55ef016b6\") " pod="openshift-network-diagnostics/network-check-target-jfg9j"
Jul 13 15:23:36.916160 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:36.916060    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 15:23:36.916160 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:36.916081    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 15:23:36.916160 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:36.916094    2555 projected.go:196] Error preparing data for projected volume kube-api-access-b5c6d for pod openshift-network-diagnostics/network-check-target-jfg9j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 15:23:36.916309 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:36.916168    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d349b31c-c0a7-4dfb-b91d-62e55ef016b6-kube-api-access-b5c6d podName:d349b31c-c0a7-4dfb-b91d-62e55ef016b6 nodeName:}" failed. No retries permitted until 2026-07-13 15:23:37.916145124 +0000 UTC m=+4.240867021 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-b5c6d" (UniqueName: "kubernetes.io/projected/d349b31c-c0a7-4dfb-b91d-62e55ef016b6-kube-api-access-b5c6d") pod "network-check-target-jfg9j" (UID: "d349b31c-c0a7-4dfb-b91d-62e55ef016b6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 15:23:37.149961 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:37.149895    2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 15:18:36 +0000 UTC" deadline="2028-04-08 14:47:58.388255806 +0000 UTC"
Jul 13 15:23:37.149961 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:37.149953    2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15239h24m21.238305419s"
Jul 13 15:23:37.355689 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:37.355650    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebcda597_80a9_4a20_99fc_0e254e2cb977.slice/crio-582f12910fe64911fa69ac59560e811df0c4300576a56fcbccab346923304505 WatchSource:0}: Error finding container 582f12910fe64911fa69ac59560e811df0c4300576a56fcbccab346923304505: Status 404 returned error can't find the container with id 582f12910fe64911fa69ac59560e811df0c4300576a56fcbccab346923304505
Jul 13 15:23:37.362240 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:37.361981    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77127f7b_f478_42a2_9972_255956e53070.slice/crio-591a9230184a68c40a68ddb5fa6eaf303d5070e310e540f649d67c312257f5ef WatchSource:0}: Error finding container 591a9230184a68c40a68ddb5fa6eaf303d5070e310e540f649d67c312257f5ef: Status 404 returned error can't find the container with id 591a9230184a68c40a68ddb5fa6eaf303d5070e310e540f649d67c312257f5ef
Jul 13 15:23:37.364045 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:37.364014    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4724159_d88b_4ed1_a5fc_956a4d1e3fe8.slice/crio-50d956bf115b423edae0923b72151aea4079405ff5f7b1b76ea832d7766029f5 WatchSource:0}: Error finding container 50d956bf115b423edae0923b72151aea4079405ff5f7b1b76ea832d7766029f5: Status 404 returned error can't find the container with id 50d956bf115b423edae0923b72151aea4079405ff5f7b1b76ea832d7766029f5
Jul 13 15:23:37.384775 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:37.384753    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25a82f60_2fa2_49cb_b7fc_84496432841f.slice/crio-cc13f9a906608deb394e3ae05a2be2a0a933382c3d5f5c6bce29e8f9b9d4572f WatchSource:0}: Error finding container cc13f9a906608deb394e3ae05a2be2a0a933382c3d5f5c6bce29e8f9b9d4572f: Status 404 returned error can't find the container with id cc13f9a906608deb394e3ae05a2be2a0a933382c3d5f5c6bce29e8f9b9d4572f
Jul 13 15:23:37.385764 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:37.385705    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f2ad453_3791_4e3a_9f4a_66ebbb2b5891.slice/crio-bd440541c38ff7b01a64bfff79211e82f13906955eac4bf14204fcae81c59eaf WatchSource:0}: Error finding container bd440541c38ff7b01a64bfff79211e82f13906955eac4bf14204fcae81c59eaf: Status 404 returned error can't find the container with id bd440541c38ff7b01a64bfff79211e82f13906955eac4bf14204fcae81c59eaf
Jul 13 15:23:37.386933 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:37.386525    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ede2cce_055c_4a8d_a4f2_aaed0d7c818d.slice/crio-3f4faf8f0ef8438b0c6b70c20f01879eb6042c9495931096ead3be6a2aca5e01 WatchSource:0}: Error finding container 3f4faf8f0ef8438b0c6b70c20f01879eb6042c9495931096ead3be6a2aca5e01: Status 404 returned error can't find the container with id 3f4faf8f0ef8438b0c6b70c20f01879eb6042c9495931096ead3be6a2aca5e01
Jul 13 15:23:37.387254 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:37.387179    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d9e5461_c76c_4666_92dd_6c8eadd6b6d7.slice/crio-71c3af838aa63879761cb7fa889d08325701b093243c1bca1fef5471535ce58f WatchSource:0}: Error finding container 71c3af838aa63879761cb7fa889d08325701b093243c1bca1fef5471535ce58f: Status 404 returned error can't find the container with id 71c3af838aa63879761cb7fa889d08325701b093243c1bca1fef5471535ce58f
Jul 13 15:23:37.389465 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:37.389436    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18dbbb96_8987_4ae8_bdf7_1ecee7120b97.slice/crio-142abd8c7888f295ab7a22178f5b19e8408c824c40eafc4ff9f0bf03ce7ad722 WatchSource:0}: Error finding container 142abd8c7888f295ab7a22178f5b19e8408c824c40eafc4ff9f0bf03ce7ad722: Status 404 returned error can't find the container with id 142abd8c7888f295ab7a22178f5b19e8408c824c40eafc4ff9f0bf03ce7ad722
Jul 13 15:23:37.390323 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:23:37.390304    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05b20951_a055_47c0_b70a_780e99535ad1.slice/crio-196a043df556cb0bae21ebc70f5a73ef1e14c9669ab514eea264872523909977 WatchSource:0}: Error finding container 196a043df556cb0bae21ebc70f5a73ef1e14c9669ab514eea264872523909977: Status 404 returned error can't find the container with id 196a043df556cb0bae21ebc70f5a73ef1e14c9669ab514eea264872523909977
Jul 13 15:23:37.523295 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:37.523271    2555 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 15:23:37.824540 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:37.824502    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f78133a-9d4f-47fb-8253-2220a6139ab9-original-pull-secret\") pod \"global-pull-secret-syncer-hdgtx\" (UID: \"1f78133a-9d4f-47fb-8253-2220a6139ab9\") " pod="kube-system/global-pull-secret-syncer-hdgtx"
Jul 13 15:23:37.824715 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:37.824565    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d500cafe-37f3-4c98-8bef-63ba985b79fa-metrics-certs\") pod \"network-metrics-daemon-5bv64\" (UID: \"d500cafe-37f3-4c98-8bef-63ba985b79fa\") " pod="openshift-multus/network-metrics-daemon-5bv64"
Jul 13 15:23:37.824766 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:37.824715    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 15:23:37.824766 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:37.824723    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 15:23:37.824861 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:37.824779    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d500cafe-37f3-4c98-8bef-63ba985b79fa-metrics-certs podName:d500cafe-37f3-4c98-8bef-63ba985b79fa nodeName:}" failed. No retries permitted until 2026-07-13 15:23:39.824760981 +0000 UTC m=+6.149482871 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d500cafe-37f3-4c98-8bef-63ba985b79fa-metrics-certs") pod "network-metrics-daemon-5bv64" (UID: "d500cafe-37f3-4c98-8bef-63ba985b79fa") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 15:23:37.824861 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:37.824798    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f78133a-9d4f-47fb-8253-2220a6139ab9-original-pull-secret podName:1f78133a-9d4f-47fb-8253-2220a6139ab9 nodeName:}" failed. No retries permitted until 2026-07-13 15:23:39.824788219 +0000 UTC m=+6.149510098 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f78133a-9d4f-47fb-8253-2220a6139ab9-original-pull-secret") pod "global-pull-secret-syncer-hdgtx" (UID: "1f78133a-9d4f-47fb-8253-2220a6139ab9") : object "kube-system"/"original-pull-secret" not registered
Jul 13 15:23:37.926050 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:37.925968    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5c6d\" (UniqueName: \"kubernetes.io/projected/d349b31c-c0a7-4dfb-b91d-62e55ef016b6-kube-api-access-b5c6d\") pod \"network-check-target-jfg9j\" (UID: \"d349b31c-c0a7-4dfb-b91d-62e55ef016b6\") " pod="openshift-network-diagnostics/network-check-target-jfg9j"
Jul 13 15:23:37.926197 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:37.926127    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 15:23:37.926197 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:37.926146    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 15:23:37.926197 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:37.926157    2555 projected.go:196] Error preparing data for projected volume kube-api-access-b5c6d for pod openshift-network-diagnostics/network-check-target-jfg9j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 15:23:37.926340 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:37.926213    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d349b31c-c0a7-4dfb-b91d-62e55ef016b6-kube-api-access-b5c6d podName:d349b31c-c0a7-4dfb-b91d-62e55ef016b6 nodeName:}" failed. No retries permitted until 2026-07-13 15:23:39.926194346 +0000 UTC m=+6.250916235 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-b5c6d" (UniqueName: "kubernetes.io/projected/d349b31c-c0a7-4dfb-b91d-62e55ef016b6-kube-api-access-b5c6d") pod "network-check-target-jfg9j" (UID: "d349b31c-c0a7-4dfb-b91d-62e55ef016b6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 15:23:38.150780 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:38.150737    2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 15:18:36 +0000 UTC" deadline="2028-01-19 02:55:32.611711967 +0000 UTC"
Jul 13 15:23:38.150780 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:38.150779    2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13307h31m54.460938115s"
Jul 13 15:23:38.200409 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:38.200334    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hdgtx"
Jul 13 15:23:38.200551 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:38.200466    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hdgtx" podUID="1f78133a-9d4f-47fb-8253-2220a6139ab9"
Jul 13 15:23:38.200942 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:38.200921    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bv64"
Jul 13 15:23:38.201051 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:38.201032    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bv64" podUID="d500cafe-37f3-4c98-8bef-63ba985b79fa"
Jul 13 15:23:38.201120 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:38.201095    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfg9j"
Jul 13 15:23:38.201172 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:38.201161    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfg9j" podUID="d349b31c-c0a7-4dfb-b91d-62e55ef016b6"
Jul 13 15:23:38.240292 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:38.240215    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-82fdm" event={"ID":"77127f7b-f478-42a2-9972-255956e53070","Type":"ContainerStarted","Data":"591a9230184a68c40a68ddb5fa6eaf303d5070e310e540f649d67c312257f5ef"}
Jul 13 15:23:38.245347 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:38.245246    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gndtt" event={"ID":"0d9e5461-c76c-4666-92dd-6c8eadd6b6d7","Type":"ContainerStarted","Data":"71c3af838aa63879761cb7fa889d08325701b093243c1bca1fef5471535ce58f"}
Jul 13 15:23:38.255434 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:38.255340    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qjpll" event={"ID":"4f2ad453-3791-4e3a-9f4a-66ebbb2b5891","Type":"ContainerStarted","Data":"bd440541c38ff7b01a64bfff79211e82f13906955eac4bf14204fcae81c59eaf"}
Jul 13 15:23:38.267968 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:38.267922    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjmns" event={"ID":"25a82f60-2fa2-49cb-b7fc-84496432841f","Type":"ContainerStarted","Data":"cc13f9a906608deb394e3ae05a2be2a0a933382c3d5f5c6bce29e8f9b9d4572f"}
Jul 13 15:23:38.276197 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:38.276159    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x8g52" event={"ID":"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8","Type":"ContainerStarted","Data":"50d956bf115b423edae0923b72151aea4079405ff5f7b1b76ea832d7766029f5"}
Jul 13 15:23:38.290347 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:38.290310    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9zjxw" event={"ID":"ebcda597-80a9-4a20-99fc-0e254e2cb977","Type":"ContainerStarted","Data":"582f12910fe64911fa69ac59560e811df0c4300576a56fcbccab346923304505"}
Jul 13 15:23:38.305932 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:38.305899    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-93.ec2.internal" event={"ID":"eda63208df358e0e9bf9d712ad8f74a0","Type":"ContainerStarted","Data":"4e940fabf0bf0ed3152b10730febb85b0c89f0945328f7f2706aa9ed7864a07d"}
Jul 13 15:23:38.316849 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:38.316810    2555 generic.go:356] "Generic (PLEG): container finished" podID="be909fcc1006eb3f5b3a01699bb59d5e" containerID="87155d9cb1d74fe883e3b3a2c9eec8b915e3c3331564679856238ae9a93b2dcf" exitCode=0
Jul 13 15:23:38.316990 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:38.316905    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal" event={"ID":"be909fcc1006eb3f5b3a01699bb59d5e","Type":"ContainerDied","Data":"87155d9cb1d74fe883e3b3a2c9eec8b915e3c3331564679856238ae9a93b2dcf"}
Jul 13 15:23:38.324617 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:38.324509    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbfjb" event={"ID":"05b20951-a055-47c0-b70a-780e99535ad1","Type":"ContainerStarted","Data":"196a043df556cb0bae21ebc70f5a73ef1e14c9669ab514eea264872523909977"}
Jul 13 15:23:38.324972 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:38.324919    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-93.ec2.internal" podStartSLOduration=3.324902018 podStartE2EDuration="3.324902018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 15:23:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:23:38.324222934 +0000 UTC m=+4.648944831" watchObservedRunningTime="2026-07-13 15:23:38.324902018 +0000 UTC m=+4.649623915"
Jul 13 15:23:38.334877 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:38.334830    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-474qm" event={"ID":"18dbbb96-8987-4ae8-bdf7-1ecee7120b97","Type":"ContainerStarted","Data":"142abd8c7888f295ab7a22178f5b19e8408c824c40eafc4ff9f0bf03ce7ad722"}
Jul 13 15:23:38.357330 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:38.357299    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-msf42" event={"ID":"9ede2cce-055c-4a8d-a4f2-aaed0d7c818d","Type":"ContainerStarted","Data":"3f4faf8f0ef8438b0c6b70c20f01879eb6042c9495931096ead3be6a2aca5e01"}
Jul 13 15:23:39.374423 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:39.374305    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal" event={"ID":"be909fcc1006eb3f5b3a01699bb59d5e","Type":"ContainerStarted","Data":"a60f8d43a618a82c69a5873f80f3a385ba3dffaf9a9254149b3401a29056c6de"}
Jul 13 15:23:39.841487 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:39.841392    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f78133a-9d4f-47fb-8253-2220a6139ab9-original-pull-secret\") pod \"global-pull-secret-syncer-hdgtx\" (UID: \"1f78133a-9d4f-47fb-8253-2220a6139ab9\") " pod="kube-system/global-pull-secret-syncer-hdgtx"
Jul 13 15:23:39.841487 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:39.841459    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d500cafe-37f3-4c98-8bef-63ba985b79fa-metrics-certs\") pod \"network-metrics-daemon-5bv64\" (UID: \"d500cafe-37f3-4c98-8bef-63ba985b79fa\") " pod="openshift-multus/network-metrics-daemon-5bv64"
Jul 13 15:23:39.841726 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:39.841707    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 15:23:39.841786 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:39.841775    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d500cafe-37f3-4c98-8bef-63ba985b79fa-metrics-certs podName:d500cafe-37f3-4c98-8bef-63ba985b79fa nodeName:}" failed. No retries permitted until 2026-07-13 15:23:43.841754829 +0000 UTC m=+10.166476730 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d500cafe-37f3-4c98-8bef-63ba985b79fa-metrics-certs") pod "network-metrics-daemon-5bv64" (UID: "d500cafe-37f3-4c98-8bef-63ba985b79fa") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 15:23:39.842201 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:39.842180    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 15:23:39.842292 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:39.842242    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f78133a-9d4f-47fb-8253-2220a6139ab9-original-pull-secret podName:1f78133a-9d4f-47fb-8253-2220a6139ab9 nodeName:}" failed. No retries permitted until 2026-07-13 15:23:43.842219573 +0000 UTC m=+10.166941466 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f78133a-9d4f-47fb-8253-2220a6139ab9-original-pull-secret") pod "global-pull-secret-syncer-hdgtx" (UID: "1f78133a-9d4f-47fb-8253-2220a6139ab9") : object "kube-system"/"original-pull-secret" not registered
Jul 13 15:23:39.942372 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:39.942330    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5c6d\" (UniqueName: \"kubernetes.io/projected/d349b31c-c0a7-4dfb-b91d-62e55ef016b6-kube-api-access-b5c6d\") pod \"network-check-target-jfg9j\" (UID: \"d349b31c-c0a7-4dfb-b91d-62e55ef016b6\") " pod="openshift-network-diagnostics/network-check-target-jfg9j"
Jul 13 15:23:39.942559 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:39.942521    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 15:23:39.942559 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:39.942542    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 15:23:39.942559 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:39.942555    2555 projected.go:196] Error preparing data for projected volume kube-api-access-b5c6d for pod openshift-network-diagnostics/network-check-target-jfg9j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 15:23:39.942742 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:39.942632    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d349b31c-c0a7-4dfb-b91d-62e55ef016b6-kube-api-access-b5c6d podName:d349b31c-c0a7-4dfb-b91d-62e55ef016b6 nodeName:}" failed. No retries permitted until 2026-07-13 15:23:43.942611795 +0000 UTC m=+10.267333685 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-b5c6d" (UniqueName: "kubernetes.io/projected/d349b31c-c0a7-4dfb-b91d-62e55ef016b6-kube-api-access-b5c6d") pod "network-check-target-jfg9j" (UID: "d349b31c-c0a7-4dfb-b91d-62e55ef016b6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 15:23:40.198410 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:40.198160    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfg9j"
Jul 13 15:23:40.198410 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:40.198160    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hdgtx"
Jul 13 15:23:40.198410 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:40.198329    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfg9j" podUID="d349b31c-c0a7-4dfb-b91d-62e55ef016b6"
Jul 13 15:23:40.199085 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:40.198401    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hdgtx" podUID="1f78133a-9d4f-47fb-8253-2220a6139ab9"
Jul 13 15:23:40.199085 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:40.198469    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bv64"
Jul 13 15:23:40.199085 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:40.199008    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bv64" podUID="d500cafe-37f3-4c98-8bef-63ba985b79fa"
Jul 13 15:23:42.197548 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:42.197058    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bv64"
Jul 13 15:23:42.197548 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:42.197060    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfg9j"
Jul 13 15:23:42.197548 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:42.197212    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bv64" podUID="d500cafe-37f3-4c98-8bef-63ba985b79fa"
Jul 13 15:23:42.197548 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:42.197228    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hdgtx"
Jul 13 15:23:42.197548 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:42.197393    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hdgtx" podUID="1f78133a-9d4f-47fb-8253-2220a6139ab9"
Jul 13 15:23:42.197548 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:42.197478    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfg9j" podUID="d349b31c-c0a7-4dfb-b91d-62e55ef016b6"
Jul 13 15:23:43.879619 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:43.879337    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f78133a-9d4f-47fb-8253-2220a6139ab9-original-pull-secret\") pod \"global-pull-secret-syncer-hdgtx\" (UID: \"1f78133a-9d4f-47fb-8253-2220a6139ab9\") " pod="kube-system/global-pull-secret-syncer-hdgtx"
Jul 13 15:23:43.879619 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:43.879400    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d500cafe-37f3-4c98-8bef-63ba985b79fa-metrics-certs\") pod \"network-metrics-daemon-5bv64\" (UID: \"d500cafe-37f3-4c98-8bef-63ba985b79fa\") " pod="openshift-multus/network-metrics-daemon-5bv64"
Jul 13 15:23:43.879619 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:43.879509    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 15:23:43.879619 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:43.879543    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 15:23:43.879619 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:43.879615    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f78133a-9d4f-47fb-8253-2220a6139ab9-original-pull-secret podName:1f78133a-9d4f-47fb-8253-2220a6139ab9 nodeName:}" failed. No retries permitted until 2026-07-13 15:23:51.879578281 +0000 UTC m=+18.204300171 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f78133a-9d4f-47fb-8253-2220a6139ab9-original-pull-secret") pod "global-pull-secret-syncer-hdgtx" (UID: "1f78133a-9d4f-47fb-8253-2220a6139ab9") : object "kube-system"/"original-pull-secret" not registered
Jul 13 15:23:43.880380 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:43.879650    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d500cafe-37f3-4c98-8bef-63ba985b79fa-metrics-certs podName:d500cafe-37f3-4c98-8bef-63ba985b79fa nodeName:}" failed. No retries permitted until 2026-07-13 15:23:51.879638068 +0000 UTC m=+18.204359948 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d500cafe-37f3-4c98-8bef-63ba985b79fa-metrics-certs") pod "network-metrics-daemon-5bv64" (UID: "d500cafe-37f3-4c98-8bef-63ba985b79fa") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 15:23:43.979924 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:43.979877    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5c6d\" (UniqueName: \"kubernetes.io/projected/d349b31c-c0a7-4dfb-b91d-62e55ef016b6-kube-api-access-b5c6d\") pod \"network-check-target-jfg9j\" (UID: \"d349b31c-c0a7-4dfb-b91d-62e55ef016b6\") " pod="openshift-network-diagnostics/network-check-target-jfg9j"
Jul 13 15:23:43.980094 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:43.980019    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 15:23:43.980094 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:43.980038    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 15:23:43.980094 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:43.980047    2555 projected.go:196] Error preparing data for projected volume kube-api-access-b5c6d for pod openshift-network-diagnostics/network-check-target-jfg9j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 15:23:43.980272 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:43.980097    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d349b31c-c0a7-4dfb-b91d-62e55ef016b6-kube-api-access-b5c6d podName:d349b31c-c0a7-4dfb-b91d-62e55ef016b6 nodeName:}" failed. No retries permitted until 2026-07-13 15:23:51.980083523 +0000 UTC m=+18.304805401 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-b5c6d" (UniqueName: "kubernetes.io/projected/d349b31c-c0a7-4dfb-b91d-62e55ef016b6-kube-api-access-b5c6d") pod "network-check-target-jfg9j" (UID: "d349b31c-c0a7-4dfb-b91d-62e55ef016b6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 15:23:44.198961 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:44.198092    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hdgtx"
Jul 13 15:23:44.198961 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:44.198204    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hdgtx" podUID="1f78133a-9d4f-47fb-8253-2220a6139ab9"
Jul 13 15:23:44.198961 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:44.198567    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfg9j"
Jul 13 15:23:44.198961 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:44.198683    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfg9j" podUID="d349b31c-c0a7-4dfb-b91d-62e55ef016b6"
Jul 13 15:23:44.198961 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:44.198745    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bv64"
Jul 13 15:23:44.198961 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:44.198816    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bv64" podUID="d500cafe-37f3-4c98-8bef-63ba985b79fa"
Jul 13 15:23:46.197561 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:46.197475    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hdgtx"
Jul 13 15:23:46.198054 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:46.197680    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hdgtx" podUID="1f78133a-9d4f-47fb-8253-2220a6139ab9"
Jul 13 15:23:46.198054 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:46.197490    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bv64"
Jul 13 15:23:46.198054 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:46.197931    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bv64" podUID="d500cafe-37f3-4c98-8bef-63ba985b79fa"
Jul 13 15:23:46.198210 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:46.198055    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfg9j"
Jul 13 15:23:46.198210 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:46.198149    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfg9j" podUID="d349b31c-c0a7-4dfb-b91d-62e55ef016b6"
Jul 13 15:23:48.197402 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:48.197373    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hdgtx"
Jul 13 15:23:48.197675 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:48.197381    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bv64"
Jul 13 15:23:48.197675 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:48.197506    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hdgtx" podUID="1f78133a-9d4f-47fb-8253-2220a6139ab9"
Jul 13 15:23:48.197675 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:48.197624    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bv64" podUID="d500cafe-37f3-4c98-8bef-63ba985b79fa"
Jul 13 15:23:48.197783 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:48.197679    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfg9j"
Jul 13 15:23:48.197783 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:48.197763    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfg9j" podUID="d349b31c-c0a7-4dfb-b91d-62e55ef016b6"
Jul 13 15:23:50.197264 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:50.197223    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bv64"
Jul 13 15:23:50.197707 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:50.197223    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfg9j"
Jul 13 15:23:50.197707 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:50.197367    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bv64" podUID="d500cafe-37f3-4c98-8bef-63ba985b79fa"
Jul 13 15:23:50.197707 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:50.197422    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hdgtx"
Jul 13 15:23:50.197707 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:50.197536    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfg9j" podUID="d349b31c-c0a7-4dfb-b91d-62e55ef016b6"
Jul 13 15:23:50.197707 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:50.197655    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hdgtx" podUID="1f78133a-9d4f-47fb-8253-2220a6139ab9"
Jul 13 15:23:51.934557 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:51.934516    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f78133a-9d4f-47fb-8253-2220a6139ab9-original-pull-secret\") pod \"global-pull-secret-syncer-hdgtx\" (UID: \"1f78133a-9d4f-47fb-8253-2220a6139ab9\") " pod="kube-system/global-pull-secret-syncer-hdgtx"
Jul 13 15:23:51.935021 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:51.934573    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d500cafe-37f3-4c98-8bef-63ba985b79fa-metrics-certs\") pod \"network-metrics-daemon-5bv64\" (UID: \"d500cafe-37f3-4c98-8bef-63ba985b79fa\") " pod="openshift-multus/network-metrics-daemon-5bv64"
Jul 13 15:23:51.935021 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:51.934707    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 15:23:51.935021 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:51.934739    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 15:23:51.935021 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:51.934788    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f78133a-9d4f-47fb-8253-2220a6139ab9-original-pull-secret podName:1f78133a-9d4f-47fb-8253-2220a6139ab9 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:07.93476673 +0000 UTC m=+34.259488608 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f78133a-9d4f-47fb-8253-2220a6139ab9-original-pull-secret") pod "global-pull-secret-syncer-hdgtx" (UID: "1f78133a-9d4f-47fb-8253-2220a6139ab9") : object "kube-system"/"original-pull-secret" not registered
Jul 13 15:23:51.935021 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:51.934809    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d500cafe-37f3-4c98-8bef-63ba985b79fa-metrics-certs podName:d500cafe-37f3-4c98-8bef-63ba985b79fa nodeName:}" failed. No retries permitted until 2026-07-13 15:24:07.934798898 +0000 UTC m=+34.259520777 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d500cafe-37f3-4c98-8bef-63ba985b79fa-metrics-certs") pod "network-metrics-daemon-5bv64" (UID: "d500cafe-37f3-4c98-8bef-63ba985b79fa") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 15:23:52.035259 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:52.035225    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5c6d\" (UniqueName: \"kubernetes.io/projected/d349b31c-c0a7-4dfb-b91d-62e55ef016b6-kube-api-access-b5c6d\") pod \"network-check-target-jfg9j\" (UID: \"d349b31c-c0a7-4dfb-b91d-62e55ef016b6\") " pod="openshift-network-diagnostics/network-check-target-jfg9j"
Jul 13 15:23:52.035426 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:52.035392    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 15:23:52.035426 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:52.035416    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 15:23:52.035426 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:52.035427    2555 projected.go:196] Error preparing data for projected volume kube-api-access-b5c6d for pod openshift-network-diagnostics/network-check-target-jfg9j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 15:23:52.035600 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:52.035479    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d349b31c-c0a7-4dfb-b91d-62e55ef016b6-kube-api-access-b5c6d podName:d349b31c-c0a7-4dfb-b91d-62e55ef016b6 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:08.035465147 +0000 UTC m=+34.360187022 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-b5c6d" (UniqueName: "kubernetes.io/projected/d349b31c-c0a7-4dfb-b91d-62e55ef016b6-kube-api-access-b5c6d") pod "network-check-target-jfg9j" (UID: "d349b31c-c0a7-4dfb-b91d-62e55ef016b6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 15:23:52.197561 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:52.197473    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hdgtx"
Jul 13 15:23:52.197722 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:52.197476    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bv64"
Jul 13 15:23:52.197722 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:52.197622    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfg9j"
Jul 13 15:23:52.197722 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:52.197616    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hdgtx" podUID="1f78133a-9d4f-47fb-8253-2220a6139ab9"
Jul 13 15:23:52.197863 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:52.197756    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bv64" podUID="d500cafe-37f3-4c98-8bef-63ba985b79fa"
Jul 13 15:23:52.197863 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:52.197823    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfg9j" podUID="d349b31c-c0a7-4dfb-b91d-62e55ef016b6"
Jul 13 15:23:54.197492 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:54.197458    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hdgtx"
Jul 13 15:23:54.197974 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:54.197548    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bv64"
Jul 13 15:23:54.197974 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:54.197570    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hdgtx" podUID="1f78133a-9d4f-47fb-8253-2220a6139ab9"
Jul 13 15:23:54.197974 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:54.197655    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bv64" podUID="d500cafe-37f3-4c98-8bef-63ba985b79fa"
Jul 13 15:23:54.197974 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:54.197709    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfg9j"
Jul 13 15:23:54.197974 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:54.197772    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfg9j" podUID="d349b31c-c0a7-4dfb-b91d-62e55ef016b6"
Jul 13 15:23:56.196980 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:56.196949    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfg9j"
Jul 13 15:23:56.197540 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:56.196993    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bv64"
Jul 13 15:23:56.197540 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:56.196957    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hdgtx"
Jul 13 15:23:56.197540 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:56.197077    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfg9j" podUID="d349b31c-c0a7-4dfb-b91d-62e55ef016b6"
Jul 13 15:23:56.197540 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:56.197178    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hdgtx" podUID="1f78133a-9d4f-47fb-8253-2220a6139ab9"
Jul 13 15:23:56.197540 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:56.197279    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bv64" podUID="d500cafe-37f3-4c98-8bef-63ba985b79fa"
Jul 13 15:23:57.419225 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:57.418873    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x8g52_f4724159-d88b-4ed1-a5fc-956a4d1e3fe8/ovn-acl-logging/0.log"
Jul 13 15:23:57.420045 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:57.419493    2555 generic.go:356] "Generic (PLEG): container finished" podID="f4724159-d88b-4ed1-a5fc-956a4d1e3fe8" containerID="6c5ecc7689f748c972df7f4168410b15d52da805f8f8080505515922611bf111" exitCode=1
Jul 13 15:23:57.420045 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:57.419565    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x8g52" event={"ID":"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8","Type":"ContainerStarted","Data":"cbf4d3c447bc47ae6f8e97d66215804bda149e4d2473e4c6144e1df382b20f90"}
Jul 13 15:23:57.420045 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:57.419693    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x8g52" event={"ID":"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8","Type":"ContainerStarted","Data":"5d6ad6bfdc360e1847b82058d31fed9ae3d17135013860781f54e1619c2146e1"}
Jul 13 15:23:57.420045 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:57.419732    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x8g52" event={"ID":"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8","Type":"ContainerStarted","Data":"df108a30b9e373d9beaf2ffb3e36b4a8791b4cf7a538916779dd81e36ddc934e"}
Jul 13 15:23:57.420045 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:57.419760    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x8g52" event={"ID":"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8","Type":"ContainerStarted","Data":"29d23841f1da9aaf2ce53cb907cce71eb5b972ce793b3e94ced9ef8513e0c509"}
Jul 13 15:23:57.420045 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:57.419787    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x8g52" event={"ID":"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8","Type":"ContainerDied","Data":"6c5ecc7689f748c972df7f4168410b15d52da805f8f8080505515922611bf111"}
Jul 13 15:23:57.420045 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:57.419821    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x8g52" event={"ID":"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8","Type":"ContainerStarted","Data":"a2a7d7003c60c31b1e2dbb9f9ef1ccb19569b9d556b80ecb5d2524371bdbbc19"}
Jul 13 15:23:57.420990 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:57.420966    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9zjxw" event={"ID":"ebcda597-80a9-4a20-99fc-0e254e2cb977","Type":"ContainerStarted","Data":"d0630c180b611ab695db9729393d0f5964fa7018dd53bda1c5dfa585932e574d"}
Jul 13 15:23:57.422540 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:57.422514    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbfjb" event={"ID":"05b20951-a055-47c0-b70a-780e99535ad1","Type":"ContainerStarted","Data":"43d1e90cdf99f3b6fc3a02b72d54ba9c5dea7e0257e5f3c9d230a2ef8e8ab78f"}
Jul 13 15:23:57.423860 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:57.423841    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-474qm" event={"ID":"18dbbb96-8987-4ae8-bdf7-1ecee7120b97","Type":"ContainerStarted","Data":"361b21f20f4ed5b007f4377421e9423a8b6c6543f8249d0d38e5e3958ee79ec8"}
Jul 13 15:23:57.425185 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:57.425158    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-msf42" event={"ID":"9ede2cce-055c-4a8d-a4f2-aaed0d7c818d","Type":"ContainerStarted","Data":"189cea44914f47b6f57de6feb232a38751080fde5989d1641340a4ead64d24d9"}
Jul 13 15:23:57.426541 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:57.426522    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-82fdm" event={"ID":"77127f7b-f478-42a2-9972-255956e53070","Type":"ContainerStarted","Data":"65f86d946d355105f85d9167bb9573483f14c764c8f97058f903f1c5e2918ac2"}
Jul 13 15:23:57.427854 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:57.427831    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gndtt" event={"ID":"0d9e5461-c76c-4666-92dd-6c8eadd6b6d7","Type":"ContainerStarted","Data":"1e785588d0be0f4c83bbb0b29132284ceae31232cc2a4f97401767664d38e33b"}
Jul 13 15:23:57.429194 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:57.429175    2555 generic.go:356] "Generic (PLEG): container finished" podID="25a82f60-2fa2-49cb-b7fc-84496432841f" containerID="cf27ae64391dbb32600e50b6cc4f2a25665e7a6d29d75840f7acea3abb731107" exitCode=0
Jul 13 15:23:57.429273 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:57.429202    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjmns" event={"ID":"25a82f60-2fa2-49cb-b7fc-84496432841f","Type":"ContainerDied","Data":"cf27ae64391dbb32600e50b6cc4f2a25665e7a6d29d75840f7acea3abb731107"}
Jul 13 15:23:57.442730 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:57.442684    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9zjxw" podStartSLOduration=4.497207851 podStartE2EDuration="23.442669704s" totalImagesPullingTime="18.945461853s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 15:23:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:23:57.442181499 +0000 UTC m=+23.766903395" watchObservedRunningTime="2026-07-13 15:23:57.442669704 +0000 UTC m=+23.767391600"
Jul 13 15:23:57.442854 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:57.442805    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-93.ec2.internal" podStartSLOduration=22.442800505 podStartE2EDuration="22.442800505s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 15:23:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:23:39.408252252 +0000 UTC m=+5.732974153" watchObservedRunningTime="2026-07-13 15:23:57.442800505 +0000 UTC m=+23.767522401"
Jul 13 15:23:57.459379 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:57.459331    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gndtt" podStartSLOduration=4.556493193 podStartE2EDuration="23.459321072s" totalImagesPullingTime="18.902827879s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 15:23:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:23:57.458862709 +0000 UTC m=+23.783584605" watchObservedRunningTime="2026-07-13 15:23:57.459321072 +0000 UTC m=+23.784042968"
Jul 13 15:23:57.480397 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:57.480348    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-82fdm" podStartSLOduration=4.521359941 podStartE2EDuration="23.48033359s" totalImagesPullingTime="18.958973649s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 15:23:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:23:57.479988373 +0000 UTC m=+23.804710275" watchObservedRunningTime="2026-07-13 15:23:57.48033359 +0000 UTC m=+23.805055487"
Jul 13 15:23:57.497977 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:57.497936    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-474qm" podStartSLOduration=4.5951614339999995 podStartE2EDuration="23.497921393s" totalImagesPullingTime="18.902759959s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:23:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:23:57.497641736 +0000 UTC m=+23.822363634" watchObservedRunningTime="2026-07-13 15:23:57.497921393 +0000 UTC m=+23.822643290"
Jul 13 15:23:57.537638 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:57.537561    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-msf42" podStartSLOduration=4.635260295 podStartE2EDuration="23.537546945s" totalImagesPullingTime="18.90228665s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 15:23:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:23:57.537513013 +0000 UTC m=+23.862234904" watchObservedRunningTime="2026-07-13 15:23:57.537546945 +0000 UTC m=+23.862268835"
Jul 13 15:23:57.705077 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:57.705055    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-474qm"
Jul 13 15:23:57.705537 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:57.705520    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-474qm"
Jul 13 15:23:57.829739 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:57.829715    2555 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 13 15:23:58.182221 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:58.182062    2555 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-13T15:23:57.829731432Z","UUID":"d41df4f7-aa28-4b13-9316-e9e830bae48d","Handler":null,"Name":"","Endpoint":""}
Jul 13 15:23:58.183677 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:58.183651    2555 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 13 15:23:58.183807 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:58.183698    2555 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 13 15:23:58.196904 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:58.196877    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bv64"
Jul 13 15:23:58.197082 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:58.196877    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfg9j"
Jul 13 15:23:58.197082 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:58.196992    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bv64" podUID="d500cafe-37f3-4c98-8bef-63ba985b79fa"
Jul 13 15:23:58.197198 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:58.197095    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfg9j" podUID="d349b31c-c0a7-4dfb-b91d-62e55ef016b6"
Jul 13 15:23:58.197198 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:58.197135    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hdgtx"
Jul 13 15:23:58.197296 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:23:58.197212    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hdgtx" podUID="1f78133a-9d4f-47fb-8253-2220a6139ab9"
Jul 13 15:23:58.435851 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:58.435766    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbfjb" event={"ID":"05b20951-a055-47c0-b70a-780e99535ad1","Type":"ContainerStarted","Data":"83c5c9ac0b5bbdb8f75842d9199627ad1ef1f0458271be36969b89adf5f20ae4"}
Jul 13 15:23:58.438256 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:58.438222    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qjpll" event={"ID":"4f2ad453-3791-4e3a-9f4a-66ebbb2b5891","Type":"ContainerStarted","Data":"fb2d6b19673f9b20b6be8098eae76e2523322a503f0cbbd702c14a9865d3cac6"}
Jul 13 15:23:59.445804 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:59.445480    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x8g52_f4724159-d88b-4ed1-a5fc-956a4d1e3fe8/ovn-acl-logging/0.log"
Jul 13 15:23:59.446283 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:59.446232    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x8g52" event={"ID":"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8","Type":"ContainerStarted","Data":"77f5ff1ab1ba777b3353a2f84f6f094ed92fb18e0fbf8de03d01b87bfd005297"}
Jul 13 15:23:59.448688 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:59.448666    2555 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 13 15:23:59.448688 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:59.448648    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbfjb" event={"ID":"05b20951-a055-47c0-b70a-780e99535ad1","Type":"ContainerStarted","Data":"ad670e18442e1da118ccebc7f8aacd09ede68c26b348a21d4ee39f2956629509"}
Jul 13 15:23:59.470322 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:59.470262    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kbfjb" podStartSLOduration=4.353552386 podStartE2EDuration="25.470243946s" totalImagesPullingTime="21.11669156s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 15:23:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:23:59.470235841 +0000 UTC m=+25.794957738" watchObservedRunningTime="2026-07-13 15:23:59.470243946 +0000 UTC m=+25.794965845"
Jul 13 15:23:59.470747 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:23:59.470710    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qjpll" podStartSLOduration=6.563332437 podStartE2EDuration="25.470701735s" totalImagesPullingTime="18.907369298s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 15:23:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:23:58.454824921 +0000 UTC m=+24.779546819" watchObservedRunningTime="2026-07-13 15:23:59.470701735 +0000 UTC m=+25.795423631"
Jul 13 15:24:00.197187 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:00.197152    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hdgtx"
Jul 13 15:24:00.197524 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:00.197152    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bv64"
Jul 13 15:24:00.197524 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:00.197291    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hdgtx" podUID="1f78133a-9d4f-47fb-8253-2220a6139ab9"
Jul 13 15:24:00.197524 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:00.197152    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfg9j"
Jul 13 15:24:00.197524 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:00.197414    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bv64" podUID="d500cafe-37f3-4c98-8bef-63ba985b79fa"
Jul 13 15:24:00.197524 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:00.197513    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfg9j" podUID="d349b31c-c0a7-4dfb-b91d-62e55ef016b6"
Jul 13 15:24:02.197355 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:02.197104    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bv64"
Jul 13 15:24:02.198116 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:02.197104    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfg9j"
Jul 13 15:24:02.198116 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:02.197398    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bv64" podUID="d500cafe-37f3-4c98-8bef-63ba985b79fa"
Jul 13 15:24:02.198116 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:02.197466    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfg9j" podUID="d349b31c-c0a7-4dfb-b91d-62e55ef016b6"
Jul 13 15:24:02.198116 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:02.197165    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hdgtx"
Jul 13 15:24:02.198116 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:02.197539    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hdgtx" podUID="1f78133a-9d4f-47fb-8253-2220a6139ab9"
Jul 13 15:24:02.457413 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:02.457328    2555 generic.go:356] "Generic (PLEG): container finished" podID="25a82f60-2fa2-49cb-b7fc-84496432841f" containerID="f1333c0c90d2b332c179a1b93e1a9ccf0315a9c1bb3cb3a13dae8b682c112492" exitCode=0
Jul 13 15:24:02.457566 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:02.457417    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjmns" event={"ID":"25a82f60-2fa2-49cb-b7fc-84496432841f","Type":"ContainerDied","Data":"f1333c0c90d2b332c179a1b93e1a9ccf0315a9c1bb3cb3a13dae8b682c112492"}
Jul 13 15:24:02.461129 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:02.461063    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x8g52_f4724159-d88b-4ed1-a5fc-956a4d1e3fe8/ovn-acl-logging/0.log"
Jul 13 15:24:02.461526 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:02.461501    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x8g52" event={"ID":"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8","Type":"ContainerStarted","Data":"ad0945d33acf4433c0e411dbcc73098fdc7d9aeb1ca8b78114a4641b8d81ba5b"}
Jul 13 15:24:02.461792 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:02.461775    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:24:02.461875 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:02.461848    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:24:02.462442 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:02.462423    2555 scope.go:117] "RemoveContainer" containerID="6c5ecc7689f748c972df7f4168410b15d52da805f8f8080505515922611bf111"
Jul 13 15:24:02.478047 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:02.478024    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:24:02.478567 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:02.478552    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:24:03.467402 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:03.467377    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x8g52_f4724159-d88b-4ed1-a5fc-956a4d1e3fe8/ovn-acl-logging/0.log"
Jul 13 15:24:03.467941 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:03.467735    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x8g52" event={"ID":"f4724159-d88b-4ed1-a5fc-956a4d1e3fe8","Type":"ContainerStarted","Data":"3f448b376724bf0d60e0743cfdcc29705e09782d43ea15c10f654d38fac2d9f2"}
Jul 13 15:24:03.467941 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:03.467855    2555 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 13 15:24:03.497575 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:03.497532    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-x8g52" podStartSLOduration=10.515020448 podStartE2EDuration="29.49751581s" totalImagesPullingTime="18.982495362s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 15:23:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:03.496517751 +0000 UTC m=+29.821239649" watchObservedRunningTime="2026-07-13 15:24:03.49751581 +0000 UTC m=+29.822237707"
Jul 13 15:24:03.520807 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:03.520779    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hdgtx"]
Jul 13 15:24:03.520993 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:03.520914    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hdgtx"
Jul 13 15:24:03.521132 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:03.521023    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hdgtx" podUID="1f78133a-9d4f-47fb-8253-2220a6139ab9"
Jul 13 15:24:03.524796 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:03.524772    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jfg9j"]
Jul 13 15:24:03.524919 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:03.524896    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfg9j"
Jul 13 15:24:03.525024 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:03.524997    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfg9j" podUID="d349b31c-c0a7-4dfb-b91d-62e55ef016b6"
Jul 13 15:24:03.525754 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:03.525725    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5bv64"]
Jul 13 15:24:03.526020 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:03.525865    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bv64"
Jul 13 15:24:03.526020 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:03.525994    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bv64" podUID="d500cafe-37f3-4c98-8bef-63ba985b79fa"
Jul 13 15:24:03.626219 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:03.626185    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:24:04.472283 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:04.472242    2555 generic.go:356] "Generic (PLEG): container finished" podID="25a82f60-2fa2-49cb-b7fc-84496432841f" containerID="5a64714c2278c94ca36dec0071d121bfb54e620a09ee38a4bf39a03311b50658" exitCode=0
Jul 13 15:24:04.472826 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:04.472342    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjmns" event={"ID":"25a82f60-2fa2-49cb-b7fc-84496432841f","Type":"ContainerDied","Data":"5a64714c2278c94ca36dec0071d121bfb54e620a09ee38a4bf39a03311b50658"}
Jul 13 15:24:05.197443 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:05.197406    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bv64"
Jul 13 15:24:05.197608 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:05.197451    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hdgtx"
Jul 13 15:24:05.197608 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:05.197408    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfg9j"
Jul 13 15:24:05.197608 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:05.197532    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bv64" podUID="d500cafe-37f3-4c98-8bef-63ba985b79fa"
Jul 13 15:24:05.197716 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:05.197618    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfg9j" podUID="d349b31c-c0a7-4dfb-b91d-62e55ef016b6"
Jul 13 15:24:05.197716 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:05.197691    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hdgtx" podUID="1f78133a-9d4f-47fb-8253-2220a6139ab9"
Jul 13 15:24:06.157664 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:06.157470    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-474qm"
Jul 13 15:24:06.158210 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:06.157766    2555 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 13 15:24:06.158210 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:06.158124    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-474qm"
Jul 13 15:24:06.478283 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:06.478251    2555 generic.go:356] "Generic (PLEG): container finished" podID="25a82f60-2fa2-49cb-b7fc-84496432841f" containerID="bc8ee3458448a2898e1fb92bba33f52290ad1cc67217322a450ae0d03e82589d" exitCode=0
Jul 13 15:24:06.478472 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:06.478338    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjmns" event={"ID":"25a82f60-2fa2-49cb-b7fc-84496432841f","Type":"ContainerDied","Data":"bc8ee3458448a2898e1fb92bba33f52290ad1cc67217322a450ae0d03e82589d"}
Jul 13 15:24:07.197319 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:07.197235    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfg9j"
Jul 13 15:24:07.197319 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:07.197271    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hdgtx"
Jul 13 15:24:07.197934 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:07.197235    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bv64"
Jul 13 15:24:07.197934 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:07.197355    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfg9j" podUID="d349b31c-c0a7-4dfb-b91d-62e55ef016b6"
Jul 13 15:24:07.197934 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:07.197425    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hdgtx" podUID="1f78133a-9d4f-47fb-8253-2220a6139ab9"
Jul 13 15:24:07.197934 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:07.197505    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5bv64" podUID="d500cafe-37f3-4c98-8bef-63ba985b79fa"
Jul 13 15:24:07.952523 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:07.952450    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d500cafe-37f3-4c98-8bef-63ba985b79fa-metrics-certs\") pod \"network-metrics-daemon-5bv64\" (UID: \"d500cafe-37f3-4c98-8bef-63ba985b79fa\") " pod="openshift-multus/network-metrics-daemon-5bv64"
Jul 13 15:24:07.952721 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:07.952626    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f78133a-9d4f-47fb-8253-2220a6139ab9-original-pull-secret\") pod \"global-pull-secret-syncer-hdgtx\" (UID: \"1f78133a-9d4f-47fb-8253-2220a6139ab9\") " pod="kube-system/global-pull-secret-syncer-hdgtx"
Jul 13 15:24:07.952721 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:07.952648    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 15:24:07.952845 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:07.952726    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d500cafe-37f3-4c98-8bef-63ba985b79fa-metrics-certs podName:d500cafe-37f3-4c98-8bef-63ba985b79fa nodeName:}" failed. No retries permitted until 2026-07-13 15:24:39.952702605 +0000 UTC m=+66.277424488 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d500cafe-37f3-4c98-8bef-63ba985b79fa-metrics-certs") pod "network-metrics-daemon-5bv64" (UID: "d500cafe-37f3-4c98-8bef-63ba985b79fa") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 15:24:07.952845 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:07.952734    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 15:24:07.952845 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:07.952783    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f78133a-9d4f-47fb-8253-2220a6139ab9-original-pull-secret podName:1f78133a-9d4f-47fb-8253-2220a6139ab9 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:39.952768348 +0000 UTC m=+66.277490242 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f78133a-9d4f-47fb-8253-2220a6139ab9-original-pull-secret") pod "global-pull-secret-syncer-hdgtx" (UID: "1f78133a-9d4f-47fb-8253-2220a6139ab9") : object "kube-system"/"original-pull-secret" not registered
Jul 13 15:24:08.052935 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:08.052900    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5c6d\" (UniqueName: \"kubernetes.io/projected/d349b31c-c0a7-4dfb-b91d-62e55ef016b6-kube-api-access-b5c6d\") pod \"network-check-target-jfg9j\" (UID: \"d349b31c-c0a7-4dfb-b91d-62e55ef016b6\") " pod="openshift-network-diagnostics/network-check-target-jfg9j"
Jul 13 15:24:08.053113 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:08.053077    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 15:24:08.053113 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:08.053106    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 15:24:08.053213 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:08.053118    2555 projected.go:196] Error preparing data for projected volume kube-api-access-b5c6d for pod openshift-network-diagnostics/network-check-target-jfg9j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 15:24:08.053213 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:08.053174    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d349b31c-c0a7-4dfb-b91d-62e55ef016b6-kube-api-access-b5c6d podName:d349b31c-c0a7-4dfb-b91d-62e55ef016b6 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:40.053159405 +0000 UTC m=+66.377881306 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-b5c6d" (UniqueName: "kubernetes.io/projected/d349b31c-c0a7-4dfb-b91d-62e55ef016b6-kube-api-access-b5c6d") pod "network-check-target-jfg9j" (UID: "d349b31c-c0a7-4dfb-b91d-62e55ef016b6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 15:24:08.960722 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:08.960688    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-93.ec2.internal" event="NodeReady"
Jul 13 15:24:08.961147 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:08.960848    2555 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 13 15:24:09.008328 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.008292    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-79dcbccd46-gmr5j"]
Jul 13 15:24:09.011136 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.011113    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79dcbccd46-gmr5j"
Jul 13 15:24:09.015293 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.014909    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 13 15:24:09.015293 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.014988    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4pjzc\""
Jul 13 15:24:09.015293 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.015139    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 13 15:24:09.015293 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.015256    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 13 15:24:09.022970 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.022946    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 13 15:24:09.027890 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.027862    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tdnrr"]
Jul 13 15:24:09.030369 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.030344    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-z7kxm"]
Jul 13 15:24:09.030990 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.030965    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tdnrr"
Jul 13 15:24:09.032788 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.032767    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wjf6q"]
Jul 13 15:24:09.032929 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.032906    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-z7kxm"
Jul 13 15:24:09.033045 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.033029    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 13 15:24:09.033395 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.033378    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dhlhs\""
Jul 13 15:24:09.033480 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.033380    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 13 15:24:09.035397 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.035377    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 13 15:24:09.035397 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.035394    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-4h9cz\""
Jul 13 15:24:09.035539 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.035485    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-cptrx"]
Jul 13 15:24:09.035718 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.035700    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 13 15:24:09.035905 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.035831    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wjf6q"
Jul 13 15:24:09.037911 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.037883    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 13 15:24:09.037911 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.037907    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-cptrx"
Jul 13 15:24:09.039870 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.038512    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 13 15:24:09.039870 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.038548    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 13 15:24:09.041033 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.041016    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-kc7zl\""
Jul 13 15:24:09.041668 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.041647    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 13 15:24:09.041802 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.041708    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 13 15:24:09.041802 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.041777    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 13 15:24:09.041959 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.041942    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-64lwg\""
Jul 13 15:24:09.042473 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.042451    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79dcbccd46-gmr5j"]
Jul 13 15:24:09.042661 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.042644    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 13 15:24:09.049760 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.049668    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-z7kxm"]
Jul 13 15:24:09.052272 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.052250    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 13 15:24:09.054098 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.053714    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wjf6q"]
Jul 13 15:24:09.055213 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.055190    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6f55fdf65b-nwzqz"]
Jul 13 15:24:09.058224 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.058202    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hmvfz"]
Jul 13 15:24:09.058578 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.058552    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6f55fdf65b-nwzqz"
Jul 13 15:24:09.060853 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.060833    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-t4nd7"]
Jul 13 15:24:09.060966 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.060945    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hmvfz"
Jul 13 15:24:09.063025 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.062999    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 13 15:24:09.063228 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.063001    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 13 15:24:09.063647 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.063627    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 13 15:24:09.063749 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.063727    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 13 15:24:09.064470 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.064449    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 13 15:24:09.065199 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.065118    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 13 15:24:09.066648 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.066628    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tdnrr"]
Jul 13 15:24:09.066716 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.066680    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-tc2dm"]
Jul 13 15:24:09.066716 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.066694    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-cdb8m\""
Jul 13 15:24:09.068261 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.067045    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 13 15:24:09.068261 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.067279    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 13 15:24:09.068261 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.067706    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 13 15:24:09.068261 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.065026    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-wgk4b\""
Jul 13 15:24:09.069005 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.068645    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-t4nd7"
Jul 13 15:24:09.069144 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.069055    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 13 15:24:09.071604 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.071552    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wqtv7"]
Jul 13 15:24:09.073567 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.071946    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-tc2dm"
Jul 13 15:24:09.073567 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.073067    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 13 15:24:09.073567 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.073114    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 13 15:24:09.073567 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.073423    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-97rjd\""
Jul 13 15:24:09.076119 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.074445    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 13 15:24:09.076119 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.074678    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 13 15:24:09.076119 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.075433    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 13 15:24:09.077245 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.077143    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-8b9bs\""
Jul 13 15:24:09.080301 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.080273    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-nn7v5"]
Jul 13 15:24:09.080967 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.080947    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wqtv7"
Jul 13 15:24:09.082475 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.082406    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 13 15:24:09.083401 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.083383    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 13 15:24:09.083893 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.083873    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-qtd84"]
Jul 13 15:24:09.084070 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.084055    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-n8x6l\""
Jul 13 15:24:09.084407 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.084205    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 13 15:24:09.084407 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.084221    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 13 15:24:09.084617 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.084597    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-nn7v5"
Jul 13 15:24:09.088334 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.088282    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qtg8w"]
Jul 13 15:24:09.088428 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.088418    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-qtd84"
Jul 13 15:24:09.088899 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.088875    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 13 15:24:09.088997 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.088898    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-4v4cm\""
Jul 13 15:24:09.089117 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.088879    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 13 15:24:09.089728 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.089709    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 13 15:24:09.089967 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.089951    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 13 15:24:09.092817 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.092793    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-cptrx"]
Jul 13 15:24:09.092900 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.092891    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qtg8w"
Jul 13 15:24:09.092998 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.092980    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-t4nd7"]
Jul 13 15:24:09.093131 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.093014    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hmvfz"]
Jul 13 15:24:09.093131 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.093036    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wqtv7"]
Jul 13 15:24:09.093131 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.093058    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qtg8w"]
Jul 13 15:24:09.093131 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.093075    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-tc2dm"]
Jul 13 15:24:09.093131 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.093094    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6f55fdf65b-nwzqz"]
Jul 13 15:24:09.093131 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.093113    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-nn7v5"]
Jul 13 15:24:09.093131 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.093129    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-qtd84"]
Jul 13 15:24:09.094164 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.093542    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 13 15:24:09.095852 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.095828    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-h8kxg\""
Jul 13 15:24:09.095958 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.095868    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 13 15:24:09.096021 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.095999    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 13 15:24:09.097164 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.097144    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-v8sn8\""
Jul 13 15:24:09.097414 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.097397    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 13 15:24:09.097652 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.097636    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 13 15:24:09.097866 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.097847    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 13 15:24:09.098013 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.097994    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 13 15:24:09.160782 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.160751    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9d90766b-99c5-4d7e-966a-1b413eabd11b-ca-trust-extracted\") pod \"image-registry-79dcbccd46-gmr5j\" (UID: \"9d90766b-99c5-4d7e-966a-1b413eabd11b\") " pod="openshift-image-registry/image-registry-79dcbccd46-gmr5j"
Jul 13 15:24:09.160782 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.160784    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/345f2b29-8ee5-4aef-97b7-422594da4954-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-tc2dm\" (UID: \"345f2b29-8ee5-4aef-97b7-422594da4954\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-tc2dm"
Jul 13 15:24:09.161025 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.160803    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g8c9\" (UniqueName: \"kubernetes.io/projected/72ca268f-c70d-4218-a657-7f1f9f4b1d7c-kube-api-access-8g8c9\") pod \"dns-default-tdnrr\" (UID: \"72ca268f-c70d-4218-a657-7f1f9f4b1d7c\") " pod="openshift-dns/dns-default-tdnrr"
Jul 13 15:24:09.161025 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.160819    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn7h4\" (UniqueName: \"kubernetes.io/projected/b144994d-e58a-4d9c-a003-891172fabc9a-kube-api-access-bn7h4\") pod \"router-default-6f55fdf65b-nwzqz\" (UID: \"b144994d-e58a-4d9c-a003-891172fabc9a\") " pod="openshift-ingress/router-default-6f55fdf65b-nwzqz"
Jul 13 15:24:09.161025 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.160839    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfmnh\" (UniqueName: \"kubernetes.io/projected/37fedee3-825f-430e-9000-bdf6e5c8c4a3-kube-api-access-nfmnh\") pod \"cluster-samples-operator-65db858894-wjf6q\" (UID: \"37fedee3-825f-430e-9000-bdf6e5c8c4a3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wjf6q"
Jul 13 15:24:09.161025 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.160920    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/42b230fa-7a3d-43ef-909f-24805511fd6d-snapshots\") pod \"insights-operator-68d9dd94cf-nn7v5\" (UID: \"42b230fa-7a3d-43ef-909f-24805511fd6d\") " pod="openshift-insights/insights-operator-68d9dd94cf-nn7v5"
Jul 13 15:24:09.161025 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.160960    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jqdr\" (UniqueName: \"kubernetes.io/projected/b605a361-0f6b-4318-b532-efcfbd569501-kube-api-access-2jqdr\") pod \"cluster-monitoring-operator-5f7f494dd4-hmvfz\" (UID: \"b605a361-0f6b-4318-b532-efcfbd569501\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hmvfz"
Jul 13 15:24:09.161025 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.160990    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d90766b-99c5-4d7e-966a-1b413eabd11b-bound-sa-token\") pod \"image-registry-79dcbccd46-gmr5j\" (UID: \"9d90766b-99c5-4d7e-966a-1b413eabd11b\") " pod="openshift-image-registry/image-registry-79dcbccd46-gmr5j"
Jul 13 15:24:09.161025 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.161018    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42b230fa-7a3d-43ef-909f-24805511fd6d-tmp\") pod \"insights-operator-68d9dd94cf-nn7v5\" (UID: \"42b230fa-7a3d-43ef-909f-24805511fd6d\") " pod="openshift-insights/insights-operator-68d9dd94cf-nn7v5"
Jul 13 15:24:09.161294 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.161078    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d90766b-99c5-4d7e-966a-1b413eabd11b-registry-tls\") pod \"image-registry-79dcbccd46-gmr5j\" (UID: \"9d90766b-99c5-4d7e-966a-1b413eabd11b\") " pod="openshift-image-registry/image-registry-79dcbccd46-gmr5j"
Jul 13 15:24:09.161294 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.161117    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grnj6\" (UniqueName: \"kubernetes.io/projected/63c0fc8b-9a59-4a66-81e6-f712ebed0254-kube-api-access-grnj6\") pod \"service-ca-operator-7695fc6c8c-t4nd7\" (UID: \"63c0fc8b-9a59-4a66-81e6-f712ebed0254\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-t4nd7"
Jul 13 15:24:09.161294 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.161171    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b144994d-e58a-4d9c-a003-891172fabc9a-stats-auth\") pod \"router-default-6f55fdf65b-nwzqz\" (UID: \"b144994d-e58a-4d9c-a003-891172fabc9a\") " pod="openshift-ingress/router-default-6f55fdf65b-nwzqz"
Jul 13 15:24:09.161294 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.161203    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42b230fa-7a3d-43ef-909f-24805511fd6d-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-nn7v5\" (UID: \"42b230fa-7a3d-43ef-909f-24805511fd6d\") " pod="openshift-insights/insights-operator-68d9dd94cf-nn7v5"
Jul 13 15:24:09.161294 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.161228    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42b230fa-7a3d-43ef-909f-24805511fd6d-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-nn7v5\" (UID: \"42b230fa-7a3d-43ef-909f-24805511fd6d\") " pod="openshift-insights/insights-operator-68d9dd94cf-nn7v5"
Jul 13 15:24:09.161294 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.161255    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72ca268f-c70d-4218-a657-7f1f9f4b1d7c-tmp-dir\") pod \"dns-default-tdnrr\" (UID: \"72ca268f-c70d-4218-a657-7f1f9f4b1d7c\") " pod="openshift-dns/dns-default-tdnrr"
Jul 13 15:24:09.161294 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.161290    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/63c0fc8b-9a59-4a66-81e6-f712ebed0254-serving-cert\") pod \"service-ca-operator-7695fc6c8c-t4nd7\" (UID: \"63c0fc8b-9a59-4a66-81e6-f712ebed0254\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-t4nd7"
Jul 13 15:24:09.161508 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.161319    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/90f53326-a36e-4682-a268-bdfec7cf722b-trusted-ca\") pod \"console-operator-7866497494-cptrx\" (UID: \"90f53326-a36e-4682-a268-bdfec7cf722b\") " pod="openshift-console-operator/console-operator-7866497494-cptrx"
Jul 13 15:24:09.161508 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.161367    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b144994d-e58a-4d9c-a003-891172fabc9a-default-certificate\") pod \"router-default-6f55fdf65b-nwzqz\" (UID: \"b144994d-e58a-4d9c-a003-891172fabc9a\") " pod="openshift-ingress/router-default-6f55fdf65b-nwzqz"
Jul 13 15:24:09.161508 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.161383    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4w8s\" (UniqueName: \"kubernetes.io/projected/5ee75ad9-88fc-477e-af2f-d31a4c51801f-kube-api-access-j4w8s\") pod \"ingress-canary-wqtv7\" (UID: \"5ee75ad9-88fc-477e-af2f-d31a4c51801f\") " pod="openshift-ingress-canary/ingress-canary-wqtv7"
Jul 13 15:24:09.161508 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.161407    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d90766b-99c5-4d7e-966a-1b413eabd11b-trusted-ca\") pod \"image-registry-79dcbccd46-gmr5j\" (UID: \"9d90766b-99c5-4d7e-966a-1b413eabd11b\") " pod="openshift-image-registry/image-registry-79dcbccd46-gmr5j"
Jul 13 15:24:09.161508 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.161431    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh88w\" (UniqueName: \"kubernetes.io/projected/42b230fa-7a3d-43ef-909f-24805511fd6d-kube-api-access-hh88w\") pod \"insights-operator-68d9dd94cf-nn7v5\" (UID: \"42b230fa-7a3d-43ef-909f-24805511fd6d\") " pod="openshift-insights/insights-operator-68d9dd94cf-nn7v5"
Jul 13 15:24:09.161508 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.161455    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7ktb\" (UniqueName: \"kubernetes.io/projected/90f53326-a36e-4682-a268-bdfec7cf722b-kube-api-access-b7ktb\") pod \"console-operator-7866497494-cptrx\" (UID: \"90f53326-a36e-4682-a268-bdfec7cf722b\") " pod="openshift-console-operator/console-operator-7866497494-cptrx"
Jul 13 15:24:09.161508 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.161476    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/72ca268f-c70d-4218-a657-7f1f9f4b1d7c-config-volume\") pod \"dns-default-tdnrr\" (UID: \"72ca268f-c70d-4218-a657-7f1f9f4b1d7c\") " pod="openshift-dns/dns-default-tdnrr"
Jul 13 15:24:09.161508 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.161500    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5l55\" (UniqueName: \"kubernetes.io/projected/9d90766b-99c5-4d7e-966a-1b413eabd11b-kube-api-access-x5l55\") pod \"image-registry-79dcbccd46-gmr5j\" (UID: \"9d90766b-99c5-4d7e-966a-1b413eabd11b\") " pod="openshift-image-registry/image-registry-79dcbccd46-gmr5j"
Jul 13 15:24:09.161748 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.161529    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/345f2b29-8ee5-4aef-97b7-422594da4954-nginx-conf\") pod \"networking-console-plugin-6cf856758c-tc2dm\" (UID: \"345f2b29-8ee5-4aef-97b7-422594da4954\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-tc2dm"
Jul 13 15:24:09.161748 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.161562    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ee75ad9-88fc-477e-af2f-d31a4c51801f-cert\") pod \"ingress-canary-wqtv7\" (UID: \"5ee75ad9-88fc-477e-af2f-d31a4c51801f\") " pod="openshift-ingress-canary/ingress-canary-wqtv7"
Jul 13 15:24:09.161748 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.161612    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/90f53326-a36e-4682-a268-bdfec7cf722b-config\") pod \"console-operator-7866497494-cptrx\" (UID: \"90f53326-a36e-4682-a268-bdfec7cf722b\") " pod="openshift-console-operator/console-operator-7866497494-cptrx"
Jul 13 15:24:09.161748 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.161651    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/90f53326-a36e-4682-a268-bdfec7cf722b-serving-cert\") pod \"console-operator-7866497494-cptrx\" (UID: \"90f53326-a36e-4682-a268-bdfec7cf722b\") " pod="openshift-console-operator/console-operator-7866497494-cptrx"
Jul 13 15:24:09.161748 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.161679    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b605a361-0f6b-4318-b532-efcfbd569501-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-hmvfz\" (UID: \"b605a361-0f6b-4318-b532-efcfbd569501\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hmvfz"
Jul 13 15:24:09.161748 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.161697    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/63c0fc8b-9a59-4a66-81e6-f712ebed0254-config\") pod \"service-ca-operator-7695fc6c8c-t4nd7\" (UID: \"63c0fc8b-9a59-4a66-81e6-f712ebed0254\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-t4nd7"
Jul 13 15:24:09.161748 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.161727    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/42b230fa-7a3d-43ef-909f-24805511fd6d-serving-cert\") pod \"insights-operator-68d9dd94cf-nn7v5\" (UID: \"42b230fa-7a3d-43ef-909f-24805511fd6d\") " pod="openshift-insights/insights-operator-68d9dd94cf-nn7v5"
Jul 13 15:24:09.161748 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.161748    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9d90766b-99c5-4d7e-966a-1b413eabd11b-image-registry-private-configuration\") pod \"image-registry-79dcbccd46-gmr5j\" (UID: \"9d90766b-99c5-4d7e-966a-1b413eabd11b\") " pod="openshift-image-registry/image-registry-79dcbccd46-gmr5j"
Jul 13 15:24:09.161972 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.161763    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9d90766b-99c5-4d7e-966a-1b413eabd11b-registry-certificates\") pod \"image-registry-79dcbccd46-gmr5j\" (UID: \"9d90766b-99c5-4d7e-966a-1b413eabd11b\") " pod="openshift-image-registry/image-registry-79dcbccd46-gmr5j"
Jul 13 15:24:09.161972 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.161779    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh8t7\" (UniqueName: \"kubernetes.io/projected/1c806596-8c96-44b3-ac4d-a5abb6d6c3c7-kube-api-access-mh8t7\") pod \"network-check-source-869dcfcdcd-qtd84\" (UID: \"1c806596-8c96-44b3-ac4d-a5abb6d6c3c7\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-qtd84"
Jul 13 15:24:09.161972 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.161817    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/72ca268f-c70d-4218-a657-7f1f9f4b1d7c-metrics-tls\") pod \"dns-default-tdnrr\" (UID: \"72ca268f-c70d-4218-a657-7f1f9f4b1d7c\") " pod="openshift-dns/dns-default-tdnrr"
Jul 13 15:24:09.161972 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.161839    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b605a361-0f6b-4318-b532-efcfbd569501-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-hmvfz\" (UID: \"b605a361-0f6b-4318-b532-efcfbd569501\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hmvfz"
Jul 13 15:24:09.161972 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.161867    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b144994d-e58a-4d9c-a003-891172fabc9a-metrics-certs\") pod \"router-default-6f55fdf65b-nwzqz\" (UID: \"b144994d-e58a-4d9c-a003-891172fabc9a\") " pod="openshift-ingress/router-default-6f55fdf65b-nwzqz"
Jul 13 15:24:09.161972 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.161889    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9d90766b-99c5-4d7e-966a-1b413eabd11b-installation-pull-secrets\") pod \"image-registry-79dcbccd46-gmr5j\" (UID: \"9d90766b-99c5-4d7e-966a-1b413eabd11b\") " pod="openshift-image-registry/image-registry-79dcbccd46-gmr5j"
Jul 13 15:24:09.161972 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.161903    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/37fedee3-825f-430e-9000-bdf6e5c8c4a3-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-wjf6q\" (UID: \"37fedee3-825f-430e-9000-bdf6e5c8c4a3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wjf6q"
Jul 13 15:24:09.161972 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.161919    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxhvq\" (UniqueName: \"kubernetes.io/projected/30748184-f09b-494c-bb8d-04fa13aff3b9-kube-api-access-pxhvq\") pod \"volume-data-source-validator-78495597f6-z7kxm\" (UID: \"30748184-f09b-494c-bb8d-04fa13aff3b9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-z7kxm"
Jul 13 15:24:09.161972 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.161937    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b144994d-e58a-4d9c-a003-891172fabc9a-service-ca-bundle\") pod \"router-default-6f55fdf65b-nwzqz\" (UID: \"b144994d-e58a-4d9c-a003-891172fabc9a\") " pod="openshift-ingress/router-default-6f55fdf65b-nwzqz"
Jul 13 15:24:09.197192 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.197152    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bv64"
Jul 13 15:24:09.197376 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.197199    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hdgtx"
Jul 13 15:24:09.197376 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.197199    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfg9j"
Jul 13 15:24:09.201280 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.201256    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 13 15:24:09.201411 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.201363    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hbtnc\""
Jul 13 15:24:09.201768 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.201747    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-489nl\""
Jul 13 15:24:09.205521 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.205499    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 13 15:24:09.263512 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.263477    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b605a361-0f6b-4318-b532-efcfbd569501-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-hmvfz\" (UID: \"b605a361-0f6b-4318-b532-efcfbd569501\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hmvfz"
Jul 13 15:24:09.263722 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.263524    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/63c0fc8b-9a59-4a66-81e6-f712ebed0254-config\") pod \"service-ca-operator-7695fc6c8c-t4nd7\" (UID: \"63c0fc8b-9a59-4a66-81e6-f712ebed0254\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-t4nd7"
Jul 13 15:24:09.263722 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.263559    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dh8n\" (UniqueName: \"kubernetes.io/projected/118282ab-3ef5-49f2-ad43-9d5eefdacf9b-kube-api-access-8dh8n\") pod \"kube-storage-version-migrator-operator-799cb7f958-qtg8w\" (UID: \"118282ab-3ef5-49f2-ad43-9d5eefdacf9b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qtg8w"
Jul 13 15:24:09.263722 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.263615    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/42b230fa-7a3d-43ef-909f-24805511fd6d-serving-cert\") pod \"insights-operator-68d9dd94cf-nn7v5\" (UID: \"42b230fa-7a3d-43ef-909f-24805511fd6d\") " pod="openshift-insights/insights-operator-68d9dd94cf-nn7v5"
Jul 13 15:24:09.263722 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.263640    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9d90766b-99c5-4d7e-966a-1b413eabd11b-image-registry-private-configuration\") pod \"image-registry-79dcbccd46-gmr5j\" (UID: \"9d90766b-99c5-4d7e-966a-1b413eabd11b\") " pod="openshift-image-registry/image-registry-79dcbccd46-gmr5j"
Jul 13 15:24:09.263722 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:09.263707    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 13 15:24:09.263974 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.263816    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9d90766b-99c5-4d7e-966a-1b413eabd11b-registry-certificates\") pod \"image-registry-79dcbccd46-gmr5j\" (UID: \"9d90766b-99c5-4d7e-966a-1b413eabd11b\") " pod="openshift-image-registry/image-registry-79dcbccd46-gmr5j"
Jul 13 15:24:09.263974 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:09.263831    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b605a361-0f6b-4318-b532-efcfbd569501-cluster-monitoring-operator-tls podName:b605a361-0f6b-4318-b532-efcfbd569501 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:09.763809585 +0000 UTC m=+36.088531461 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b605a361-0f6b-4318-b532-efcfbd569501-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-hmvfz" (UID: "b605a361-0f6b-4318-b532-efcfbd569501") : secret "cluster-monitoring-operator-tls" not found
Jul 13 15:24:09.263974 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.263868    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh8t7\" (UniqueName: \"kubernetes.io/projected/1c806596-8c96-44b3-ac4d-a5abb6d6c3c7-kube-api-access-mh8t7\") pod \"network-check-source-869dcfcdcd-qtd84\" (UID: \"1c806596-8c96-44b3-ac4d-a5abb6d6c3c7\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-qtd84"
Jul 13 15:24:09.263974 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.263902    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/72ca268f-c70d-4218-a657-7f1f9f4b1d7c-metrics-tls\") pod \"dns-default-tdnrr\" (UID: \"72ca268f-c70d-4218-a657-7f1f9f4b1d7c\") " pod="openshift-dns/dns-default-tdnrr"
Jul 13 15:24:09.263974 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.263929    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b605a361-0f6b-4318-b532-efcfbd569501-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-hmvfz\" (UID: \"b605a361-0f6b-4318-b532-efcfbd569501\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hmvfz"
Jul 13 15:24:09.263974 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.263960    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b144994d-e58a-4d9c-a003-891172fabc9a-metrics-certs\") pod \"router-default-6f55fdf65b-nwzqz\" (UID: \"b144994d-e58a-4d9c-a003-891172fabc9a\") " pod="openshift-ingress/router-default-6f55fdf65b-nwzqz"
Jul 13 15:24:09.264213 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.263983    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9d90766b-99c5-4d7e-966a-1b413eabd11b-installation-pull-secrets\") pod \"image-registry-79dcbccd46-gmr5j\" (UID: \"9d90766b-99c5-4d7e-966a-1b413eabd11b\") " pod="openshift-image-registry/image-registry-79dcbccd46-gmr5j"
Jul 13 15:24:09.264213 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.264005    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/37fedee3-825f-430e-9000-bdf6e5c8c4a3-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-wjf6q\" (UID: \"37fedee3-825f-430e-9000-bdf6e5c8c4a3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wjf6q"
Jul 13 15:24:09.264213 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.264029    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxhvq\" (UniqueName: \"kubernetes.io/projected/30748184-f09b-494c-bb8d-04fa13aff3b9-kube-api-access-pxhvq\") pod \"volume-data-source-validator-78495597f6-z7kxm\" (UID: \"30748184-f09b-494c-bb8d-04fa13aff3b9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-z7kxm"
Jul 13 15:24:09.264213 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.264054    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b144994d-e58a-4d9c-a003-891172fabc9a-service-ca-bundle\") pod \"router-default-6f55fdf65b-nwzqz\" (UID: \"b144994d-e58a-4d9c-a003-891172fabc9a\") " pod="openshift-ingress/router-default-6f55fdf65b-nwzqz"
Jul 13 15:24:09.264213 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.264080    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9d90766b-99c5-4d7e-966a-1b413eabd11b-ca-trust-extracted\") pod \"image-registry-79dcbccd46-gmr5j\" (UID: \"9d90766b-99c5-4d7e-966a-1b413eabd11b\") " pod="openshift-image-registry/image-registry-79dcbccd46-gmr5j"
Jul 13 15:24:09.264213 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.264102    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/345f2b29-8ee5-4aef-97b7-422594da4954-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-tc2dm\" (UID: \"345f2b29-8ee5-4aef-97b7-422594da4954\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-tc2dm"
Jul 13 15:24:09.264213 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.264124    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g8c9\" (UniqueName: \"kubernetes.io/projected/72ca268f-c70d-4218-a657-7f1f9f4b1d7c-kube-api-access-8g8c9\") pod \"dns-default-tdnrr\" (UID: \"72ca268f-c70d-4218-a657-7f1f9f4b1d7c\") " pod="openshift-dns/dns-default-tdnrr"
Jul 13 15:24:09.264213 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.264148    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn7h4\" (UniqueName: \"kubernetes.io/projected/b144994d-e58a-4d9c-a003-891172fabc9a-kube-api-access-bn7h4\") pod \"router-default-6f55fdf65b-nwzqz\" (UID: \"b144994d-e58a-4d9c-a003-891172fabc9a\") " pod="openshift-ingress/router-default-6f55fdf65b-nwzqz"
Jul 13 15:24:09.264213 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.264172    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfmnh\" (UniqueName: \"kubernetes.io/projected/37fedee3-825f-430e-9000-bdf6e5c8c4a3-kube-api-access-nfmnh\") pod \"cluster-samples-operator-65db858894-wjf6q\" (UID: \"37fedee3-825f-430e-9000-bdf6e5c8c4a3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wjf6q"
Jul 13 15:24:09.264213 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.264205    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/42b230fa-7a3d-43ef-909f-24805511fd6d-snapshots\") pod \"insights-operator-68d9dd94cf-nn7v5\" (UID: \"42b230fa-7a3d-43ef-909f-24805511fd6d\") " pod="openshift-insights/insights-operator-68d9dd94cf-nn7v5"
Jul 13 15:24:09.264726 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.264229    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/118282ab-3ef5-49f2-ad43-9d5eefdacf9b-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-qtg8w\" (UID: \"118282ab-3ef5-49f2-ad43-9d5eefdacf9b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qtg8w"
Jul 13 15:24:09.264726 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.264271    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jqdr\" (UniqueName: \"kubernetes.io/projected/b605a361-0f6b-4318-b532-efcfbd569501-kube-api-access-2jqdr\") pod \"cluster-monitoring-operator-5f7f494dd4-hmvfz\" (UID: \"b605a361-0f6b-4318-b532-efcfbd569501\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hmvfz"
Jul 13 15:24:09.264726 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.264297    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d90766b-99c5-4d7e-966a-1b413eabd11b-bound-sa-token\") pod \"image-registry-79dcbccd46-gmr5j\" (UID: \"9d90766b-99c5-4d7e-966a-1b413eabd11b\") " pod="openshift-image-registry/image-registry-79dcbccd46-gmr5j"
Jul 13 15:24:09.264726 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.264303    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/63c0fc8b-9a59-4a66-81e6-f712ebed0254-config\") pod \"service-ca-operator-7695fc6c8c-t4nd7\" (UID: \"63c0fc8b-9a59-4a66-81e6-f712ebed0254\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-t4nd7"
Jul 13 15:24:09.264726 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.264326    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42b230fa-7a3d-43ef-909f-24805511fd6d-tmp\") pod \"insights-operator-68d9dd94cf-nn7v5\" (UID: \"42b230fa-7a3d-43ef-909f-24805511fd6d\") " pod="openshift-insights/insights-operator-68d9dd94cf-nn7v5"
Jul 13 15:24:09.264726 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.264360    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9d90766b-99c5-4d7e-966a-1b413eabd11b-registry-certificates\") pod \"image-registry-79dcbccd46-gmr5j\" (UID: \"9d90766b-99c5-4d7e-966a-1b413eabd11b\") " pod="openshift-image-registry/image-registry-79dcbccd46-gmr5j"
Jul 13 15:24:09.264726 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:09.264444    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b144994d-e58a-4d9c-a003-891172fabc9a-service-ca-bundle podName:b144994d-e58a-4d9c-a003-891172fabc9a nodeName:}" failed. No retries permitted until 2026-07-13 15:24:09.764425885 +0000 UTC m=+36.089147796 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b144994d-e58a-4d9c-a003-891172fabc9a-service-ca-bundle") pod "router-default-6f55fdf65b-nwzqz" (UID: "b144994d-e58a-4d9c-a003-891172fabc9a") : configmap references non-existent config key: service-ca.crt
Jul 13 15:24:09.264726 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:09.264510    2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 13 15:24:09.264726 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:09.264525    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 15:24:09.264726 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:09.264545    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b144994d-e58a-4d9c-a003-891172fabc9a-metrics-certs podName:b144994d-e58a-4d9c-a003-891172fabc9a nodeName:}" failed. No retries permitted until 2026-07-13 15:24:09.764533556 +0000 UTC m=+36.089255460 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b144994d-e58a-4d9c-a003-891172fabc9a-metrics-certs") pod "router-default-6f55fdf65b-nwzqz" (UID: "b144994d-e58a-4d9c-a003-891172fabc9a") : secret "router-metrics-certs-default" not found
Jul 13 15:24:09.264726 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:09.264613    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72ca268f-c70d-4218-a657-7f1f9f4b1d7c-metrics-tls podName:72ca268f-c70d-4218-a657-7f1f9f4b1d7c nodeName:}" failed. No retries permitted until 2026-07-13 15:24:09.764573371 +0000 UTC m=+36.089295281 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/72ca268f-c70d-4218-a657-7f1f9f4b1d7c-metrics-tls") pod "dns-default-tdnrr" (UID: "72ca268f-c70d-4218-a657-7f1f9f4b1d7c") : secret "dns-default-metrics-tls" not found
Jul 13 15:24:09.264726 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.264645    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d90766b-99c5-4d7e-966a-1b413eabd11b-registry-tls\") pod \"image-registry-79dcbccd46-gmr5j\" (UID: \"9d90766b-99c5-4d7e-966a-1b413eabd11b\") " pod="openshift-image-registry/image-registry-79dcbccd46-gmr5j"
Jul 13 15:24:09.264726 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.264662    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42b230fa-7a3d-43ef-909f-24805511fd6d-tmp\") pod \"insights-operator-68d9dd94cf-nn7v5\" (UID: \"42b230fa-7a3d-43ef-909f-24805511fd6d\") " pod="openshift-insights/insights-operator-68d9dd94cf-nn7v5"
Jul 13 15:24:09.264726 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.264687    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grnj6\" (UniqueName: \"kubernetes.io/projected/63c0fc8b-9a59-4a66-81e6-f712ebed0254-kube-api-access-grnj6\") pod \"service-ca-operator-7695fc6c8c-t4nd7\" (UID: \"63c0fc8b-9a59-4a66-81e6-f712ebed0254\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-t4nd7"
Jul 13 15:24:09.264726 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:09.264716    2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 13 15:24:09.264726 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.264726    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b144994d-e58a-4d9c-a003-891172fabc9a-stats-auth\") pod \"router-default-6f55fdf65b-nwzqz\" (UID: \"b144994d-e58a-4d9c-a003-891172fabc9a\") " pod="openshift-ingress/router-default-6f55fdf65b-nwzqz"
Jul 13 15:24:09.265452 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.264756    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42b230fa-7a3d-43ef-909f-24805511fd6d-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-nn7v5\" (UID: \"42b230fa-7a3d-43ef-909f-24805511fd6d\") " pod="openshift-insights/insights-operator-68d9dd94cf-nn7v5"
Jul 13 15:24:09.265452 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:09.264780    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37fedee3-825f-430e-9000-bdf6e5c8c4a3-samples-operator-tls podName:37fedee3-825f-430e-9000-bdf6e5c8c4a3 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:09.764762645 +0000 UTC m=+36.089484540 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/37fedee3-825f-430e-9000-bdf6e5c8c4a3-samples-operator-tls") pod "cluster-samples-operator-65db858894-wjf6q" (UID: "37fedee3-825f-430e-9000-bdf6e5c8c4a3") : secret "samples-operator-tls" not found
Jul 13 15:24:09.265452 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.264817    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42b230fa-7a3d-43ef-909f-24805511fd6d-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-nn7v5\" (UID: \"42b230fa-7a3d-43ef-909f-24805511fd6d\") " pod="openshift-insights/insights-operator-68d9dd94cf-nn7v5"
Jul 13 15:24:09.265452 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.264850    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72ca268f-c70d-4218-a657-7f1f9f4b1d7c-tmp-dir\") pod \"dns-default-tdnrr\" (UID: \"72ca268f-c70d-4218-a657-7f1f9f4b1d7c\") " pod="openshift-dns/dns-default-tdnrr"
Jul 13 15:24:09.265452 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.264882    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/63c0fc8b-9a59-4a66-81e6-f712ebed0254-serving-cert\") pod \"service-ca-operator-7695fc6c8c-t4nd7\" (UID: \"63c0fc8b-9a59-4a66-81e6-f712ebed0254\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-t4nd7"
Jul 13 15:24:09.265452 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.264913    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/90f53326-a36e-4682-a268-bdfec7cf722b-trusted-ca\") pod \"console-operator-7866497494-cptrx\" (UID: \"90f53326-a36e-4682-a268-bdfec7cf722b\") " pod="openshift-console-operator/console-operator-7866497494-cptrx"
Jul 13 15:24:09.265452 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.264917    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9d90766b-99c5-4d7e-966a-1b413eabd11b-ca-trust-extracted\") pod \"image-registry-79dcbccd46-gmr5j\" (UID: \"9d90766b-99c5-4d7e-966a-1b413eabd11b\") " pod="openshift-image-registry/image-registry-79dcbccd46-gmr5j"
Jul 13 15:24:09.265452 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.264962    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b144994d-e58a-4d9c-a003-891172fabc9a-default-certificate\") pod \"router-default-6f55fdf65b-nwzqz\" (UID: \"b144994d-e58a-4d9c-a003-891172fabc9a\") " pod="openshift-ingress/router-default-6f55fdf65b-nwzqz"
Jul 13 15:24:09.265452 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.264990    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4w8s\" (UniqueName: \"kubernetes.io/projected/5ee75ad9-88fc-477e-af2f-d31a4c51801f-kube-api-access-j4w8s\") pod \"ingress-canary-wqtv7\" (UID: \"5ee75ad9-88fc-477e-af2f-d31a4c51801f\") " pod="openshift-ingress-canary/ingress-canary-wqtv7"
Jul 13 15:24:09.265452 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.265019    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/118282ab-3ef5-49f2-ad43-9d5eefdacf9b-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-qtg8w\" (UID: \"118282ab-3ef5-49f2-ad43-9d5eefdacf9b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qtg8w"
Jul 13 15:24:09.265452 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.265047    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d90766b-99c5-4d7e-966a-1b413eabd11b-trusted-ca\") pod \"image-registry-79dcbccd46-gmr5j\" (UID: \"9d90766b-99c5-4d7e-966a-1b413eabd11b\") " pod="openshift-image-registry/image-registry-79dcbccd46-gmr5j"
Jul 13 15:24:09.265452 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.265071    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hh88w\" (UniqueName: \"kubernetes.io/projected/42b230fa-7a3d-43ef-909f-24805511fd6d-kube-api-access-hh88w\") pod \"insights-operator-68d9dd94cf-nn7v5\" (UID: \"42b230fa-7a3d-43ef-909f-24805511fd6d\") " pod="openshift-insights/insights-operator-68d9dd94cf-nn7v5"
Jul 13 15:24:09.265452 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.265097    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7ktb\" (UniqueName: \"kubernetes.io/projected/90f53326-a36e-4682-a268-bdfec7cf722b-kube-api-access-b7ktb\") pod \"console-operator-7866497494-cptrx\" (UID: \"90f53326-a36e-4682-a268-bdfec7cf722b\") " pod="openshift-console-operator/console-operator-7866497494-cptrx"
Jul 13 15:24:09.265452 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.265129    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/72ca268f-c70d-4218-a657-7f1f9f4b1d7c-config-volume\") pod \"dns-default-tdnrr\" (UID: \"72ca268f-c70d-4218-a657-7f1f9f4b1d7c\") " pod="openshift-dns/dns-default-tdnrr"
Jul 13 15:24:09.265452 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.265154    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5l55\" (UniqueName: \"kubernetes.io/projected/9d90766b-99c5-4d7e-966a-1b413eabd11b-kube-api-access-x5l55\") pod \"image-registry-79dcbccd46-gmr5j\" (UID: \"9d90766b-99c5-4d7e-966a-1b413eabd11b\") " pod="openshift-image-registry/image-registry-79dcbccd46-gmr5j"
Jul 13 15:24:09.266229 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.265180    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/345f2b29-8ee5-4aef-97b7-422594da4954-nginx-conf\") pod \"networking-console-plugin-6cf856758c-tc2dm\" (UID: \"345f2b29-8ee5-4aef-97b7-422594da4954\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-tc2dm"
Jul 13 15:24:09.266229 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.265205    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ee75ad9-88fc-477e-af2f-d31a4c51801f-cert\") pod \"ingress-canary-wqtv7\" (UID: \"5ee75ad9-88fc-477e-af2f-d31a4c51801f\") " pod="openshift-ingress-canary/ingress-canary-wqtv7"
Jul 13 15:24:09.266229 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.265335    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/42b230fa-7a3d-43ef-909f-24805511fd6d-snapshots\") pod \"insights-operator-68d9dd94cf-nn7v5\" (UID: \"42b230fa-7a3d-43ef-909f-24805511fd6d\") " pod="openshift-insights/insights-operator-68d9dd94cf-nn7v5"
Jul 13 15:24:09.266229 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.265695    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42b230fa-7a3d-43ef-909f-24805511fd6d-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-nn7v5\" (UID: \"42b230fa-7a3d-43ef-909f-24805511fd6d\") " pod="openshift-insights/insights-operator-68d9dd94cf-nn7v5"
Jul 13 15:24:09.266229 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:09.265796    2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 15:24:09.266229 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:09.265863    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/345f2b29-8ee5-4aef-97b7-422594da4954-networking-console-plugin-cert podName:345f2b29-8ee5-4aef-97b7-422594da4954 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:09.765849766 +0000 UTC m=+36.090571641 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/345f2b29-8ee5-4aef-97b7-422594da4954-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-tc2dm" (UID: "345f2b29-8ee5-4aef-97b7-422594da4954") : secret "networking-console-plugin-cert" not found
Jul 13 15:24:09.266229 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:09.266109    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 15:24:09.266229 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:09.266124    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79dcbccd46-gmr5j: secret "image-registry-tls" not found
Jul 13 15:24:09.266229 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:09.266163    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d90766b-99c5-4d7e-966a-1b413eabd11b-registry-tls podName:9d90766b-99c5-4d7e-966a-1b413eabd11b nodeName:}" failed. No retries permitted until 2026-07-13 15:24:09.766150255 +0000 UTC m=+36.090872146 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9d90766b-99c5-4d7e-966a-1b413eabd11b-registry-tls") pod "image-registry-79dcbccd46-gmr5j" (UID: "9d90766b-99c5-4d7e-966a-1b413eabd11b") : secret "image-registry-tls" not found
Jul 13 15:24:09.266657 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.266317    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b605a361-0f6b-4318-b532-efcfbd569501-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-hmvfz\" (UID: \"b605a361-0f6b-4318-b532-efcfbd569501\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hmvfz"
Jul 13 15:24:09.266657 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.266558    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42b230fa-7a3d-43ef-909f-24805511fd6d-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-nn7v5\" (UID: \"42b230fa-7a3d-43ef-909f-24805511fd6d\") " pod="openshift-insights/insights-operator-68d9dd94cf-nn7v5"
Jul 13 15:24:09.267179 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.267158    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d90766b-99c5-4d7e-966a-1b413eabd11b-trusted-ca\") pod \"image-registry-79dcbccd46-gmr5j\" (UID: \"9d90766b-99c5-4d7e-966a-1b413eabd11b\") " pod="openshift-image-registry/image-registry-79dcbccd46-gmr5j"
Jul 13 15:24:09.267295 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.267217    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/90f53326-a36e-4682-a268-bdfec7cf722b-trusted-ca\") pod \"console-operator-7866497494-cptrx\" (UID: \"90f53326-a36e-4682-a268-bdfec7cf722b\") " pod="openshift-console-operator/console-operator-7866497494-cptrx"
Jul 13 15:24:09.267390 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.267368    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72ca268f-c70d-4218-a657-7f1f9f4b1d7c-tmp-dir\") pod \"dns-default-tdnrr\" (UID: \"72ca268f-c70d-4218-a657-7f1f9f4b1d7c\") " pod="openshift-dns/dns-default-tdnrr"
Jul 13 15:24:09.267488 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.267464    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/90f53326-a36e-4682-a268-bdfec7cf722b-config\") pod \"console-operator-7866497494-cptrx\" (UID: \"90f53326-a36e-4682-a268-bdfec7cf722b\") " pod="openshift-console-operator/console-operator-7866497494-cptrx"
Jul 13 15:24:09.267554 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.267530    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/90f53326-a36e-4682-a268-bdfec7cf722b-serving-cert\") pod \"console-operator-7866497494-cptrx\" (UID: \"90f53326-a36e-4682-a268-bdfec7cf722b\") " pod="openshift-console-operator/console-operator-7866497494-cptrx"
Jul 13 15:24:09.268253 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.268216    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/90f53326-a36e-4682-a268-bdfec7cf722b-config\") pod \"console-operator-7866497494-cptrx\" (UID: \"90f53326-a36e-4682-a268-bdfec7cf722b\") " pod="openshift-console-operator/console-operator-7866497494-cptrx"
Jul 13 15:24:09.268356 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.268227    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/72ca268f-c70d-4218-a657-7f1f9f4b1d7c-config-volume\") pod \"dns-default-tdnrr\" (UID: \"72ca268f-c70d-4218-a657-7f1f9f4b1d7c\") " pod="openshift-dns/dns-default-tdnrr"
Jul 13 15:24:09.268641 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.268622    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/345f2b29-8ee5-4aef-97b7-422594da4954-nginx-conf\") pod \"networking-console-plugin-6cf856758c-tc2dm\" (UID: \"345f2b29-8ee5-4aef-97b7-422594da4954\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-tc2dm"
Jul 13 15:24:09.269968 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.269942    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b144994d-e58a-4d9c-a003-891172fabc9a-default-certificate\") pod \"router-default-6f55fdf65b-nwzqz\" (UID: \"b144994d-e58a-4d9c-a003-891172fabc9a\") " pod="openshift-ingress/router-default-6f55fdf65b-nwzqz"
Jul 13 15:24:09.270077 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.270057    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ee75ad9-88fc-477e-af2f-d31a4c51801f-cert\") pod \"ingress-canary-wqtv7\" (UID: \"5ee75ad9-88fc-477e-af2f-d31a4c51801f\") " pod="openshift-ingress-canary/ingress-canary-wqtv7"
Jul 13 15:24:09.270417 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.270201    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9d90766b-99c5-4d7e-966a-1b413eabd11b-image-registry-private-configuration\") pod \"image-registry-79dcbccd46-gmr5j\" (UID: \"9d90766b-99c5-4d7e-966a-1b413eabd11b\") " pod="openshift-image-registry/image-registry-79dcbccd46-gmr5j"
Jul 13 15:24:09.270508 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.270413    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:09.270508 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.270493    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b144994d-e58a-4d9c-a003-891172fabc9a-stats-auth\") pod \"router-default-6f55fdf65b-nwzqz\" (UID: \"b144994d-e58a-4d9c-a003-891172fabc9a\") " pod="openshift-ingress/router-default-6f55fdf65b-nwzqz"
Jul 13 15:24:09.270955 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.270923    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/42b230fa-7a3d-43ef-909f-24805511fd6d-serving-cert\") pod \"insights-operator-68d9dd94cf-nn7v5\" (UID: \"42b230fa-7a3d-43ef-909f-24805511fd6d\") " pod="openshift-insights/insights-operator-68d9dd94cf-nn7v5"
Jul 13 15:24:09.271049 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.271033    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9d90766b-99c5-4d7e-966a-1b413eabd11b-installation-pull-secrets\") pod \"image-registry-79dcbccd46-gmr5j\" (UID: \"9d90766b-99c5-4d7e-966a-1b413eabd11b\") " pod="openshift-image-registry/image-registry-79dcbccd46-gmr5j"
Jul 13 15:24:09.271130 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.271104    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/63c0fc8b-9a59-4a66-81e6-f712ebed0254-serving-cert\") pod \"service-ca-operator-7695fc6c8c-t4nd7\" (UID: \"63c0fc8b-9a59-4a66-81e6-f712ebed0254\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-t4nd7"
Jul 13 15:24:09.271694 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.271673    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/90f53326-a36e-4682-a268-bdfec7cf722b-serving-cert\") pod \"console-operator-7866497494-cptrx\" (UID: \"90f53326-a36e-4682-a268-bdfec7cf722b\") " pod="openshift-console-operator/console-operator-7866497494-cptrx"
Jul 13 15:24:09.278961 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.278936    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh8t7\" (UniqueName: \"kubernetes.io/projected/1c806596-8c96-44b3-ac4d-a5abb6d6c3c7-kube-api-access-mh8t7\") pod \"network-check-source-869dcfcdcd-qtd84\" (UID: \"1c806596-8c96-44b3-ac4d-a5abb6d6c3c7\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-qtd84"
Jul 13 15:24:09.281974 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.281942    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxhvq\" (UniqueName: \"kubernetes.io/projected/30748184-f09b-494c-bb8d-04fa13aff3b9-kube-api-access-pxhvq\") pod \"volume-data-source-validator-78495597f6-z7kxm\" (UID: \"30748184-f09b-494c-bb8d-04fa13aff3b9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-z7kxm"
Jul 13 15:24:09.282786 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.282762    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh88w\" (UniqueName: \"kubernetes.io/projected/42b230fa-7a3d-43ef-909f-24805511fd6d-kube-api-access-hh88w\") pod \"insights-operator-68d9dd94cf-nn7v5\" (UID: \"42b230fa-7a3d-43ef-909f-24805511fd6d\") " pod="openshift-insights/insights-operator-68d9dd94cf-nn7v5"
Jul 13 15:24:09.283715 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.283173    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d90766b-99c5-4d7e-966a-1b413eabd11b-bound-sa-token\") pod \"image-registry-79dcbccd46-gmr5j\" (UID: \"9d90766b-99c5-4d7e-966a-1b413eabd11b\") " pod="openshift-image-registry/image-registry-79dcbccd46-gmr5j"
Jul 13 15:24:09.283715 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.283553    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7ktb\" (UniqueName: \"kubernetes.io/projected/90f53326-a36e-4682-a268-bdfec7cf722b-kube-api-access-b7ktb\") pod \"console-operator-7866497494-cptrx\" (UID: \"90f53326-a36e-4682-a268-bdfec7cf722b\") " pod="openshift-console-operator/console-operator-7866497494-cptrx"
Jul 13 15:24:09.283715 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.283666    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4w8s\" (UniqueName: \"kubernetes.io/projected/5ee75ad9-88fc-477e-af2f-d31a4c51801f-kube-api-access-j4w8s\") pod \"ingress-canary-wqtv7\" (UID: \"5ee75ad9-88fc-477e-af2f-d31a4c51801f\") " pod="openshift-ingress-canary/ingress-canary-wqtv7"
Jul 13 15:24:09.283918 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.283779    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jqdr\" (UniqueName: \"kubernetes.io/projected/b605a361-0f6b-4318-b532-efcfbd569501-kube-api-access-2jqdr\") pod \"cluster-monitoring-operator-5f7f494dd4-hmvfz\" (UID: \"b605a361-0f6b-4318-b532-efcfbd569501\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hmvfz"
Jul 13 15:24:09.285349 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.285303    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g8c9\" (UniqueName: \"kubernetes.io/projected/72ca268f-c70d-4218-a657-7f1f9f4b1d7c-kube-api-access-8g8c9\") pod \"dns-default-tdnrr\" (UID: \"72ca268f-c70d-4218-a657-7f1f9f4b1d7c\") " pod="openshift-dns/dns-default-tdnrr"
Jul 13 15:24:09.285721 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.285699    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5l55\" (UniqueName: \"kubernetes.io/projected/9d90766b-99c5-4d7e-966a-1b413eabd11b-kube-api-access-x5l55\") pod \"image-registry-79dcbccd46-gmr5j\" (UID: \"9d90766b-99c5-4d7e-966a-1b413eabd11b\") " pod="openshift-image-registry/image-registry-79dcbccd46-gmr5j"
Jul 13 15:24:09.286235 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.286215    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfmnh\" (UniqueName: \"kubernetes.io/projected/37fedee3-825f-430e-9000-bdf6e5c8c4a3-kube-api-access-nfmnh\") pod \"cluster-samples-operator-65db858894-wjf6q\" (UID: \"37fedee3-825f-430e-9000-bdf6e5c8c4a3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wjf6q"
Jul 13 15:24:09.286339 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.286320    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grnj6\" (UniqueName: \"kubernetes.io/projected/63c0fc8b-9a59-4a66-81e6-f712ebed0254-kube-api-access-grnj6\") pod \"service-ca-operator-7695fc6c8c-t4nd7\" (UID: \"63c0fc8b-9a59-4a66-81e6-f712ebed0254\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-t4nd7"
Jul 13 15:24:09.287356 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.287333    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn7h4\" (UniqueName: \"kubernetes.io/projected/b144994d-e58a-4d9c-a003-891172fabc9a-kube-api-access-bn7h4\") pod \"router-default-6f55fdf65b-nwzqz\" (UID: \"b144994d-e58a-4d9c-a003-891172fabc9a\") " pod="openshift-ingress/router-default-6f55fdf65b-nwzqz"
Jul 13 15:24:09.355603 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.355499    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-z7kxm"
Jul 13 15:24:09.368186 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.368158    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dh8n\" (UniqueName: \"kubernetes.io/projected/118282ab-3ef5-49f2-ad43-9d5eefdacf9b-kube-api-access-8dh8n\") pod \"kube-storage-version-migrator-operator-799cb7f958-qtg8w\" (UID: \"118282ab-3ef5-49f2-ad43-9d5eefdacf9b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qtg8w"
Jul 13 15:24:09.368326 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.368293    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/118282ab-3ef5-49f2-ad43-9d5eefdacf9b-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-qtg8w\" (UID: \"118282ab-3ef5-49f2-ad43-9d5eefdacf9b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qtg8w"
Jul 13 15:24:09.368408 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.368392    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/118282ab-3ef5-49f2-ad43-9d5eefdacf9b-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-qtg8w\" (UID: \"118282ab-3ef5-49f2-ad43-9d5eefdacf9b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qtg8w"
Jul 13 15:24:09.368956 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.368928    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/118282ab-3ef5-49f2-ad43-9d5eefdacf9b-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-qtg8w\" (UID: \"118282ab-3ef5-49f2-ad43-9d5eefdacf9b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qtg8w"
Jul 13 15:24:09.370770 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.370745    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/118282ab-3ef5-49f2-ad43-9d5eefdacf9b-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-qtg8w\" (UID: \"118282ab-3ef5-49f2-ad43-9d5eefdacf9b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qtg8w"
Jul 13 15:24:09.373912 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.373888    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:09.378132 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.378105    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dh8n\" (UniqueName: \"kubernetes.io/projected/118282ab-3ef5-49f2-ad43-9d5eefdacf9b-kube-api-access-8dh8n\") pod \"kube-storage-version-migrator-operator-799cb7f958-qtg8w\" (UID: \"118282ab-3ef5-49f2-ad43-9d5eefdacf9b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qtg8w"
Jul 13 15:24:09.381031 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.381008    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-cptrx"
Jul 13 15:24:09.408047 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.408018    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-t4nd7"
Jul 13 15:24:09.423758 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.423732    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wqtv7"
Jul 13 15:24:09.431461 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.431440    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-nn7v5"
Jul 13 15:24:09.437074 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.437049    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-qtd84"
Jul 13 15:24:09.442888 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.442869    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qtg8w"
Jul 13 15:24:09.632314 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.632199    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:09.710989 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.710953    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:09.772259 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.772219    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b605a361-0f6b-4318-b532-efcfbd569501-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-hmvfz\" (UID: \"b605a361-0f6b-4318-b532-efcfbd569501\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hmvfz"
Jul 13 15:24:09.772451 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.772274    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/72ca268f-c70d-4218-a657-7f1f9f4b1d7c-metrics-tls\") pod \"dns-default-tdnrr\" (UID: \"72ca268f-c70d-4218-a657-7f1f9f4b1d7c\") " pod="openshift-dns/dns-default-tdnrr"
Jul 13 15:24:09.772451 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.772380    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b144994d-e58a-4d9c-a003-891172fabc9a-metrics-certs\") pod \"router-default-6f55fdf65b-nwzqz\" (UID: \"b144994d-e58a-4d9c-a003-891172fabc9a\") " pod="openshift-ingress/router-default-6f55fdf65b-nwzqz"
Jul 13 15:24:09.772451 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:09.772390    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 13 15:24:09.772451 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.772419    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/37fedee3-825f-430e-9000-bdf6e5c8c4a3-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-wjf6q\" (UID: \"37fedee3-825f-430e-9000-bdf6e5c8c4a3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wjf6q"
Jul 13 15:24:09.772705 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:09.772461    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b605a361-0f6b-4318-b532-efcfbd569501-cluster-monitoring-operator-tls podName:b605a361-0f6b-4318-b532-efcfbd569501 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:10.772440209 +0000 UTC m=+37.097162106 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b605a361-0f6b-4318-b532-efcfbd569501-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-hmvfz" (UID: "b605a361-0f6b-4318-b532-efcfbd569501") : secret "cluster-monitoring-operator-tls" not found
Jul 13 15:24:09.772705 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.772483    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b144994d-e58a-4d9c-a003-891172fabc9a-service-ca-bundle\") pod \"router-default-6f55fdf65b-nwzqz\" (UID: \"b144994d-e58a-4d9c-a003-891172fabc9a\") " pod="openshift-ingress/router-default-6f55fdf65b-nwzqz"
Jul 13 15:24:09.772705 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:09.772497    2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 13 15:24:09.772705 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.772524    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/345f2b29-8ee5-4aef-97b7-422594da4954-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-tc2dm\" (UID: \"345f2b29-8ee5-4aef-97b7-422594da4954\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-tc2dm"
Jul 13 15:24:09.772705 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:09.772525    2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 13 15:24:09.772705 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:09.772537    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37fedee3-825f-430e-9000-bdf6e5c8c4a3-samples-operator-tls podName:37fedee3-825f-430e-9000-bdf6e5c8c4a3 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:10.772525608 +0000 UTC m=+37.097247496 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/37fedee3-825f-430e-9000-bdf6e5c8c4a3-samples-operator-tls") pod "cluster-samples-operator-65db858894-wjf6q" (UID: "37fedee3-825f-430e-9000-bdf6e5c8c4a3") : secret "samples-operator-tls" not found
Jul 13 15:24:09.772705 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:09.772561    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b144994d-e58a-4d9c-a003-891172fabc9a-metrics-certs podName:b144994d-e58a-4d9c-a003-891172fabc9a nodeName:}" failed. No retries permitted until 2026-07-13 15:24:10.772552221 +0000 UTC m=+37.097274102 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b144994d-e58a-4d9c-a003-891172fabc9a-metrics-certs") pod "router-default-6f55fdf65b-nwzqz" (UID: "b144994d-e58a-4d9c-a003-891172fabc9a") : secret "router-metrics-certs-default" not found
Jul 13 15:24:09.772705 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:09.772391    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 15:24:09.773089 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:09.773067    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b144994d-e58a-4d9c-a003-891172fabc9a-service-ca-bundle podName:b144994d-e58a-4d9c-a003-891172fabc9a nodeName:}" failed. No retries permitted until 2026-07-13 15:24:10.773044064 +0000 UTC m=+37.097765944 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b144994d-e58a-4d9c-a003-891172fabc9a-service-ca-bundle") pod "router-default-6f55fdf65b-nwzqz" (UID: "b144994d-e58a-4d9c-a003-891172fabc9a") : configmap references non-existent config key: service-ca.crt
Jul 13 15:24:09.773149 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:09.773128    2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 15:24:09.773194 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:09.773135    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72ca268f-c70d-4218-a657-7f1f9f4b1d7c-metrics-tls podName:72ca268f-c70d-4218-a657-7f1f9f4b1d7c nodeName:}" failed. No retries permitted until 2026-07-13 15:24:10.773105727 +0000 UTC m=+37.097827603 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/72ca268f-c70d-4218-a657-7f1f9f4b1d7c-metrics-tls") pod "dns-default-tdnrr" (UID: "72ca268f-c70d-4218-a657-7f1f9f4b1d7c") : secret "dns-default-metrics-tls" not found
Jul 13 15:24:09.773246 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:09.773221    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d90766b-99c5-4d7e-966a-1b413eabd11b-registry-tls\") pod \"image-registry-79dcbccd46-gmr5j\" (UID: \"9d90766b-99c5-4d7e-966a-1b413eabd11b\") " pod="openshift-image-registry/image-registry-79dcbccd46-gmr5j"
Jul 13 15:24:09.773292 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:09.773249    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/345f2b29-8ee5-4aef-97b7-422594da4954-networking-console-plugin-cert podName:345f2b29-8ee5-4aef-97b7-422594da4954 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:10.773235441 +0000 UTC m=+37.097957321 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/345f2b29-8ee5-4aef-97b7-422594da4954-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-tc2dm" (UID: "345f2b29-8ee5-4aef-97b7-422594da4954") : secret "networking-console-plugin-cert" not found
Jul 13 15:24:09.773292 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:09.773281    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 15:24:09.773382 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:09.773298    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79dcbccd46-gmr5j: secret "image-registry-tls" not found
Jul 13 15:24:09.773382 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:09.773362    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d90766b-99c5-4d7e-966a-1b413eabd11b-registry-tls podName:9d90766b-99c5-4d7e-966a-1b413eabd11b nodeName:}" failed. No retries permitted until 2026-07-13 15:24:10.773348904 +0000 UTC m=+37.098070792 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9d90766b-99c5-4d7e-966a-1b413eabd11b-registry-tls") pod "image-registry-79dcbccd46-gmr5j" (UID: "9d90766b-99c5-4d7e-966a-1b413eabd11b") : secret "image-registry-tls" not found
Jul 13 15:24:10.790946 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:10.783887    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/72ca268f-c70d-4218-a657-7f1f9f4b1d7c-metrics-tls\") pod \"dns-default-tdnrr\" (UID: \"72ca268f-c70d-4218-a657-7f1f9f4b1d7c\") " pod="openshift-dns/dns-default-tdnrr"
Jul 13 15:24:10.790946 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:10.788554    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b144994d-e58a-4d9c-a003-891172fabc9a-metrics-certs\") pod \"router-default-6f55fdf65b-nwzqz\" (UID: \"b144994d-e58a-4d9c-a003-891172fabc9a\") " pod="openshift-ingress/router-default-6f55fdf65b-nwzqz"
Jul 13 15:24:10.790946 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:10.788612    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/37fedee3-825f-430e-9000-bdf6e5c8c4a3-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-wjf6q\" (UID: \"37fedee3-825f-430e-9000-bdf6e5c8c4a3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wjf6q"
Jul 13 15:24:10.790946 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:10.788649    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b144994d-e58a-4d9c-a003-891172fabc9a-service-ca-bundle\") pod \"router-default-6f55fdf65b-nwzqz\" (UID: \"b144994d-e58a-4d9c-a003-891172fabc9a\") " pod="openshift-ingress/router-default-6f55fdf65b-nwzqz"
Jul 13 15:24:10.790946 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:10.788691    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/345f2b29-8ee5-4aef-97b7-422594da4954-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-tc2dm\" (UID: \"345f2b29-8ee5-4aef-97b7-422594da4954\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-tc2dm"
Jul 13 15:24:10.790946 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:10.788754    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d90766b-99c5-4d7e-966a-1b413eabd11b-registry-tls\") pod \"image-registry-79dcbccd46-gmr5j\" (UID: \"9d90766b-99c5-4d7e-966a-1b413eabd11b\") " pod="openshift-image-registry/image-registry-79dcbccd46-gmr5j"
Jul 13 15:24:10.790946 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:10.788068    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 15:24:10.790946 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:10.788882    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72ca268f-c70d-4218-a657-7f1f9f4b1d7c-metrics-tls podName:72ca268f-c70d-4218-a657-7f1f9f4b1d7c nodeName:}" failed. No retries permitted until 2026-07-13 15:24:12.788860283 +0000 UTC m=+39.113582175 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/72ca268f-c70d-4218-a657-7f1f9f4b1d7c-metrics-tls") pod "dns-default-tdnrr" (UID: "72ca268f-c70d-4218-a657-7f1f9f4b1d7c") : secret "dns-default-metrics-tls" not found
Jul 13 15:24:10.790946 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:10.788913    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b605a361-0f6b-4318-b532-efcfbd569501-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-hmvfz\" (UID: \"b605a361-0f6b-4318-b532-efcfbd569501\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hmvfz"
Jul 13 15:24:10.790946 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:10.788958    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 15:24:10.790946 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:10.788977    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79dcbccd46-gmr5j: secret "image-registry-tls" not found
Jul 13 15:24:10.790946 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:10.789027    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d90766b-99c5-4d7e-966a-1b413eabd11b-registry-tls podName:9d90766b-99c5-4d7e-966a-1b413eabd11b nodeName:}" failed. No retries permitted until 2026-07-13 15:24:12.789010435 +0000 UTC m=+39.113732326 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9d90766b-99c5-4d7e-966a-1b413eabd11b-registry-tls") pod "image-registry-79dcbccd46-gmr5j" (UID: "9d90766b-99c5-4d7e-966a-1b413eabd11b") : secret "image-registry-tls" not found
Jul 13 15:24:10.790946 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:10.789030    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 13 15:24:10.790946 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:10.789067    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b605a361-0f6b-4318-b532-efcfbd569501-cluster-monitoring-operator-tls podName:b605a361-0f6b-4318-b532-efcfbd569501 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:12.78905557 +0000 UTC m=+39.113777448 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b605a361-0f6b-4318-b532-efcfbd569501-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-hmvfz" (UID: "b605a361-0f6b-4318-b532-efcfbd569501") : secret "cluster-monitoring-operator-tls" not found
Jul 13 15:24:10.790946 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:10.788802    2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 13 15:24:10.790946 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:10.789088    2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 13 15:24:10.792390 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:10.789099    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b144994d-e58a-4d9c-a003-891172fabc9a-metrics-certs podName:b144994d-e58a-4d9c-a003-891172fabc9a nodeName:}" failed. No retries permitted until 2026-07-13 15:24:12.789090987 +0000 UTC m=+39.113812900 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b144994d-e58a-4d9c-a003-891172fabc9a-metrics-certs") pod "router-default-6f55fdf65b-nwzqz" (UID: "b144994d-e58a-4d9c-a003-891172fabc9a") : secret "router-metrics-certs-default" not found
Jul 13 15:24:10.792390 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:10.789125    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37fedee3-825f-430e-9000-bdf6e5c8c4a3-samples-operator-tls podName:37fedee3-825f-430e-9000-bdf6e5c8c4a3 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:12.789113684 +0000 UTC m=+39.113835561 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/37fedee3-825f-430e-9000-bdf6e5c8c4a3-samples-operator-tls") pod "cluster-samples-operator-65db858894-wjf6q" (UID: "37fedee3-825f-430e-9000-bdf6e5c8c4a3") : secret "samples-operator-tls" not found
Jul 13 15:24:10.792390 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:10.789191    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b144994d-e58a-4d9c-a003-891172fabc9a-service-ca-bundle podName:b144994d-e58a-4d9c-a003-891172fabc9a nodeName:}" failed. No retries permitted until 2026-07-13 15:24:12.789181506 +0000 UTC m=+39.113903388 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b144994d-e58a-4d9c-a003-891172fabc9a-service-ca-bundle") pod "router-default-6f55fdf65b-nwzqz" (UID: "b144994d-e58a-4d9c-a003-891172fabc9a") : configmap references non-existent config key: service-ca.crt
Jul 13 15:24:10.792390 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:10.789249    2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 15:24:10.792390 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:10.789281    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/345f2b29-8ee5-4aef-97b7-422594da4954-networking-console-plugin-cert podName:345f2b29-8ee5-4aef-97b7-422594da4954 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:12.789271353 +0000 UTC m=+39.113993287 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/345f2b29-8ee5-4aef-97b7-422594da4954-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-tc2dm" (UID: "345f2b29-8ee5-4aef-97b7-422594da4954") : secret "networking-console-plugin-cert" not found
Jul 13 15:24:10.950252 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:10.950223    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-cptrx"]
Jul 13 15:24:10.955703 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:10.955636    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-t4nd7"]
Jul 13 15:24:10.959905 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:24:10.959866    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63c0fc8b_9a59_4a66_81e6_f712ebed0254.slice/crio-5d677eaafd3a61451f8c248a15dd306710ed09ecaa9ac502d7f4d8bb919f4804 WatchSource:0}: Error finding container 5d677eaafd3a61451f8c248a15dd306710ed09ecaa9ac502d7f4d8bb919f4804: Status 404 returned error can't find the container with id 5d677eaafd3a61451f8c248a15dd306710ed09ecaa9ac502d7f4d8bb919f4804
Jul 13 15:24:10.961311 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:10.961289    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qtg8w"]
Jul 13 15:24:10.966881 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:10.966858    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-nn7v5"]
Jul 13 15:24:10.970234 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:10.970212    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wqtv7"]
Jul 13 15:24:10.975476 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:10.975449    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-qtd84"]
Jul 13 15:24:10.978468 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:10.978444    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-z7kxm"]
Jul 13 15:24:10.983118 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:24:10.983087    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c806596_8c96_44b3_ac4d_a5abb6d6c3c7.slice/crio-ea0ab7ead50d7289d3b8ba28160e8a29ce157bb0388f8a616aca5ddaa01891ec WatchSource:0}: Error finding container ea0ab7ead50d7289d3b8ba28160e8a29ce157bb0388f8a616aca5ddaa01891ec: Status 404 returned error can't find the container with id ea0ab7ead50d7289d3b8ba28160e8a29ce157bb0388f8a616aca5ddaa01891ec
Jul 13 15:24:10.983615 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:24:10.983545    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42b230fa_7a3d_43ef_909f_24805511fd6d.slice/crio-d362f0f109634bcd0f37f4595ae1e43e2a88e0501949fd7ad59b7e090c65a3bd WatchSource:0}: Error finding container d362f0f109634bcd0f37f4595ae1e43e2a88e0501949fd7ad59b7e090c65a3bd: Status 404 returned error can't find the container with id d362f0f109634bcd0f37f4595ae1e43e2a88e0501949fd7ad59b7e090c65a3bd
Jul 13 15:24:10.984114 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:24:10.984080    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ee75ad9_88fc_477e_af2f_d31a4c51801f.slice/crio-3985ad22b431057ded0ce77cb5394bef3a64875fb224aa8ec8d4c563689fdd8b WatchSource:0}: Error finding container 3985ad22b431057ded0ce77cb5394bef3a64875fb224aa8ec8d4c563689fdd8b: Status 404 returned error can't find the container with id 3985ad22b431057ded0ce77cb5394bef3a64875fb224aa8ec8d4c563689fdd8b
Jul 13 15:24:10.987745 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:24:10.987488    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30748184_f09b_494c_bb8d_04fa13aff3b9.slice/crio-08bc228e4711aa3c4036b45dbe33cebcc9adbf20bfe44fef29329c3060e61b9b WatchSource:0}: Error finding container 08bc228e4711aa3c4036b45dbe33cebcc9adbf20bfe44fef29329c3060e61b9b: Status 404 returned error can't find the container with id 08bc228e4711aa3c4036b45dbe33cebcc9adbf20bfe44fef29329c3060e61b9b
Jul 13 15:24:10.988292 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:24:10.988267    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod118282ab_3ef5_49f2_ad43_9d5eefdacf9b.slice/crio-2265d44d20e2843ad2e6f31b831e19c251bb4b2cec1dcbf362a434043c5a7108 WatchSource:0}: Error finding container 2265d44d20e2843ad2e6f31b831e19c251bb4b2cec1dcbf362a434043c5a7108: Status 404 returned error can't find the container with id 2265d44d20e2843ad2e6f31b831e19c251bb4b2cec1dcbf362a434043c5a7108
Jul 13 15:24:11.491613 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:11.491564    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qtg8w" event={"ID":"118282ab-3ef5-49f2-ad43-9d5eefdacf9b","Type":"ContainerStarted","Data":"2265d44d20e2843ad2e6f31b831e19c251bb4b2cec1dcbf362a434043c5a7108"}
Jul 13 15:24:11.492915 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:11.492886    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-qtd84" event={"ID":"1c806596-8c96-44b3-ac4d-a5abb6d6c3c7","Type":"ContainerStarted","Data":"ea0ab7ead50d7289d3b8ba28160e8a29ce157bb0388f8a616aca5ddaa01891ec"}
Jul 13 15:24:11.496377 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:11.496351    2555 generic.go:356] "Generic (PLEG): container finished" podID="25a82f60-2fa2-49cb-b7fc-84496432841f" containerID="44fbee03c522a9e721493ad711854cd32b2e97f115d36af6fe961947ef6d2a59" exitCode=0
Jul 13 15:24:11.496490 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:11.496434    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjmns" event={"ID":"25a82f60-2fa2-49cb-b7fc-84496432841f","Type":"ContainerDied","Data":"44fbee03c522a9e721493ad711854cd32b2e97f115d36af6fe961947ef6d2a59"}
Jul 13 15:24:11.497859 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:11.497824    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-t4nd7" event={"ID":"63c0fc8b-9a59-4a66-81e6-f712ebed0254","Type":"ContainerStarted","Data":"5d677eaafd3a61451f8c248a15dd306710ed09ecaa9ac502d7f4d8bb919f4804"}
Jul 13 15:24:11.499088 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:11.499064    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-nn7v5" event={"ID":"42b230fa-7a3d-43ef-909f-24805511fd6d","Type":"ContainerStarted","Data":"d362f0f109634bcd0f37f4595ae1e43e2a88e0501949fd7ad59b7e090c65a3bd"}
Jul 13 15:24:11.500860 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:11.500836    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-cptrx" event={"ID":"90f53326-a36e-4682-a268-bdfec7cf722b","Type":"ContainerStarted","Data":"a6513cb2cf362c514891fbe53efe84d6a4c5ab9a99e111736c7c020dddd3a8c2"}
Jul 13 15:24:11.502253 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:11.502214    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-z7kxm" event={"ID":"30748184-f09b-494c-bb8d-04fa13aff3b9","Type":"ContainerStarted","Data":"08bc228e4711aa3c4036b45dbe33cebcc9adbf20bfe44fef29329c3060e61b9b"}
Jul 13 15:24:11.503466 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:11.503447    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wqtv7" event={"ID":"5ee75ad9-88fc-477e-af2f-d31a4c51801f","Type":"ContainerStarted","Data":"3985ad22b431057ded0ce77cb5394bef3a64875fb224aa8ec8d4c563689fdd8b"}
Jul 13 15:24:12.516550 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:12.516070    2555 generic.go:356] "Generic (PLEG): container finished" podID="25a82f60-2fa2-49cb-b7fc-84496432841f" containerID="92d439d087fd4364c2b6cd3e4e50cda6c3c40cc823296a47a101fdec252c3e43" exitCode=0
Jul 13 15:24:12.516550 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:12.516200    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjmns" event={"ID":"25a82f60-2fa2-49cb-b7fc-84496432841f","Type":"ContainerDied","Data":"92d439d087fd4364c2b6cd3e4e50cda6c3c40cc823296a47a101fdec252c3e43"}
Jul 13 15:24:12.809110 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:12.807594    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b605a361-0f6b-4318-b532-efcfbd569501-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-hmvfz\" (UID: \"b605a361-0f6b-4318-b532-efcfbd569501\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hmvfz"
Jul 13 15:24:12.809110 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:12.807655    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/72ca268f-c70d-4218-a657-7f1f9f4b1d7c-metrics-tls\") pod \"dns-default-tdnrr\" (UID: \"72ca268f-c70d-4218-a657-7f1f9f4b1d7c\") " pod="openshift-dns/dns-default-tdnrr"
Jul 13 15:24:12.809110 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:12.807692    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b144994d-e58a-4d9c-a003-891172fabc9a-metrics-certs\") pod \"router-default-6f55fdf65b-nwzqz\" (UID: \"b144994d-e58a-4d9c-a003-891172fabc9a\") " pod="openshift-ingress/router-default-6f55fdf65b-nwzqz"
Jul 13 15:24:12.809110 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:12.807723    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/37fedee3-825f-430e-9000-bdf6e5c8c4a3-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-wjf6q\" (UID: \"37fedee3-825f-430e-9000-bdf6e5c8c4a3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wjf6q"
Jul 13 15:24:12.809110 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:12.807756    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b144994d-e58a-4d9c-a003-891172fabc9a-service-ca-bundle\") pod \"router-default-6f55fdf65b-nwzqz\" (UID: \"b144994d-e58a-4d9c-a003-891172fabc9a\") " pod="openshift-ingress/router-default-6f55fdf65b-nwzqz"
Jul 13 15:24:12.809110 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:12.807790    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/345f2b29-8ee5-4aef-97b7-422594da4954-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-tc2dm\" (UID: \"345f2b29-8ee5-4aef-97b7-422594da4954\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-tc2dm"
Jul 13 15:24:12.809110 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:12.807849    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d90766b-99c5-4d7e-966a-1b413eabd11b-registry-tls\") pod \"image-registry-79dcbccd46-gmr5j\" (UID: \"9d90766b-99c5-4d7e-966a-1b413eabd11b\") " pod="openshift-image-registry/image-registry-79dcbccd46-gmr5j"
Jul 13 15:24:12.809110 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:12.808028    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 15:24:12.809110 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:12.808044    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79dcbccd46-gmr5j: secret "image-registry-tls" not found
Jul 13 15:24:12.809110 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:12.808103    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d90766b-99c5-4d7e-966a-1b413eabd11b-registry-tls podName:9d90766b-99c5-4d7e-966a-1b413eabd11b nodeName:}" failed. No retries permitted until 2026-07-13 15:24:16.808085333 +0000 UTC m=+43.132807213 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9d90766b-99c5-4d7e-966a-1b413eabd11b-registry-tls") pod "image-registry-79dcbccd46-gmr5j" (UID: "9d90766b-99c5-4d7e-966a-1b413eabd11b") : secret "image-registry-tls" not found
Jul 13 15:24:12.809110 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:12.808515    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 13 15:24:12.809110 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:12.808566    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b605a361-0f6b-4318-b532-efcfbd569501-cluster-monitoring-operator-tls podName:b605a361-0f6b-4318-b532-efcfbd569501 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:16.80855131 +0000 UTC m=+43.133273189 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b605a361-0f6b-4318-b532-efcfbd569501-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-hmvfz" (UID: "b605a361-0f6b-4318-b532-efcfbd569501") : secret "cluster-monitoring-operator-tls" not found
Jul 13 15:24:12.809110 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:12.808640    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 15:24:12.809110 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:12.808671    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72ca268f-c70d-4218-a657-7f1f9f4b1d7c-metrics-tls podName:72ca268f-c70d-4218-a657-7f1f9f4b1d7c nodeName:}" failed. No retries permitted until 2026-07-13 15:24:16.808660954 +0000 UTC m=+43.133382833 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/72ca268f-c70d-4218-a657-7f1f9f4b1d7c-metrics-tls") pod "dns-default-tdnrr" (UID: "72ca268f-c70d-4218-a657-7f1f9f4b1d7c") : secret "dns-default-metrics-tls" not found
Jul 13 15:24:12.809110 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:12.808720    2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 13 15:24:12.809110 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:12.808749    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b144994d-e58a-4d9c-a003-891172fabc9a-metrics-certs podName:b144994d-e58a-4d9c-a003-891172fabc9a nodeName:}" failed. No retries permitted until 2026-07-13 15:24:16.808740146 +0000 UTC m=+43.133462036 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b144994d-e58a-4d9c-a003-891172fabc9a-metrics-certs") pod "router-default-6f55fdf65b-nwzqz" (UID: "b144994d-e58a-4d9c-a003-891172fabc9a") : secret "router-metrics-certs-default" not found
Jul 13 15:24:12.810098 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:12.808802    2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 13 15:24:12.810098 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:12.808831    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37fedee3-825f-430e-9000-bdf6e5c8c4a3-samples-operator-tls podName:37fedee3-825f-430e-9000-bdf6e5c8c4a3 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:16.808821318 +0000 UTC m=+43.133543195 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/37fedee3-825f-430e-9000-bdf6e5c8c4a3-samples-operator-tls") pod "cluster-samples-operator-65db858894-wjf6q" (UID: "37fedee3-825f-430e-9000-bdf6e5c8c4a3") : secret "samples-operator-tls" not found
Jul 13 15:24:12.810098 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:12.808889    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b144994d-e58a-4d9c-a003-891172fabc9a-service-ca-bundle podName:b144994d-e58a-4d9c-a003-891172fabc9a nodeName:}" failed. No retries permitted until 2026-07-13 15:24:16.808880427 +0000 UTC m=+43.133602306 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b144994d-e58a-4d9c-a003-891172fabc9a-service-ca-bundle") pod "router-default-6f55fdf65b-nwzqz" (UID: "b144994d-e58a-4d9c-a003-891172fabc9a") : configmap references non-existent config key: service-ca.crt
Jul 13 15:24:12.810098 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:12.808954    2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 15:24:12.810098 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:12.808983    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/345f2b29-8ee5-4aef-97b7-422594da4954-networking-console-plugin-cert podName:345f2b29-8ee5-4aef-97b7-422594da4954 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:16.808973253 +0000 UTC m=+43.133695137 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/345f2b29-8ee5-4aef-97b7-422594da4954-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-tc2dm" (UID: "345f2b29-8ee5-4aef-97b7-422594da4954") : secret "networking-console-plugin-cert" not found
Jul 13 15:24:13.528526 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:13.527832    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjmns" event={"ID":"25a82f60-2fa2-49cb-b7fc-84496432841f","Type":"ContainerStarted","Data":"98bb8cd362eeecfa3d4e5252600a5fb9027874d18702961b7432f2541c6702e0"}
Jul 13 15:24:13.531022 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:13.530874    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-z7kxm" event={"ID":"30748184-f09b-494c-bb8d-04fa13aff3b9","Type":"ContainerStarted","Data":"5a266d758fcef44db3b14439f8896a7c7672939c724ce7be357210f37f4386c5"}
Jul 13 15:24:13.556176 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:13.554859    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vjmns" podStartSLOduration=9.677494929 podStartE2EDuration="39.554839228s" totalImagesPullingTime="29.877344299s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 15:23:34 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:13.553844166 +0000 UTC m=+39.878566077" watchObservedRunningTime="2026-07-13 15:24:13.554839228 +0000 UTC m=+39.879561126"
Jul 13 15:24:13.577615 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:13.577011    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-z7kxm" podStartSLOduration=25.363811343 podStartE2EDuration="27.576987724s" totalImagesPullingTime="2.213176381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:23:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:13.576424831 +0000 UTC m=+39.901146729" watchObservedRunningTime="2026-07-13 15:24:13.576987724 +0000 UTC m=+39.901709623"
Jul 13 15:24:13.746162 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:13.746064    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:13.915532 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:13.915445    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:14.258644 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:14.258577    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:16.847860 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:16.847823    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d90766b-99c5-4d7e-966a-1b413eabd11b-registry-tls\") pod \"image-registry-79dcbccd46-gmr5j\" (UID: \"9d90766b-99c5-4d7e-966a-1b413eabd11b\") " pod="openshift-image-registry/image-registry-79dcbccd46-gmr5j"
Jul 13 15:24:16.848567 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:16.847936    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b605a361-0f6b-4318-b532-efcfbd569501-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-hmvfz\" (UID: \"b605a361-0f6b-4318-b532-efcfbd569501\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hmvfz"
Jul 13 15:24:16.848567 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:16.847977    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/72ca268f-c70d-4218-a657-7f1f9f4b1d7c-metrics-tls\") pod \"dns-default-tdnrr\" (UID: \"72ca268f-c70d-4218-a657-7f1f9f4b1d7c\") " pod="openshift-dns/dns-default-tdnrr"
Jul 13 15:24:16.848567 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:16.847996    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 15:24:16.848567 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:16.848009    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 13 15:24:16.848567 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:16.848018    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79dcbccd46-gmr5j: secret "image-registry-tls" not found
Jul 13 15:24:16.848567 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:16.847999    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b144994d-e58a-4d9c-a003-891172fabc9a-metrics-certs\") pod \"router-default-6f55fdf65b-nwzqz\" (UID: \"b144994d-e58a-4d9c-a003-891172fabc9a\") " pod="openshift-ingress/router-default-6f55fdf65b-nwzqz"
Jul 13 15:24:16.848567 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:16.848076    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d90766b-99c5-4d7e-966a-1b413eabd11b-registry-tls podName:9d90766b-99c5-4d7e-966a-1b413eabd11b nodeName:}" failed. No retries permitted until 2026-07-13 15:24:24.848054646 +0000 UTC m=+51.172776520 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9d90766b-99c5-4d7e-966a-1b413eabd11b-registry-tls") pod "image-registry-79dcbccd46-gmr5j" (UID: "9d90766b-99c5-4d7e-966a-1b413eabd11b") : secret "image-registry-tls" not found
Jul 13 15:24:16.848567 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:16.848078    2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 13 15:24:16.848567 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:16.848114    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 15:24:16.848567 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:16.848159    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b605a361-0f6b-4318-b532-efcfbd569501-cluster-monitoring-operator-tls podName:b605a361-0f6b-4318-b532-efcfbd569501 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:24.848147904 +0000 UTC m=+51.172869786 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b605a361-0f6b-4318-b532-efcfbd569501-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-hmvfz" (UID: "b605a361-0f6b-4318-b532-efcfbd569501") : secret "cluster-monitoring-operator-tls" not found
Jul 13 15:24:16.848567 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:16.848178    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72ca268f-c70d-4218-a657-7f1f9f4b1d7c-metrics-tls podName:72ca268f-c70d-4218-a657-7f1f9f4b1d7c nodeName:}" failed. No retries permitted until 2026-07-13 15:24:24.84816895 +0000 UTC m=+51.172890829 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/72ca268f-c70d-4218-a657-7f1f9f4b1d7c-metrics-tls") pod "dns-default-tdnrr" (UID: "72ca268f-c70d-4218-a657-7f1f9f4b1d7c") : secret "dns-default-metrics-tls" not found
Jul 13 15:24:16.848567 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:16.848194    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b144994d-e58a-4d9c-a003-891172fabc9a-metrics-certs podName:b144994d-e58a-4d9c-a003-891172fabc9a nodeName:}" failed. No retries permitted until 2026-07-13 15:24:24.848185857 +0000 UTC m=+51.172907747 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b144994d-e58a-4d9c-a003-891172fabc9a-metrics-certs") pod "router-default-6f55fdf65b-nwzqz" (UID: "b144994d-e58a-4d9c-a003-891172fabc9a") : secret "router-metrics-certs-default" not found
Jul 13 15:24:16.848567 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:16.848226    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/37fedee3-825f-430e-9000-bdf6e5c8c4a3-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-wjf6q\" (UID: \"37fedee3-825f-430e-9000-bdf6e5c8c4a3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wjf6q"
Jul 13 15:24:16.848567 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:16.848271    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b144994d-e58a-4d9c-a003-891172fabc9a-service-ca-bundle\") pod \"router-default-6f55fdf65b-nwzqz\" (UID: \"b144994d-e58a-4d9c-a003-891172fabc9a\") " pod="openshift-ingress/router-default-6f55fdf65b-nwzqz"
Jul 13 15:24:16.848567 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:16.848305    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/345f2b29-8ee5-4aef-97b7-422594da4954-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-tc2dm\" (UID: \"345f2b29-8ee5-4aef-97b7-422594da4954\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-tc2dm"
Jul 13 15:24:16.848567 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:16.848420    2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 15:24:16.849419 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:16.848455    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/345f2b29-8ee5-4aef-97b7-422594da4954-networking-console-plugin-cert podName:345f2b29-8ee5-4aef-97b7-422594da4954 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:24.848443376 +0000 UTC m=+51.173165265 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/345f2b29-8ee5-4aef-97b7-422594da4954-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-tc2dm" (UID: "345f2b29-8ee5-4aef-97b7-422594da4954") : secret "networking-console-plugin-cert" not found
Jul 13 15:24:16.849419 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:16.848511    2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 13 15:24:16.849419 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:16.848538    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b144994d-e58a-4d9c-a003-891172fabc9a-service-ca-bundle podName:b144994d-e58a-4d9c-a003-891172fabc9a nodeName:}" failed. No retries permitted until 2026-07-13 15:24:24.848525925 +0000 UTC m=+51.173247801 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b144994d-e58a-4d9c-a003-891172fabc9a-service-ca-bundle") pod "router-default-6f55fdf65b-nwzqz" (UID: "b144994d-e58a-4d9c-a003-891172fabc9a") : configmap references non-existent config key: service-ca.crt
Jul 13 15:24:16.849419 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:16.848556    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37fedee3-825f-430e-9000-bdf6e5c8c4a3-samples-operator-tls podName:37fedee3-825f-430e-9000-bdf6e5c8c4a3 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:24.848547545 +0000 UTC m=+51.173269433 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/37fedee3-825f-430e-9000-bdf6e5c8c4a3-samples-operator-tls") pod "cluster-samples-operator-65db858894-wjf6q" (UID: "37fedee3-825f-430e-9000-bdf6e5c8c4a3") : secret "samples-operator-tls" not found
Jul 13 15:24:19.549217 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:19.549185    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cptrx_90f53326-a36e-4682-a268-bdfec7cf722b/console-operator/0.log"
Jul 13 15:24:19.549726 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:19.549236    2555 generic.go:356] "Generic (PLEG): container finished" podID="90f53326-a36e-4682-a268-bdfec7cf722b" containerID="b31c673654d6e74a57b4eb774d4649a7fff63b59be0011324721c0b735461921" exitCode=255
Jul 13 15:24:19.549726 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:19.549318    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-cptrx" event={"ID":"90f53326-a36e-4682-a268-bdfec7cf722b","Type":"ContainerDied","Data":"b31c673654d6e74a57b4eb774d4649a7fff63b59be0011324721c0b735461921"}
Jul 13 15:24:19.549827 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:19.549805    2555 scope.go:117] "RemoveContainer" containerID="b31c673654d6e74a57b4eb774d4649a7fff63b59be0011324721c0b735461921"
Jul 13 15:24:19.551381 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:19.551351    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wqtv7" event={"ID":"5ee75ad9-88fc-477e-af2f-d31a4c51801f","Type":"ContainerStarted","Data":"66798efc8a69d4622697b634bfaae9187c091e9b43e2e603c32cfc4752d4870f"}
Jul 13 15:24:19.557095 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:19.557068    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qtg8w" event={"ID":"118282ab-3ef5-49f2-ad43-9d5eefdacf9b","Type":"ContainerStarted","Data":"f7d8185fca1144f7b293c0bfb15f3deef6952d8ec1e152921d4d0505254e7b67"}
Jul 13 15:24:19.559204 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:19.559174    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-qtd84" event={"ID":"1c806596-8c96-44b3-ac4d-a5abb6d6c3c7","Type":"ContainerStarted","Data":"3764d47d37243eb951687c04f69af8193a46b6b91b5cfb93f4d540ada3dcc190"}
Jul 13 15:24:19.561302 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:19.560945    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-t4nd7" event={"ID":"63c0fc8b-9a59-4a66-81e6-f712ebed0254","Type":"ContainerStarted","Data":"cdba9bc992ca4ce1617373cd78756e3f8748d48d4886c913618ae72a491949be"}
Jul 13 15:24:19.562501 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:19.562481    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-nn7v5" event={"ID":"42b230fa-7a3d-43ef-909f-24805511fd6d","Type":"ContainerStarted","Data":"0d4029272e56fa8806a94589b1fb3948741f1c90e219f230b6124d61c24a715e"}
Jul 13 15:24:19.589223 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:19.589041    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-qtd84" podStartSLOduration=24.889675096 podStartE2EDuration="32.589019759s" totalImagesPullingTime="7.699344663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:23:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:19.587289512 +0000 UTC m=+45.912011408" watchObservedRunningTime="2026-07-13 15:24:19.589019759 +0000 UTC m=+45.913741658"
Jul 13 15:24:19.604164 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:19.604103    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wqtv7" podStartSLOduration=2.916047512 podStartE2EDuration="10.604080157s" totalImagesPullingTime="7.688032645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:24:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:19.603436901 +0000 UTC m=+45.928158801" watchObservedRunningTime="2026-07-13 15:24:19.604080157 +0000 UTC m=+45.928802055"
Jul 13 15:24:19.622617 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:19.622534    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qtg8w" podStartSLOduration=24.934498648 podStartE2EDuration="32.622513082s" totalImagesPullingTime="7.688014434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:23:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:19.62192257 +0000 UTC m=+45.946644480" watchObservedRunningTime="2026-07-13 15:24:19.622513082 +0000 UTC m=+45.947234958"
Jul 13 15:24:19.646515 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:19.646457    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-nn7v5" podStartSLOduration=24.958506673 podStartE2EDuration="32.646436538s" totalImagesPullingTime="7.687929865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:23:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:19.646349828 +0000 UTC m=+45.971071728" watchObservedRunningTime="2026-07-13 15:24:19.646436538 +0000 UTC m=+45.971158436"
Jul 13 15:24:19.668387 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:19.667036    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-t4nd7" podStartSLOduration=24.951734935 podStartE2EDuration="32.667013675s" totalImagesPullingTime="7.71527874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:23:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:19.66628896 +0000 UTC m=+45.991010852" watchObservedRunningTime="2026-07-13 15:24:19.667013675 +0000 UTC m=+45.991735573"
Jul 13 15:24:19.898420 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:19.898310    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:19.999670 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:19.999623    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:20.105171 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:20.105134    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-wzqbw"]
Jul 13 15:24:20.121418 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:20.121382    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:20.123814 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:20.123787    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-wzqbw"]
Jul 13 15:24:20.123982 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:20.123912    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-wzqbw"
Jul 13 15:24:20.127389 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:20.127358    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 13 15:24:20.127562 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:20.127526    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-dcb7t\""
Jul 13 15:24:20.127910 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:20.127888    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 13 15:24:20.179274 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:20.179172    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh9z5\" (UniqueName: \"kubernetes.io/projected/c0e309cc-8060-4f5d-8f0b-898b69b0b5f9-kube-api-access-vh9z5\") pod \"migrator-7f59b54f6c-wzqbw\" (UID: \"c0e309cc-8060-4f5d-8f0b-898b69b0b5f9\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-wzqbw"
Jul 13 15:24:20.212856 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:20.212814    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:20.280064 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:20.280021    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh9z5\" (UniqueName: \"kubernetes.io/projected/c0e309cc-8060-4f5d-8f0b-898b69b0b5f9-kube-api-access-vh9z5\") pod \"migrator-7f59b54f6c-wzqbw\" (UID: \"c0e309cc-8060-4f5d-8f0b-898b69b0b5f9\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-wzqbw"
Jul 13 15:24:20.291819 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:20.291790    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh9z5\" (UniqueName: \"kubernetes.io/projected/c0e309cc-8060-4f5d-8f0b-898b69b0b5f9-kube-api-access-vh9z5\") pod \"migrator-7f59b54f6c-wzqbw\" (UID: \"c0e309cc-8060-4f5d-8f0b-898b69b0b5f9\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-wzqbw"
Jul 13 15:24:20.312084 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:20.312050    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:20.373464 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:20.373401    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vwk27"]
Jul 13 15:24:20.395946 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:20.395915    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vwk27"
Jul 13 15:24:20.397966 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:20.397929    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vwk27"]
Jul 13 15:24:20.398864 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:20.398841    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 13 15:24:20.399200 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:20.399176    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-74ppt\""
Jul 13 15:24:20.403081 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:20.402817    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 13 15:24:20.436767 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:20.436685    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-wzqbw"
Jul 13 15:24:20.482983 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:20.482945    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/20415ed9-d86c-492d-bb29-21922b2a8677-crio-socket\") pod \"insights-runtime-extractor-vwk27\" (UID: \"20415ed9-d86c-492d-bb29-21922b2a8677\") " pod="openshift-insights/insights-runtime-extractor-vwk27"
Jul 13 15:24:20.483129 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:20.483003    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/20415ed9-d86c-492d-bb29-21922b2a8677-data-volume\") pod \"insights-runtime-extractor-vwk27\" (UID: \"20415ed9-d86c-492d-bb29-21922b2a8677\") " pod="openshift-insights/insights-runtime-extractor-vwk27"
Jul 13 15:24:20.483129 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:20.483096    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/20415ed9-d86c-492d-bb29-21922b2a8677-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vwk27\" (UID: \"20415ed9-d86c-492d-bb29-21922b2a8677\") " pod="openshift-insights/insights-runtime-extractor-vwk27"
Jul 13 15:24:20.483231 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:20.483141    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/20415ed9-d86c-492d-bb29-21922b2a8677-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vwk27\" (UID: \"20415ed9-d86c-492d-bb29-21922b2a8677\") " pod="openshift-insights/insights-runtime-extractor-vwk27"
Jul 13 15:24:20.483231 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:20.483186    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hghf2\" (UniqueName: \"kubernetes.io/projected/20415ed9-d86c-492d-bb29-21922b2a8677-kube-api-access-hghf2\") pod \"insights-runtime-extractor-vwk27\" (UID: \"20415ed9-d86c-492d-bb29-21922b2a8677\") " pod="openshift-insights/insights-runtime-extractor-vwk27"
Jul 13 15:24:20.534115 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:20.534071    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:20.568201 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:20.568177    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cptrx_90f53326-a36e-4682-a268-bdfec7cf722b/console-operator/1.log"
Jul 13 15:24:20.568661 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:20.568645    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cptrx_90f53326-a36e-4682-a268-bdfec7cf722b/console-operator/0.log"
Jul 13 15:24:20.568744 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:20.568685    2555 generic.go:356] "Generic (PLEG): container finished" podID="90f53326-a36e-4682-a268-bdfec7cf722b" containerID="fe25a3f226ac00391c4f0ea984df8436f33bff44aaf0398bd26ce315f64df1dd" exitCode=255
Jul 13 15:24:20.568800 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:20.568780    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-cptrx" event={"ID":"90f53326-a36e-4682-a268-bdfec7cf722b","Type":"ContainerDied","Data":"fe25a3f226ac00391c4f0ea984df8436f33bff44aaf0398bd26ce315f64df1dd"}
Jul 13 15:24:20.568850 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:20.568834    2555 scope.go:117] "RemoveContainer" containerID="b31c673654d6e74a57b4eb774d4649a7fff63b59be0011324721c0b735461921"
Jul 13 15:24:20.569133 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:20.569037    2555 scope.go:117] "RemoveContainer" containerID="fe25a3f226ac00391c4f0ea984df8436f33bff44aaf0398bd26ce315f64df1dd"
Jul 13 15:24:20.569265 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:20.569240    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-cptrx_openshift-console-operator(90f53326-a36e-4682-a268-bdfec7cf722b)\"" pod="openshift-console-operator/console-operator-7866497494-cptrx" podUID="90f53326-a36e-4682-a268-bdfec7cf722b"
Jul 13 15:24:20.584193 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:20.584167    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/20415ed9-d86c-492d-bb29-21922b2a8677-data-volume\") pod \"insights-runtime-extractor-vwk27\" (UID: \"20415ed9-d86c-492d-bb29-21922b2a8677\") " pod="openshift-insights/insights-runtime-extractor-vwk27"
Jul 13 15:24:20.584513 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:20.584489    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/20415ed9-d86c-492d-bb29-21922b2a8677-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vwk27\" (UID: \"20415ed9-d86c-492d-bb29-21922b2a8677\") " pod="openshift-insights/insights-runtime-extractor-vwk27"
Jul 13 15:24:20.584624 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:20.584521    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/20415ed9-d86c-492d-bb29-21922b2a8677-data-volume\") pod \"insights-runtime-extractor-vwk27\" (UID: \"20415ed9-d86c-492d-bb29-21922b2a8677\") " pod="openshift-insights/insights-runtime-extractor-vwk27"
Jul 13 15:24:20.584686 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:20.584656    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/20415ed9-d86c-492d-bb29-21922b2a8677-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vwk27\" (UID: \"20415ed9-d86c-492d-bb29-21922b2a8677\") " pod="openshift-insights/insights-runtime-extractor-vwk27"
Jul 13 15:24:20.584762 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:20.584743    2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 15:24:20.584836 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:20.584824    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/20415ed9-d86c-492d-bb29-21922b2a8677-kube-rbac-proxy-cm podName:20415ed9-d86c-492d-bb29-21922b2a8677 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:21.084802667 +0000 UTC m=+47.409524549 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/20415ed9-d86c-492d-bb29-21922b2a8677-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vwk27" (UID: "20415ed9-d86c-492d-bb29-21922b2a8677") : configmap "kube-rbac-proxy" not found
Jul 13 15:24:20.584905 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:20.584836    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 15:24:20.584905 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:20.584891    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20415ed9-d86c-492d-bb29-21922b2a8677-insights-runtime-extractor-tls podName:20415ed9-d86c-492d-bb29-21922b2a8677 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:21.084877565 +0000 UTC m=+47.409599441 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/20415ed9-d86c-492d-bb29-21922b2a8677-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vwk27" (UID: "20415ed9-d86c-492d-bb29-21922b2a8677") : secret "insights-runtime-extractor-tls" not found
Jul 13 15:24:20.585088 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:20.585069    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hghf2\" (UniqueName: \"kubernetes.io/projected/20415ed9-d86c-492d-bb29-21922b2a8677-kube-api-access-hghf2\") pod \"insights-runtime-extractor-vwk27\" (UID: \"20415ed9-d86c-492d-bb29-21922b2a8677\") " pod="openshift-insights/insights-runtime-extractor-vwk27"
Jul 13 15:24:20.585161 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:20.585147    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/20415ed9-d86c-492d-bb29-21922b2a8677-crio-socket\") pod \"insights-runtime-extractor-vwk27\" (UID: \"20415ed9-d86c-492d-bb29-21922b2a8677\") " pod="openshift-insights/insights-runtime-extractor-vwk27"
Jul 13 15:24:20.585245 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:20.585230    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/20415ed9-d86c-492d-bb29-21922b2a8677-crio-socket\") pod \"insights-runtime-extractor-vwk27\" (UID: \"20415ed9-d86c-492d-bb29-21922b2a8677\") " pod="openshift-insights/insights-runtime-extractor-vwk27"
Jul 13 15:24:20.602201 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:20.602177    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-wzqbw"]
Jul 13 15:24:20.604092 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:20.604072    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hghf2\" (UniqueName: \"kubernetes.io/projected/20415ed9-d86c-492d-bb29-21922b2a8677-kube-api-access-hghf2\") pod \"insights-runtime-extractor-vwk27\" (UID: \"20415ed9-d86c-492d-bb29-21922b2a8677\") " pod="openshift-insights/insights-runtime-extractor-vwk27"
Jul 13 15:24:20.604651 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:24:20.604624    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0e309cc_8060_4f5d_8f0b_898b69b0b5f9.slice/crio-2d687df10bc722457729489bdae648c44fd3018d12239da7b8bf12af8d29d8f5 WatchSource:0}: Error finding container 2d687df10bc722457729489bdae648c44fd3018d12239da7b8bf12af8d29d8f5: Status 404 returned error can't find the container with id 2d687df10bc722457729489bdae648c44fd3018d12239da7b8bf12af8d29d8f5
Jul 13 15:24:20.628621 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:20.628572    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:20.729120 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:20.729085    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:21.090112 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:21.090021    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/20415ed9-d86c-492d-bb29-21922b2a8677-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vwk27\" (UID: \"20415ed9-d86c-492d-bb29-21922b2a8677\") " pod="openshift-insights/insights-runtime-extractor-vwk27"
Jul 13 15:24:21.090112 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:21.090090    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/20415ed9-d86c-492d-bb29-21922b2a8677-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vwk27\" (UID: \"20415ed9-d86c-492d-bb29-21922b2a8677\") " pod="openshift-insights/insights-runtime-extractor-vwk27"
Jul 13 15:24:21.090277 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:21.090168    2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 15:24:21.090277 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:21.090206    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 15:24:21.090277 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:21.090240    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/20415ed9-d86c-492d-bb29-21922b2a8677-kube-rbac-proxy-cm podName:20415ed9-d86c-492d-bb29-21922b2a8677 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:22.090217893 +0000 UTC m=+48.414939781 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/20415ed9-d86c-492d-bb29-21922b2a8677-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vwk27" (UID: "20415ed9-d86c-492d-bb29-21922b2a8677") : configmap "kube-rbac-proxy" not found
Jul 13 15:24:21.090277 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:21.090259    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20415ed9-d86c-492d-bb29-21922b2a8677-insights-runtime-extractor-tls podName:20415ed9-d86c-492d-bb29-21922b2a8677 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:22.090250456 +0000 UTC m=+48.414972332 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/20415ed9-d86c-492d-bb29-21922b2a8677-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vwk27" (UID: "20415ed9-d86c-492d-bb29-21922b2a8677") : secret "insights-runtime-extractor-tls" not found
Jul 13 15:24:21.332237 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:21.332190    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:21.559455 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:21.559410    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:21.574048 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:21.574023    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cptrx_90f53326-a36e-4682-a268-bdfec7cf722b/console-operator/1.log"
Jul 13 15:24:21.574461 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:21.574417    2555 scope.go:117] "RemoveContainer" containerID="fe25a3f226ac00391c4f0ea984df8436f33bff44aaf0398bd26ce315f64df1dd"
Jul 13 15:24:21.574618 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:21.574579    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-cptrx_openshift-console-operator(90f53326-a36e-4682-a268-bdfec7cf722b)\"" pod="openshift-console-operator/console-operator-7866497494-cptrx" podUID="90f53326-a36e-4682-a268-bdfec7cf722b"
Jul 13 15:24:21.575277 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:21.575252    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-wzqbw" event={"ID":"c0e309cc-8060-4f5d-8f0b-898b69b0b5f9","Type":"ContainerStarted","Data":"2d687df10bc722457729489bdae648c44fd3018d12239da7b8bf12af8d29d8f5"}
Jul 13 15:24:22.099560 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:22.099529    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/20415ed9-d86c-492d-bb29-21922b2a8677-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vwk27\" (UID: \"20415ed9-d86c-492d-bb29-21922b2a8677\") " pod="openshift-insights/insights-runtime-extractor-vwk27"
Jul 13 15:24:22.099756 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:22.099605    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/20415ed9-d86c-492d-bb29-21922b2a8677-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vwk27\" (UID: \"20415ed9-d86c-492d-bb29-21922b2a8677\") " pod="openshift-insights/insights-runtime-extractor-vwk27"
Jul 13 15:24:22.099756 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:22.099660    2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 15:24:22.099756 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:22.099719    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 15:24:22.099756 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:22.099735    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/20415ed9-d86c-492d-bb29-21922b2a8677-kube-rbac-proxy-cm podName:20415ed9-d86c-492d-bb29-21922b2a8677 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:24.09971395 +0000 UTC m=+50.424435826 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/20415ed9-d86c-492d-bb29-21922b2a8677-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vwk27" (UID: "20415ed9-d86c-492d-bb29-21922b2a8677") : configmap "kube-rbac-proxy" not found
Jul 13 15:24:22.099903 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:22.099760    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20415ed9-d86c-492d-bb29-21922b2a8677-insights-runtime-extractor-tls podName:20415ed9-d86c-492d-bb29-21922b2a8677 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:24.09974874 +0000 UTC m=+50.424470616 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/20415ed9-d86c-492d-bb29-21922b2a8677-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vwk27" (UID: "20415ed9-d86c-492d-bb29-21922b2a8677") : secret "insights-runtime-extractor-tls" not found
Jul 13 15:24:22.251692 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:22.251654    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-z2tpc"]
Jul 13 15:24:22.278849 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:22.278813    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-z2tpc"
Jul 13 15:24:22.288951 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:22.288921    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 13 15:24:22.289118 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:22.289048    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-z2tpc"]
Jul 13 15:24:22.289969 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:22.289943    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 13 15:24:22.290113 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:22.290094    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 13 15:24:22.290323 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:22.290002    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-649d5\""
Jul 13 15:24:22.290636 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:22.290409    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 13 15:24:22.301247 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:22.301223    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d10762da-b80a-416b-bd09-b60ec97e7fcb-signing-cabundle\") pod \"service-ca-79f68b9f4f-z2tpc\" (UID: \"d10762da-b80a-416b-bd09-b60ec97e7fcb\") " pod="openshift-service-ca/service-ca-79f68b9f4f-z2tpc"
Jul 13 15:24:22.301355 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:22.301254    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtdjd\" (UniqueName: \"kubernetes.io/projected/d10762da-b80a-416b-bd09-b60ec97e7fcb-kube-api-access-rtdjd\") pod \"service-ca-79f68b9f4f-z2tpc\" (UID: \"d10762da-b80a-416b-bd09-b60ec97e7fcb\") " pod="openshift-service-ca/service-ca-79f68b9f4f-z2tpc"
Jul 13 15:24:22.301402 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:22.301361    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d10762da-b80a-416b-bd09-b60ec97e7fcb-signing-key\") pod \"service-ca-79f68b9f4f-z2tpc\" (UID: \"d10762da-b80a-416b-bd09-b60ec97e7fcb\") " pod="openshift-service-ca/service-ca-79f68b9f4f-z2tpc"
Jul 13 15:24:22.343186 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:22.342622    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:22.367020 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:22.366999    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-msf42_9ede2cce-055c-4a8d-a4f2-aaed0d7c818d/dns-node-resolver/0.log"
Jul 13 15:24:22.401808 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:22.401766    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d10762da-b80a-416b-bd09-b60ec97e7fcb-signing-cabundle\") pod \"service-ca-79f68b9f4f-z2tpc\" (UID: \"d10762da-b80a-416b-bd09-b60ec97e7fcb\") " pod="openshift-service-ca/service-ca-79f68b9f4f-z2tpc"
Jul 13 15:24:22.401808 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:22.401796    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtdjd\" (UniqueName: \"kubernetes.io/projected/d10762da-b80a-416b-bd09-b60ec97e7fcb-kube-api-access-rtdjd\") pod \"service-ca-79f68b9f4f-z2tpc\" (UID: \"d10762da-b80a-416b-bd09-b60ec97e7fcb\") " pod="openshift-service-ca/service-ca-79f68b9f4f-z2tpc"
Jul 13 15:24:22.402039 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:22.402019    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d10762da-b80a-416b-bd09-b60ec97e7fcb-signing-key\") pod \"service-ca-79f68b9f4f-z2tpc\" (UID: \"d10762da-b80a-416b-bd09-b60ec97e7fcb\") " pod="openshift-service-ca/service-ca-79f68b9f4f-z2tpc"
Jul 13 15:24:22.402578 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:22.402556    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d10762da-b80a-416b-bd09-b60ec97e7fcb-signing-cabundle\") pod \"service-ca-79f68b9f4f-z2tpc\" (UID: \"d10762da-b80a-416b-bd09-b60ec97e7fcb\") " pod="openshift-service-ca/service-ca-79f68b9f4f-z2tpc"
Jul 13 15:24:22.404198 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:22.404178    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d10762da-b80a-416b-bd09-b60ec97e7fcb-signing-key\") pod \"service-ca-79f68b9f4f-z2tpc\" (UID: \"d10762da-b80a-416b-bd09-b60ec97e7fcb\") " pod="openshift-service-ca/service-ca-79f68b9f4f-z2tpc"
Jul 13 15:24:22.416031 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:22.416007    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtdjd\" (UniqueName: \"kubernetes.io/projected/d10762da-b80a-416b-bd09-b60ec97e7fcb-kube-api-access-rtdjd\") pod \"service-ca-79f68b9f4f-z2tpc\" (UID: \"d10762da-b80a-416b-bd09-b60ec97e7fcb\") " pod="openshift-service-ca/service-ca-79f68b9f4f-z2tpc"
Jul 13 15:24:22.446770 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:22.446738    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:22.581027 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:22.580993    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-wzqbw" event={"ID":"c0e309cc-8060-4f5d-8f0b-898b69b0b5f9","Type":"ContainerStarted","Data":"cf671fe0f291465f4114e230d558431ddd5e6909faefae574ea3a3b37aa42537"}
Jul 13 15:24:22.590166 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:22.590145    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-z2tpc"
Jul 13 15:24:22.737469 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:22.737310    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-z2tpc"]
Jul 13 15:24:22.739941 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:24:22.739914    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd10762da_b80a_416b_bd09_b60ec97e7fcb.slice/crio-35e4c861fffcdae33254e4f388923474398b50f5a6a11e9b91b9cd2a3ab5d20a WatchSource:0}: Error finding container 35e4c861fffcdae33254e4f388923474398b50f5a6a11e9b91b9cd2a3ab5d20a: Status 404 returned error can't find the container with id 35e4c861fffcdae33254e4f388923474398b50f5a6a11e9b91b9cd2a3ab5d20a
Jul 13 15:24:22.785169 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:22.785141    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:22.882696 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:22.882612    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:23.362844 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:23.362816    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gndtt_0d9e5461-c76c-4666-92dd-6c8eadd6b6d7/node-ca/0.log"
Jul 13 15:24:23.586844 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:23.586809    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-wzqbw" event={"ID":"c0e309cc-8060-4f5d-8f0b-898b69b0b5f9","Type":"ContainerStarted","Data":"ac687bea3c8af69ce179d6f6b6990dcacb9750786528a8ddcdaa6aedbc95d1f1"}
Jul 13 15:24:23.588299 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:23.588273    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-z2tpc" event={"ID":"d10762da-b80a-416b-bd09-b60ec97e7fcb","Type":"ContainerStarted","Data":"8fec7fbee82195d6ba292215edd4bca9331ff11956edd50abcaecc41505065ba"}
Jul 13 15:24:23.588409 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:23.588314    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-z2tpc" event={"ID":"d10762da-b80a-416b-bd09-b60ec97e7fcb","Type":"ContainerStarted","Data":"35e4c861fffcdae33254e4f388923474398b50f5a6a11e9b91b9cd2a3ab5d20a"}
Jul 13 15:24:23.624168 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:23.624071    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-wzqbw" podStartSLOduration=1.886785567 podStartE2EDuration="3.624055049s" totalImagesPullingTime="1.737269482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:24:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:23.622736976 +0000 UTC m=+49.947458874" watchObservedRunningTime="2026-07-13 15:24:23.624055049 +0000 UTC m=+49.948776988"
Jul 13 15:24:23.629272 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:23.629246    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:23.646291 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:23.646236    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-z2tpc" podStartSLOduration=1.6462181359999999 podStartE2EDuration="1.646218136s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:24:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:23.645749185 +0000 UTC m=+49.970471082" watchObservedRunningTime="2026-07-13 15:24:23.646218136 +0000 UTC m=+49.970940075"
Jul 13 15:24:23.932147 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:23.932059    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:23.978808 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:23.978772    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wqtv7_5ee75ad9-88fc-477e-af2f-d31a4c51801f/serve-healthcheck-canary/0.log"
Jul 13 15:24:24.064305 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:24.064262    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:24.117208 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:24.117169    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/20415ed9-d86c-492d-bb29-21922b2a8677-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vwk27\" (UID: \"20415ed9-d86c-492d-bb29-21922b2a8677\") " pod="openshift-insights/insights-runtime-extractor-vwk27"
Jul 13 15:24:24.117381 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:24.117248    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/20415ed9-d86c-492d-bb29-21922b2a8677-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vwk27\" (UID: \"20415ed9-d86c-492d-bb29-21922b2a8677\") " pod="openshift-insights/insights-runtime-extractor-vwk27"
Jul 13 15:24:24.117381 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:24.117294    2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 15:24:24.117381 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:24.117362    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/20415ed9-d86c-492d-bb29-21922b2a8677-kube-rbac-proxy-cm podName:20415ed9-d86c-492d-bb29-21922b2a8677 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:28.117342877 +0000 UTC m=+54.442064771 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/20415ed9-d86c-492d-bb29-21922b2a8677-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vwk27" (UID: "20415ed9-d86c-492d-bb29-21922b2a8677") : configmap "kube-rbac-proxy" not found
Jul 13 15:24:24.117563 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:24.117410    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 15:24:24.117563 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:24.117451    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20415ed9-d86c-492d-bb29-21922b2a8677-insights-runtime-extractor-tls podName:20415ed9-d86c-492d-bb29-21922b2a8677 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:28.117437142 +0000 UTC m=+54.442159019 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/20415ed9-d86c-492d-bb29-21922b2a8677-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vwk27" (UID: "20415ed9-d86c-492d-bb29-21922b2a8677") : secret "insights-runtime-extractor-tls" not found
Jul 13 15:24:24.167787 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:24.167738    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-wzqbw_c0e309cc-8060-4f5d-8f0b-898b69b0b5f9/migrator/0.log"
Jul 13 15:24:24.168355 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:24.168317    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:24.268077 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:24.268044    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:24.377735 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:24.377703    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:24.403435 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:24.403402    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-wzqbw_c0e309cc-8060-4f5d-8f0b-898b69b0b5f9/graceful-termination/0.log"
Jul 13 15:24:24.568342 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:24.568263    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-qtg8w_118282ab-3ef5-49f2-ad43-9d5eefdacf9b/kube-storage-version-migrator-operator/0.log"
Jul 13 15:24:24.829883 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:24.829793    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:24.929554 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:24.929512    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/72ca268f-c70d-4218-a657-7f1f9f4b1d7c-metrics-tls\") pod \"dns-default-tdnrr\" (UID: \"72ca268f-c70d-4218-a657-7f1f9f4b1d7c\") " pod="openshift-dns/dns-default-tdnrr"
Jul 13 15:24:24.929554 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:24.929556    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b144994d-e58a-4d9c-a003-891172fabc9a-metrics-certs\") pod \"router-default-6f55fdf65b-nwzqz\" (UID: \"b144994d-e58a-4d9c-a003-891172fabc9a\") " pod="openshift-ingress/router-default-6f55fdf65b-nwzqz"
Jul 13 15:24:24.929802 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:24.929581    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/37fedee3-825f-430e-9000-bdf6e5c8c4a3-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-wjf6q\" (UID: \"37fedee3-825f-430e-9000-bdf6e5c8c4a3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wjf6q"
Jul 13 15:24:24.929802 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:24.929637    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b144994d-e58a-4d9c-a003-891172fabc9a-service-ca-bundle\") pod \"router-default-6f55fdf65b-nwzqz\" (UID: \"b144994d-e58a-4d9c-a003-891172fabc9a\") " pod="openshift-ingress/router-default-6f55fdf65b-nwzqz"
Jul 13 15:24:24.929802 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:24.929659    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/345f2b29-8ee5-4aef-97b7-422594da4954-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-tc2dm\" (UID: \"345f2b29-8ee5-4aef-97b7-422594da4954\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-tc2dm"
Jul 13 15:24:24.929802 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:24.929680    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 15:24:24.929802 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:24.929697    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d90766b-99c5-4d7e-966a-1b413eabd11b-registry-tls\") pod \"image-registry-79dcbccd46-gmr5j\" (UID: \"9d90766b-99c5-4d7e-966a-1b413eabd11b\") " pod="openshift-image-registry/image-registry-79dcbccd46-gmr5j"
Jul 13 15:24:24.929802 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:24.929768    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72ca268f-c70d-4218-a657-7f1f9f4b1d7c-metrics-tls podName:72ca268f-c70d-4218-a657-7f1f9f4b1d7c nodeName:}" failed. No retries permitted until 2026-07-13 15:24:40.929742228 +0000 UTC m=+67.254464103 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/72ca268f-c70d-4218-a657-7f1f9f4b1d7c-metrics-tls") pod "dns-default-tdnrr" (UID: "72ca268f-c70d-4218-a657-7f1f9f4b1d7c") : secret "dns-default-metrics-tls" not found
Jul 13 15:24:24.929802 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:24.929680    2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 13 15:24:24.930189 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:24.929812    2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 15:24:24.930189 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:24.929845    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 15:24:24.930189 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:24.929862    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79dcbccd46-gmr5j: secret "image-registry-tls" not found
Jul 13 15:24:24.930189 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:24.929864    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b605a361-0f6b-4318-b532-efcfbd569501-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-hmvfz\" (UID: \"b605a361-0f6b-4318-b532-efcfbd569501\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hmvfz"
Jul 13 15:24:24.930189 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:24.929876    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b144994d-e58a-4d9c-a003-891172fabc9a-service-ca-bundle podName:b144994d-e58a-4d9c-a003-891172fabc9a nodeName:}" failed. No retries permitted until 2026-07-13 15:24:40.929857461 +0000 UTC m=+67.254579345 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b144994d-e58a-4d9c-a003-891172fabc9a-service-ca-bundle") pod "router-default-6f55fdf65b-nwzqz" (UID: "b144994d-e58a-4d9c-a003-891172fabc9a") : configmap references non-existent config key: service-ca.crt
Jul 13 15:24:24.930189 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:24.929905    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b144994d-e58a-4d9c-a003-891172fabc9a-metrics-certs podName:b144994d-e58a-4d9c-a003-891172fabc9a nodeName:}" failed. No retries permitted until 2026-07-13 15:24:40.929894948 +0000 UTC m=+67.254616838 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b144994d-e58a-4d9c-a003-891172fabc9a-metrics-certs") pod "router-default-6f55fdf65b-nwzqz" (UID: "b144994d-e58a-4d9c-a003-891172fabc9a") : secret "router-metrics-certs-default" not found
Jul 13 15:24:24.930189 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:24.929921    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 13 15:24:24.930189 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:24.929924    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/345f2b29-8ee5-4aef-97b7-422594da4954-networking-console-plugin-cert podName:345f2b29-8ee5-4aef-97b7-422594da4954 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:40.929915795 +0000 UTC m=+67.254637670 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/345f2b29-8ee5-4aef-97b7-422594da4954-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-tc2dm" (UID: "345f2b29-8ee5-4aef-97b7-422594da4954") : secret "networking-console-plugin-cert" not found
Jul 13 15:24:24.930189 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:24.929942    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d90766b-99c5-4d7e-966a-1b413eabd11b-registry-tls podName:9d90766b-99c5-4d7e-966a-1b413eabd11b nodeName:}" failed. No retries permitted until 2026-07-13 15:24:40.929934246 +0000 UTC m=+67.254656121 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9d90766b-99c5-4d7e-966a-1b413eabd11b-registry-tls") pod "image-registry-79dcbccd46-gmr5j" (UID: "9d90766b-99c5-4d7e-966a-1b413eabd11b") : secret "image-registry-tls" not found
Jul 13 15:24:24.930189 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:24.929958    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b605a361-0f6b-4318-b532-efcfbd569501-cluster-monitoring-operator-tls podName:b605a361-0f6b-4318-b532-efcfbd569501 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:40.92995055 +0000 UTC m=+67.254672431 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b605a361-0f6b-4318-b532-efcfbd569501-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-hmvfz" (UID: "b605a361-0f6b-4318-b532-efcfbd569501") : secret "cluster-monitoring-operator-tls" not found
Jul 13 15:24:24.932205 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:24.932180    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/37fedee3-825f-430e-9000-bdf6e5c8c4a3-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-wjf6q\" (UID: \"37fedee3-825f-430e-9000-bdf6e5c8c4a3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wjf6q"
Jul 13 15:24:24.967577 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:24.967543    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wjf6q"
Jul 13 15:24:25.130417 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:25.130343    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wjf6q"]
Jul 13 15:24:25.214882 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:25.214849    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:25.597026 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:25.596984    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wjf6q" event={"ID":"37fedee3-825f-430e-9000-bdf6e5c8c4a3","Type":"ContainerStarted","Data":"b38c10c3d9cf8e208226ec9f1a4a094ee258be328377d7c9a0fa9381c1528280"}
Jul 13 15:24:25.810930 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:25.810884    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:26.218189 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:26.218152    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:26.619311 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:26.619226    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:26.727141 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:26.727095    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:27.014096 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:27.014052    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:27.231795 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:27.231754    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:27.626034 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:27.626002    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:27.743536 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:27.743506    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:27.837806 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:27.837780    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:28.161474 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:28.161384    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/20415ed9-d86c-492d-bb29-21922b2a8677-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vwk27\" (UID: \"20415ed9-d86c-492d-bb29-21922b2a8677\") " pod="openshift-insights/insights-runtime-extractor-vwk27"
Jul 13 15:24:28.161659 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:28.161482    2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 15:24:28.161659 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:28.161465    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/20415ed9-d86c-492d-bb29-21922b2a8677-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vwk27\" (UID: \"20415ed9-d86c-492d-bb29-21922b2a8677\") " pod="openshift-insights/insights-runtime-extractor-vwk27"
Jul 13 15:24:28.161659 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:28.161563    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/20415ed9-d86c-492d-bb29-21922b2a8677-kube-rbac-proxy-cm podName:20415ed9-d86c-492d-bb29-21922b2a8677 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:36.161540061 +0000 UTC m=+62.486261954 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/20415ed9-d86c-492d-bb29-21922b2a8677-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vwk27" (UID: "20415ed9-d86c-492d-bb29-21922b2a8677") : configmap "kube-rbac-proxy" not found
Jul 13 15:24:28.161659 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:28.161653    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 15:24:28.161829 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:28.161708    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20415ed9-d86c-492d-bb29-21922b2a8677-insights-runtime-extractor-tls podName:20415ed9-d86c-492d-bb29-21922b2a8677 nodeName:}" failed. No retries permitted until 2026-07-13 15:24:36.161692052 +0000 UTC m=+62.486413929 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/20415ed9-d86c-492d-bb29-21922b2a8677-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vwk27" (UID: "20415ed9-d86c-492d-bb29-21922b2a8677") : secret "insights-runtime-extractor-tls" not found
Jul 13 15:24:28.243780 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:28.243746    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:28.435440 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:28.435356    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:28.534593 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:28.534547    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:28.610421 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:28.610387    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wjf6q" event={"ID":"37fedee3-825f-430e-9000-bdf6e5c8c4a3","Type":"ContainerStarted","Data":"0f676d255ca2a032fa9d02ace340649a9eb47701a9a746f2ff24607503672248"}
Jul 13 15:24:28.610566 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:28.610439    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wjf6q" event={"ID":"37fedee3-825f-430e-9000-bdf6e5c8c4a3","Type":"ContainerStarted","Data":"6308987ed7269241412de0e78c734a7666a0cb4e1af25fc56f1388aaf56cba2d"}
Jul 13 15:24:28.631690 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:28.631644    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wjf6q" podStartSLOduration=40.064417203 podStartE2EDuration="42.631624644s" totalImagesPullingTime="2.567207441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:23:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:28.630763695 +0000 UTC m=+54.955485592" watchObservedRunningTime="2026-07-13 15:24:28.631624644 +0000 UTC m=+54.956346540"
Jul 13 15:24:28.805374 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:28.805333    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:29.382185 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:29.382137    2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-cptrx"
Jul 13 15:24:29.382747 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:29.382256    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-cptrx"
Jul 13 15:24:29.382747 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:29.382610    2555 scope.go:117] "RemoveContainer" containerID="fe25a3f226ac00391c4f0ea984df8436f33bff44aaf0398bd26ce315f64df1dd"
Jul 13 15:24:29.382834 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:24:29.382776    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-cptrx_openshift-console-operator(90f53326-a36e-4682-a268-bdfec7cf722b)\"" pod="openshift-console-operator/console-operator-7866497494-cptrx" podUID="90f53326-a36e-4682-a268-bdfec7cf722b"
Jul 13 15:24:29.407860 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:29.407820    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:29.738832 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:29.738800    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:30.007957 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:30.007868    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:30.209099 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:30.209064    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:30.649739 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:30.649702    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:30.807252 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:30.807215    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:31.212913 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:31.212884    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:32.290297 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:32.290254    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:32.409172 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:32.409133    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:32.606901 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:32.606813    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:32.833618 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:32.833566    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:33.203802 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:33.203769    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:33.289694 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:33.289660    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:33.806975 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:33.806941    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:34.011602 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:34.011550    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:34.235801 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:34.235768    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:34.631382 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:34.631297    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:35.491271 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:35.491242    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x8g52"
Jul 13 15:24:35.882277 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:35.882183    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:36.236026 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:36.236002    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/20415ed9-d86c-492d-bb29-21922b2a8677-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vwk27\" (UID: \"20415ed9-d86c-492d-bb29-21922b2a8677\") " pod="openshift-insights/insights-runtime-extractor-vwk27"
Jul 13 15:24:36.236202 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:36.236049    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/20415ed9-d86c-492d-bb29-21922b2a8677-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vwk27\" (UID: \"20415ed9-d86c-492d-bb29-21922b2a8677\") " pod="openshift-insights/insights-runtime-extractor-vwk27"
Jul 13 15:24:36.236492 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:36.236472    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/20415ed9-d86c-492d-bb29-21922b2a8677-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vwk27\" (UID: \"20415ed9-d86c-492d-bb29-21922b2a8677\") " pod="openshift-insights/insights-runtime-extractor-vwk27"
Jul 13 15:24:36.238298 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:36.238281    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/20415ed9-d86c-492d-bb29-21922b2a8677-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vwk27\" (UID: \"20415ed9-d86c-492d-bb29-21922b2a8677\") " pod="openshift-insights/insights-runtime-extractor-vwk27"
Jul 13 15:24:36.310364 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:36.310331    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-74ppt\""
Jul 13 15:24:36.318430 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:36.318406    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vwk27"
Jul 13 15:24:36.454205 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:36.454166    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vwk27"]
Jul 13 15:24:36.457967 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:24:36.457937    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20415ed9_d86c_492d_bb29_21922b2a8677.slice/crio-277e1b1c86f3486dd2ee6b723a978fc1b9c700f5408c8f0f3013768fa71a9f25 WatchSource:0}: Error finding container 277e1b1c86f3486dd2ee6b723a978fc1b9c700f5408c8f0f3013768fa71a9f25: Status 404 returned error can't find the container with id 277e1b1c86f3486dd2ee6b723a978fc1b9c700f5408c8f0f3013768fa71a9f25
Jul 13 15:24:36.643644 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:36.643543    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vwk27" event={"ID":"20415ed9-d86c-492d-bb29-21922b2a8677","Type":"ContainerStarted","Data":"277e1b1c86f3486dd2ee6b723a978fc1b9c700f5408c8f0f3013768fa71a9f25"}
Jul 13 15:24:39.189078 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:39.189046    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:39.265976 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:39.265887    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:39.970658 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:39.970623    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f78133a-9d4f-47fb-8253-2220a6139ab9-original-pull-secret\") pod \"global-pull-secret-syncer-hdgtx\" (UID: \"1f78133a-9d4f-47fb-8253-2220a6139ab9\") " pod="kube-system/global-pull-secret-syncer-hdgtx"
Jul 13 15:24:39.970833 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:39.970674    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d500cafe-37f3-4c98-8bef-63ba985b79fa-metrics-certs\") pod \"network-metrics-daemon-5bv64\" (UID: \"d500cafe-37f3-4c98-8bef-63ba985b79fa\") " pod="openshift-multus/network-metrics-daemon-5bv64"
Jul 13 15:24:39.974991 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:39.974963    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 13 15:24:39.975116 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:39.975067    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 13 15:24:39.984034 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:39.984003    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f78133a-9d4f-47fb-8253-2220a6139ab9-original-pull-secret\") pod \"global-pull-secret-syncer-hdgtx\" (UID: \"1f78133a-9d4f-47fb-8253-2220a6139ab9\") " pod="kube-system/global-pull-secret-syncer-hdgtx"
Jul 13 15:24:39.984215 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:39.984068    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d500cafe-37f3-4c98-8bef-63ba985b79fa-metrics-certs\") pod \"network-metrics-daemon-5bv64\" (UID: \"d500cafe-37f3-4c98-8bef-63ba985b79fa\") " pod="openshift-multus/network-metrics-daemon-5bv64"
Jul 13 15:24:40.072161 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:40.072126    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5c6d\" (UniqueName: \"kubernetes.io/projected/d349b31c-c0a7-4dfb-b91d-62e55ef016b6-kube-api-access-b5c6d\") pod \"network-check-target-jfg9j\" (UID: \"d349b31c-c0a7-4dfb-b91d-62e55ef016b6\") " pod="openshift-network-diagnostics/network-check-target-jfg9j"
Jul 13 15:24:40.075194 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:40.075163    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5c6d\" (UniqueName: \"kubernetes.io/projected/d349b31c-c0a7-4dfb-b91d-62e55ef016b6-kube-api-access-b5c6d\") pod \"network-check-target-jfg9j\" (UID: \"d349b31c-c0a7-4dfb-b91d-62e55ef016b6\") " pod="openshift-network-diagnostics/network-check-target-jfg9j"
Jul 13 15:24:40.111831 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:40.111802    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hbtnc\""
Jul 13 15:24:40.117857 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:40.117827    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-489nl\""
Jul 13 15:24:40.119809 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:40.119787    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5bv64"
Jul 13 15:24:40.121019 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:40.120984    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hdgtx"
Jul 13 15:24:40.126133 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:40.126107    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfg9j"
Jul 13 15:24:40.670761 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:40.670703    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hdgtx"]
Jul 13 15:24:40.673853 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:24:40.673826    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f78133a_9d4f_47fb_8253_2220a6139ab9.slice/crio-259f33e4018f383847c3a0e9447262decfb125cae9311a17de658695ad1ba2ea WatchSource:0}: Error finding container 259f33e4018f383847c3a0e9447262decfb125cae9311a17de658695ad1ba2ea: Status 404 returned error can't find the container with id 259f33e4018f383847c3a0e9447262decfb125cae9311a17de658695ad1ba2ea
Jul 13 15:24:40.691907 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:40.691880    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jfg9j"]
Jul 13 15:24:40.694038 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:24:40.694013    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd349b31c_c0a7_4dfb_b91d_62e55ef016b6.slice/crio-49b647f5836a75c6d94a60f8bd487b0270c19a878126cf3e2b238e64b079ee97 WatchSource:0}: Error finding container 49b647f5836a75c6d94a60f8bd487b0270c19a878126cf3e2b238e64b079ee97: Status 404 returned error can't find the container with id 49b647f5836a75c6d94a60f8bd487b0270c19a878126cf3e2b238e64b079ee97
Jul 13 15:24:40.899443 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:40.899363    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5bv64"]
Jul 13 15:24:40.902311 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:24:40.902284    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd500cafe_37f3_4c98_8bef_63ba985b79fa.slice/crio-22722612288b80ab9a59e863ea5dfe21af5253446fd8b443e647f467d2bb1fb7 WatchSource:0}: Error finding container 22722612288b80ab9a59e863ea5dfe21af5253446fd8b443e647f467d2bb1fb7: Status 404 returned error can't find the container with id 22722612288b80ab9a59e863ea5dfe21af5253446fd8b443e647f467d2bb1fb7
Jul 13 15:24:40.979798 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:40.979764    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/72ca268f-c70d-4218-a657-7f1f9f4b1d7c-metrics-tls\") pod \"dns-default-tdnrr\" (UID: \"72ca268f-c70d-4218-a657-7f1f9f4b1d7c\") " pod="openshift-dns/dns-default-tdnrr"
Jul 13 15:24:40.979798 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:40.979812    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b144994d-e58a-4d9c-a003-891172fabc9a-metrics-certs\") pod \"router-default-6f55fdf65b-nwzqz\" (UID: \"b144994d-e58a-4d9c-a003-891172fabc9a\") " pod="openshift-ingress/router-default-6f55fdf65b-nwzqz"
Jul 13 15:24:40.980066 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:40.979848    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b144994d-e58a-4d9c-a003-891172fabc9a-service-ca-bundle\") pod \"router-default-6f55fdf65b-nwzqz\" (UID: \"b144994d-e58a-4d9c-a003-891172fabc9a\") " pod="openshift-ingress/router-default-6f55fdf65b-nwzqz"
Jul 13 15:24:40.980066 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:40.979877    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/345f2b29-8ee5-4aef-97b7-422594da4954-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-tc2dm\" (UID: \"345f2b29-8ee5-4aef-97b7-422594da4954\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-tc2dm"
Jul 13 15:24:40.980066 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:40.979919    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d90766b-99c5-4d7e-966a-1b413eabd11b-registry-tls\") pod \"image-registry-79dcbccd46-gmr5j\" (UID: \"9d90766b-99c5-4d7e-966a-1b413eabd11b\") " pod="openshift-image-registry/image-registry-79dcbccd46-gmr5j"
Jul 13 15:24:40.980066 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:40.979988    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b605a361-0f6b-4318-b532-efcfbd569501-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-hmvfz\" (UID: \"b605a361-0f6b-4318-b532-efcfbd569501\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hmvfz"
Jul 13 15:24:40.980672 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:40.980641    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b144994d-e58a-4d9c-a003-891172fabc9a-service-ca-bundle\") pod \"router-default-6f55fdf65b-nwzqz\" (UID: \"b144994d-e58a-4d9c-a003-891172fabc9a\") " pod="openshift-ingress/router-default-6f55fdf65b-nwzqz"
Jul 13 15:24:40.982430 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:40.982405    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b605a361-0f6b-4318-b532-efcfbd569501-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-hmvfz\" (UID: \"b605a361-0f6b-4318-b532-efcfbd569501\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hmvfz"
Jul 13 15:24:40.982619 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:40.982599    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d90766b-99c5-4d7e-966a-1b413eabd11b-registry-tls\") pod \"image-registry-79dcbccd46-gmr5j\" (UID: \"9d90766b-99c5-4d7e-966a-1b413eabd11b\") " pod="openshift-image-registry/image-registry-79dcbccd46-gmr5j"
Jul 13 15:24:40.982619 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:40.982608    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/345f2b29-8ee5-4aef-97b7-422594da4954-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-tc2dm\" (UID: \"345f2b29-8ee5-4aef-97b7-422594da4954\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-tc2dm"
Jul 13 15:24:40.982697 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:40.982644    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/72ca268f-c70d-4218-a657-7f1f9f4b1d7c-metrics-tls\") pod \"dns-default-tdnrr\" (UID: \"72ca268f-c70d-4218-a657-7f1f9f4b1d7c\") " pod="openshift-dns/dns-default-tdnrr"
Jul 13 15:24:40.982744 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:40.982729    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b144994d-e58a-4d9c-a003-891172fabc9a-metrics-certs\") pod \"router-default-6f55fdf65b-nwzqz\" (UID: \"b144994d-e58a-4d9c-a003-891172fabc9a\") " pod="openshift-ingress/router-default-6f55fdf65b-nwzqz"
Jul 13 15:24:41.128807 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:41.128779    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4pjzc\""
Jul 13 15:24:41.136565 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:41.136535    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79dcbccd46-gmr5j"
Jul 13 15:24:41.147831 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:41.147807    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dhlhs\""
Jul 13 15:24:41.155377 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:41.155313    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tdnrr"
Jul 13 15:24:41.194447 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:41.194382    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-wgk4b\""
Jul 13 15:24:41.202597 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:41.202512    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6f55fdf65b-nwzqz"
Jul 13 15:24:41.203252 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:41.203230    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-cdb8m\""
Jul 13 15:24:41.211125 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:41.211094    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hmvfz"
Jul 13 15:24:41.220380 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:41.218907    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-8b9bs\""
Jul 13 15:24:41.227275 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:41.226725    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-tc2dm"
Jul 13 15:24:41.312470 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:41.312388    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79dcbccd46-gmr5j"]
Jul 13 15:24:41.351754 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:41.340722    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tdnrr"]
Jul 13 15:24:41.359762 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:24:41.359712    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72ca268f_c70d_4218_a657_7f1f9f4b1d7c.slice/crio-04fb96a588990cc3ec7c6ec18c5699a42fa3f2cb641baf8186416939077b77bb WatchSource:0}: Error finding container 04fb96a588990cc3ec7c6ec18c5699a42fa3f2cb641baf8186416939077b77bb: Status 404 returned error can't find the container with id 04fb96a588990cc3ec7c6ec18c5699a42fa3f2cb641baf8186416939077b77bb
Jul 13 15:24:41.431885 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:41.431805    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6f55fdf65b-nwzqz"]
Jul 13 15:24:41.438078 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:24:41.438039    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb144994d_e58a_4d9c_a003_891172fabc9a.slice/crio-b180b15938538ba73bb477976ab0d81efaaa3ecf2d42e4a70f2189470083e31d WatchSource:0}: Error finding container b180b15938538ba73bb477976ab0d81efaaa3ecf2d42e4a70f2189470083e31d: Status 404 returned error can't find the container with id b180b15938538ba73bb477976ab0d81efaaa3ecf2d42e4a70f2189470083e31d
Jul 13 15:24:41.454094 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:41.454068    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hmvfz"]
Jul 13 15:24:41.456664 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:24:41.455876    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb605a361_0f6b_4318_b532_efcfbd569501.slice/crio-66590f1ed78b3d31daa76f99d4d226c4cd3c08204c03a49bcbc2cb1378c25e8f WatchSource:0}: Error finding container 66590f1ed78b3d31daa76f99d4d226c4cd3c08204c03a49bcbc2cb1378c25e8f: Status 404 returned error can't find the container with id 66590f1ed78b3d31daa76f99d4d226c4cd3c08204c03a49bcbc2cb1378c25e8f
Jul 13 15:24:41.469957 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:41.469925    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-tc2dm"]
Jul 13 15:24:41.562642 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:24:41.562604    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod345f2b29_8ee5_4aef_97b7_422594da4954.slice/crio-c3d4e99c6e4bb59de36341ad533055b4b7262406dc69388a46d83f1684275c31 WatchSource:0}: Error finding container c3d4e99c6e4bb59de36341ad533055b4b7262406dc69388a46d83f1684275c31: Status 404 returned error can't find the container with id c3d4e99c6e4bb59de36341ad533055b4b7262406dc69388a46d83f1684275c31
Jul 13 15:24:41.667226 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:41.667147    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hdgtx" event={"ID":"1f78133a-9d4f-47fb-8253-2220a6139ab9","Type":"ContainerStarted","Data":"259f33e4018f383847c3a0e9447262decfb125cae9311a17de658695ad1ba2ea"}
Jul 13 15:24:41.674184 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:41.674104    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vwk27" event={"ID":"20415ed9-d86c-492d-bb29-21922b2a8677","Type":"ContainerStarted","Data":"a516272cee956be87bb84b9f6ce57146dc4288cb920e9e7abc888752e200a9fa"}
Jul 13 15:24:41.677695 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:41.677002    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79dcbccd46-gmr5j" event={"ID":"9d90766b-99c5-4d7e-966a-1b413eabd11b","Type":"ContainerStarted","Data":"135b57f9abcbe3976542facbdc5cbcd15911298675c4245170b8892c55fddbd4"}
Jul 13 15:24:41.677695 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:41.677060    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79dcbccd46-gmr5j" event={"ID":"9d90766b-99c5-4d7e-966a-1b413eabd11b","Type":"ContainerStarted","Data":"0d8226673f2d35bdb78a606b81a8d3311082649c36919f2247e7bf10d450b516"}
Jul 13 15:24:41.677695 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:41.677250    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-79dcbccd46-gmr5j"
Jul 13 15:24:41.680660 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:41.680625    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jfg9j" event={"ID":"d349b31c-c0a7-4dfb-b91d-62e55ef016b6","Type":"ContainerStarted","Data":"f52e96e5e05f4297f94bd39fd47505c636e65a7138648bf154733c3243e0f80e"}
Jul 13 15:24:41.680804 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:41.680692    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jfg9j" event={"ID":"d349b31c-c0a7-4dfb-b91d-62e55ef016b6","Type":"ContainerStarted","Data":"49b647f5836a75c6d94a60f8bd487b0270c19a878126cf3e2b238e64b079ee97"}
Jul 13 15:24:41.680936 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:41.680917    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jfg9j"
Jul 13 15:24:41.683234 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:41.683175    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-tc2dm" event={"ID":"345f2b29-8ee5-4aef-97b7-422594da4954","Type":"ContainerStarted","Data":"c3d4e99c6e4bb59de36341ad533055b4b7262406dc69388a46d83f1684275c31"}
Jul 13 15:24:41.685405 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:41.685376    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5bv64" event={"ID":"d500cafe-37f3-4c98-8bef-63ba985b79fa","Type":"ContainerStarted","Data":"22722612288b80ab9a59e863ea5dfe21af5253446fd8b443e647f467d2bb1fb7"}
Jul 13 15:24:41.687700 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:41.687628    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hmvfz" event={"ID":"b605a361-0f6b-4318-b532-efcfbd569501","Type":"ContainerStarted","Data":"66590f1ed78b3d31daa76f99d4d226c4cd3c08204c03a49bcbc2cb1378c25e8f"}
Jul 13 15:24:41.690897 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:41.690312    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6f55fdf65b-nwzqz" event={"ID":"b144994d-e58a-4d9c-a003-891172fabc9a","Type":"ContainerStarted","Data":"87a894ec4059ed20078be338263611f05b9c0327fbdcd422be39de2b7ac6ab7d"}
Jul 13 15:24:41.690897 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:41.690358    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6f55fdf65b-nwzqz" event={"ID":"b144994d-e58a-4d9c-a003-891172fabc9a","Type":"ContainerStarted","Data":"b180b15938538ba73bb477976ab0d81efaaa3ecf2d42e4a70f2189470083e31d"}
Jul 13 15:24:41.693741 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:41.693676    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tdnrr" event={"ID":"72ca268f-c70d-4218-a657-7f1f9f4b1d7c","Type":"ContainerStarted","Data":"04fb96a588990cc3ec7c6ec18c5699a42fa3f2cb641baf8186416939077b77bb"}
Jul 13 15:24:41.720247 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:41.719831    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-79dcbccd46-gmr5j" podStartSLOduration=67.719813049 podStartE2EDuration="1m7.719813049s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:23:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:41.701388982 +0000 UTC m=+68.026110917" watchObservedRunningTime="2026-07-13 15:24:41.719813049 +0000 UTC m=+68.044534945"
Jul 13 15:24:41.720247 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:41.720018    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jfg9j" podStartSLOduration=67.720013706 podStartE2EDuration="1m7.720013706s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:23:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:41.71863183 +0000 UTC m=+68.043353728" watchObservedRunningTime="2026-07-13 15:24:41.720013706 +0000 UTC m=+68.044735602"
Jul 13 15:24:41.739897 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:41.739543    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6f55fdf65b-nwzqz" podStartSLOduration=55.739523237 podStartE2EDuration="55.739523237s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:23:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:41.739095939 +0000 UTC m=+68.063817837" watchObservedRunningTime="2026-07-13 15:24:41.739523237 +0000 UTC m=+68.064245136"
Jul 13 15:24:42.202835 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.202802    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6f55fdf65b-nwzqz"
Jul 13 15:24:42.205704 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.205676    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6f55fdf65b-nwzqz"
Jul 13 15:24:42.551837 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.551751    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-bc59-rtgrb"]
Jul 13 15:24:42.569016 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.568942    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-756bd7b76-mc6zk"]
Jul 13 15:24:42.569897 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.569303    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bc59-rtgrb"
Jul 13 15:24:42.573133 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.572783    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 13 15:24:42.573504 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.573426    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 13 15:24:42.574413 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.574391    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 13 15:24:42.574832 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.574662    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 13 15:24:42.589722 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.589362    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9f8594dc-xshtx"]
Jul 13 15:24:42.589972 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.589955    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-756bd7b76-mc6zk"
Jul 13 15:24:42.596148 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.593979    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-tfc4d\""
Jul 13 15:24:42.596148 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.593979    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 13 15:24:42.603283 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.603259    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-bc59-rtgrb"]
Jul 13 15:24:42.603433 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.603311    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-756bd7b76-mc6zk"]
Jul 13 15:24:42.603433 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.603330    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9f8594dc-xshtx"]
Jul 13 15:24:42.603562 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.603444    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9f8594dc-xshtx"
Jul 13 15:24:42.607357 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.607292    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:42.610449 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.609643    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 13 15:24:42.610449 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.609955    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 13 15:24:42.610932 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.610910    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 13 15:24:42.611245 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.611227    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 13 15:24:42.693146 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.693088    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:42.695979 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.695658    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4d485558-3c13-41e0-a608-436166c55205-hub\") pod \"cluster-proxy-proxy-agent-9f8594dc-xshtx\" (UID: \"4d485558-3c13-41e0-a608-436166c55205\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9f8594dc-xshtx"
Jul 13 15:24:42.695979 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.695759    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d485558-3c13-41e0-a608-436166c55205-additional-service-ca\") pod \"cluster-proxy-proxy-agent-9f8594dc-xshtx\" (UID: \"4d485558-3c13-41e0-a608-436166c55205\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9f8594dc-xshtx"
Jul 13 15:24:42.695979 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.695790    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t2m7\" (UniqueName: \"kubernetes.io/projected/ca850af6-166c-4c02-a9e3-1a86df65665e-kube-api-access-4t2m7\") pod \"klusterlet-addon-workmgr-bc59-rtgrb\" (UID: \"ca850af6-166c-4c02-a9e3-1a86df65665e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bc59-rtgrb"
Jul 13 15:24:42.695979 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.695833    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nkbc\" (UniqueName: \"kubernetes.io/projected/33c524f8-c79a-4ee2-8b65-2b79a4b16297-kube-api-access-4nkbc\") pod \"managed-serviceaccount-addon-agent-756bd7b76-mc6zk\" (UID: \"33c524f8-c79a-4ee2-8b65-2b79a4b16297\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-756bd7b76-mc6zk"
Jul 13 15:24:42.695979 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.695860    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4d485558-3c13-41e0-a608-436166c55205-ca\") pod \"cluster-proxy-proxy-agent-9f8594dc-xshtx\" (UID: \"4d485558-3c13-41e0-a608-436166c55205\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9f8594dc-xshtx"
Jul 13 15:24:42.695979 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.695883    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4d485558-3c13-41e0-a608-436166c55205-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-9f8594dc-xshtx\" (UID: \"4d485558-3c13-41e0-a608-436166c55205\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9f8594dc-xshtx"
Jul 13 15:24:42.695979 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.695911    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h9t8\" (UniqueName: \"kubernetes.io/projected/4d485558-3c13-41e0-a608-436166c55205-kube-api-access-6h9t8\") pod \"cluster-proxy-proxy-agent-9f8594dc-xshtx\" (UID: \"4d485558-3c13-41e0-a608-436166c55205\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9f8594dc-xshtx"
Jul 13 15:24:42.695979 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.695940    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca850af6-166c-4c02-a9e3-1a86df65665e-tmp\") pod \"klusterlet-addon-workmgr-bc59-rtgrb\" (UID: \"ca850af6-166c-4c02-a9e3-1a86df65665e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bc59-rtgrb"
Jul 13 15:24:42.696518 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.696036    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4d485558-3c13-41e0-a608-436166c55205-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-9f8594dc-xshtx\" (UID: \"4d485558-3c13-41e0-a608-436166c55205\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9f8594dc-xshtx"
Jul 13 15:24:42.696518 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.696065    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ca850af6-166c-4c02-a9e3-1a86df65665e-klusterlet-config\") pod \"klusterlet-addon-workmgr-bc59-rtgrb\" (UID: \"ca850af6-166c-4c02-a9e3-1a86df65665e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bc59-rtgrb"
Jul 13 15:24:42.696518 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.696100    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/33c524f8-c79a-4ee2-8b65-2b79a4b16297-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-756bd7b76-mc6zk\" (UID: \"33c524f8-c79a-4ee2-8b65-2b79a4b16297\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-756bd7b76-mc6zk"
Jul 13 15:24:42.702045 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.701942    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vwk27" event={"ID":"20415ed9-d86c-492d-bb29-21922b2a8677","Type":"ContainerStarted","Data":"4a2a21c91d0cd3a1f62dca9bb20a1cff1b21fb8984ad7ce6fd284b1791b77abf"}
Jul 13 15:24:42.704865 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.704795    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5bv64" event={"ID":"d500cafe-37f3-4c98-8bef-63ba985b79fa","Type":"ContainerStarted","Data":"09f44723f459876ba8f4f8a2a9360379c50920d84ed3903949ed8bc2025965a8"}
Jul 13 15:24:42.705016 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.704888    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6f55fdf65b-nwzqz"
Jul 13 15:24:42.707104 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.707004    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6f55fdf65b-nwzqz"
Jul 13 15:24:42.795206 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.795142    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:42.797905 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.797034    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d485558-3c13-41e0-a608-436166c55205-additional-service-ca\") pod \"cluster-proxy-proxy-agent-9f8594dc-xshtx\" (UID: \"4d485558-3c13-41e0-a608-436166c55205\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9f8594dc-xshtx"
Jul 13 15:24:42.797905 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.797072    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t2m7\" (UniqueName: \"kubernetes.io/projected/ca850af6-166c-4c02-a9e3-1a86df65665e-kube-api-access-4t2m7\") pod \"klusterlet-addon-workmgr-bc59-rtgrb\" (UID: \"ca850af6-166c-4c02-a9e3-1a86df65665e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bc59-rtgrb"
Jul 13 15:24:42.797905 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.797111    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nkbc\" (UniqueName: \"kubernetes.io/projected/33c524f8-c79a-4ee2-8b65-2b79a4b16297-kube-api-access-4nkbc\") pod \"managed-serviceaccount-addon-agent-756bd7b76-mc6zk\" (UID: \"33c524f8-c79a-4ee2-8b65-2b79a4b16297\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-756bd7b76-mc6zk"
Jul 13 15:24:42.797905 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.797136    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4d485558-3c13-41e0-a608-436166c55205-ca\") pod \"cluster-proxy-proxy-agent-9f8594dc-xshtx\" (UID: \"4d485558-3c13-41e0-a608-436166c55205\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9f8594dc-xshtx"
Jul 13 15:24:42.797905 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.797158    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4d485558-3c13-41e0-a608-436166c55205-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-9f8594dc-xshtx\" (UID: \"4d485558-3c13-41e0-a608-436166c55205\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9f8594dc-xshtx"
Jul 13 15:24:42.797905 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.797198    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h9t8\" (UniqueName: \"kubernetes.io/projected/4d485558-3c13-41e0-a608-436166c55205-kube-api-access-6h9t8\") pod \"cluster-proxy-proxy-agent-9f8594dc-xshtx\" (UID: \"4d485558-3c13-41e0-a608-436166c55205\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9f8594dc-xshtx"
Jul 13 15:24:42.797905 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.797245    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca850af6-166c-4c02-a9e3-1a86df65665e-tmp\") pod \"klusterlet-addon-workmgr-bc59-rtgrb\" (UID: \"ca850af6-166c-4c02-a9e3-1a86df65665e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bc59-rtgrb"
Jul 13 15:24:42.797905 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.797330    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4d485558-3c13-41e0-a608-436166c55205-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-9f8594dc-xshtx\" (UID: \"4d485558-3c13-41e0-a608-436166c55205\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9f8594dc-xshtx"
Jul 13 15:24:42.797905 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.797355    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ca850af6-166c-4c02-a9e3-1a86df65665e-klusterlet-config\") pod \"klusterlet-addon-workmgr-bc59-rtgrb\" (UID: \"ca850af6-166c-4c02-a9e3-1a86df65665e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bc59-rtgrb"
Jul 13 15:24:42.797905 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.797378    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/33c524f8-c79a-4ee2-8b65-2b79a4b16297-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-756bd7b76-mc6zk\" (UID: \"33c524f8-c79a-4ee2-8b65-2b79a4b16297\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-756bd7b76-mc6zk"
Jul 13 15:24:42.797905 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.797491    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4d485558-3c13-41e0-a608-436166c55205-hub\") pod \"cluster-proxy-proxy-agent-9f8594dc-xshtx\" (UID: \"4d485558-3c13-41e0-a608-436166c55205\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9f8594dc-xshtx"
Jul 13 15:24:42.804652 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.801068    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d485558-3c13-41e0-a608-436166c55205-additional-service-ca\") pod \"cluster-proxy-proxy-agent-9f8594dc-xshtx\" (UID: \"4d485558-3c13-41e0-a608-436166c55205\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9f8594dc-xshtx"
Jul 13 15:24:42.804652 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.801338    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca850af6-166c-4c02-a9e3-1a86df65665e-tmp\") pod \"klusterlet-addon-workmgr-bc59-rtgrb\" (UID: \"ca850af6-166c-4c02-a9e3-1a86df65665e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bc59-rtgrb"
Jul 13 15:24:42.804652 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.803734    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4d485558-3c13-41e0-a608-436166c55205-hub\") pod \"cluster-proxy-proxy-agent-9f8594dc-xshtx\" (UID: \"4d485558-3c13-41e0-a608-436166c55205\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9f8594dc-xshtx"
Jul 13 15:24:42.818751 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.818663    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h9t8\" (UniqueName: \"kubernetes.io/projected/4d485558-3c13-41e0-a608-436166c55205-kube-api-access-6h9t8\") pod \"cluster-proxy-proxy-agent-9f8594dc-xshtx\" (UID: \"4d485558-3c13-41e0-a608-436166c55205\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9f8594dc-xshtx"
Jul 13 15:24:42.824665 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.819669    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/33c524f8-c79a-4ee2-8b65-2b79a4b16297-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-756bd7b76-mc6zk\" (UID: \"33c524f8-c79a-4ee2-8b65-2b79a4b16297\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-756bd7b76-mc6zk"
Jul 13 15:24:42.824665 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.823504    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ca850af6-166c-4c02-a9e3-1a86df65665e-klusterlet-config\") pod \"klusterlet-addon-workmgr-bc59-rtgrb\" (UID: \"ca850af6-166c-4c02-a9e3-1a86df65665e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bc59-rtgrb"
Jul 13 15:24:42.824665 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.823668    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4d485558-3c13-41e0-a608-436166c55205-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-9f8594dc-xshtx\" (UID: \"4d485558-3c13-41e0-a608-436166c55205\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9f8594dc-xshtx"
Jul 13 15:24:42.824665 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.824143    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4d485558-3c13-41e0-a608-436166c55205-ca\") pod \"cluster-proxy-proxy-agent-9f8594dc-xshtx\" (UID: \"4d485558-3c13-41e0-a608-436166c55205\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9f8594dc-xshtx"
Jul 13 15:24:42.824665 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.824468    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4d485558-3c13-41e0-a608-436166c55205-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-9f8594dc-xshtx\" (UID: \"4d485558-3c13-41e0-a608-436166c55205\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9f8594dc-xshtx"
Jul 13 15:24:42.827275 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.824781    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nkbc\" (UniqueName: \"kubernetes.io/projected/33c524f8-c79a-4ee2-8b65-2b79a4b16297-kube-api-access-4nkbc\") pod \"managed-serviceaccount-addon-agent-756bd7b76-mc6zk\" (UID: \"33c524f8-c79a-4ee2-8b65-2b79a4b16297\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-756bd7b76-mc6zk"
Jul 13 15:24:42.827275 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.825038    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t2m7\" (UniqueName: \"kubernetes.io/projected/ca850af6-166c-4c02-a9e3-1a86df65665e-kube-api-access-4t2m7\") pod \"klusterlet-addon-workmgr-bc59-rtgrb\" (UID: \"ca850af6-166c-4c02-a9e3-1a86df65665e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bc59-rtgrb"
Jul 13 15:24:42.887632 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.887308    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bc59-rtgrb"
Jul 13 15:24:42.901379 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.901332    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:42.913285 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.913196    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-756bd7b76-mc6zk"
Jul 13 15:24:42.924313 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:42.924286    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9f8594dc-xshtx"
Jul 13 15:24:43.014223 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:43.014139    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:43.119525 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:43.114817    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:43.140447 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:43.140332    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-bc59-rtgrb"]
Jul 13 15:24:43.160994 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:43.160773    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-756bd7b76-mc6zk"]
Jul 13 15:24:43.234709 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:43.234673    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9f8594dc-xshtx"]
Jul 13 15:24:43.242802 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:24:43.242744    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4d485558_3c13_41e0_a608_436166c55205.slice/crio-94058f1e1a83dd1e9bbaa6ed7a0460fa81a80d042780ca2f2cf7c0ef2860e53d WatchSource:0}: Error finding container 94058f1e1a83dd1e9bbaa6ed7a0460fa81a80d042780ca2f2cf7c0ef2860e53d: Status 404 returned error can't find the container with id 94058f1e1a83dd1e9bbaa6ed7a0460fa81a80d042780ca2f2cf7c0ef2860e53d
Jul 13 15:24:43.589748 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:43.589669    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:43.679614 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:43.679545    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:43.714815 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:43.714691    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9f8594dc-xshtx" event={"ID":"4d485558-3c13-41e0-a608-436166c55205","Type":"ContainerStarted","Data":"94058f1e1a83dd1e9bbaa6ed7a0460fa81a80d042780ca2f2cf7c0ef2860e53d"}
Jul 13 15:24:43.721204 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:43.721105    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bc59-rtgrb" event={"ID":"ca850af6-166c-4c02-a9e3-1a86df65665e","Type":"ContainerStarted","Data":"a7d3dadd4bb619227fea88cf00fdb32805410e5effd3eb8c6cdfa73f58a77e5c"}
Jul 13 15:24:43.722878 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:43.722803    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-756bd7b76-mc6zk" event={"ID":"33c524f8-c79a-4ee2-8b65-2b79a4b16297","Type":"ContainerStarted","Data":"28149bafcef722f4468fa541123012c574760e4741eb682a9d294944dbe1ea54"}
Jul 13 15:24:43.728578 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:43.728542    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5bv64" event={"ID":"d500cafe-37f3-4c98-8bef-63ba985b79fa","Type":"ContainerStarted","Data":"1ba050edc6d72a5ccccd6bb21a3a17345cdc07be9e68fd8ab690cbacee236c71"}
Jul 13 15:24:43.764358 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:43.764301    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5bv64" podStartSLOduration=68.233139161 podStartE2EDuration="1m9.764270055s" totalImagesPullingTime="1.531130894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:23:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:43.763768452 +0000 UTC m=+70.088490350" watchObservedRunningTime="2026-07-13 15:24:43.764270055 +0000 UTC m=+70.088991957"
Jul 13 15:24:44.021498 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:44.021453    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:44.153883 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:44.153793    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:44.199195 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:44.199166    2555 scope.go:117] "RemoveContainer" containerID="fe25a3f226ac00391c4f0ea984df8436f33bff44aaf0398bd26ce315f64df1dd"
Jul 13 15:24:44.775542 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:44.775451    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:45.165247 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:45.165106    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:45.264621 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:45.264571    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:45.959269 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:45.959111    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:46.042777 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:46.042735    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:46.374226 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:46.374175    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:46.474904 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:46.474865    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:47.942814 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:47.942774    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:48.007432 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:48.007347    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:48.491450 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:48.491390    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:53.247502 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:53.247464    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:53.340988 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:53.340950    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:53.785709 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:53.785271    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hmvfz" event={"ID":"b605a361-0f6b-4318-b532-efcfbd569501","Type":"ContainerStarted","Data":"6cbb9dc98635ca19b71d4d1e51bfcc5aeaaaefd5d887656b0c9220757ced3c46"}
Jul 13 15:24:53.788237 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:53.788160    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tdnrr" event={"ID":"72ca268f-c70d-4218-a657-7f1f9f4b1d7c","Type":"ContainerStarted","Data":"ffdd03de2d0312937ecbdeec877520fad0b1c40a38b832bb8db4790d0f447ce8"}
Jul 13 15:24:53.788237 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:53.788216    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tdnrr" event={"ID":"72ca268f-c70d-4218-a657-7f1f9f4b1d7c","Type":"ContainerStarted","Data":"415cd18836ec6e0d05da54743ac35640ba547ca40a791496e9d2551b56fb1f79"}
Jul 13 15:24:53.788449 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:53.788247    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tdnrr"
Jul 13 15:24:53.789739 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:53.789710    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hdgtx" event={"ID":"1f78133a-9d4f-47fb-8253-2220a6139ab9","Type":"ContainerStarted","Data":"fddafb95460a413fc93243c1c0159366f9ab4e649763e6f011e6e5570431cd6e"}
Jul 13 15:24:53.792183 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:53.792116    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9f8594dc-xshtx" event={"ID":"4d485558-3c13-41e0-a608-436166c55205","Type":"ContainerStarted","Data":"57b2fd067606216388b3653aef17f6ebc3c579e5a0175d0ba0b265b80faf60da"}
Jul 13 15:24:53.792183 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:53.792157    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9f8594dc-xshtx" event={"ID":"4d485558-3c13-41e0-a608-436166c55205","Type":"ContainerStarted","Data":"179a9f7626449ba48d3723a3f2027beb58feb90fbdda09e27b7e9f3fe9581893"}
Jul 13 15:24:53.793748 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:53.793726    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bc59-rtgrb" event={"ID":"ca850af6-166c-4c02-a9e3-1a86df65665e","Type":"ContainerStarted","Data":"a63a173aa6782a54272ac97976200f37a2b1c0b137f5451dc40c58f5d6aa1a22"}
Jul 13 15:24:53.793907 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:53.793892    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bc59-rtgrb"
Jul 13 15:24:53.796044 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:53.796025    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bc59-rtgrb"
Jul 13 15:24:53.796438 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:53.796420    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cptrx_90f53326-a36e-4682-a268-bdfec7cf722b/console-operator/1.log"
Jul 13 15:24:53.796530 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:53.796511    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-cptrx" event={"ID":"90f53326-a36e-4682-a268-bdfec7cf722b","Type":"ContainerStarted","Data":"12f08637e727f0cc7ef9f473604734d59e7e07ca60002bca6f79363445af7e1b"}
Jul 13 15:24:53.796815 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:53.796797    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-cptrx"
Jul 13 15:24:53.799502 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:53.799480    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vwk27" event={"ID":"20415ed9-d86c-492d-bb29-21922b2a8677","Type":"ContainerStarted","Data":"2e481ffe00640b3a2708e233c4f37624cafab18e434e2ae52d2bd9b050a19005"}
Jul 13 15:24:53.801129 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:53.801106    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-756bd7b76-mc6zk" event={"ID":"33c524f8-c79a-4ee2-8b65-2b79a4b16297","Type":"ContainerStarted","Data":"2424fe39fc76a2b64ed5dcb70468a9a47f1cf108dc54939cc892d4c4c0e111e0"}
Jul 13 15:24:53.803528 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:53.802913    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-tc2dm" event={"ID":"345f2b29-8ee5-4aef-97b7-422594da4954","Type":"ContainerStarted","Data":"a0b8bcbae6ce0f1f215395f5c8eac362c88ac5348ed25802d0338c617852a754"}
Jul 13 15:24:53.808942 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:53.808898    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hmvfz" podStartSLOduration=55.856931957 podStartE2EDuration="1m7.808864017s" totalImagesPullingTime="11.95193206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:23:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:53.805932021 +0000 UTC m=+80.130653919" watchObservedRunningTime="2026-07-13 15:24:53.808864017 +0000 UTC m=+80.133585916"
Jul 13 15:24:53.827756 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:53.827706    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tdnrr" podStartSLOduration=34.350420806 podStartE2EDuration="44.827688678s" totalImagesPullingTime="10.477267872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:24:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:53.827520573 +0000 UTC m=+80.152242474" watchObservedRunningTime="2026-07-13 15:24:53.827688678 +0000 UTC m=+80.152410576"
Jul 13 15:24:53.856650 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:53.856572    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bc59-rtgrb" podStartSLOduration=1.57314223 podStartE2EDuration="11.856552232s" totalImagesPullingTime="10.283410002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:24:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:53.856252371 +0000 UTC m=+80.180974269" watchObservedRunningTime="2026-07-13 15:24:53.856552232 +0000 UTC m=+80.181274131"
Jul 13 15:24:53.882094 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:53.882035    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-tc2dm" podStartSLOduration=53.602014601 podStartE2EDuration="1m3.882014993s" totalImagesPullingTime="10.280000392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:23:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:53.880684408 +0000 UTC m=+80.205406308" watchObservedRunningTime="2026-07-13 15:24:53.882014993 +0000 UTC m=+80.206736890"
Jul 13 15:24:53.917228 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:53.917175    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-cptrx" podStartSLOduration=60.196378751 podStartE2EDuration="1m7.917151818s" totalImagesPullingTime="7.720773067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:23:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:53.915280446 +0000 UTC m=+80.240002344" watchObservedRunningTime="2026-07-13 15:24:53.917151818 +0000 UTC m=+80.241873718"
Jul 13 15:24:53.949497 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:53.949442    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vwk27" podStartSLOduration=17.157490919 podStartE2EDuration="33.94942754s" totalImagesPullingTime="16.791936621s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 15:24:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:53.947826726 +0000 UTC m=+80.272548663" watchObservedRunningTime="2026-07-13 15:24:53.94942754 +0000 UTC m=+80.274149436"
Jul 13 15:24:53.960600 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:53.960556    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:53.969493 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:53.969448    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hdgtx" podStartSLOduration=67.236373304 podStartE2EDuration="1m19.969432987s" totalImagesPullingTime="12.733059683s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 15:23:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:53.967899109 +0000 UTC m=+80.292621006" watchObservedRunningTime="2026-07-13 15:24:53.969432987 +0000 UTC m=+80.294154884"
Jul 13 15:24:53.992992 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:53.992939    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-756bd7b76-mc6zk" podStartSLOduration=1.7365819070000001 podStartE2EDuration="11.992920843s" totalImagesPullingTime="10.256338936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:24:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:53.991798786 +0000 UTC m=+80.316520684" watchObservedRunningTime="2026-07-13 15:24:53.992920843 +0000 UTC m=+80.317642740"
Jul 13 15:24:54.048653 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:54.048509    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:54.141177 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:54.141138    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:54.220815 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:54.220782    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-cptrx"
Jul 13 15:24:54.223238 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:54.223210    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:54.313973 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:54.313886    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:54.422949 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:54.422887    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:54.507562 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:54.507523    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:54.587728 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:54.587654    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:54.808812 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:54.808771    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9f8594dc-xshtx" event={"ID":"4d485558-3c13-41e0-a608-436166c55205","Type":"ContainerStarted","Data":"fec8c97697273a2e770e17292c3173bedb5885b4b629cc299b051c426f6445df"}
Jul 13 15:24:54.832189 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:54.832060    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-9f8594dc-xshtx" podStartSLOduration=2.6512192089999997 podStartE2EDuration="12.832043334s" totalImagesPullingTime="10.180824125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:24:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:24:54.831956923 +0000 UTC m=+81.156678821" watchObservedRunningTime="2026-07-13 15:24:54.832043334 +0000 UTC m=+81.156765235"
Jul 13 15:24:54.909487 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:54.909402    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:55.094426 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:55.094387    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:55.195218 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:55.195136    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:55.637657 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:55.637624    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:56.411292 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:56.411152    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:56.510113 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:56.510073    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:56.677285 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:56.677200    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:57.139390 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:57.139352    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:57.240125 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:57.240087    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:58.187990 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:58.187952    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:58.269642 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:58.269574    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:24:58.429367 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:24:58.429316    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:00.614897 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:00.614857    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:01.140764 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:01.140722    2555 patch_prober.go:28] interesting pod/image-registry-79dcbccd46-gmr5j container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 13 15:25:01.140924 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:01.140793    2555 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-79dcbccd46-gmr5j" podUID="9d90766b-99c5-4d7e-966a-1b413eabd11b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 15:25:01.689725 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:01.689691    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:01.790549 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:01.790511    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:02.709391 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:02.709359    2555 patch_prober.go:28] interesting pod/image-registry-79dcbccd46-gmr5j container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 13 15:25:02.709926 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:02.709441    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-79dcbccd46-gmr5j" podUID="9d90766b-99c5-4d7e-966a-1b413eabd11b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 15:25:03.337357 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:03.337323    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:03.435916 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:03.435880    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:03.537247 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:03.537213    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:03.644496 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:03.644399    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:03.671439 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:03.671406    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6qdcn"]
Jul 13 15:25:03.678891 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:03.678864    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6qdcn"
Jul 13 15:25:03.683708 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:03.683683    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 13 15:25:03.684064 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:03.683682    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 13 15:25:03.684222 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:03.683683    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 13 15:25:03.684222 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:03.683723    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 13 15:25:03.684906 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:03.684884    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hjgnp\""
Jul 13 15:25:03.750080 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:03.750018    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:03.794104 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:03.794065    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f3f7655b-679e-4b6f-a692-5c4dd8cc623c-root\") pod \"node-exporter-6qdcn\" (UID: \"f3f7655b-679e-4b6f-a692-5c4dd8cc623c\") " pod="openshift-monitoring/node-exporter-6qdcn"
Jul 13 15:25:03.794285 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:03.794119    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f3f7655b-679e-4b6f-a692-5c4dd8cc623c-node-exporter-tls\") pod \"node-exporter-6qdcn\" (UID: \"f3f7655b-679e-4b6f-a692-5c4dd8cc623c\") " pod="openshift-monitoring/node-exporter-6qdcn"
Jul 13 15:25:03.794285 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:03.794152    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f3f7655b-679e-4b6f-a692-5c4dd8cc623c-node-exporter-accelerators-collector-config\") pod \"node-exporter-6qdcn\" (UID: \"f3f7655b-679e-4b6f-a692-5c4dd8cc623c\") " pod="openshift-monitoring/node-exporter-6qdcn"
Jul 13 15:25:03.794404 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:03.794274    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f3f7655b-679e-4b6f-a692-5c4dd8cc623c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6qdcn\" (UID: \"f3f7655b-679e-4b6f-a692-5c4dd8cc623c\") " pod="openshift-monitoring/node-exporter-6qdcn"
Jul 13 15:25:03.794404 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:03.794335    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3f7655b-679e-4b6f-a692-5c4dd8cc623c-metrics-client-ca\") pod \"node-exporter-6qdcn\" (UID: \"f3f7655b-679e-4b6f-a692-5c4dd8cc623c\") " pod="openshift-monitoring/node-exporter-6qdcn"
Jul 13 15:25:03.794404 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:03.794372    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f3f7655b-679e-4b6f-a692-5c4dd8cc623c-sys\") pod \"node-exporter-6qdcn\" (UID: \"f3f7655b-679e-4b6f-a692-5c4dd8cc623c\") " pod="openshift-monitoring/node-exporter-6qdcn"
Jul 13 15:25:03.794404 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:03.794400    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48d2w\" (UniqueName: \"kubernetes.io/projected/f3f7655b-679e-4b6f-a692-5c4dd8cc623c-kube-api-access-48d2w\") pod \"node-exporter-6qdcn\" (UID: \"f3f7655b-679e-4b6f-a692-5c4dd8cc623c\") " pod="openshift-monitoring/node-exporter-6qdcn"
Jul 13 15:25:03.794620 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:03.794437    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f3f7655b-679e-4b6f-a692-5c4dd8cc623c-node-exporter-textfile\") pod \"node-exporter-6qdcn\" (UID: \"f3f7655b-679e-4b6f-a692-5c4dd8cc623c\") " pod="openshift-monitoring/node-exporter-6qdcn"
Jul 13 15:25:03.794620 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:03.794461    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f3f7655b-679e-4b6f-a692-5c4dd8cc623c-node-exporter-wtmp\") pod \"node-exporter-6qdcn\" (UID: \"f3f7655b-679e-4b6f-a692-5c4dd8cc623c\") " pod="openshift-monitoring/node-exporter-6qdcn"
Jul 13 15:25:03.811786 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:03.811756    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tdnrr"
Jul 13 15:25:03.840111 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:03.840067    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:03.895607 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:03.895480    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48d2w\" (UniqueName: \"kubernetes.io/projected/f3f7655b-679e-4b6f-a692-5c4dd8cc623c-kube-api-access-48d2w\") pod \"node-exporter-6qdcn\" (UID: \"f3f7655b-679e-4b6f-a692-5c4dd8cc623c\") " pod="openshift-monitoring/node-exporter-6qdcn"
Jul 13 15:25:03.895607 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:03.895542    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f3f7655b-679e-4b6f-a692-5c4dd8cc623c-node-exporter-textfile\") pod \"node-exporter-6qdcn\" (UID: \"f3f7655b-679e-4b6f-a692-5c4dd8cc623c\") " pod="openshift-monitoring/node-exporter-6qdcn"
Jul 13 15:25:03.895607 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:03.895570    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f3f7655b-679e-4b6f-a692-5c4dd8cc623c-node-exporter-wtmp\") pod \"node-exporter-6qdcn\" (UID: \"f3f7655b-679e-4b6f-a692-5c4dd8cc623c\") " pod="openshift-monitoring/node-exporter-6qdcn"
Jul 13 15:25:03.895934 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:03.895909    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f3f7655b-679e-4b6f-a692-5c4dd8cc623c-root\") pod \"node-exporter-6qdcn\" (UID: \"f3f7655b-679e-4b6f-a692-5c4dd8cc623c\") " pod="openshift-monitoring/node-exporter-6qdcn"
Jul 13 15:25:03.896002 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:03.895948    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f3f7655b-679e-4b6f-a692-5c4dd8cc623c-node-exporter-tls\") pod \"node-exporter-6qdcn\" (UID: \"f3f7655b-679e-4b6f-a692-5c4dd8cc623c\") " pod="openshift-monitoring/node-exporter-6qdcn"
Jul 13 15:25:03.896055 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:03.895999    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f3f7655b-679e-4b6f-a692-5c4dd8cc623c-node-exporter-wtmp\") pod \"node-exporter-6qdcn\" (UID: \"f3f7655b-679e-4b6f-a692-5c4dd8cc623c\") " pod="openshift-monitoring/node-exporter-6qdcn"
Jul 13 15:25:03.896055 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:03.896007    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f3f7655b-679e-4b6f-a692-5c4dd8cc623c-node-exporter-accelerators-collector-config\") pod \"node-exporter-6qdcn\" (UID: \"f3f7655b-679e-4b6f-a692-5c4dd8cc623c\") " pod="openshift-monitoring/node-exporter-6qdcn"
Jul 13 15:25:03.896055 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:03.895999    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f3f7655b-679e-4b6f-a692-5c4dd8cc623c-node-exporter-textfile\") pod \"node-exporter-6qdcn\" (UID: \"f3f7655b-679e-4b6f-a692-5c4dd8cc623c\") " pod="openshift-monitoring/node-exporter-6qdcn"
Jul 13 15:25:03.896198 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:03.896065    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f3f7655b-679e-4b6f-a692-5c4dd8cc623c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6qdcn\" (UID: \"f3f7655b-679e-4b6f-a692-5c4dd8cc623c\") " pod="openshift-monitoring/node-exporter-6qdcn"
Jul 13 15:25:03.896198 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:03.896097    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3f7655b-679e-4b6f-a692-5c4dd8cc623c-metrics-client-ca\") pod \"node-exporter-6qdcn\" (UID: \"f3f7655b-679e-4b6f-a692-5c4dd8cc623c\") " pod="openshift-monitoring/node-exporter-6qdcn"
Jul 13 15:25:03.896198 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:03.896147    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f3f7655b-679e-4b6f-a692-5c4dd8cc623c-sys\") pod \"node-exporter-6qdcn\" (UID: \"f3f7655b-679e-4b6f-a692-5c4dd8cc623c\") " pod="openshift-monitoring/node-exporter-6qdcn"
Jul 13 15:25:03.896354 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:03.896229    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f3f7655b-679e-4b6f-a692-5c4dd8cc623c-sys\") pod \"node-exporter-6qdcn\" (UID: \"f3f7655b-679e-4b6f-a692-5c4dd8cc623c\") " pod="openshift-monitoring/node-exporter-6qdcn"
Jul 13 15:25:03.896407 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:25:03.896377    2555 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 13 15:25:03.896465 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:25:03.896453    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3f7655b-679e-4b6f-a692-5c4dd8cc623c-node-exporter-tls podName:f3f7655b-679e-4b6f-a692-5c4dd8cc623c nodeName:}" failed. No retries permitted until 2026-07-13 15:25:04.396431294 +0000 UTC m=+90.721153172 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/f3f7655b-679e-4b6f-a692-5c4dd8cc623c-node-exporter-tls") pod "node-exporter-6qdcn" (UID: "f3f7655b-679e-4b6f-a692-5c4dd8cc623c") : secret "node-exporter-tls" not found
Jul 13 15:25:03.896576 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:03.896550    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f3f7655b-679e-4b6f-a692-5c4dd8cc623c-node-exporter-accelerators-collector-config\") pod \"node-exporter-6qdcn\" (UID: \"f3f7655b-679e-4b6f-a692-5c4dd8cc623c\") " pod="openshift-monitoring/node-exporter-6qdcn"
Jul 13 15:25:03.896728 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:03.896707    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f3f7655b-679e-4b6f-a692-5c4dd8cc623c-root\") pod \"node-exporter-6qdcn\" (UID: \"f3f7655b-679e-4b6f-a692-5c4dd8cc623c\") " pod="openshift-monitoring/node-exporter-6qdcn"
Jul 13 15:25:03.896798 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:03.896766    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3f7655b-679e-4b6f-a692-5c4dd8cc623c-metrics-client-ca\") pod \"node-exporter-6qdcn\" (UID: \"f3f7655b-679e-4b6f-a692-5c4dd8cc623c\") " pod="openshift-monitoring/node-exporter-6qdcn"
Jul 13 15:25:03.898872 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:03.898849    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f3f7655b-679e-4b6f-a692-5c4dd8cc623c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6qdcn\" (UID: \"f3f7655b-679e-4b6f-a692-5c4dd8cc623c\") " pod="openshift-monitoring/node-exporter-6qdcn"
Jul 13 15:25:03.913127 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:03.912964    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48d2w\" (UniqueName: \"kubernetes.io/projected/f3f7655b-679e-4b6f-a692-5c4dd8cc623c-kube-api-access-48d2w\") pod \"node-exporter-6qdcn\" (UID: \"f3f7655b-679e-4b6f-a692-5c4dd8cc623c\") " pod="openshift-monitoring/node-exporter-6qdcn"
Jul 13 15:25:04.360442 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:04.360405    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:04.400044 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:04.400009    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f3f7655b-679e-4b6f-a692-5c4dd8cc623c-node-exporter-tls\") pod \"node-exporter-6qdcn\" (UID: \"f3f7655b-679e-4b6f-a692-5c4dd8cc623c\") " pod="openshift-monitoring/node-exporter-6qdcn"
Jul 13 15:25:04.402469 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:04.402434    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f3f7655b-679e-4b6f-a692-5c4dd8cc623c-node-exporter-tls\") pod \"node-exporter-6qdcn\" (UID: \"f3f7655b-679e-4b6f-a692-5c4dd8cc623c\") " pod="openshift-monitoring/node-exporter-6qdcn"
Jul 13 15:25:04.514888 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:04.514850    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:04.598074 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:04.598047    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6qdcn"
Jul 13 15:25:04.611722 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:25:04.611662    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3f7655b_679e_4b6f_a692_5c4dd8cc623c.slice/crio-5b218342b643dd1cefce790eff78361e606df397e2cc30cc8105e038f95ab797 WatchSource:0}: Error finding container 5b218342b643dd1cefce790eff78361e606df397e2cc30cc8105e038f95ab797: Status 404 returned error can't find the container with id 5b218342b643dd1cefce790eff78361e606df397e2cc30cc8105e038f95ab797
Jul 13 15:25:04.744052 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:04.744008    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:04.851704 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:04.851672    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6qdcn" event={"ID":"f3f7655b-679e-4b6f-a692-5c4dd8cc623c","Type":"ContainerStarted","Data":"5b218342b643dd1cefce790eff78361e606df397e2cc30cc8105e038f95ab797"}
Jul 13 15:25:04.869061 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:04.868975    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:04.964847 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:04.964812    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:05.172119 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:05.171939    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:05.265410 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:05.265371    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:05.730209 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:05.730179    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:05.833954 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:05.833919    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:05.857265 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:05.857234    2555 generic.go:356] "Generic (PLEG): container finished" podID="f3f7655b-679e-4b6f-a692-5c4dd8cc623c" containerID="430b2837518cefa55b0c82e20b1d7779dcaee23711e28a0ef27c53a0d61bd888" exitCode=0
Jul 13 15:25:05.857688 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:05.857279    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6qdcn" event={"ID":"f3f7655b-679e-4b6f-a692-5c4dd8cc623c","Type":"ContainerDied","Data":"430b2837518cefa55b0c82e20b1d7779dcaee23711e28a0ef27c53a0d61bd888"}
Jul 13 15:25:06.864139 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:06.864101    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6qdcn" event={"ID":"f3f7655b-679e-4b6f-a692-5c4dd8cc623c","Type":"ContainerStarted","Data":"7e5b2143aaf7863f92456aacf7d19168b66cc1c5172562db0c393cb99efb742f"}
Jul 13 15:25:06.864651 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:06.864163    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6qdcn" event={"ID":"f3f7655b-679e-4b6f-a692-5c4dd8cc623c","Type":"ContainerStarted","Data":"4f3149ed6998d5ac7d4d1ac6b580aa9572e851cf297fbf8bbef98df715325d2a"}
Jul 13 15:25:06.886628 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:06.886560    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6qdcn" podStartSLOduration=2.969392261 podStartE2EDuration="3.886544459s" totalImagesPullingTime="854.269104ms" totalInitContainerRuntime="62.883094ms" isStatefulPod=true podCreationTimestamp="2026-07-13 15:25:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:25:06.884939241 +0000 UTC m=+93.209661164" watchObservedRunningTime="2026-07-13 15:25:06.886544459 +0000 UTC m=+93.211266355"
Jul 13 15:25:07.011042 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:07.011000    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:07.168179 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:07.168083    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:07.446548 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:07.446456    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:07.519093 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:07.519057    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:07.621395 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:07.621357    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:07.720820 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:07.720789    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:08.340127 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:08.340087    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:08.420835 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:08.420796    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:08.486204 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:08.486167    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:08.563096 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:08.563060    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:09.208547 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:09.208515    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:09.323969 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:09.323935    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:10.076537 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:10.076497    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:10.157979 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:10.157947    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:10.226339 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:10.226302    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:10.408862 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:10.408787    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-79dcbccd46-gmr5j"]
Jul 13 15:25:10.414297 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:10.414255    2555 patch_prober.go:28] interesting pod/image-registry-79dcbccd46-gmr5j container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 13 15:25:10.414439 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:10.414319    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-79dcbccd46-gmr5j" podUID="9d90766b-99c5-4d7e-966a-1b413eabd11b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 15:25:10.535884 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:10.535842    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:10.653957 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:10.653916    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:10.731215 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:10.731174    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:11.186348 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:11.186253    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:11.275959 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:11.275921    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:12.150757 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:12.150719    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:12.223301 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:12.223263    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:12.708039 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:12.708012    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jfg9j"
Jul 13 15:25:13.052457 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:13.052422    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:13.118849 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:13.118821    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:14.328456 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:14.328420    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:14.435432 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:14.435377    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:15.589304 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:15.589263    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:15.687044 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:15.687007    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:15.787298 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:15.787265    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:20.253885 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:20.253844    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:20.354047 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:20.353998    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:20.413776 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:20.413749    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-79dcbccd46-gmr5j"
Jul 13 15:25:21.934171 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:21.934135    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:22.036191 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:22.036155    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:22.138571 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:22.138531    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:23.333806 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:23.333773    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:23.694358 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:23.694279    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:23.796102 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:23.796060    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:24.176281 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:24.176242    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:24.238034 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:24.237993    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:29.736068 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:29.736037    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:29.837713 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:29.837674    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:29.962600 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:29.962544    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:34.969299 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:34.969268    2555 generic.go:356] "Generic (PLEG): container finished" podID="118282ab-3ef5-49f2-ad43-9d5eefdacf9b" containerID="f7d8185fca1144f7b293c0bfb15f3deef6952d8ec1e152921d4d0505254e7b67" exitCode=0
Jul 13 15:25:34.969835 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:34.969344    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qtg8w" event={"ID":"118282ab-3ef5-49f2-ad43-9d5eefdacf9b","Type":"ContainerDied","Data":"f7d8185fca1144f7b293c0bfb15f3deef6952d8ec1e152921d4d0505254e7b67"}
Jul 13 15:25:34.969835 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:34.969698    2555 scope.go:117] "RemoveContainer" containerID="f7d8185fca1144f7b293c0bfb15f3deef6952d8ec1e152921d4d0505254e7b67"
Jul 13 15:25:35.430253 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:35.430153    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-79dcbccd46-gmr5j" podUID="9d90766b-99c5-4d7e-966a-1b413eabd11b" containerName="registry" containerID="cri-o://135b57f9abcbe3976542facbdc5cbcd15911298675c4245170b8892c55fddbd4" gracePeriod=30
Jul 13 15:25:35.668704 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:35.668679    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79dcbccd46-gmr5j"
Jul 13 15:25:35.762799 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:35.762764    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d90766b-99c5-4d7e-966a-1b413eabd11b-registry-tls\") pod \"9d90766b-99c5-4d7e-966a-1b413eabd11b\" (UID: \"9d90766b-99c5-4d7e-966a-1b413eabd11b\") "
Jul 13 15:25:35.763007 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:35.762818    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9d90766b-99c5-4d7e-966a-1b413eabd11b-ca-trust-extracted\") pod \"9d90766b-99c5-4d7e-966a-1b413eabd11b\" (UID: \"9d90766b-99c5-4d7e-966a-1b413eabd11b\") "
Jul 13 15:25:35.763007 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:35.762851    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9d90766b-99c5-4d7e-966a-1b413eabd11b-registry-certificates\") pod \"9d90766b-99c5-4d7e-966a-1b413eabd11b\" (UID: \"9d90766b-99c5-4d7e-966a-1b413eabd11b\") "
Jul 13 15:25:35.763007 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:35.762891    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d90766b-99c5-4d7e-966a-1b413eabd11b-bound-sa-token\") pod \"9d90766b-99c5-4d7e-966a-1b413eabd11b\" (UID: \"9d90766b-99c5-4d7e-966a-1b413eabd11b\") "
Jul 13 15:25:35.763007 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:35.762950    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9d90766b-99c5-4d7e-966a-1b413eabd11b-image-registry-private-configuration\") pod \"9d90766b-99c5-4d7e-966a-1b413eabd11b\" (UID: \"9d90766b-99c5-4d7e-966a-1b413eabd11b\") "
Jul 13 15:25:35.763007 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:35.762971    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9d90766b-99c5-4d7e-966a-1b413eabd11b-installation-pull-secrets\") pod \"9d90766b-99c5-4d7e-966a-1b413eabd11b\" (UID: \"9d90766b-99c5-4d7e-966a-1b413eabd11b\") "
Jul 13 15:25:35.763341 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:35.763011    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d90766b-99c5-4d7e-966a-1b413eabd11b-trusted-ca\") pod \"9d90766b-99c5-4d7e-966a-1b413eabd11b\" (UID: \"9d90766b-99c5-4d7e-966a-1b413eabd11b\") "
Jul 13 15:25:35.763341 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:35.763033    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x5l55\" (UniqueName: \"kubernetes.io/projected/9d90766b-99c5-4d7e-966a-1b413eabd11b-kube-api-access-x5l55\") pod \"9d90766b-99c5-4d7e-966a-1b413eabd11b\" (UID: \"9d90766b-99c5-4d7e-966a-1b413eabd11b\") "
Jul 13 15:25:35.763438 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:35.763364    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d90766b-99c5-4d7e-966a-1b413eabd11b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9d90766b-99c5-4d7e-966a-1b413eabd11b" (UID: "9d90766b-99c5-4d7e-966a-1b413eabd11b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:25:35.763863 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:35.763827    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d90766b-99c5-4d7e-966a-1b413eabd11b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9d90766b-99c5-4d7e-966a-1b413eabd11b" (UID: "9d90766b-99c5-4d7e-966a-1b413eabd11b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:25:35.765566 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:35.765541    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d90766b-99c5-4d7e-966a-1b413eabd11b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9d90766b-99c5-4d7e-966a-1b413eabd11b" (UID: "9d90766b-99c5-4d7e-966a-1b413eabd11b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:25:35.765711 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:35.765660    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d90766b-99c5-4d7e-966a-1b413eabd11b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9d90766b-99c5-4d7e-966a-1b413eabd11b" (UID: "9d90766b-99c5-4d7e-966a-1b413eabd11b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:25:35.765863 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:35.765835    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d90766b-99c5-4d7e-966a-1b413eabd11b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9d90766b-99c5-4d7e-966a-1b413eabd11b" (UID: "9d90766b-99c5-4d7e-966a-1b413eabd11b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 15:25:35.765904 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:35.765842    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d90766b-99c5-4d7e-966a-1b413eabd11b-kube-api-access-x5l55" (OuterVolumeSpecName: "kube-api-access-x5l55") pod "9d90766b-99c5-4d7e-966a-1b413eabd11b" (UID: "9d90766b-99c5-4d7e-966a-1b413eabd11b"). InnerVolumeSpecName "kube-api-access-x5l55". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:25:35.766150 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:35.766125    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d90766b-99c5-4d7e-966a-1b413eabd11b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9d90766b-99c5-4d7e-966a-1b413eabd11b" (UID: "9d90766b-99c5-4d7e-966a-1b413eabd11b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 15:25:35.771661 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:35.771638    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d90766b-99c5-4d7e-966a-1b413eabd11b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9d90766b-99c5-4d7e-966a-1b413eabd11b" (UID: "9d90766b-99c5-4d7e-966a-1b413eabd11b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:25:35.864193 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:35.864152    2555 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9d90766b-99c5-4d7e-966a-1b413eabd11b-ca-trust-extracted\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:25:35.864193 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:35.864186    2555 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9d90766b-99c5-4d7e-966a-1b413eabd11b-registry-certificates\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:25:35.864193 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:35.864196    2555 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d90766b-99c5-4d7e-966a-1b413eabd11b-bound-sa-token\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:25:35.864436 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:35.864206    2555 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9d90766b-99c5-4d7e-966a-1b413eabd11b-image-registry-private-configuration\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:25:35.864436 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:35.864216    2555 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9d90766b-99c5-4d7e-966a-1b413eabd11b-installation-pull-secrets\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:25:35.864436 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:35.864226    2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d90766b-99c5-4d7e-966a-1b413eabd11b-trusted-ca\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:25:35.864436 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:35.864236    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5l55\" (UniqueName: \"kubernetes.io/projected/9d90766b-99c5-4d7e-966a-1b413eabd11b-kube-api-access-x5l55\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:25:35.864436 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:35.864244    2555 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9d90766b-99c5-4d7e-966a-1b413eabd11b-registry-tls\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:25:35.975552 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:35.975513    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-qtg8w" event={"ID":"118282ab-3ef5-49f2-ad43-9d5eefdacf9b","Type":"ContainerStarted","Data":"16dce30e40b5981e2c84a049a3822b19f74ebe16dd301917ac3f7d1dcb6ed62c"}
Jul 13 15:25:35.976735 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:35.976710    2555 generic.go:356] "Generic (PLEG): container finished" podID="9d90766b-99c5-4d7e-966a-1b413eabd11b" containerID="135b57f9abcbe3976542facbdc5cbcd15911298675c4245170b8892c55fddbd4" exitCode=0
Jul 13 15:25:35.976847 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:35.976737    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79dcbccd46-gmr5j"
Jul 13 15:25:35.976847 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:35.976758    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79dcbccd46-gmr5j" event={"ID":"9d90766b-99c5-4d7e-966a-1b413eabd11b","Type":"ContainerDied","Data":"135b57f9abcbe3976542facbdc5cbcd15911298675c4245170b8892c55fddbd4"}
Jul 13 15:25:35.976847 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:35.976800    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79dcbccd46-gmr5j" event={"ID":"9d90766b-99c5-4d7e-966a-1b413eabd11b","Type":"ContainerDied","Data":"0d8226673f2d35bdb78a606b81a8d3311082649c36919f2247e7bf10d450b516"}
Jul 13 15:25:35.976847 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:35.976822    2555 scope.go:117] "RemoveContainer" containerID="135b57f9abcbe3976542facbdc5cbcd15911298675c4245170b8892c55fddbd4"
Jul 13 15:25:35.985380 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:35.985360    2555 scope.go:117] "RemoveContainer" containerID="135b57f9abcbe3976542facbdc5cbcd15911298675c4245170b8892c55fddbd4"
Jul 13 15:25:35.985657 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:25:35.985633    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"135b57f9abcbe3976542facbdc5cbcd15911298675c4245170b8892c55fddbd4\": container with ID starting with 135b57f9abcbe3976542facbdc5cbcd15911298675c4245170b8892c55fddbd4 not found: ID does not exist" containerID="135b57f9abcbe3976542facbdc5cbcd15911298675c4245170b8892c55fddbd4"
Jul 13 15:25:35.985719 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:35.985666    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"135b57f9abcbe3976542facbdc5cbcd15911298675c4245170b8892c55fddbd4"} err="failed to get container status \"135b57f9abcbe3976542facbdc5cbcd15911298675c4245170b8892c55fddbd4\": rpc error: code = NotFound desc = could not find container \"135b57f9abcbe3976542facbdc5cbcd15911298675c4245170b8892c55fddbd4\": container with ID starting with 135b57f9abcbe3976542facbdc5cbcd15911298675c4245170b8892c55fddbd4 not found: ID does not exist"
Jul 13 15:25:36.018304 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:36.018219    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-79dcbccd46-gmr5j"]
Jul 13 15:25:36.025510 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:36.025480    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-79dcbccd46-gmr5j"]
Jul 13 15:25:36.201623 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:36.201572    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d90766b-99c5-4d7e-966a-1b413eabd11b" path="/var/lib/kubelet/pods/9d90766b-99c5-4d7e-966a-1b413eabd11b/volumes"
Jul 13 15:25:36.522527 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:36.522495    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:39.193495 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:39.193463    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:39.326628 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:39.326566    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:25:39.993995 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:39.993963    2555 generic.go:356] "Generic (PLEG): container finished" podID="42b230fa-7a3d-43ef-909f-24805511fd6d" containerID="0d4029272e56fa8806a94589b1fb3948741f1c90e219f230b6124d61c24a715e" exitCode=0
Jul 13 15:25:39.994184 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:39.994041    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-nn7v5" event={"ID":"42b230fa-7a3d-43ef-909f-24805511fd6d","Type":"ContainerDied","Data":"0d4029272e56fa8806a94589b1fb3948741f1c90e219f230b6124d61c24a715e"}
Jul 13 15:25:39.994440 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:39.994421    2555 scope.go:117] "RemoveContainer" containerID="0d4029272e56fa8806a94589b1fb3948741f1c90e219f230b6124d61c24a715e"
Jul 13 15:25:39.995501 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:39.995479    2555 generic.go:356] "Generic (PLEG): container finished" podID="63c0fc8b-9a59-4a66-81e6-f712ebed0254" containerID="cdba9bc992ca4ce1617373cd78756e3f8748d48d4886c913618ae72a491949be" exitCode=0
Jul 13 15:25:39.995637 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:39.995530    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-t4nd7" event={"ID":"63c0fc8b-9a59-4a66-81e6-f712ebed0254","Type":"ContainerDied","Data":"cdba9bc992ca4ce1617373cd78756e3f8748d48d4886c913618ae72a491949be"}
Jul 13 15:25:39.995796 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:39.995783    2555 scope.go:117] "RemoveContainer" containerID="cdba9bc992ca4ce1617373cd78756e3f8748d48d4886c913618ae72a491949be"
Jul 13 15:25:41.001470 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:41.001429    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-t4nd7" event={"ID":"63c0fc8b-9a59-4a66-81e6-f712ebed0254","Type":"ContainerStarted","Data":"ecb73ea7c8519ec6777f42bd870740b621ed6350c4976e4c0fd7ea3a1a5ea1c0"}
Jul 13 15:25:41.003249 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:25:41.003223    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-nn7v5" event={"ID":"42b230fa-7a3d-43ef-909f-24805511fd6d","Type":"ContainerStarted","Data":"fcee8d547f7369d94c57a099cf206dbaa4cf1e61e77804015130dbfd9e93bf48"}
Jul 13 15:26:19.940520 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:26:19.940482    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:26:20.014638 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:26:20.014573    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:26:29.433696 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:26:29.433611    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:26:29.528668 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:26:29.528622    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:26:29.599646 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:26:29.599605    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:26:30.120901 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:26:30.120863    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:26:30.223602 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:26:30.223559    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:26:31.820973 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:26:31.820937    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:26:31.897657 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:26:31.897617    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:26:39.174047 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:26:39.174011    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:26:39.274002 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:26:39.273965    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:26:39.345334 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:26:39.345299    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:26:39.973575 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:26:39.973542    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:26:40.084807 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:26:40.084767    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:26:40.184812 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:26:40.184776    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:27:11.458005 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:27:11.457959    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:27:11.528906 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:27:11.528868    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:27:23.190510 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:27:23.190469    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:27:23.291015 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:27:23.290981    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:27:28.250386 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:27:28.250348    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:27:36.282609 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:27:36.282545    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:27:50.600844 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:27:50.600804    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:27:51.630968 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:27:51.630932    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:27:54.213766 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:27:54.213735    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:27:54.316273 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:27:54.316242    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:27:55.150108 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:27:55.150072    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:27:55.250453 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:27:55.250423    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:27:55.492291 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:27:55.492265    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:27:57.010402 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:27:57.010318    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:27:57.110107 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:27:57.110067    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:27:58.064364 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:27:58.064331    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:27:58.276311 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:27:58.276276    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:28:01.013363 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:01.013325    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:28:01.096210 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:01.096174    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:28:04.631227 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:04.631185    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:28:04.735920 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:04.735881    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:28:05.294498 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:05.294459    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:28:12.499964 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:12.499918    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:28:12.590246 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:12.590212    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:28:12.901433 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:12.901342    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:28:13.000367 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:13.000331    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:28:14.694929 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:14.694887    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:28:31.882726 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:31.882686    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:28:32.014760 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:32.014724    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:28:32.475211 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:32.475175    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:28:32.696876 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:32.696844    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:28:32.793659 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:32.793553    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:28:32.840756 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:32.840717    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7695c54b44-srkvs"]
Jul 13 15:28:32.841041 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:32.841028    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d90766b-99c5-4d7e-966a-1b413eabd11b" containerName="registry"
Jul 13 15:28:32.841084 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:32.841044    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d90766b-99c5-4d7e-966a-1b413eabd11b" containerName="registry"
Jul 13 15:28:32.841118 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:32.841102    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d90766b-99c5-4d7e-966a-1b413eabd11b" containerName="registry"
Jul 13 15:28:32.844091 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:32.844071    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-srkvs"
Jul 13 15:28:32.847373 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:32.847352    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rbd9j\""
Jul 13 15:28:32.847483 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:32.847446    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 13 15:28:32.847736 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:32.847720    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 13 15:28:32.847789 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:32.847776    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 13 15:28:32.848184 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:32.848167    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 13 15:28:32.866344 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:32.866316    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7695c54b44-srkvs"]
Jul 13 15:28:32.944352 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:32.944314    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsbrx\" (UniqueName: \"kubernetes.io/projected/97eb5169-eb65-430e-a099-bb4de7e8b38f-kube-api-access-xsbrx\") pod \"opendatahub-operator-controller-manager-7695c54b44-srkvs\" (UID: \"97eb5169-eb65-430e-a099-bb4de7e8b38f\") " pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-srkvs"
Jul 13 15:28:32.944775 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:32.944374    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/97eb5169-eb65-430e-a099-bb4de7e8b38f-manifests\") pod \"opendatahub-operator-controller-manager-7695c54b44-srkvs\" (UID: \"97eb5169-eb65-430e-a099-bb4de7e8b38f\") " pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-srkvs"
Jul 13 15:28:32.944775 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:32.944403    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/97eb5169-eb65-430e-a099-bb4de7e8b38f-webhook-cert\") pod \"opendatahub-operator-controller-manager-7695c54b44-srkvs\" (UID: \"97eb5169-eb65-430e-a099-bb4de7e8b38f\") " pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-srkvs"
Jul 13 15:28:32.944775 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:32.944437    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/97eb5169-eb65-430e-a099-bb4de7e8b38f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7695c54b44-srkvs\" (UID: \"97eb5169-eb65-430e-a099-bb4de7e8b38f\") " pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-srkvs"
Jul 13 15:28:32.944775 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:32.944484    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97eb5169-eb65-430e-a099-bb4de7e8b38f-tmp\") pod \"opendatahub-operator-controller-manager-7695c54b44-srkvs\" (UID: \"97eb5169-eb65-430e-a099-bb4de7e8b38f\") " pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-srkvs"
Jul 13 15:28:32.972984 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:32.972951    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:28:33.045055 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:33.044949    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/97eb5169-eb65-430e-a099-bb4de7e8b38f-manifests\") pod \"opendatahub-operator-controller-manager-7695c54b44-srkvs\" (UID: \"97eb5169-eb65-430e-a099-bb4de7e8b38f\") " pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-srkvs"
Jul 13 15:28:33.045055 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:33.045004    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/97eb5169-eb65-430e-a099-bb4de7e8b38f-webhook-cert\") pod \"opendatahub-operator-controller-manager-7695c54b44-srkvs\" (UID: \"97eb5169-eb65-430e-a099-bb4de7e8b38f\") " pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-srkvs"
Jul 13 15:28:33.045055 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:33.045040    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/97eb5169-eb65-430e-a099-bb4de7e8b38f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7695c54b44-srkvs\" (UID: \"97eb5169-eb65-430e-a099-bb4de7e8b38f\") " pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-srkvs"
Jul 13 15:28:33.045270 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:33.045077    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97eb5169-eb65-430e-a099-bb4de7e8b38f-tmp\") pod \"opendatahub-operator-controller-manager-7695c54b44-srkvs\" (UID: \"97eb5169-eb65-430e-a099-bb4de7e8b38f\") " pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-srkvs"
Jul 13 15:28:33.045270 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:33.045143    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsbrx\" (UniqueName: \"kubernetes.io/projected/97eb5169-eb65-430e-a099-bb4de7e8b38f-kube-api-access-xsbrx\") pod \"opendatahub-operator-controller-manager-7695c54b44-srkvs\" (UID: \"97eb5169-eb65-430e-a099-bb4de7e8b38f\") " pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-srkvs"
Jul 13 15:28:33.045397 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:33.045375    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/97eb5169-eb65-430e-a099-bb4de7e8b38f-manifests\") pod \"opendatahub-operator-controller-manager-7695c54b44-srkvs\" (UID: \"97eb5169-eb65-430e-a099-bb4de7e8b38f\") " pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-srkvs"
Jul 13 15:28:33.047455 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:33.047432    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97eb5169-eb65-430e-a099-bb4de7e8b38f-tmp\") pod \"opendatahub-operator-controller-manager-7695c54b44-srkvs\" (UID: \"97eb5169-eb65-430e-a099-bb4de7e8b38f\") " pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-srkvs"
Jul 13 15:28:33.047552 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:33.047531    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/97eb5169-eb65-430e-a099-bb4de7e8b38f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7695c54b44-srkvs\" (UID: \"97eb5169-eb65-430e-a099-bb4de7e8b38f\") " pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-srkvs"
Jul 13 15:28:33.047607 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:33.047562    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/97eb5169-eb65-430e-a099-bb4de7e8b38f-webhook-cert\") pod \"opendatahub-operator-controller-manager-7695c54b44-srkvs\" (UID: \"97eb5169-eb65-430e-a099-bb4de7e8b38f\") " pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-srkvs"
Jul 13 15:28:33.057652 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:33.057627    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsbrx\" (UniqueName: \"kubernetes.io/projected/97eb5169-eb65-430e-a099-bb4de7e8b38f-kube-api-access-xsbrx\") pod \"opendatahub-operator-controller-manager-7695c54b44-srkvs\" (UID: \"97eb5169-eb65-430e-a099-bb4de7e8b38f\") " pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-srkvs"
Jul 13 15:28:33.075787 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:33.075758    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:28:33.155063 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:33.155023    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-srkvs"
Jul 13 15:28:33.173228 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:33.173195    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:28:33.296216 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:33.296140    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7695c54b44-srkvs"]
Jul 13 15:28:33.299629 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:28:33.299598    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97eb5169_eb65_430e_a099_bb4de7e8b38f.slice/crio-ed8d7e6e3b0578c7286fbf906a774dcb67f0ca074fca5a4b9ce6089d6788670c WatchSource:0}: Error finding container ed8d7e6e3b0578c7286fbf906a774dcb67f0ca074fca5a4b9ce6089d6788670c: Status 404 returned error can't find the container with id ed8d7e6e3b0578c7286fbf906a774dcb67f0ca074fca5a4b9ce6089d6788670c
Jul 13 15:28:33.422409 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:33.422359    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:28:33.528747 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:33.528716    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:28:33.620172 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:33.620081    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:28:33.661036 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:33.661000    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-srkvs" event={"ID":"97eb5169-eb65-430e-a099-bb4de7e8b38f","Type":"ContainerStarted","Data":"ed8d7e6e3b0578c7286fbf906a774dcb67f0ca074fca5a4b9ce6089d6788670c"}
Jul 13 15:28:33.720307 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:33.720250    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:28:34.105398 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:34.105365    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cptrx_90f53326-a36e-4682-a268-bdfec7cf722b/console-operator/1.log"
Jul 13 15:28:34.107677 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:34.107649    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cptrx_90f53326-a36e-4682-a268-bdfec7cf722b/console-operator/1.log"
Jul 13 15:28:34.115268 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:34.115242    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x8g52_f4724159-d88b-4ed1-a5fc-956a4d1e3fe8/ovn-acl-logging/0.log"
Jul 13 15:28:34.117498 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:34.117472    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x8g52_f4724159-d88b-4ed1-a5fc-956a4d1e3fe8/ovn-acl-logging/0.log"
Jul 13 15:28:34.119038 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:34.119022    2555 kubelet.go:1648] "Image garbage collection succeeded"
Jul 13 15:28:37.013770 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:37.013720    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:28:37.687293 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:37.687254    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-srkvs" event={"ID":"97eb5169-eb65-430e-a099-bb4de7e8b38f","Type":"ContainerStarted","Data":"15e5f0b074a017dbc91f8ccb8997ead37383c3651f7ac56ba0e6101dad7d9eb6"}
Jul 13 15:28:38.207038 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:38.207004    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:28:38.692768 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:38.692736    2555 generic.go:356] "Generic (PLEG): container finished" podID="97eb5169-eb65-430e-a099-bb4de7e8b38f" containerID="15e5f0b074a017dbc91f8ccb8997ead37383c3651f7ac56ba0e6101dad7d9eb6" exitCode=0
Jul 13 15:28:38.692952 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:38.692807    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-srkvs" event={"ID":"97eb5169-eb65-430e-a099-bb4de7e8b38f","Type":"ContainerDied","Data":"15e5f0b074a017dbc91f8ccb8997ead37383c3651f7ac56ba0e6101dad7d9eb6"}
Jul 13 15:28:38.693305 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:38.693285    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 15:28:39.698697 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:39.698660    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-srkvs" event={"ID":"97eb5169-eb65-430e-a099-bb4de7e8b38f","Type":"ContainerStarted","Data":"f08c60a188689dfb5e321cc4c0fe7fd630e5d102115b0deeed866bb74d0e1491"}
Jul 13 15:28:39.699176 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:39.698768    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-srkvs"
Jul 13 15:28:39.723943 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:39.723871    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-srkvs" podStartSLOduration=2.217788143 podStartE2EDuration="7.723854554s" totalImagesPullingTime="4.471198276s" totalInitContainerRuntime="1.034868135s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:28:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:28:39.721822274 +0000 UTC m=+306.046544200" watchObservedRunningTime="2026-07-13 15:28:39.723854554 +0000 UTC m=+306.048576452"
Jul 13 15:28:44.411526 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:44.411493    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:28:44.530897 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:44.530864    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:28:49.327936 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:49.327899    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:28:49.426601 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:49.426545    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:28:50.705200 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:50.705169    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7695c54b44-srkvs"
Jul 13 15:28:52.891697 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:52.891666    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:28:53.026480 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:53.026440    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:28:53.375595 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:53.375555    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:28:53.661203 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:53.661110    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:28:53.771788 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:53.771746    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:28:53.855005 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:53.854976    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:28:53.944830 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:53.944741    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:28:54.466886 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:54.466856    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:28:54.819208 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:54.819169    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:28:54.999196 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:54.999159    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:28:55.073781 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:55.073676    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:28:56.350756 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:28:56.350717    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:29:00.513943 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:00.513904    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:29:00.611536 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:00.611503    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:29:01.051385 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:01.051350    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:29:01.239942 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:01.239889    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:29:01.341872 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:01.341786    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:29:02.171884 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:02.171840    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b567978d6-xj8bl"]
Jul 13 15:29:02.175310 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:02.175284    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7b567978d6-xj8bl"
Jul 13 15:29:02.177980 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:02.177947    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 13 15:29:02.178951 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:02.178921    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 13 15:29:02.179253 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:02.179232    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xl4w8\""
Jul 13 15:29:02.179351 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:02.179331    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 13 15:29:02.179531 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:02.179512    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 13 15:29:02.179602 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:02.179571    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 13 15:29:02.184666 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:02.184641    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b567978d6-xj8bl"]
Jul 13 15:29:02.284716 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:02.284678    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f6adab2a-02ff-4c13-8a56-d4ad4a8804ae-metrics-cert\") pod \"lws-controller-manager-7b567978d6-xj8bl\" (UID: \"f6adab2a-02ff-4c13-8a56-d4ad4a8804ae\") " pod="openshift-lws-operator/lws-controller-manager-7b567978d6-xj8bl"
Jul 13 15:29:02.284885 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:02.284736    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f6adab2a-02ff-4c13-8a56-d4ad4a8804ae-cert\") pod \"lws-controller-manager-7b567978d6-xj8bl\" (UID: \"f6adab2a-02ff-4c13-8a56-d4ad4a8804ae\") " pod="openshift-lws-operator/lws-controller-manager-7b567978d6-xj8bl"
Jul 13 15:29:02.284885 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:02.284754    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f6adab2a-02ff-4c13-8a56-d4ad4a8804ae-manager-config\") pod \"lws-controller-manager-7b567978d6-xj8bl\" (UID: \"f6adab2a-02ff-4c13-8a56-d4ad4a8804ae\") " pod="openshift-lws-operator/lws-controller-manager-7b567978d6-xj8bl"
Jul 13 15:29:02.284885 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:02.284773    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6568\" (UniqueName: \"kubernetes.io/projected/f6adab2a-02ff-4c13-8a56-d4ad4a8804ae-kube-api-access-z6568\") pod \"lws-controller-manager-7b567978d6-xj8bl\" (UID: \"f6adab2a-02ff-4c13-8a56-d4ad4a8804ae\") " pod="openshift-lws-operator/lws-controller-manager-7b567978d6-xj8bl"
Jul 13 15:29:02.385148 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:02.385108    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f6adab2a-02ff-4c13-8a56-d4ad4a8804ae-metrics-cert\") pod \"lws-controller-manager-7b567978d6-xj8bl\" (UID: \"f6adab2a-02ff-4c13-8a56-d4ad4a8804ae\") " pod="openshift-lws-operator/lws-controller-manager-7b567978d6-xj8bl"
Jul 13 15:29:02.385298 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:02.385180    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f6adab2a-02ff-4c13-8a56-d4ad4a8804ae-cert\") pod \"lws-controller-manager-7b567978d6-xj8bl\" (UID: \"f6adab2a-02ff-4c13-8a56-d4ad4a8804ae\") " pod="openshift-lws-operator/lws-controller-manager-7b567978d6-xj8bl"
Jul 13 15:29:02.385298 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:02.385212    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f6adab2a-02ff-4c13-8a56-d4ad4a8804ae-manager-config\") pod \"lws-controller-manager-7b567978d6-xj8bl\" (UID: \"f6adab2a-02ff-4c13-8a56-d4ad4a8804ae\") " pod="openshift-lws-operator/lws-controller-manager-7b567978d6-xj8bl"
Jul 13 15:29:02.385298 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:02.385240    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6568\" (UniqueName: \"kubernetes.io/projected/f6adab2a-02ff-4c13-8a56-d4ad4a8804ae-kube-api-access-z6568\") pod \"lws-controller-manager-7b567978d6-xj8bl\" (UID: \"f6adab2a-02ff-4c13-8a56-d4ad4a8804ae\") " pod="openshift-lws-operator/lws-controller-manager-7b567978d6-xj8bl"
Jul 13 15:29:02.385994 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:02.385968    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f6adab2a-02ff-4c13-8a56-d4ad4a8804ae-manager-config\") pod \"lws-controller-manager-7b567978d6-xj8bl\" (UID: \"f6adab2a-02ff-4c13-8a56-d4ad4a8804ae\") " pod="openshift-lws-operator/lws-controller-manager-7b567978d6-xj8bl"
Jul 13 15:29:02.387708 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:02.387687    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f6adab2a-02ff-4c13-8a56-d4ad4a8804ae-metrics-cert\") pod \"lws-controller-manager-7b567978d6-xj8bl\" (UID: \"f6adab2a-02ff-4c13-8a56-d4ad4a8804ae\") " pod="openshift-lws-operator/lws-controller-manager-7b567978d6-xj8bl"
Jul 13 15:29:02.387794 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:02.387760    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f6adab2a-02ff-4c13-8a56-d4ad4a8804ae-cert\") pod \"lws-controller-manager-7b567978d6-xj8bl\" (UID: \"f6adab2a-02ff-4c13-8a56-d4ad4a8804ae\") " pod="openshift-lws-operator/lws-controller-manager-7b567978d6-xj8bl"
Jul 13 15:29:02.394328 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:02.394304    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6568\" (UniqueName: \"kubernetes.io/projected/f6adab2a-02ff-4c13-8a56-d4ad4a8804ae-kube-api-access-z6568\") pod \"lws-controller-manager-7b567978d6-xj8bl\" (UID: \"f6adab2a-02ff-4c13-8a56-d4ad4a8804ae\") " pod="openshift-lws-operator/lws-controller-manager-7b567978d6-xj8bl"
Jul 13 15:29:02.491109 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:02.491082    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7b567978d6-xj8bl"
Jul 13 15:29:02.646123 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:02.646090    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b567978d6-xj8bl"]
Jul 13 15:29:02.649388 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:29:02.649360    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6adab2a_02ff_4c13_8a56_d4ad4a8804ae.slice/crio-f07242ec4bec881bf231a7e0b0d388a6a47b8e667dcb0ff66d8286895318c7ba WatchSource:0}: Error finding container f07242ec4bec881bf231a7e0b0d388a6a47b8e667dcb0ff66d8286895318c7ba: Status 404 returned error can't find the container with id f07242ec4bec881bf231a7e0b0d388a6a47b8e667dcb0ff66d8286895318c7ba
Jul 13 15:29:02.799201 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:02.799121    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7b567978d6-xj8bl" event={"ID":"f6adab2a-02ff-4c13-8a56-d4ad4a8804ae","Type":"ContainerStarted","Data":"f07242ec4bec881bf231a7e0b0d388a6a47b8e667dcb0ff66d8286895318c7ba"}
Jul 13 15:29:05.134198 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:05.134162    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:29:05.276827 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:05.276787    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:29:05.323779 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:05.323740    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-b67r8"]
Jul 13 15:29:05.328737 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:05.328714    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b67r8"
Jul 13 15:29:05.334646 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:05.334624    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 13 15:29:05.336318 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:05.336301    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-9k4gw\""
Jul 13 15:29:05.361927 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:05.361900    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-b67r8"]
Jul 13 15:29:05.414479 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:05.414381    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e8500e3-6979-44e6-ae9b-522f31726ab6-cert\") pod \"kserve-controller-manager-d6f4b65b8-b67r8\" (UID: \"5e8500e3-6979-44e6-ae9b-522f31726ab6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b67r8"
Jul 13 15:29:05.414479 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:05.414438    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdcqd\" (UniqueName: \"kubernetes.io/projected/5e8500e3-6979-44e6-ae9b-522f31726ab6-kube-api-access-hdcqd\") pod \"kserve-controller-manager-d6f4b65b8-b67r8\" (UID: \"5e8500e3-6979-44e6-ae9b-522f31726ab6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b67r8"
Jul 13 15:29:05.451927 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:05.451894    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:29:05.515357 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:05.515319    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e8500e3-6979-44e6-ae9b-522f31726ab6-cert\") pod \"kserve-controller-manager-d6f4b65b8-b67r8\" (UID: \"5e8500e3-6979-44e6-ae9b-522f31726ab6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b67r8"
Jul 13 15:29:05.515557 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:05.515373    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdcqd\" (UniqueName: \"kubernetes.io/projected/5e8500e3-6979-44e6-ae9b-522f31726ab6-kube-api-access-hdcqd\") pod \"kserve-controller-manager-d6f4b65b8-b67r8\" (UID: \"5e8500e3-6979-44e6-ae9b-522f31726ab6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b67r8"
Jul 13 15:29:05.517691 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:05.517668    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e8500e3-6979-44e6-ae9b-522f31726ab6-cert\") pod \"kserve-controller-manager-d6f4b65b8-b67r8\" (UID: \"5e8500e3-6979-44e6-ae9b-522f31726ab6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b67r8"
Jul 13 15:29:05.526630 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:05.526609    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdcqd\" (UniqueName: \"kubernetes.io/projected/5e8500e3-6979-44e6-ae9b-522f31726ab6-kube-api-access-hdcqd\") pod \"kserve-controller-manager-d6f4b65b8-b67r8\" (UID: \"5e8500e3-6979-44e6-ae9b-522f31726ab6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b67r8"
Jul 13 15:29:05.640964 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:05.640923    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b67r8"
Jul 13 15:29:05.819672 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:29:05.819631    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e8500e3_6979_44e6_ae9b_522f31726ab6.slice/crio-87e911a33111bce089bb7ff0a9e737d936c917698dcfe1c5bb55c3dc6755d138 WatchSource:0}: Error finding container 87e911a33111bce089bb7ff0a9e737d936c917698dcfe1c5bb55c3dc6755d138: Status 404 returned error can't find the container with id 87e911a33111bce089bb7ff0a9e737d936c917698dcfe1c5bb55c3dc6755d138
Jul 13 15:29:05.819788 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:05.819677    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-b67r8"]
Jul 13 15:29:06.677214 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:06.677178    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:29:06.775496 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:06.775451    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:29:06.816754 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:06.816725    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b67r8" event={"ID":"5e8500e3-6979-44e6-ae9b-522f31726ab6","Type":"ContainerStarted","Data":"87e911a33111bce089bb7ff0a9e737d936c917698dcfe1c5bb55c3dc6755d138"}
Jul 13 15:29:09.833329 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:09.833238    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b67r8" event={"ID":"5e8500e3-6979-44e6-ae9b-522f31726ab6","Type":"ContainerStarted","Data":"32f2e6141cbfbe48b28df405353c68a54e677f703ee3ddb3c76bf5dcb25ac814"}
Jul 13 15:29:09.833329 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:09.833313    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b67r8"
Jul 13 15:29:09.898324 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:09.898251    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b67r8" podStartSLOduration=1.177026089 podStartE2EDuration="4.898234949s" totalImagesPullingTime="3.72120886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:29:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:29:09.898179483 +0000 UTC m=+336.222901378" watchObservedRunningTime="2026-07-13 15:29:09.898234949 +0000 UTC m=+336.222956845"
Jul 13 15:29:15.861982 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:15.861942    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7b567978d6-xj8bl" event={"ID":"f6adab2a-02ff-4c13-8a56-d4ad4a8804ae","Type":"ContainerStarted","Data":"2d4652cdd201d7d3b1406e81eb8407e2cae437daf11586e57bea54bc4979e3cb"}
Jul 13 15:29:15.862371 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:15.862059    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7b567978d6-xj8bl"
Jul 13 15:29:15.885773 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:15.885724    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7b567978d6-xj8bl" podStartSLOduration=1.2717378080000001 podStartE2EDuration="13.885707944s" totalImagesPullingTime="12.613970136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:29:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:29:15.882999845 +0000 UTC m=+342.207721745" watchObservedRunningTime="2026-07-13 15:29:15.885707944 +0000 UTC m=+342.210429930"
Jul 13 15:29:22.205222 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:22.205187    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:29:26.871734 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:26.871644    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7b567978d6-xj8bl"
Jul 13 15:29:40.843012 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:40.842974    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b67r8"
Jul 13 15:29:54.532287 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:54.532248    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:29:54.625028 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:54.624989    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:29:54.745917 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:54.745884    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2kjbc"]
Jul 13 15:29:54.754921 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:54.754895    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2kjbc"
Jul 13 15:29:54.757946 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:54.757921    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 13 15:29:54.758598 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:54.758561    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-m5k7g\""
Jul 13 15:29:54.758738 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:54.758712    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 13 15:29:54.771940 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:54.771909    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2kjbc"]
Jul 13 15:29:54.799918 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:54.799829    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbhjr\" (UniqueName: \"kubernetes.io/projected/2b972ced-33ed-477e-9295-5dcdd66b8ab1-kube-api-access-zbhjr\") pod \"kuadrant-operator-catalog-2kjbc\" (UID: \"2b972ced-33ed-477e-9295-5dcdd66b8ab1\") " pod="kuadrant-system/kuadrant-operator-catalog-2kjbc"
Jul 13 15:29:54.835048 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:54.835015    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:29:54.900202 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:54.900167    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbhjr\" (UniqueName: \"kubernetes.io/projected/2b972ced-33ed-477e-9295-5dcdd66b8ab1-kube-api-access-zbhjr\") pod \"kuadrant-operator-catalog-2kjbc\" (UID: \"2b972ced-33ed-477e-9295-5dcdd66b8ab1\") " pod="kuadrant-system/kuadrant-operator-catalog-2kjbc"
Jul 13 15:29:54.922964 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:54.922926    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbhjr\" (UniqueName: \"kubernetes.io/projected/2b972ced-33ed-477e-9295-5dcdd66b8ab1-kube-api-access-zbhjr\") pod \"kuadrant-operator-catalog-2kjbc\" (UID: \"2b972ced-33ed-477e-9295-5dcdd66b8ab1\") " pod="kuadrant-system/kuadrant-operator-catalog-2kjbc"
Jul 13 15:29:55.064648 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:55.064540    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2kjbc"
Jul 13 15:29:55.069351 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:55.069326    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2kjbc"]
Jul 13 15:29:55.210851 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:55.210823    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2kjbc"]
Jul 13 15:29:55.212327 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:29:55.212297    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b972ced_33ed_477e_9295_5dcdd66b8ab1.slice/crio-c7cc94a53aaf707b03bd27e49c65ed7cb950643b1ecb31c3f13a3ce517f9338d WatchSource:0}: Error finding container c7cc94a53aaf707b03bd27e49c65ed7cb950643b1ecb31c3f13a3ce517f9338d: Status 404 returned error can't find the container with id c7cc94a53aaf707b03bd27e49c65ed7cb950643b1ecb31c3f13a3ce517f9338d
Jul 13 15:29:56.037215 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:56.037180    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2kjbc" event={"ID":"2b972ced-33ed-477e-9295-5dcdd66b8ab1","Type":"ContainerStarted","Data":"c7cc94a53aaf707b03bd27e49c65ed7cb950643b1ecb31c3f13a3ce517f9338d"}
Jul 13 15:29:58.047664 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:58.047625    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2kjbc" event={"ID":"2b972ced-33ed-477e-9295-5dcdd66b8ab1","Type":"ContainerStarted","Data":"48f8da08f3a0f7ba74b2877cf1d1b8a3bfe7b0d3b8ae7573ca8b131420481e91"}
Jul 13 15:29:58.048081 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:58.047689    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-2kjbc" podUID="2b972ced-33ed-477e-9295-5dcdd66b8ab1" containerName="registry-server" containerID="cri-o://48f8da08f3a0f7ba74b2877cf1d1b8a3bfe7b0d3b8ae7573ca8b131420481e91" gracePeriod=2
Jul 13 15:29:58.075201 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:58.075146    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-2kjbc" podStartSLOduration=1.9124941199999999 podStartE2EDuration="4.075130528s" totalImagesPullingTime="2.162636408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:29:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:29:58.07399814 +0000 UTC m=+384.398720036" watchObservedRunningTime="2026-07-13 15:29:58.075130528 +0000 UTC m=+384.399852424"
Jul 13 15:29:58.297798 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:58.297729    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2kjbc"
Jul 13 15:29:58.324436 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:58.324393    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zbhjr\" (UniqueName: \"kubernetes.io/projected/2b972ced-33ed-477e-9295-5dcdd66b8ab1-kube-api-access-zbhjr\") pod \"2b972ced-33ed-477e-9295-5dcdd66b8ab1\" (UID: \"2b972ced-33ed-477e-9295-5dcdd66b8ab1\") "
Jul 13 15:29:58.326646 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:58.326612    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b972ced-33ed-477e-9295-5dcdd66b8ab1-kube-api-access-zbhjr" (OuterVolumeSpecName: "kube-api-access-zbhjr") pod "2b972ced-33ed-477e-9295-5dcdd66b8ab1" (UID: "2b972ced-33ed-477e-9295-5dcdd66b8ab1"). InnerVolumeSpecName "kube-api-access-zbhjr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:29:58.425015 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:58.424976    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zbhjr\" (UniqueName: \"kubernetes.io/projected/2b972ced-33ed-477e-9295-5dcdd66b8ab1-kube-api-access-zbhjr\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:29:59.052904 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:59.052868    2555 generic.go:356] "Generic (PLEG): container finished" podID="2b972ced-33ed-477e-9295-5dcdd66b8ab1" containerID="48f8da08f3a0f7ba74b2877cf1d1b8a3bfe7b0d3b8ae7573ca8b131420481e91" exitCode=0
Jul 13 15:29:59.053282 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:59.052914    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2kjbc"
Jul 13 15:29:59.053282 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:59.052953    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2kjbc" event={"ID":"2b972ced-33ed-477e-9295-5dcdd66b8ab1","Type":"ContainerDied","Data":"48f8da08f3a0f7ba74b2877cf1d1b8a3bfe7b0d3b8ae7573ca8b131420481e91"}
Jul 13 15:29:59.053282 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:59.053006    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2kjbc" event={"ID":"2b972ced-33ed-477e-9295-5dcdd66b8ab1","Type":"ContainerDied","Data":"c7cc94a53aaf707b03bd27e49c65ed7cb950643b1ecb31c3f13a3ce517f9338d"}
Jul 13 15:29:59.053282 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:59.053031    2555 scope.go:117] "RemoveContainer" containerID="48f8da08f3a0f7ba74b2877cf1d1b8a3bfe7b0d3b8ae7573ca8b131420481e91"
Jul 13 15:29:59.062320 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:59.062303    2555 scope.go:117] "RemoveContainer" containerID="48f8da08f3a0f7ba74b2877cf1d1b8a3bfe7b0d3b8ae7573ca8b131420481e91"
Jul 13 15:29:59.062550 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:29:59.062532    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48f8da08f3a0f7ba74b2877cf1d1b8a3bfe7b0d3b8ae7573ca8b131420481e91\": container with ID starting with 48f8da08f3a0f7ba74b2877cf1d1b8a3bfe7b0d3b8ae7573ca8b131420481e91 not found: ID does not exist" containerID="48f8da08f3a0f7ba74b2877cf1d1b8a3bfe7b0d3b8ae7573ca8b131420481e91"
Jul 13 15:29:59.062634 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:59.062563    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48f8da08f3a0f7ba74b2877cf1d1b8a3bfe7b0d3b8ae7573ca8b131420481e91"} err="failed to get container status \"48f8da08f3a0f7ba74b2877cf1d1b8a3bfe7b0d3b8ae7573ca8b131420481e91\": rpc error: code = NotFound desc = could not find container \"48f8da08f3a0f7ba74b2877cf1d1b8a3bfe7b0d3b8ae7573ca8b131420481e91\": container with ID starting with 48f8da08f3a0f7ba74b2877cf1d1b8a3bfe7b0d3b8ae7573ca8b131420481e91 not found: ID does not exist"
Jul 13 15:29:59.076729 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:59.076704    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2kjbc"]
Jul 13 15:29:59.079934 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:29:59.079916    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2kjbc"]
Jul 13 15:30:00.202611 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:00.202567    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b972ced-33ed-477e-9295-5dcdd66b8ab1" path="/var/lib/kubelet/pods/2b972ced-33ed-477e-9295-5dcdd66b8ab1/volumes"
Jul 13 15:30:23.485419 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:23.485383    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:30:27.099995 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:27.099958    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:30:27.208735 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:27.208701    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:30:28.646429 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:28.646368    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:30:31.205353 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:31.205315    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbjfq"]
Jul 13 15:30:31.205724 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:31.205632    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b972ced-33ed-477e-9295-5dcdd66b8ab1" containerName="registry-server"
Jul 13 15:30:31.205724 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:31.205644    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b972ced-33ed-477e-9295-5dcdd66b8ab1" containerName="registry-server"
Jul 13 15:30:31.205724 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:31.205713    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b972ced-33ed-477e-9295-5dcdd66b8ab1" containerName="registry-server"
Jul 13 15:30:31.213308 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:31.213289    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbjfq"
Jul 13 15:30:31.216872 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:31.216852    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 13 15:30:31.216997 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:31.216985    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-q98wm\""
Jul 13 15:30:31.217322 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:31.217303    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 13 15:30:31.225044 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:31.225020    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbjfq"]
Jul 13 15:30:31.291281 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:31.291239    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae78482c-a3be-4dff-862f-184c1fae056f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pbjfq\" (UID: \"ae78482c-a3be-4dff-862f-184c1fae056f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbjfq"
Jul 13 15:30:31.291458 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:31.291327    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnrnr\" (UniqueName: \"kubernetes.io/projected/ae78482c-a3be-4dff-862f-184c1fae056f-kube-api-access-tnrnr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pbjfq\" (UID: \"ae78482c-a3be-4dff-862f-184c1fae056f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbjfq"
Jul 13 15:30:31.392220 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:31.392180    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnrnr\" (UniqueName: \"kubernetes.io/projected/ae78482c-a3be-4dff-862f-184c1fae056f-kube-api-access-tnrnr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pbjfq\" (UID: \"ae78482c-a3be-4dff-862f-184c1fae056f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbjfq"
Jul 13 15:30:31.392431 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:31.392236    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae78482c-a3be-4dff-862f-184c1fae056f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pbjfq\" (UID: \"ae78482c-a3be-4dff-862f-184c1fae056f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbjfq"
Jul 13 15:30:31.392636 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:31.392614    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae78482c-a3be-4dff-862f-184c1fae056f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pbjfq\" (UID: \"ae78482c-a3be-4dff-862f-184c1fae056f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbjfq"
Jul 13 15:30:31.403687 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:31.403665    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnrnr\" (UniqueName: \"kubernetes.io/projected/ae78482c-a3be-4dff-862f-184c1fae056f-kube-api-access-tnrnr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pbjfq\" (UID: \"ae78482c-a3be-4dff-862f-184c1fae056f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbjfq"
Jul 13 15:30:31.522872 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:31.522834    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbjfq"
Jul 13 15:30:31.655829 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:31.655800    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbjfq"]
Jul 13 15:30:31.658698 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:30:31.658666    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae78482c_a3be_4dff_862f_184c1fae056f.slice/crio-d49a53f1cbb8ec50cf158f1a3790bc4d315341e284c51aacabb238bc4d54936c WatchSource:0}: Error finding container d49a53f1cbb8ec50cf158f1a3790bc4d315341e284c51aacabb238bc4d54936c: Status 404 returned error can't find the container with id d49a53f1cbb8ec50cf158f1a3790bc4d315341e284c51aacabb238bc4d54936c
Jul 13 15:30:31.705273 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:31.705236    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:30:32.079465 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:32.079415    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:30:32.195050 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:32.195004    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbjfq" event={"ID":"ae78482c-a3be-4dff-862f-184c1fae056f","Type":"ContainerStarted","Data":"d49a53f1cbb8ec50cf158f1a3790bc4d315341e284c51aacabb238bc4d54936c"}
Jul 13 15:30:33.535084 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:33.535046    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:30:35.080529 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:35.080492    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:30:35.932218 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:35.932180    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:30:36.031813 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:36.031721    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:30:37.920223 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:37.920176    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:30:39.230752 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:39.230718    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbjfq" event={"ID":"ae78482c-a3be-4dff-862f-184c1fae056f","Type":"ContainerStarted","Data":"0f6b609bfe75701ff2d7d7f109df236c19d83a2daa10ef19f47638591615ae49"}
Jul 13 15:30:39.231217 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:39.230843    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbjfq"
Jul 13 15:30:39.253551 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:39.253500    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbjfq" podStartSLOduration=1.008597489 podStartE2EDuration="8.25348362s" totalImagesPullingTime="7.244886131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:30:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:30:39.252176143 +0000 UTC m=+425.576898040" watchObservedRunningTime="2026-07-13 15:30:39.25348362 +0000 UTC m=+425.578205517"
Jul 13 15:30:39.289204 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:39.289162    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:30:39.389934 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:39.389900    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:30:39.987457 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:39.987410    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:30:40.089657 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:40.089620    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:30:40.191146 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:40.191117    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:30:41.902780 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:41.902742    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:30:42.027999 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:42.027969    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:30:42.685615 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:42.685567    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:30:42.747167 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:42.747132    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:30:50.237368 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:50.237342    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbjfq"
Jul 13 15:30:51.329874 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:51.329838    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:30:51.443915 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:51.443883    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:30:51.541633 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:51.541597    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:30:52.047448 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:52.047415    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbjfq"]
Jul 13 15:30:52.047660 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:52.047635    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbjfq" podUID="ae78482c-a3be-4dff-862f-184c1fae056f" containerName="manager" containerID="cri-o://0f6b609bfe75701ff2d7d7f109df236c19d83a2daa10ef19f47638591615ae49" gracePeriod=2
Jul 13 15:30:52.049782 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:52.049760    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rjjd4"]
Jul 13 15:30:52.053180 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:52.053160    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rjjd4"
Jul 13 15:30:52.058341 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:52.058320    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbjfq"]
Jul 13 15:30:52.062206 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:30:52.062166    2555 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"ae78482c-a3be-4dff-862f-184c1fae056f\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-pbjfq\": pods \"kuadrant-operator-controller-manager-8684c9ff49-pbjfq\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbjfq"
Jul 13 15:30:52.064027 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:52.063996    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rjjd4"]
Jul 13 15:30:52.074082 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:52.074061    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wscc"]
Jul 13 15:30:52.074359 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:52.074348    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae78482c-a3be-4dff-862f-184c1fae056f" containerName="manager"
Jul 13 15:30:52.074399 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:52.074361    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae78482c-a3be-4dff-862f-184c1fae056f" containerName="manager"
Jul 13 15:30:52.074432 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:52.074415    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae78482c-a3be-4dff-862f-184c1fae056f" containerName="manager"
Jul 13 15:30:52.077376 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:52.077354    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wscc"
Jul 13 15:30:52.091396 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:30:52.091360    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pbjfq\" is forbidden: User \"system:node:ip-10-0-137-93.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-93.ec2.internal' and this object" podUID="ae78482c-a3be-4dff-862f-184c1fae056f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbjfq"
Jul 13 15:30:52.093018 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:30:52.092993    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pbjfq\" is forbidden: User \"system:node:ip-10-0-137-93.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-93.ec2.internal' and this object" podUID="ae78482c-a3be-4dff-862f-184c1fae056f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbjfq"
Jul 13 15:30:52.094932 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:52.094911    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wscc"]
Jul 13 15:30:52.169508 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:52.169479    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/03ce4607-02b0-489d-9318-f35f98c2374b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rjjd4\" (UID: \"03ce4607-02b0-489d-9318-f35f98c2374b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rjjd4"
Jul 13 15:30:52.169650 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:52.169632    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pphzb\" (UniqueName: \"kubernetes.io/projected/03ce4607-02b0-489d-9318-f35f98c2374b-kube-api-access-pphzb\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rjjd4\" (UID: \"03ce4607-02b0-489d-9318-f35f98c2374b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rjjd4"
Jul 13 15:30:52.270611 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:52.270568    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9913c26c-4377-469d-b8a7-5d537b4b1e4e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4wscc\" (UID: \"9913c26c-4377-469d-b8a7-5d537b4b1e4e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wscc"
Jul 13 15:30:52.270738 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:52.270634    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pphzb\" (UniqueName: \"kubernetes.io/projected/03ce4607-02b0-489d-9318-f35f98c2374b-kube-api-access-pphzb\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rjjd4\" (UID: \"03ce4607-02b0-489d-9318-f35f98c2374b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rjjd4"
Jul 13 15:30:52.270738 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:52.270717    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzd87\" (UniqueName: \"kubernetes.io/projected/9913c26c-4377-469d-b8a7-5d537b4b1e4e-kube-api-access-kzd87\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4wscc\" (UID: \"9913c26c-4377-469d-b8a7-5d537b4b1e4e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wscc"
Jul 13 15:30:52.270848 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:52.270739    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/03ce4607-02b0-489d-9318-f35f98c2374b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rjjd4\" (UID: \"03ce4607-02b0-489d-9318-f35f98c2374b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rjjd4"
Jul 13 15:30:52.271022 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:52.271005    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/03ce4607-02b0-489d-9318-f35f98c2374b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rjjd4\" (UID: \"03ce4607-02b0-489d-9318-f35f98c2374b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rjjd4"
Jul 13 15:30:52.279060 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:52.279038    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pphzb\" (UniqueName: \"kubernetes.io/projected/03ce4607-02b0-489d-9318-f35f98c2374b-kube-api-access-pphzb\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rjjd4\" (UID: \"03ce4607-02b0-489d-9318-f35f98c2374b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rjjd4"
Jul 13 15:30:52.286830 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:52.286808    2555 generic.go:356] "Generic (PLEG): container finished" podID="ae78482c-a3be-4dff-862f-184c1fae056f" containerID="0f6b609bfe75701ff2d7d7f109df236c19d83a2daa10ef19f47638591615ae49" exitCode=0
Jul 13 15:30:52.286929 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:52.286872    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d49a53f1cbb8ec50cf158f1a3790bc4d315341e284c51aacabb238bc4d54936c"
Jul 13 15:30:52.293642 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:52.293624    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbjfq"
Jul 13 15:30:52.371255 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:52.371206    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzd87\" (UniqueName: \"kubernetes.io/projected/9913c26c-4377-469d-b8a7-5d537b4b1e4e-kube-api-access-kzd87\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4wscc\" (UID: \"9913c26c-4377-469d-b8a7-5d537b4b1e4e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wscc"
Jul 13 15:30:52.371513 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:52.371280    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9913c26c-4377-469d-b8a7-5d537b4b1e4e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4wscc\" (UID: \"9913c26c-4377-469d-b8a7-5d537b4b1e4e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wscc"
Jul 13 15:30:52.371556 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:52.371531    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9913c26c-4377-469d-b8a7-5d537b4b1e4e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4wscc\" (UID: \"9913c26c-4377-469d-b8a7-5d537b4b1e4e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wscc"
Jul 13 15:30:52.382002 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:52.381984    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzd87\" (UniqueName: \"kubernetes.io/projected/9913c26c-4377-469d-b8a7-5d537b4b1e4e-kube-api-access-kzd87\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4wscc\" (UID: \"9913c26c-4377-469d-b8a7-5d537b4b1e4e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wscc"
Jul 13 15:30:52.412978 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:52.412956    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rjjd4"
Jul 13 15:30:52.419839 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:52.419822    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wscc"
Jul 13 15:30:52.471812 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:52.471761    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnrnr\" (UniqueName: \"kubernetes.io/projected/ae78482c-a3be-4dff-862f-184c1fae056f-kube-api-access-tnrnr\") pod \"ae78482c-a3be-4dff-862f-184c1fae056f\" (UID: \"ae78482c-a3be-4dff-862f-184c1fae056f\") "
Jul 13 15:30:52.471940 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:52.471847    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae78482c-a3be-4dff-862f-184c1fae056f-extensions-socket-volume\") pod \"ae78482c-a3be-4dff-862f-184c1fae056f\" (UID: \"ae78482c-a3be-4dff-862f-184c1fae056f\") "
Jul 13 15:30:52.472953 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:52.472917    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae78482c-a3be-4dff-862f-184c1fae056f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ae78482c-a3be-4dff-862f-184c1fae056f" (UID: "ae78482c-a3be-4dff-862f-184c1fae056f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:30:52.476630 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:52.476282    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae78482c-a3be-4dff-862f-184c1fae056f-kube-api-access-tnrnr" (OuterVolumeSpecName: "kube-api-access-tnrnr") pod "ae78482c-a3be-4dff-862f-184c1fae056f" (UID: "ae78482c-a3be-4dff-862f-184c1fae056f"). InnerVolumeSpecName "kube-api-access-tnrnr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:30:52.572676 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:52.572639    2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae78482c-a3be-4dff-862f-184c1fae056f-extensions-socket-volume\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:30:52.572676 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:52.572677    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnrnr\" (UniqueName: \"kubernetes.io/projected/ae78482c-a3be-4dff-862f-184c1fae056f-kube-api-access-tnrnr\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:30:52.578781 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:52.578758    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wscc"]
Jul 13 15:30:52.580771 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:30:52.580746    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9913c26c_4377_469d_b8a7_5d537b4b1e4e.slice/crio-1ad704de2c23281c874825d109eace93fa4a9df641ef335ae93fd1436a2a1483 WatchSource:0}: Error finding container 1ad704de2c23281c874825d109eace93fa4a9df641ef335ae93fd1436a2a1483: Status 404 returned error can't find the container with id 1ad704de2c23281c874825d109eace93fa4a9df641ef335ae93fd1436a2a1483
Jul 13 15:30:52.605825 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:30:52.605802    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03ce4607_02b0_489d_9318_f35f98c2374b.slice/crio-93a284e80dac9ba24070b16e8ee8e747e65b25d874518a4b00f43fe73f724809 WatchSource:0}: Error finding container 93a284e80dac9ba24070b16e8ee8e747e65b25d874518a4b00f43fe73f724809: Status 404 returned error can't find the container with id 93a284e80dac9ba24070b16e8ee8e747e65b25d874518a4b00f43fe73f724809
Jul 13 15:30:52.608473 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:52.608455    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rjjd4"]
Jul 13 15:30:53.293680 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:53.293639    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wscc" event={"ID":"9913c26c-4377-469d-b8a7-5d537b4b1e4e","Type":"ContainerStarted","Data":"1b82e4fca3a52447b9b6bfd2faab19c3292fa03da573b2e8681ebbe535be9a3c"}
Jul 13 15:30:53.293857 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:53.293706    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wscc" event={"ID":"9913c26c-4377-469d-b8a7-5d537b4b1e4e","Type":"ContainerStarted","Data":"1ad704de2c23281c874825d109eace93fa4a9df641ef335ae93fd1436a2a1483"}
Jul 13 15:30:53.293857 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:53.293774    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wscc"
Jul 13 15:30:53.295182 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:53.295157    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rjjd4" event={"ID":"03ce4607-02b0-489d-9318-f35f98c2374b","Type":"ContainerStarted","Data":"65f2a43ff96293f85c08ae284fc4e5edd9bf5c916421f7a94fdfcfc268b4cd83"}
Jul 13 15:30:53.295182 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:53.295172    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pbjfq"
Jul 13 15:30:53.295306 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:53.295206    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rjjd4" event={"ID":"03ce4607-02b0-489d-9318-f35f98c2374b","Type":"ContainerStarted","Data":"93a284e80dac9ba24070b16e8ee8e747e65b25d874518a4b00f43fe73f724809"}
Jul 13 15:30:53.316652 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:53.316611    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wscc" podStartSLOduration=1.316597869 podStartE2EDuration="1.316597869s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:30:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:30:53.314774338 +0000 UTC m=+439.639496229" watchObservedRunningTime="2026-07-13 15:30:53.316597869 +0000 UTC m=+439.641319757"
Jul 13 15:30:53.335254 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:53.335157    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rjjd4" podStartSLOduration=1.3351432349999999 podStartE2EDuration="1.335143235s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:30:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:30:53.333457707 +0000 UTC m=+439.658179597" watchObservedRunningTime="2026-07-13 15:30:53.335143235 +0000 UTC m=+439.659865131"
Jul 13 15:30:53.775395 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:53.775352    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:30:54.113785 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:54.113706    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:30:54.203673 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:54.203645    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae78482c-a3be-4dff-862f-184c1fae056f" path="/var/lib/kubelet/pods/ae78482c-a3be-4dff-862f-184c1fae056f/volumes"
Jul 13 15:30:54.299228 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:54.299191    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rjjd4"
Jul 13 15:30:54.456764 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:54.456683    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:30:54.541553 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:30:54.541516    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:31:01.484200 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:01.484099    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:31:01.590044 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:01.590004    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:31:04.302038 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:04.302010    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wscc"
Jul 13 15:31:04.894340 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:04.894305    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:31:04.994940 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:04.994899    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:31:05.304914 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:05.304891    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rjjd4"
Jul 13 15:31:05.385892 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:05.385857    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wscc"]
Jul 13 15:31:05.386071 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:05.386029    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wscc" podUID="9913c26c-4377-469d-b8a7-5d537b4b1e4e" containerName="manager" containerID="cri-o://1b82e4fca3a52447b9b6bfd2faab19c3292fa03da573b2e8681ebbe535be9a3c" gracePeriod=10
Jul 13 15:31:05.638245 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:05.638212    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wscc"
Jul 13 15:31:05.680989 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:05.680956    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kzd87\" (UniqueName: \"kubernetes.io/projected/9913c26c-4377-469d-b8a7-5d537b4b1e4e-kube-api-access-kzd87\") pod \"9913c26c-4377-469d-b8a7-5d537b4b1e4e\" (UID: \"9913c26c-4377-469d-b8a7-5d537b4b1e4e\") "
Jul 13 15:31:05.681164 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:05.681090    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9913c26c-4377-469d-b8a7-5d537b4b1e4e-extensions-socket-volume\") pod \"9913c26c-4377-469d-b8a7-5d537b4b1e4e\" (UID: \"9913c26c-4377-469d-b8a7-5d537b4b1e4e\") "
Jul 13 15:31:05.681451 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:05.681416    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9913c26c-4377-469d-b8a7-5d537b4b1e4e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9913c26c-4377-469d-b8a7-5d537b4b1e4e" (UID: "9913c26c-4377-469d-b8a7-5d537b4b1e4e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:31:05.683136 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:05.683116    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9913c26c-4377-469d-b8a7-5d537b4b1e4e-kube-api-access-kzd87" (OuterVolumeSpecName: "kube-api-access-kzd87") pod "9913c26c-4377-469d-b8a7-5d537b4b1e4e" (UID: "9913c26c-4377-469d-b8a7-5d537b4b1e4e"). InnerVolumeSpecName "kube-api-access-kzd87". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:31:05.782506 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:05.782476    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzd87\" (UniqueName: \"kubernetes.io/projected/9913c26c-4377-469d-b8a7-5d537b4b1e4e-kube-api-access-kzd87\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:31:05.782506 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:05.782501    2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9913c26c-4377-469d-b8a7-5d537b4b1e4e-extensions-socket-volume\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:31:06.353542 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:06.353510    2555 generic.go:356] "Generic (PLEG): container finished" podID="9913c26c-4377-469d-b8a7-5d537b4b1e4e" containerID="1b82e4fca3a52447b9b6bfd2faab19c3292fa03da573b2e8681ebbe535be9a3c" exitCode=0
Jul 13 15:31:06.353935 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:06.353567    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wscc"
Jul 13 15:31:06.353935 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:06.353610    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wscc" event={"ID":"9913c26c-4377-469d-b8a7-5d537b4b1e4e","Type":"ContainerDied","Data":"1b82e4fca3a52447b9b6bfd2faab19c3292fa03da573b2e8681ebbe535be9a3c"}
Jul 13 15:31:06.353935 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:06.353671    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wscc" event={"ID":"9913c26c-4377-469d-b8a7-5d537b4b1e4e","Type":"ContainerDied","Data":"1ad704de2c23281c874825d109eace93fa4a9df641ef335ae93fd1436a2a1483"}
Jul 13 15:31:06.353935 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:06.353701    2555 scope.go:117] "RemoveContainer" containerID="1b82e4fca3a52447b9b6bfd2faab19c3292fa03da573b2e8681ebbe535be9a3c"
Jul 13 15:31:06.363752 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:06.363270    2555 scope.go:117] "RemoveContainer" containerID="1b82e4fca3a52447b9b6bfd2faab19c3292fa03da573b2e8681ebbe535be9a3c"
Jul 13 15:31:06.364167 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:31:06.364133    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b82e4fca3a52447b9b6bfd2faab19c3292fa03da573b2e8681ebbe535be9a3c\": container with ID starting with 1b82e4fca3a52447b9b6bfd2faab19c3292fa03da573b2e8681ebbe535be9a3c not found: ID does not exist" containerID="1b82e4fca3a52447b9b6bfd2faab19c3292fa03da573b2e8681ebbe535be9a3c"
Jul 13 15:31:06.364237 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:06.364176    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b82e4fca3a52447b9b6bfd2faab19c3292fa03da573b2e8681ebbe535be9a3c"} err="failed to get container status \"1b82e4fca3a52447b9b6bfd2faab19c3292fa03da573b2e8681ebbe535be9a3c\": rpc error: code = NotFound desc = could not find container \"1b82e4fca3a52447b9b6bfd2faab19c3292fa03da573b2e8681ebbe535be9a3c\": container with ID starting with 1b82e4fca3a52447b9b6bfd2faab19c3292fa03da573b2e8681ebbe535be9a3c not found: ID does not exist"
Jul 13 15:31:06.372937 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:06.372917    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wscc"]
Jul 13 15:31:06.376489 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:06.376469    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4wscc"]
Jul 13 15:31:08.202535 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:08.202504    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9913c26c-4377-469d-b8a7-5d537b4b1e4e" path="/var/lib/kubelet/pods/9913c26c-4377-469d-b8a7-5d537b4b1e4e/volumes"
Jul 13 15:31:12.942745 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:12.942715    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:31:13.057412 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:13.057369    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:31:15.419246 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:15.419216    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:31:15.483050 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:15.483025    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:31:18.026205 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:18.026171    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rjjd4"]
Jul 13 15:31:18.026667 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:18.026452    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rjjd4" podUID="03ce4607-02b0-489d-9318-f35f98c2374b" containerName="manager" containerID="cri-o://65f2a43ff96293f85c08ae284fc4e5edd9bf5c916421f7a94fdfcfc268b4cd83" gracePeriod=10
Jul 13 15:31:18.268061 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:18.268037    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rjjd4"
Jul 13 15:31:18.384256 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:18.384181    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pphzb\" (UniqueName: \"kubernetes.io/projected/03ce4607-02b0-489d-9318-f35f98c2374b-kube-api-access-pphzb\") pod \"03ce4607-02b0-489d-9318-f35f98c2374b\" (UID: \"03ce4607-02b0-489d-9318-f35f98c2374b\") "
Jul 13 15:31:18.384256 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:18.384231    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/03ce4607-02b0-489d-9318-f35f98c2374b-extensions-socket-volume\") pod \"03ce4607-02b0-489d-9318-f35f98c2374b\" (UID: \"03ce4607-02b0-489d-9318-f35f98c2374b\") "
Jul 13 15:31:18.384676 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:18.384652    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03ce4607-02b0-489d-9318-f35f98c2374b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "03ce4607-02b0-489d-9318-f35f98c2374b" (UID: "03ce4607-02b0-489d-9318-f35f98c2374b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:31:18.386390 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:18.386363    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03ce4607-02b0-489d-9318-f35f98c2374b-kube-api-access-pphzb" (OuterVolumeSpecName: "kube-api-access-pphzb") pod "03ce4607-02b0-489d-9318-f35f98c2374b" (UID: "03ce4607-02b0-489d-9318-f35f98c2374b"). InnerVolumeSpecName "kube-api-access-pphzb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:31:18.412600 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:18.412563    2555 generic.go:356] "Generic (PLEG): container finished" podID="03ce4607-02b0-489d-9318-f35f98c2374b" containerID="65f2a43ff96293f85c08ae284fc4e5edd9bf5c916421f7a94fdfcfc268b4cd83" exitCode=0
Jul 13 15:31:18.412703 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:18.412630    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rjjd4"
Jul 13 15:31:18.412703 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:18.412653    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rjjd4" event={"ID":"03ce4607-02b0-489d-9318-f35f98c2374b","Type":"ContainerDied","Data":"65f2a43ff96293f85c08ae284fc4e5edd9bf5c916421f7a94fdfcfc268b4cd83"}
Jul 13 15:31:18.412774 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:18.412708    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rjjd4" event={"ID":"03ce4607-02b0-489d-9318-f35f98c2374b","Type":"ContainerDied","Data":"93a284e80dac9ba24070b16e8ee8e747e65b25d874518a4b00f43fe73f724809"}
Jul 13 15:31:18.412774 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:18.412732    2555 scope.go:117] "RemoveContainer" containerID="65f2a43ff96293f85c08ae284fc4e5edd9bf5c916421f7a94fdfcfc268b4cd83"
Jul 13 15:31:18.421262 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:18.421244    2555 scope.go:117] "RemoveContainer" containerID="65f2a43ff96293f85c08ae284fc4e5edd9bf5c916421f7a94fdfcfc268b4cd83"
Jul 13 15:31:18.421495 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:31:18.421475    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65f2a43ff96293f85c08ae284fc4e5edd9bf5c916421f7a94fdfcfc268b4cd83\": container with ID starting with 65f2a43ff96293f85c08ae284fc4e5edd9bf5c916421f7a94fdfcfc268b4cd83 not found: ID does not exist" containerID="65f2a43ff96293f85c08ae284fc4e5edd9bf5c916421f7a94fdfcfc268b4cd83"
Jul 13 15:31:18.421534 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:18.421503    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65f2a43ff96293f85c08ae284fc4e5edd9bf5c916421f7a94fdfcfc268b4cd83"} err="failed to get container status \"65f2a43ff96293f85c08ae284fc4e5edd9bf5c916421f7a94fdfcfc268b4cd83\": rpc error: code = NotFound desc = could not find container \"65f2a43ff96293f85c08ae284fc4e5edd9bf5c916421f7a94fdfcfc268b4cd83\": container with ID starting with 65f2a43ff96293f85c08ae284fc4e5edd9bf5c916421f7a94fdfcfc268b4cd83 not found: ID does not exist"
Jul 13 15:31:18.435562 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:18.435539    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rjjd4"]
Jul 13 15:31:18.438470 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:18.438451    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rjjd4"]
Jul 13 15:31:18.485439 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:18.485419    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pphzb\" (UniqueName: \"kubernetes.io/projected/03ce4607-02b0-489d-9318-f35f98c2374b-kube-api-access-pphzb\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:31:18.485439 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:18.485437    2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/03ce4607-02b0-489d-9318-f35f98c2374b-extensions-socket-volume\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:31:19.757196 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:19.757155    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:31:19.857814 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:19.857778    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:31:20.202796 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:20.202706    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03ce4607-02b0-489d-9318-f35f98c2374b" path="/var/lib/kubelet/pods/03ce4607-02b0-489d-9318-f35f98c2374b/volumes"
Jul 13 15:31:21.768372 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:21.768342    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm"]
Jul 13 15:31:21.768786 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:21.768655    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03ce4607-02b0-489d-9318-f35f98c2374b" containerName="manager"
Jul 13 15:31:21.768786 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:21.768666    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="03ce4607-02b0-489d-9318-f35f98c2374b" containerName="manager"
Jul 13 15:31:21.768786 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:21.768679    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9913c26c-4377-469d-b8a7-5d537b4b1e4e" containerName="manager"
Jul 13 15:31:21.768786 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:21.768685    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="9913c26c-4377-469d-b8a7-5d537b4b1e4e" containerName="manager"
Jul 13 15:31:21.768786 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:21.768745    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="9913c26c-4377-469d-b8a7-5d537b4b1e4e" containerName="manager"
Jul 13 15:31:21.768786 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:21.768754    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="03ce4607-02b0-489d-9318-f35f98c2374b" containerName="manager"
Jul 13 15:31:21.772695 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:21.772678    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm"
Jul 13 15:31:21.774973 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:21.774951    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 13 15:31:21.775076 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:21.774990    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-vczjv\""
Jul 13 15:31:21.782907 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:21.782885    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm"]
Jul 13 15:31:21.797327 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:21.797300    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:31:21.910316 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:21.910280    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-b5pfm\" (UID: \"f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm"
Jul 13 15:31:21.910316 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:21.910321    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-b5pfm\" (UID: \"f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm"
Jul 13 15:31:21.910529 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:21.910379    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-b5pfm\" (UID: \"f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm"
Jul 13 15:31:21.910529 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:21.910433    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-b5pfm\" (UID: \"f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm"
Jul 13 15:31:21.910529 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:21.910453    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-b5pfm\" (UID: \"f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm"
Jul 13 15:31:21.910529 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:21.910470    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67567\" (UniqueName: \"kubernetes.io/projected/f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48-kube-api-access-67567\") pod \"maas-default-gateway-openshift-default-56654dcf7-b5pfm\" (UID: \"f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm"
Jul 13 15:31:21.910529 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:21.910505    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-b5pfm\" (UID: \"f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm"
Jul 13 15:31:21.910846 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:21.910551    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-b5pfm\" (UID: \"f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm"
Jul 13 15:31:21.910846 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:21.910568    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-b5pfm\" (UID: \"f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm"
Jul 13 15:31:22.011666 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:22.011632    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-b5pfm\" (UID: \"f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm"
Jul 13 15:31:22.011666 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:22.011671    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-b5pfm\" (UID: \"f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm"
Jul 13 15:31:22.011896 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:22.011697    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67567\" (UniqueName: \"kubernetes.io/projected/f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48-kube-api-access-67567\") pod \"maas-default-gateway-openshift-default-56654dcf7-b5pfm\" (UID: \"f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm"
Jul 13 15:31:22.011896 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:22.011815    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-b5pfm\" (UID: \"f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm"
Jul 13 15:31:22.011896 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:22.011887    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-b5pfm\" (UID: \"f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm"
Jul 13 15:31:22.012122 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:22.011915    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-b5pfm\" (UID: \"f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm"
Jul 13 15:31:22.012122 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:22.011969    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-b5pfm\" (UID: \"f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm"
Jul 13 15:31:22.012122 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:22.012011    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-b5pfm\" (UID: \"f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm"
Jul 13 15:31:22.012122 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:22.012067    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-b5pfm\" (UID: \"f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm"
Jul 13 15:31:22.012323 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:22.012304    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-b5pfm\" (UID: \"f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm"
Jul 13 15:31:22.012374 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:22.012358    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-b5pfm\" (UID: \"f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm"
Jul 13 15:31:22.012436 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:22.012402    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-b5pfm\" (UID: \"f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm"
Jul 13 15:31:22.012436 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:22.012413    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-b5pfm\" (UID: \"f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm"
Jul 13 15:31:22.012634 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:22.012614    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-b5pfm\" (UID: \"f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm"
Jul 13 15:31:22.014278 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:22.014257    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-b5pfm\" (UID: \"f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm"
Jul 13 15:31:22.014485 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:22.014468    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-b5pfm\" (UID: \"f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm"
Jul 13 15:31:22.021508 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:22.021424    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-b5pfm\" (UID: \"f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm"
Jul 13 15:31:22.021710 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:22.021605    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67567\" (UniqueName: \"kubernetes.io/projected/f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48-kube-api-access-67567\") pod \"maas-default-gateway-openshift-default-56654dcf7-b5pfm\" (UID: \"f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm"
Jul 13 15:31:22.083784 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:22.083749    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm"
Jul 13 15:31:22.229356 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:22.229323    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm"]
Jul 13 15:31:22.233310 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:31:22.233285    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9d12fc4_f2cc_4afa_9b03_5c0a3a5b2f48.slice/crio-683b7911ad323c077f1e0e90237b1bf43a0474eedda27f51fe5769c59631c0e3 WatchSource:0}: Error finding container 683b7911ad323c077f1e0e90237b1bf43a0474eedda27f51fe5769c59631c0e3: Status 404 returned error can't find the container with id 683b7911ad323c077f1e0e90237b1bf43a0474eedda27f51fe5769c59631c0e3
Jul 13 15:31:22.439199 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:22.439101    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm" event={"ID":"f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48","Type":"ContainerStarted","Data":"683b7911ad323c077f1e0e90237b1bf43a0474eedda27f51fe5769c59631c0e3"}
Jul 13 15:31:22.856282 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:22.856241    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:31:23.548764 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:23.548709    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:31:23.622075 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:23.622025    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:31:25.237527 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:25.237484    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 15:31:25.237828 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:25.237563    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 15:31:25.237828 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:25.237607    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 15:31:25.456013 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:25.455974    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm" event={"ID":"f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48","Type":"ContainerStarted","Data":"011820b8a46074b9ff478fbece783ca17f6a86b8017cbc49954539f87d4d7faf"}
Jul 13 15:31:25.479773 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:25.479725    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm" podStartSLOduration=1.478170688 podStartE2EDuration="4.479710862s" totalImagesPullingTime="3.001540174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:31:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:31:25.477964188 +0000 UTC m=+471.802686085" watchObservedRunningTime="2026-07-13 15:31:25.479710862 +0000 UTC m=+471.804432759"
Jul 13 15:31:26.084911 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:26.084871    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm"
Jul 13 15:31:26.089844 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:26.089817    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm"
Jul 13 15:31:26.461024 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:26.460933    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm"
Jul 13 15:31:26.462097 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:26.462077    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm"
Jul 13 15:31:27.130198 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:27.130158    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:31:28.351001 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:28.350969    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:31:33.557102 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:33.557066    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:31:33.657921 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:33.657883    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:31:36.006747 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:36.006713    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:31:36.112925 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:36.112892    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:31:37.312922 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:37.312882    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:31:37.324217 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:37.324188    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tl8cw"]
Jul 13 15:31:37.328868 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:37.328854    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-tl8cw"
Jul 13 15:31:37.331642 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:37.331626    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 13 15:31:37.331735 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:37.331681    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 13 15:31:37.331780 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:37.331736    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 13 15:31:37.332504 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:37.332489    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4qjbx\""
Jul 13 15:31:37.338324 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:37.338304    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tl8cw"]
Jul 13 15:31:37.417578 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:37.417547    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tl8cw"]
Jul 13 15:31:37.420367 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:37.420338    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:31:37.446538 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:37.446512    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5j6k\" (UniqueName: \"kubernetes.io/projected/2bbe7cba-682a-4b3a-a9f4-93214dca73e6-kube-api-access-x5j6k\") pod \"limitador-limitador-64c94fd64f-tl8cw\" (UID: \"2bbe7cba-682a-4b3a-a9f4-93214dca73e6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tl8cw"
Jul 13 15:31:37.446650 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:37.446560    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2bbe7cba-682a-4b3a-a9f4-93214dca73e6-config-file\") pod \"limitador-limitador-64c94fd64f-tl8cw\" (UID: \"2bbe7cba-682a-4b3a-a9f4-93214dca73e6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tl8cw"
Jul 13 15:31:37.524334 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:37.524304    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:31:37.547323 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:37.547291    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5j6k\" (UniqueName: \"kubernetes.io/projected/2bbe7cba-682a-4b3a-a9f4-93214dca73e6-kube-api-access-x5j6k\") pod \"limitador-limitador-64c94fd64f-tl8cw\" (UID: \"2bbe7cba-682a-4b3a-a9f4-93214dca73e6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tl8cw"
Jul 13 15:31:37.547438 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:37.547340    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2bbe7cba-682a-4b3a-a9f4-93214dca73e6-config-file\") pod \"limitador-limitador-64c94fd64f-tl8cw\" (UID: \"2bbe7cba-682a-4b3a-a9f4-93214dca73e6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tl8cw"
Jul 13 15:31:37.547919 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:37.547901    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2bbe7cba-682a-4b3a-a9f4-93214dca73e6-config-file\") pod \"limitador-limitador-64c94fd64f-tl8cw\" (UID: \"2bbe7cba-682a-4b3a-a9f4-93214dca73e6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tl8cw"
Jul 13 15:31:37.556647 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:37.556622    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5j6k\" (UniqueName: \"kubernetes.io/projected/2bbe7cba-682a-4b3a-a9f4-93214dca73e6-kube-api-access-x5j6k\") pod \"limitador-limitador-64c94fd64f-tl8cw\" (UID: \"2bbe7cba-682a-4b3a-a9f4-93214dca73e6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tl8cw"
Jul 13 15:31:37.639746 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:37.639685    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-tl8cw"
Jul 13 15:31:37.776058 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:37.776035    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tl8cw"]
Jul 13 15:31:37.778064 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:31:37.778034    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bbe7cba_682a_4b3a_a9f4_93214dca73e6.slice/crio-58768d0c4748ad1076938cb1469cc068d003f95b58ed76e1689e4087618a6054 WatchSource:0}: Error finding container 58768d0c4748ad1076938cb1469cc068d003f95b58ed76e1689e4087618a6054: Status 404 returned error can't find the container with id 58768d0c4748ad1076938cb1469cc068d003f95b58ed76e1689e4087618a6054
Jul 13 15:31:38.203489 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:38.203462    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-4qd68"]
Jul 13 15:31:38.209756 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:38.209725    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4qd68"
Jul 13 15:31:38.212477 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:38.212449    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-drvmg\""
Jul 13 15:31:38.213972 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:38.213948    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-4qd68"]
Jul 13 15:31:38.234936 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:38.234912    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:31:38.288407 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:38.288364    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:31:38.355551 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:38.355512    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlstz\" (UniqueName: \"kubernetes.io/projected/59d2c586-c51e-4e1b-9498-f4a370e7acd1-kube-api-access-mlstz\") pod \"authorino-58cd955675-4qd68\" (UID: \"59d2c586-c51e-4e1b-9498-f4a370e7acd1\") " pod="kuadrant-system/authorino-58cd955675-4qd68"
Jul 13 15:31:38.456243 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:38.456162    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlstz\" (UniqueName: \"kubernetes.io/projected/59d2c586-c51e-4e1b-9498-f4a370e7acd1-kube-api-access-mlstz\") pod \"authorino-58cd955675-4qd68\" (UID: \"59d2c586-c51e-4e1b-9498-f4a370e7acd1\") " pod="kuadrant-system/authorino-58cd955675-4qd68"
Jul 13 15:31:38.467579 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:38.467521    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlstz\" (UniqueName: \"kubernetes.io/projected/59d2c586-c51e-4e1b-9498-f4a370e7acd1-kube-api-access-mlstz\") pod \"authorino-58cd955675-4qd68\" (UID: \"59d2c586-c51e-4e1b-9498-f4a370e7acd1\") " pod="kuadrant-system/authorino-58cd955675-4qd68"
Jul 13 15:31:38.521691 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:38.521650    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-tl8cw" event={"ID":"2bbe7cba-682a-4b3a-a9f4-93214dca73e6","Type":"ContainerStarted","Data":"58768d0c4748ad1076938cb1469cc068d003f95b58ed76e1689e4087618a6054"}
Jul 13 15:31:38.521934 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:38.521914    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4qd68"
Jul 13 15:31:38.706841 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:38.706812    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-4qd68"]
Jul 13 15:31:38.709626 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:31:38.709594    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod59d2c586_c51e_4e1b_9498_f4a370e7acd1.slice/crio-83f76bd4c83f9c254c473806ba779601b042d7cebfc104aa98b776eb78f8ee7a WatchSource:0}: Error finding container 83f76bd4c83f9c254c473806ba779601b042d7cebfc104aa98b776eb78f8ee7a: Status 404 returned error can't find the container with id 83f76bd4c83f9c254c473806ba779601b042d7cebfc104aa98b776eb78f8ee7a
Jul 13 15:31:39.528718 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:39.528676    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4qd68" event={"ID":"59d2c586-c51e-4e1b-9498-f4a370e7acd1","Type":"ContainerStarted","Data":"83f76bd4c83f9c254c473806ba779601b042d7cebfc104aa98b776eb78f8ee7a"}
Jul 13 15:31:40.535614 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:40.535563    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-tl8cw" event={"ID":"2bbe7cba-682a-4b3a-a9f4-93214dca73e6","Type":"ContainerStarted","Data":"f88fa77486f50e696a8d80e6dc01a52d5a4f0cfb826f03dff56314eebd263ec2"}
Jul 13 15:31:40.536019 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:40.535663    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-tl8cw"
Jul 13 15:31:40.555351 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:40.555301    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-tl8cw" podStartSLOduration=0.889644429 podStartE2EDuration="3.555285048s" totalImagesPullingTime="2.665640619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:31:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:31:40.554623348 +0000 UTC m=+486.879345247" watchObservedRunningTime="2026-07-13 15:31:40.555285048 +0000 UTC m=+486.880006945"
Jul 13 15:31:43.187244 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:43.187161    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:31:43.347194 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:43.347159    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-4qd68"]
Jul 13 15:31:43.552536 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:43.552499    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4qd68" event={"ID":"59d2c586-c51e-4e1b-9498-f4a370e7acd1","Type":"ContainerStarted","Data":"bd434676ecdd3f86c16985754afef91679d5d8640167f15b3186c18ba040d647"}
Jul 13 15:31:43.568935 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:43.568882    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-4qd68" podStartSLOduration=1.373698566 podStartE2EDuration="5.568866293s" totalImagesPullingTime="4.195167727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:31:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:31:43.568166761 +0000 UTC m=+489.892888652" watchObservedRunningTime="2026-07-13 15:31:43.568866293 +0000 UTC m=+489.893588218"
Jul 13 15:31:44.557119 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:44.557075    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-4qd68" podUID="59d2c586-c51e-4e1b-9498-f4a370e7acd1" containerName="authorino" containerID="cri-o://bd434676ecdd3f86c16985754afef91679d5d8640167f15b3186c18ba040d647" gracePeriod=30
Jul 13 15:31:44.805054 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:44.805029    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4qd68"
Jul 13 15:31:44.815005 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:44.814949    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mlstz\" (UniqueName: \"kubernetes.io/projected/59d2c586-c51e-4e1b-9498-f4a370e7acd1-kube-api-access-mlstz\") pod \"59d2c586-c51e-4e1b-9498-f4a370e7acd1\" (UID: \"59d2c586-c51e-4e1b-9498-f4a370e7acd1\") "
Jul 13 15:31:44.816957 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:44.816928    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59d2c586-c51e-4e1b-9498-f4a370e7acd1-kube-api-access-mlstz" (OuterVolumeSpecName: "kube-api-access-mlstz") pod "59d2c586-c51e-4e1b-9498-f4a370e7acd1" (UID: "59d2c586-c51e-4e1b-9498-f4a370e7acd1"). InnerVolumeSpecName "kube-api-access-mlstz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:31:44.915798 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:44.915762    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mlstz\" (UniqueName: \"kubernetes.io/projected/59d2c586-c51e-4e1b-9498-f4a370e7acd1-kube-api-access-mlstz\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:31:45.563021 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:45.562982    2555 generic.go:356] "Generic (PLEG): container finished" podID="59d2c586-c51e-4e1b-9498-f4a370e7acd1" containerID="bd434676ecdd3f86c16985754afef91679d5d8640167f15b3186c18ba040d647" exitCode=0
Jul 13 15:31:45.563431 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:45.563030    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4qd68"
Jul 13 15:31:45.563431 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:45.563042    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4qd68" event={"ID":"59d2c586-c51e-4e1b-9498-f4a370e7acd1","Type":"ContainerDied","Data":"bd434676ecdd3f86c16985754afef91679d5d8640167f15b3186c18ba040d647"}
Jul 13 15:31:45.563431 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:45.563083    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4qd68" event={"ID":"59d2c586-c51e-4e1b-9498-f4a370e7acd1","Type":"ContainerDied","Data":"83f76bd4c83f9c254c473806ba779601b042d7cebfc104aa98b776eb78f8ee7a"}
Jul 13 15:31:45.563431 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:45.563102    2555 scope.go:117] "RemoveContainer" containerID="bd434676ecdd3f86c16985754afef91679d5d8640167f15b3186c18ba040d647"
Jul 13 15:31:45.572058 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:45.572040    2555 scope.go:117] "RemoveContainer" containerID="bd434676ecdd3f86c16985754afef91679d5d8640167f15b3186c18ba040d647"
Jul 13 15:31:45.572325 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:31:45.572307    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd434676ecdd3f86c16985754afef91679d5d8640167f15b3186c18ba040d647\": container with ID starting with bd434676ecdd3f86c16985754afef91679d5d8640167f15b3186c18ba040d647 not found: ID does not exist" containerID="bd434676ecdd3f86c16985754afef91679d5d8640167f15b3186c18ba040d647"
Jul 13 15:31:45.572372 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:45.572334    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd434676ecdd3f86c16985754afef91679d5d8640167f15b3186c18ba040d647"} err="failed to get container status \"bd434676ecdd3f86c16985754afef91679d5d8640167f15b3186c18ba040d647\": rpc error: code = NotFound desc = could not find container \"bd434676ecdd3f86c16985754afef91679d5d8640167f15b3186c18ba040d647\": container with ID starting with bd434676ecdd3f86c16985754afef91679d5d8640167f15b3186c18ba040d647 not found: ID does not exist"
Jul 13 15:31:45.583278 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:45.583255    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-4qd68"]
Jul 13 15:31:45.587070 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:45.587048    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-4qd68"]
Jul 13 15:31:46.202997 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:46.202966    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59d2c586-c51e-4e1b-9498-f4a370e7acd1" path="/var/lib/kubelet/pods/59d2c586-c51e-4e1b-9498-f4a370e7acd1/volumes"
Jul 13 15:31:51.542726 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:51.542698    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-tl8cw"
Jul 13 15:31:52.349767 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:52.349727    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tl8cw"]
Jul 13 15:31:52.353073 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:52.350033    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-tl8cw" podUID="2bbe7cba-682a-4b3a-a9f4-93214dca73e6" containerName="limitador" containerID="cri-o://f88fa77486f50e696a8d80e6dc01a52d5a4f0cfb826f03dff56314eebd263ec2" gracePeriod=30
Jul 13 15:31:52.894465 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:52.894441    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-tl8cw"
Jul 13 15:31:52.965686 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:52.965571    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2bbe7cba-682a-4b3a-a9f4-93214dca73e6-config-file\") pod \"2bbe7cba-682a-4b3a-a9f4-93214dca73e6\" (UID: \"2bbe7cba-682a-4b3a-a9f4-93214dca73e6\") "
Jul 13 15:31:52.965686 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:52.965656    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x5j6k\" (UniqueName: \"kubernetes.io/projected/2bbe7cba-682a-4b3a-a9f4-93214dca73e6-kube-api-access-x5j6k\") pod \"2bbe7cba-682a-4b3a-a9f4-93214dca73e6\" (UID: \"2bbe7cba-682a-4b3a-a9f4-93214dca73e6\") "
Jul 13 15:31:52.965967 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:52.965943    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bbe7cba-682a-4b3a-a9f4-93214dca73e6-config-file" (OuterVolumeSpecName: "config-file") pod "2bbe7cba-682a-4b3a-a9f4-93214dca73e6" (UID: "2bbe7cba-682a-4b3a-a9f4-93214dca73e6"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:31:52.967684 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:52.967658    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bbe7cba-682a-4b3a-a9f4-93214dca73e6-kube-api-access-x5j6k" (OuterVolumeSpecName: "kube-api-access-x5j6k") pod "2bbe7cba-682a-4b3a-a9f4-93214dca73e6" (UID: "2bbe7cba-682a-4b3a-a9f4-93214dca73e6"). InnerVolumeSpecName "kube-api-access-x5j6k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:31:53.066846 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:53.066812    2555 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2bbe7cba-682a-4b3a-a9f4-93214dca73e6-config-file\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:31:53.066846 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:53.066840    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5j6k\" (UniqueName: \"kubernetes.io/projected/2bbe7cba-682a-4b3a-a9f4-93214dca73e6-kube-api-access-x5j6k\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:31:53.598345 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:53.598311    2555 generic.go:356] "Generic (PLEG): container finished" podID="2bbe7cba-682a-4b3a-a9f4-93214dca73e6" containerID="f88fa77486f50e696a8d80e6dc01a52d5a4f0cfb826f03dff56314eebd263ec2" exitCode=0
Jul 13 15:31:53.598540 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:53.598364    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-tl8cw"
Jul 13 15:31:53.598540 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:53.598409    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-tl8cw" event={"ID":"2bbe7cba-682a-4b3a-a9f4-93214dca73e6","Type":"ContainerDied","Data":"f88fa77486f50e696a8d80e6dc01a52d5a4f0cfb826f03dff56314eebd263ec2"}
Jul 13 15:31:53.598540 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:53.598477    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-tl8cw" event={"ID":"2bbe7cba-682a-4b3a-a9f4-93214dca73e6","Type":"ContainerDied","Data":"58768d0c4748ad1076938cb1469cc068d003f95b58ed76e1689e4087618a6054"}
Jul 13 15:31:53.598540 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:53.598500    2555 scope.go:117] "RemoveContainer" containerID="f88fa77486f50e696a8d80e6dc01a52d5a4f0cfb826f03dff56314eebd263ec2"
Jul 13 15:31:53.607473 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:53.607453    2555 scope.go:117] "RemoveContainer" containerID="f88fa77486f50e696a8d80e6dc01a52d5a4f0cfb826f03dff56314eebd263ec2"
Jul 13 15:31:53.607737 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:31:53.607717    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f88fa77486f50e696a8d80e6dc01a52d5a4f0cfb826f03dff56314eebd263ec2\": container with ID starting with f88fa77486f50e696a8d80e6dc01a52d5a4f0cfb826f03dff56314eebd263ec2 not found: ID does not exist" containerID="f88fa77486f50e696a8d80e6dc01a52d5a4f0cfb826f03dff56314eebd263ec2"
Jul 13 15:31:53.607786 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:53.607747    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f88fa77486f50e696a8d80e6dc01a52d5a4f0cfb826f03dff56314eebd263ec2"} err="failed to get container status \"f88fa77486f50e696a8d80e6dc01a52d5a4f0cfb826f03dff56314eebd263ec2\": rpc error: code = NotFound desc = could not find container \"f88fa77486f50e696a8d80e6dc01a52d5a4f0cfb826f03dff56314eebd263ec2\": container with ID starting with f88fa77486f50e696a8d80e6dc01a52d5a4f0cfb826f03dff56314eebd263ec2 not found: ID does not exist"
Jul 13 15:31:53.619773 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:53.619748    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tl8cw"]
Jul 13 15:31:53.623241 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:53.623221    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tl8cw"]
Jul 13 15:31:54.204002 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:54.203972    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bbe7cba-682a-4b3a-a9f4-93214dca73e6" path="/var/lib/kubelet/pods/2bbe7cba-682a-4b3a-a9f4-93214dca73e6/volumes"
Jul 13 15:31:58.080952 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:58.080899    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:31:58.182806 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:58.182772    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:31:58.598184 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:58.598141    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-qdg5k"]
Jul 13 15:31:58.598529 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:58.598511    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bbe7cba-682a-4b3a-a9f4-93214dca73e6" containerName="limitador"
Jul 13 15:31:58.598637 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:58.598532    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bbe7cba-682a-4b3a-a9f4-93214dca73e6" containerName="limitador"
Jul 13 15:31:58.598637 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:58.598577    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59d2c586-c51e-4e1b-9498-f4a370e7acd1" containerName="authorino"
Jul 13 15:31:58.598637 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:58.598612    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="59d2c586-c51e-4e1b-9498-f4a370e7acd1" containerName="authorino"
Jul 13 15:31:58.598790 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:58.598696    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="59d2c586-c51e-4e1b-9498-f4a370e7acd1" containerName="authorino"
Jul 13 15:31:58.598790 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:58.598708    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bbe7cba-682a-4b3a-a9f4-93214dca73e6" containerName="limitador"
Jul 13 15:31:58.601655 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:58.601630    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qdg5k"
Jul 13 15:31:58.604091 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:58.604070    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 13 15:31:58.604220 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:58.604070    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 15:31:58.604220 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:58.604132    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-98b59\""
Jul 13 15:31:58.604811 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:58.604794    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 13 15:31:58.614119 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:58.614093    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-qdg5k"]
Jul 13 15:31:58.660044 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:58.660022    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:31:58.715223 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:58.715196    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/fc8bc0de-ffcd-4571-b6bc-0078c050e04a-data\") pod \"postgres-69fb4594cf-qdg5k\" (UID: \"fc8bc0de-ffcd-4571-b6bc-0078c050e04a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qdg5k"
Jul 13 15:31:58.715322 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:58.715250    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b424z\" (UniqueName: \"kubernetes.io/projected/fc8bc0de-ffcd-4571-b6bc-0078c050e04a-kube-api-access-b424z\") pod \"postgres-69fb4594cf-qdg5k\" (UID: \"fc8bc0de-ffcd-4571-b6bc-0078c050e04a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qdg5k"
Jul 13 15:31:58.816618 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:58.816577    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/fc8bc0de-ffcd-4571-b6bc-0078c050e04a-data\") pod \"postgres-69fb4594cf-qdg5k\" (UID: \"fc8bc0de-ffcd-4571-b6bc-0078c050e04a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qdg5k"
Jul 13 15:31:58.816727 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:58.816665    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b424z\" (UniqueName: \"kubernetes.io/projected/fc8bc0de-ffcd-4571-b6bc-0078c050e04a-kube-api-access-b424z\") pod \"postgres-69fb4594cf-qdg5k\" (UID: \"fc8bc0de-ffcd-4571-b6bc-0078c050e04a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qdg5k"
Jul 13 15:31:58.816939 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:58.816916    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/fc8bc0de-ffcd-4571-b6bc-0078c050e04a-data\") pod \"postgres-69fb4594cf-qdg5k\" (UID: \"fc8bc0de-ffcd-4571-b6bc-0078c050e04a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qdg5k"
Jul 13 15:31:58.826645 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:58.826624    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b424z\" (UniqueName: \"kubernetes.io/projected/fc8bc0de-ffcd-4571-b6bc-0078c050e04a-kube-api-access-b424z\") pod \"postgres-69fb4594cf-qdg5k\" (UID: \"fc8bc0de-ffcd-4571-b6bc-0078c050e04a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qdg5k"
Jul 13 15:31:58.915793 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:58.915731    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qdg5k"
Jul 13 15:31:59.043506 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:59.043481    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-qdg5k"]
Jul 13 15:31:59.045962 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:31:59.045935    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc8bc0de_ffcd_4571_b6bc_0078c050e04a.slice/crio-33c2f94372d7948f693a9e4b1145e06e81441b827d5d5194b6eacacb5ac3cb6b WatchSource:0}: Error finding container 33c2f94372d7948f693a9e4b1145e06e81441b827d5d5194b6eacacb5ac3cb6b: Status 404 returned error can't find the container with id 33c2f94372d7948f693a9e4b1145e06e81441b827d5d5194b6eacacb5ac3cb6b
Jul 13 15:31:59.630600 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:31:59.630554    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qdg5k" event={"ID":"fc8bc0de-ffcd-4571-b6bc-0078c050e04a","Type":"ContainerStarted","Data":"33c2f94372d7948f693a9e4b1145e06e81441b827d5d5194b6eacacb5ac3cb6b"}
Jul 13 15:32:04.660989 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:04.660952    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qdg5k" event={"ID":"fc8bc0de-ffcd-4571-b6bc-0078c050e04a","Type":"ContainerStarted","Data":"97de919a7b7f7567f1dceb466ef583bf95d0fd4746cd8c98e503b084f70afd19"}
Jul 13 15:32:04.661418 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:04.661077    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qdg5k"
Jul 13 15:32:04.679052 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:04.679007    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qdg5k" podStartSLOduration=1.727476265 podStartE2EDuration="6.67899489s" totalImagesPullingTime="4.951518625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:31:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:32:04.678437861 +0000 UTC m=+511.003159759" watchObservedRunningTime="2026-07-13 15:32:04.67899489 +0000 UTC m=+511.003716786"
Jul 13 15:32:10.695205 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:10.695175    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qdg5k"
Jul 13 15:32:11.015535 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:11.015484    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:32:11.182410 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:11.182372    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:32:11.238278 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:11.238246    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x887h"]
Jul 13 15:32:11.243066 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:11.243046    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-x887h"
Jul 13 15:32:11.245473 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:11.245452    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 13 15:32:11.245579 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:11.245482    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 13 15:32:11.245579 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:11.245521    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-drvmg\""
Jul 13 15:32:11.248619 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:11.248597    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x887h"]
Jul 13 15:32:11.319055 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:11.318976    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr92s\" (UniqueName: \"kubernetes.io/projected/a46dde6f-70b5-4e05-8d1d-44166df2b69a-kube-api-access-dr92s\") pod \"authorino-5d4b67c446-x887h\" (UID: \"a46dde6f-70b5-4e05-8d1d-44166df2b69a\") " pod="kuadrant-system/authorino-5d4b67c446-x887h"
Jul 13 15:32:11.420406 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:11.420361    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr92s\" (UniqueName: \"kubernetes.io/projected/a46dde6f-70b5-4e05-8d1d-44166df2b69a-kube-api-access-dr92s\") pod \"authorino-5d4b67c446-x887h\" (UID: \"a46dde6f-70b5-4e05-8d1d-44166df2b69a\") " pod="kuadrant-system/authorino-5d4b67c446-x887h"
Jul 13 15:32:11.429028 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:11.429002    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr92s\" (UniqueName: \"kubernetes.io/projected/a46dde6f-70b5-4e05-8d1d-44166df2b69a-kube-api-access-dr92s\") pod \"authorino-5d4b67c446-x887h\" (UID: \"a46dde6f-70b5-4e05-8d1d-44166df2b69a\") " pod="kuadrant-system/authorino-5d4b67c446-x887h"
Jul 13 15:32:11.467265 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:11.467236    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x887h"]
Jul 13 15:32:11.467477 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:11.467466    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-x887h"
Jul 13 15:32:11.604273 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:11.604250    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x887h"]
Jul 13 15:32:11.606487 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:32:11.606456    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda46dde6f_70b5_4e05_8d1d_44166df2b69a.slice/crio-99b5b43db6bbf4ec5fc31772a265c7aa737619482d913c2ce5bdcb4abb5496c4 WatchSource:0}: Error finding container 99b5b43db6bbf4ec5fc31772a265c7aa737619482d913c2ce5bdcb4abb5496c4: Status 404 returned error can't find the container with id 99b5b43db6bbf4ec5fc31772a265c7aa737619482d913c2ce5bdcb4abb5496c4
Jul 13 15:32:11.623129 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:11.623105    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-65f956d9c5-h7sdk"]
Jul 13 15:32:11.628446 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:11.628426    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65f956d9c5-h7sdk"
Jul 13 15:32:11.630825 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:11.630806    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 13 15:32:11.634653 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:11.634628    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-65f956d9c5-h7sdk"]
Jul 13 15:32:11.696513 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:11.696485    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-x887h" event={"ID":"a46dde6f-70b5-4e05-8d1d-44166df2b69a","Type":"ContainerStarted","Data":"99b5b43db6bbf4ec5fc31772a265c7aa737619482d913c2ce5bdcb4abb5496c4"}
Jul 13 15:32:11.722845 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:11.722826    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8a4090c4-92f5-44b0-a8fe-b90df7ab72b3-tls-cert\") pod \"authorino-65f956d9c5-h7sdk\" (UID: \"8a4090c4-92f5-44b0-a8fe-b90df7ab72b3\") " pod="kuadrant-system/authorino-65f956d9c5-h7sdk"
Jul 13 15:32:11.722926 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:11.722875    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqnvz\" (UniqueName: \"kubernetes.io/projected/8a4090c4-92f5-44b0-a8fe-b90df7ab72b3-kube-api-access-lqnvz\") pod \"authorino-65f956d9c5-h7sdk\" (UID: \"8a4090c4-92f5-44b0-a8fe-b90df7ab72b3\") " pod="kuadrant-system/authorino-65f956d9c5-h7sdk"
Jul 13 15:32:11.823831 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:11.823797    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqnvz\" (UniqueName: \"kubernetes.io/projected/8a4090c4-92f5-44b0-a8fe-b90df7ab72b3-kube-api-access-lqnvz\") pod \"authorino-65f956d9c5-h7sdk\" (UID: \"8a4090c4-92f5-44b0-a8fe-b90df7ab72b3\") " pod="kuadrant-system/authorino-65f956d9c5-h7sdk"
Jul 13 15:32:11.823970 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:11.823863    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8a4090c4-92f5-44b0-a8fe-b90df7ab72b3-tls-cert\") pod \"authorino-65f956d9c5-h7sdk\" (UID: \"8a4090c4-92f5-44b0-a8fe-b90df7ab72b3\") " pod="kuadrant-system/authorino-65f956d9c5-h7sdk"
Jul 13 15:32:11.826227 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:11.826208    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8a4090c4-92f5-44b0-a8fe-b90df7ab72b3-tls-cert\") pod \"authorino-65f956d9c5-h7sdk\" (UID: \"8a4090c4-92f5-44b0-a8fe-b90df7ab72b3\") " pod="kuadrant-system/authorino-65f956d9c5-h7sdk"
Jul 13 15:32:11.833452 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:11.833432    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqnvz\" (UniqueName: \"kubernetes.io/projected/8a4090c4-92f5-44b0-a8fe-b90df7ab72b3-kube-api-access-lqnvz\") pod \"authorino-65f956d9c5-h7sdk\" (UID: \"8a4090c4-92f5-44b0-a8fe-b90df7ab72b3\") " pod="kuadrant-system/authorino-65f956d9c5-h7sdk"
Jul 13 15:32:11.938155 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:11.938100    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65f956d9c5-h7sdk"
Jul 13 15:32:12.107400 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:12.107376    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-65f956d9c5-h7sdk"]
Jul 13 15:32:12.108511 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:32:12.108486    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a4090c4_92f5_44b0_a8fe_b90df7ab72b3.slice/crio-a7ecf93288e5e46111f218b3206962fda16898bc428776ab2f85a7a36020d96a WatchSource:0}: Error finding container a7ecf93288e5e46111f218b3206962fda16898bc428776ab2f85a7a36020d96a: Status 404 returned error can't find the container with id a7ecf93288e5e46111f218b3206962fda16898bc428776ab2f85a7a36020d96a
Jul 13 15:32:12.704959 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:12.704928    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-x887h" event={"ID":"a46dde6f-70b5-4e05-8d1d-44166df2b69a","Type":"ContainerStarted","Data":"739e46bddd7990a9552cf517c54ca1ea2d578bb10ddb30b4fad99dcc3cdb4409"}
Jul 13 15:32:12.705412 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:12.704912    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-x887h" podUID="a46dde6f-70b5-4e05-8d1d-44166df2b69a" containerName="authorino" containerID="cri-o://739e46bddd7990a9552cf517c54ca1ea2d578bb10ddb30b4fad99dcc3cdb4409" gracePeriod=30
Jul 13 15:32:12.707062 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:12.707035    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65f956d9c5-h7sdk" event={"ID":"8a4090c4-92f5-44b0-a8fe-b90df7ab72b3","Type":"ContainerStarted","Data":"444df9c29970f9bb2dbf8c5e74cc7830248a7442f8584fa8f9fd2ce742a187f6"}
Jul 13 15:32:12.707184 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:12.707073    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65f956d9c5-h7sdk" event={"ID":"8a4090c4-92f5-44b0-a8fe-b90df7ab72b3","Type":"ContainerStarted","Data":"a7ecf93288e5e46111f218b3206962fda16898bc428776ab2f85a7a36020d96a"}
Jul 13 15:32:12.721907 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:12.721865    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-x887h" podStartSLOduration=1.140194237 podStartE2EDuration="1.721851434s" totalImagesPullingTime="581.657197ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:32:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:32:12.720979455 +0000 UTC m=+519.045701355" watchObservedRunningTime="2026-07-13 15:32:12.721851434 +0000 UTC m=+519.046573330"
Jul 13 15:32:12.740045 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:12.740007    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-65f956d9c5-h7sdk" podStartSLOduration=1.258339547 podStartE2EDuration="1.739989441s" totalImagesPullingTime="481.649894ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:32:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:32:12.738832874 +0000 UTC m=+519.063554770" watchObservedRunningTime="2026-07-13 15:32:12.739989441 +0000 UTC m=+519.064711337"
Jul 13 15:32:12.988710 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:12.988683    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-x887h"
Jul 13 15:32:13.035869 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:13.035841    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dr92s\" (UniqueName: \"kubernetes.io/projected/a46dde6f-70b5-4e05-8d1d-44166df2b69a-kube-api-access-dr92s\") pod \"a46dde6f-70b5-4e05-8d1d-44166df2b69a\" (UID: \"a46dde6f-70b5-4e05-8d1d-44166df2b69a\") "
Jul 13 15:32:13.037823 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:13.037796    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a46dde6f-70b5-4e05-8d1d-44166df2b69a-kube-api-access-dr92s" (OuterVolumeSpecName: "kube-api-access-dr92s") pod "a46dde6f-70b5-4e05-8d1d-44166df2b69a" (UID: "a46dde6f-70b5-4e05-8d1d-44166df2b69a"). InnerVolumeSpecName "kube-api-access-dr92s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:32:13.136680 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:13.136620    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dr92s\" (UniqueName: \"kubernetes.io/projected/a46dde6f-70b5-4e05-8d1d-44166df2b69a-kube-api-access-dr92s\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:32:13.712429 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:13.712342    2555 generic.go:356] "Generic (PLEG): container finished" podID="a46dde6f-70b5-4e05-8d1d-44166df2b69a" containerID="739e46bddd7990a9552cf517c54ca1ea2d578bb10ddb30b4fad99dcc3cdb4409" exitCode=0
Jul 13 15:32:13.712429 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:13.712407    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-x887h"
Jul 13 15:32:13.712919 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:13.712434    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-x887h" event={"ID":"a46dde6f-70b5-4e05-8d1d-44166df2b69a","Type":"ContainerDied","Data":"739e46bddd7990a9552cf517c54ca1ea2d578bb10ddb30b4fad99dcc3cdb4409"}
Jul 13 15:32:13.712919 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:13.712488    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-x887h" event={"ID":"a46dde6f-70b5-4e05-8d1d-44166df2b69a","Type":"ContainerDied","Data":"99b5b43db6bbf4ec5fc31772a265c7aa737619482d913c2ce5bdcb4abb5496c4"}
Jul 13 15:32:13.712919 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:13.712515    2555 scope.go:117] "RemoveContainer" containerID="739e46bddd7990a9552cf517c54ca1ea2d578bb10ddb30b4fad99dcc3cdb4409"
Jul 13 15:32:13.720991 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:13.720975    2555 scope.go:117] "RemoveContainer" containerID="739e46bddd7990a9552cf517c54ca1ea2d578bb10ddb30b4fad99dcc3cdb4409"
Jul 13 15:32:13.721241 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:32:13.721226    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"739e46bddd7990a9552cf517c54ca1ea2d578bb10ddb30b4fad99dcc3cdb4409\": container with ID starting with 739e46bddd7990a9552cf517c54ca1ea2d578bb10ddb30b4fad99dcc3cdb4409 not found: ID does not exist" containerID="739e46bddd7990a9552cf517c54ca1ea2d578bb10ddb30b4fad99dcc3cdb4409"
Jul 13 15:32:13.721279 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:13.721250    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"739e46bddd7990a9552cf517c54ca1ea2d578bb10ddb30b4fad99dcc3cdb4409"} err="failed to get container status \"739e46bddd7990a9552cf517c54ca1ea2d578bb10ddb30b4fad99dcc3cdb4409\": rpc error: code = NotFound desc = could not find container \"739e46bddd7990a9552cf517c54ca1ea2d578bb10ddb30b4fad99dcc3cdb4409\": container with ID starting with 739e46bddd7990a9552cf517c54ca1ea2d578bb10ddb30b4fad99dcc3cdb4409 not found: ID does not exist"
Jul 13 15:32:13.733911 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:13.733889    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x887h"]
Jul 13 15:32:13.740208 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:13.740189    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-x887h"]
Jul 13 15:32:14.202353 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:14.202324    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a46dde6f-70b5-4e05-8d1d-44166df2b69a" path="/var/lib/kubelet/pods/a46dde6f-70b5-4e05-8d1d-44166df2b69a/volumes"
Jul 13 15:32:17.595703 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:17.595668    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-85bdf557cd-z4wtp"]
Jul 13 15:32:17.596251 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:17.596025    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a46dde6f-70b5-4e05-8d1d-44166df2b69a" containerName="authorino"
Jul 13 15:32:17.596251 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:17.596036    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a46dde6f-70b5-4e05-8d1d-44166df2b69a" containerName="authorino"
Jul 13 15:32:17.596251 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:17.596095    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="a46dde6f-70b5-4e05-8d1d-44166df2b69a" containerName="authorino"
Jul 13 15:32:17.612386 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:17.612347    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:32:17.616995 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:17.616951    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85bdf557cd-z4wtp"]
Jul 13 15:32:17.617138 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:17.617075    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85bdf557cd-z4wtp"
Jul 13 15:32:17.619796 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:17.619774    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 13 15:32:17.619918 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:17.619774    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 13 15:32:17.619999 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:17.619920    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rv4jb\""
Jul 13 15:32:17.670536 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:17.670502    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9819fbbd-cfe4-4786-8016-137c9d37aef3-webhook-cert\") pod \"maas-controller-85bdf557cd-z4wtp\" (UID: \"9819fbbd-cfe4-4786-8016-137c9d37aef3\") " pod="opendatahub/maas-controller-85bdf557cd-z4wtp"
Jul 13 15:32:17.670684 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:17.670557    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx95x\" (UniqueName: \"kubernetes.io/projected/9819fbbd-cfe4-4786-8016-137c9d37aef3-kube-api-access-qx95x\") pod \"maas-controller-85bdf557cd-z4wtp\" (UID: \"9819fbbd-cfe4-4786-8016-137c9d37aef3\") " pod="opendatahub/maas-controller-85bdf557cd-z4wtp"
Jul 13 15:32:17.707466 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:17.707438    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:32:17.761464 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:17.761433    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5496d869d5-dcljp"]
Jul 13 15:32:17.764981 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:17.764958    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5496d869d5-dcljp"
Jul 13 15:32:17.771281 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:17.771253    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx95x\" (UniqueName: \"kubernetes.io/projected/9819fbbd-cfe4-4786-8016-137c9d37aef3-kube-api-access-qx95x\") pod \"maas-controller-85bdf557cd-z4wtp\" (UID: \"9819fbbd-cfe4-4786-8016-137c9d37aef3\") " pod="opendatahub/maas-controller-85bdf557cd-z4wtp"
Jul 13 15:32:17.771771 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:17.771463    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9819fbbd-cfe4-4786-8016-137c9d37aef3-webhook-cert\") pod \"maas-controller-85bdf557cd-z4wtp\" (UID: \"9819fbbd-cfe4-4786-8016-137c9d37aef3\") " pod="opendatahub/maas-controller-85bdf557cd-z4wtp"
Jul 13 15:32:17.774068 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:17.774040    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5496d869d5-dcljp"]
Jul 13 15:32:17.774743 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:17.774720    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9819fbbd-cfe4-4786-8016-137c9d37aef3-webhook-cert\") pod \"maas-controller-85bdf557cd-z4wtp\" (UID: \"9819fbbd-cfe4-4786-8016-137c9d37aef3\") " pod="opendatahub/maas-controller-85bdf557cd-z4wtp"
Jul 13 15:32:17.776627 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:17.776574    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:32:17.779783 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:17.779759    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx95x\" (UniqueName: \"kubernetes.io/projected/9819fbbd-cfe4-4786-8016-137c9d37aef3-kube-api-access-qx95x\") pod \"maas-controller-85bdf557cd-z4wtp\" (UID: \"9819fbbd-cfe4-4786-8016-137c9d37aef3\") " pod="opendatahub/maas-controller-85bdf557cd-z4wtp"
Jul 13 15:32:17.872832 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:17.872753    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e48eb49a-0943-4363-a9bc-6b5c0cb02393-webhook-cert\") pod \"maas-controller-5496d869d5-dcljp\" (UID: \"e48eb49a-0943-4363-a9bc-6b5c0cb02393\") " pod="opendatahub/maas-controller-5496d869d5-dcljp"
Jul 13 15:32:17.872832 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:17.872793    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbnr4\" (UniqueName: \"kubernetes.io/projected/e48eb49a-0943-4363-a9bc-6b5c0cb02393-kube-api-access-fbnr4\") pod \"maas-controller-5496d869d5-dcljp\" (UID: \"e48eb49a-0943-4363-a9bc-6b5c0cb02393\") " pod="opendatahub/maas-controller-5496d869d5-dcljp"
Jul 13 15:32:17.928230 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:17.928195    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85bdf557cd-z4wtp"
Jul 13 15:32:17.973947 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:17.973912    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e48eb49a-0943-4363-a9bc-6b5c0cb02393-webhook-cert\") pod \"maas-controller-5496d869d5-dcljp\" (UID: \"e48eb49a-0943-4363-a9bc-6b5c0cb02393\") " pod="opendatahub/maas-controller-5496d869d5-dcljp"
Jul 13 15:32:17.974102 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:17.973958    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbnr4\" (UniqueName: \"kubernetes.io/projected/e48eb49a-0943-4363-a9bc-6b5c0cb02393-kube-api-access-fbnr4\") pod \"maas-controller-5496d869d5-dcljp\" (UID: \"e48eb49a-0943-4363-a9bc-6b5c0cb02393\") " pod="opendatahub/maas-controller-5496d869d5-dcljp"
Jul 13 15:32:17.977663 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:17.976928    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e48eb49a-0943-4363-a9bc-6b5c0cb02393-webhook-cert\") pod \"maas-controller-5496d869d5-dcljp\" (UID: \"e48eb49a-0943-4363-a9bc-6b5c0cb02393\") " pod="opendatahub/maas-controller-5496d869d5-dcljp"
Jul 13 15:32:17.984146 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:17.984086    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbnr4\" (UniqueName: \"kubernetes.io/projected/e48eb49a-0943-4363-a9bc-6b5c0cb02393-kube-api-access-fbnr4\") pod \"maas-controller-5496d869d5-dcljp\" (UID: \"e48eb49a-0943-4363-a9bc-6b5c0cb02393\") " pod="opendatahub/maas-controller-5496d869d5-dcljp"
Jul 13 15:32:18.063384 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:18.063359    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85bdf557cd-z4wtp"]
Jul 13 15:32:18.065373 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:32:18.065345    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9819fbbd_cfe4_4786_8016_137c9d37aef3.slice/crio-7428c7023f8444a8cce0f9118f3a89fd597435fd2a7c1cf24f69c42ba24aee65 WatchSource:0}: Error finding container 7428c7023f8444a8cce0f9118f3a89fd597435fd2a7c1cf24f69c42ba24aee65: Status 404 returned error can't find the container with id 7428c7023f8444a8cce0f9118f3a89fd597435fd2a7c1cf24f69c42ba24aee65
Jul 13 15:32:18.077077 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:18.077056    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5496d869d5-dcljp"
Jul 13 15:32:18.206659 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:18.206637    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5496d869d5-dcljp"]
Jul 13 15:32:18.208575 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:32:18.208550    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode48eb49a_0943_4363_a9bc_6b5c0cb02393.slice/crio-0c16eedb7c955a562480b9b33ad0d29c7492c9e1634c8a52da5e428c9b725ee6 WatchSource:0}: Error finding container 0c16eedb7c955a562480b9b33ad0d29c7492c9e1634c8a52da5e428c9b725ee6: Status 404 returned error can't find the container with id 0c16eedb7c955a562480b9b33ad0d29c7492c9e1634c8a52da5e428c9b725ee6
Jul 13 15:32:18.738127 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:18.738083    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5496d869d5-dcljp" event={"ID":"e48eb49a-0943-4363-a9bc-6b5c0cb02393","Type":"ContainerStarted","Data":"0c16eedb7c955a562480b9b33ad0d29c7492c9e1634c8a52da5e428c9b725ee6"}
Jul 13 15:32:18.739184 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:18.739160    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85bdf557cd-z4wtp" event={"ID":"9819fbbd-cfe4-4786-8016-137c9d37aef3","Type":"ContainerStarted","Data":"7428c7023f8444a8cce0f9118f3a89fd597435fd2a7c1cf24f69c42ba24aee65"}
Jul 13 15:32:21.233673 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:21.233639    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:32:21.340246 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:21.340146    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:32:21.759145 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:21.759092    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5496d869d5-dcljp" event={"ID":"e48eb49a-0943-4363-a9bc-6b5c0cb02393","Type":"ContainerStarted","Data":"a7db3d0aeb868edfcd7f83f54dd8823ebc657f5cbe7bc87cc106f51e05eac7f8"}
Jul 13 15:32:21.759431 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:21.759159    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5496d869d5-dcljp"
Jul 13 15:32:21.760714 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:21.760687    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85bdf557cd-z4wtp" event={"ID":"9819fbbd-cfe4-4786-8016-137c9d37aef3","Type":"ContainerStarted","Data":"111ceeb8c567d84dd8bab69b7552811782fef65c1272c6333518e2c2c0877db6"}
Jul 13 15:32:21.760807 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:21.760743    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-85bdf557cd-z4wtp"
Jul 13 15:32:21.781909 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:21.781862    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5496d869d5-dcljp" podStartSLOduration=1.953632896 podStartE2EDuration="4.781847832s" totalImagesPullingTime="2.828214936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:32:21.780051238 +0000 UTC m=+528.104773131" watchObservedRunningTime="2026-07-13 15:32:21.781847832 +0000 UTC m=+528.106569727"
Jul 13 15:32:21.800394 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:21.800342    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-85bdf557cd-z4wtp" podStartSLOduration=1.81957299 podStartE2EDuration="4.800326583s" totalImagesPullingTime="2.980753593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:32:21.799571086 +0000 UTC m=+528.124292985" watchObservedRunningTime="2026-07-13 15:32:21.800326583 +0000 UTC m=+528.125048479"
Jul 13 15:32:32.766870 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:32.766783    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-85bdf557cd-z4wtp"
Jul 13 15:32:32.766870 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:32.766856    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5496d869d5-dcljp"
Jul 13 15:32:32.828407 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:32.828365    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85bdf557cd-z4wtp"]
Jul 13 15:32:32.828659 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:32.828633    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-85bdf557cd-z4wtp" podUID="9819fbbd-cfe4-4786-8016-137c9d37aef3" containerName="manager" containerID="cri-o://111ceeb8c567d84dd8bab69b7552811782fef65c1272c6333518e2c2c0877db6" gracePeriod=30
Jul 13 15:32:33.091037 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:33.091015    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85bdf557cd-z4wtp"
Jul 13 15:32:33.206045 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:33.206018    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9819fbbd-cfe4-4786-8016-137c9d37aef3-webhook-cert\") pod \"9819fbbd-cfe4-4786-8016-137c9d37aef3\" (UID: \"9819fbbd-cfe4-4786-8016-137c9d37aef3\") "
Jul 13 15:32:33.206045 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:33.206050    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qx95x\" (UniqueName: \"kubernetes.io/projected/9819fbbd-cfe4-4786-8016-137c9d37aef3-kube-api-access-qx95x\") pod \"9819fbbd-cfe4-4786-8016-137c9d37aef3\" (UID: \"9819fbbd-cfe4-4786-8016-137c9d37aef3\") "
Jul 13 15:32:33.208204 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:33.208179    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9819fbbd-cfe4-4786-8016-137c9d37aef3-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9819fbbd-cfe4-4786-8016-137c9d37aef3" (UID: "9819fbbd-cfe4-4786-8016-137c9d37aef3"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 15:32:33.208299 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:33.208224    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9819fbbd-cfe4-4786-8016-137c9d37aef3-kube-api-access-qx95x" (OuterVolumeSpecName: "kube-api-access-qx95x") pod "9819fbbd-cfe4-4786-8016-137c9d37aef3" (UID: "9819fbbd-cfe4-4786-8016-137c9d37aef3"). InnerVolumeSpecName "kube-api-access-qx95x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:32:33.307180 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:33.307143    2555 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9819fbbd-cfe4-4786-8016-137c9d37aef3-webhook-cert\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:32:33.307180 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:33.307173    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qx95x\" (UniqueName: \"kubernetes.io/projected/9819fbbd-cfe4-4786-8016-137c9d37aef3-kube-api-access-qx95x\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:32:33.814289 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:33.814257    2555 generic.go:356] "Generic (PLEG): container finished" podID="9819fbbd-cfe4-4786-8016-137c9d37aef3" containerID="111ceeb8c567d84dd8bab69b7552811782fef65c1272c6333518e2c2c0877db6" exitCode=0
Jul 13 15:32:33.814760 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:33.814299    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85bdf557cd-z4wtp"
Jul 13 15:32:33.814760 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:33.814307    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85bdf557cd-z4wtp" event={"ID":"9819fbbd-cfe4-4786-8016-137c9d37aef3","Type":"ContainerDied","Data":"111ceeb8c567d84dd8bab69b7552811782fef65c1272c6333518e2c2c0877db6"}
Jul 13 15:32:33.814760 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:33.814346    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85bdf557cd-z4wtp" event={"ID":"9819fbbd-cfe4-4786-8016-137c9d37aef3","Type":"ContainerDied","Data":"7428c7023f8444a8cce0f9118f3a89fd597435fd2a7c1cf24f69c42ba24aee65"}
Jul 13 15:32:33.814760 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:33.814367    2555 scope.go:117] "RemoveContainer" containerID="111ceeb8c567d84dd8bab69b7552811782fef65c1272c6333518e2c2c0877db6"
Jul 13 15:32:33.823135 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:33.823116    2555 scope.go:117] "RemoveContainer" containerID="111ceeb8c567d84dd8bab69b7552811782fef65c1272c6333518e2c2c0877db6"
Jul 13 15:32:33.823380 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:32:33.823362    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"111ceeb8c567d84dd8bab69b7552811782fef65c1272c6333518e2c2c0877db6\": container with ID starting with 111ceeb8c567d84dd8bab69b7552811782fef65c1272c6333518e2c2c0877db6 not found: ID does not exist" containerID="111ceeb8c567d84dd8bab69b7552811782fef65c1272c6333518e2c2c0877db6"
Jul 13 15:32:33.823421 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:33.823387    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"111ceeb8c567d84dd8bab69b7552811782fef65c1272c6333518e2c2c0877db6"} err="failed to get container status \"111ceeb8c567d84dd8bab69b7552811782fef65c1272c6333518e2c2c0877db6\": rpc error: code = NotFound desc = could not find container \"111ceeb8c567d84dd8bab69b7552811782fef65c1272c6333518e2c2c0877db6\": container with ID starting with 111ceeb8c567d84dd8bab69b7552811782fef65c1272c6333518e2c2c0877db6 not found: ID does not exist"
Jul 13 15:32:33.834836 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:33.834816    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85bdf557cd-z4wtp"]
Jul 13 15:32:33.838955 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:33.838936    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-85bdf557cd-z4wtp"]
Jul 13 15:32:34.204092 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:34.204057    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9819fbbd-cfe4-4786-8016-137c9d37aef3" path="/var/lib/kubelet/pods/9819fbbd-cfe4-4786-8016-137c9d37aef3/volumes"
Jul 13 15:32:52.784426 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:52.784357    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:32:52.883065 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:52.883026    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:32:53.381912 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:53.381881    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:32:53.411909 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:53.411874    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-56464bcd74-jqhlb"]
Jul 13 15:32:53.412204 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:53.412192    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9819fbbd-cfe4-4786-8016-137c9d37aef3" containerName="manager"
Jul 13 15:32:53.412262 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:53.412205    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="9819fbbd-cfe4-4786-8016-137c9d37aef3" containerName="manager"
Jul 13 15:32:53.412317 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:53.412293    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="9819fbbd-cfe4-4786-8016-137c9d37aef3" containerName="manager"
Jul 13 15:32:53.418668 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:53.418646    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-56464bcd74-jqhlb"
Jul 13 15:32:53.421120 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:53.421088    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 13 15:32:53.427700 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:53.427676    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-56464bcd74-jqhlb"]
Jul 13 15:32:53.580223 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:53.580184    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/740c0bcf-fad9-4e4d-bf80-ef2d84c32043-openshift-service-ca\") pod \"maas-api-56464bcd74-jqhlb\" (UID: \"740c0bcf-fad9-4e4d-bf80-ef2d84c32043\") " pod="odh-ai-gateway-infra/maas-api-56464bcd74-jqhlb"
Jul 13 15:32:53.580381 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:53.580270    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/740c0bcf-fad9-4e4d-bf80-ef2d84c32043-maas-api-tls\") pod \"maas-api-56464bcd74-jqhlb\" (UID: \"740c0bcf-fad9-4e4d-bf80-ef2d84c32043\") " pod="odh-ai-gateway-infra/maas-api-56464bcd74-jqhlb"
Jul 13 15:32:53.580381 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:53.580300    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42qg4\" (UniqueName: \"kubernetes.io/projected/740c0bcf-fad9-4e4d-bf80-ef2d84c32043-kube-api-access-42qg4\") pod \"maas-api-56464bcd74-jqhlb\" (UID: \"740c0bcf-fad9-4e4d-bf80-ef2d84c32043\") " pod="odh-ai-gateway-infra/maas-api-56464bcd74-jqhlb"
Jul 13 15:32:53.643181 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:53.643078    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:32:53.681368 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:53.681331    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/740c0bcf-fad9-4e4d-bf80-ef2d84c32043-maas-api-tls\") pod \"maas-api-56464bcd74-jqhlb\" (UID: \"740c0bcf-fad9-4e4d-bf80-ef2d84c32043\") " pod="odh-ai-gateway-infra/maas-api-56464bcd74-jqhlb"
Jul 13 15:32:53.681561 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:53.681465    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42qg4\" (UniqueName: \"kubernetes.io/projected/740c0bcf-fad9-4e4d-bf80-ef2d84c32043-kube-api-access-42qg4\") pod \"maas-api-56464bcd74-jqhlb\" (UID: \"740c0bcf-fad9-4e4d-bf80-ef2d84c32043\") " pod="odh-ai-gateway-infra/maas-api-56464bcd74-jqhlb"
Jul 13 15:32:53.681677 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:53.681579    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/740c0bcf-fad9-4e4d-bf80-ef2d84c32043-openshift-service-ca\") pod \"maas-api-56464bcd74-jqhlb\" (UID: \"740c0bcf-fad9-4e4d-bf80-ef2d84c32043\") " pod="odh-ai-gateway-infra/maas-api-56464bcd74-jqhlb"
Jul 13 15:32:53.682326 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:53.682301    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/740c0bcf-fad9-4e4d-bf80-ef2d84c32043-openshift-service-ca\") pod \"maas-api-56464bcd74-jqhlb\" (UID: \"740c0bcf-fad9-4e4d-bf80-ef2d84c32043\") " pod="odh-ai-gateway-infra/maas-api-56464bcd74-jqhlb"
Jul 13 15:32:53.684036 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:53.684013    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/740c0bcf-fad9-4e4d-bf80-ef2d84c32043-maas-api-tls\") pod \"maas-api-56464bcd74-jqhlb\" (UID: \"740c0bcf-fad9-4e4d-bf80-ef2d84c32043\") " pod="odh-ai-gateway-infra/maas-api-56464bcd74-jqhlb"
Jul 13 15:32:53.689781 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:53.689760    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42qg4\" (UniqueName: \"kubernetes.io/projected/740c0bcf-fad9-4e4d-bf80-ef2d84c32043-kube-api-access-42qg4\") pod \"maas-api-56464bcd74-jqhlb\" (UID: \"740c0bcf-fad9-4e4d-bf80-ef2d84c32043\") " pod="odh-ai-gateway-infra/maas-api-56464bcd74-jqhlb"
Jul 13 15:32:53.730539 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:53.730510    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-56464bcd74-jqhlb"
Jul 13 15:32:53.852822 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:53.852770    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:32:53.876634 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:53.876545    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-56464bcd74-jqhlb"]
Jul 13 15:32:53.879662 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:32:53.879632    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod740c0bcf_fad9_4e4d_bf80_ef2d84c32043.slice/crio-a79fbfa063c4200c347f297859e9618fe00d968484130b4083bd8be22afa8a53 WatchSource:0}: Error finding container a79fbfa063c4200c347f297859e9618fe00d968484130b4083bd8be22afa8a53: Status 404 returned error can't find the container with id a79fbfa063c4200c347f297859e9618fe00d968484130b4083bd8be22afa8a53
Jul 13 15:32:53.909895 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:53.909816    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-56464bcd74-jqhlb" event={"ID":"740c0bcf-fad9-4e4d-bf80-ef2d84c32043","Type":"ContainerStarted","Data":"a79fbfa063c4200c347f297859e9618fe00d968484130b4083bd8be22afa8a53"}
Jul 13 15:32:53.942558 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:53.942519    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-v44pf"]
Jul 13 15:32:53.946930 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:53.946908    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-v44pf"
Jul 13 15:32:53.947057 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:53.946915    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:32:53.949372 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:53.949355    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 13 15:32:53.955357 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:53.955337    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-v44pf"]
Jul 13 15:32:53.989752 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:53.989724    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-vgnll"]
Jul 13 15:32:53.992906 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:53.992890    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-vgnll"
Jul 13 15:32:53.995258 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:53.995240    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-4mn7w\""
Jul 13 15:32:54.004857 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:54.004834    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-vgnll"]
Jul 13 15:32:54.085466 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:54.085443    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9b4ww\" (UniqueName: \"kubernetes.io/projected/e2534dc7-b5b4-41c0-b6ad-51f586e19a2e-kube-api-access-9b4ww\") pod \"payload-processing-f9b8d9b9b-vgnll\" (UID: \"e2534dc7-b5b4-41c0-b6ad-51f586e19a2e\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-vgnll"
Jul 13 15:32:54.085637 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:54.085486    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh7b8\" (UniqueName: \"kubernetes.io/projected/a07c4115-54c4-430b-9242-2262c8fa63f5-kube-api-access-vh7b8\") pod \"payload-pre-processing-74584bb9f8-v44pf\" (UID: \"a07c4115-54c4-430b-9242-2262c8fa63f5\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-v44pf"
Jul 13 15:32:54.085637 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:54.085511    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a07c4115-54c4-430b-9242-2262c8fa63f5-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-v44pf\" (UID: \"a07c4115-54c4-430b-9242-2262c8fa63f5\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-v44pf"
Jul 13 15:32:54.085718 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:54.085649    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2534dc7-b5b4-41c0-b6ad-51f586e19a2e-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-vgnll\" (UID: \"e2534dc7-b5b4-41c0-b6ad-51f586e19a2e\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-vgnll"
Jul 13 15:32:54.186891 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:54.186807    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh7b8\" (UniqueName: \"kubernetes.io/projected/a07c4115-54c4-430b-9242-2262c8fa63f5-kube-api-access-vh7b8\") pod \"payload-pre-processing-74584bb9f8-v44pf\" (UID: \"a07c4115-54c4-430b-9242-2262c8fa63f5\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-v44pf"
Jul 13 15:32:54.186891 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:54.186851    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a07c4115-54c4-430b-9242-2262c8fa63f5-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-v44pf\" (UID: \"a07c4115-54c4-430b-9242-2262c8fa63f5\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-v44pf"
Jul 13 15:32:54.187346 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:54.186898    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2534dc7-b5b4-41c0-b6ad-51f586e19a2e-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-vgnll\" (UID: \"e2534dc7-b5b4-41c0-b6ad-51f586e19a2e\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-vgnll"
Jul 13 15:32:54.187346 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:54.186942    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b4ww\" (UniqueName: \"kubernetes.io/projected/e2534dc7-b5b4-41c0-b6ad-51f586e19a2e-kube-api-access-9b4ww\") pod \"payload-processing-f9b8d9b9b-vgnll\" (UID: \"e2534dc7-b5b4-41c0-b6ad-51f586e19a2e\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-vgnll"
Jul 13 15:32:54.187794 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:54.187770    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2534dc7-b5b4-41c0-b6ad-51f586e19a2e-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-vgnll\" (UID: \"e2534dc7-b5b4-41c0-b6ad-51f586e19a2e\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-vgnll"
Jul 13 15:32:54.187891 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:54.187803    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a07c4115-54c4-430b-9242-2262c8fa63f5-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-v44pf\" (UID: \"a07c4115-54c4-430b-9242-2262c8fa63f5\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-v44pf"
Jul 13 15:32:54.198664 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:54.198639    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b4ww\" (UniqueName: \"kubernetes.io/projected/e2534dc7-b5b4-41c0-b6ad-51f586e19a2e-kube-api-access-9b4ww\") pod \"payload-processing-f9b8d9b9b-vgnll\" (UID: \"e2534dc7-b5b4-41c0-b6ad-51f586e19a2e\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-vgnll"
Jul 13 15:32:54.199215 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:54.199194    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh7b8\" (UniqueName: \"kubernetes.io/projected/a07c4115-54c4-430b-9242-2262c8fa63f5-kube-api-access-vh7b8\") pod \"payload-pre-processing-74584bb9f8-v44pf\" (UID: \"a07c4115-54c4-430b-9242-2262c8fa63f5\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-v44pf"
Jul 13 15:32:54.258124 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:54.258094    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-v44pf"
Jul 13 15:32:54.303060 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:54.303032    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-vgnll"
Jul 13 15:32:54.403940 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:54.403912    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-v44pf"]
Jul 13 15:32:54.408936 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:32:54.408893    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda07c4115_54c4_430b_9242_2262c8fa63f5.slice/crio-1edc22a5909e92eea1065c9e90f8948690e2a7e24ea7dc28355b6ef4b01e9ee9 WatchSource:0}: Error finding container 1edc22a5909e92eea1065c9e90f8948690e2a7e24ea7dc28355b6ef4b01e9ee9: Status 404 returned error can't find the container with id 1edc22a5909e92eea1065c9e90f8948690e2a7e24ea7dc28355b6ef4b01e9ee9
Jul 13 15:32:54.456032 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:54.455975    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-vgnll"]
Jul 13 15:32:54.458321 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:32:54.458290    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2534dc7_b5b4_41c0_b6ad_51f586e19a2e.slice/crio-f8cc0649e4f0ef52adc1b2291aac523fc0a839f6616a541f3bbcc76366914df4 WatchSource:0}: Error finding container f8cc0649e4f0ef52adc1b2291aac523fc0a839f6616a541f3bbcc76366914df4: Status 404 returned error can't find the container with id f8cc0649e4f0ef52adc1b2291aac523fc0a839f6616a541f3bbcc76366914df4
Jul 13 15:32:54.917009 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:54.916944    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-v44pf" event={"ID":"a07c4115-54c4-430b-9242-2262c8fa63f5","Type":"ContainerStarted","Data":"1edc22a5909e92eea1065c9e90f8948690e2a7e24ea7dc28355b6ef4b01e9ee9"}
Jul 13 15:32:54.918392 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:54.918363    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-vgnll" event={"ID":"e2534dc7-b5b4-41c0-b6ad-51f586e19a2e","Type":"ContainerStarted","Data":"f8cc0649e4f0ef52adc1b2291aac523fc0a839f6616a541f3bbcc76366914df4"}
Jul 13 15:32:56.931705 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:56.931626    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-56464bcd74-jqhlb" event={"ID":"740c0bcf-fad9-4e4d-bf80-ef2d84c32043","Type":"ContainerStarted","Data":"c5f619372ed7e6cfc13987b69429bc76c47d79d1b145a519d6fb99417ef808a7"}
Jul 13 15:32:56.932066 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:56.931749    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-56464bcd74-jqhlb"
Jul 13 15:32:56.933415 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:56.933390    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-v44pf" event={"ID":"a07c4115-54c4-430b-9242-2262c8fa63f5","Type":"ContainerStarted","Data":"d991190076d15ac1ed0cc0f132a457eff7283b5525e4edf2ee6fae7c749df556"}
Jul 13 15:32:56.933566 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:56.933466    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-v44pf"
Jul 13 15:32:56.934820 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:56.934800    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-vgnll" event={"ID":"e2534dc7-b5b4-41c0-b6ad-51f586e19a2e","Type":"ContainerStarted","Data":"85493e0d818f4d591a878127ec03336567e7097ecf661411870b4e61e15c4d04"}
Jul 13 15:32:56.934924 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:56.934845    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-vgnll"
Jul 13 15:32:56.951873 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:56.951833    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-56464bcd74-jqhlb" podStartSLOduration=1.520264616 podStartE2EDuration="3.951820683s" totalImagesPullingTime="2.431556067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:32:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:32:56.950839106 +0000 UTC m=+563.275561002" watchObservedRunningTime="2026-07-13 15:32:56.951820683 +0000 UTC m=+563.276542606"
Jul 13 15:32:56.970616 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:56.970548    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-vgnll" podStartSLOduration=2.117870382 podStartE2EDuration="3.970530154s" totalImagesPullingTime="1.852659772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:32:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:32:56.967874157 +0000 UTC m=+563.292596054" watchObservedRunningTime="2026-07-13 15:32:56.970530154 +0000 UTC m=+563.295252051"
Jul 13 15:32:56.988138 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:32:56.988074    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-v44pf" podStartSLOduration=2.082721498 podStartE2EDuration="3.988054473s" totalImagesPullingTime="1.905332975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:32:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:32:56.986875639 +0000 UTC m=+563.311597537" watchObservedRunningTime="2026-07-13 15:32:56.988054473 +0000 UTC m=+563.312776369"
Jul 13 15:33:01.481023 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:01.480983    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:33:01.962660 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:01.962542    2555 generic.go:356] "Generic (PLEG): container finished" podID="f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48" containerID="011820b8a46074b9ff478fbece783ca17f6a86b8017cbc49954539f87d4d7faf" exitCode=0
Jul 13 15:33:01.962660 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:01.962624    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm" event={"ID":"f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48","Type":"ContainerDied","Data":"011820b8a46074b9ff478fbece783ca17f6a86b8017cbc49954539f87d4d7faf"}
Jul 13 15:33:01.963041 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:01.963027    2555 scope.go:117] "RemoveContainer" containerID="011820b8a46074b9ff478fbece783ca17f6a86b8017cbc49954539f87d4d7faf"
Jul 13 15:33:01.963984 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:01.963955    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 15:33:01.964046 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:01.964024    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 15:33:01.964099 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:01.964055    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 15:33:02.945511 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:02.945482    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-56464bcd74-jqhlb"
Jul 13 15:33:02.989613 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:02.989437    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm" event={"ID":"f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48","Type":"ContainerStarted","Data":"cf3d65b1faa77640968fda92d59a6a979aa683fcd51548a7c8193ec34b4d76b7"}
Jul 13 15:33:03.088822 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:03.088783    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm"
Jul 13 15:33:03.089077 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:03.089049    2555 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-b5pfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 13 15:33:03.089272 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:03.089247    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm" podUID="f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 13 15:33:04.084740 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:04.084695    2555 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-b5pfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 13 15:33:04.085259 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:04.084764    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm" podUID="f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 13 15:33:04.456273 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:04.456177    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:33:04.555924 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:04.555876    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:33:05.084942 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:05.084900    2555 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-b5pfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 13 15:33:05.085544 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:05.085509    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm" podUID="f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 13 15:33:06.084517 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:06.084475    2555 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-b5pfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 13 15:33:06.084834 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:06.084798    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm" podUID="f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 13 15:33:07.088169 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:07.088140    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm"
Jul 13 15:33:07.088580 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:07.088499    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm"
Jul 13 15:33:07.089282 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:07.089262    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b5pfm"
Jul 13 15:33:07.941765 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:07.941736    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-vgnll"
Jul 13 15:33:07.941973 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:07.941803    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-v44pf"
Jul 13 15:33:22.499103 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:22.499072    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:33:23.183512 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:23.183474    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:33:34.143004 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:34.142974    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cptrx_90f53326-a36e-4682-a268-bdfec7cf722b/console-operator/1.log"
Jul 13 15:33:34.143543 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:34.142975    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cptrx_90f53326-a36e-4682-a268-bdfec7cf722b/console-operator/1.log"
Jul 13 15:33:34.151838 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:34.151815    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x8g52_f4724159-d88b-4ed1-a5fc-956a4d1e3fe8/ovn-acl-logging/0.log"
Jul 13 15:33:34.151960 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:34.151823    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x8g52_f4724159-d88b-4ed1-a5fc-956a4d1e3fe8/ovn-acl-logging/0.log"
Jul 13 15:33:39.730872 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:39.730833    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-r6jfq"]
Jul 13 15:33:39.736845 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:39.736819    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6jfq"
Jul 13 15:33:39.739414 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:39.739391    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 13 15:33:39.739558 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:39.739492    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tl4pf\""
Jul 13 15:33:39.740035 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:39.740020    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 13 15:33:39.740219 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:39.740201    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 13 15:33:39.746841 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:39.746819    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-r6jfq"]
Jul 13 15:33:39.758340 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:39.758306    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:33:39.905388 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:39.905359    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be3ab37b-024d-4948-9786-9b64fe90cbd0-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r6jfq\" (UID: \"be3ab37b-024d-4948-9786-9b64fe90cbd0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6jfq"
Jul 13 15:33:39.905388 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:39.905388    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be3ab37b-024d-4948-9786-9b64fe90cbd0-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r6jfq\" (UID: \"be3ab37b-024d-4948-9786-9b64fe90cbd0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6jfq"
Jul 13 15:33:39.905667 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:39.905408    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be3ab37b-024d-4948-9786-9b64fe90cbd0-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r6jfq\" (UID: \"be3ab37b-024d-4948-9786-9b64fe90cbd0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6jfq"
Jul 13 15:33:39.905667 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:39.905429    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be3ab37b-024d-4948-9786-9b64fe90cbd0-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r6jfq\" (UID: \"be3ab37b-024d-4948-9786-9b64fe90cbd0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6jfq"
Jul 13 15:33:39.905667 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:39.905537    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4b82\" (UniqueName: \"kubernetes.io/projected/be3ab37b-024d-4948-9786-9b64fe90cbd0-kube-api-access-d4b82\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r6jfq\" (UID: \"be3ab37b-024d-4948-9786-9b64fe90cbd0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6jfq"
Jul 13 15:33:39.905667 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:39.905614    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be3ab37b-024d-4948-9786-9b64fe90cbd0-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r6jfq\" (UID: \"be3ab37b-024d-4948-9786-9b64fe90cbd0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6jfq"
Jul 13 15:33:40.006622 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:40.006526    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4b82\" (UniqueName: \"kubernetes.io/projected/be3ab37b-024d-4948-9786-9b64fe90cbd0-kube-api-access-d4b82\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r6jfq\" (UID: \"be3ab37b-024d-4948-9786-9b64fe90cbd0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6jfq"
Jul 13 15:33:40.006622 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:40.006611    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be3ab37b-024d-4948-9786-9b64fe90cbd0-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r6jfq\" (UID: \"be3ab37b-024d-4948-9786-9b64fe90cbd0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6jfq"
Jul 13 15:33:40.006797 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:40.006663    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be3ab37b-024d-4948-9786-9b64fe90cbd0-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r6jfq\" (UID: \"be3ab37b-024d-4948-9786-9b64fe90cbd0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6jfq"
Jul 13 15:33:40.006797 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:40.006678    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be3ab37b-024d-4948-9786-9b64fe90cbd0-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r6jfq\" (UID: \"be3ab37b-024d-4948-9786-9b64fe90cbd0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6jfq"
Jul 13 15:33:40.006797 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:40.006694    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be3ab37b-024d-4948-9786-9b64fe90cbd0-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r6jfq\" (UID: \"be3ab37b-024d-4948-9786-9b64fe90cbd0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6jfq"
Jul 13 15:33:40.006797 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:40.006710    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be3ab37b-024d-4948-9786-9b64fe90cbd0-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r6jfq\" (UID: \"be3ab37b-024d-4948-9786-9b64fe90cbd0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6jfq"
Jul 13 15:33:40.007186 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:40.007161    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be3ab37b-024d-4948-9786-9b64fe90cbd0-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r6jfq\" (UID: \"be3ab37b-024d-4948-9786-9b64fe90cbd0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6jfq"
Jul 13 15:33:40.007244 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:40.007177    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be3ab37b-024d-4948-9786-9b64fe90cbd0-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r6jfq\" (UID: \"be3ab37b-024d-4948-9786-9b64fe90cbd0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6jfq"
Jul 13 15:33:40.007244 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:40.007207    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be3ab37b-024d-4948-9786-9b64fe90cbd0-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r6jfq\" (UID: \"be3ab37b-024d-4948-9786-9b64fe90cbd0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6jfq"
Jul 13 15:33:40.008974 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:40.008947    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be3ab37b-024d-4948-9786-9b64fe90cbd0-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r6jfq\" (UID: \"be3ab37b-024d-4948-9786-9b64fe90cbd0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6jfq"
Jul 13 15:33:40.009265 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:40.009246    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be3ab37b-024d-4948-9786-9b64fe90cbd0-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r6jfq\" (UID: \"be3ab37b-024d-4948-9786-9b64fe90cbd0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6jfq"
Jul 13 15:33:40.015072 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:40.015053    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4b82\" (UniqueName: \"kubernetes.io/projected/be3ab37b-024d-4948-9786-9b64fe90cbd0-kube-api-access-d4b82\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r6jfq\" (UID: \"be3ab37b-024d-4948-9786-9b64fe90cbd0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6jfq"
Jul 13 15:33:40.049219 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:40.049193    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6jfq"
Jul 13 15:33:40.182863 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:40.182840    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-r6jfq"]
Jul 13 15:33:40.184490 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:33:40.184462    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe3ab37b_024d_4948_9786_9b64fe90cbd0.slice/crio-c2eb4dc02c5db32fabeec2a777b81bb5634a3f77818270543db0b953c189bbd1 WatchSource:0}: Error finding container c2eb4dc02c5db32fabeec2a777b81bb5634a3f77818270543db0b953c189bbd1: Status 404 returned error can't find the container with id c2eb4dc02c5db32fabeec2a777b81bb5634a3f77818270543db0b953c189bbd1
Jul 13 15:33:40.185691 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:40.185675    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 15:33:41.172764 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:41.172725    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6jfq" event={"ID":"be3ab37b-024d-4948-9786-9b64fe90cbd0","Type":"ContainerStarted","Data":"c2eb4dc02c5db32fabeec2a777b81bb5634a3f77818270543db0b953c189bbd1"}
Jul 13 15:33:42.178519 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:42.178483    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6jfq" event={"ID":"be3ab37b-024d-4948-9786-9b64fe90cbd0","Type":"ContainerStarted","Data":"0d678ace75614d037f50428da762e57ce9ea497a02e91f472bc3692a093dead1"}
Jul 13 15:33:42.199561 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:42.199497    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6jfq" podStartSLOduration=2.032337253 podStartE2EDuration="3.199478683s" totalImagesPullingTime="1.16714143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:33:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:33:42.198884422 +0000 UTC m=+608.523606321" watchObservedRunningTime="2026-07-13 15:33:42.199478683 +0000 UTC m=+608.524200582"
Jul 13 15:33:44.294797 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:44.294762    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:33:44.352566 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:44.352537    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:33:46.072092 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:46.072053    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:33:46.124797 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:46.124768    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:33:50.050338 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:50.050297    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6jfq"
Jul 13 15:33:50.050751 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:50.050368    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6jfq"
Jul 13 15:33:50.062879 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:50.062849    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6jfq"
Jul 13 15:33:50.225341 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:50.225308    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r6jfq"
Jul 13 15:33:52.351186 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:33:52.351148    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:34:00.080810 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:34:00.080725    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:34:14.141853 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:34:14.141814    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:34:22.136140 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:34:22.136105    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-wxzls"]
Jul 13 15:34:22.141238 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:34:22.141214    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wxzls"
Jul 13 15:34:22.143762 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:34:22.143741    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 13 15:34:22.150595 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:34:22.150563    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-wxzls"]
Jul 13 15:34:22.156258 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:34:22.156233    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:34:22.279717 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:34:22.279680    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fjxf\" (UniqueName: \"kubernetes.io/projected/2ba9aeef-321d-4d06-9c95-8532ac1c2934-kube-api-access-2fjxf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wxzls\" (UID: \"2ba9aeef-321d-4d06-9c95-8532ac1c2934\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wxzls"
Jul 13 15:34:22.279717 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:34:22.279720    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ba9aeef-321d-4d06-9c95-8532ac1c2934-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wxzls\" (UID: \"2ba9aeef-321d-4d06-9c95-8532ac1c2934\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wxzls"
Jul 13 15:34:22.279954 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:34:22.279747    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ba9aeef-321d-4d06-9c95-8532ac1c2934-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wxzls\" (UID: \"2ba9aeef-321d-4d06-9c95-8532ac1c2934\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wxzls"
Jul 13 15:34:22.279954 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:34:22.279836    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ba9aeef-321d-4d06-9c95-8532ac1c2934-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wxzls\" (UID: \"2ba9aeef-321d-4d06-9c95-8532ac1c2934\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wxzls"
Jul 13 15:34:22.279954 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:34:22.279864    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ba9aeef-321d-4d06-9c95-8532ac1c2934-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wxzls\" (UID: \"2ba9aeef-321d-4d06-9c95-8532ac1c2934\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wxzls"
Jul 13 15:34:22.279954 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:34:22.279933    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ba9aeef-321d-4d06-9c95-8532ac1c2934-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wxzls\" (UID: \"2ba9aeef-321d-4d06-9c95-8532ac1c2934\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wxzls"
Jul 13 15:34:22.381240 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:34:22.381213    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ba9aeef-321d-4d06-9c95-8532ac1c2934-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wxzls\" (UID: \"2ba9aeef-321d-4d06-9c95-8532ac1c2934\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wxzls"
Jul 13 15:34:22.381371 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:34:22.381247    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ba9aeef-321d-4d06-9c95-8532ac1c2934-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wxzls\" (UID: \"2ba9aeef-321d-4d06-9c95-8532ac1c2934\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wxzls"
Jul 13 15:34:22.381371 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:34:22.381286    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ba9aeef-321d-4d06-9c95-8532ac1c2934-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wxzls\" (UID: \"2ba9aeef-321d-4d06-9c95-8532ac1c2934\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wxzls"
Jul 13 15:34:22.381464 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:34:22.381392    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fjxf\" (UniqueName: \"kubernetes.io/projected/2ba9aeef-321d-4d06-9c95-8532ac1c2934-kube-api-access-2fjxf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wxzls\" (UID: \"2ba9aeef-321d-4d06-9c95-8532ac1c2934\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wxzls"
Jul 13 15:34:22.381849 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:34:22.381452    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ba9aeef-321d-4d06-9c95-8532ac1c2934-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wxzls\" (UID: \"2ba9aeef-321d-4d06-9c95-8532ac1c2934\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wxzls"
Jul 13 15:34:22.381991 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:34:22.381888    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ba9aeef-321d-4d06-9c95-8532ac1c2934-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wxzls\" (UID: \"2ba9aeef-321d-4d06-9c95-8532ac1c2934\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wxzls"
Jul 13 15:34:22.382118 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:34:22.381894    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ba9aeef-321d-4d06-9c95-8532ac1c2934-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wxzls\" (UID: \"2ba9aeef-321d-4d06-9c95-8532ac1c2934\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wxzls"
Jul 13 15:34:22.382335 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:34:22.382161    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ba9aeef-321d-4d06-9c95-8532ac1c2934-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wxzls\" (UID: \"2ba9aeef-321d-4d06-9c95-8532ac1c2934\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wxzls"
Jul 13 15:34:22.382464 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:34:22.382213    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ba9aeef-321d-4d06-9c95-8532ac1c2934-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wxzls\" (UID: \"2ba9aeef-321d-4d06-9c95-8532ac1c2934\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wxzls"
Jul 13 15:34:22.384693 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:34:22.384669    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ba9aeef-321d-4d06-9c95-8532ac1c2934-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wxzls\" (UID: \"2ba9aeef-321d-4d06-9c95-8532ac1c2934\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wxzls"
Jul 13 15:34:22.389355 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:34:22.389302    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ba9aeef-321d-4d06-9c95-8532ac1c2934-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wxzls\" (UID: \"2ba9aeef-321d-4d06-9c95-8532ac1c2934\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wxzls"
Jul 13 15:34:22.392012 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:34:22.391988    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fjxf\" (UniqueName: \"kubernetes.io/projected/2ba9aeef-321d-4d06-9c95-8532ac1c2934-kube-api-access-2fjxf\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wxzls\" (UID: \"2ba9aeef-321d-4d06-9c95-8532ac1c2934\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wxzls"
Jul 13 15:34:22.452886 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:34:22.452862    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wxzls"
Jul 13 15:34:22.587758 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:34:22.587733    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-wxzls"]
Jul 13 15:34:22.590013 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:34:22.589986    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ba9aeef_321d_4d06_9c95_8532ac1c2934.slice/crio-56e0d9a44e5f50b4c3f635e6bb701e06dd073481cf5679acb55abdb9fc31285b WatchSource:0}: Error finding container 56e0d9a44e5f50b4c3f635e6bb701e06dd073481cf5679acb55abdb9fc31285b: Status 404 returned error can't find the container with id 56e0d9a44e5f50b4c3f635e6bb701e06dd073481cf5679acb55abdb9fc31285b
Jul 13 15:34:23.364115 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:34:23.364083    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wxzls" event={"ID":"2ba9aeef-321d-4d06-9c95-8532ac1c2934","Type":"ContainerStarted","Data":"19ca19dce94aded23cc6dd934b4d6d3602854f9fd2ba1df36cbbc7f5dd2cca53"}
Jul 13 15:34:23.364499 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:34:23.364132    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wxzls" event={"ID":"2ba9aeef-321d-4d06-9c95-8532ac1c2934","Type":"ContainerStarted","Data":"56e0d9a44e5f50b4c3f635e6bb701e06dd073481cf5679acb55abdb9fc31285b"}
Jul 13 15:34:32.453628 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:34:32.453574    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wxzls"
Jul 13 15:34:32.454136 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:34:32.453656    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wxzls"
Jul 13 15:34:32.466464 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:34:32.466424    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wxzls"
Jul 13 15:34:32.484834 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:34:32.484789    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wxzls" podStartSLOduration=10.305121229 podStartE2EDuration="10.484771561s" totalImagesPullingTime="179.650332ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:34:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:34:23.382677802 +0000 UTC m=+649.707399700" watchObservedRunningTime="2026-07-13 15:34:32.484771561 +0000 UTC m=+658.809493459"
Jul 13 15:34:33.423580 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:34:33.423552    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wxzls"
Jul 13 15:34:49.477673 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:34:49.477634    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:36:07.835037 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:36:07.834993    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:36:07.906844 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:36:07.906804    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:36:08.690616 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:36:08.690572    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-65f956d9c5-h7sdk"]
Jul 13 15:36:08.690804 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:36:08.690782    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-65f956d9c5-h7sdk" podUID="8a4090c4-92f5-44b0-a8fe-b90df7ab72b3" containerName="authorino" containerID="cri-o://444df9c29970f9bb2dbf8c5e74cc7830248a7442f8584fa8f9fd2ce742a187f6" gracePeriod=30
Jul 13 15:36:08.883652 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:36:08.883602    2555 generic.go:356] "Generic (PLEG): container finished" podID="8a4090c4-92f5-44b0-a8fe-b90df7ab72b3" containerID="444df9c29970f9bb2dbf8c5e74cc7830248a7442f8584fa8f9fd2ce742a187f6" exitCode=0
Jul 13 15:36:08.884070 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:36:08.883648    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65f956d9c5-h7sdk" event={"ID":"8a4090c4-92f5-44b0-a8fe-b90df7ab72b3","Type":"ContainerDied","Data":"444df9c29970f9bb2dbf8c5e74cc7830248a7442f8584fa8f9fd2ce742a187f6"}
Jul 13 15:36:08.947911 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:36:08.947856    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65f956d9c5-h7sdk"
Jul 13 15:36:09.036565 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:36:09.036534    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:36:09.103680 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:36:09.103655    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8a4090c4-92f5-44b0-a8fe-b90df7ab72b3-tls-cert\") pod \"8a4090c4-92f5-44b0-a8fe-b90df7ab72b3\" (UID: \"8a4090c4-92f5-44b0-a8fe-b90df7ab72b3\") "
Jul 13 15:36:09.103835 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:36:09.103705    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqnvz\" (UniqueName: \"kubernetes.io/projected/8a4090c4-92f5-44b0-a8fe-b90df7ab72b3-kube-api-access-lqnvz\") pod \"8a4090c4-92f5-44b0-a8fe-b90df7ab72b3\" (UID: \"8a4090c4-92f5-44b0-a8fe-b90df7ab72b3\") "
Jul 13 15:36:09.105761 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:36:09.105733    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a4090c4-92f5-44b0-a8fe-b90df7ab72b3-kube-api-access-lqnvz" (OuterVolumeSpecName: "kube-api-access-lqnvz") pod "8a4090c4-92f5-44b0-a8fe-b90df7ab72b3" (UID: "8a4090c4-92f5-44b0-a8fe-b90df7ab72b3"). InnerVolumeSpecName "kube-api-access-lqnvz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:36:09.113784 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:36:09.113759    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a4090c4-92f5-44b0-a8fe-b90df7ab72b3-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "8a4090c4-92f5-44b0-a8fe-b90df7ab72b3" (UID: "8a4090c4-92f5-44b0-a8fe-b90df7ab72b3"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 15:36:09.124099 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:36:09.124075    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:36:09.205275 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:36:09.205206    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqnvz\" (UniqueName: \"kubernetes.io/projected/8a4090c4-92f5-44b0-a8fe-b90df7ab72b3-kube-api-access-lqnvz\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:36:09.205275 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:36:09.205231    2555 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8a4090c4-92f5-44b0-a8fe-b90df7ab72b3-tls-cert\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:36:09.890316 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:36:09.890287    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65f956d9c5-h7sdk"
Jul 13 15:36:09.890758 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:36:09.890336    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65f956d9c5-h7sdk" event={"ID":"8a4090c4-92f5-44b0-a8fe-b90df7ab72b3","Type":"ContainerDied","Data":"a7ecf93288e5e46111f218b3206962fda16898bc428776ab2f85a7a36020d96a"}
Jul 13 15:36:09.890758 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:36:09.890379    2555 scope.go:117] "RemoveContainer" containerID="444df9c29970f9bb2dbf8c5e74cc7830248a7442f8584fa8f9fd2ce742a187f6"
Jul 13 15:36:09.925037 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:36:09.925014    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-65f956d9c5-h7sdk"]
Jul 13 15:36:09.926680 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:36:09.926660    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-65f956d9c5-h7sdk"]
Jul 13 15:36:10.203516 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:36:10.203429    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a4090c4-92f5-44b0-a8fe-b90df7ab72b3" path="/var/lib/kubelet/pods/8a4090c4-92f5-44b0-a8fe-b90df7ab72b3/volumes"
Jul 13 15:37:20.031880 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:20.031849    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:37:20.158751 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:20.158712    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5496d869d5-dcljp"]
Jul 13 15:37:20.159284 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:20.159228    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5496d869d5-dcljp" podUID="e48eb49a-0943-4363-a9bc-6b5c0cb02393" containerName="manager" containerID="cri-o://a7db3d0aeb868edfcd7f83f54dd8823ebc657f5cbe7bc87cc106f51e05eac7f8" gracePeriod=30
Jul 13 15:37:20.421289 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:20.421260    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5496d869d5-dcljp"
Jul 13 15:37:20.516395 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:20.516361    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e48eb49a-0943-4363-a9bc-6b5c0cb02393-webhook-cert\") pod \"e48eb49a-0943-4363-a9bc-6b5c0cb02393\" (UID: \"e48eb49a-0943-4363-a9bc-6b5c0cb02393\") "
Jul 13 15:37:20.516623 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:20.516420    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbnr4\" (UniqueName: \"kubernetes.io/projected/e48eb49a-0943-4363-a9bc-6b5c0cb02393-kube-api-access-fbnr4\") pod \"e48eb49a-0943-4363-a9bc-6b5c0cb02393\" (UID: \"e48eb49a-0943-4363-a9bc-6b5c0cb02393\") "
Jul 13 15:37:20.518556 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:20.518518    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e48eb49a-0943-4363-a9bc-6b5c0cb02393-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e48eb49a-0943-4363-a9bc-6b5c0cb02393" (UID: "e48eb49a-0943-4363-a9bc-6b5c0cb02393"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 15:37:20.518696 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:20.518573    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e48eb49a-0943-4363-a9bc-6b5c0cb02393-kube-api-access-fbnr4" (OuterVolumeSpecName: "kube-api-access-fbnr4") pod "e48eb49a-0943-4363-a9bc-6b5c0cb02393" (UID: "e48eb49a-0943-4363-a9bc-6b5c0cb02393"). InnerVolumeSpecName "kube-api-access-fbnr4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:37:20.617175 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:20.617089    2555 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e48eb49a-0943-4363-a9bc-6b5c0cb02393-webhook-cert\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:37:20.617175 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:20.617120    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbnr4\" (UniqueName: \"kubernetes.io/projected/e48eb49a-0943-4363-a9bc-6b5c0cb02393-kube-api-access-fbnr4\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:37:21.226665 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:21.226630    2555 generic.go:356] "Generic (PLEG): container finished" podID="e48eb49a-0943-4363-a9bc-6b5c0cb02393" containerID="a7db3d0aeb868edfcd7f83f54dd8823ebc657f5cbe7bc87cc106f51e05eac7f8" exitCode=0
Jul 13 15:37:21.227088 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:21.226674    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5496d869d5-dcljp"
Jul 13 15:37:21.227088 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:21.226693    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5496d869d5-dcljp" event={"ID":"e48eb49a-0943-4363-a9bc-6b5c0cb02393","Type":"ContainerDied","Data":"a7db3d0aeb868edfcd7f83f54dd8823ebc657f5cbe7bc87cc106f51e05eac7f8"}
Jul 13 15:37:21.227088 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:21.226744    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5496d869d5-dcljp" event={"ID":"e48eb49a-0943-4363-a9bc-6b5c0cb02393","Type":"ContainerDied","Data":"0c16eedb7c955a562480b9b33ad0d29c7492c9e1634c8a52da5e428c9b725ee6"}
Jul 13 15:37:21.227088 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:21.226775    2555 scope.go:117] "RemoveContainer" containerID="a7db3d0aeb868edfcd7f83f54dd8823ebc657f5cbe7bc87cc106f51e05eac7f8"
Jul 13 15:37:21.235642 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:21.235623    2555 scope.go:117] "RemoveContainer" containerID="a7db3d0aeb868edfcd7f83f54dd8823ebc657f5cbe7bc87cc106f51e05eac7f8"
Jul 13 15:37:21.235901 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:37:21.235882    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7db3d0aeb868edfcd7f83f54dd8823ebc657f5cbe7bc87cc106f51e05eac7f8\": container with ID starting with a7db3d0aeb868edfcd7f83f54dd8823ebc657f5cbe7bc87cc106f51e05eac7f8 not found: ID does not exist" containerID="a7db3d0aeb868edfcd7f83f54dd8823ebc657f5cbe7bc87cc106f51e05eac7f8"
Jul 13 15:37:21.235951 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:21.235909    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7db3d0aeb868edfcd7f83f54dd8823ebc657f5cbe7bc87cc106f51e05eac7f8"} err="failed to get container status \"a7db3d0aeb868edfcd7f83f54dd8823ebc657f5cbe7bc87cc106f51e05eac7f8\": rpc error: code = NotFound desc = could not find container \"a7db3d0aeb868edfcd7f83f54dd8823ebc657f5cbe7bc87cc106f51e05eac7f8\": container with ID starting with a7db3d0aeb868edfcd7f83f54dd8823ebc657f5cbe7bc87cc106f51e05eac7f8 not found: ID does not exist"
Jul 13 15:37:21.247866 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:21.247841    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5496d869d5-dcljp"]
Jul 13 15:37:21.251621 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:21.251601    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5496d869d5-dcljp"]
Jul 13 15:37:21.907455 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:21.907422    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:37:22.029765 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:22.029725    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5496d869d5-4z6lw"]
Jul 13 15:37:22.030102 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:22.030088    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a4090c4-92f5-44b0-a8fe-b90df7ab72b3" containerName="authorino"
Jul 13 15:37:22.030146 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:22.030103    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a4090c4-92f5-44b0-a8fe-b90df7ab72b3" containerName="authorino"
Jul 13 15:37:22.030146 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:22.030129    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e48eb49a-0943-4363-a9bc-6b5c0cb02393" containerName="manager"
Jul 13 15:37:22.030146 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:22.030135    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="e48eb49a-0943-4363-a9bc-6b5c0cb02393" containerName="manager"
Jul 13 15:37:22.030255 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:22.030192    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a4090c4-92f5-44b0-a8fe-b90df7ab72b3" containerName="authorino"
Jul 13 15:37:22.030255 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:22.030203    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="e48eb49a-0943-4363-a9bc-6b5c0cb02393" containerName="manager"
Jul 13 15:37:22.034410 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:22.034388    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5496d869d5-4z6lw"
Jul 13 15:37:22.037081 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:22.037056    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rv4jb\""
Jul 13 15:37:22.037205 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:22.037087    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 13 15:37:22.037205 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:22.037103    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 13 15:37:22.043380 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:22.043355    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5496d869d5-4z6lw"]
Jul 13 15:37:22.127033 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:22.126996    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpl77\" (UniqueName: \"kubernetes.io/projected/5941779e-a585-4393-8107-4abf90259a6b-kube-api-access-dpl77\") pod \"maas-controller-5496d869d5-4z6lw\" (UID: \"5941779e-a585-4393-8107-4abf90259a6b\") " pod="opendatahub/maas-controller-5496d869d5-4z6lw"
Jul 13 15:37:22.127218 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:22.127066    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5941779e-a585-4393-8107-4abf90259a6b-webhook-cert\") pod \"maas-controller-5496d869d5-4z6lw\" (UID: \"5941779e-a585-4393-8107-4abf90259a6b\") " pod="opendatahub/maas-controller-5496d869d5-4z6lw"
Jul 13 15:37:22.203417 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:22.203342    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e48eb49a-0943-4363-a9bc-6b5c0cb02393" path="/var/lib/kubelet/pods/e48eb49a-0943-4363-a9bc-6b5c0cb02393/volumes"
Jul 13 15:37:22.227785 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:22.227762    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpl77\" (UniqueName: \"kubernetes.io/projected/5941779e-a585-4393-8107-4abf90259a6b-kube-api-access-dpl77\") pod \"maas-controller-5496d869d5-4z6lw\" (UID: \"5941779e-a585-4393-8107-4abf90259a6b\") " pod="opendatahub/maas-controller-5496d869d5-4z6lw"
Jul 13 15:37:22.228107 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:22.227814    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5941779e-a585-4393-8107-4abf90259a6b-webhook-cert\") pod \"maas-controller-5496d869d5-4z6lw\" (UID: \"5941779e-a585-4393-8107-4abf90259a6b\") " pod="opendatahub/maas-controller-5496d869d5-4z6lw"
Jul 13 15:37:22.230238 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:22.230213    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5941779e-a585-4393-8107-4abf90259a6b-webhook-cert\") pod \"maas-controller-5496d869d5-4z6lw\" (UID: \"5941779e-a585-4393-8107-4abf90259a6b\") " pod="opendatahub/maas-controller-5496d869d5-4z6lw"
Jul 13 15:37:22.242758 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:22.242737    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpl77\" (UniqueName: \"kubernetes.io/projected/5941779e-a585-4393-8107-4abf90259a6b-kube-api-access-dpl77\") pod \"maas-controller-5496d869d5-4z6lw\" (UID: \"5941779e-a585-4393-8107-4abf90259a6b\") " pod="opendatahub/maas-controller-5496d869d5-4z6lw"
Jul 13 15:37:22.345341 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:22.345301    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5496d869d5-4z6lw"
Jul 13 15:37:22.481261 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:22.481237    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5496d869d5-4z6lw"]
Jul 13 15:37:22.483471 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:37:22.483449    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5941779e_a585_4393_8107_4abf90259a6b.slice/crio-80cf75043878609b614874a4f77f3ad545a0295e0194d4763710a7e7b51be63e WatchSource:0}: Error finding container 80cf75043878609b614874a4f77f3ad545a0295e0194d4763710a7e7b51be63e: Status 404 returned error can't find the container with id 80cf75043878609b614874a4f77f3ad545a0295e0194d4763710a7e7b51be63e
Jul 13 15:37:23.241090 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:23.241065    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5496d869d5-4z6lw" event={"ID":"5941779e-a585-4393-8107-4abf90259a6b","Type":"ContainerStarted","Data":"0ce7c6cbbbb71b02a266acf1639ed68de0137a4dcd5fb102511fe35a38ea3684"}
Jul 13 15:37:23.241417 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:23.241113    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5496d869d5-4z6lw" event={"ID":"5941779e-a585-4393-8107-4abf90259a6b","Type":"ContainerStarted","Data":"80cf75043878609b614874a4f77f3ad545a0295e0194d4763710a7e7b51be63e"}
Jul 13 15:37:23.241417 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:23.241171    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5496d869d5-4z6lw"
Jul 13 15:37:23.260949 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:23.260904    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5496d869d5-4z6lw" podStartSLOduration=0.574827449 podStartE2EDuration="1.260889956s" totalImagesPullingTime="686.062507ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:37:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:37:23.259637295 +0000 UTC m=+829.584359191" watchObservedRunningTime="2026-07-13 15:37:23.260889956 +0000 UTC m=+829.585611852"
Jul 13 15:37:27.922043 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:27.922003    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:37:34.214137 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:34.214104    2555 scope.go:117] "RemoveContainer" containerID="0f6b609bfe75701ff2d7d7f109df236c19d83a2daa10ef19f47638591615ae49"
Jul 13 15:37:34.248674 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:37:34.248648    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5496d869d5-4z6lw"
Jul 13 15:38:03.171743 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:38:03.171702    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:38:03.269635 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:38:03.269580    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:38:03.440754 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:38:03.440659    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:38:09.644445 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:38:09.644408    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:38:09.750379 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:38:09.750345    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:38:09.844979 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:38:09.844949    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:38:10.032858 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:38:10.032823    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:38:15.960257 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:38:15.960213    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:38:16.061600 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:38:16.061563    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:38:34.173520 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:38:34.173435    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cptrx_90f53326-a36e-4682-a268-bdfec7cf722b/console-operator/1.log"
Jul 13 15:38:34.176868 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:38:34.176845    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cptrx_90f53326-a36e-4682-a268-bdfec7cf722b/console-operator/1.log"
Jul 13 15:38:34.184203 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:38:34.184184    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x8g52_f4724159-d88b-4ed1-a5fc-956a4d1e3fe8/ovn-acl-logging/0.log"
Jul 13 15:38:34.187132 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:38:34.187110    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x8g52_f4724159-d88b-4ed1-a5fc-956a4d1e3fe8/ovn-acl-logging/0.log"
Jul 13 15:39:54.852361 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:39:54.852310    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:41:00.355032 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:41:00.354991    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:42:14.210053 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:42:14.210017    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:42:14.271319 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:42:14.271279    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:43:34.206176 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:43:34.206150    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cptrx_90f53326-a36e-4682-a268-bdfec7cf722b/console-operator/1.log"
Jul 13 15:43:34.211156 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:43:34.211134    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cptrx_90f53326-a36e-4682-a268-bdfec7cf722b/console-operator/1.log"
Jul 13 15:43:34.214036 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:43:34.214018    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x8g52_f4724159-d88b-4ed1-a5fc-956a4d1e3fe8/ovn-acl-logging/0.log"
Jul 13 15:43:34.218656 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:43:34.218639    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x8g52_f4724159-d88b-4ed1-a5fc-956a4d1e3fe8/ovn-acl-logging/0.log"
Jul 13 15:45:00.196768 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:45:00.196688    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29732625-2gpqk"]
Jul 13 15:45:00.200219 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:45:00.200198    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732625-2gpqk"
Jul 13 15:45:00.204251 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:45:00.204227    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p7lrf\""
Jul 13 15:45:00.210709 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:45:00.210689    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732625-2gpqk"
Jul 13 15:45:00.283687 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:45:00.283651    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29732625-2gpqk"]
Jul 13 15:45:00.580879 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:45:00.580847    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29732625-2gpqk"]
Jul 13 15:45:00.581344 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:45:00.581313    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7415b735_8b99_42b4_a97c_4c57f2d51967.slice/crio-448699ef70e8d470118c88a95fc4dfad8679efb4b693834f59b2c401c122eef6 WatchSource:0}: Error finding container 448699ef70e8d470118c88a95fc4dfad8679efb4b693834f59b2c401c122eef6: Status 404 returned error can't find the container with id 448699ef70e8d470118c88a95fc4dfad8679efb4b693834f59b2c401c122eef6
Jul 13 15:45:00.583130 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:45:00.583112    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 15:45:01.353502 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:45:01.353461    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732625-2gpqk" event={"ID":"7415b735-8b99-42b4-a97c-4c57f2d51967","Type":"ContainerStarted","Data":"448699ef70e8d470118c88a95fc4dfad8679efb4b693834f59b2c401c122eef6"}
Jul 13 15:45:08.390654 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:45:08.390550    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732625-2gpqk" event={"ID":"7415b735-8b99-42b4-a97c-4c57f2d51967","Type":"ContainerStarted","Data":"d84bba20b3b5eb970e7f67793c9cb4d89d3cfd7212fe5a46678931a77f0ef8ef"}
Jul 13 15:45:08.408284 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:45:08.408228    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732625-2gpqk" podStartSLOduration=1.276173408 podStartE2EDuration="8.408212898s" totalImagesPullingTime="7.13203949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:45:08.406964108 +0000 UTC m=+1294.731686007" watchObservedRunningTime="2026-07-13 15:45:08.408212898 +0000 UTC m=+1294.732934796"
Jul 13 15:45:09.396428 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:45:09.396381    2555 generic.go:356] "Generic (PLEG): container finished" podID="7415b735-8b99-42b4-a97c-4c57f2d51967" containerID="d84bba20b3b5eb970e7f67793c9cb4d89d3cfd7212fe5a46678931a77f0ef8ef" exitCode=0
Jul 13 15:45:09.396845 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:45:09.396467    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732625-2gpqk" event={"ID":"7415b735-8b99-42b4-a97c-4c57f2d51967","Type":"ContainerDied","Data":"d84bba20b3b5eb970e7f67793c9cb4d89d3cfd7212fe5a46678931a77f0ef8ef"}
Jul 13 15:45:10.534162 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:45:10.534132    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732625-2gpqk"
Jul 13 15:45:11.406728 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:45:11.406701    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732625-2gpqk"
Jul 13 15:45:11.406728 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:45:11.406710    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732625-2gpqk" event={"ID":"7415b735-8b99-42b4-a97c-4c57f2d51967","Type":"ContainerDied","Data":"448699ef70e8d470118c88a95fc4dfad8679efb4b693834f59b2c401c122eef6"}
Jul 13 15:45:11.406938 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:45:11.406768    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="448699ef70e8d470118c88a95fc4dfad8679efb4b693834f59b2c401c122eef6"
Jul 13 15:46:23.276968 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:46:23.276931    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:46:50.224365 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:46:50.224316    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:48:34.235761 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:48:34.235726    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cptrx_90f53326-a36e-4682-a268-bdfec7cf722b/console-operator/1.log"
Jul 13 15:48:34.242310 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:48:34.242279    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cptrx_90f53326-a36e-4682-a268-bdfec7cf722b/console-operator/1.log"
Jul 13 15:48:34.244918 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:48:34.244897    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x8g52_f4724159-d88b-4ed1-a5fc-956a4d1e3fe8/ovn-acl-logging/0.log"
Jul 13 15:48:34.250771 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:48:34.250748    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x8g52_f4724159-d88b-4ed1-a5fc-956a4d1e3fe8/ovn-acl-logging/0.log"
Jul 13 15:48:43.231955 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:48:43.231914    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:48:43.317179 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:48:43.317145    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:49:07.054806 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:07.054773    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:49:13.473719 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:13.473683    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:49:21.731882 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:21.731843    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:49:26.883534 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:26.883500    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:49:29.907697 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:29.907667    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:49:30.007703 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:30.007662    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:49:30.402296 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:30.402262    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:49:36.233407 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:36.233365    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:49:36.292958 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:36.292892    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:49:36.410879 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:36.410848    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8"]
Jul 13 15:49:36.411256 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:36.411244    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7415b735-8b99-42b4-a97c-4c57f2d51967" containerName="cleanup"
Jul 13 15:49:36.411307 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:36.411257    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="7415b735-8b99-42b4-a97c-4c57f2d51967" containerName="cleanup"
Jul 13 15:49:36.411344 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:36.411323    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="7415b735-8b99-42b4-a97c-4c57f2d51967" containerName="cleanup"
Jul 13 15:49:36.414353 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:36.414326    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8"
Jul 13 15:49:36.416863 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:36.416706    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-70631383-openshift-default-dockercfg-qd56g\""
Jul 13 15:49:36.436723 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:36.436688    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8"]
Jul 13 15:49:36.441780 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:36.441746    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:49:36.508851 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:36.508748    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5777c02-004d-48d1-af65-4aea8aa09e61-workload-socket\") pod \"e2e-ait-70631383-openshift-default-674fdf57f7-67bd8\" (UID: \"d5777c02-004d-48d1-af65-4aea8aa09e61\") " pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8"
Jul 13 15:49:36.508851 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:36.508808    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5777c02-004d-48d1-af65-4aea8aa09e61-istio-token\") pod \"e2e-ait-70631383-openshift-default-674fdf57f7-67bd8\" (UID: \"d5777c02-004d-48d1-af65-4aea8aa09e61\") " pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8"
Jul 13 15:49:36.509039 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:36.508865    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5777c02-004d-48d1-af65-4aea8aa09e61-credential-socket\") pod \"e2e-ait-70631383-openshift-default-674fdf57f7-67bd8\" (UID: \"d5777c02-004d-48d1-af65-4aea8aa09e61\") " pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8"
Jul 13 15:49:36.509039 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:36.508951    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5777c02-004d-48d1-af65-4aea8aa09e61-istio-data\") pod \"e2e-ait-70631383-openshift-default-674fdf57f7-67bd8\" (UID: \"d5777c02-004d-48d1-af65-4aea8aa09e61\") " pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8"
Jul 13 15:49:36.509039 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:36.508992    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5777c02-004d-48d1-af65-4aea8aa09e61-istio-podinfo\") pod \"e2e-ait-70631383-openshift-default-674fdf57f7-67bd8\" (UID: \"d5777c02-004d-48d1-af65-4aea8aa09e61\") " pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8"
Jul 13 15:49:36.509174 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:36.509042    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5777c02-004d-48d1-af65-4aea8aa09e61-workload-certs\") pod \"e2e-ait-70631383-openshift-default-674fdf57f7-67bd8\" (UID: \"d5777c02-004d-48d1-af65-4aea8aa09e61\") " pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8"
Jul 13 15:49:36.509174 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:36.509079    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5777c02-004d-48d1-af65-4aea8aa09e61-istiod-ca-cert\") pod \"e2e-ait-70631383-openshift-default-674fdf57f7-67bd8\" (UID: \"d5777c02-004d-48d1-af65-4aea8aa09e61\") " pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8"
Jul 13 15:49:36.509174 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:36.509140    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5777c02-004d-48d1-af65-4aea8aa09e61-istio-envoy\") pod \"e2e-ait-70631383-openshift-default-674fdf57f7-67bd8\" (UID: \"d5777c02-004d-48d1-af65-4aea8aa09e61\") " pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8"
Jul 13 15:49:36.509174 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:36.509164    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hrk8\" (UniqueName: \"kubernetes.io/projected/d5777c02-004d-48d1-af65-4aea8aa09e61-kube-api-access-8hrk8\") pod \"e2e-ait-70631383-openshift-default-674fdf57f7-67bd8\" (UID: \"d5777c02-004d-48d1-af65-4aea8aa09e61\") " pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8"
Jul 13 15:49:36.537131 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:36.537099    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:49:36.609733 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:36.609690    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5777c02-004d-48d1-af65-4aea8aa09e61-credential-socket\") pod \"e2e-ait-70631383-openshift-default-674fdf57f7-67bd8\" (UID: \"d5777c02-004d-48d1-af65-4aea8aa09e61\") " pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8"
Jul 13 15:49:36.609912 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:36.609738    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5777c02-004d-48d1-af65-4aea8aa09e61-istio-data\") pod \"e2e-ait-70631383-openshift-default-674fdf57f7-67bd8\" (UID: \"d5777c02-004d-48d1-af65-4aea8aa09e61\") " pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8"
Jul 13 15:49:36.609912 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:36.609764    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5777c02-004d-48d1-af65-4aea8aa09e61-istio-podinfo\") pod \"e2e-ait-70631383-openshift-default-674fdf57f7-67bd8\" (UID: \"d5777c02-004d-48d1-af65-4aea8aa09e61\") " pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8"
Jul 13 15:49:36.610050 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:36.609947    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5777c02-004d-48d1-af65-4aea8aa09e61-workload-certs\") pod \"e2e-ait-70631383-openshift-default-674fdf57f7-67bd8\" (UID: \"d5777c02-004d-48d1-af65-4aea8aa09e61\") " pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8"
Jul 13 15:49:36.610050 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:36.609972    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5777c02-004d-48d1-af65-4aea8aa09e61-istiod-ca-cert\") pod \"e2e-ait-70631383-openshift-default-674fdf57f7-67bd8\" (UID: \"d5777c02-004d-48d1-af65-4aea8aa09e61\") " pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8"
Jul 13 15:49:36.610050 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:36.610002    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5777c02-004d-48d1-af65-4aea8aa09e61-istio-envoy\") pod \"e2e-ait-70631383-openshift-default-674fdf57f7-67bd8\" (UID: \"d5777c02-004d-48d1-af65-4aea8aa09e61\") " pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8"
Jul 13 15:49:36.610207 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:36.610107    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hrk8\" (UniqueName: \"kubernetes.io/projected/d5777c02-004d-48d1-af65-4aea8aa09e61-kube-api-access-8hrk8\") pod \"e2e-ait-70631383-openshift-default-674fdf57f7-67bd8\" (UID: \"d5777c02-004d-48d1-af65-4aea8aa09e61\") " pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8"
Jul 13 15:49:36.610207 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:36.610124    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5777c02-004d-48d1-af65-4aea8aa09e61-istio-data\") pod \"e2e-ait-70631383-openshift-default-674fdf57f7-67bd8\" (UID: \"d5777c02-004d-48d1-af65-4aea8aa09e61\") " pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8"
Jul 13 15:49:36.610207 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:36.610201    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5777c02-004d-48d1-af65-4aea8aa09e61-workload-socket\") pod \"e2e-ait-70631383-openshift-default-674fdf57f7-67bd8\" (UID: \"d5777c02-004d-48d1-af65-4aea8aa09e61\") " pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8"
Jul 13 15:49:36.610362 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:36.610235    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5777c02-004d-48d1-af65-4aea8aa09e61-istio-token\") pod \"e2e-ait-70631383-openshift-default-674fdf57f7-67bd8\" (UID: \"d5777c02-004d-48d1-af65-4aea8aa09e61\") " pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8"
Jul 13 15:49:36.610362 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:36.610293    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5777c02-004d-48d1-af65-4aea8aa09e61-credential-socket\") pod \"e2e-ait-70631383-openshift-default-674fdf57f7-67bd8\" (UID: \"d5777c02-004d-48d1-af65-4aea8aa09e61\") " pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8"
Jul 13 15:49:36.610485 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:36.610460    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5777c02-004d-48d1-af65-4aea8aa09e61-workload-certs\") pod \"e2e-ait-70631383-openshift-default-674fdf57f7-67bd8\" (UID: \"d5777c02-004d-48d1-af65-4aea8aa09e61\") " pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8"
Jul 13 15:49:36.610661 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:36.610641    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5777c02-004d-48d1-af65-4aea8aa09e61-workload-socket\") pod \"e2e-ait-70631383-openshift-default-674fdf57f7-67bd8\" (UID: \"d5777c02-004d-48d1-af65-4aea8aa09e61\") " pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8"
Jul 13 15:49:36.610765 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:36.610745    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5777c02-004d-48d1-af65-4aea8aa09e61-istiod-ca-cert\") pod \"e2e-ait-70631383-openshift-default-674fdf57f7-67bd8\" (UID: \"d5777c02-004d-48d1-af65-4aea8aa09e61\") " pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8"
Jul 13 15:49:36.612232 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:36.612212    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5777c02-004d-48d1-af65-4aea8aa09e61-istio-envoy\") pod \"e2e-ait-70631383-openshift-default-674fdf57f7-67bd8\" (UID: \"d5777c02-004d-48d1-af65-4aea8aa09e61\") " pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8"
Jul 13 15:49:36.612371 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:36.612354    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5777c02-004d-48d1-af65-4aea8aa09e61-istio-podinfo\") pod \"e2e-ait-70631383-openshift-default-674fdf57f7-67bd8\" (UID: \"d5777c02-004d-48d1-af65-4aea8aa09e61\") " pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8"
Jul 13 15:49:36.618059 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:36.618024    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5777c02-004d-48d1-af65-4aea8aa09e61-istio-token\") pod \"e2e-ait-70631383-openshift-default-674fdf57f7-67bd8\" (UID: \"d5777c02-004d-48d1-af65-4aea8aa09e61\") " pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8"
Jul 13 15:49:36.618659 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:36.618640    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hrk8\" (UniqueName: \"kubernetes.io/projected/d5777c02-004d-48d1-af65-4aea8aa09e61-kube-api-access-8hrk8\") pod \"e2e-ait-70631383-openshift-default-674fdf57f7-67bd8\" (UID: \"d5777c02-004d-48d1-af65-4aea8aa09e61\") " pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8"
Jul 13 15:49:36.725115 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:36.725077    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8"
Jul 13 15:49:36.870715 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:36.870689    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8"]
Jul 13 15:49:36.872905 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:49:36.872872    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5777c02_004d_48d1_af65_4aea8aa09e61.slice/crio-f9bfe96789fd7cc2fe7120a8cfa141777e49928a2686a8895d93cbdda1972704 WatchSource:0}: Error finding container f9bfe96789fd7cc2fe7120a8cfa141777e49928a2686a8895d93cbdda1972704: Status 404 returned error can't find the container with id f9bfe96789fd7cc2fe7120a8cfa141777e49928a2686a8895d93cbdda1972704
Jul 13 15:49:36.875139 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:36.875107    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 15:49:36.875201 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:36.875175    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 15:49:36.875237 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:36.875209    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 15:49:37.553686 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:37.553639    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:49:37.620928 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:37.620886    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:49:37.624025 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:37.624001    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-70631383-5457b65668-4245r"]
Jul 13 15:49:37.627110 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:37.627090    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-70631383-5457b65668-4245r"
Jul 13 15:49:37.629218 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:37.629198    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-70631383-serving-cert\""
Jul 13 15:49:37.629408 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:37.629390    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kjwpb\""
Jul 13 15:49:37.635533 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:37.635507    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-70631383-5457b65668-4245r"]
Jul 13 15:49:37.649238 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:37.649205    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8" event={"ID":"d5777c02-004d-48d1-af65-4aea8aa09e61","Type":"ContainerStarted","Data":"d9471b6d9008c8e0b1a865c17a43b060cc807251b3afbf20ee84a7dc181e2d00"}
Jul 13 15:49:37.649424 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:37.649279    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8" event={"ID":"d5777c02-004d-48d1-af65-4aea8aa09e61","Type":"ContainerStarted","Data":"f9bfe96789fd7cc2fe7120a8cfa141777e49928a2686a8895d93cbdda1972704"}
Jul 13 15:49:37.667420 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:37.667359    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8" podStartSLOduration=1.667344524 podStartE2EDuration="1.667344524s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:49:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:49:37.664800292 +0000 UTC m=+1563.989522210" watchObservedRunningTime="2026-07-13 15:49:37.667344524 +0000 UTC m=+1563.992066420"
Jul 13 15:49:37.689227 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:37.689189    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:49:37.720129 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:37.720098    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39ebef86-b0dd-4b72-ac62-ec04d7b3663b-openshift-service-ca\") pod \"maas-api-e2e-ait-70631383-5457b65668-4245r\" (UID: \"39ebef86-b0dd-4b72-ac62-ec04d7b3663b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-70631383-5457b65668-4245r"
Jul 13 15:49:37.720248 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:37.720147    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39ebef86-b0dd-4b72-ac62-ec04d7b3663b-maas-api-tls\") pod \"maas-api-e2e-ait-70631383-5457b65668-4245r\" (UID: \"39ebef86-b0dd-4b72-ac62-ec04d7b3663b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-70631383-5457b65668-4245r"
Jul 13 15:49:37.720360 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:37.720336    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znlph\" (UniqueName: \"kubernetes.io/projected/39ebef86-b0dd-4b72-ac62-ec04d7b3663b-kube-api-access-znlph\") pod \"maas-api-e2e-ait-70631383-5457b65668-4245r\" (UID: \"39ebef86-b0dd-4b72-ac62-ec04d7b3663b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-70631383-5457b65668-4245r"
Jul 13 15:49:37.726077 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:37.726061    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8"
Jul 13 15:49:37.731168 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:37.731147    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8"
Jul 13 15:49:37.820865 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:37.820768    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znlph\" (UniqueName: \"kubernetes.io/projected/39ebef86-b0dd-4b72-ac62-ec04d7b3663b-kube-api-access-znlph\") pod \"maas-api-e2e-ait-70631383-5457b65668-4245r\" (UID: \"39ebef86-b0dd-4b72-ac62-ec04d7b3663b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-70631383-5457b65668-4245r"
Jul 13 15:49:37.820865 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:37.820811    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39ebef86-b0dd-4b72-ac62-ec04d7b3663b-openshift-service-ca\") pod \"maas-api-e2e-ait-70631383-5457b65668-4245r\" (UID: \"39ebef86-b0dd-4b72-ac62-ec04d7b3663b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-70631383-5457b65668-4245r"
Jul 13 15:49:37.820865 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:37.820850    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39ebef86-b0dd-4b72-ac62-ec04d7b3663b-maas-api-tls\") pod \"maas-api-e2e-ait-70631383-5457b65668-4245r\" (UID: \"39ebef86-b0dd-4b72-ac62-ec04d7b3663b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-70631383-5457b65668-4245r"
Jul 13 15:49:37.821162 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:49:37.820947    2555 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-70631383-serving-cert: secret "maas-api-e2e-ait-70631383-serving-cert" not found
Jul 13 15:49:37.821162 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:49:37.821000    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39ebef86-b0dd-4b72-ac62-ec04d7b3663b-maas-api-tls podName:39ebef86-b0dd-4b72-ac62-ec04d7b3663b nodeName:}" failed. No retries permitted until 2026-07-13 15:49:38.320983532 +0000 UTC m=+1564.645705406 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/39ebef86-b0dd-4b72-ac62-ec04d7b3663b-maas-api-tls") pod "maas-api-e2e-ait-70631383-5457b65668-4245r" (UID: "39ebef86-b0dd-4b72-ac62-ec04d7b3663b") : secret "maas-api-e2e-ait-70631383-serving-cert" not found
Jul 13 15:49:37.821551 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:37.821529    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39ebef86-b0dd-4b72-ac62-ec04d7b3663b-openshift-service-ca\") pod \"maas-api-e2e-ait-70631383-5457b65668-4245r\" (UID: \"39ebef86-b0dd-4b72-ac62-ec04d7b3663b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-70631383-5457b65668-4245r"
Jul 13 15:49:37.829361 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:37.829325    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znlph\" (UniqueName: \"kubernetes.io/projected/39ebef86-b0dd-4b72-ac62-ec04d7b3663b-kube-api-access-znlph\") pod \"maas-api-e2e-ait-70631383-5457b65668-4245r\" (UID: \"39ebef86-b0dd-4b72-ac62-ec04d7b3663b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-70631383-5457b65668-4245r"
Jul 13 15:49:38.242447 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:38.242414    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:49:38.325999 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:38.325958    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39ebef86-b0dd-4b72-ac62-ec04d7b3663b-maas-api-tls\") pod \"maas-api-e2e-ait-70631383-5457b65668-4245r\" (UID: \"39ebef86-b0dd-4b72-ac62-ec04d7b3663b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-70631383-5457b65668-4245r"
Jul 13 15:49:38.328496 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:38.328462    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39ebef86-b0dd-4b72-ac62-ec04d7b3663b-maas-api-tls\") pod \"maas-api-e2e-ait-70631383-5457b65668-4245r\" (UID: \"39ebef86-b0dd-4b72-ac62-ec04d7b3663b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-70631383-5457b65668-4245r"
Jul 13 15:49:38.342759 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:38.342683    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:49:38.542510 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:38.542425    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-70631383-5457b65668-4245r"
Jul 13 15:49:38.656144 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:38.656109    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8"
Jul 13 15:49:38.657391 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:38.657368    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8"
Jul 13 15:49:38.692843 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:38.692793    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-70631383-5457b65668-4245r"]
Jul 13 15:49:38.696121 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:49:38.696085    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39ebef86_b0dd_4b72_ac62_ec04d7b3663b.slice/crio-8bc6cbf9a4fdd10ae6e29974197bb9d483c218de39d7416aa82259eb98dfe115 WatchSource:0}: Error finding container 8bc6cbf9a4fdd10ae6e29974197bb9d483c218de39d7416aa82259eb98dfe115: Status 404 returned error can't find the container with id 8bc6cbf9a4fdd10ae6e29974197bb9d483c218de39d7416aa82259eb98dfe115
Jul 13 15:49:39.662558 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:39.662466    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-70631383-5457b65668-4245r" event={"ID":"39ebef86-b0dd-4b72-ac62-ec04d7b3663b","Type":"ContainerStarted","Data":"e5da0c1238d26fb0ae32f817aeb4b2757eddc0057bcdd6e05c967fc7d76f1ccd"}
Jul 13 15:49:39.662558 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:39.662525    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-70631383-5457b65668-4245r" event={"ID":"39ebef86-b0dd-4b72-ac62-ec04d7b3663b","Type":"ContainerStarted","Data":"8bc6cbf9a4fdd10ae6e29974197bb9d483c218de39d7416aa82259eb98dfe115"}
Jul 13 15:49:39.662974 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:39.662645    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-70631383-5457b65668-4245r"
Jul 13 15:49:39.681322 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:39.681264    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-70631383-5457b65668-4245r" podStartSLOduration=2.133005428 podStartE2EDuration="2.681249306s" totalImagesPullingTime="548.243878ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:49:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:49:39.679046575 +0000 UTC m=+1566.003768471" watchObservedRunningTime="2026-07-13 15:49:39.681249306 +0000 UTC m=+1566.005971240"
Jul 13 15:49:40.094993 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:40.094959    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:49:45.681664 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:45.680902    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-70631383-5457b65668-4245r"
Jul 13 15:49:49.720907 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:49.720876    2555 generic.go:356] "Generic (PLEG): container finished" podID="d5777c02-004d-48d1-af65-4aea8aa09e61" containerID="d9471b6d9008c8e0b1a865c17a43b060cc807251b3afbf20ee84a7dc181e2d00" exitCode=0
Jul 13 15:49:49.721331 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:49.720952    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8" event={"ID":"d5777c02-004d-48d1-af65-4aea8aa09e61","Type":"ContainerDied","Data":"d9471b6d9008c8e0b1a865c17a43b060cc807251b3afbf20ee84a7dc181e2d00"}
Jul 13 15:49:49.721380 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:49.721345    2555 scope.go:117] "RemoveContainer" containerID="d9471b6d9008c8e0b1a865c17a43b060cc807251b3afbf20ee84a7dc181e2d00"
Jul 13 15:49:49.722417 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:49.722391    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 15:49:49.722494 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:49.722457    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 15:49:49.722494 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:49.722487    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 15:49:50.727837 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:50.727803    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8" event={"ID":"d5777c02-004d-48d1-af65-4aea8aa09e61","Type":"ContainerStarted","Data":"bb0a46eed2acfe4d4c74b8fa0596bb1212ca12e43fe8fe65ad9ff2b46d09c0af"}
Jul 13 15:49:51.725664 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:51.725627    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8"
Jul 13 15:49:51.726859 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:51.726831    2555 patch_prober.go:28] interesting pod/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 13 15:49:51.726982 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:51.726883    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8" podUID="d5777c02-004d-48d1-af65-4aea8aa09e61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 13 15:49:52.726202 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:52.726164    2555 patch_prober.go:28] interesting pod/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 13 15:49:52.726574 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:52.726224    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8" podUID="d5777c02-004d-48d1-af65-4aea8aa09e61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 13 15:49:53.294616 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:53.294558    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-70631383-5457b65668-4245r"]
Jul 13 15:49:53.294813 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:53.294751    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-70631383-5457b65668-4245r" podUID="39ebef86-b0dd-4b72-ac62-ec04d7b3663b" containerName="maas-api" containerID="cri-o://e5da0c1238d26fb0ae32f817aeb4b2757eddc0057bcdd6e05c967fc7d76f1ccd" gracePeriod=30
Jul 13 15:49:53.323187 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:53.323164    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:49:53.558406 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:53.558348    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-70631383-5457b65668-4245r"
Jul 13 15:49:53.656669 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:53.656635    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8"
Jul 13 15:49:53.693275 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:53.693240    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39ebef86-b0dd-4b72-ac62-ec04d7b3663b-maas-api-tls\") pod \"39ebef86-b0dd-4b72-ac62-ec04d7b3663b\" (UID: \"39ebef86-b0dd-4b72-ac62-ec04d7b3663b\") "
Jul 13 15:49:53.693405 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:53.693357    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znlph\" (UniqueName: \"kubernetes.io/projected/39ebef86-b0dd-4b72-ac62-ec04d7b3663b-kube-api-access-znlph\") pod \"39ebef86-b0dd-4b72-ac62-ec04d7b3663b\" (UID: \"39ebef86-b0dd-4b72-ac62-ec04d7b3663b\") "
Jul 13 15:49:53.693458 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:53.693403    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39ebef86-b0dd-4b72-ac62-ec04d7b3663b-openshift-service-ca\") pod \"39ebef86-b0dd-4b72-ac62-ec04d7b3663b\" (UID: \"39ebef86-b0dd-4b72-ac62-ec04d7b3663b\") "
Jul 13 15:49:53.693791 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:53.693760    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39ebef86-b0dd-4b72-ac62-ec04d7b3663b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "39ebef86-b0dd-4b72-ac62-ec04d7b3663b" (UID: "39ebef86-b0dd-4b72-ac62-ec04d7b3663b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:49:53.695538 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:53.695515    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39ebef86-b0dd-4b72-ac62-ec04d7b3663b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "39ebef86-b0dd-4b72-ac62-ec04d7b3663b" (UID: "39ebef86-b0dd-4b72-ac62-ec04d7b3663b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 15:49:53.695663 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:53.695641    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39ebef86-b0dd-4b72-ac62-ec04d7b3663b-kube-api-access-znlph" (OuterVolumeSpecName: "kube-api-access-znlph") pod "39ebef86-b0dd-4b72-ac62-ec04d7b3663b" (UID: "39ebef86-b0dd-4b72-ac62-ec04d7b3663b"). InnerVolumeSpecName "kube-api-access-znlph". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:49:53.725792 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:53.725756    2555 patch_prober.go:28] interesting pod/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 13 15:49:53.725951 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:53.725818    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8" podUID="d5777c02-004d-48d1-af65-4aea8aa09e61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 13 15:49:53.743487 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:53.743454    2555 generic.go:356] "Generic (PLEG): container finished" podID="39ebef86-b0dd-4b72-ac62-ec04d7b3663b" containerID="e5da0c1238d26fb0ae32f817aeb4b2757eddc0057bcdd6e05c967fc7d76f1ccd" exitCode=0
Jul 13 15:49:53.743869 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:53.743499    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-70631383-5457b65668-4245r"
Jul 13 15:49:53.743869 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:53.743534    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-70631383-5457b65668-4245r" event={"ID":"39ebef86-b0dd-4b72-ac62-ec04d7b3663b","Type":"ContainerDied","Data":"e5da0c1238d26fb0ae32f817aeb4b2757eddc0057bcdd6e05c967fc7d76f1ccd"}
Jul 13 15:49:53.743869 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:53.743610    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-70631383-5457b65668-4245r" event={"ID":"39ebef86-b0dd-4b72-ac62-ec04d7b3663b","Type":"ContainerDied","Data":"8bc6cbf9a4fdd10ae6e29974197bb9d483c218de39d7416aa82259eb98dfe115"}
Jul 13 15:49:53.743869 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:53.743634    2555 scope.go:117] "RemoveContainer" containerID="e5da0c1238d26fb0ae32f817aeb4b2757eddc0057bcdd6e05c967fc7d76f1ccd"
Jul 13 15:49:53.754552 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:53.754526    2555 scope.go:117] "RemoveContainer" containerID="e5da0c1238d26fb0ae32f817aeb4b2757eddc0057bcdd6e05c967fc7d76f1ccd"
Jul 13 15:49:53.754993 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:49:53.754970    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5da0c1238d26fb0ae32f817aeb4b2757eddc0057bcdd6e05c967fc7d76f1ccd\": container with ID starting with e5da0c1238d26fb0ae32f817aeb4b2757eddc0057bcdd6e05c967fc7d76f1ccd not found: ID does not exist" containerID="e5da0c1238d26fb0ae32f817aeb4b2757eddc0057bcdd6e05c967fc7d76f1ccd"
Jul 13 15:49:53.755083 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:53.755005    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5da0c1238d26fb0ae32f817aeb4b2757eddc0057bcdd6e05c967fc7d76f1ccd"} err="failed to get container status \"e5da0c1238d26fb0ae32f817aeb4b2757eddc0057bcdd6e05c967fc7d76f1ccd\": rpc error: code = NotFound desc = could not find container \"e5da0c1238d26fb0ae32f817aeb4b2757eddc0057bcdd6e05c967fc7d76f1ccd\": container with ID starting with e5da0c1238d26fb0ae32f817aeb4b2757eddc0057bcdd6e05c967fc7d76f1ccd not found: ID does not exist"
Jul 13 15:49:53.779980 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:53.779912    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-70631383-5457b65668-4245r"]
Jul 13 15:49:53.787612 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:53.783343    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-70631383-5457b65668-4245r"]
Jul 13 15:49:53.794774 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:53.794691    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39ebef86-b0dd-4b72-ac62-ec04d7b3663b-openshift-service-ca\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:49:53.794774 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:53.794721    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39ebef86-b0dd-4b72-ac62-ec04d7b3663b-maas-api-tls\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:49:53.794774 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:53.794739    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znlph\" (UniqueName: \"kubernetes.io/projected/39ebef86-b0dd-4b72-ac62-ec04d7b3663b-kube-api-access-znlph\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:49:54.203082 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:54.203050    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39ebef86-b0dd-4b72-ac62-ec04d7b3663b" path="/var/lib/kubelet/pods/39ebef86-b0dd-4b72-ac62-ec04d7b3663b/volumes"
Jul 13 15:49:54.729957 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:54.729927    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8"
Jul 13 15:49:54.730821 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:54.730801    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8"
Jul 13 15:49:57.813514 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:49:57.813474    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:50:03.756323 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:03.756277    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:50:03.857786 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:03.857752    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:50:07.971891 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:07.971859    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:50:08.103473 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:08.103437    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8"]
Jul 13 15:50:08.103720 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:08.103693    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8" podUID="d5777c02-004d-48d1-af65-4aea8aa09e61" containerName="istio-proxy" containerID="cri-o://bb0a46eed2acfe4d4c74b8fa0596bb1212ca12e43fe8fe65ad9ff2b46d09c0af" gracePeriod=30
Jul 13 15:50:08.130182 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:08.130156    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:50:08.626054 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:08.626020    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:50:08.726641 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:08.726577    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:50:08.814423 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:08.814396    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:50:09.733465 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:09.733430    2555 patch_prober.go:28] interesting pod/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 13 15:50:09.733984 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:09.733556    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8" podUID="d5777c02-004d-48d1-af65-4aea8aa09e61" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 15:50:10.053641 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:10.053536    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:50:10.129779 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:10.129746    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e90cca64-f98dccd57-zfsfb"]
Jul 13 15:50:10.130205 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:10.130187    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39ebef86-b0dd-4b72-ac62-ec04d7b3663b" containerName="maas-api"
Jul 13 15:50:10.130265 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:10.130210    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="39ebef86-b0dd-4b72-ac62-ec04d7b3663b" containerName="maas-api"
Jul 13 15:50:10.130316 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:10.130286    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="39ebef86-b0dd-4b72-ac62-ec04d7b3663b" containerName="maas-api"
Jul 13 15:50:10.133334 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:10.133317    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e90cca64-f98dccd57-zfsfb"
Jul 13 15:50:10.136536 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:10.136510    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kjwpb\""
Jul 13 15:50:10.136703 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:10.136508    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-e90cca64-serving-cert\""
Jul 13 15:50:10.142436 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:10.142414    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e90cca64-f98dccd57-zfsfb"]
Jul 13 15:50:10.162842 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:10.162819    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:50:10.240969 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:10.240941    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvdp7\" (UniqueName: \"kubernetes.io/projected/68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec-kube-api-access-nvdp7\") pod \"maas-api-e2e-migrate-e90cca64-f98dccd57-zfsfb\" (UID: \"68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e90cca64-f98dccd57-zfsfb"
Jul 13 15:50:10.241112 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:10.240973    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec-maas-api-tls\") pod \"maas-api-e2e-migrate-e90cca64-f98dccd57-zfsfb\" (UID: \"68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e90cca64-f98dccd57-zfsfb"
Jul 13 15:50:10.241112 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:10.241007    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec-openshift-service-ca\") pod \"maas-api-e2e-migrate-e90cca64-f98dccd57-zfsfb\" (UID: \"68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e90cca64-f98dccd57-zfsfb"
Jul 13 15:50:10.342232 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:10.342151    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvdp7\" (UniqueName: \"kubernetes.io/projected/68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec-kube-api-access-nvdp7\") pod \"maas-api-e2e-migrate-e90cca64-f98dccd57-zfsfb\" (UID: \"68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e90cca64-f98dccd57-zfsfb"
Jul 13 15:50:10.342232 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:10.342184    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec-maas-api-tls\") pod \"maas-api-e2e-migrate-e90cca64-f98dccd57-zfsfb\" (UID: \"68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e90cca64-f98dccd57-zfsfb"
Jul 13 15:50:10.342232 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:10.342228    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec-openshift-service-ca\") pod \"maas-api-e2e-migrate-e90cca64-f98dccd57-zfsfb\" (UID: \"68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e90cca64-f98dccd57-zfsfb"
Jul 13 15:50:10.342541 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:50:10.342361    2555 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-e90cca64-serving-cert: secret "maas-api-e2e-migrate-e90cca64-serving-cert" not found
Jul 13 15:50:10.342541 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:50:10.342434    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec-maas-api-tls podName:68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec nodeName:}" failed. No retries permitted until 2026-07-13 15:50:10.842413121 +0000 UTC m=+1597.167135001 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec-maas-api-tls") pod "maas-api-e2e-migrate-e90cca64-f98dccd57-zfsfb" (UID: "68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec") : secret "maas-api-e2e-migrate-e90cca64-serving-cert" not found
Jul 13 15:50:10.342998 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:10.342973    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec-openshift-service-ca\") pod \"maas-api-e2e-migrate-e90cca64-f98dccd57-zfsfb\" (UID: \"68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e90cca64-f98dccd57-zfsfb"
Jul 13 15:50:10.351063 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:10.351040    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvdp7\" (UniqueName: \"kubernetes.io/projected/68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec-kube-api-access-nvdp7\") pod \"maas-api-e2e-migrate-e90cca64-f98dccd57-zfsfb\" (UID: \"68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e90cca64-f98dccd57-zfsfb"
Jul 13 15:50:10.405202 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:10.405172    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:50:10.835841 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:10.835803    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:50:10.848548 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:10.848523    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec-maas-api-tls\") pod \"maas-api-e2e-migrate-e90cca64-f98dccd57-zfsfb\" (UID: \"68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e90cca64-f98dccd57-zfsfb"
Jul 13 15:50:10.850991 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:10.850967    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec-maas-api-tls\") pod \"maas-api-e2e-migrate-e90cca64-f98dccd57-zfsfb\" (UID: \"68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e90cca64-f98dccd57-zfsfb"
Jul 13 15:50:10.934161 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:10.934134    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:50:11.045729 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:11.045697    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e90cca64-f98dccd57-zfsfb"
Jul 13 15:50:11.177952 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:11.177928    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e90cca64-f98dccd57-zfsfb"]
Jul 13 15:50:11.180101 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:50:11.180074    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68d3ffa1_a1d0_45a9_b9ea_76878da2d7ec.slice/crio-1624d40ede180e3ff89998f068227769e005823a708cafd4c87c9345895ae078 WatchSource:0}: Error finding container 1624d40ede180e3ff89998f068227769e005823a708cafd4c87c9345895ae078: Status 404 returned error can't find the container with id 1624d40ede180e3ff89998f068227769e005823a708cafd4c87c9345895ae078
Jul 13 15:50:11.181430 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:11.181413    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 15:50:11.831059 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:11.831008    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e90cca64-f98dccd57-zfsfb" event={"ID":"68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec","Type":"ContainerStarted","Data":"69a7f7f589e9dd03997f4f0022b6d1c009723efeabd5d5188f9c17d30420bc0d"}
Jul 13 15:50:11.831225 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:11.831081    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e90cca64-f98dccd57-zfsfb" event={"ID":"68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec","Type":"ContainerStarted","Data":"1624d40ede180e3ff89998f068227769e005823a708cafd4c87c9345895ae078"}
Jul 13 15:50:11.831225 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:11.831104    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e90cca64-f98dccd57-zfsfb"
Jul 13 15:50:11.847978 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:11.847884    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e90cca64-f98dccd57-zfsfb" podStartSLOduration=1.434132901 podStartE2EDuration="1.847864322s" totalImagesPullingTime="413.731421ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:50:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:50:11.846661923 +0000 UTC m=+1598.171383821" watchObservedRunningTime="2026-07-13 15:50:11.847864322 +0000 UTC m=+1598.172586219"
Jul 13 15:50:13.365494 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:13.365466    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8"
Jul 13 15:50:13.470508 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:13.470475    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5777c02-004d-48d1-af65-4aea8aa09e61-istio-token\") pod \"d5777c02-004d-48d1-af65-4aea8aa09e61\" (UID: \"d5777c02-004d-48d1-af65-4aea8aa09e61\") "
Jul 13 15:50:13.470706 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:13.470561    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5777c02-004d-48d1-af65-4aea8aa09e61-istio-data\") pod \"d5777c02-004d-48d1-af65-4aea8aa09e61\" (UID: \"d5777c02-004d-48d1-af65-4aea8aa09e61\") "
Jul 13 15:50:13.470706 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:13.470605    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5777c02-004d-48d1-af65-4aea8aa09e61-istio-podinfo\") pod \"d5777c02-004d-48d1-af65-4aea8aa09e61\" (UID: \"d5777c02-004d-48d1-af65-4aea8aa09e61\") "
Jul 13 15:50:13.470706 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:13.470623    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5777c02-004d-48d1-af65-4aea8aa09e61-istiod-ca-cert\") pod \"d5777c02-004d-48d1-af65-4aea8aa09e61\" (UID: \"d5777c02-004d-48d1-af65-4aea8aa09e61\") "
Jul 13 15:50:13.470706 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:13.470639    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5777c02-004d-48d1-af65-4aea8aa09e61-istio-envoy\") pod \"d5777c02-004d-48d1-af65-4aea8aa09e61\" (UID: \"d5777c02-004d-48d1-af65-4aea8aa09e61\") "
Jul 13 15:50:13.470706 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:13.470656    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5777c02-004d-48d1-af65-4aea8aa09e61-credential-socket\") pod \"d5777c02-004d-48d1-af65-4aea8aa09e61\" (UID: \"d5777c02-004d-48d1-af65-4aea8aa09e61\") "
Jul 13 15:50:13.470706 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:13.470678    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5777c02-004d-48d1-af65-4aea8aa09e61-workload-certs\") pod \"d5777c02-004d-48d1-af65-4aea8aa09e61\" (UID: \"d5777c02-004d-48d1-af65-4aea8aa09e61\") "
Jul 13 15:50:13.470706 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:13.470708    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5777c02-004d-48d1-af65-4aea8aa09e61-workload-socket\") pod \"d5777c02-004d-48d1-af65-4aea8aa09e61\" (UID: \"d5777c02-004d-48d1-af65-4aea8aa09e61\") "
Jul 13 15:50:13.471062 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:13.470728    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hrk8\" (UniqueName: \"kubernetes.io/projected/d5777c02-004d-48d1-af65-4aea8aa09e61-kube-api-access-8hrk8\") pod \"d5777c02-004d-48d1-af65-4aea8aa09e61\" (UID: \"d5777c02-004d-48d1-af65-4aea8aa09e61\") "
Jul 13 15:50:13.471062 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:13.470983    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5777c02-004d-48d1-af65-4aea8aa09e61-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d5777c02-004d-48d1-af65-4aea8aa09e61" (UID: "d5777c02-004d-48d1-af65-4aea8aa09e61"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:50:13.471162 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:13.471113    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5777c02-004d-48d1-af65-4aea8aa09e61-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d5777c02-004d-48d1-af65-4aea8aa09e61" (UID: "d5777c02-004d-48d1-af65-4aea8aa09e61"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:50:13.471237 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:13.471214    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5777c02-004d-48d1-af65-4aea8aa09e61-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d5777c02-004d-48d1-af65-4aea8aa09e61" (UID: "d5777c02-004d-48d1-af65-4aea8aa09e61"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:50:13.471350 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:13.471324    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5777c02-004d-48d1-af65-4aea8aa09e61-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d5777c02-004d-48d1-af65-4aea8aa09e61" (UID: "d5777c02-004d-48d1-af65-4aea8aa09e61"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:50:13.471514 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:13.471415    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5777c02-004d-48d1-af65-4aea8aa09e61-istio-data" (OuterVolumeSpecName: "istio-data") pod "d5777c02-004d-48d1-af65-4aea8aa09e61" (UID: "d5777c02-004d-48d1-af65-4aea8aa09e61"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:50:13.473081 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:13.473057    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d5777c02-004d-48d1-af65-4aea8aa09e61-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d5777c02-004d-48d1-af65-4aea8aa09e61" (UID: "d5777c02-004d-48d1-af65-4aea8aa09e61"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 15:50:13.473177 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:13.473078    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5777c02-004d-48d1-af65-4aea8aa09e61-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d5777c02-004d-48d1-af65-4aea8aa09e61" (UID: "d5777c02-004d-48d1-af65-4aea8aa09e61"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:50:13.473177 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:13.473085    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5777c02-004d-48d1-af65-4aea8aa09e61-istio-token" (OuterVolumeSpecName: "istio-token") pod "d5777c02-004d-48d1-af65-4aea8aa09e61" (UID: "d5777c02-004d-48d1-af65-4aea8aa09e61"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:50:13.473177 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:13.473098    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5777c02-004d-48d1-af65-4aea8aa09e61-kube-api-access-8hrk8" (OuterVolumeSpecName: "kube-api-access-8hrk8") pod "d5777c02-004d-48d1-af65-4aea8aa09e61" (UID: "d5777c02-004d-48d1-af65-4aea8aa09e61"). InnerVolumeSpecName "kube-api-access-8hrk8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:50:13.571663 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:13.571626    2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5777c02-004d-48d1-af65-4aea8aa09e61-istio-data\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:50:13.571663 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:13.571657    2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5777c02-004d-48d1-af65-4aea8aa09e61-istio-podinfo\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:50:13.571663 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:13.571666    2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5777c02-004d-48d1-af65-4aea8aa09e61-istiod-ca-cert\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:50:13.571663 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:13.571675    2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5777c02-004d-48d1-af65-4aea8aa09e61-istio-envoy\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:50:13.571939 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:13.571682    2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5777c02-004d-48d1-af65-4aea8aa09e61-credential-socket\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:50:13.571939 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:13.571691    2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5777c02-004d-48d1-af65-4aea8aa09e61-workload-certs\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:50:13.571939 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:13.571699    2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5777c02-004d-48d1-af65-4aea8aa09e61-workload-socket\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:50:13.571939 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:13.571707    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hrk8\" (UniqueName: \"kubernetes.io/projected/d5777c02-004d-48d1-af65-4aea8aa09e61-kube-api-access-8hrk8\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:50:13.571939 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:13.571716    2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5777c02-004d-48d1-af65-4aea8aa09e61-istio-token\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:50:13.842198 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:13.842161    2555 generic.go:356] "Generic (PLEG): container finished" podID="d5777c02-004d-48d1-af65-4aea8aa09e61" containerID="bb0a46eed2acfe4d4c74b8fa0596bb1212ca12e43fe8fe65ad9ff2b46d09c0af" exitCode=0
Jul 13 15:50:13.842371 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:13.842228    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8"
Jul 13 15:50:13.842371 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:13.842245    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8" event={"ID":"d5777c02-004d-48d1-af65-4aea8aa09e61","Type":"ContainerDied","Data":"bb0a46eed2acfe4d4c74b8fa0596bb1212ca12e43fe8fe65ad9ff2b46d09c0af"}
Jul 13 15:50:13.842371 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:13.842325    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8" event={"ID":"d5777c02-004d-48d1-af65-4aea8aa09e61","Type":"ContainerDied","Data":"f9bfe96789fd7cc2fe7120a8cfa141777e49928a2686a8895d93cbdda1972704"}
Jul 13 15:50:13.842371 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:13.842348    2555 scope.go:117] "RemoveContainer" containerID="bb0a46eed2acfe4d4c74b8fa0596bb1212ca12e43fe8fe65ad9ff2b46d09c0af"
Jul 13 15:50:13.851482 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:13.851459    2555 scope.go:117] "RemoveContainer" containerID="d9471b6d9008c8e0b1a865c17a43b060cc807251b3afbf20ee84a7dc181e2d00"
Jul 13 15:50:13.859346 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:13.859323    2555 scope.go:117] "RemoveContainer" containerID="bb0a46eed2acfe4d4c74b8fa0596bb1212ca12e43fe8fe65ad9ff2b46d09c0af"
Jul 13 15:50:13.859613 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:50:13.859576    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb0a46eed2acfe4d4c74b8fa0596bb1212ca12e43fe8fe65ad9ff2b46d09c0af\": container with ID starting with bb0a46eed2acfe4d4c74b8fa0596bb1212ca12e43fe8fe65ad9ff2b46d09c0af not found: ID does not exist" containerID="bb0a46eed2acfe4d4c74b8fa0596bb1212ca12e43fe8fe65ad9ff2b46d09c0af"
Jul 13 15:50:13.859691 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:13.859618    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb0a46eed2acfe4d4c74b8fa0596bb1212ca12e43fe8fe65ad9ff2b46d09c0af"} err="failed to get container status \"bb0a46eed2acfe4d4c74b8fa0596bb1212ca12e43fe8fe65ad9ff2b46d09c0af\": rpc error: code = NotFound desc = could not find container \"bb0a46eed2acfe4d4c74b8fa0596bb1212ca12e43fe8fe65ad9ff2b46d09c0af\": container with ID starting with bb0a46eed2acfe4d4c74b8fa0596bb1212ca12e43fe8fe65ad9ff2b46d09c0af not found: ID does not exist"
Jul 13 15:50:13.859691 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:13.859634    2555 scope.go:117] "RemoveContainer" containerID="d9471b6d9008c8e0b1a865c17a43b060cc807251b3afbf20ee84a7dc181e2d00"
Jul 13 15:50:13.859883 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:50:13.859870    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9471b6d9008c8e0b1a865c17a43b060cc807251b3afbf20ee84a7dc181e2d00\": container with ID starting with d9471b6d9008c8e0b1a865c17a43b060cc807251b3afbf20ee84a7dc181e2d00 not found: ID does not exist" containerID="d9471b6d9008c8e0b1a865c17a43b060cc807251b3afbf20ee84a7dc181e2d00"
Jul 13 15:50:13.859923 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:13.859887    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9471b6d9008c8e0b1a865c17a43b060cc807251b3afbf20ee84a7dc181e2d00"} err="failed to get container status \"d9471b6d9008c8e0b1a865c17a43b060cc807251b3afbf20ee84a7dc181e2d00\": rpc error: code = NotFound desc = could not find container \"d9471b6d9008c8e0b1a865c17a43b060cc807251b3afbf20ee84a7dc181e2d00\": container with ID starting with d9471b6d9008c8e0b1a865c17a43b060cc807251b3afbf20ee84a7dc181e2d00 not found: ID does not exist"
Jul 13 15:50:13.863877 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:13.863857    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8"]
Jul 13 15:50:13.869765 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:13.869746    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-70631383-openshift-default-674fdf57f7-67bd8"]
Jul 13 15:50:14.204052 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:14.203974    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5777c02-004d-48d1-af65-4aea8aa09e61" path="/var/lib/kubelet/pods/d5777c02-004d-48d1-af65-4aea8aa09e61/volumes"
Jul 13 15:50:14.528288 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:14.528261    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:50:14.617268 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:14.617218    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:50:14.617784 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:14.617764    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e90cca64-c6j5t"]
Jul 13 15:50:14.618154 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:14.618142    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5777c02-004d-48d1-af65-4aea8aa09e61" containerName="istio-proxy"
Jul 13 15:50:14.618196 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:14.618157    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5777c02-004d-48d1-af65-4aea8aa09e61" containerName="istio-proxy"
Jul 13 15:50:14.618245 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:14.618235    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5777c02-004d-48d1-af65-4aea8aa09e61" containerName="istio-proxy"
Jul 13 15:50:14.623320 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:14.623298    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e90cca64-c6j5t"
Jul 13 15:50:14.627924 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:14.627232    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p7lrf\""
Jul 13 15:50:14.628656 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:14.628620    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e90cca64-c6j5t"]
Jul 13 15:50:14.783842 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:14.783748    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea8ca949-8e00-46ce-826a-7deff8125a9c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-e90cca64-c6j5t\" (UID: \"ea8ca949-8e00-46ce-826a-7deff8125a9c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e90cca64-c6j5t"
Jul 13 15:50:14.885076 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:14.885044    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea8ca949-8e00-46ce-826a-7deff8125a9c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-e90cca64-c6j5t\" (UID: \"ea8ca949-8e00-46ce-826a-7deff8125a9c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e90cca64-c6j5t"
Jul 13 15:50:14.885723 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:14.885706    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea8ca949-8e00-46ce-826a-7deff8125a9c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-e90cca64-c6j5t\" (UID: \"ea8ca949-8e00-46ce-826a-7deff8125a9c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e90cca64-c6j5t"
Jul 13 15:50:14.936075 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:14.936051    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e90cca64-c6j5t"
Jul 13 15:50:15.093203 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:15.093177    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e90cca64-c6j5t"]
Jul 13 15:50:15.095311 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:50:15.095286    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea8ca949_8e00_46ce_826a_7deff8125a9c.slice/crio-2a8bfebea766bdf941503ab4dbd5f2a586ba0bc619c694995c48053c24fc6d4b WatchSource:0}: Error finding container 2a8bfebea766bdf941503ab4dbd5f2a586ba0bc619c694995c48053c24fc6d4b: Status 404 returned error can't find the container with id 2a8bfebea766bdf941503ab4dbd5f2a586ba0bc619c694995c48053c24fc6d4b
Jul 13 15:50:15.854286 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:15.854254    2555 generic.go:356] "Generic (PLEG): container finished" podID="ea8ca949-8e00-46ce-826a-7deff8125a9c" containerID="3aa8c65170c92e3e59fb45dc22a05195d1cfe7c829d1ea8a83a08fc84ec2fac7" exitCode=7
Jul 13 15:50:15.854704 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:15.854344    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e90cca64-c6j5t" event={"ID":"ea8ca949-8e00-46ce-826a-7deff8125a9c","Type":"ContainerDied","Data":"3aa8c65170c92e3e59fb45dc22a05195d1cfe7c829d1ea8a83a08fc84ec2fac7"}
Jul 13 15:50:15.854704 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:15.854395    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e90cca64-c6j5t" event={"ID":"ea8ca949-8e00-46ce-826a-7deff8125a9c","Type":"ContainerStarted","Data":"2a8bfebea766bdf941503ab4dbd5f2a586ba0bc619c694995c48053c24fc6d4b"}
Jul 13 15:50:15.854704 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:15.854478    2555 scope.go:117] "RemoveContainer" containerID="3aa8c65170c92e3e59fb45dc22a05195d1cfe7c829d1ea8a83a08fc84ec2fac7"
Jul 13 15:50:16.860549 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:16.860517    2555 generic.go:356] "Generic (PLEG): container finished" podID="ea8ca949-8e00-46ce-826a-7deff8125a9c" containerID="8be07e8fed558bcac52db6dd97c0dd8d6799d80cc167fe7f06f878256d975df6" exitCode=7
Jul 13 15:50:16.860996 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:16.860558    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e90cca64-c6j5t" event={"ID":"ea8ca949-8e00-46ce-826a-7deff8125a9c","Type":"ContainerDied","Data":"8be07e8fed558bcac52db6dd97c0dd8d6799d80cc167fe7f06f878256d975df6"}
Jul 13 15:50:16.860996 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:16.860633    2555 scope.go:117] "RemoveContainer" containerID="3aa8c65170c92e3e59fb45dc22a05195d1cfe7c829d1ea8a83a08fc84ec2fac7"
Jul 13 15:50:16.860996 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:16.860849    2555 scope.go:117] "RemoveContainer" containerID="8be07e8fed558bcac52db6dd97c0dd8d6799d80cc167fe7f06f878256d975df6"
Jul 13 15:50:16.861147 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:50:16.861045    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-e90cca64-c6j5t_odh-ai-gateway-infra(ea8ca949-8e00-46ce-826a-7deff8125a9c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e90cca64-c6j5t" podUID="ea8ca949-8e00-46ce-826a-7deff8125a9c"
Jul 13 15:50:17.840995 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:17.840971    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e90cca64-f98dccd57-zfsfb"
Jul 13 15:50:17.848868 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:17.848828    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:50:17.875467 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:17.875440    2555 scope.go:117] "RemoveContainer" containerID="8be07e8fed558bcac52db6dd97c0dd8d6799d80cc167fe7f06f878256d975df6"
Jul 13 15:50:17.875962 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:50:17.875638    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-e90cca64-c6j5t_odh-ai-gateway-infra(ea8ca949-8e00-46ce-826a-7deff8125a9c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e90cca64-c6j5t" podUID="ea8ca949-8e00-46ce-826a-7deff8125a9c"
Jul 13 15:50:19.164299 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:19.164266    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:50:28.197720 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:28.197693    2555 scope.go:117] "RemoveContainer" containerID="8be07e8fed558bcac52db6dd97c0dd8d6799d80cc167fe7f06f878256d975df6"
Jul 13 15:50:28.342284 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:28.342235    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:50:28.927877 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:28.927843    2555 generic.go:356] "Generic (PLEG): container finished" podID="ea8ca949-8e00-46ce-826a-7deff8125a9c" containerID="6e323ea6cadbc82ee63c76eb7adcba7d97371cf4fca9401cba422acb729c4480" exitCode=0
Jul 13 15:50:28.928028 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:28.927893    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e90cca64-c6j5t" event={"ID":"ea8ca949-8e00-46ce-826a-7deff8125a9c","Type":"ContainerDied","Data":"6e323ea6cadbc82ee63c76eb7adcba7d97371cf4fca9401cba422acb729c4480"}
Jul 13 15:50:28.928028 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:28.927965    2555 scope.go:117] "RemoveContainer" containerID="8be07e8fed558bcac52db6dd97c0dd8d6799d80cc167fe7f06f878256d975df6"
Jul 13 15:50:29.958929 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:29.958895    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e90cca64-c6j5t"]
Jul 13 15:50:30.065682 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:30.065660    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e90cca64-c6j5t"
Jul 13 15:50:30.105810 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:30.105778    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea8ca949-8e00-46ce-826a-7deff8125a9c-maas-api-service-ca\") pod \"ea8ca949-8e00-46ce-826a-7deff8125a9c\" (UID: \"ea8ca949-8e00-46ce-826a-7deff8125a9c\") "
Jul 13 15:50:30.106084 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:30.106063    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea8ca949-8e00-46ce-826a-7deff8125a9c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ea8ca949-8e00-46ce-826a-7deff8125a9c" (UID: "ea8ca949-8e00-46ce-826a-7deff8125a9c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:50:30.206570 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:30.206494    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea8ca949-8e00-46ce-826a-7deff8125a9c-maas-api-service-ca\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:50:30.940018 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:30.939992    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e90cca64-c6j5t"
Jul 13 15:50:30.940288 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:30.940032    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e90cca64-c6j5t" event={"ID":"ea8ca949-8e00-46ce-826a-7deff8125a9c","Type":"ContainerDied","Data":"2a8bfebea766bdf941503ab4dbd5f2a586ba0bc619c694995c48053c24fc6d4b"}
Jul 13 15:50:30.940288 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:30.940076    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2a8bfebea766bdf941503ab4dbd5f2a586ba0bc619c694995c48053c24fc6d4b"
Jul 13 15:50:30.966791 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:30.966767    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e90cca64-c6j5t"]
Jul 13 15:50:30.970808 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:30.970788    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e90cca64-c6j5t"]
Jul 13 15:50:32.202995 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:50:32.202960    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea8ca949-8e00-46ce-826a-7deff8125a9c" path="/var/lib/kubelet/pods/ea8ca949-8e00-46ce-826a-7deff8125a9c/volumes"
Jul 13 15:51:04.670431 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:04.670398    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e90cca64-8lbhf"]
Jul 13 15:51:04.670890 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:04.670772    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea8ca949-8e00-46ce-826a-7deff8125a9c" containerName="revoke-keys"
Jul 13 15:51:04.670890 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:04.670783    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea8ca949-8e00-46ce-826a-7deff8125a9c" containerName="revoke-keys"
Jul 13 15:51:04.670890 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:04.670803    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea8ca949-8e00-46ce-826a-7deff8125a9c" containerName="revoke-keys"
Jul 13 15:51:04.670890 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:04.670809    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea8ca949-8e00-46ce-826a-7deff8125a9c" containerName="revoke-keys"
Jul 13 15:51:04.670890 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:04.670816    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5777c02-004d-48d1-af65-4aea8aa09e61" containerName="istio-proxy"
Jul 13 15:51:04.670890 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:04.670821    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5777c02-004d-48d1-af65-4aea8aa09e61" containerName="istio-proxy"
Jul 13 15:51:04.670890 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:04.670881    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea8ca949-8e00-46ce-826a-7deff8125a9c" containerName="revoke-keys"
Jul 13 15:51:04.670890 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:04.670891    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea8ca949-8e00-46ce-826a-7deff8125a9c" containerName="revoke-keys"
Jul 13 15:51:04.671140 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:04.670897    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5777c02-004d-48d1-af65-4aea8aa09e61" containerName="istio-proxy"
Jul 13 15:51:04.674093 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:04.674078    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e90cca64-8lbhf"
Jul 13 15:51:04.676335 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:04.676307    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p7lrf\""
Jul 13 15:51:04.680824 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:04.680790    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e90cca64-8lbhf"]
Jul 13 15:51:04.809194 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:04.809161    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/25b34e7f-ab03-403f-b9c7-e67433c787c0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-e90cca64-8lbhf\" (UID: \"25b34e7f-ab03-403f-b9c7-e67433c787c0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e90cca64-8lbhf"
Jul 13 15:51:04.910270 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:04.910233    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/25b34e7f-ab03-403f-b9c7-e67433c787c0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-e90cca64-8lbhf\" (UID: \"25b34e7f-ab03-403f-b9c7-e67433c787c0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e90cca64-8lbhf"
Jul 13 15:51:04.910840 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:04.910821    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/25b34e7f-ab03-403f-b9c7-e67433c787c0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-e90cca64-8lbhf\" (UID: \"25b34e7f-ab03-403f-b9c7-e67433c787c0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e90cca64-8lbhf"
Jul 13 15:51:04.985743 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:04.985715    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e90cca64-8lbhf"
Jul 13 15:51:05.114455 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:05.114433    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e90cca64-8lbhf"]
Jul 13 15:51:05.116747 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:51:05.116715    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25b34e7f_ab03_403f_b9c7_e67433c787c0.slice/crio-f32918b6dc26ff7d8c350a55c02b224a891f4072b5516b782d43adc0f777a73c WatchSource:0}: Error finding container f32918b6dc26ff7d8c350a55c02b224a891f4072b5516b782d43adc0f777a73c: Status 404 returned error can't find the container with id f32918b6dc26ff7d8c350a55c02b224a891f4072b5516b782d43adc0f777a73c
Jul 13 15:51:06.112340 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:06.112290    2555 generic.go:356] "Generic (PLEG): container finished" podID="25b34e7f-ab03-403f-b9c7-e67433c787c0" containerID="02f0191ec9a114547582d86b80a4ac7efba83febb18a9a25e2d27a23fd8deedc" exitCode=0
Jul 13 15:51:06.112771 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:06.112369    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e90cca64-8lbhf" event={"ID":"25b34e7f-ab03-403f-b9c7-e67433c787c0","Type":"ContainerDied","Data":"02f0191ec9a114547582d86b80a4ac7efba83febb18a9a25e2d27a23fd8deedc"}
Jul 13 15:51:06.112771 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:06.112463    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e90cca64-8lbhf" event={"ID":"25b34e7f-ab03-403f-b9c7-e67433c787c0","Type":"ContainerStarted","Data":"f32918b6dc26ff7d8c350a55c02b224a891f4072b5516b782d43adc0f777a73c"}
Jul 13 15:51:07.247753 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:07.247727    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e90cca64-8lbhf"
Jul 13 15:51:07.332734 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:07.332703    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/25b34e7f-ab03-403f-b9c7-e67433c787c0-maas-api-service-ca\") pod \"25b34e7f-ab03-403f-b9c7-e67433c787c0\" (UID: \"25b34e7f-ab03-403f-b9c7-e67433c787c0\") "
Jul 13 15:51:07.333093 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:07.333065    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25b34e7f-ab03-403f-b9c7-e67433c787c0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "25b34e7f-ab03-403f-b9c7-e67433c787c0" (UID: "25b34e7f-ab03-403f-b9c7-e67433c787c0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:51:07.434108 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:07.434030    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/25b34e7f-ab03-403f-b9c7-e67433c787c0-maas-api-service-ca\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:51:08.123084 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:08.123050    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e90cca64-8lbhf"
Jul 13 15:51:08.123264 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:08.123086    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e90cca64-8lbhf" event={"ID":"25b34e7f-ab03-403f-b9c7-e67433c787c0","Type":"ContainerDied","Data":"f32918b6dc26ff7d8c350a55c02b224a891f4072b5516b782d43adc0f777a73c"}
Jul 13 15:51:08.123264 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:08.123139    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f32918b6dc26ff7d8c350a55c02b224a891f4072b5516b782d43adc0f777a73c"
Jul 13 15:51:14.757199 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:14.757164    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:51:14.869622 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:14.869565    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:51:15.070239 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:15.070158    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e90cca64-f98dccd57-zfsfb"]
Jul 13 15:51:15.070510 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:15.070455    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e90cca64-f98dccd57-zfsfb" podUID="68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec" containerName="maas-api" containerID="cri-o://69a7f7f589e9dd03997f4f0022b6d1c009723efeabd5d5188f9c17d30420bc0d" gracePeriod=30
Jul 13 15:51:15.098932 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:15.098912    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:51:15.324501 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:15.324437    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e90cca64-f98dccd57-zfsfb"
Jul 13 15:51:15.501798 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:15.501750    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec-openshift-service-ca\") pod \"68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec\" (UID: \"68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec\") "
Jul 13 15:51:15.501798 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:15.501808    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nvdp7\" (UniqueName: \"kubernetes.io/projected/68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec-kube-api-access-nvdp7\") pod \"68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec\" (UID: \"68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec\") "
Jul 13 15:51:15.502011 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:15.501857    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec-maas-api-tls\") pod \"68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec\" (UID: \"68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec\") "
Jul 13 15:51:15.502136 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:15.502111    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec" (UID: "68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:51:15.503912 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:15.503875    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec" (UID: "68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 15:51:15.504017 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:15.503978    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec-kube-api-access-nvdp7" (OuterVolumeSpecName: "kube-api-access-nvdp7") pod "68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec" (UID: "68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec"). InnerVolumeSpecName "kube-api-access-nvdp7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:51:15.603048 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:15.602957    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec-openshift-service-ca\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:51:15.603048 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:15.602990    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nvdp7\" (UniqueName: \"kubernetes.io/projected/68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec-kube-api-access-nvdp7\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:51:15.603048 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:15.603001    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec-maas-api-tls\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:51:16.170414 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:16.170378    2555 generic.go:356] "Generic (PLEG): container finished" podID="68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec" containerID="69a7f7f589e9dd03997f4f0022b6d1c009723efeabd5d5188f9c17d30420bc0d" exitCode=0
Jul 13 15:51:16.170414 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:16.170415    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e90cca64-f98dccd57-zfsfb"
Jul 13 15:51:16.170886 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:16.170467    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e90cca64-f98dccd57-zfsfb" event={"ID":"68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec","Type":"ContainerDied","Data":"69a7f7f589e9dd03997f4f0022b6d1c009723efeabd5d5188f9c17d30420bc0d"}
Jul 13 15:51:16.170886 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:16.170513    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e90cca64-f98dccd57-zfsfb" event={"ID":"68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec","Type":"ContainerDied","Data":"1624d40ede180e3ff89998f068227769e005823a708cafd4c87c9345895ae078"}
Jul 13 15:51:16.170886 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:16.170537    2555 scope.go:117] "RemoveContainer" containerID="69a7f7f589e9dd03997f4f0022b6d1c009723efeabd5d5188f9c17d30420bc0d"
Jul 13 15:51:16.180229 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:16.180212    2555 scope.go:117] "RemoveContainer" containerID="69a7f7f589e9dd03997f4f0022b6d1c009723efeabd5d5188f9c17d30420bc0d"
Jul 13 15:51:16.180499 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:51:16.180477    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69a7f7f589e9dd03997f4f0022b6d1c009723efeabd5d5188f9c17d30420bc0d\": container with ID starting with 69a7f7f589e9dd03997f4f0022b6d1c009723efeabd5d5188f9c17d30420bc0d not found: ID does not exist" containerID="69a7f7f589e9dd03997f4f0022b6d1c009723efeabd5d5188f9c17d30420bc0d"
Jul 13 15:51:16.180574 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:16.180506    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69a7f7f589e9dd03997f4f0022b6d1c009723efeabd5d5188f9c17d30420bc0d"} err="failed to get container status \"69a7f7f589e9dd03997f4f0022b6d1c009723efeabd5d5188f9c17d30420bc0d\": rpc error: code = NotFound desc = could not find container \"69a7f7f589e9dd03997f4f0022b6d1c009723efeabd5d5188f9c17d30420bc0d\": container with ID starting with 69a7f7f589e9dd03997f4f0022b6d1c009723efeabd5d5188f9c17d30420bc0d not found: ID does not exist"
Jul 13 15:51:16.192017 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:16.191990    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e90cca64-f98dccd57-zfsfb"]
Jul 13 15:51:16.197605 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:16.197564    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e90cca64-f98dccd57-zfsfb"]
Jul 13 15:51:16.206438 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:16.206413    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec" path="/var/lib/kubelet/pods/68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec/volumes"
Jul 13 15:51:20.859288 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:20.859255    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:51:20.918089 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:20.918054    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:51:21.054304 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.054268    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv"]
Jul 13 15:51:21.055105 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.055072    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25b34e7f-ab03-403f-b9c7-e67433c787c0" containerName="revoke-keys"
Jul 13 15:51:21.055105 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.055103    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="25b34e7f-ab03-403f-b9c7-e67433c787c0" containerName="revoke-keys"
Jul 13 15:51:21.055316 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.055114    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec" containerName="maas-api"
Jul 13 15:51:21.055316 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.055122    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec" containerName="maas-api"
Jul 13 15:51:21.055316 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.055134    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea8ca949-8e00-46ce-826a-7deff8125a9c" containerName="revoke-keys"
Jul 13 15:51:21.055316 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.055140    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea8ca949-8e00-46ce-826a-7deff8125a9c" containerName="revoke-keys"
Jul 13 15:51:21.055316 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.055217    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="25b34e7f-ab03-403f-b9c7-e67433c787c0" containerName="revoke-keys"
Jul 13 15:51:21.055316 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.055225    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="68d3ffa1-a1d0-45a9-b9ea-76878da2d7ec" containerName="maas-api"
Jul 13 15:51:21.055316 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.055232    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea8ca949-8e00-46ce-826a-7deff8125a9c" containerName="revoke-keys"
Jul 13 15:51:21.059861 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.059839    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv"
Jul 13 15:51:21.062206 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.062185    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-f762c5e1-openshift-default-dockercfg-vwtfn\""
Jul 13 15:51:21.069197 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.069171    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv"]
Jul 13 15:51:21.087574 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.087544    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:51:21.148863 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.148830    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-istio-podinfo\") pod \"e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv\" (UID: \"bd2bc50a-f4e3-4ab3-8f96-a49be3250494\") " pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv"
Jul 13 15:51:21.148863 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.148866    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-workload-socket\") pod \"e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv\" (UID: \"bd2bc50a-f4e3-4ab3-8f96-a49be3250494\") " pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv"
Jul 13 15:51:21.149079 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.148886    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-istiod-ca-cert\") pod \"e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv\" (UID: \"bd2bc50a-f4e3-4ab3-8f96-a49be3250494\") " pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv"
Jul 13 15:51:21.149079 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.148997    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-istio-envoy\") pod \"e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv\" (UID: \"bd2bc50a-f4e3-4ab3-8f96-a49be3250494\") " pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv"
Jul 13 15:51:21.149079 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.149022    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-istio-data\") pod \"e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv\" (UID: \"bd2bc50a-f4e3-4ab3-8f96-a49be3250494\") " pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv"
Jul 13 15:51:21.149079 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.149039    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-istio-token\") pod \"e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv\" (UID: \"bd2bc50a-f4e3-4ab3-8f96-a49be3250494\") " pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv"
Jul 13 15:51:21.149079 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.149057    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4krc9\" (UniqueName: \"kubernetes.io/projected/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-kube-api-access-4krc9\") pod \"e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv\" (UID: \"bd2bc50a-f4e3-4ab3-8f96-a49be3250494\") " pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv"
Jul 13 15:51:21.149303 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.149088    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-credential-socket\") pod \"e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv\" (UID: \"bd2bc50a-f4e3-4ab3-8f96-a49be3250494\") " pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv"
Jul 13 15:51:21.149303 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.149179    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-workload-certs\") pod \"e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv\" (UID: \"bd2bc50a-f4e3-4ab3-8f96-a49be3250494\") " pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv"
Jul 13 15:51:21.184964 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.184927    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:51:21.250033 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.250000    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-workload-certs\") pod \"e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv\" (UID: \"bd2bc50a-f4e3-4ab3-8f96-a49be3250494\") " pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv"
Jul 13 15:51:21.250208 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.250050    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-istio-podinfo\") pod \"e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv\" (UID: \"bd2bc50a-f4e3-4ab3-8f96-a49be3250494\") " pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv"
Jul 13 15:51:21.250208 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.250078    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-workload-socket\") pod \"e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv\" (UID: \"bd2bc50a-f4e3-4ab3-8f96-a49be3250494\") " pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv"
Jul 13 15:51:21.250208 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.250102    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-istiod-ca-cert\") pod \"e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv\" (UID: \"bd2bc50a-f4e3-4ab3-8f96-a49be3250494\") " pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv"
Jul 13 15:51:21.250414 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.250392    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-workload-certs\") pod \"e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv\" (UID: \"bd2bc50a-f4e3-4ab3-8f96-a49be3250494\") " pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv"
Jul 13 15:51:21.250482 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.250438    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-workload-socket\") pod \"e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv\" (UID: \"bd2bc50a-f4e3-4ab3-8f96-a49be3250494\") " pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv"
Jul 13 15:51:21.250482 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.250436    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-istio-envoy\") pod \"e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv\" (UID: \"bd2bc50a-f4e3-4ab3-8f96-a49be3250494\") " pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv"
Jul 13 15:51:21.250619 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.250491    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-istio-data\") pod \"e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv\" (UID: \"bd2bc50a-f4e3-4ab3-8f96-a49be3250494\") " pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv"
Jul 13 15:51:21.250619 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.250518    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-istio-token\") pod \"e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv\" (UID: \"bd2bc50a-f4e3-4ab3-8f96-a49be3250494\") " pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv"
Jul 13 15:51:21.250619 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.250542    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4krc9\" (UniqueName: \"kubernetes.io/projected/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-kube-api-access-4krc9\") pod \"e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv\" (UID: \"bd2bc50a-f4e3-4ab3-8f96-a49be3250494\") " pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv"
Jul 13 15:51:21.250619 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.250603    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-credential-socket\") pod \"e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv\" (UID: \"bd2bc50a-f4e3-4ab3-8f96-a49be3250494\") " pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv"
Jul 13 15:51:21.250840 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.250801    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-istio-data\") pod \"e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv\" (UID: \"bd2bc50a-f4e3-4ab3-8f96-a49be3250494\") " pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv"
Jul 13 15:51:21.251237 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.251197    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-credential-socket\") pod \"e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv\" (UID: \"bd2bc50a-f4e3-4ab3-8f96-a49be3250494\") " pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv"
Jul 13 15:51:21.251341 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.251293    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-istiod-ca-cert\") pod \"e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv\" (UID: \"bd2bc50a-f4e3-4ab3-8f96-a49be3250494\") " pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv"
Jul 13 15:51:21.257573 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.257515    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-istio-envoy\") pod \"e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv\" (UID: \"bd2bc50a-f4e3-4ab3-8f96-a49be3250494\") " pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv"
Jul 13 15:51:21.258850 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.258161    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-istio-podinfo\") pod \"e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv\" (UID: \"bd2bc50a-f4e3-4ab3-8f96-a49be3250494\") " pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv"
Jul 13 15:51:21.259804 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.259783    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-istio-token\") pod \"e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv\" (UID: \"bd2bc50a-f4e3-4ab3-8f96-a49be3250494\") " pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv"
Jul 13 15:51:21.260097 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.260076    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4krc9\" (UniqueName: \"kubernetes.io/projected/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-kube-api-access-4krc9\") pod \"e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv\" (UID: \"bd2bc50a-f4e3-4ab3-8f96-a49be3250494\") " pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv"
Jul 13 15:51:21.285296 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.285271    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:51:21.372014 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.371923    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv"
Jul 13 15:51:21.514406 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.514377    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv"]
Jul 13 15:51:21.516776 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:51:21.516751    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd2bc50a_f4e3_4ab3_8f96_a49be3250494.slice/crio-e098ebf82127a6a3df0b01bf4380175f7699d91fcef56da7df3a6391648abd0f WatchSource:0}: Error finding container e098ebf82127a6a3df0b01bf4380175f7699d91fcef56da7df3a6391648abd0f: Status 404 returned error can't find the container with id e098ebf82127a6a3df0b01bf4380175f7699d91fcef56da7df3a6391648abd0f
Jul 13 15:51:21.519660 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.519625    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 15:51:21.519755 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.519692    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 15:51:21.519755 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:21.519721    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 15:51:22.203703 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:22.203666    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv" event={"ID":"bd2bc50a-f4e3-4ab3-8f96-a49be3250494","Type":"ContainerStarted","Data":"b261769e579272c5fbed303ab0df542733778c2aac2347ba8eeb8c130a2e1c2d"}
Jul 13 15:51:22.204089 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:22.203727    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv" event={"ID":"bd2bc50a-f4e3-4ab3-8f96-a49be3250494","Type":"ContainerStarted","Data":"e098ebf82127a6a3df0b01bf4380175f7699d91fcef56da7df3a6391648abd0f"}
Jul 13 15:51:22.227617 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:22.227555    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv" podStartSLOduration=1.22753958 podStartE2EDuration="1.22753958s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:51:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:51:22.224363617 +0000 UTC m=+1668.549085510" watchObservedRunningTime="2026-07-13 15:51:22.22753958 +0000 UTC m=+1668.552261476"
Jul 13 15:51:22.290642 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:22.290598    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:51:22.372319 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:22.372278    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv"
Jul 13 15:51:22.378199 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:22.378174    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv"
Jul 13 15:51:22.385876 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:22.385841    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:51:22.511082 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:22.511050    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f762c5e1-6976855cbd-rd8lw"]
Jul 13 15:51:22.514782 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:22.514760    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f762c5e1-6976855cbd-rd8lw"
Jul 13 15:51:22.517299 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:22.517270    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-f762c5e1-serving-cert\""
Jul 13 15:51:22.517417 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:22.517339    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kjwpb\""
Jul 13 15:51:22.528626 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:22.528603    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f762c5e1-6976855cbd-rd8lw"]
Jul 13 15:51:22.544573 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:22.544543    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:51:22.562917 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:22.562895    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/947fabe7-fdb8-4a6e-9f4c-90f295564c45-maas-api-tls\") pod \"maas-api-e2e-ait-f762c5e1-6976855cbd-rd8lw\" (UID: \"947fabe7-fdb8-4a6e-9f4c-90f295564c45\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f762c5e1-6976855cbd-rd8lw"
Jul 13 15:51:22.563048 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:22.562933    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/947fabe7-fdb8-4a6e-9f4c-90f295564c45-openshift-service-ca\") pod \"maas-api-e2e-ait-f762c5e1-6976855cbd-rd8lw\" (UID: \"947fabe7-fdb8-4a6e-9f4c-90f295564c45\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f762c5e1-6976855cbd-rd8lw"
Jul 13 15:51:22.563048 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:22.562952    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5c7n\" (UniqueName: \"kubernetes.io/projected/947fabe7-fdb8-4a6e-9f4c-90f295564c45-kube-api-access-t5c7n\") pod \"maas-api-e2e-ait-f762c5e1-6976855cbd-rd8lw\" (UID: \"947fabe7-fdb8-4a6e-9f4c-90f295564c45\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f762c5e1-6976855cbd-rd8lw"
Jul 13 15:51:22.664467 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:22.664438    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/947fabe7-fdb8-4a6e-9f4c-90f295564c45-maas-api-tls\") pod \"maas-api-e2e-ait-f762c5e1-6976855cbd-rd8lw\" (UID: \"947fabe7-fdb8-4a6e-9f4c-90f295564c45\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f762c5e1-6976855cbd-rd8lw"
Jul 13 15:51:22.664672 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:22.664482    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/947fabe7-fdb8-4a6e-9f4c-90f295564c45-openshift-service-ca\") pod \"maas-api-e2e-ait-f762c5e1-6976855cbd-rd8lw\" (UID: \"947fabe7-fdb8-4a6e-9f4c-90f295564c45\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f762c5e1-6976855cbd-rd8lw"
Jul 13 15:51:22.664672 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:22.664503    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5c7n\" (UniqueName: \"kubernetes.io/projected/947fabe7-fdb8-4a6e-9f4c-90f295564c45-kube-api-access-t5c7n\") pod \"maas-api-e2e-ait-f762c5e1-6976855cbd-rd8lw\" (UID: \"947fabe7-fdb8-4a6e-9f4c-90f295564c45\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f762c5e1-6976855cbd-rd8lw"
Jul 13 15:51:22.665099 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:22.665076    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/947fabe7-fdb8-4a6e-9f4c-90f295564c45-openshift-service-ca\") pod \"maas-api-e2e-ait-f762c5e1-6976855cbd-rd8lw\" (UID: \"947fabe7-fdb8-4a6e-9f4c-90f295564c45\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f762c5e1-6976855cbd-rd8lw"
Jul 13 15:51:22.667070 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:22.667052    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/947fabe7-fdb8-4a6e-9f4c-90f295564c45-maas-api-tls\") pod \"maas-api-e2e-ait-f762c5e1-6976855cbd-rd8lw\" (UID: \"947fabe7-fdb8-4a6e-9f4c-90f295564c45\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f762c5e1-6976855cbd-rd8lw"
Jul 13 15:51:22.671706 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:22.671688    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5c7n\" (UniqueName: \"kubernetes.io/projected/947fabe7-fdb8-4a6e-9f4c-90f295564c45-kube-api-access-t5c7n\") pod \"maas-api-e2e-ait-f762c5e1-6976855cbd-rd8lw\" (UID: \"947fabe7-fdb8-4a6e-9f4c-90f295564c45\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f762c5e1-6976855cbd-rd8lw"
Jul 13 15:51:22.687171 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:22.687147    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:51:22.826949 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:22.826887    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f762c5e1-6976855cbd-rd8lw"
Jul 13 15:51:22.956752 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:22.956727    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f762c5e1-6976855cbd-rd8lw"]
Jul 13 15:51:22.959173 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:51:22.959147    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod947fabe7_fdb8_4a6e_9f4c_90f295564c45.slice/crio-51012e969d66fcea1bb5a789328469cf007e142893b848dcbcef7208bc75efab WatchSource:0}: Error finding container 51012e969d66fcea1bb5a789328469cf007e142893b848dcbcef7208bc75efab: Status 404 returned error can't find the container with id 51012e969d66fcea1bb5a789328469cf007e142893b848dcbcef7208bc75efab
Jul 13 15:51:22.973115 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:22.973093    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:51:23.074424 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:23.074395    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:51:23.209696 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:23.209612    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f762c5e1-6976855cbd-rd8lw" event={"ID":"947fabe7-fdb8-4a6e-9f4c-90f295564c45","Type":"ContainerStarted","Data":"51012e969d66fcea1bb5a789328469cf007e142893b848dcbcef7208bc75efab"}
Jul 13 15:51:23.210129 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:23.209862    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv"
Jul 13 15:51:23.210874 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:23.210857    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv"
Jul 13 15:51:24.215880 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:24.215848    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f762c5e1-6976855cbd-rd8lw" event={"ID":"947fabe7-fdb8-4a6e-9f4c-90f295564c45","Type":"ContainerStarted","Data":"72f992095373ff8b1bf8a8f41cb96959df927a0ec327664cf59abe77435b6372"}
Jul 13 15:51:24.216275 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:24.215976    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f762c5e1-6976855cbd-rd8lw"
Jul 13 15:51:24.234821 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:24.234776    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f762c5e1-6976855cbd-rd8lw" podStartSLOduration=1.629376919 podStartE2EDuration="2.234757896s" totalImagesPullingTime="605.380977ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:51:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:51:24.232200318 +0000 UTC m=+1670.556922217" watchObservedRunningTime="2026-07-13 15:51:24.234757896 +0000 UTC m=+1670.559479797"
Jul 13 15:51:24.702961 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:24.702925    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:51:30.226807 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:30.226771    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f762c5e1-6976855cbd-rd8lw"
Jul 13 15:51:34.269935 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:34.269902    2555 generic.go:356] "Generic (PLEG): container finished" podID="bd2bc50a-f4e3-4ab3-8f96-a49be3250494" containerID="b261769e579272c5fbed303ab0df542733778c2aac2347ba8eeb8c130a2e1c2d" exitCode=0
Jul 13 15:51:34.269935 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:34.269943    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv" event={"ID":"bd2bc50a-f4e3-4ab3-8f96-a49be3250494","Type":"ContainerDied","Data":"b261769e579272c5fbed303ab0df542733778c2aac2347ba8eeb8c130a2e1c2d"}
Jul 13 15:51:34.270466 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:34.270301    2555 scope.go:117] "RemoveContainer" containerID="b261769e579272c5fbed303ab0df542733778c2aac2347ba8eeb8c130a2e1c2d"
Jul 13 15:51:34.271263 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:34.271230    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 15:51:34.271360 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:34.271319    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 15:51:34.271424 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:34.271379    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 15:51:35.281829 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:35.281781    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv" event={"ID":"bd2bc50a-f4e3-4ab3-8f96-a49be3250494","Type":"ContainerStarted","Data":"a7edb0ea99408312a7c457a9f5ee81ea47cc11ff9c575c45bab8384d617d856c"}
Jul 13 15:51:35.372435 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:35.372397    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv"
Jul 13 15:51:35.373597 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:35.373548    2555 patch_prober.go:28] interesting pod/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 13 15:51:35.373735 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:35.373635    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv" podUID="bd2bc50a-f4e3-4ab3-8f96-a49be3250494" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 13 15:51:36.373117 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:36.373079    2555 patch_prober.go:28] interesting pod/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 13 15:51:36.373722 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:36.373682    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv" podUID="bd2bc50a-f4e3-4ab3-8f96-a49be3250494" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 13 15:51:37.373229 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:37.373179    2555 patch_prober.go:28] interesting pod/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 13 15:51:37.373755 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:37.373264    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv" podUID="bd2bc50a-f4e3-4ab3-8f96-a49be3250494" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 13 15:51:38.210604 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:38.210552    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv"
Jul 13 15:51:38.372814 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:38.372776    2555 patch_prober.go:28] interesting pod/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 13 15:51:38.373096 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:38.373067    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv" podUID="bd2bc50a-f4e3-4ab3-8f96-a49be3250494" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 13 15:51:39.376433 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:39.376402    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv"
Jul 13 15:51:39.377457 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:51:39.377438    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv"
Jul 13 15:52:27.946917 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:27.946885    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f762c5e1-6976855cbd-rd8lw"]
Jul 13 15:52:27.947421 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:27.947121    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f762c5e1-6976855cbd-rd8lw" podUID="947fabe7-fdb8-4a6e-9f4c-90f295564c45" containerName="maas-api" containerID="cri-o://72f992095373ff8b1bf8a8f41cb96959df927a0ec327664cf59abe77435b6372" gracePeriod=30
Jul 13 15:52:27.969127 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:27.969103    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:52:28.201404 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:28.201339    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f762c5e1-6976855cbd-rd8lw"
Jul 13 15:52:28.247505 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:28.247480    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/947fabe7-fdb8-4a6e-9f4c-90f295564c45-maas-api-tls\") pod \"947fabe7-fdb8-4a6e-9f4c-90f295564c45\" (UID: \"947fabe7-fdb8-4a6e-9f4c-90f295564c45\") "
Jul 13 15:52:28.247679 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:28.247516    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5c7n\" (UniqueName: \"kubernetes.io/projected/947fabe7-fdb8-4a6e-9f4c-90f295564c45-kube-api-access-t5c7n\") pod \"947fabe7-fdb8-4a6e-9f4c-90f295564c45\" (UID: \"947fabe7-fdb8-4a6e-9f4c-90f295564c45\") "
Jul 13 15:52:28.247679 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:28.247622    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/947fabe7-fdb8-4a6e-9f4c-90f295564c45-openshift-service-ca\") pod \"947fabe7-fdb8-4a6e-9f4c-90f295564c45\" (UID: \"947fabe7-fdb8-4a6e-9f4c-90f295564c45\") "
Jul 13 15:52:28.248033 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:28.248005    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/947fabe7-fdb8-4a6e-9f4c-90f295564c45-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "947fabe7-fdb8-4a6e-9f4c-90f295564c45" (UID: "947fabe7-fdb8-4a6e-9f4c-90f295564c45"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:52:28.249745 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:28.249721    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/947fabe7-fdb8-4a6e-9f4c-90f295564c45-kube-api-access-t5c7n" (OuterVolumeSpecName: "kube-api-access-t5c7n") pod "947fabe7-fdb8-4a6e-9f4c-90f295564c45" (UID: "947fabe7-fdb8-4a6e-9f4c-90f295564c45"). InnerVolumeSpecName "kube-api-access-t5c7n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:52:28.249861 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:28.249841    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/947fabe7-fdb8-4a6e-9f4c-90f295564c45-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "947fabe7-fdb8-4a6e-9f4c-90f295564c45" (UID: "947fabe7-fdb8-4a6e-9f4c-90f295564c45"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 15:52:28.349020 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:28.348997    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/947fabe7-fdb8-4a6e-9f4c-90f295564c45-maas-api-tls\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:52:28.349020 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:28.349018    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5c7n\" (UniqueName: \"kubernetes.io/projected/947fabe7-fdb8-4a6e-9f4c-90f295564c45-kube-api-access-t5c7n\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:52:28.349152 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:28.349028    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/947fabe7-fdb8-4a6e-9f4c-90f295564c45-openshift-service-ca\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:52:28.542523 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:28.542492    2555 generic.go:356] "Generic (PLEG): container finished" podID="947fabe7-fdb8-4a6e-9f4c-90f295564c45" containerID="72f992095373ff8b1bf8a8f41cb96959df927a0ec327664cf59abe77435b6372" exitCode=0
Jul 13 15:52:28.542696 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:28.542535    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f762c5e1-6976855cbd-rd8lw"
Jul 13 15:52:28.542696 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:28.542577    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f762c5e1-6976855cbd-rd8lw" event={"ID":"947fabe7-fdb8-4a6e-9f4c-90f295564c45","Type":"ContainerDied","Data":"72f992095373ff8b1bf8a8f41cb96959df927a0ec327664cf59abe77435b6372"}
Jul 13 15:52:28.542696 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:28.542648    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f762c5e1-6976855cbd-rd8lw" event={"ID":"947fabe7-fdb8-4a6e-9f4c-90f295564c45","Type":"ContainerDied","Data":"51012e969d66fcea1bb5a789328469cf007e142893b848dcbcef7208bc75efab"}
Jul 13 15:52:28.542696 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:28.542671    2555 scope.go:117] "RemoveContainer" containerID="72f992095373ff8b1bf8a8f41cb96959df927a0ec327664cf59abe77435b6372"
Jul 13 15:52:28.557695 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:28.557672    2555 scope.go:117] "RemoveContainer" containerID="72f992095373ff8b1bf8a8f41cb96959df927a0ec327664cf59abe77435b6372"
Jul 13 15:52:28.557944 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:52:28.557926    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72f992095373ff8b1bf8a8f41cb96959df927a0ec327664cf59abe77435b6372\": container with ID starting with 72f992095373ff8b1bf8a8f41cb96959df927a0ec327664cf59abe77435b6372 not found: ID does not exist" containerID="72f992095373ff8b1bf8a8f41cb96959df927a0ec327664cf59abe77435b6372"
Jul 13 15:52:28.558004 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:28.557952    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72f992095373ff8b1bf8a8f41cb96959df927a0ec327664cf59abe77435b6372"} err="failed to get container status \"72f992095373ff8b1bf8a8f41cb96959df927a0ec327664cf59abe77435b6372\": rpc error: code = NotFound desc = could not find container \"72f992095373ff8b1bf8a8f41cb96959df927a0ec327664cf59abe77435b6372\": container with ID starting with 72f992095373ff8b1bf8a8f41cb96959df927a0ec327664cf59abe77435b6372 not found: ID does not exist"
Jul 13 15:52:28.567241 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:28.567215    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f762c5e1-6976855cbd-rd8lw"]
Jul 13 15:52:28.573181 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:28.573159    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f762c5e1-6976855cbd-rd8lw"]
Jul 13 15:52:30.203243 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:30.203213    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="947fabe7-fdb8-4a6e-9f4c-90f295564c45" path="/var/lib/kubelet/pods/947fabe7-fdb8-4a6e-9f4c-90f295564c45/volumes"
Jul 13 15:52:32.498711 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:32.498678    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:52:38.759792 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:38.759756    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:52:38.826628 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:38.826579    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:52:43.536050 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:43.536014    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv"]
Jul 13 15:52:43.536462 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:43.536213    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv" podUID="bd2bc50a-f4e3-4ab3-8f96-a49be3250494" containerName="istio-proxy" containerID="cri-o://a7edb0ea99408312a7c457a9f5ee81ea47cc11ff9c575c45bab8384d617d856c" gracePeriod=30
Jul 13 15:52:43.561384 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:43.561353    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:52:43.842457 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:43.842373    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96"]
Jul 13 15:52:43.842981 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:43.842965    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="947fabe7-fdb8-4a6e-9f4c-90f295564c45" containerName="maas-api"
Jul 13 15:52:43.843031 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:43.842985    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="947fabe7-fdb8-4a6e-9f4c-90f295564c45" containerName="maas-api"
Jul 13 15:52:43.843090 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:43.843078    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="947fabe7-fdb8-4a6e-9f4c-90f295564c45" containerName="maas-api"
Jul 13 15:52:43.846551 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:43.846528    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96"
Jul 13 15:52:43.848853 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:43.848830    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-d997b9d6-openshift-default-dockercfg-gzjbt\""
Jul 13 15:52:43.858715 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:43.858686    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96"]
Jul 13 15:52:43.872415 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:43.872385    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:52:43.995312 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:43.995272    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f58e558-e501-440e-851f-eafbd15556c0-istio-token\") pod \"e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96\" (UID: \"0f58e558-e501-440e-851f-eafbd15556c0\") " pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96"
Jul 13 15:52:43.995312 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:43.995312    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f58e558-e501-440e-851f-eafbd15556c0-istiod-ca-cert\") pod \"e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96\" (UID: \"0f58e558-e501-440e-851f-eafbd15556c0\") " pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96"
Jul 13 15:52:43.995524 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:43.995411    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f58e558-e501-440e-851f-eafbd15556c0-credential-socket\") pod \"e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96\" (UID: \"0f58e558-e501-440e-851f-eafbd15556c0\") " pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96"
Jul 13 15:52:43.995524 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:43.995470    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f58e558-e501-440e-851f-eafbd15556c0-workload-certs\") pod \"e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96\" (UID: \"0f58e558-e501-440e-851f-eafbd15556c0\") " pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96"
Jul 13 15:52:43.995524 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:43.995514    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f58e558-e501-440e-851f-eafbd15556c0-istio-data\") pod \"e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96\" (UID: \"0f58e558-e501-440e-851f-eafbd15556c0\") " pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96"
Jul 13 15:52:43.995668 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:43.995540    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f58e558-e501-440e-851f-eafbd15556c0-workload-socket\") pod \"e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96\" (UID: \"0f58e558-e501-440e-851f-eafbd15556c0\") " pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96"
Jul 13 15:52:43.995668 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:43.995560    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f58e558-e501-440e-851f-eafbd15556c0-istio-podinfo\") pod \"e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96\" (UID: \"0f58e558-e501-440e-851f-eafbd15556c0\") " pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96"
Jul 13 15:52:43.995668 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:43.995612    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f58e558-e501-440e-851f-eafbd15556c0-istio-envoy\") pod \"e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96\" (UID: \"0f58e558-e501-440e-851f-eafbd15556c0\") " pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96"
Jul 13 15:52:43.995668 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:43.995652    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktn4s\" (UniqueName: \"kubernetes.io/projected/0f58e558-e501-440e-851f-eafbd15556c0-kube-api-access-ktn4s\") pod \"e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96\" (UID: \"0f58e558-e501-440e-851f-eafbd15556c0\") " pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96"
Jul 13 15:52:44.097184 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:44.097083    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f58e558-e501-440e-851f-eafbd15556c0-credential-socket\") pod \"e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96\" (UID: \"0f58e558-e501-440e-851f-eafbd15556c0\") " pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96"
Jul 13 15:52:44.097184 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:44.097137    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f58e558-e501-440e-851f-eafbd15556c0-workload-certs\") pod \"e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96\" (UID: \"0f58e558-e501-440e-851f-eafbd15556c0\") " pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96"
Jul 13 15:52:44.097184 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:44.097175    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f58e558-e501-440e-851f-eafbd15556c0-istio-data\") pod \"e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96\" (UID: \"0f58e558-e501-440e-851f-eafbd15556c0\") " pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96"
Jul 13 15:52:44.097473 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:44.097206    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f58e558-e501-440e-851f-eafbd15556c0-workload-socket\") pod \"e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96\" (UID: \"0f58e558-e501-440e-851f-eafbd15556c0\") " pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96"
Jul 13 15:52:44.097473 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:44.097235    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f58e558-e501-440e-851f-eafbd15556c0-istio-podinfo\") pod \"e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96\" (UID: \"0f58e558-e501-440e-851f-eafbd15556c0\") " pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96"
Jul 13 15:52:44.097473 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:44.097258    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f58e558-e501-440e-851f-eafbd15556c0-istio-envoy\") pod \"e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96\" (UID: \"0f58e558-e501-440e-851f-eafbd15556c0\") " pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96"
Jul 13 15:52:44.097473 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:44.097307    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktn4s\" (UniqueName: \"kubernetes.io/projected/0f58e558-e501-440e-851f-eafbd15556c0-kube-api-access-ktn4s\") pod \"e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96\" (UID: \"0f58e558-e501-440e-851f-eafbd15556c0\") " pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96"
Jul 13 15:52:44.097701 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:44.097566    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f58e558-e501-440e-851f-eafbd15556c0-credential-socket\") pod \"e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96\" (UID: \"0f58e558-e501-440e-851f-eafbd15556c0\") " pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96"
Jul 13 15:52:44.097701 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:44.097620    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f58e558-e501-440e-851f-eafbd15556c0-workload-certs\") pod \"e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96\" (UID: \"0f58e558-e501-440e-851f-eafbd15556c0\") " pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96"
Jul 13 15:52:44.097701 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:44.097680    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f58e558-e501-440e-851f-eafbd15556c0-workload-socket\") pod \"e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96\" (UID: \"0f58e558-e501-440e-851f-eafbd15556c0\") " pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96"
Jul 13 15:52:44.097853 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:44.097355    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f58e558-e501-440e-851f-eafbd15556c0-istio-token\") pod \"e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96\" (UID: \"0f58e558-e501-440e-851f-eafbd15556c0\") " pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96"
Jul 13 15:52:44.097853 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:44.097767    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f58e558-e501-440e-851f-eafbd15556c0-istiod-ca-cert\") pod \"e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96\" (UID: \"0f58e558-e501-440e-851f-eafbd15556c0\") " pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96"
Jul 13 15:52:44.097853 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:44.097719    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f58e558-e501-440e-851f-eafbd15556c0-istio-data\") pod \"e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96\" (UID: \"0f58e558-e501-440e-851f-eafbd15556c0\") " pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96"
Jul 13 15:52:44.098342 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:44.098320    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f58e558-e501-440e-851f-eafbd15556c0-istiod-ca-cert\") pod \"e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96\" (UID: \"0f58e558-e501-440e-851f-eafbd15556c0\") " pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96"
Jul 13 15:52:44.099576 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:44.099555    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f58e558-e501-440e-851f-eafbd15556c0-istio-envoy\") pod \"e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96\" (UID: \"0f58e558-e501-440e-851f-eafbd15556c0\") " pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96"
Jul 13 15:52:44.099891 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:44.099875    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f58e558-e501-440e-851f-eafbd15556c0-istio-podinfo\") pod \"e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96\" (UID: \"0f58e558-e501-440e-851f-eafbd15556c0\") " pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96"
Jul 13 15:52:44.106888 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:44.106868    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f58e558-e501-440e-851f-eafbd15556c0-istio-token\") pod \"e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96\" (UID: \"0f58e558-e501-440e-851f-eafbd15556c0\") " pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96"
Jul 13 15:52:44.107451 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:44.107426    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktn4s\" (UniqueName: \"kubernetes.io/projected/0f58e558-e501-440e-851f-eafbd15556c0-kube-api-access-ktn4s\") pod \"e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96\" (UID: \"0f58e558-e501-440e-851f-eafbd15556c0\") " pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96"
Jul 13 15:52:44.160452 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:44.160408    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96"
Jul 13 15:52:44.303144 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:44.303120    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96"]
Jul 13 15:52:44.305144 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:52:44.305118    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f58e558_e501_440e_851f_eafbd15556c0.slice/crio-8604ef102753010d1b49eb1f5ca147943f528c248e9d3f0814ed66bf2cc6ab29 WatchSource:0}: Error finding container 8604ef102753010d1b49eb1f5ca147943f528c248e9d3f0814ed66bf2cc6ab29: Status 404 returned error can't find the container with id 8604ef102753010d1b49eb1f5ca147943f528c248e9d3f0814ed66bf2cc6ab29
Jul 13 15:52:44.307500 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:44.307467    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 15:52:44.307602 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:44.307528    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 15:52:44.307602 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:44.307556    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 15:52:44.628506 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:44.628404    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96" event={"ID":"0f58e558-e501-440e-851f-eafbd15556c0","Type":"ContainerStarted","Data":"9954679800cdad7a8792678056a4ed132db7c4e967d9ed0bf4b6a2ac13a79701"}
Jul 13 15:52:44.628506 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:44.628468    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96" event={"ID":"0f58e558-e501-440e-851f-eafbd15556c0","Type":"ContainerStarted","Data":"8604ef102753010d1b49eb1f5ca147943f528c248e9d3f0814ed66bf2cc6ab29"}
Jul 13 15:52:44.649660 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:44.649573    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96" podStartSLOduration=1.64955599 podStartE2EDuration="1.64955599s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:52:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:52:44.647552247 +0000 UTC m=+1750.972274142" watchObservedRunningTime="2026-07-13 15:52:44.64955599 +0000 UTC m=+1750.974277887"
Jul 13 15:52:44.860370 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:44.860319    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:52:44.961409 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:44.961325    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:52:45.060851 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:45.060821    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:52:45.161122 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:45.161080    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96"
Jul 13 15:52:45.166815 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:45.166784    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96"
Jul 13 15:52:45.215927 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:45.215849    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-d997b9d6-5f979968bb-cnwsf"]
Jul 13 15:52:45.220062 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:45.220042    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d997b9d6-5f979968bb-cnwsf"
Jul 13 15:52:45.222279 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:45.222253    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-d997b9d6-serving-cert\""
Jul 13 15:52:45.222406 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:45.222341    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kjwpb\""
Jul 13 15:52:45.230287 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:45.230260    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-d997b9d6-5f979968bb-cnwsf"]
Jul 13 15:52:45.249741 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:45.249712    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:52:45.309882 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:45.309848    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz8qp\" (UniqueName: \"kubernetes.io/projected/ef1249cb-5385-4c6f-ba9a-2f4041997ecc-kube-api-access-qz8qp\") pod \"maas-api-e2e-derive-d997b9d6-5f979968bb-cnwsf\" (UID: \"ef1249cb-5385-4c6f-ba9a-2f4041997ecc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d997b9d6-5f979968bb-cnwsf"
Jul 13 15:52:45.310091 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:45.309971    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef1249cb-5385-4c6f-ba9a-2f4041997ecc-openshift-service-ca\") pod \"maas-api-e2e-derive-d997b9d6-5f979968bb-cnwsf\" (UID: \"ef1249cb-5385-4c6f-ba9a-2f4041997ecc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d997b9d6-5f979968bb-cnwsf"
Jul 13 15:52:45.310091 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:45.310052    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef1249cb-5385-4c6f-ba9a-2f4041997ecc-maas-api-tls\") pod \"maas-api-e2e-derive-d997b9d6-5f979968bb-cnwsf\" (UID: \"ef1249cb-5385-4c6f-ba9a-2f4041997ecc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d997b9d6-5f979968bb-cnwsf"
Jul 13 15:52:45.411151 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:45.411108    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef1249cb-5385-4c6f-ba9a-2f4041997ecc-openshift-service-ca\") pod \"maas-api-e2e-derive-d997b9d6-5f979968bb-cnwsf\" (UID: \"ef1249cb-5385-4c6f-ba9a-2f4041997ecc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d997b9d6-5f979968bb-cnwsf"
Jul 13 15:52:45.411338 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:45.411164    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef1249cb-5385-4c6f-ba9a-2f4041997ecc-maas-api-tls\") pod \"maas-api-e2e-derive-d997b9d6-5f979968bb-cnwsf\" (UID: \"ef1249cb-5385-4c6f-ba9a-2f4041997ecc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d997b9d6-5f979968bb-cnwsf"
Jul 13 15:52:45.411338 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:45.411206    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz8qp\" (UniqueName: \"kubernetes.io/projected/ef1249cb-5385-4c6f-ba9a-2f4041997ecc-kube-api-access-qz8qp\") pod \"maas-api-e2e-derive-d997b9d6-5f979968bb-cnwsf\" (UID: \"ef1249cb-5385-4c6f-ba9a-2f4041997ecc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d997b9d6-5f979968bb-cnwsf"
Jul 13 15:52:45.411840 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:45.411817    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef1249cb-5385-4c6f-ba9a-2f4041997ecc-openshift-service-ca\") pod \"maas-api-e2e-derive-d997b9d6-5f979968bb-cnwsf\" (UID: \"ef1249cb-5385-4c6f-ba9a-2f4041997ecc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d997b9d6-5f979968bb-cnwsf"
Jul 13 15:52:45.413855 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:45.413823    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:52:45.413977 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:45.413930    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef1249cb-5385-4c6f-ba9a-2f4041997ecc-maas-api-tls\") pod \"maas-api-e2e-derive-d997b9d6-5f979968bb-cnwsf\" (UID: \"ef1249cb-5385-4c6f-ba9a-2f4041997ecc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d997b9d6-5f979968bb-cnwsf"
Jul 13 15:52:45.419052 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:45.419027    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz8qp\" (UniqueName: \"kubernetes.io/projected/ef1249cb-5385-4c6f-ba9a-2f4041997ecc-kube-api-access-qz8qp\") pod \"maas-api-e2e-derive-d997b9d6-5f979968bb-cnwsf\" (UID: \"ef1249cb-5385-4c6f-ba9a-2f4041997ecc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d997b9d6-5f979968bb-cnwsf"
Jul 13 15:52:45.533230 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:45.533181    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d997b9d6-5f979968bb-cnwsf"
Jul 13 15:52:45.634107 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:45.634071    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96"
Jul 13 15:52:45.635685 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:45.635654    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96"
Jul 13 15:52:45.679906 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:45.679876    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-d997b9d6-5f979968bb-cnwsf"]
Jul 13 15:52:45.681497 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:52:45.681466    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef1249cb_5385_4c6f_ba9a_2f4041997ecc.slice/crio-e8ee7a842cf2f94d9163e2fd19213f422436cc5958caf3a122ad16ed97673593 WatchSource:0}: Error finding container e8ee7a842cf2f94d9163e2fd19213f422436cc5958caf3a122ad16ed97673593: Status 404 returned error can't find the container with id e8ee7a842cf2f94d9163e2fd19213f422436cc5958caf3a122ad16ed97673593
Jul 13 15:52:45.839784 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:45.839688    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:52:45.941095 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:45.941061    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:52:46.641037 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:46.640997    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d997b9d6-5f979968bb-cnwsf" event={"ID":"ef1249cb-5385-4c6f-ba9a-2f4041997ecc","Type":"ContainerStarted","Data":"85ed906d261aa5cb8029dc641727238275db0e07240c4d9c588ad72821b3f381"}
Jul 13 15:52:46.641524 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:46.641212    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d997b9d6-5f979968bb-cnwsf"
Jul 13 15:52:46.641524 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:46.641253    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d997b9d6-5f979968bb-cnwsf" event={"ID":"ef1249cb-5385-4c6f-ba9a-2f4041997ecc","Type":"ContainerStarted","Data":"e8ee7a842cf2f94d9163e2fd19213f422436cc5958caf3a122ad16ed97673593"}
Jul 13 15:52:46.657378 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:46.657333    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d997b9d6-5f979968bb-cnwsf" podStartSLOduration=1.244358969 podStartE2EDuration="1.657318514s" totalImagesPullingTime="412.959545ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:52:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:52:46.656464439 +0000 UTC m=+1752.981186357" watchObservedRunningTime="2026-07-13 15:52:46.657318514 +0000 UTC m=+1752.982040411"
Jul 13 15:52:48.656945 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:48.656918    2555 generic.go:356] "Generic (PLEG): container finished" podID="bd2bc50a-f4e3-4ab3-8f96-a49be3250494" containerID="a7edb0ea99408312a7c457a9f5ee81ea47cc11ff9c575c45bab8384d617d856c" exitCode=0
Jul 13 15:52:48.657257 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:48.656977    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv" event={"ID":"bd2bc50a-f4e3-4ab3-8f96-a49be3250494","Type":"ContainerDied","Data":"a7edb0ea99408312a7c457a9f5ee81ea47cc11ff9c575c45bab8384d617d856c"}
Jul 13 15:52:48.657257 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:48.657025    2555 scope.go:117] "RemoveContainer" containerID="b261769e579272c5fbed303ab0df542733778c2aac2347ba8eeb8c130a2e1c2d"
Jul 13 15:52:48.797376 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:48.797313    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv"
Jul 13 15:52:48.946838 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:48.946809    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-istio-envoy\") pod \"bd2bc50a-f4e3-4ab3-8f96-a49be3250494\" (UID: \"bd2bc50a-f4e3-4ab3-8f96-a49be3250494\") "
Jul 13 15:52:48.946989 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:48.946855    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-istio-data\") pod \"bd2bc50a-f4e3-4ab3-8f96-a49be3250494\" (UID: \"bd2bc50a-f4e3-4ab3-8f96-a49be3250494\") "
Jul 13 15:52:48.946989 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:48.946889    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-istio-token\") pod \"bd2bc50a-f4e3-4ab3-8f96-a49be3250494\" (UID: \"bd2bc50a-f4e3-4ab3-8f96-a49be3250494\") "
Jul 13 15:52:48.946989 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:48.946914    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4krc9\" (UniqueName: \"kubernetes.io/projected/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-kube-api-access-4krc9\") pod \"bd2bc50a-f4e3-4ab3-8f96-a49be3250494\" (UID: \"bd2bc50a-f4e3-4ab3-8f96-a49be3250494\") "
Jul 13 15:52:48.946989 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:48.946954    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-istiod-ca-cert\") pod \"bd2bc50a-f4e3-4ab3-8f96-a49be3250494\" (UID: \"bd2bc50a-f4e3-4ab3-8f96-a49be3250494\") "
Jul 13 15:52:48.947218 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:48.947111    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-workload-socket\") pod \"bd2bc50a-f4e3-4ab3-8f96-a49be3250494\" (UID: \"bd2bc50a-f4e3-4ab3-8f96-a49be3250494\") "
Jul 13 15:52:48.947218 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:48.947153    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-workload-certs\") pod \"bd2bc50a-f4e3-4ab3-8f96-a49be3250494\" (UID: \"bd2bc50a-f4e3-4ab3-8f96-a49be3250494\") "
Jul 13 15:52:48.947218 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:48.947205    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-credential-socket\") pod \"bd2bc50a-f4e3-4ab3-8f96-a49be3250494\" (UID: \"bd2bc50a-f4e3-4ab3-8f96-a49be3250494\") "
Jul 13 15:52:48.947374 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:48.947248    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-istio-podinfo\") pod \"bd2bc50a-f4e3-4ab3-8f96-a49be3250494\" (UID: \"bd2bc50a-f4e3-4ab3-8f96-a49be3250494\") "
Jul 13 15:52:48.947435 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:48.947379    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bd2bc50a-f4e3-4ab3-8f96-a49be3250494" (UID: "bd2bc50a-f4e3-4ab3-8f96-a49be3250494"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:52:48.947435 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:48.947412    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bd2bc50a-f4e3-4ab3-8f96-a49be3250494" (UID: "bd2bc50a-f4e3-4ab3-8f96-a49be3250494"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:52:48.947655 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:48.947628    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bd2bc50a-f4e3-4ab3-8f96-a49be3250494" (UID: "bd2bc50a-f4e3-4ab3-8f96-a49be3250494"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:52:48.947788 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:48.947773    2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-istiod-ca-cert\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:52:48.947847 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:48.947780    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bd2bc50a-f4e3-4ab3-8f96-a49be3250494" (UID: "bd2bc50a-f4e3-4ab3-8f96-a49be3250494"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:52:48.947847 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:48.947794    2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-workload-socket\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:52:48.947847 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:48.947807    2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-workload-certs\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:52:48.947973 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:48.947893    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-istio-data" (OuterVolumeSpecName: "istio-data") pod "bd2bc50a-f4e3-4ab3-8f96-a49be3250494" (UID: "bd2bc50a-f4e3-4ab3-8f96-a49be3250494"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:52:48.949230 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:48.949202    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-istio-token" (OuterVolumeSpecName: "istio-token") pod "bd2bc50a-f4e3-4ab3-8f96-a49be3250494" (UID: "bd2bc50a-f4e3-4ab3-8f96-a49be3250494"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:52:48.949393 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:48.949374    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bd2bc50a-f4e3-4ab3-8f96-a49be3250494" (UID: "bd2bc50a-f4e3-4ab3-8f96-a49be3250494"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:52:48.949457 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:48.949442    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-kube-api-access-4krc9" (OuterVolumeSpecName: "kube-api-access-4krc9") pod "bd2bc50a-f4e3-4ab3-8f96-a49be3250494" (UID: "bd2bc50a-f4e3-4ab3-8f96-a49be3250494"). InnerVolumeSpecName "kube-api-access-4krc9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:52:48.949636 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:48.949617    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bd2bc50a-f4e3-4ab3-8f96-a49be3250494" (UID: "bd2bc50a-f4e3-4ab3-8f96-a49be3250494"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 15:52:49.048356 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:49.048295    2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-istio-envoy\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:52:49.048356 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:49.048315    2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-istio-data\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:52:49.048356 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:49.048323    2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-istio-token\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:52:49.048356 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:49.048331    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4krc9\" (UniqueName: \"kubernetes.io/projected/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-kube-api-access-4krc9\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:52:49.048356 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:49.048340    2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-credential-socket\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:52:49.048356 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:49.048348    2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd2bc50a-f4e3-4ab3-8f96-a49be3250494-istio-podinfo\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:52:49.663324 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:49.663280    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv" event={"ID":"bd2bc50a-f4e3-4ab3-8f96-a49be3250494","Type":"ContainerDied","Data":"e098ebf82127a6a3df0b01bf4380175f7699d91fcef56da7df3a6391648abd0f"}
Jul 13 15:52:49.663324 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:49.663313    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv"
Jul 13 15:52:49.663835 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:49.663387    2555 scope.go:117] "RemoveContainer" containerID="a7edb0ea99408312a7c457a9f5ee81ea47cc11ff9c575c45bab8384d617d856c"
Jul 13 15:52:49.684920 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:49.684893    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv"]
Jul 13 15:52:49.688326 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:49.688306    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-f762c5e1-openshift-default-6676979c8f-6jjrv"]
Jul 13 15:52:50.078046 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:50.078008    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:52:50.180262 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:50.180231    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:52:50.204271 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:50.204240    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd2bc50a-f4e3-4ab3-8f96-a49be3250494" path="/var/lib/kubelet/pods/bd2bc50a-f4e3-4ab3-8f96-a49be3250494/volumes"
Jul 13 15:52:52.654792 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:52.654762    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d997b9d6-5f979968bb-cnwsf"
Jul 13 15:52:53.330708 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:52:53.330677    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:53:01.339061 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:01.337085    2555 patch_prober.go:28] interesting pod/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": read tcp 10.132.0.2:39336->10.132.0.54:15021: read: connection reset by peer" start-of-body=
Jul 13 15:53:01.339061 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:01.337153    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96" podUID="0f58e558-e501-440e-851f-eafbd15556c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": read tcp 10.132.0.2:39336->10.132.0.54:15021: read: connection reset by peer"
Jul 13 15:53:01.724782 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:01.724752    2555 generic.go:356] "Generic (PLEG): container finished" podID="0f58e558-e501-440e-851f-eafbd15556c0" containerID="9954679800cdad7a8792678056a4ed132db7c4e967d9ed0bf4b6a2ac13a79701" exitCode=0
Jul 13 15:53:01.724955 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:01.724822    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96" event={"ID":"0f58e558-e501-440e-851f-eafbd15556c0","Type":"ContainerDied","Data":"9954679800cdad7a8792678056a4ed132db7c4e967d9ed0bf4b6a2ac13a79701"}
Jul 13 15:53:01.725175 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:01.725162    2555 scope.go:117] "RemoveContainer" containerID="9954679800cdad7a8792678056a4ed132db7c4e967d9ed0bf4b6a2ac13a79701"
Jul 13 15:53:01.726147 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:01.726121    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 15:53:01.726254 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:01.726198    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 15:53:01.726254 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:01.726227    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 15:53:02.731510 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:02.731476    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96" event={"ID":"0f58e558-e501-440e-851f-eafbd15556c0","Type":"ContainerStarted","Data":"7edd74d0e7dc2daf28ec234f82f85b88f30a04e260728de286b9ac646bd70581"}
Jul 13 15:53:03.161327 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:03.161237    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96"
Jul 13 15:53:03.161476 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:03.161455    2555 patch_prober.go:28] interesting pod/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 13 15:53:03.161527 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:03.161507    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96" podUID="0f58e558-e501-440e-851f-eafbd15556c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 13 15:53:04.161152 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:04.161121    2555 patch_prober.go:28] interesting pod/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 13 15:53:04.161534 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:04.161175    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96" podUID="0f58e558-e501-440e-851f-eafbd15556c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 13 15:53:05.161336 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:05.161299    2555 patch_prober.go:28] interesting pod/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 13 15:53:05.161826 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:05.161361    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96" podUID="0f58e558-e501-440e-851f-eafbd15556c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 13 15:53:06.160835 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:06.160803    2555 patch_prober.go:28] interesting pod/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 13 15:53:06.161012 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:06.160856    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96" podUID="0f58e558-e501-440e-851f-eafbd15556c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 13 15:53:07.164206 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:07.164178    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96"
Jul 13 15:53:07.164661 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:07.164549    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96"
Jul 13 15:53:07.165363 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:07.165345    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96"
Jul 13 15:53:34.267199 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:34.267168    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cptrx_90f53326-a36e-4682-a268-bdfec7cf722b/console-operator/1.log"
Jul 13 15:53:34.273819 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:34.273799    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cptrx_90f53326-a36e-4682-a268-bdfec7cf722b/console-operator/1.log"
Jul 13 15:53:34.274976 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:34.274959    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x8g52_f4724159-d88b-4ed1-a5fc-956a4d1e3fe8/ovn-acl-logging/0.log"
Jul 13 15:53:34.281208 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:34.281192    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x8g52_f4724159-d88b-4ed1-a5fc-956a4d1e3fe8/ovn-acl-logging/0.log"
Jul 13 15:53:49.866024 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:49.865976    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-d997b9d6-5f979968bb-cnwsf"]
Jul 13 15:53:49.866505 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:49.866226    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d997b9d6-5f979968bb-cnwsf" podUID="ef1249cb-5385-4c6f-ba9a-2f4041997ecc" containerName="maas-api" containerID="cri-o://85ed906d261aa5cb8029dc641727238275db0e07240c4d9c588ad72821b3f381" gracePeriod=30
Jul 13 15:53:49.891485 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:49.891457    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:53:50.118228 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:50.118161    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d997b9d6-5f979968bb-cnwsf"
Jul 13 15:53:50.202253 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:50.202222    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qz8qp\" (UniqueName: \"kubernetes.io/projected/ef1249cb-5385-4c6f-ba9a-2f4041997ecc-kube-api-access-qz8qp\") pod \"ef1249cb-5385-4c6f-ba9a-2f4041997ecc\" (UID: \"ef1249cb-5385-4c6f-ba9a-2f4041997ecc\") "
Jul 13 15:53:50.202253 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:50.202257    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef1249cb-5385-4c6f-ba9a-2f4041997ecc-maas-api-tls\") pod \"ef1249cb-5385-4c6f-ba9a-2f4041997ecc\" (UID: \"ef1249cb-5385-4c6f-ba9a-2f4041997ecc\") "
Jul 13 15:53:50.202498 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:50.202284    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef1249cb-5385-4c6f-ba9a-2f4041997ecc-openshift-service-ca\") pod \"ef1249cb-5385-4c6f-ba9a-2f4041997ecc\" (UID: \"ef1249cb-5385-4c6f-ba9a-2f4041997ecc\") "
Jul 13 15:53:50.202714 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:50.202690    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef1249cb-5385-4c6f-ba9a-2f4041997ecc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ef1249cb-5385-4c6f-ba9a-2f4041997ecc" (UID: "ef1249cb-5385-4c6f-ba9a-2f4041997ecc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:53:50.204512 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:50.204416    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef1249cb-5385-4c6f-ba9a-2f4041997ecc-kube-api-access-qz8qp" (OuterVolumeSpecName: "kube-api-access-qz8qp") pod "ef1249cb-5385-4c6f-ba9a-2f4041997ecc" (UID: "ef1249cb-5385-4c6f-ba9a-2f4041997ecc"). InnerVolumeSpecName "kube-api-access-qz8qp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:53:50.204512 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:50.204438    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef1249cb-5385-4c6f-ba9a-2f4041997ecc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ef1249cb-5385-4c6f-ba9a-2f4041997ecc" (UID: "ef1249cb-5385-4c6f-ba9a-2f4041997ecc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 15:53:50.303277 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:50.303194    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qz8qp\" (UniqueName: \"kubernetes.io/projected/ef1249cb-5385-4c6f-ba9a-2f4041997ecc-kube-api-access-qz8qp\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:53:50.303277 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:50.303231    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef1249cb-5385-4c6f-ba9a-2f4041997ecc-maas-api-tls\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:53:50.303277 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:50.303248    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef1249cb-5385-4c6f-ba9a-2f4041997ecc-openshift-service-ca\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:53:50.968699 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:50.968661    2555 generic.go:356] "Generic (PLEG): container finished" podID="ef1249cb-5385-4c6f-ba9a-2f4041997ecc" containerID="85ed906d261aa5cb8029dc641727238275db0e07240c4d9c588ad72821b3f381" exitCode=0
Jul 13 15:53:50.969139 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:50.968712    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d997b9d6-5f979968bb-cnwsf"
Jul 13 15:53:50.969139 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:50.968742    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d997b9d6-5f979968bb-cnwsf" event={"ID":"ef1249cb-5385-4c6f-ba9a-2f4041997ecc","Type":"ContainerDied","Data":"85ed906d261aa5cb8029dc641727238275db0e07240c4d9c588ad72821b3f381"}
Jul 13 15:53:50.969139 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:50.968794    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d997b9d6-5f979968bb-cnwsf" event={"ID":"ef1249cb-5385-4c6f-ba9a-2f4041997ecc","Type":"ContainerDied","Data":"e8ee7a842cf2f94d9163e2fd19213f422436cc5958caf3a122ad16ed97673593"}
Jul 13 15:53:50.969139 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:50.968816    2555 scope.go:117] "RemoveContainer" containerID="85ed906d261aa5cb8029dc641727238275db0e07240c4d9c588ad72821b3f381"
Jul 13 15:53:50.977732 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:50.977672    2555 scope.go:117] "RemoveContainer" containerID="85ed906d261aa5cb8029dc641727238275db0e07240c4d9c588ad72821b3f381"
Jul 13 15:53:50.977969 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:53:50.977952    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85ed906d261aa5cb8029dc641727238275db0e07240c4d9c588ad72821b3f381\": container with ID starting with 85ed906d261aa5cb8029dc641727238275db0e07240c4d9c588ad72821b3f381 not found: ID does not exist" containerID="85ed906d261aa5cb8029dc641727238275db0e07240c4d9c588ad72821b3f381"
Jul 13 15:53:50.978016 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:50.977977    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85ed906d261aa5cb8029dc641727238275db0e07240c4d9c588ad72821b3f381"} err="failed to get container status \"85ed906d261aa5cb8029dc641727238275db0e07240c4d9c588ad72821b3f381\": rpc error: code = NotFound desc = could not find container \"85ed906d261aa5cb8029dc641727238275db0e07240c4d9c588ad72821b3f381\": container with ID starting with 85ed906d261aa5cb8029dc641727238275db0e07240c4d9c588ad72821b3f381 not found: ID does not exist"
Jul 13 15:53:50.992632 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:50.992598    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-d997b9d6-5f979968bb-cnwsf"]
Jul 13 15:53:50.997109 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:50.997080    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-d997b9d6-5f979968bb-cnwsf"]
Jul 13 15:53:52.203397 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:52.203354    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef1249cb-5385-4c6f-ba9a-2f4041997ecc" path="/var/lib/kubelet/pods/ef1249cb-5385-4c6f-ba9a-2f4041997ecc/volumes"
Jul 13 15:53:54.551203 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:53:54.551159    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:54:00.500122 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:00.500091    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:54:00.600275 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:00.600250    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:54:04.719637 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:04.718622    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96"]
Jul 13 15:54:04.719637 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:04.718922    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96" podUID="0f58e558-e501-440e-851f-eafbd15556c0" containerName="istio-proxy" containerID="cri-o://7edd74d0e7dc2daf28ec234f82f85b88f30a04e260728de286b9ac646bd70581" gracePeriod=30
Jul 13 15:54:04.737542 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:04.737514    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:54:05.334702 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:05.334670    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:54:05.427000 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:05.426971    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:54:05.529936 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:05.529904    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:54:06.951793 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:06.951762    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:54:07.167359 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:07.167315    2555 patch_prober.go:28] interesting pod/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 13 15:54:07.167552 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:07.167379    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96" podUID="0f58e558-e501-440e-851f-eafbd15556c0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 15:54:09.970980 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:09.970957    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96"
Jul 13 15:54:10.062983 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:10.062954    2555 generic.go:356] "Generic (PLEG): container finished" podID="0f58e558-e501-440e-851f-eafbd15556c0" containerID="7edd74d0e7dc2daf28ec234f82f85b88f30a04e260728de286b9ac646bd70581" exitCode=0
Jul 13 15:54:10.063135 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:10.062995    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96" event={"ID":"0f58e558-e501-440e-851f-eafbd15556c0","Type":"ContainerDied","Data":"7edd74d0e7dc2daf28ec234f82f85b88f30a04e260728de286b9ac646bd70581"}
Jul 13 15:54:10.063135 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:10.063043    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96" event={"ID":"0f58e558-e501-440e-851f-eafbd15556c0","Type":"ContainerDied","Data":"8604ef102753010d1b49eb1f5ca147943f528c248e9d3f0814ed66bf2cc6ab29"}
Jul 13 15:54:10.063135 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:10.063073    2555 scope.go:117] "RemoveContainer" containerID="7edd74d0e7dc2daf28ec234f82f85b88f30a04e260728de286b9ac646bd70581"
Jul 13 15:54:10.063135 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:10.062997    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96"
Jul 13 15:54:10.071772 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:10.071756    2555 scope.go:117] "RemoveContainer" containerID="9954679800cdad7a8792678056a4ed132db7c4e967d9ed0bf4b6a2ac13a79701"
Jul 13 15:54:10.076865 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:10.076847    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ktn4s\" (UniqueName: \"kubernetes.io/projected/0f58e558-e501-440e-851f-eafbd15556c0-kube-api-access-ktn4s\") pod \"0f58e558-e501-440e-851f-eafbd15556c0\" (UID: \"0f58e558-e501-440e-851f-eafbd15556c0\") "
Jul 13 15:54:10.076948 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:10.076883    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f58e558-e501-440e-851f-eafbd15556c0-istio-envoy\") pod \"0f58e558-e501-440e-851f-eafbd15556c0\" (UID: \"0f58e558-e501-440e-851f-eafbd15556c0\") "
Jul 13 15:54:10.076948 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:10.076905    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f58e558-e501-440e-851f-eafbd15556c0-istio-token\") pod \"0f58e558-e501-440e-851f-eafbd15556c0\" (UID: \"0f58e558-e501-440e-851f-eafbd15556c0\") "
Jul 13 15:54:10.076948 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:10.076922    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f58e558-e501-440e-851f-eafbd15556c0-credential-socket\") pod \"0f58e558-e501-440e-851f-eafbd15556c0\" (UID: \"0f58e558-e501-440e-851f-eafbd15556c0\") "
Jul 13 15:54:10.077097 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:10.076962    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f58e558-e501-440e-851f-eafbd15556c0-workload-socket\") pod \"0f58e558-e501-440e-851f-eafbd15556c0\" (UID: \"0f58e558-e501-440e-851f-eafbd15556c0\") "
Jul 13 15:54:10.077097 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:10.077052    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f58e558-e501-440e-851f-eafbd15556c0-istiod-ca-cert\") pod \"0f58e558-e501-440e-851f-eafbd15556c0\" (UID: \"0f58e558-e501-440e-851f-eafbd15556c0\") "
Jul 13 15:54:10.077097 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:10.077074    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f58e558-e501-440e-851f-eafbd15556c0-istio-podinfo\") pod \"0f58e558-e501-440e-851f-eafbd15556c0\" (UID: \"0f58e558-e501-440e-851f-eafbd15556c0\") "
Jul 13 15:54:10.077242 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:10.077101    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f58e558-e501-440e-851f-eafbd15556c0-workload-certs\") pod \"0f58e558-e501-440e-851f-eafbd15556c0\" (UID: \"0f58e558-e501-440e-851f-eafbd15556c0\") "
Jul 13 15:54:10.077242 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:10.077144    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f58e558-e501-440e-851f-eafbd15556c0-istio-data\") pod \"0f58e558-e501-440e-851f-eafbd15556c0\" (UID: \"0f58e558-e501-440e-851f-eafbd15556c0\") "
Jul 13 15:54:10.077346 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:10.077291    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f58e558-e501-440e-851f-eafbd15556c0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0f58e558-e501-440e-851f-eafbd15556c0" (UID: "0f58e558-e501-440e-851f-eafbd15556c0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:54:10.077495 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:10.077474    2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f58e558-e501-440e-851f-eafbd15556c0-credential-socket\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:54:10.077864 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:10.077662    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f58e558-e501-440e-851f-eafbd15556c0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0f58e558-e501-440e-851f-eafbd15556c0" (UID: "0f58e558-e501-440e-851f-eafbd15556c0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:54:10.077864 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:10.077577    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f58e558-e501-440e-851f-eafbd15556c0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0f58e558-e501-440e-851f-eafbd15556c0" (UID: "0f58e558-e501-440e-851f-eafbd15556c0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:54:10.077864 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:10.077744    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f58e558-e501-440e-851f-eafbd15556c0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0f58e558-e501-440e-851f-eafbd15556c0" (UID: "0f58e558-e501-440e-851f-eafbd15556c0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:54:10.078302 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:10.078274    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f58e558-e501-440e-851f-eafbd15556c0-istio-data" (OuterVolumeSpecName: "istio-data") pod "0f58e558-e501-440e-851f-eafbd15556c0" (UID: "0f58e558-e501-440e-851f-eafbd15556c0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:54:10.079261 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:10.079235    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f58e558-e501-440e-851f-eafbd15556c0-istio-token" (OuterVolumeSpecName: "istio-token") pod "0f58e558-e501-440e-851f-eafbd15556c0" (UID: "0f58e558-e501-440e-851f-eafbd15556c0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:54:10.079400 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:10.079378    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f58e558-e501-440e-851f-eafbd15556c0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0f58e558-e501-440e-851f-eafbd15556c0" (UID: "0f58e558-e501-440e-851f-eafbd15556c0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:54:10.079467 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:10.079402    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f58e558-e501-440e-851f-eafbd15556c0-kube-api-access-ktn4s" (OuterVolumeSpecName: "kube-api-access-ktn4s") pod "0f58e558-e501-440e-851f-eafbd15556c0" (UID: "0f58e558-e501-440e-851f-eafbd15556c0"). InnerVolumeSpecName "kube-api-access-ktn4s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:54:10.079671 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:10.079652    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0f58e558-e501-440e-851f-eafbd15556c0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0f58e558-e501-440e-851f-eafbd15556c0" (UID: "0f58e558-e501-440e-851f-eafbd15556c0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 15:54:10.080057 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:10.080038    2555 scope.go:117] "RemoveContainer" containerID="7edd74d0e7dc2daf28ec234f82f85b88f30a04e260728de286b9ac646bd70581"
Jul 13 15:54:10.080306 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:54:10.080287    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7edd74d0e7dc2daf28ec234f82f85b88f30a04e260728de286b9ac646bd70581\": container with ID starting with 7edd74d0e7dc2daf28ec234f82f85b88f30a04e260728de286b9ac646bd70581 not found: ID does not exist" containerID="7edd74d0e7dc2daf28ec234f82f85b88f30a04e260728de286b9ac646bd70581"
Jul 13 15:54:10.080374 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:10.080318    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7edd74d0e7dc2daf28ec234f82f85b88f30a04e260728de286b9ac646bd70581"} err="failed to get container status \"7edd74d0e7dc2daf28ec234f82f85b88f30a04e260728de286b9ac646bd70581\": rpc error: code = NotFound desc = could not find container \"7edd74d0e7dc2daf28ec234f82f85b88f30a04e260728de286b9ac646bd70581\": container with ID starting with 7edd74d0e7dc2daf28ec234f82f85b88f30a04e260728de286b9ac646bd70581 not found: ID does not exist"
Jul 13 15:54:10.080374 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:10.080341    2555 scope.go:117] "RemoveContainer" containerID="9954679800cdad7a8792678056a4ed132db7c4e967d9ed0bf4b6a2ac13a79701"
Jul 13 15:54:10.080574 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:54:10.080555    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9954679800cdad7a8792678056a4ed132db7c4e967d9ed0bf4b6a2ac13a79701\": container with ID starting with 9954679800cdad7a8792678056a4ed132db7c4e967d9ed0bf4b6a2ac13a79701 not found: ID does not exist" containerID="9954679800cdad7a8792678056a4ed132db7c4e967d9ed0bf4b6a2ac13a79701"
Jul 13 15:54:10.080661 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:10.080636    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9954679800cdad7a8792678056a4ed132db7c4e967d9ed0bf4b6a2ac13a79701"} err="failed to get container status \"9954679800cdad7a8792678056a4ed132db7c4e967d9ed0bf4b6a2ac13a79701\": rpc error: code = NotFound desc = could not find container \"9954679800cdad7a8792678056a4ed132db7c4e967d9ed0bf4b6a2ac13a79701\": container with ID starting with 9954679800cdad7a8792678056a4ed132db7c4e967d9ed0bf4b6a2ac13a79701 not found: ID does not exist"
Jul 13 15:54:10.178406 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:10.178368    2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f58e558-e501-440e-851f-eafbd15556c0-istiod-ca-cert\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:54:10.178406 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:10.178399    2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f58e558-e501-440e-851f-eafbd15556c0-istio-podinfo\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:54:10.178406 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:10.178408    2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f58e558-e501-440e-851f-eafbd15556c0-workload-certs\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:54:10.178671 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:10.178423    2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f58e558-e501-440e-851f-eafbd15556c0-istio-data\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:54:10.178671 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:10.178433    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ktn4s\" (UniqueName: \"kubernetes.io/projected/0f58e558-e501-440e-851f-eafbd15556c0-kube-api-access-ktn4s\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:54:10.178671 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:10.178442    2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f58e558-e501-440e-851f-eafbd15556c0-istio-envoy\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:54:10.178671 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:10.178450    2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f58e558-e501-440e-851f-eafbd15556c0-istio-token\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:54:10.178671 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:10.178457    2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f58e558-e501-440e-851f-eafbd15556c0-workload-socket\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:54:10.382784 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:10.382698    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96"]
Jul 13 15:54:10.391943 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:10.391913    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-d997b9d6-openshift-default-55db9598bc-9pb96"]
Jul 13 15:54:11.066822 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:11.066788    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:54:12.203054 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:12.203018    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f58e558-e501-440e-851f-eafbd15556c0" path="/var/lib/kubelet/pods/0f58e558-e501-440e-851f-eafbd15556c0/volumes"
Jul 13 15:54:12.996712 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:12.996683    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:54:13.101311 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:13.101278    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:54:13.197537 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:13.197507    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:54:13.297923 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:13.297852    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:54:13.725273 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:13.725246    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:54:39.747242 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:39.747207    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:54:45.753121 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:45.753086    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:54:45.853427 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:54:45.853394    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:55:01.775236 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:01.775152    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:55:07.518809 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:07.518779    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:55:07.574000 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:07.573974    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:55:07.820482 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:07.820395    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:55:07.920369 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:07.920340    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:55:18.626273 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:18.626237    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:55:19.081776 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:19.081741    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:55:25.080132 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:25.080102    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:55:25.136084 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:25.136057    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:55:25.204937 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:25.204906    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:55:25.369687 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:25.369614    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:55:25.470535 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:25.470506    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:55:26.173619 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:26.173567    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:55:26.272894 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:26.272869    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:55:26.468113 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:26.468083    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:55:28.025136 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:28.025104    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:55:34.020713 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:34.020675    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:55:34.121344 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:34.121309    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:55:34.711223 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:34.711189    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:55:40.797982 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:40.797948    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:55:40.861344 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:40.861313    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:55:41.117192 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.117118    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:55:41.271521 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.271486    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:55:41.322086 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.322058    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl"]
Jul 13 15:55:41.322416 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.322403    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef1249cb-5385-4c6f-ba9a-2f4041997ecc" containerName="maas-api"
Jul 13 15:55:41.322457 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.322418    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef1249cb-5385-4c6f-ba9a-2f4041997ecc" containerName="maas-api"
Jul 13 15:55:41.322457 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.322427    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f58e558-e501-440e-851f-eafbd15556c0" containerName="istio-proxy"
Jul 13 15:55:41.322457 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.322432    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f58e558-e501-440e-851f-eafbd15556c0" containerName="istio-proxy"
Jul 13 15:55:41.322457 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.322442    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f58e558-e501-440e-851f-eafbd15556c0" containerName="istio-proxy"
Jul 13 15:55:41.322457 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.322448    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f58e558-e501-440e-851f-eafbd15556c0" containerName="istio-proxy"
Jul 13 15:55:41.322620 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.322462    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd2bc50a-f4e3-4ab3-8f96-a49be3250494" containerName="istio-proxy"
Jul 13 15:55:41.322620 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.322467    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd2bc50a-f4e3-4ab3-8f96-a49be3250494" containerName="istio-proxy"
Jul 13 15:55:41.322620 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.322520    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f58e558-e501-440e-851f-eafbd15556c0" containerName="istio-proxy"
Jul 13 15:55:41.322620 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.322527    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd2bc50a-f4e3-4ab3-8f96-a49be3250494" containerName="istio-proxy"
Jul 13 15:55:41.322620 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.322534    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd2bc50a-f4e3-4ab3-8f96-a49be3250494" containerName="istio-proxy"
Jul 13 15:55:41.322620 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.322539    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef1249cb-5385-4c6f-ba9a-2f4041997ecc" containerName="maas-api"
Jul 13 15:55:41.325503 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.325487    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl"
Jul 13 15:55:41.327900 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.327882    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-6270d141-openshift-default-dockercfg-v8wzl\""
Jul 13 15:55:41.343684 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.343655    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl"]
Jul 13 15:55:41.346197 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.346172    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:55:41.455701 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.455610    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad1af09f-8d85-4096-9890-df612f8e0564-workload-socket\") pod \"e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl\" (UID: \"ad1af09f-8d85-4096-9890-df612f8e0564\") " pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl"
Jul 13 15:55:41.455701 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.455653    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad1af09f-8d85-4096-9890-df612f8e0564-istio-token\") pod \"e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl\" (UID: \"ad1af09f-8d85-4096-9890-df612f8e0564\") " pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl"
Jul 13 15:55:41.455924 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.455722    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad1af09f-8d85-4096-9890-df612f8e0564-istio-envoy\") pod \"e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl\" (UID: \"ad1af09f-8d85-4096-9890-df612f8e0564\") " pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl"
Jul 13 15:55:41.455924 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.455745    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad1af09f-8d85-4096-9890-df612f8e0564-istio-podinfo\") pod \"e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl\" (UID: \"ad1af09f-8d85-4096-9890-df612f8e0564\") " pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl"
Jul 13 15:55:41.455924 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.455768    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5mnw\" (UniqueName: \"kubernetes.io/projected/ad1af09f-8d85-4096-9890-df612f8e0564-kube-api-access-v5mnw\") pod \"e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl\" (UID: \"ad1af09f-8d85-4096-9890-df612f8e0564\") " pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl"
Jul 13 15:55:41.455924 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.455815    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad1af09f-8d85-4096-9890-df612f8e0564-istio-data\") pod \"e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl\" (UID: \"ad1af09f-8d85-4096-9890-df612f8e0564\") " pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl"
Jul 13 15:55:41.455924 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.455889    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad1af09f-8d85-4096-9890-df612f8e0564-credential-socket\") pod \"e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl\" (UID: \"ad1af09f-8d85-4096-9890-df612f8e0564\") " pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl"
Jul 13 15:55:41.456127 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.455927    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad1af09f-8d85-4096-9890-df612f8e0564-workload-certs\") pod \"e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl\" (UID: \"ad1af09f-8d85-4096-9890-df612f8e0564\") " pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl"
Jul 13 15:55:41.456127 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.455959    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad1af09f-8d85-4096-9890-df612f8e0564-istiod-ca-cert\") pod \"e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl\" (UID: \"ad1af09f-8d85-4096-9890-df612f8e0564\") " pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl"
Jul 13 15:55:41.557344 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.557307    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad1af09f-8d85-4096-9890-df612f8e0564-workload-socket\") pod \"e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl\" (UID: \"ad1af09f-8d85-4096-9890-df612f8e0564\") " pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl"
Jul 13 15:55:41.557344 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.557343    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad1af09f-8d85-4096-9890-df612f8e0564-istio-token\") pod \"e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl\" (UID: \"ad1af09f-8d85-4096-9890-df612f8e0564\") " pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl"
Jul 13 15:55:41.557561 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.557388    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad1af09f-8d85-4096-9890-df612f8e0564-istio-envoy\") pod \"e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl\" (UID: \"ad1af09f-8d85-4096-9890-df612f8e0564\") " pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl"
Jul 13 15:55:41.557561 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.557406    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad1af09f-8d85-4096-9890-df612f8e0564-istio-podinfo\") pod \"e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl\" (UID: \"ad1af09f-8d85-4096-9890-df612f8e0564\") " pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl"
Jul 13 15:55:41.557561 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.557423    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5mnw\" (UniqueName: \"kubernetes.io/projected/ad1af09f-8d85-4096-9890-df612f8e0564-kube-api-access-v5mnw\") pod \"e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl\" (UID: \"ad1af09f-8d85-4096-9890-df612f8e0564\") " pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl"
Jul 13 15:55:41.557561 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.557456    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad1af09f-8d85-4096-9890-df612f8e0564-istio-data\") pod \"e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl\" (UID: \"ad1af09f-8d85-4096-9890-df612f8e0564\") " pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl"
Jul 13 15:55:41.557561 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.557516    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad1af09f-8d85-4096-9890-df612f8e0564-credential-socket\") pod \"e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl\" (UID: \"ad1af09f-8d85-4096-9890-df612f8e0564\") " pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl"
Jul 13 15:55:41.557561 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.557555    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad1af09f-8d85-4096-9890-df612f8e0564-workload-certs\") pod \"e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl\" (UID: \"ad1af09f-8d85-4096-9890-df612f8e0564\") " pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl"
Jul 13 15:55:41.557905 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.557717    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad1af09f-8d85-4096-9890-df612f8e0564-istiod-ca-cert\") pod \"e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl\" (UID: \"ad1af09f-8d85-4096-9890-df612f8e0564\") " pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl"
Jul 13 15:55:41.557905 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.557776    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad1af09f-8d85-4096-9890-df612f8e0564-workload-socket\") pod \"e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl\" (UID: \"ad1af09f-8d85-4096-9890-df612f8e0564\") " pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl"
Jul 13 15:55:41.557905 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.557853    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad1af09f-8d85-4096-9890-df612f8e0564-workload-certs\") pod \"e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl\" (UID: \"ad1af09f-8d85-4096-9890-df612f8e0564\") " pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl"
Jul 13 15:55:41.558047 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.557910    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad1af09f-8d85-4096-9890-df612f8e0564-credential-socket\") pod \"e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl\" (UID: \"ad1af09f-8d85-4096-9890-df612f8e0564\") " pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl"
Jul 13 15:55:41.558087 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.558044    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad1af09f-8d85-4096-9890-df612f8e0564-istio-data\") pod \"e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl\" (UID: \"ad1af09f-8d85-4096-9890-df612f8e0564\") " pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl"
Jul 13 15:55:41.558447 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.558426    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad1af09f-8d85-4096-9890-df612f8e0564-istiod-ca-cert\") pod \"e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl\" (UID: \"ad1af09f-8d85-4096-9890-df612f8e0564\") " pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl"
Jul 13 15:55:41.559743 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.559722    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad1af09f-8d85-4096-9890-df612f8e0564-istio-envoy\") pod \"e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl\" (UID: \"ad1af09f-8d85-4096-9890-df612f8e0564\") " pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl"
Jul 13 15:55:41.559961 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.559941    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad1af09f-8d85-4096-9890-df612f8e0564-istio-podinfo\") pod \"e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl\" (UID: \"ad1af09f-8d85-4096-9890-df612f8e0564\") " pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl"
Jul 13 15:55:41.564923 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.564895    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad1af09f-8d85-4096-9890-df612f8e0564-istio-token\") pod \"e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl\" (UID: \"ad1af09f-8d85-4096-9890-df612f8e0564\") " pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl"
Jul 13 15:55:41.565111 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.565089    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5mnw\" (UniqueName: \"kubernetes.io/projected/ad1af09f-8d85-4096-9890-df612f8e0564-kube-api-access-v5mnw\") pod \"e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl\" (UID: \"ad1af09f-8d85-4096-9890-df612f8e0564\") " pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl"
Jul 13 15:55:41.593973 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.593929    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:55:41.635504 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.635483    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl"
Jul 13 15:55:41.769176 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.769146    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl"]
Jul 13 15:55:41.771535 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:55:41.771511    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad1af09f_8d85_4096_9890_df612f8e0564.slice/crio-41e63780e971d27174b5ef90935eb1dfeebe848c6c538691d90136d48e062208 WatchSource:0}: Error finding container 41e63780e971d27174b5ef90935eb1dfeebe848c6c538691d90136d48e062208: Status 404 returned error can't find the container with id 41e63780e971d27174b5ef90935eb1dfeebe848c6c538691d90136d48e062208
Jul 13 15:55:41.773658 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.773622    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 15:55:41.773732 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.773704    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 15:55:41.773772 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:41.773752    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 15:55:42.499379 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:42.499342    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl" event={"ID":"ad1af09f-8d85-4096-9890-df612f8e0564","Type":"ContainerStarted","Data":"319f465fa5f579fdd8713adcb1c3b3a279b8f0348f31592b6478d737cd55273e"}
Jul 13 15:55:42.499813 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:42.499420    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl" event={"ID":"ad1af09f-8d85-4096-9890-df612f8e0564","Type":"ContainerStarted","Data":"41e63780e971d27174b5ef90935eb1dfeebe848c6c538691d90136d48e062208"}
Jul 13 15:55:42.519357 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:42.519311    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl" podStartSLOduration=1.519296805 podStartE2EDuration="1.519296805s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:55:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:55:42.518020313 +0000 UTC m=+1928.842742209" watchObservedRunningTime="2026-07-13 15:55:42.519296805 +0000 UTC m=+1928.844018700"
Jul 13 15:55:42.636452 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:42.636428    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl"
Jul 13 15:55:42.640999 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:42.640977    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl"
Jul 13 15:55:43.503802 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:43.503766    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl"
Jul 13 15:55:43.504599 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:43.504570    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl"
Jul 13 15:55:44.507824 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:44.507793    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:55:44.608121 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:44.608089    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:55:44.644453 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:44.644425    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6270d141-76956b4779-lb9fb"]
Jul 13 15:55:44.644842 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:44.644827    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd2bc50a-f4e3-4ab3-8f96-a49be3250494" containerName="istio-proxy"
Jul 13 15:55:44.644915 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:44.644845    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd2bc50a-f4e3-4ab3-8f96-a49be3250494" containerName="istio-proxy"
Jul 13 15:55:44.644949 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:44.644925    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f58e558-e501-440e-851f-eafbd15556c0" containerName="istio-proxy"
Jul 13 15:55:44.648137 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:44.648119    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6270d141-76956b4779-lb9fb"
Jul 13 15:55:44.650563 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:44.650540    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-6270d141-serving-cert\""
Jul 13 15:55:44.650702 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:44.650621    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kjwpb\""
Jul 13 15:55:44.657979 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:44.657956    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6270d141-76956b4779-lb9fb"]
Jul 13 15:55:44.680264 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:44.680237    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:55:44.788386 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:44.788306    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76ed6ed2-892b-4834-a63b-a5439dc974eb-openshift-service-ca\") pod \"maas-api-e2e-mt-6270d141-76956b4779-lb9fb\" (UID: \"76ed6ed2-892b-4834-a63b-a5439dc974eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6270d141-76956b4779-lb9fb"
Jul 13 15:55:44.788386 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:44.788366    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzfgk\" (UniqueName: \"kubernetes.io/projected/76ed6ed2-892b-4834-a63b-a5439dc974eb-kube-api-access-jzfgk\") pod \"maas-api-e2e-mt-6270d141-76956b4779-lb9fb\" (UID: \"76ed6ed2-892b-4834-a63b-a5439dc974eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6270d141-76956b4779-lb9fb"
Jul 13 15:55:44.788544 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:44.788444    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76ed6ed2-892b-4834-a63b-a5439dc974eb-maas-api-tls\") pod \"maas-api-e2e-mt-6270d141-76956b4779-lb9fb\" (UID: \"76ed6ed2-892b-4834-a63b-a5439dc974eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6270d141-76956b4779-lb9fb"
Jul 13 15:55:44.889062 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:44.889028    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76ed6ed2-892b-4834-a63b-a5439dc974eb-maas-api-tls\") pod \"maas-api-e2e-mt-6270d141-76956b4779-lb9fb\" (UID: \"76ed6ed2-892b-4834-a63b-a5439dc974eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6270d141-76956b4779-lb9fb"
Jul 13 15:55:44.889253 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:44.889096    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76ed6ed2-892b-4834-a63b-a5439dc974eb-openshift-service-ca\") pod \"maas-api-e2e-mt-6270d141-76956b4779-lb9fb\" (UID: \"76ed6ed2-892b-4834-a63b-a5439dc974eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6270d141-76956b4779-lb9fb"
Jul 13 15:55:44.889253 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:44.889142    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzfgk\" (UniqueName: \"kubernetes.io/projected/76ed6ed2-892b-4834-a63b-a5439dc974eb-kube-api-access-jzfgk\") pod \"maas-api-e2e-mt-6270d141-76956b4779-lb9fb\" (UID: \"76ed6ed2-892b-4834-a63b-a5439dc974eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6270d141-76956b4779-lb9fb"
Jul 13 15:55:44.889253 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:55:44.889204    2555 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-6270d141-serving-cert: secret "maas-api-e2e-mt-6270d141-serving-cert" not found
Jul 13 15:55:44.889424 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:55:44.889286    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76ed6ed2-892b-4834-a63b-a5439dc974eb-maas-api-tls podName:76ed6ed2-892b-4834-a63b-a5439dc974eb nodeName:}" failed. No retries permitted until 2026-07-13 15:55:45.389263311 +0000 UTC m=+1931.713985199 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/76ed6ed2-892b-4834-a63b-a5439dc974eb-maas-api-tls") pod "maas-api-e2e-mt-6270d141-76956b4779-lb9fb" (UID: "76ed6ed2-892b-4834-a63b-a5439dc974eb") : secret "maas-api-e2e-mt-6270d141-serving-cert" not found
Jul 13 15:55:44.889809 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:44.889792    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76ed6ed2-892b-4834-a63b-a5439dc974eb-openshift-service-ca\") pod \"maas-api-e2e-mt-6270d141-76956b4779-lb9fb\" (UID: \"76ed6ed2-892b-4834-a63b-a5439dc974eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6270d141-76956b4779-lb9fb"
Jul 13 15:55:44.906069 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:44.906043    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzfgk\" (UniqueName: \"kubernetes.io/projected/76ed6ed2-892b-4834-a63b-a5439dc974eb-kube-api-access-jzfgk\") pod \"maas-api-e2e-mt-6270d141-76956b4779-lb9fb\" (UID: \"76ed6ed2-892b-4834-a63b-a5439dc974eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6270d141-76956b4779-lb9fb"
Jul 13 15:55:45.173155 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:45.173075    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:55:45.270321 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:45.270290    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:55:45.393579 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:45.393544    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76ed6ed2-892b-4834-a63b-a5439dc974eb-maas-api-tls\") pod \"maas-api-e2e-mt-6270d141-76956b4779-lb9fb\" (UID: \"76ed6ed2-892b-4834-a63b-a5439dc974eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6270d141-76956b4779-lb9fb"
Jul 13 15:55:45.396031 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:45.396002    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76ed6ed2-892b-4834-a63b-a5439dc974eb-maas-api-tls\") pod \"maas-api-e2e-mt-6270d141-76956b4779-lb9fb\" (UID: \"76ed6ed2-892b-4834-a63b-a5439dc974eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6270d141-76956b4779-lb9fb"
Jul 13 15:55:45.561083 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:45.561056    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6270d141-76956b4779-lb9fb"
Jul 13 15:55:45.697895 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:45.697873    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6270d141-76956b4779-lb9fb"]
Jul 13 15:55:45.699978 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:55:45.699948    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76ed6ed2_892b_4834_a63b_a5439dc974eb.slice/crio-a4a927388b9155a6a4adc55f68a81f90405693c665f210229b47fe32a9823955 WatchSource:0}: Error finding container a4a927388b9155a6a4adc55f68a81f90405693c665f210229b47fe32a9823955: Status 404 returned error can't find the container with id a4a927388b9155a6a4adc55f68a81f90405693c665f210229b47fe32a9823955
Jul 13 15:55:45.701453 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:45.701430    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 15:55:46.518872 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:46.518789    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6270d141-76956b4779-lb9fb" event={"ID":"76ed6ed2-892b-4834-a63b-a5439dc974eb","Type":"ContainerStarted","Data":"178369e1049c51993253391a30649c32a398538c336cda131167743da26cc24d"}
Jul 13 15:55:46.518872 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:46.518850    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6270d141-76956b4779-lb9fb" event={"ID":"76ed6ed2-892b-4834-a63b-a5439dc974eb","Type":"ContainerStarted","Data":"a4a927388b9155a6a4adc55f68a81f90405693c665f210229b47fe32a9823955"}
Jul 13 15:55:46.519040 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:46.518877    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6270d141-76956b4779-lb9fb"
Jul 13 15:55:46.538481 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:46.538440    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6270d141-76956b4779-lb9fb" podStartSLOduration=1.980889259 podStartE2EDuration="2.538425284s" totalImagesPullingTime="557.536025ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:55:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:55:46.537533467 +0000 UTC m=+1932.862255363" watchObservedRunningTime="2026-07-13 15:55:46.538425284 +0000 UTC m=+1932.863147180"
Jul 13 15:55:48.981927 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:48.981895    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:55:49.725349 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:49.725313    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:55:49.826269 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:49.826236    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:55:50.102929 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:50.102835    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:55:52.528935 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:52.528908    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6270d141-76956b4779-lb9fb"
Jul 13 15:55:55.991966 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:55.991925    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:55:56.091336 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:56.091297    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:55:58.505622 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:58.505574    2555 patch_prober.go:28] interesting pod/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 13 15:55:58.506046 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:58.505638    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl" podUID="ad1af09f-8d85-4096-9890-df612f8e0564" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 13 15:55:58.575152 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:58.575123    2555 generic.go:356] "Generic (PLEG): container finished" podID="ad1af09f-8d85-4096-9890-df612f8e0564" containerID="319f465fa5f579fdd8713adcb1c3b3a279b8f0348f31592b6478d737cd55273e" exitCode=0
Jul 13 15:55:58.575305 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:58.575203    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl" event={"ID":"ad1af09f-8d85-4096-9890-df612f8e0564","Type":"ContainerDied","Data":"319f465fa5f579fdd8713adcb1c3b3a279b8f0348f31592b6478d737cd55273e"}
Jul 13 15:55:58.575632 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:58.575614    2555 scope.go:117] "RemoveContainer" containerID="319f465fa5f579fdd8713adcb1c3b3a279b8f0348f31592b6478d737cd55273e"
Jul 13 15:55:58.576598 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:58.576555    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 15:55:58.576696 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:58.576652    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 15:55:58.576763 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:58.576699    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 15:55:59.585000 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:59.584945    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl" event={"ID":"ad1af09f-8d85-4096-9890-df612f8e0564","Type":"ContainerStarted","Data":"a1a862e2b8628c94369bc592710a146f49f8c1d239e3faf96d714de508f6b123"}
Jul 13 15:55:59.635733 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:59.635704    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl"
Jul 13 15:55:59.635923 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:59.635896    2555 patch_prober.go:28] interesting pod/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 13 15:55:59.635969 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:55:59.635936    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl" podUID="ad1af09f-8d85-4096-9890-df612f8e0564" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 13 15:56:00.636499 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:00.636465    2555 patch_prober.go:28] interesting pod/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 13 15:56:00.636899 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:00.636517    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl" podUID="ad1af09f-8d85-4096-9890-df612f8e0564" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 13 15:56:01.636964 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:01.636929    2555 patch_prober.go:28] interesting pod/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 13 15:56:01.637339 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:01.636995    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl" podUID="ad1af09f-8d85-4096-9890-df612f8e0564" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 13 15:56:02.635890 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:02.635855    2555 patch_prober.go:28] interesting pod/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 13 15:56:02.636091 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:02.635941    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl" podUID="ad1af09f-8d85-4096-9890-df612f8e0564" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 13 15:56:03.639429 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:03.639395    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl"
Jul 13 15:56:03.639937 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:03.639807    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl"
Jul 13 15:56:03.640450 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:03.640430    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl"
Jul 13 15:56:06.738601 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:06.738548    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6270d141-76956b4779-lb9fb"]
Jul 13 15:56:06.739086 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:06.738778    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6270d141-76956b4779-lb9fb" podUID="76ed6ed2-892b-4834-a63b-a5439dc974eb" containerName="maas-api" containerID="cri-o://178369e1049c51993253391a30649c32a398538c336cda131167743da26cc24d" gracePeriod=30
Jul 13 15:56:06.763320 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:06.763295    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:56:06.993499 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:06.993447    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6270d141-76956b4779-lb9fb"
Jul 13 15:56:07.089276 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:07.089247    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzfgk\" (UniqueName: \"kubernetes.io/projected/76ed6ed2-892b-4834-a63b-a5439dc974eb-kube-api-access-jzfgk\") pod \"76ed6ed2-892b-4834-a63b-a5439dc974eb\" (UID: \"76ed6ed2-892b-4834-a63b-a5439dc974eb\") "
Jul 13 15:56:07.089473 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:07.089297    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76ed6ed2-892b-4834-a63b-a5439dc974eb-openshift-service-ca\") pod \"76ed6ed2-892b-4834-a63b-a5439dc974eb\" (UID: \"76ed6ed2-892b-4834-a63b-a5439dc974eb\") "
Jul 13 15:56:07.089473 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:07.089324    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76ed6ed2-892b-4834-a63b-a5439dc974eb-maas-api-tls\") pod \"76ed6ed2-892b-4834-a63b-a5439dc974eb\" (UID: \"76ed6ed2-892b-4834-a63b-a5439dc974eb\") "
Jul 13 15:56:07.089745 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:07.089712    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76ed6ed2-892b-4834-a63b-a5439dc974eb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "76ed6ed2-892b-4834-a63b-a5439dc974eb" (UID: "76ed6ed2-892b-4834-a63b-a5439dc974eb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:56:07.091541 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:07.091515    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76ed6ed2-892b-4834-a63b-a5439dc974eb-kube-api-access-jzfgk" (OuterVolumeSpecName: "kube-api-access-jzfgk") pod "76ed6ed2-892b-4834-a63b-a5439dc974eb" (UID: "76ed6ed2-892b-4834-a63b-a5439dc974eb"). InnerVolumeSpecName "kube-api-access-jzfgk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:56:07.091541 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:07.091527    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76ed6ed2-892b-4834-a63b-a5439dc974eb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "76ed6ed2-892b-4834-a63b-a5439dc974eb" (UID: "76ed6ed2-892b-4834-a63b-a5439dc974eb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 15:56:07.190467 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:07.190426    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzfgk\" (UniqueName: \"kubernetes.io/projected/76ed6ed2-892b-4834-a63b-a5439dc974eb-kube-api-access-jzfgk\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:56:07.190467 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:07.190461    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76ed6ed2-892b-4834-a63b-a5439dc974eb-openshift-service-ca\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:56:07.190467 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:07.190475    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76ed6ed2-892b-4834-a63b-a5439dc974eb-maas-api-tls\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:56:07.633033 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:07.632993    2555 generic.go:356] "Generic (PLEG): container finished" podID="76ed6ed2-892b-4834-a63b-a5439dc974eb" containerID="178369e1049c51993253391a30649c32a398538c336cda131167743da26cc24d" exitCode=0
Jul 13 15:56:07.633216 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:07.633040    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6270d141-76956b4779-lb9fb"
Jul 13 15:56:07.633216 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:07.633075    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6270d141-76956b4779-lb9fb" event={"ID":"76ed6ed2-892b-4834-a63b-a5439dc974eb","Type":"ContainerDied","Data":"178369e1049c51993253391a30649c32a398538c336cda131167743da26cc24d"}
Jul 13 15:56:07.633216 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:07.633128    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6270d141-76956b4779-lb9fb" event={"ID":"76ed6ed2-892b-4834-a63b-a5439dc974eb","Type":"ContainerDied","Data":"a4a927388b9155a6a4adc55f68a81f90405693c665f210229b47fe32a9823955"}
Jul 13 15:56:07.633216 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:07.633148    2555 scope.go:117] "RemoveContainer" containerID="178369e1049c51993253391a30649c32a398538c336cda131167743da26cc24d"
Jul 13 15:56:07.644910 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:07.644889    2555 scope.go:117] "RemoveContainer" containerID="178369e1049c51993253391a30649c32a398538c336cda131167743da26cc24d"
Jul 13 15:56:07.645200 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:56:07.645182    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"178369e1049c51993253391a30649c32a398538c336cda131167743da26cc24d\": container with ID starting with 178369e1049c51993253391a30649c32a398538c336cda131167743da26cc24d not found: ID does not exist" containerID="178369e1049c51993253391a30649c32a398538c336cda131167743da26cc24d"
Jul 13 15:56:07.645272 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:07.645214    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"178369e1049c51993253391a30649c32a398538c336cda131167743da26cc24d"} err="failed to get container status \"178369e1049c51993253391a30649c32a398538c336cda131167743da26cc24d\": rpc error: code = NotFound desc = could not find container \"178369e1049c51993253391a30649c32a398538c336cda131167743da26cc24d\": container with ID starting with 178369e1049c51993253391a30649c32a398538c336cda131167743da26cc24d not found: ID does not exist"
Jul 13 15:56:07.661538 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:07.661503    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6270d141-76956b4779-lb9fb"]
Jul 13 15:56:07.666888 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:07.666865    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6270d141-76956b4779-lb9fb"]
Jul 13 15:56:08.203002 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:08.202958    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76ed6ed2-892b-4834-a63b-a5439dc974eb" path="/var/lib/kubelet/pods/76ed6ed2-892b-4834-a63b-a5439dc974eb/volumes"
Jul 13 15:56:11.436104 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:11.436069    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:56:17.401882 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:17.401835    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:56:17.451106 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:17.451032    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:56:22.157524 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:22.157487    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl"]
Jul 13 15:56:22.158017 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:22.157742    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl" podUID="ad1af09f-8d85-4096-9890-df612f8e0564" containerName="istio-proxy" containerID="cri-o://a1a862e2b8628c94369bc592710a146f49f8c1d239e3faf96d714de508f6b123" gracePeriod=30
Jul 13 15:56:22.177934 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:22.177902    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:56:22.419674 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:22.419594    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:56:22.549138 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:22.549107    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:56:22.655948 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:22.655918    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:56:22.779110 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:22.779079    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:56:27.413295 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:27.413270    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl"
Jul 13 15:56:27.464267 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:27.464165    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad1af09f-8d85-4096-9890-df612f8e0564-credential-socket\") pod \"ad1af09f-8d85-4096-9890-df612f8e0564\" (UID: \"ad1af09f-8d85-4096-9890-df612f8e0564\") "
Jul 13 15:56:27.464267 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:27.464214    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad1af09f-8d85-4096-9890-df612f8e0564-istio-token\") pod \"ad1af09f-8d85-4096-9890-df612f8e0564\" (UID: \"ad1af09f-8d85-4096-9890-df612f8e0564\") "
Jul 13 15:56:27.464267 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:27.464256    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad1af09f-8d85-4096-9890-df612f8e0564-istio-envoy\") pod \"ad1af09f-8d85-4096-9890-df612f8e0564\" (UID: \"ad1af09f-8d85-4096-9890-df612f8e0564\") "
Jul 13 15:56:27.464578 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:27.464279    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad1af09f-8d85-4096-9890-df612f8e0564-istio-data\") pod \"ad1af09f-8d85-4096-9890-df612f8e0564\" (UID: \"ad1af09f-8d85-4096-9890-df612f8e0564\") "
Jul 13 15:56:27.464578 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:27.464303    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad1af09f-8d85-4096-9890-df612f8e0564-workload-certs\") pod \"ad1af09f-8d85-4096-9890-df612f8e0564\" (UID: \"ad1af09f-8d85-4096-9890-df612f8e0564\") "
Jul 13 15:56:27.464578 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:27.464377    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5mnw\" (UniqueName: \"kubernetes.io/projected/ad1af09f-8d85-4096-9890-df612f8e0564-kube-api-access-v5mnw\") pod \"ad1af09f-8d85-4096-9890-df612f8e0564\" (UID: \"ad1af09f-8d85-4096-9890-df612f8e0564\") "
Jul 13 15:56:27.464578 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:27.464419    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad1af09f-8d85-4096-9890-df612f8e0564-istio-podinfo\") pod \"ad1af09f-8d85-4096-9890-df612f8e0564\" (UID: \"ad1af09f-8d85-4096-9890-df612f8e0564\") "
Jul 13 15:56:27.464578 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:27.464472    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad1af09f-8d85-4096-9890-df612f8e0564-workload-socket\") pod \"ad1af09f-8d85-4096-9890-df612f8e0564\" (UID: \"ad1af09f-8d85-4096-9890-df612f8e0564\") "
Jul 13 15:56:27.464578 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:27.464494    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad1af09f-8d85-4096-9890-df612f8e0564-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ad1af09f-8d85-4096-9890-df612f8e0564" (UID: "ad1af09f-8d85-4096-9890-df612f8e0564"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:56:27.464578 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:27.464500    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad1af09f-8d85-4096-9890-df612f8e0564-istiod-ca-cert\") pod \"ad1af09f-8d85-4096-9890-df612f8e0564\" (UID: \"ad1af09f-8d85-4096-9890-df612f8e0564\") "
Jul 13 15:56:27.464943 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:27.464819    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad1af09f-8d85-4096-9890-df612f8e0564-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ad1af09f-8d85-4096-9890-df612f8e0564" (UID: "ad1af09f-8d85-4096-9890-df612f8e0564"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:56:27.464943 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:27.464813    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad1af09f-8d85-4096-9890-df612f8e0564-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ad1af09f-8d85-4096-9890-df612f8e0564" (UID: "ad1af09f-8d85-4096-9890-df612f8e0564"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:56:27.464943 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:27.464898    2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad1af09f-8d85-4096-9890-df612f8e0564-credential-socket\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:56:27.465084 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:27.465004    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad1af09f-8d85-4096-9890-df612f8e0564-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ad1af09f-8d85-4096-9890-df612f8e0564" (UID: "ad1af09f-8d85-4096-9890-df612f8e0564"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:56:27.465316 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:27.465287    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad1af09f-8d85-4096-9890-df612f8e0564-istio-data" (OuterVolumeSpecName: "istio-data") pod "ad1af09f-8d85-4096-9890-df612f8e0564" (UID: "ad1af09f-8d85-4096-9890-df612f8e0564"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:56:27.466726 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:27.466702    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad1af09f-8d85-4096-9890-df612f8e0564-kube-api-access-v5mnw" (OuterVolumeSpecName: "kube-api-access-v5mnw") pod "ad1af09f-8d85-4096-9890-df612f8e0564" (UID: "ad1af09f-8d85-4096-9890-df612f8e0564"). InnerVolumeSpecName "kube-api-access-v5mnw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:56:27.466802 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:27.466725    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ad1af09f-8d85-4096-9890-df612f8e0564-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ad1af09f-8d85-4096-9890-df612f8e0564" (UID: "ad1af09f-8d85-4096-9890-df612f8e0564"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 15:56:27.466995 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:27.466970    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad1af09f-8d85-4096-9890-df612f8e0564-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ad1af09f-8d85-4096-9890-df612f8e0564" (UID: "ad1af09f-8d85-4096-9890-df612f8e0564"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:56:27.467092 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:27.467074    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad1af09f-8d85-4096-9890-df612f8e0564-istio-token" (OuterVolumeSpecName: "istio-token") pod "ad1af09f-8d85-4096-9890-df612f8e0564" (UID: "ad1af09f-8d85-4096-9890-df612f8e0564"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:56:27.565734 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:27.565703    2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad1af09f-8d85-4096-9890-df612f8e0564-workload-socket\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:56:27.565734 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:27.565729    2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad1af09f-8d85-4096-9890-df612f8e0564-istiod-ca-cert\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:56:27.565734 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:27.565739    2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad1af09f-8d85-4096-9890-df612f8e0564-istio-token\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:56:27.565963 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:27.565747    2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad1af09f-8d85-4096-9890-df612f8e0564-istio-envoy\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:56:27.565963 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:27.565754    2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad1af09f-8d85-4096-9890-df612f8e0564-istio-data\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:56:27.565963 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:27.565761    2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad1af09f-8d85-4096-9890-df612f8e0564-workload-certs\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:56:27.565963 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:27.565771    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5mnw\" (UniqueName: \"kubernetes.io/projected/ad1af09f-8d85-4096-9890-df612f8e0564-kube-api-access-v5mnw\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:56:27.565963 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:27.565779    2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad1af09f-8d85-4096-9890-df612f8e0564-istio-podinfo\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:56:27.741636 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:27.741576    2555 generic.go:356] "Generic (PLEG): container finished" podID="ad1af09f-8d85-4096-9890-df612f8e0564" containerID="a1a862e2b8628c94369bc592710a146f49f8c1d239e3faf96d714de508f6b123" exitCode=0
Jul 13 15:56:27.741786 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:27.741656    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl" event={"ID":"ad1af09f-8d85-4096-9890-df612f8e0564","Type":"ContainerDied","Data":"a1a862e2b8628c94369bc592710a146f49f8c1d239e3faf96d714de508f6b123"}
Jul 13 15:56:27.741786 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:27.741660    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl"
Jul 13 15:56:27.741786 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:27.741699    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl" event={"ID":"ad1af09f-8d85-4096-9890-df612f8e0564","Type":"ContainerDied","Data":"41e63780e971d27174b5ef90935eb1dfeebe848c6c538691d90136d48e062208"}
Jul 13 15:56:27.741786 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:27.741721    2555 scope.go:117] "RemoveContainer" containerID="a1a862e2b8628c94369bc592710a146f49f8c1d239e3faf96d714de508f6b123"
Jul 13 15:56:27.751094 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:27.751076    2555 scope.go:117] "RemoveContainer" containerID="319f465fa5f579fdd8713adcb1c3b3a279b8f0348f31592b6478d737cd55273e"
Jul 13 15:56:27.758903 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:27.758886    2555 scope.go:117] "RemoveContainer" containerID="a1a862e2b8628c94369bc592710a146f49f8c1d239e3faf96d714de508f6b123"
Jul 13 15:56:27.759118 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:56:27.759102    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1a862e2b8628c94369bc592710a146f49f8c1d239e3faf96d714de508f6b123\": container with ID starting with a1a862e2b8628c94369bc592710a146f49f8c1d239e3faf96d714de508f6b123 not found: ID does not exist" containerID="a1a862e2b8628c94369bc592710a146f49f8c1d239e3faf96d714de508f6b123"
Jul 13 15:56:27.759172 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:27.759127    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1a862e2b8628c94369bc592710a146f49f8c1d239e3faf96d714de508f6b123"} err="failed to get container status \"a1a862e2b8628c94369bc592710a146f49f8c1d239e3faf96d714de508f6b123\": rpc error: code = NotFound desc = could not find container \"a1a862e2b8628c94369bc592710a146f49f8c1d239e3faf96d714de508f6b123\": container with ID starting with a1a862e2b8628c94369bc592710a146f49f8c1d239e3faf96d714de508f6b123 not found: ID does not exist"
Jul 13 15:56:27.759172 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:27.759144    2555 scope.go:117] "RemoveContainer" containerID="319f465fa5f579fdd8713adcb1c3b3a279b8f0348f31592b6478d737cd55273e"
Jul 13 15:56:27.759368 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:56:27.759354    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"319f465fa5f579fdd8713adcb1c3b3a279b8f0348f31592b6478d737cd55273e\": container with ID starting with 319f465fa5f579fdd8713adcb1c3b3a279b8f0348f31592b6478d737cd55273e not found: ID does not exist" containerID="319f465fa5f579fdd8713adcb1c3b3a279b8f0348f31592b6478d737cd55273e"
Jul 13 15:56:27.759401 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:27.759372    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"319f465fa5f579fdd8713adcb1c3b3a279b8f0348f31592b6478d737cd55273e"} err="failed to get container status \"319f465fa5f579fdd8713adcb1c3b3a279b8f0348f31592b6478d737cd55273e\": rpc error: code = NotFound desc = could not find container \"319f465fa5f579fdd8713adcb1c3b3a279b8f0348f31592b6478d737cd55273e\": container with ID starting with 319f465fa5f579fdd8713adcb1c3b3a279b8f0348f31592b6478d737cd55273e not found: ID does not exist"
Jul 13 15:56:27.776253 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:27.776222    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl"]
Jul 13 15:56:27.780741 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:27.780716    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-6270d141-openshift-default-6d49f8fd59-sppnl"]
Jul 13 15:56:28.202940 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:28.202861    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad1af09f-8d85-4096-9890-df612f8e0564" path="/var/lib/kubelet/pods/ad1af09f-8d85-4096-9890-df612f8e0564/volumes"
Jul 13 15:56:28.625407 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:28.625365    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:56:28.683758 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:28.683733    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:56:28.786765 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:28.786727    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:56:28.879958 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:28.879888    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:56:29.026041 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:29.026018    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:56:34.395896 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:34.395868    2555 scope.go:117] "RemoveContainer" containerID="6e323ea6cadbc82ee63c76eb7adcba7d97371cf4fca9401cba422acb729c4480"
Jul 13 15:56:34.806375 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:34.806334    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:56:34.906757 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:34.906726    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:56:41.788267 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:41.788230    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:56:42.085614 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.085526    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9"]
Jul 13 15:56:42.086046 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.086031    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad1af09f-8d85-4096-9890-df612f8e0564" containerName="istio-proxy"
Jul 13 15:56:42.086087 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.086049    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad1af09f-8d85-4096-9890-df612f8e0564" containerName="istio-proxy"
Jul 13 15:56:42.086087 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.086075    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76ed6ed2-892b-4834-a63b-a5439dc974eb" containerName="maas-api"
Jul 13 15:56:42.086087 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.086083    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="76ed6ed2-892b-4834-a63b-a5439dc974eb" containerName="maas-api"
Jul 13 15:56:42.086223 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.086182    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad1af09f-8d85-4096-9890-df612f8e0564" containerName="istio-proxy"
Jul 13 15:56:42.086223 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.086193    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="76ed6ed2-892b-4834-a63b-a5439dc974eb" containerName="maas-api"
Jul 13 15:56:42.086223 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.086204    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad1af09f-8d85-4096-9890-df612f8e0564" containerName="istio-proxy"
Jul 13 15:56:42.089681 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.089662    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9"
Jul 13 15:56:42.092190 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.092167    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-5461ffdf-openshift-default-dockercfg-k65v2\""
Jul 13 15:56:42.097675 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.097469    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9"]
Jul 13 15:56:42.114755 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.114729    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:56:42.192136 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.192094    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xlnf\" (UniqueName: \"kubernetes.io/projected/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-kube-api-access-9xlnf\") pod \"e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9\" (UID: \"5253bc17-fd1b-46b6-8a3b-d80380fad6cf\") " pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9"
Jul 13 15:56:42.192302 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.192156    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-workload-socket\") pod \"e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9\" (UID: \"5253bc17-fd1b-46b6-8a3b-d80380fad6cf\") " pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9"
Jul 13 15:56:42.192302 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.192198    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-credential-socket\") pod \"e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9\" (UID: \"5253bc17-fd1b-46b6-8a3b-d80380fad6cf\") " pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9"
Jul 13 15:56:42.192302 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.192220    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-istio-podinfo\") pod \"e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9\" (UID: \"5253bc17-fd1b-46b6-8a3b-d80380fad6cf\") " pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9"
Jul 13 15:56:42.192452 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.192313    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-istiod-ca-cert\") pod \"e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9\" (UID: \"5253bc17-fd1b-46b6-8a3b-d80380fad6cf\") " pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9"
Jul 13 15:56:42.192452 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.192376    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-workload-certs\") pod \"e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9\" (UID: \"5253bc17-fd1b-46b6-8a3b-d80380fad6cf\") " pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9"
Jul 13 15:56:42.192452 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.192400    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-istio-envoy\") pod \"e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9\" (UID: \"5253bc17-fd1b-46b6-8a3b-d80380fad6cf\") " pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9"
Jul 13 15:56:42.192452 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.192420    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-istio-token\") pod \"e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9\" (UID: \"5253bc17-fd1b-46b6-8a3b-d80380fad6cf\") " pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9"
Jul 13 15:56:42.192452 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.192449    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-istio-data\") pod \"e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9\" (UID: \"5253bc17-fd1b-46b6-8a3b-d80380fad6cf\") " pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9"
Jul 13 15:56:42.293468 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.293433    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-workload-certs\") pod \"e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9\" (UID: \"5253bc17-fd1b-46b6-8a3b-d80380fad6cf\") " pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9"
Jul 13 15:56:42.293468 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.293468    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-istio-envoy\") pod \"e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9\" (UID: \"5253bc17-fd1b-46b6-8a3b-d80380fad6cf\") " pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9"
Jul 13 15:56:42.293752 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.293496    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-istio-token\") pod \"e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9\" (UID: \"5253bc17-fd1b-46b6-8a3b-d80380fad6cf\") " pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9"
Jul 13 15:56:42.293752 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.293544    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-istio-data\") pod \"e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9\" (UID: \"5253bc17-fd1b-46b6-8a3b-d80380fad6cf\") " pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9"
Jul 13 15:56:42.293752 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.293603    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xlnf\" (UniqueName: \"kubernetes.io/projected/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-kube-api-access-9xlnf\") pod \"e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9\" (UID: \"5253bc17-fd1b-46b6-8a3b-d80380fad6cf\") " pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9"
Jul 13 15:56:42.293752 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.293642    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-workload-socket\") pod \"e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9\" (UID: \"5253bc17-fd1b-46b6-8a3b-d80380fad6cf\") " pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9"
Jul 13 15:56:42.293752 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.293684    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-credential-socket\") pod \"e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9\" (UID: \"5253bc17-fd1b-46b6-8a3b-d80380fad6cf\") " pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9"
Jul 13 15:56:42.293752 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.293709    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-istio-podinfo\") pod \"e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9\" (UID: \"5253bc17-fd1b-46b6-8a3b-d80380fad6cf\") " pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9"
Jul 13 15:56:42.294073 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.293784    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-istiod-ca-cert\") pod \"e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9\" (UID: \"5253bc17-fd1b-46b6-8a3b-d80380fad6cf\") " pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9"
Jul 13 15:56:42.294073 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.293885    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-workload-certs\") pod \"e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9\" (UID: \"5253bc17-fd1b-46b6-8a3b-d80380fad6cf\") " pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9"
Jul 13 15:56:42.294185 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.294162    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-credential-socket\") pod \"e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9\" (UID: \"5253bc17-fd1b-46b6-8a3b-d80380fad6cf\") " pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9"
Jul 13 15:56:42.294243 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.294222    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-workload-socket\") pod \"e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9\" (UID: \"5253bc17-fd1b-46b6-8a3b-d80380fad6cf\") " pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9"
Jul 13 15:56:42.294299 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.294283    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-istio-data\") pod \"e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9\" (UID: \"5253bc17-fd1b-46b6-8a3b-d80380fad6cf\") " pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9"
Jul 13 15:56:42.294479 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.294457    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-istiod-ca-cert\") pod \"e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9\" (UID: \"5253bc17-fd1b-46b6-8a3b-d80380fad6cf\") " pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9"
Jul 13 15:56:42.296136 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.296113    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-istio-envoy\") pod \"e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9\" (UID: \"5253bc17-fd1b-46b6-8a3b-d80380fad6cf\") " pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9"
Jul 13 15:56:42.296326 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.296306    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-istio-podinfo\") pod \"e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9\" (UID: \"5253bc17-fd1b-46b6-8a3b-d80380fad6cf\") " pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9"
Jul 13 15:56:42.302196 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.302174    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-istio-token\") pod \"e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9\" (UID: \"5253bc17-fd1b-46b6-8a3b-d80380fad6cf\") " pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9"
Jul 13 15:56:42.302376 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.302355    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xlnf\" (UniqueName: \"kubernetes.io/projected/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-kube-api-access-9xlnf\") pod \"e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9\" (UID: \"5253bc17-fd1b-46b6-8a3b-d80380fad6cf\") " pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9"
Jul 13 15:56:42.401163 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.401067    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9"
Jul 13 15:56:42.552094 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.552064    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9"]
Jul 13 15:56:42.554067 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:56:42.554040    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5253bc17_fd1b_46b6_8a3b_d80380fad6cf.slice/crio-18c89a29a0b50932a1ab961fb432c47d1a1be1793c27160cee4ab92b4e61e6c4 WatchSource:0}: Error finding container 18c89a29a0b50932a1ab961fb432c47d1a1be1793c27160cee4ab92b4e61e6c4: Status 404 returned error can't find the container with id 18c89a29a0b50932a1ab961fb432c47d1a1be1793c27160cee4ab92b4e61e6c4
Jul 13 15:56:42.556282 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.556252    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 15:56:42.556365 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.556314    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 15:56:42.556365 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.556350    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 15:56:42.814176 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.814130    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9" event={"ID":"5253bc17-fd1b-46b6-8a3b-d80380fad6cf","Type":"ContainerStarted","Data":"a7f5246af5168da768b5277555a1e970e7923b26dafc0ae48f9a4e730f0ad68a"}
Jul 13 15:56:42.814666 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.814191    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9" event={"ID":"5253bc17-fd1b-46b6-8a3b-d80380fad6cf","Type":"ContainerStarted","Data":"18c89a29a0b50932a1ab961fb432c47d1a1be1793c27160cee4ab92b4e61e6c4"}
Jul 13 15:56:42.834738 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:42.834690    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9" podStartSLOduration=0.834674755 podStartE2EDuration="834.674755ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:56:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:56:42.832792824 +0000 UTC m=+1989.157514720" watchObservedRunningTime="2026-07-13 15:56:42.834674755 +0000 UTC m=+1989.159396650"
Jul 13 15:56:43.350993 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:43.350965    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:56:43.401491 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:43.401460    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9"
Jul 13 15:56:43.408600 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:43.408555    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9"
Jul 13 15:56:43.819491 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:43.819460    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9"
Jul 13 15:56:43.820314 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:43.820293    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9"
Jul 13 15:56:44.792845 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:44.792804    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:56:44.891772 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:44.891742    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:56:45.032310 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:45.032268    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5461ffdf-78886d8466-9v9kh"]
Jul 13 15:56:45.032877 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:45.032857    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad1af09f-8d85-4096-9890-df612f8e0564" containerName="istio-proxy"
Jul 13 15:56:45.032950 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:45.032881    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad1af09f-8d85-4096-9890-df612f8e0564" containerName="istio-proxy"
Jul 13 15:56:45.036626 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:45.036605    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5461ffdf-78886d8466-9v9kh"
Jul 13 15:56:45.039058 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:45.039034    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-5461ffdf-serving-cert\""
Jul 13 15:56:45.039169 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:45.039065    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kjwpb\""
Jul 13 15:56:45.044612 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:45.044524    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5461ffdf-78886d8466-9v9kh"]
Jul 13 15:56:45.062207 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:45.062178    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:56:45.122401 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:45.122364    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/490d2626-dcec-483b-b758-f2295130a12e-openshift-service-ca\") pod \"maas-api-e2e-mt-5461ffdf-78886d8466-9v9kh\" (UID: \"490d2626-dcec-483b-b758-f2295130a12e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5461ffdf-78886d8466-9v9kh"
Jul 13 15:56:45.122604 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:45.122427    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/490d2626-dcec-483b-b758-f2295130a12e-maas-api-tls\") pod \"maas-api-e2e-mt-5461ffdf-78886d8466-9v9kh\" (UID: \"490d2626-dcec-483b-b758-f2295130a12e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5461ffdf-78886d8466-9v9kh"
Jul 13 15:56:45.122604 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:45.122476    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48svq\" (UniqueName: \"kubernetes.io/projected/490d2626-dcec-483b-b758-f2295130a12e-kube-api-access-48svq\") pod \"maas-api-e2e-mt-5461ffdf-78886d8466-9v9kh\" (UID: \"490d2626-dcec-483b-b758-f2295130a12e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5461ffdf-78886d8466-9v9kh"
Jul 13 15:56:45.204960 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:45.204923    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:56:45.223146 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:45.223121    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48svq\" (UniqueName: \"kubernetes.io/projected/490d2626-dcec-483b-b758-f2295130a12e-kube-api-access-48svq\") pod \"maas-api-e2e-mt-5461ffdf-78886d8466-9v9kh\" (UID: \"490d2626-dcec-483b-b758-f2295130a12e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5461ffdf-78886d8466-9v9kh"
Jul 13 15:56:45.223263 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:45.223163    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/490d2626-dcec-483b-b758-f2295130a12e-openshift-service-ca\") pod \"maas-api-e2e-mt-5461ffdf-78886d8466-9v9kh\" (UID: \"490d2626-dcec-483b-b758-f2295130a12e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5461ffdf-78886d8466-9v9kh"
Jul 13 15:56:45.223263 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:45.223209    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/490d2626-dcec-483b-b758-f2295130a12e-maas-api-tls\") pod \"maas-api-e2e-mt-5461ffdf-78886d8466-9v9kh\" (UID: \"490d2626-dcec-483b-b758-f2295130a12e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5461ffdf-78886d8466-9v9kh"
Jul 13 15:56:45.223847 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:45.223830    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/490d2626-dcec-483b-b758-f2295130a12e-openshift-service-ca\") pod \"maas-api-e2e-mt-5461ffdf-78886d8466-9v9kh\" (UID: \"490d2626-dcec-483b-b758-f2295130a12e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5461ffdf-78886d8466-9v9kh"
Jul 13 15:56:45.225493 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:45.225475    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/490d2626-dcec-483b-b758-f2295130a12e-maas-api-tls\") pod \"maas-api-e2e-mt-5461ffdf-78886d8466-9v9kh\" (UID: \"490d2626-dcec-483b-b758-f2295130a12e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5461ffdf-78886d8466-9v9kh"
Jul 13 15:56:45.230973 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:45.230951    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48svq\" (UniqueName: \"kubernetes.io/projected/490d2626-dcec-483b-b758-f2295130a12e-kube-api-access-48svq\") pod \"maas-api-e2e-mt-5461ffdf-78886d8466-9v9kh\" (UID: \"490d2626-dcec-483b-b758-f2295130a12e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5461ffdf-78886d8466-9v9kh"
Jul 13 15:56:45.351109 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:45.351021    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5461ffdf-78886d8466-9v9kh"
Jul 13 15:56:45.492473 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:45.492443    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5461ffdf-78886d8466-9v9kh"]
Jul 13 15:56:45.494552 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:56:45.494527    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod490d2626_dcec_483b_b758_f2295130a12e.slice/crio-df4de4c099cd4320a3bb9e6f6e7b9f05ecf35a2781755431a5c4fc212116d0f3 WatchSource:0}: Error finding container df4de4c099cd4320a3bb9e6f6e7b9f05ecf35a2781755431a5c4fc212116d0f3: Status 404 returned error can't find the container with id df4de4c099cd4320a3bb9e6f6e7b9f05ecf35a2781755431a5c4fc212116d0f3
Jul 13 15:56:45.533900 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:45.533866    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:56:45.635166 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:45.635078    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:56:45.830235 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:45.830193    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5461ffdf-78886d8466-9v9kh" event={"ID":"490d2626-dcec-483b-b758-f2295130a12e","Type":"ContainerStarted","Data":"df4de4c099cd4320a3bb9e6f6e7b9f05ecf35a2781755431a5c4fc212116d0f3"}
Jul 13 15:56:46.790596 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:46.790550    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:56:46.836450 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:46.836421    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5461ffdf-78886d8466-9v9kh" event={"ID":"490d2626-dcec-483b-b758-f2295130a12e","Type":"ContainerStarted","Data":"0606b0899d1cbdf8521850b90f051a01c609bbb42c4e5658adb9b8328c4190fd"}
Jul 13 15:56:46.836630 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:46.836532    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5461ffdf-78886d8466-9v9kh"
Jul 13 15:56:46.854888 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:46.854844    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5461ffdf-78886d8466-9v9kh" podStartSLOduration=0.991577684 podStartE2EDuration="1.854830016s" totalImagesPullingTime="863.252332ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:56:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:56:46.85369841 +0000 UTC m=+1993.178420307" watchObservedRunningTime="2026-07-13 15:56:46.854830016 +0000 UTC m=+1993.179551911"
Jul 13 15:56:49.295434 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:49.295398    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:56:52.848019 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:52.847987    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5461ffdf-78886d8466-9v9kh"
Jul 13 15:56:55.523430 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:55.523386    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:56:55.577400 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:55.577356    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:56:57.653259 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:57.653220    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:56:59.861832 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:59.861785    2555 patch_prober.go:28] interesting pod/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 13 15:56:59.864150 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:56:59.861864    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9" podUID="5253bc17-fd1b-46b6-8a3b-d80380fad6cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 13 15:57:00.913192 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:57:00.913158    2555 generic.go:356] "Generic (PLEG): container finished" podID="5253bc17-fd1b-46b6-8a3b-d80380fad6cf" containerID="a7f5246af5168da768b5277555a1e970e7923b26dafc0ae48f9a4e730f0ad68a" exitCode=0
Jul 13 15:57:00.913605 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:57:00.913241    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9" event={"ID":"5253bc17-fd1b-46b6-8a3b-d80380fad6cf","Type":"ContainerDied","Data":"a7f5246af5168da768b5277555a1e970e7923b26dafc0ae48f9a4e730f0ad68a"}
Jul 13 15:57:00.913683 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:57:00.913665    2555 scope.go:117] "RemoveContainer" containerID="a7f5246af5168da768b5277555a1e970e7923b26dafc0ae48f9a4e730f0ad68a"
Jul 13 15:57:00.914641 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:57:00.914610    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 15:57:00.914753 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:57:00.914677    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 15:57:00.914753 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:57:00.914717    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 15:57:01.920513 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:57:01.920478    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9" event={"ID":"5253bc17-fd1b-46b6-8a3b-d80380fad6cf","Type":"ContainerStarted","Data":"2be144c89920dabb8b03e0ea187cc547717eb000ff6da92c9e7f695218844589"}
Jul 13 15:57:02.401667 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:57:02.401630    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9"
Jul 13 15:57:02.401858 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:57:02.401840    2555 patch_prober.go:28] interesting pod/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 13 15:57:02.401903 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:57:02.401880    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9" podUID="5253bc17-fd1b-46b6-8a3b-d80380fad6cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 13 15:57:03.402446 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:57:03.402409    2555 patch_prober.go:28] interesting pod/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 13 15:57:03.402855 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:57:03.402475    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9" podUID="5253bc17-fd1b-46b6-8a3b-d80380fad6cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 13 15:57:04.401673 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:57:04.401637    2555 patch_prober.go:28] interesting pod/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 13 15:57:04.401987 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:57:04.401693    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9" podUID="5253bc17-fd1b-46b6-8a3b-d80380fad6cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 13 15:57:05.401935 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:57:05.401898    2555 patch_prober.go:28] interesting pod/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 13 15:57:05.402328 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:57:05.401949    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9" podUID="5253bc17-fd1b-46b6-8a3b-d80380fad6cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 13 15:57:06.404967 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:57:06.404932    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9"
Jul 13 15:57:06.405344 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:57:06.405193    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9"
Jul 13 15:57:06.405794 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:57:06.405778    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9"
Jul 13 15:57:32.834291 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:57:32.834254    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5461ffdf-78886d8466-9v9kh"]
Jul 13 15:57:32.834850 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:57:32.834504    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5461ffdf-78886d8466-9v9kh" podUID="490d2626-dcec-483b-b758-f2295130a12e" containerName="maas-api" containerID="cri-o://0606b0899d1cbdf8521850b90f051a01c609bbb42c4e5658adb9b8328c4190fd" gracePeriod=30
Jul 13 15:57:32.843057 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:57:32.843024    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5461ffdf-78886d8466-9v9kh" podUID="490d2626-dcec-483b-b758-f2295130a12e" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.59:8443/health\": dial tcp 10.132.0.59:8443: connect: connection refused"
Jul 13 15:57:32.857577 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:57:32.857554    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:57:33.066620 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:57:33.066572    2555 generic.go:356] "Generic (PLEG): container finished" podID="490d2626-dcec-483b-b758-f2295130a12e" containerID="0606b0899d1cbdf8521850b90f051a01c609bbb42c4e5658adb9b8328c4190fd" exitCode=0
Jul 13 15:57:33.066746 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:57:33.066656    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5461ffdf-78886d8466-9v9kh" event={"ID":"490d2626-dcec-483b-b758-f2295130a12e","Type":"ContainerDied","Data":"0606b0899d1cbdf8521850b90f051a01c609bbb42c4e5658adb9b8328c4190fd"}
Jul 13 15:57:33.066746 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:57:33.066719    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5461ffdf-78886d8466-9v9kh" event={"ID":"490d2626-dcec-483b-b758-f2295130a12e","Type":"ContainerDied","Data":"df4de4c099cd4320a3bb9e6f6e7b9f05ecf35a2781755431a5c4fc212116d0f3"}
Jul 13 15:57:33.066746 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:57:33.066743    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="df4de4c099cd4320a3bb9e6f6e7b9f05ecf35a2781755431a5c4fc212116d0f3"
Jul 13 15:57:33.077340 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:57:33.077322    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5461ffdf-78886d8466-9v9kh"
Jul 13 15:57:33.162673 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:57:33.162553    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/490d2626-dcec-483b-b758-f2295130a12e-maas-api-tls\") pod \"490d2626-dcec-483b-b758-f2295130a12e\" (UID: \"490d2626-dcec-483b-b758-f2295130a12e\") "
Jul 13 15:57:33.162834 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:57:33.162761    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/490d2626-dcec-483b-b758-f2295130a12e-openshift-service-ca\") pod \"490d2626-dcec-483b-b758-f2295130a12e\" (UID: \"490d2626-dcec-483b-b758-f2295130a12e\") "
Jul 13 15:57:33.162834 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:57:33.162795    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48svq\" (UniqueName: \"kubernetes.io/projected/490d2626-dcec-483b-b758-f2295130a12e-kube-api-access-48svq\") pod \"490d2626-dcec-483b-b758-f2295130a12e\" (UID: \"490d2626-dcec-483b-b758-f2295130a12e\") "
Jul 13 15:57:33.163146 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:57:33.163126    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/490d2626-dcec-483b-b758-f2295130a12e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "490d2626-dcec-483b-b758-f2295130a12e" (UID: "490d2626-dcec-483b-b758-f2295130a12e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:57:33.164710 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:57:33.164685    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/490d2626-dcec-483b-b758-f2295130a12e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "490d2626-dcec-483b-b758-f2295130a12e" (UID: "490d2626-dcec-483b-b758-f2295130a12e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 15:57:33.164786 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:57:33.164748    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/490d2626-dcec-483b-b758-f2295130a12e-kube-api-access-48svq" (OuterVolumeSpecName: "kube-api-access-48svq") pod "490d2626-dcec-483b-b758-f2295130a12e" (UID: "490d2626-dcec-483b-b758-f2295130a12e"). InnerVolumeSpecName "kube-api-access-48svq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:57:33.263750 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:57:33.263711    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/490d2626-dcec-483b-b758-f2295130a12e-openshift-service-ca\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:57:33.263750 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:57:33.263743    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48svq\" (UniqueName: \"kubernetes.io/projected/490d2626-dcec-483b-b758-f2295130a12e-kube-api-access-48svq\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:57:33.263750 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:57:33.263753    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/490d2626-dcec-483b-b758-f2295130a12e-maas-api-tls\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:57:34.071691 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:57:34.071657    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5461ffdf-78886d8466-9v9kh"
Jul 13 15:57:34.092313 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:57:34.092251    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5461ffdf-78886d8466-9v9kh"]
Jul 13 15:57:34.094039 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:57:34.094017    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5461ffdf-78886d8466-9v9kh"]
Jul 13 15:57:34.203549 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:57:34.203515    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="490d2626-dcec-483b-b758-f2295130a12e" path="/var/lib/kubelet/pods/490d2626-dcec-483b-b758-f2295130a12e/volumes"
Jul 13 15:57:37.489499 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:57:37.489465    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:57:42.574233 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:57:42.574204    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:57:45.622407 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:57:45.622375    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:57:45.723272 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:57:45.723235    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:58:19.141316 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:19.141281    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:58:19.923003 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:19.922973    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:58:25.598315 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:25.598276    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:58:31.251143 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:31.251107    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:58:31.315210 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:31.315175    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:58:34.296226 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:34.296202    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cptrx_90f53326-a36e-4682-a268-bdfec7cf722b/console-operator/1.log"
Jul 13 15:58:34.310928 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:34.310896    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x8g52_f4724159-d88b-4ed1-a5fc-956a4d1e3fe8/ovn-acl-logging/0.log"
Jul 13 15:58:34.311099 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:34.310963    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cptrx_90f53326-a36e-4682-a268-bdfec7cf722b/console-operator/1.log"
Jul 13 15:58:34.319099 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:34.319077    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x8g52_f4724159-d88b-4ed1-a5fc-956a4d1e3fe8/ovn-acl-logging/0.log"
Jul 13 15:58:39.716515 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:39.716479    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9"]
Jul 13 15:58:39.716920 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:39.716753    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9" podUID="5253bc17-fd1b-46b6-8a3b-d80380fad6cf" containerName="istio-proxy" containerID="cri-o://2be144c89920dabb8b03e0ea187cc547717eb000ff6da92c9e7f695218844589" gracePeriod=30
Jul 13 15:58:39.739303 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:39.739269    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:58:39.981828 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:39.981792    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:58:41.009411 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:41.009377    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:58:41.108942 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:41.108906    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:58:41.208861 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:41.208833    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:58:41.981838 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:41.981812    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:58:42.083961 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:42.083930    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:58:42.181532 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:42.181507    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:58:43.642154 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:43.642119    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:58:44.973520 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:44.973498    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9"
Jul 13 15:58:45.093307 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:45.093213    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-workload-certs\") pod \"5253bc17-fd1b-46b6-8a3b-d80380fad6cf\" (UID: \"5253bc17-fd1b-46b6-8a3b-d80380fad6cf\") "
Jul 13 15:58:45.093307 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:45.093255    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-istio-data\") pod \"5253bc17-fd1b-46b6-8a3b-d80380fad6cf\" (UID: \"5253bc17-fd1b-46b6-8a3b-d80380fad6cf\") "
Jul 13 15:58:45.093307 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:45.093305    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xlnf\" (UniqueName: \"kubernetes.io/projected/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-kube-api-access-9xlnf\") pod \"5253bc17-fd1b-46b6-8a3b-d80380fad6cf\" (UID: \"5253bc17-fd1b-46b6-8a3b-d80380fad6cf\") "
Jul 13 15:58:45.093614 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:45.093329    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-istio-podinfo\") pod \"5253bc17-fd1b-46b6-8a3b-d80380fad6cf\" (UID: \"5253bc17-fd1b-46b6-8a3b-d80380fad6cf\") "
Jul 13 15:58:45.093614 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:45.093350    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-istiod-ca-cert\") pod \"5253bc17-fd1b-46b6-8a3b-d80380fad6cf\" (UID: \"5253bc17-fd1b-46b6-8a3b-d80380fad6cf\") "
Jul 13 15:58:45.093614 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:45.093382    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-istio-envoy\") pod \"5253bc17-fd1b-46b6-8a3b-d80380fad6cf\" (UID: \"5253bc17-fd1b-46b6-8a3b-d80380fad6cf\") "
Jul 13 15:58:45.093614 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:45.093407    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-istio-token\") pod \"5253bc17-fd1b-46b6-8a3b-d80380fad6cf\" (UID: \"5253bc17-fd1b-46b6-8a3b-d80380fad6cf\") "
Jul 13 15:58:45.093614 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:45.093431    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-credential-socket\") pod \"5253bc17-fd1b-46b6-8a3b-d80380fad6cf\" (UID: \"5253bc17-fd1b-46b6-8a3b-d80380fad6cf\") "
Jul 13 15:58:45.093614 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:45.093475    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-workload-socket\") pod \"5253bc17-fd1b-46b6-8a3b-d80380fad6cf\" (UID: \"5253bc17-fd1b-46b6-8a3b-d80380fad6cf\") "
Jul 13 15:58:45.093937 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:45.093906    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5253bc17-fd1b-46b6-8a3b-d80380fad6cf" (UID: "5253bc17-fd1b-46b6-8a3b-d80380fad6cf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 15:58:45.094055 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:45.093915    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5253bc17-fd1b-46b6-8a3b-d80380fad6cf" (UID: "5253bc17-fd1b-46b6-8a3b-d80380fad6cf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:58:45.094055 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:45.094017    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5253bc17-fd1b-46b6-8a3b-d80380fad6cf" (UID: "5253bc17-fd1b-46b6-8a3b-d80380fad6cf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:58:45.094269 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:45.094117    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5253bc17-fd1b-46b6-8a3b-d80380fad6cf" (UID: "5253bc17-fd1b-46b6-8a3b-d80380fad6cf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:58:45.094532 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:45.094505    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-istio-data" (OuterVolumeSpecName: "istio-data") pod "5253bc17-fd1b-46b6-8a3b-d80380fad6cf" (UID: "5253bc17-fd1b-46b6-8a3b-d80380fad6cf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:58:45.095754 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:45.095727    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5253bc17-fd1b-46b6-8a3b-d80380fad6cf" (UID: "5253bc17-fd1b-46b6-8a3b-d80380fad6cf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 15:58:45.095931 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:45.095910    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-istio-token" (OuterVolumeSpecName: "istio-token") pod "5253bc17-fd1b-46b6-8a3b-d80380fad6cf" (UID: "5253bc17-fd1b-46b6-8a3b-d80380fad6cf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:58:45.096121 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:45.096093    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5253bc17-fd1b-46b6-8a3b-d80380fad6cf" (UID: "5253bc17-fd1b-46b6-8a3b-d80380fad6cf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 15:58:45.096121 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:45.096109    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-kube-api-access-9xlnf" (OuterVolumeSpecName: "kube-api-access-9xlnf") pod "5253bc17-fd1b-46b6-8a3b-d80380fad6cf" (UID: "5253bc17-fd1b-46b6-8a3b-d80380fad6cf"). InnerVolumeSpecName "kube-api-access-9xlnf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 15:58:45.194291 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:45.194263    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xlnf\" (UniqueName: \"kubernetes.io/projected/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-kube-api-access-9xlnf\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:58:45.194291 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:45.194287    2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-istio-podinfo\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:58:45.194445 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:45.194297    2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-istiod-ca-cert\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:58:45.194445 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:45.194305    2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-istio-envoy\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:58:45.194445 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:45.194313    2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-istio-token\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:58:45.194445 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:45.194320    2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-credential-socket\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:58:45.194445 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:45.194328    2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-workload-socket\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:58:45.194445 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:45.194335    2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-workload-certs\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:58:45.194445 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:45.194346    2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5253bc17-fd1b-46b6-8a3b-d80380fad6cf-istio-data\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 15:58:45.404297 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:45.404208    2555 generic.go:356] "Generic (PLEG): container finished" podID="5253bc17-fd1b-46b6-8a3b-d80380fad6cf" containerID="2be144c89920dabb8b03e0ea187cc547717eb000ff6da92c9e7f695218844589" exitCode=0
Jul 13 15:58:45.404297 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:45.404254    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9"
Jul 13 15:58:45.404476 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:45.404296    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9" event={"ID":"5253bc17-fd1b-46b6-8a3b-d80380fad6cf","Type":"ContainerDied","Data":"2be144c89920dabb8b03e0ea187cc547717eb000ff6da92c9e7f695218844589"}
Jul 13 15:58:45.404476 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:45.404361    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9" event={"ID":"5253bc17-fd1b-46b6-8a3b-d80380fad6cf","Type":"ContainerDied","Data":"18c89a29a0b50932a1ab961fb432c47d1a1be1793c27160cee4ab92b4e61e6c4"}
Jul 13 15:58:45.404476 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:45.404384    2555 scope.go:117] "RemoveContainer" containerID="2be144c89920dabb8b03e0ea187cc547717eb000ff6da92c9e7f695218844589"
Jul 13 15:58:45.413693 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:45.413674    2555 scope.go:117] "RemoveContainer" containerID="a7f5246af5168da768b5277555a1e970e7923b26dafc0ae48f9a4e730f0ad68a"
Jul 13 15:58:45.422101 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:45.422083    2555 scope.go:117] "RemoveContainer" containerID="2be144c89920dabb8b03e0ea187cc547717eb000ff6da92c9e7f695218844589"
Jul 13 15:58:45.422339 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:58:45.422322    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2be144c89920dabb8b03e0ea187cc547717eb000ff6da92c9e7f695218844589\": container with ID starting with 2be144c89920dabb8b03e0ea187cc547717eb000ff6da92c9e7f695218844589 not found: ID does not exist" containerID="2be144c89920dabb8b03e0ea187cc547717eb000ff6da92c9e7f695218844589"
Jul 13 15:58:45.422387 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:45.422348    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2be144c89920dabb8b03e0ea187cc547717eb000ff6da92c9e7f695218844589"} err="failed to get container status \"2be144c89920dabb8b03e0ea187cc547717eb000ff6da92c9e7f695218844589\": rpc error: code = NotFound desc = could not find container \"2be144c89920dabb8b03e0ea187cc547717eb000ff6da92c9e7f695218844589\": container with ID starting with 2be144c89920dabb8b03e0ea187cc547717eb000ff6da92c9e7f695218844589 not found: ID does not exist"
Jul 13 15:58:45.422387 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:45.422365    2555 scope.go:117] "RemoveContainer" containerID="a7f5246af5168da768b5277555a1e970e7923b26dafc0ae48f9a4e730f0ad68a"
Jul 13 15:58:45.422562 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:58:45.422545    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7f5246af5168da768b5277555a1e970e7923b26dafc0ae48f9a4e730f0ad68a\": container with ID starting with a7f5246af5168da768b5277555a1e970e7923b26dafc0ae48f9a4e730f0ad68a not found: ID does not exist" containerID="a7f5246af5168da768b5277555a1e970e7923b26dafc0ae48f9a4e730f0ad68a"
Jul 13 15:58:45.422623 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:45.422567    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7f5246af5168da768b5277555a1e970e7923b26dafc0ae48f9a4e730f0ad68a"} err="failed to get container status \"a7f5246af5168da768b5277555a1e970e7923b26dafc0ae48f9a4e730f0ad68a\": rpc error: code = NotFound desc = could not find container \"a7f5246af5168da768b5277555a1e970e7923b26dafc0ae48f9a4e730f0ad68a\": container with ID starting with a7f5246af5168da768b5277555a1e970e7923b26dafc0ae48f9a4e730f0ad68a not found: ID does not exist"
Jul 13 15:58:45.426083 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:45.426052    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9"]
Jul 13 15:58:45.429371 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:45.429352    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-5461ffdf-openshift-default-68f5555b47-jbql9"]
Jul 13 15:58:46.202681 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:46.202647    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5253bc17-fd1b-46b6-8a3b-d80380fad6cf" path="/var/lib/kubelet/pods/5253bc17-fd1b-46b6-8a3b-d80380fad6cf/volumes"
Jul 13 15:58:49.508746 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:49.508712    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:58:49.577039 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:49.577006    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:58:50.206990 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:50.206957    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:58:55.984604 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:55.984549    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:58:56.039977 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:56.039950    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:58:56.120461 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:56.120421    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:58:56.218484 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:58:56.218464    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:59:06.729722 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:06.729682    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:59:07.085944 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:07.085857    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:59:28.088725 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:28.088630    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:59:34.363231 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:34.363195    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:59:34.462694 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:34.462661    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:59:34.742786 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:34.742755    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:59:35.035580 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.035485    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth"]
Jul 13 15:59:35.036071 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.036049    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5253bc17-fd1b-46b6-8a3b-d80380fad6cf" containerName="istio-proxy"
Jul 13 15:59:35.036134 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.036075    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="5253bc17-fd1b-46b6-8a3b-d80380fad6cf" containerName="istio-proxy"
Jul 13 15:59:35.036134 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.036117    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5253bc17-fd1b-46b6-8a3b-d80380fad6cf" containerName="istio-proxy"
Jul 13 15:59:35.036134 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.036127    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="5253bc17-fd1b-46b6-8a3b-d80380fad6cf" containerName="istio-proxy"
Jul 13 15:59:35.036281 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.036144    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="490d2626-dcec-483b-b758-f2295130a12e" containerName="maas-api"
Jul 13 15:59:35.036281 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.036155    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="490d2626-dcec-483b-b758-f2295130a12e" containerName="maas-api"
Jul 13 15:59:35.036281 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.036262    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="5253bc17-fd1b-46b6-8a3b-d80380fad6cf" containerName="istio-proxy"
Jul 13 15:59:35.036281 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.036276    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="490d2626-dcec-483b-b758-f2295130a12e" containerName="maas-api"
Jul 13 15:59:35.036491 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.036287    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="5253bc17-fd1b-46b6-8a3b-d80380fad6cf" containerName="istio-proxy"
Jul 13 15:59:35.040941 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.040915    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth"
Jul 13 15:59:35.043213 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.043191    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-47280f-openshift-default-dockercfg-dsbg8\""
Jul 13 15:59:35.054303 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.054279    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth"]
Jul 13 15:59:35.060231 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.060184    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:59:35.128389 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.128349    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/def17a6e-068f-42de-af14-079d2c07ae48-workload-socket\") pod \"e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth\" (UID: \"def17a6e-068f-42de-af14-079d2c07ae48\") " pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth"
Jul 13 15:59:35.128549 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.128434    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/def17a6e-068f-42de-af14-079d2c07ae48-credential-socket\") pod \"e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth\" (UID: \"def17a6e-068f-42de-af14-079d2c07ae48\") " pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth"
Jul 13 15:59:35.128549 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.128459    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/def17a6e-068f-42de-af14-079d2c07ae48-istio-data\") pod \"e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth\" (UID: \"def17a6e-068f-42de-af14-079d2c07ae48\") " pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth"
Jul 13 15:59:35.128549 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.128488    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/def17a6e-068f-42de-af14-079d2c07ae48-istio-envoy\") pod \"e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth\" (UID: \"def17a6e-068f-42de-af14-079d2c07ae48\") " pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth"
Jul 13 15:59:35.128693 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.128545    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/def17a6e-068f-42de-af14-079d2c07ae48-workload-certs\") pod \"e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth\" (UID: \"def17a6e-068f-42de-af14-079d2c07ae48\") " pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth"
Jul 13 15:59:35.128693 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.128618    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/def17a6e-068f-42de-af14-079d2c07ae48-istio-podinfo\") pod \"e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth\" (UID: \"def17a6e-068f-42de-af14-079d2c07ae48\") " pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth"
Jul 13 15:59:35.128693 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.128647    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/def17a6e-068f-42de-af14-079d2c07ae48-istio-token\") pod \"e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth\" (UID: \"def17a6e-068f-42de-af14-079d2c07ae48\") " pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth"
Jul 13 15:59:35.128796 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.128696    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/def17a6e-068f-42de-af14-079d2c07ae48-istiod-ca-cert\") pod \"e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth\" (UID: \"def17a6e-068f-42de-af14-079d2c07ae48\") " pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth"
Jul 13 15:59:35.128796 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.128765    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljxnc\" (UniqueName: \"kubernetes.io/projected/def17a6e-068f-42de-af14-079d2c07ae48-kube-api-access-ljxnc\") pod \"e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth\" (UID: \"def17a6e-068f-42de-af14-079d2c07ae48\") " pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth"
Jul 13 15:59:35.230074 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.230052    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/def17a6e-068f-42de-af14-079d2c07ae48-credential-socket\") pod \"e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth\" (UID: \"def17a6e-068f-42de-af14-079d2c07ae48\") " pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth"
Jul 13 15:59:35.230205 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.230081    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/def17a6e-068f-42de-af14-079d2c07ae48-istio-data\") pod \"e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth\" (UID: \"def17a6e-068f-42de-af14-079d2c07ae48\") " pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth"
Jul 13 15:59:35.230205 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.230106    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/def17a6e-068f-42de-af14-079d2c07ae48-istio-envoy\") pod \"e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth\" (UID: \"def17a6e-068f-42de-af14-079d2c07ae48\") " pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth"
Jul 13 15:59:35.230205 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.230123    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/def17a6e-068f-42de-af14-079d2c07ae48-workload-certs\") pod \"e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth\" (UID: \"def17a6e-068f-42de-af14-079d2c07ae48\") " pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth"
Jul 13 15:59:35.230205 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.230139    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/def17a6e-068f-42de-af14-079d2c07ae48-istio-podinfo\") pod \"e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth\" (UID: \"def17a6e-068f-42de-af14-079d2c07ae48\") " pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth"
Jul 13 15:59:35.230205 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.230153    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/def17a6e-068f-42de-af14-079d2c07ae48-istio-token\") pod \"e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth\" (UID: \"def17a6e-068f-42de-af14-079d2c07ae48\") " pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth"
Jul 13 15:59:35.230205 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.230176    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/def17a6e-068f-42de-af14-079d2c07ae48-istiod-ca-cert\") pod \"e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth\" (UID: \"def17a6e-068f-42de-af14-079d2c07ae48\") " pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth"
Jul 13 15:59:35.230532 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.230228    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljxnc\" (UniqueName: \"kubernetes.io/projected/def17a6e-068f-42de-af14-079d2c07ae48-kube-api-access-ljxnc\") pod \"e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth\" (UID: \"def17a6e-068f-42de-af14-079d2c07ae48\") " pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth"
Jul 13 15:59:35.230532 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.230287    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/def17a6e-068f-42de-af14-079d2c07ae48-workload-socket\") pod \"e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth\" (UID: \"def17a6e-068f-42de-af14-079d2c07ae48\") " pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth"
Jul 13 15:59:35.230532 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.230499    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/def17a6e-068f-42de-af14-079d2c07ae48-credential-socket\") pod \"e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth\" (UID: \"def17a6e-068f-42de-af14-079d2c07ae48\") " pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth"
Jul 13 15:59:35.230724 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.230562    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/def17a6e-068f-42de-af14-079d2c07ae48-workload-certs\") pod \"e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth\" (UID: \"def17a6e-068f-42de-af14-079d2c07ae48\") " pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth"
Jul 13 15:59:35.230873 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.230845    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/def17a6e-068f-42de-af14-079d2c07ae48-workload-socket\") pod \"e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth\" (UID: \"def17a6e-068f-42de-af14-079d2c07ae48\") " pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth"
Jul 13 15:59:35.230995 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.230925    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/def17a6e-068f-42de-af14-079d2c07ae48-istio-data\") pod \"e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth\" (UID: \"def17a6e-068f-42de-af14-079d2c07ae48\") " pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth"
Jul 13 15:59:35.231056 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.230978    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/def17a6e-068f-42de-af14-079d2c07ae48-istiod-ca-cert\") pod \"e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth\" (UID: \"def17a6e-068f-42de-af14-079d2c07ae48\") " pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth"
Jul 13 15:59:35.232649 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.232628    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/def17a6e-068f-42de-af14-079d2c07ae48-istio-envoy\") pod \"e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth\" (UID: \"def17a6e-068f-42de-af14-079d2c07ae48\") " pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth"
Jul 13 15:59:35.232982 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.232964    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/def17a6e-068f-42de-af14-079d2c07ae48-istio-podinfo\") pod \"e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth\" (UID: \"def17a6e-068f-42de-af14-079d2c07ae48\") " pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth"
Jul 13 15:59:35.239888 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.239864    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljxnc\" (UniqueName: \"kubernetes.io/projected/def17a6e-068f-42de-af14-079d2c07ae48-kube-api-access-ljxnc\") pod \"e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth\" (UID: \"def17a6e-068f-42de-af14-079d2c07ae48\") " pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth"
Jul 13 15:59:35.240399 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.240380    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/def17a6e-068f-42de-af14-079d2c07ae48-istio-token\") pod \"e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth\" (UID: \"def17a6e-068f-42de-af14-079d2c07ae48\") " pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth"
Jul 13 15:59:35.355350 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.355282    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth"
Jul 13 15:59:35.386194 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.386138    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:59:35.497628 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.497230    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth"]
Jul 13 15:59:35.500093 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:59:35.500069    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddef17a6e_068f_42de_af14_079d2c07ae48.slice/crio-94860141786d28be27c4d24b0a1f8a9ba137343678a3ffeeb693f919a677a4a1 WatchSource:0}: Error finding container 94860141786d28be27c4d24b0a1f8a9ba137343678a3ffeeb693f919a677a4a1: Status 404 returned error can't find the container with id 94860141786d28be27c4d24b0a1f8a9ba137343678a3ffeeb693f919a677a4a1
Jul 13 15:59:35.502235 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.502204    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 15:59:35.502327 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.502265    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 15:59:35.502327 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.502295    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 15:59:35.651643 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.651560    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth" event={"ID":"def17a6e-068f-42de-af14-079d2c07ae48","Type":"ContainerStarted","Data":"2d8cdaba79dccaf6b03823cfe607b823a1cb39a7e1bf025fe1eb7edab95ff35b"}
Jul 13 15:59:35.651784 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.651675    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth" event={"ID":"def17a6e-068f-42de-af14-079d2c07ae48","Type":"ContainerStarted","Data":"94860141786d28be27c4d24b0a1f8a9ba137343678a3ffeeb693f919a677a4a1"}
Jul 13 15:59:35.675366 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:35.675319    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth" podStartSLOduration=0.675303589 podStartE2EDuration="675.303589ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:59:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:59:35.673659675 +0000 UTC m=+2161.998381576" watchObservedRunningTime="2026-07-13 15:59:35.675303589 +0000 UTC m=+2162.000025486"
Jul 13 15:59:36.355943 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:36.355916    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth"
Jul 13 15:59:36.360470 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:36.360446    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth"
Jul 13 15:59:36.656444 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:36.656356    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth"
Jul 13 15:59:36.657334 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:36.657313    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth"
Jul 13 15:59:37.714113 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:37.714082    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:59:37.793502 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:37.793455    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:59:37.797411 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:37.797382    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-47280f-8c7bc59df-pf8vp"]
Jul 13 15:59:37.801103 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:37.801082    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-47280f-8c7bc59df-pf8vp"
Jul 13 15:59:37.803536 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:37.803512    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-47280f-serving-cert\""
Jul 13 15:59:37.803668 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:37.803512    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kjwpb\""
Jul 13 15:59:37.814423 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:37.814351    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-47280f-8c7bc59df-pf8vp"]
Jul 13 15:59:37.851508 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:37.851473    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38868625-0d0e-404e-a465-fd22899c5b49-openshift-service-ca\") pod \"maas-api-e2e-inf-a-47280f-8c7bc59df-pf8vp\" (UID: \"38868625-0d0e-404e-a465-fd22899c5b49\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-47280f-8c7bc59df-pf8vp"
Jul 13 15:59:37.851639 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:37.851526    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmlf9\" (UniqueName: \"kubernetes.io/projected/38868625-0d0e-404e-a465-fd22899c5b49-kube-api-access-pmlf9\") pod \"maas-api-e2e-inf-a-47280f-8c7bc59df-pf8vp\" (UID: \"38868625-0d0e-404e-a465-fd22899c5b49\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-47280f-8c7bc59df-pf8vp"
Jul 13 15:59:37.851639 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:37.851560    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38868625-0d0e-404e-a465-fd22899c5b49-maas-api-tls\") pod \"maas-api-e2e-inf-a-47280f-8c7bc59df-pf8vp\" (UID: \"38868625-0d0e-404e-a465-fd22899c5b49\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-47280f-8c7bc59df-pf8vp"
Jul 13 15:59:37.851639 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:37.851616    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:59:37.952997 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:37.952969    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38868625-0d0e-404e-a465-fd22899c5b49-openshift-service-ca\") pod \"maas-api-e2e-inf-a-47280f-8c7bc59df-pf8vp\" (UID: \"38868625-0d0e-404e-a465-fd22899c5b49\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-47280f-8c7bc59df-pf8vp"
Jul 13 15:59:37.953225 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:37.953036    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmlf9\" (UniqueName: \"kubernetes.io/projected/38868625-0d0e-404e-a465-fd22899c5b49-kube-api-access-pmlf9\") pod \"maas-api-e2e-inf-a-47280f-8c7bc59df-pf8vp\" (UID: \"38868625-0d0e-404e-a465-fd22899c5b49\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-47280f-8c7bc59df-pf8vp"
Jul 13 15:59:37.953225 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:37.953081    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38868625-0d0e-404e-a465-fd22899c5b49-maas-api-tls\") pod \"maas-api-e2e-inf-a-47280f-8c7bc59df-pf8vp\" (UID: \"38868625-0d0e-404e-a465-fd22899c5b49\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-47280f-8c7bc59df-pf8vp"
Jul 13 15:59:37.953337 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:59:37.953224    2555 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-47280f-serving-cert: secret "maas-api-e2e-inf-a-47280f-serving-cert" not found
Jul 13 15:59:37.953337 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:59:37.953296    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38868625-0d0e-404e-a465-fd22899c5b49-maas-api-tls podName:38868625-0d0e-404e-a465-fd22899c5b49 nodeName:}" failed. No retries permitted until 2026-07-13 15:59:38.453275768 +0000 UTC m=+2164.777997653 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/38868625-0d0e-404e-a465-fd22899c5b49-maas-api-tls") pod "maas-api-e2e-inf-a-47280f-8c7bc59df-pf8vp" (UID: "38868625-0d0e-404e-a465-fd22899c5b49") : secret "maas-api-e2e-inf-a-47280f-serving-cert" not found
Jul 13 15:59:37.953681 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:37.953661    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38868625-0d0e-404e-a465-fd22899c5b49-openshift-service-ca\") pod \"maas-api-e2e-inf-a-47280f-8c7bc59df-pf8vp\" (UID: \"38868625-0d0e-404e-a465-fd22899c5b49\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-47280f-8c7bc59df-pf8vp"
Jul 13 15:59:37.962190 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:37.962165    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmlf9\" (UniqueName: \"kubernetes.io/projected/38868625-0d0e-404e-a465-fd22899c5b49-kube-api-access-pmlf9\") pod \"maas-api-e2e-inf-a-47280f-8c7bc59df-pf8vp\" (UID: \"38868625-0d0e-404e-a465-fd22899c5b49\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-47280f-8c7bc59df-pf8vp"
Jul 13 15:59:38.064137 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:38.064112    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:59:38.287712 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:38.287684    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:59:38.393735 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:38.393636    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:59:38.457292 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:38.457250    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38868625-0d0e-404e-a465-fd22899c5b49-maas-api-tls\") pod \"maas-api-e2e-inf-a-47280f-8c7bc59df-pf8vp\" (UID: \"38868625-0d0e-404e-a465-fd22899c5b49\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-47280f-8c7bc59df-pf8vp"
Jul 13 15:59:38.460109 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:38.460079    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38868625-0d0e-404e-a465-fd22899c5b49-maas-api-tls\") pod \"maas-api-e2e-inf-a-47280f-8c7bc59df-pf8vp\" (UID: \"38868625-0d0e-404e-a465-fd22899c5b49\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-47280f-8c7bc59df-pf8vp"
Jul 13 15:59:38.712390 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:38.712295    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-47280f-8c7bc59df-pf8vp"
Jul 13 15:59:38.856718 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:38.856681    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-47280f-8c7bc59df-pf8vp"]
Jul 13 15:59:38.858339 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:59:38.858313    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38868625_0d0e_404e_a465_fd22899c5b49.slice/crio-88d350f20e70dbef988c7e87d17be4251a12d467c927d64aadaef2739a497a21 WatchSource:0}: Error finding container 88d350f20e70dbef988c7e87d17be4251a12d467c927d64aadaef2739a497a21: Status 404 returned error can't find the container with id 88d350f20e70dbef988c7e87d17be4251a12d467c927d64aadaef2739a497a21
Jul 13 15:59:39.672123 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:39.672031    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-47280f-8c7bc59df-pf8vp" event={"ID":"38868625-0d0e-404e-a465-fd22899c5b49","Type":"ContainerStarted","Data":"9bc31ddf13110858f38c7f89663687bf3c39389c7011b4a9962757a3adad07b2"}
Jul 13 15:59:39.672123 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:39.672095    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-47280f-8c7bc59df-pf8vp" event={"ID":"38868625-0d0e-404e-a465-fd22899c5b49","Type":"ContainerStarted","Data":"88d350f20e70dbef988c7e87d17be4251a12d467c927d64aadaef2739a497a21"}
Jul 13 15:59:39.672302 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:39.672130    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-47280f-8c7bc59df-pf8vp"
Jul 13 15:59:39.692154 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:39.692103    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-47280f-8c7bc59df-pf8vp" podStartSLOduration=2.167693582 podStartE2EDuration="2.69208705s" totalImagesPullingTime="524.393468ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:59:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:59:39.690757385 +0000 UTC m=+2166.015479283" watchObservedRunningTime="2026-07-13 15:59:39.69208705 +0000 UTC m=+2166.016808947"
Jul 13 15:59:42.157093 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:42.157053    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:59:42.521265 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:42.521227    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:59:42.860331 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:42.860239    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:59:43.124903 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:43.124822    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:59:45.308600 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:45.308554    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:59:45.414263 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:45.414229    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:59:45.437169 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:45.437143    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ef5b3f-cd95b7df8-mmzjh"]
Jul 13 15:59:45.441017 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:45.440996    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ef5b3f-cd95b7df8-mmzjh"
Jul 13 15:59:45.443695 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:45.443672    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-ef5b3f-serving-cert\""
Jul 13 15:59:45.483717 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:45.483686    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ef5b3f-cd95b7df8-mmzjh"]
Jul 13 15:59:45.524188 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:45.524152    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73b816be-710b-4781-96a7-e6f326c53249-maas-api-tls\") pod \"maas-api-e2e-inf-b-ef5b3f-cd95b7df8-mmzjh\" (UID: \"73b816be-710b-4781-96a7-e6f326c53249\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ef5b3f-cd95b7df8-mmzjh"
Jul 13 15:59:45.524352 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:45.524278    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/73b816be-710b-4781-96a7-e6f326c53249-openshift-service-ca\") pod \"maas-api-e2e-inf-b-ef5b3f-cd95b7df8-mmzjh\" (UID: \"73b816be-710b-4781-96a7-e6f326c53249\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ef5b3f-cd95b7df8-mmzjh"
Jul 13 15:59:45.524352 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:45.524320    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmmdf\" (UniqueName: \"kubernetes.io/projected/73b816be-710b-4781-96a7-e6f326c53249-kube-api-access-wmmdf\") pod \"maas-api-e2e-inf-b-ef5b3f-cd95b7df8-mmzjh\" (UID: \"73b816be-710b-4781-96a7-e6f326c53249\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ef5b3f-cd95b7df8-mmzjh"
Jul 13 15:59:45.524522 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:45.524504    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:59:45.625247 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:45.625138    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/73b816be-710b-4781-96a7-e6f326c53249-openshift-service-ca\") pod \"maas-api-e2e-inf-b-ef5b3f-cd95b7df8-mmzjh\" (UID: \"73b816be-710b-4781-96a7-e6f326c53249\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ef5b3f-cd95b7df8-mmzjh"
Jul 13 15:59:45.625503 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:45.625473    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmmdf\" (UniqueName: \"kubernetes.io/projected/73b816be-710b-4781-96a7-e6f326c53249-kube-api-access-wmmdf\") pod \"maas-api-e2e-inf-b-ef5b3f-cd95b7df8-mmzjh\" (UID: \"73b816be-710b-4781-96a7-e6f326c53249\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ef5b3f-cd95b7df8-mmzjh"
Jul 13 15:59:45.625651 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:45.625565    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73b816be-710b-4781-96a7-e6f326c53249-maas-api-tls\") pod \"maas-api-e2e-inf-b-ef5b3f-cd95b7df8-mmzjh\" (UID: \"73b816be-710b-4781-96a7-e6f326c53249\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ef5b3f-cd95b7df8-mmzjh"
Jul 13 15:59:45.625771 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:59:45.625750    2555 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-ef5b3f-serving-cert: secret "maas-api-e2e-inf-b-ef5b3f-serving-cert" not found
Jul 13 15:59:45.625946 ip-10-0-137-93 kubenswrapper[2555]: E0713 15:59:45.625933    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73b816be-710b-4781-96a7-e6f326c53249-maas-api-tls podName:73b816be-710b-4781-96a7-e6f326c53249 nodeName:}" failed. No retries permitted until 2026-07-13 15:59:46.125911401 +0000 UTC m=+2172.450633291 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/73b816be-710b-4781-96a7-e6f326c53249-maas-api-tls") pod "maas-api-e2e-inf-b-ef5b3f-cd95b7df8-mmzjh" (UID: "73b816be-710b-4781-96a7-e6f326c53249") : secret "maas-api-e2e-inf-b-ef5b3f-serving-cert" not found
Jul 13 15:59:45.626135 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:45.626004    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/73b816be-710b-4781-96a7-e6f326c53249-openshift-service-ca\") pod \"maas-api-e2e-inf-b-ef5b3f-cd95b7df8-mmzjh\" (UID: \"73b816be-710b-4781-96a7-e6f326c53249\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ef5b3f-cd95b7df8-mmzjh"
Jul 13 15:59:45.636445 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:45.636420    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmmdf\" (UniqueName: \"kubernetes.io/projected/73b816be-710b-4781-96a7-e6f326c53249-kube-api-access-wmmdf\") pod \"maas-api-e2e-inf-b-ef5b3f-cd95b7df8-mmzjh\" (UID: \"73b816be-710b-4781-96a7-e6f326c53249\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ef5b3f-cd95b7df8-mmzjh"
Jul 13 15:59:45.683998 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:45.683972    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-47280f-8c7bc59df-pf8vp"
Jul 13 15:59:45.842207 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:45.842178    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:59:46.130817 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:46.130779    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73b816be-710b-4781-96a7-e6f326c53249-maas-api-tls\") pod \"maas-api-e2e-inf-b-ef5b3f-cd95b7df8-mmzjh\" (UID: \"73b816be-710b-4781-96a7-e6f326c53249\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ef5b3f-cd95b7df8-mmzjh"
Jul 13 15:59:46.133416 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:46.133378    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73b816be-710b-4781-96a7-e6f326c53249-maas-api-tls\") pod \"maas-api-e2e-inf-b-ef5b3f-cd95b7df8-mmzjh\" (UID: \"73b816be-710b-4781-96a7-e6f326c53249\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ef5b3f-cd95b7df8-mmzjh"
Jul 13 15:59:46.165876 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:46.165832    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:59:46.279088 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:46.279048    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:59:46.351637 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:46.351608    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ef5b3f-cd95b7df8-mmzjh"
Jul 13 15:59:46.544059 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:46.544019    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ef5b3f-cd95b7df8-mmzjh"]
Jul 13 15:59:46.546294 ip-10-0-137-93 kubenswrapper[2555]: W0713 15:59:46.546259    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73b816be_710b_4781_96a7_e6f326c53249.slice/crio-474d50c8ce39d22a7bff8ee1f4b1486ea5300ecc6fa06133ec18baed280cd54e WatchSource:0}: Error finding container 474d50c8ce39d22a7bff8ee1f4b1486ea5300ecc6fa06133ec18baed280cd54e: Status 404 returned error can't find the container with id 474d50c8ce39d22a7bff8ee1f4b1486ea5300ecc6fa06133ec18baed280cd54e
Jul 13 15:59:46.710946 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:46.710852    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ef5b3f-cd95b7df8-mmzjh" event={"ID":"73b816be-710b-4781-96a7-e6f326c53249","Type":"ContainerStarted","Data":"474d50c8ce39d22a7bff8ee1f4b1486ea5300ecc6fa06133ec18baed280cd54e"}
Jul 13 15:59:47.716531 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:47.716495    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ef5b3f-cd95b7df8-mmzjh" event={"ID":"73b816be-710b-4781-96a7-e6f326c53249","Type":"ContainerStarted","Data":"abfc575dba29ed3b8bed237b79758e941b479a1bd4f5ed73e352ed6a78b23af5"}
Jul 13 15:59:47.716933 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:47.716622    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ef5b3f-cd95b7df8-mmzjh"
Jul 13 15:59:47.736545 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:47.736502    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ef5b3f-cd95b7df8-mmzjh" podStartSLOduration=2.403637083 podStartE2EDuration="2.736487661s" totalImagesPullingTime="332.850578ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:59:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:59:47.734807885 +0000 UTC m=+2174.059529781" watchObservedRunningTime="2026-07-13 15:59:47.736487661 +0000 UTC m=+2174.061209558"
Jul 13 15:59:49.856731 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:49.856691    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:59:52.697761 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:52.697718    2555 patch_prober.go:28] interesting pod/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 13 15:59:52.698151 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:52.697775    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth" podUID="def17a6e-068f-42de-af14-079d2c07ae48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 13 15:59:53.727347 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:53.727316    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ef5b3f-cd95b7df8-mmzjh"
Jul 13 15:59:53.748064 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:53.748029    2555 generic.go:356] "Generic (PLEG): container finished" podID="def17a6e-068f-42de-af14-079d2c07ae48" containerID="2d8cdaba79dccaf6b03823cfe607b823a1cb39a7e1bf025fe1eb7edab95ff35b" exitCode=0
Jul 13 15:59:53.748064 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:53.748063    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth" event={"ID":"def17a6e-068f-42de-af14-079d2c07ae48","Type":"ContainerDied","Data":"2d8cdaba79dccaf6b03823cfe607b823a1cb39a7e1bf025fe1eb7edab95ff35b"}
Jul 13 15:59:53.748413 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:53.748398    2555 scope.go:117] "RemoveContainer" containerID="2d8cdaba79dccaf6b03823cfe607b823a1cb39a7e1bf025fe1eb7edab95ff35b"
Jul 13 15:59:53.749332 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:53.749304    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 15:59:53.749421 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:53.749365    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 15:59:53.749421 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:53.749412    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 15:59:54.755160 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:54.755127    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth" event={"ID":"def17a6e-068f-42de-af14-079d2c07ae48","Type":"ContainerStarted","Data":"4326607080a86809a6ef93c7c48a12eddd45610df86b3352c621ed3efad1457f"}
Jul 13 15:59:55.355640 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:55.355606    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth"
Jul 13 15:59:55.355830 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:55.355807    2555 patch_prober.go:28] interesting pod/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 13 15:59:55.355878 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:55.355859    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth" podUID="def17a6e-068f-42de-af14-079d2c07ae48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 13 15:59:56.355785 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:56.355754    2555 patch_prober.go:28] interesting pod/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 13 15:59:56.356147 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:56.355804    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth" podUID="def17a6e-068f-42de-af14-079d2c07ae48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 13 15:59:57.356499 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:57.356458    2555 patch_prober.go:28] interesting pod/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 13 15:59:57.356906 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:57.356521    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth" podUID="def17a6e-068f-42de-af14-079d2c07ae48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 13 15:59:58.356527 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:58.356494    2555 patch_prober.go:28] interesting pod/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 13 15:59:58.356966 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:58.356542    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth" podUID="def17a6e-068f-42de-af14-079d2c07ae48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 13 15:59:59.069637 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:59.069602    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:59:59.169711 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:59.169672    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 15:59:59.359541 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:59.359466    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth"
Jul 13 15:59:59.359914 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:59.359770    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth"
Jul 13 15:59:59.360495 ip-10-0-137-93 kubenswrapper[2555]: I0713 15:59:59.360472    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth"
Jul 13 16:00:00.565578 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:00:00.565543    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:00:06.937389 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:00:06.937355    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:00:07.035629 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:00:07.035577    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:00:20.936998 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:00:20.936960    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:00:43.428817 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:00:43.428774    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:00:44.361703 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:00:44.361668    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:00:45.116852 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:00:45.116817    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:00:45.219672 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:00:45.219639    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:00:55.005637 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:00:55.005595    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-47280f-8c7bc59df-pf8vp"]
Jul 13 16:00:55.006113 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:00:55.005815    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-47280f-8c7bc59df-pf8vp" podUID="38868625-0d0e-404e-a465-fd22899c5b49" containerName="maas-api" containerID="cri-o://9bc31ddf13110858f38c7f89663687bf3c39389c7011b4a9962757a3adad07b2" gracePeriod=30
Jul 13 16:00:55.034076 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:00:55.034045    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:00:55.256251 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:00:55.256193    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-47280f-8c7bc59df-pf8vp"
Jul 13 16:00:55.353321 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:00:55.353293    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38868625-0d0e-404e-a465-fd22899c5b49-maas-api-tls\") pod \"38868625-0d0e-404e-a465-fd22899c5b49\" (UID: \"38868625-0d0e-404e-a465-fd22899c5b49\") "
Jul 13 16:00:55.353454 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:00:55.353360    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38868625-0d0e-404e-a465-fd22899c5b49-openshift-service-ca\") pod \"38868625-0d0e-404e-a465-fd22899c5b49\" (UID: \"38868625-0d0e-404e-a465-fd22899c5b49\") "
Jul 13 16:00:55.353454 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:00:55.353423    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmlf9\" (UniqueName: \"kubernetes.io/projected/38868625-0d0e-404e-a465-fd22899c5b49-kube-api-access-pmlf9\") pod \"38868625-0d0e-404e-a465-fd22899c5b49\" (UID: \"38868625-0d0e-404e-a465-fd22899c5b49\") "
Jul 13 16:00:55.353742 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:00:55.353719    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38868625-0d0e-404e-a465-fd22899c5b49-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "38868625-0d0e-404e-a465-fd22899c5b49" (UID: "38868625-0d0e-404e-a465-fd22899c5b49"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 16:00:55.353836 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:00:55.353819    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38868625-0d0e-404e-a465-fd22899c5b49-openshift-service-ca\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:00:55.355455 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:00:55.355431    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38868625-0d0e-404e-a465-fd22899c5b49-kube-api-access-pmlf9" (OuterVolumeSpecName: "kube-api-access-pmlf9") pod "38868625-0d0e-404e-a465-fd22899c5b49" (UID: "38868625-0d0e-404e-a465-fd22899c5b49"). InnerVolumeSpecName "kube-api-access-pmlf9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:00:55.355609 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:00:55.355578    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38868625-0d0e-404e-a465-fd22899c5b49-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "38868625-0d0e-404e-a465-fd22899c5b49" (UID: "38868625-0d0e-404e-a465-fd22899c5b49"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 16:00:55.454231 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:00:55.454195    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38868625-0d0e-404e-a465-fd22899c5b49-maas-api-tls\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:00:55.454231 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:00:55.454225    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmlf9\" (UniqueName: \"kubernetes.io/projected/38868625-0d0e-404e-a465-fd22899c5b49-kube-api-access-pmlf9\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:00:56.059006 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:00:56.058967    2555 generic.go:356] "Generic (PLEG): container finished" podID="38868625-0d0e-404e-a465-fd22899c5b49" containerID="9bc31ddf13110858f38c7f89663687bf3c39389c7011b4a9962757a3adad07b2" exitCode=0
Jul 13 16:00:56.059478 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:00:56.059014    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-47280f-8c7bc59df-pf8vp" event={"ID":"38868625-0d0e-404e-a465-fd22899c5b49","Type":"ContainerDied","Data":"9bc31ddf13110858f38c7f89663687bf3c39389c7011b4a9962757a3adad07b2"}
Jul 13 16:00:56.059478 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:00:56.059020    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-47280f-8c7bc59df-pf8vp"
Jul 13 16:00:56.059478 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:00:56.059099    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-47280f-8c7bc59df-pf8vp" event={"ID":"38868625-0d0e-404e-a465-fd22899c5b49","Type":"ContainerDied","Data":"88d350f20e70dbef988c7e87d17be4251a12d467c927d64aadaef2739a497a21"}
Jul 13 16:00:56.059478 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:00:56.059132    2555 scope.go:117] "RemoveContainer" containerID="9bc31ddf13110858f38c7f89663687bf3c39389c7011b4a9962757a3adad07b2"
Jul 13 16:00:56.068287 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:00:56.068272    2555 scope.go:117] "RemoveContainer" containerID="9bc31ddf13110858f38c7f89663687bf3c39389c7011b4a9962757a3adad07b2"
Jul 13 16:00:56.068526 ip-10-0-137-93 kubenswrapper[2555]: E0713 16:00:56.068510    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bc31ddf13110858f38c7f89663687bf3c39389c7011b4a9962757a3adad07b2\": container with ID starting with 9bc31ddf13110858f38c7f89663687bf3c39389c7011b4a9962757a3adad07b2 not found: ID does not exist" containerID="9bc31ddf13110858f38c7f89663687bf3c39389c7011b4a9962757a3adad07b2"
Jul 13 16:00:56.068578 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:00:56.068533    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bc31ddf13110858f38c7f89663687bf3c39389c7011b4a9962757a3adad07b2"} err="failed to get container status \"9bc31ddf13110858f38c7f89663687bf3c39389c7011b4a9962757a3adad07b2\": rpc error: code = NotFound desc = could not find container \"9bc31ddf13110858f38c7f89663687bf3c39389c7011b4a9962757a3adad07b2\": container with ID starting with 9bc31ddf13110858f38c7f89663687bf3c39389c7011b4a9962757a3adad07b2 not found: ID does not exist"
Jul 13 16:00:56.083254 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:00:56.083233    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-47280f-8c7bc59df-pf8vp"]
Jul 13 16:00:56.087349 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:00:56.087326    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-47280f-8c7bc59df-pf8vp"]
Jul 13 16:00:56.202391 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:00:56.202366    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38868625-0d0e-404e-a465-fd22899c5b49" path="/var/lib/kubelet/pods/38868625-0d0e-404e-a465-fd22899c5b49/volumes"
Jul 13 16:00:59.577246 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:00:59.577207    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:01:03.468821 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:03.468786    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:01:06.358134 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:06.358085    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:01:06.412309 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:06.412263    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:01:10.257628 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:10.257580    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth"]
Jul 13 16:01:10.258114 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:10.257847    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth" podUID="def17a6e-068f-42de-af14-079d2c07ae48" containerName="istio-proxy" containerID="cri-o://4326607080a86809a6ef93c7c48a12eddd45610df86b3352c621ed3efad1457f" gracePeriod=30
Jul 13 16:01:10.300841 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:10.300805    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:01:10.506317 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:10.506279    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:01:11.388687 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:11.388648    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:01:11.489077 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:11.489049    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:01:14.362294 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:14.362256    2555 patch_prober.go:28] interesting pod/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 13 16:01:14.362709 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:14.362333    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth" podUID="def17a6e-068f-42de-af14-079d2c07ae48" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 16:01:15.508828 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:15.508802    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth"
Jul 13 16:01:15.521547 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:15.521477    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/def17a6e-068f-42de-af14-079d2c07ae48-istio-token\") pod \"def17a6e-068f-42de-af14-079d2c07ae48\" (UID: \"def17a6e-068f-42de-af14-079d2c07ae48\") "
Jul 13 16:01:15.521547 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:15.521528    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/def17a6e-068f-42de-af14-079d2c07ae48-istio-data\") pod \"def17a6e-068f-42de-af14-079d2c07ae48\" (UID: \"def17a6e-068f-42de-af14-079d2c07ae48\") "
Jul 13 16:01:15.521547 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:15.521545    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/def17a6e-068f-42de-af14-079d2c07ae48-workload-certs\") pod \"def17a6e-068f-42de-af14-079d2c07ae48\" (UID: \"def17a6e-068f-42de-af14-079d2c07ae48\") "
Jul 13 16:01:15.521791 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:15.521572    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/def17a6e-068f-42de-af14-079d2c07ae48-workload-socket\") pod \"def17a6e-068f-42de-af14-079d2c07ae48\" (UID: \"def17a6e-068f-42de-af14-079d2c07ae48\") "
Jul 13 16:01:15.521791 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:15.521613    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/def17a6e-068f-42de-af14-079d2c07ae48-istiod-ca-cert\") pod \"def17a6e-068f-42de-af14-079d2c07ae48\" (UID: \"def17a6e-068f-42de-af14-079d2c07ae48\") "
Jul 13 16:01:15.521791 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:15.521644    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/def17a6e-068f-42de-af14-079d2c07ae48-credential-socket\") pod \"def17a6e-068f-42de-af14-079d2c07ae48\" (UID: \"def17a6e-068f-42de-af14-079d2c07ae48\") "
Jul 13 16:01:15.521791 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:15.521670    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/def17a6e-068f-42de-af14-079d2c07ae48-istio-envoy\") pod \"def17a6e-068f-42de-af14-079d2c07ae48\" (UID: \"def17a6e-068f-42de-af14-079d2c07ae48\") "
Jul 13 16:01:15.521791 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:15.521692    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/def17a6e-068f-42de-af14-079d2c07ae48-istio-podinfo\") pod \"def17a6e-068f-42de-af14-079d2c07ae48\" (UID: \"def17a6e-068f-42de-af14-079d2c07ae48\") "
Jul 13 16:01:15.521791 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:15.521716    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ljxnc\" (UniqueName: \"kubernetes.io/projected/def17a6e-068f-42de-af14-079d2c07ae48-kube-api-access-ljxnc\") pod \"def17a6e-068f-42de-af14-079d2c07ae48\" (UID: \"def17a6e-068f-42de-af14-079d2c07ae48\") "
Jul 13 16:01:15.522087 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:15.521868    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/def17a6e-068f-42de-af14-079d2c07ae48-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "def17a6e-068f-42de-af14-079d2c07ae48" (UID: "def17a6e-068f-42de-af14-079d2c07ae48"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:01:15.522087 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:15.521941    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/def17a6e-068f-42de-af14-079d2c07ae48-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "def17a6e-068f-42de-af14-079d2c07ae48" (UID: "def17a6e-068f-42de-af14-079d2c07ae48"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:01:15.522087 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:15.522024    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/def17a6e-068f-42de-af14-079d2c07ae48-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "def17a6e-068f-42de-af14-079d2c07ae48" (UID: "def17a6e-068f-42de-af14-079d2c07ae48"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 16:01:15.522222 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:15.522166    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/def17a6e-068f-42de-af14-079d2c07ae48-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "def17a6e-068f-42de-af14-079d2c07ae48" (UID: "def17a6e-068f-42de-af14-079d2c07ae48"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:01:15.522222 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:15.522068    2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/def17a6e-068f-42de-af14-079d2c07ae48-workload-certs\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:01:15.522222 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:15.522203    2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/def17a6e-068f-42de-af14-079d2c07ae48-workload-socket\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:01:15.522645 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:15.522619    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/def17a6e-068f-42de-af14-079d2c07ae48-istio-data" (OuterVolumeSpecName: "istio-data") pod "def17a6e-068f-42de-af14-079d2c07ae48" (UID: "def17a6e-068f-42de-af14-079d2c07ae48"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:01:15.523820 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:15.523794    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/def17a6e-068f-42de-af14-079d2c07ae48-istio-token" (OuterVolumeSpecName: "istio-token") pod "def17a6e-068f-42de-af14-079d2c07ae48" (UID: "def17a6e-068f-42de-af14-079d2c07ae48"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:01:15.523914 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:15.523862    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/def17a6e-068f-42de-af14-079d2c07ae48-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "def17a6e-068f-42de-af14-079d2c07ae48" (UID: "def17a6e-068f-42de-af14-079d2c07ae48"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 16:01:15.524286 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:15.524270    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/def17a6e-068f-42de-af14-079d2c07ae48-kube-api-access-ljxnc" (OuterVolumeSpecName: "kube-api-access-ljxnc") pod "def17a6e-068f-42de-af14-079d2c07ae48" (UID: "def17a6e-068f-42de-af14-079d2c07ae48"). InnerVolumeSpecName "kube-api-access-ljxnc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:01:15.524345 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:15.524279    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/def17a6e-068f-42de-af14-079d2c07ae48-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "def17a6e-068f-42de-af14-079d2c07ae48" (UID: "def17a6e-068f-42de-af14-079d2c07ae48"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:01:15.623136 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:15.623105    2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/def17a6e-068f-42de-af14-079d2c07ae48-istio-data\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:01:15.623136 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:15.623131    2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/def17a6e-068f-42de-af14-079d2c07ae48-istiod-ca-cert\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:01:15.623136 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:15.623140    2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/def17a6e-068f-42de-af14-079d2c07ae48-credential-socket\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:01:15.623358 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:15.623148    2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/def17a6e-068f-42de-af14-079d2c07ae48-istio-envoy\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:01:15.623358 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:15.623156    2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/def17a6e-068f-42de-af14-079d2c07ae48-istio-podinfo\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:01:15.623358 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:15.623164    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljxnc\" (UniqueName: \"kubernetes.io/projected/def17a6e-068f-42de-af14-079d2c07ae48-kube-api-access-ljxnc\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:01:15.623358 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:15.623171    2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/def17a6e-068f-42de-af14-079d2c07ae48-istio-token\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:01:16.164079 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:16.164040    2555 generic.go:356] "Generic (PLEG): container finished" podID="def17a6e-068f-42de-af14-079d2c07ae48" containerID="4326607080a86809a6ef93c7c48a12eddd45610df86b3352c621ed3efad1457f" exitCode=0
Jul 13 16:01:16.164249 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:16.164088    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth"
Jul 13 16:01:16.164249 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:16.164120    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth" event={"ID":"def17a6e-068f-42de-af14-079d2c07ae48","Type":"ContainerDied","Data":"4326607080a86809a6ef93c7c48a12eddd45610df86b3352c621ed3efad1457f"}
Jul 13 16:01:16.164249 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:16.164173    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth" event={"ID":"def17a6e-068f-42de-af14-079d2c07ae48","Type":"ContainerDied","Data":"94860141786d28be27c4d24b0a1f8a9ba137343678a3ffeeb693f919a677a4a1"}
Jul 13 16:01:16.164249 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:16.164196    2555 scope.go:117] "RemoveContainer" containerID="4326607080a86809a6ef93c7c48a12eddd45610df86b3352c621ed3efad1457f"
Jul 13 16:01:16.173828 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:16.173813    2555 scope.go:117] "RemoveContainer" containerID="2d8cdaba79dccaf6b03823cfe607b823a1cb39a7e1bf025fe1eb7edab95ff35b"
Jul 13 16:01:16.182153 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:16.182135    2555 scope.go:117] "RemoveContainer" containerID="4326607080a86809a6ef93c7c48a12eddd45610df86b3352c621ed3efad1457f"
Jul 13 16:01:16.182378 ip-10-0-137-93 kubenswrapper[2555]: E0713 16:01:16.182360    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4326607080a86809a6ef93c7c48a12eddd45610df86b3352c621ed3efad1457f\": container with ID starting with 4326607080a86809a6ef93c7c48a12eddd45610df86b3352c621ed3efad1457f not found: ID does not exist" containerID="4326607080a86809a6ef93c7c48a12eddd45610df86b3352c621ed3efad1457f"
Jul 13 16:01:16.182448 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:16.182391    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4326607080a86809a6ef93c7c48a12eddd45610df86b3352c621ed3efad1457f"} err="failed to get container status \"4326607080a86809a6ef93c7c48a12eddd45610df86b3352c621ed3efad1457f\": rpc error: code = NotFound desc = could not find container \"4326607080a86809a6ef93c7c48a12eddd45610df86b3352c621ed3efad1457f\": container with ID starting with 4326607080a86809a6ef93c7c48a12eddd45610df86b3352c621ed3efad1457f not found: ID does not exist"
Jul 13 16:01:16.182448 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:16.182414    2555 scope.go:117] "RemoveContainer" containerID="2d8cdaba79dccaf6b03823cfe607b823a1cb39a7e1bf025fe1eb7edab95ff35b"
Jul 13 16:01:16.182652 ip-10-0-137-93 kubenswrapper[2555]: E0713 16:01:16.182635    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d8cdaba79dccaf6b03823cfe607b823a1cb39a7e1bf025fe1eb7edab95ff35b\": container with ID starting with 2d8cdaba79dccaf6b03823cfe607b823a1cb39a7e1bf025fe1eb7edab95ff35b not found: ID does not exist" containerID="2d8cdaba79dccaf6b03823cfe607b823a1cb39a7e1bf025fe1eb7edab95ff35b"
Jul 13 16:01:16.182704 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:16.182659    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d8cdaba79dccaf6b03823cfe607b823a1cb39a7e1bf025fe1eb7edab95ff35b"} err="failed to get container status \"2d8cdaba79dccaf6b03823cfe607b823a1cb39a7e1bf025fe1eb7edab95ff35b\": rpc error: code = NotFound desc = could not find container \"2d8cdaba79dccaf6b03823cfe607b823a1cb39a7e1bf025fe1eb7edab95ff35b\": container with ID starting with 2d8cdaba79dccaf6b03823cfe607b823a1cb39a7e1bf025fe1eb7edab95ff35b not found: ID does not exist"
Jul 13 16:01:16.189197 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:16.189178    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth"]
Jul 13 16:01:16.194547 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:16.194528    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-47280f-openshift-default-64bb5f6c6c-5hfth"]
Jul 13 16:01:16.203664 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:16.203643    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="def17a6e-068f-42de-af14-079d2c07ae48" path="/var/lib/kubelet/pods/def17a6e-068f-42de-af14-079d2c07ae48/volumes"
Jul 13 16:01:20.280782 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:20.280750    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:01:21.310878 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:21.310842    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ef5b3f-cd95b7df8-mmzjh"]
Jul 13 16:01:21.311322 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:21.311062    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ef5b3f-cd95b7df8-mmzjh" podUID="73b816be-710b-4781-96a7-e6f326c53249" containerName="maas-api" containerID="cri-o://abfc575dba29ed3b8bed237b79758e941b479a1bd4f5ed73e352ed6a78b23af5" gracePeriod=30
Jul 13 16:01:21.343564 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:21.343532    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:01:21.561304 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:21.561237    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ef5b3f-cd95b7df8-mmzjh"
Jul 13 16:01:21.675846 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:21.675807    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmmdf\" (UniqueName: \"kubernetes.io/projected/73b816be-710b-4781-96a7-e6f326c53249-kube-api-access-wmmdf\") pod \"73b816be-710b-4781-96a7-e6f326c53249\" (UID: \"73b816be-710b-4781-96a7-e6f326c53249\") "
Jul 13 16:01:21.676022 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:21.675910    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73b816be-710b-4781-96a7-e6f326c53249-maas-api-tls\") pod \"73b816be-710b-4781-96a7-e6f326c53249\" (UID: \"73b816be-710b-4781-96a7-e6f326c53249\") "
Jul 13 16:01:21.676022 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:21.675934    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/73b816be-710b-4781-96a7-e6f326c53249-openshift-service-ca\") pod \"73b816be-710b-4781-96a7-e6f326c53249\" (UID: \"73b816be-710b-4781-96a7-e6f326c53249\") "
Jul 13 16:01:21.676343 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:21.676321    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73b816be-710b-4781-96a7-e6f326c53249-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "73b816be-710b-4781-96a7-e6f326c53249" (UID: "73b816be-710b-4781-96a7-e6f326c53249"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 16:01:21.678002 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:21.677979    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73b816be-710b-4781-96a7-e6f326c53249-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "73b816be-710b-4781-96a7-e6f326c53249" (UID: "73b816be-710b-4781-96a7-e6f326c53249"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 16:01:21.678081 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:21.678061    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73b816be-710b-4781-96a7-e6f326c53249-kube-api-access-wmmdf" (OuterVolumeSpecName: "kube-api-access-wmmdf") pod "73b816be-710b-4781-96a7-e6f326c53249" (UID: "73b816be-710b-4781-96a7-e6f326c53249"). InnerVolumeSpecName "kube-api-access-wmmdf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:01:21.776484 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:21.776449    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73b816be-710b-4781-96a7-e6f326c53249-maas-api-tls\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:01:21.776484 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:21.776478    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/73b816be-710b-4781-96a7-e6f326c53249-openshift-service-ca\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:01:21.776721 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:21.776511    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmmdf\" (UniqueName: \"kubernetes.io/projected/73b816be-710b-4781-96a7-e6f326c53249-kube-api-access-wmmdf\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:01:22.197349 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:22.197314    2555 generic.go:356] "Generic (PLEG): container finished" podID="73b816be-710b-4781-96a7-e6f326c53249" containerID="abfc575dba29ed3b8bed237b79758e941b479a1bd4f5ed73e352ed6a78b23af5" exitCode=0
Jul 13 16:01:22.197520 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:22.197430    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ef5b3f-cd95b7df8-mmzjh"
Jul 13 16:01:22.202956 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:22.202923    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ef5b3f-cd95b7df8-mmzjh" event={"ID":"73b816be-710b-4781-96a7-e6f326c53249","Type":"ContainerDied","Data":"abfc575dba29ed3b8bed237b79758e941b479a1bd4f5ed73e352ed6a78b23af5"}
Jul 13 16:01:22.202956 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:22.202970    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ef5b3f-cd95b7df8-mmzjh" event={"ID":"73b816be-710b-4781-96a7-e6f326c53249","Type":"ContainerDied","Data":"474d50c8ce39d22a7bff8ee1f4b1486ea5300ecc6fa06133ec18baed280cd54e"}
Jul 13 16:01:22.203203 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:22.202994    2555 scope.go:117] "RemoveContainer" containerID="abfc575dba29ed3b8bed237b79758e941b479a1bd4f5ed73e352ed6a78b23af5"
Jul 13 16:01:22.212966 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:22.212947    2555 scope.go:117] "RemoveContainer" containerID="abfc575dba29ed3b8bed237b79758e941b479a1bd4f5ed73e352ed6a78b23af5"
Jul 13 16:01:22.213211 ip-10-0-137-93 kubenswrapper[2555]: E0713 16:01:22.213192    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abfc575dba29ed3b8bed237b79758e941b479a1bd4f5ed73e352ed6a78b23af5\": container with ID starting with abfc575dba29ed3b8bed237b79758e941b479a1bd4f5ed73e352ed6a78b23af5 not found: ID does not exist" containerID="abfc575dba29ed3b8bed237b79758e941b479a1bd4f5ed73e352ed6a78b23af5"
Jul 13 16:01:22.213264 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:22.213220    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abfc575dba29ed3b8bed237b79758e941b479a1bd4f5ed73e352ed6a78b23af5"} err="failed to get container status \"abfc575dba29ed3b8bed237b79758e941b479a1bd4f5ed73e352ed6a78b23af5\": rpc error: code = NotFound desc = could not find container \"abfc575dba29ed3b8bed237b79758e941b479a1bd4f5ed73e352ed6a78b23af5\": container with ID starting with abfc575dba29ed3b8bed237b79758e941b479a1bd4f5ed73e352ed6a78b23af5 not found: ID does not exist"
Jul 13 16:01:22.227888 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:22.227865    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ef5b3f-cd95b7df8-mmzjh"]
Jul 13 16:01:22.234909 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:22.234887    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ef5b3f-cd95b7df8-mmzjh"]
Jul 13 16:01:24.203563 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:24.203527    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73b816be-710b-4781-96a7-e6f326c53249" path="/var/lib/kubelet/pods/73b816be-710b-4781-96a7-e6f326c53249/volumes"
Jul 13 16:01:25.731674 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:25.731639    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:01:32.065217 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:32.065181    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:01:32.162937 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:32.162888    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:01:36.469416 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:36.469380    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:01:36.685493 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:36.685458    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:01:37.039155 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.039126    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:01:37.337820 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.337737    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s"]
Jul 13 16:01:37.344177 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.344132    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="def17a6e-068f-42de-af14-079d2c07ae48" containerName="istio-proxy"
Jul 13 16:01:37.344177 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.344176    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="def17a6e-068f-42de-af14-079d2c07ae48" containerName="istio-proxy"
Jul 13 16:01:37.344411 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.344209    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73b816be-710b-4781-96a7-e6f326c53249" containerName="maas-api"
Jul 13 16:01:37.344411 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.344218    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="73b816be-710b-4781-96a7-e6f326c53249" containerName="maas-api"
Jul 13 16:01:37.344411 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.344240    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="def17a6e-068f-42de-af14-079d2c07ae48" containerName="istio-proxy"
Jul 13 16:01:37.344411 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.344249    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="def17a6e-068f-42de-af14-079d2c07ae48" containerName="istio-proxy"
Jul 13 16:01:37.344411 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.344266    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38868625-0d0e-404e-a465-fd22899c5b49" containerName="maas-api"
Jul 13 16:01:37.344411 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.344274    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="38868625-0d0e-404e-a465-fd22899c5b49" containerName="maas-api"
Jul 13 16:01:37.344709 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.344470    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="73b816be-710b-4781-96a7-e6f326c53249" containerName="maas-api"
Jul 13 16:01:37.344709 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.344485    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="def17a6e-068f-42de-af14-079d2c07ae48" containerName="istio-proxy"
Jul 13 16:01:37.344709 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.344501    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="def17a6e-068f-42de-af14-079d2c07ae48" containerName="istio-proxy"
Jul 13 16:01:37.344709 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.344520    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="38868625-0d0e-404e-a465-fd22899c5b49" containerName="maas-api"
Jul 13 16:01:37.349705 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.349683    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s"
Jul 13 16:01:37.352459 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.352434    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-714794-openshift-default-dockercfg-5fqrg\""
Jul 13 16:01:37.355653 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.355628    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s"]
Jul 13 16:01:37.357770 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.357721    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:01:37.425271 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.425219    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0bd73ad-736e-464e-b367-c790e79233e1-workload-socket\") pod \"e2e-api-a-714794-openshift-default-5c66995599-9m75s\" (UID: \"c0bd73ad-736e-464e-b367-c790e79233e1\") " pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s"
Jul 13 16:01:37.425271 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.425266    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0bd73ad-736e-464e-b367-c790e79233e1-credential-socket\") pod \"e2e-api-a-714794-openshift-default-5c66995599-9m75s\" (UID: \"c0bd73ad-736e-464e-b367-c790e79233e1\") " pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s"
Jul 13 16:01:37.425504 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.425327    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0bd73ad-736e-464e-b367-c790e79233e1-istio-envoy\") pod \"e2e-api-a-714794-openshift-default-5c66995599-9m75s\" (UID: \"c0bd73ad-736e-464e-b367-c790e79233e1\") " pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s"
Jul 13 16:01:37.425504 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.425414    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nb7r\" (UniqueName: \"kubernetes.io/projected/c0bd73ad-736e-464e-b367-c790e79233e1-kube-api-access-4nb7r\") pod \"e2e-api-a-714794-openshift-default-5c66995599-9m75s\" (UID: \"c0bd73ad-736e-464e-b367-c790e79233e1\") " pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s"
Jul 13 16:01:37.425504 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.425436    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0bd73ad-736e-464e-b367-c790e79233e1-workload-certs\") pod \"e2e-api-a-714794-openshift-default-5c66995599-9m75s\" (UID: \"c0bd73ad-736e-464e-b367-c790e79233e1\") " pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s"
Jul 13 16:01:37.425504 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.425478    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0bd73ad-736e-464e-b367-c790e79233e1-istio-token\") pod \"e2e-api-a-714794-openshift-default-5c66995599-9m75s\" (UID: \"c0bd73ad-736e-464e-b367-c790e79233e1\") " pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s"
Jul 13 16:01:37.425767 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.425523    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0bd73ad-736e-464e-b367-c790e79233e1-istio-data\") pod \"e2e-api-a-714794-openshift-default-5c66995599-9m75s\" (UID: \"c0bd73ad-736e-464e-b367-c790e79233e1\") " pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s"
Jul 13 16:01:37.425767 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.425544    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0bd73ad-736e-464e-b367-c790e79233e1-istio-podinfo\") pod \"e2e-api-a-714794-openshift-default-5c66995599-9m75s\" (UID: \"c0bd73ad-736e-464e-b367-c790e79233e1\") " pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s"
Jul 13 16:01:37.425767 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.425600    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0bd73ad-736e-464e-b367-c790e79233e1-istiod-ca-cert\") pod \"e2e-api-a-714794-openshift-default-5c66995599-9m75s\" (UID: \"c0bd73ad-736e-464e-b367-c790e79233e1\") " pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s"
Jul 13 16:01:37.526642 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.526602    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nb7r\" (UniqueName: \"kubernetes.io/projected/c0bd73ad-736e-464e-b367-c790e79233e1-kube-api-access-4nb7r\") pod \"e2e-api-a-714794-openshift-default-5c66995599-9m75s\" (UID: \"c0bd73ad-736e-464e-b367-c790e79233e1\") " pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s"
Jul 13 16:01:37.527090 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.526652    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0bd73ad-736e-464e-b367-c790e79233e1-workload-certs\") pod \"e2e-api-a-714794-openshift-default-5c66995599-9m75s\" (UID: \"c0bd73ad-736e-464e-b367-c790e79233e1\") " pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s"
Jul 13 16:01:37.527090 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.526682    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0bd73ad-736e-464e-b367-c790e79233e1-istio-token\") pod \"e2e-api-a-714794-openshift-default-5c66995599-9m75s\" (UID: \"c0bd73ad-736e-464e-b367-c790e79233e1\") " pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s"
Jul 13 16:01:37.527090 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.526724    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0bd73ad-736e-464e-b367-c790e79233e1-istio-data\") pod \"e2e-api-a-714794-openshift-default-5c66995599-9m75s\" (UID: \"c0bd73ad-736e-464e-b367-c790e79233e1\") " pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s"
Jul 13 16:01:37.527090 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.526854    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0bd73ad-736e-464e-b367-c790e79233e1-istio-podinfo\") pod \"e2e-api-a-714794-openshift-default-5c66995599-9m75s\" (UID: \"c0bd73ad-736e-464e-b367-c790e79233e1\") " pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s"
Jul 13 16:01:37.527090 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.526957    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0bd73ad-736e-464e-b367-c790e79233e1-istiod-ca-cert\") pod \"e2e-api-a-714794-openshift-default-5c66995599-9m75s\" (UID: \"c0bd73ad-736e-464e-b367-c790e79233e1\") " pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s"
Jul 13 16:01:37.527090 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.527030    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0bd73ad-736e-464e-b367-c790e79233e1-workload-socket\") pod \"e2e-api-a-714794-openshift-default-5c66995599-9m75s\" (UID: \"c0bd73ad-736e-464e-b367-c790e79233e1\") " pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s"
Jul 13 16:01:37.527090 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.527059    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0bd73ad-736e-464e-b367-c790e79233e1-credential-socket\") pod \"e2e-api-a-714794-openshift-default-5c66995599-9m75s\" (UID: \"c0bd73ad-736e-464e-b367-c790e79233e1\") " pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s"
Jul 13 16:01:37.527090 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.527069    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0bd73ad-736e-464e-b367-c790e79233e1-workload-certs\") pod \"e2e-api-a-714794-openshift-default-5c66995599-9m75s\" (UID: \"c0bd73ad-736e-464e-b367-c790e79233e1\") " pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s"
Jul 13 16:01:37.527542 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.527098    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0bd73ad-736e-464e-b367-c790e79233e1-istio-envoy\") pod \"e2e-api-a-714794-openshift-default-5c66995599-9m75s\" (UID: \"c0bd73ad-736e-464e-b367-c790e79233e1\") " pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s"
Jul 13 16:01:37.527542 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.527111    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0bd73ad-736e-464e-b367-c790e79233e1-istio-data\") pod \"e2e-api-a-714794-openshift-default-5c66995599-9m75s\" (UID: \"c0bd73ad-736e-464e-b367-c790e79233e1\") " pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s"
Jul 13 16:01:37.527542 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.527337    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0bd73ad-736e-464e-b367-c790e79233e1-workload-socket\") pod \"e2e-api-a-714794-openshift-default-5c66995599-9m75s\" (UID: \"c0bd73ad-736e-464e-b367-c790e79233e1\") " pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s"
Jul 13 16:01:37.527542 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.527365    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0bd73ad-736e-464e-b367-c790e79233e1-credential-socket\") pod \"e2e-api-a-714794-openshift-default-5c66995599-9m75s\" (UID: \"c0bd73ad-736e-464e-b367-c790e79233e1\") " pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s"
Jul 13 16:01:37.527733 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.527661    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0bd73ad-736e-464e-b367-c790e79233e1-istiod-ca-cert\") pod \"e2e-api-a-714794-openshift-default-5c66995599-9m75s\" (UID: \"c0bd73ad-736e-464e-b367-c790e79233e1\") " pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s"
Jul 13 16:01:37.529283 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.529255    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0bd73ad-736e-464e-b367-c790e79233e1-istio-envoy\") pod \"e2e-api-a-714794-openshift-default-5c66995599-9m75s\" (UID: \"c0bd73ad-736e-464e-b367-c790e79233e1\") " pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s"
Jul 13 16:01:37.529706 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.529686    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0bd73ad-736e-464e-b367-c790e79233e1-istio-podinfo\") pod \"e2e-api-a-714794-openshift-default-5c66995599-9m75s\" (UID: \"c0bd73ad-736e-464e-b367-c790e79233e1\") " pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s"
Jul 13 16:01:37.537868 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.537839    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0bd73ad-736e-464e-b367-c790e79233e1-istio-token\") pod \"e2e-api-a-714794-openshift-default-5c66995599-9m75s\" (UID: \"c0bd73ad-736e-464e-b367-c790e79233e1\") " pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s"
Jul 13 16:01:37.538131 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.538109    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nb7r\" (UniqueName: \"kubernetes.io/projected/c0bd73ad-736e-464e-b367-c790e79233e1-kube-api-access-4nb7r\") pod \"e2e-api-a-714794-openshift-default-5c66995599-9m75s\" (UID: \"c0bd73ad-736e-464e-b367-c790e79233e1\") " pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s"
Jul 13 16:01:37.662852 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.662761    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s"
Jul 13 16:01:37.819788 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.819761    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s"]
Jul 13 16:01:37.821456 ip-10-0-137-93 kubenswrapper[2555]: W0713 16:01:37.821427    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0bd73ad_736e_464e_b367_c790e79233e1.slice/crio-829bc0ddacd5061632dabac0f793ce81eb646018232fdffb1d3d4f613756c698 WatchSource:0}: Error finding container 829bc0ddacd5061632dabac0f793ce81eb646018232fdffb1d3d4f613756c698: Status 404 returned error can't find the container with id 829bc0ddacd5061632dabac0f793ce81eb646018232fdffb1d3d4f613756c698
Jul 13 16:01:37.823658 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.823627    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 16:01:37.823721 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.823697    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 16:01:37.823758 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.823729    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 16:01:37.930465 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:37.930365    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:01:38.275321 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:38.275283    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s" event={"ID":"c0bd73ad-736e-464e-b367-c790e79233e1","Type":"ContainerStarted","Data":"d0564659199c1923b1224fcf6da89c8ca8230049b2f5b5b0d40952fca25530e4"}
Jul 13 16:01:38.275544 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:38.275341    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s" event={"ID":"c0bd73ad-736e-464e-b367-c790e79233e1","Type":"ContainerStarted","Data":"829bc0ddacd5061632dabac0f793ce81eb646018232fdffb1d3d4f613756c698"}
Jul 13 16:01:38.297132 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:38.297070    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s" podStartSLOduration=1.297048556 podStartE2EDuration="1.297048556s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:01:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:01:38.294899854 +0000 UTC m=+2284.619621787" watchObservedRunningTime="2026-07-13 16:01:38.297048556 +0000 UTC m=+2284.621770456"
Jul 13 16:01:38.663715 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:38.663611    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s"
Jul 13 16:01:38.668394 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:38.668366    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s"
Jul 13 16:01:39.280725 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:39.280695    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s"
Jul 13 16:01:39.281706 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:39.281685    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s"
Jul 13 16:01:40.212870 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:40.212835    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:01:40.356359 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:40.356327    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:01:40.433890 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:40.433861    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-714794-85c9cc569c-tl2gm"]
Jul 13 16:01:40.437410 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:40.437388    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-714794-85c9cc569c-tl2gm"
Jul 13 16:01:40.439795 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:40.439770    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-714794-serving-cert\""
Jul 13 16:01:40.439907 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:40.439860    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kjwpb\""
Jul 13 16:01:40.448465 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:40.448440    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-714794-85c9cc569c-tl2gm"]
Jul 13 16:01:40.465182 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:40.465108    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:01:40.557961 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:40.557929    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2f165eaf-af96-4d29-8177-dfb1be534aa8-maas-api-tls\") pod \"maas-api-e2e-api-a-714794-85c9cc569c-tl2gm\" (UID: \"2f165eaf-af96-4d29-8177-dfb1be534aa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-714794-85c9cc569c-tl2gm"
Jul 13 16:01:40.558141 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:40.557994    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5t69\" (UniqueName: \"kubernetes.io/projected/2f165eaf-af96-4d29-8177-dfb1be534aa8-kube-api-access-v5t69\") pod \"maas-api-e2e-api-a-714794-85c9cc569c-tl2gm\" (UID: \"2f165eaf-af96-4d29-8177-dfb1be534aa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-714794-85c9cc569c-tl2gm"
Jul 13 16:01:40.558141 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:40.558116    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f165eaf-af96-4d29-8177-dfb1be534aa8-openshift-service-ca\") pod \"maas-api-e2e-api-a-714794-85c9cc569c-tl2gm\" (UID: \"2f165eaf-af96-4d29-8177-dfb1be534aa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-714794-85c9cc569c-tl2gm"
Jul 13 16:01:40.659107 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:40.659076    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5t69\" (UniqueName: \"kubernetes.io/projected/2f165eaf-af96-4d29-8177-dfb1be534aa8-kube-api-access-v5t69\") pod \"maas-api-e2e-api-a-714794-85c9cc569c-tl2gm\" (UID: \"2f165eaf-af96-4d29-8177-dfb1be534aa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-714794-85c9cc569c-tl2gm"
Jul 13 16:01:40.659287 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:40.659145    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f165eaf-af96-4d29-8177-dfb1be534aa8-openshift-service-ca\") pod \"maas-api-e2e-api-a-714794-85c9cc569c-tl2gm\" (UID: \"2f165eaf-af96-4d29-8177-dfb1be534aa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-714794-85c9cc569c-tl2gm"
Jul 13 16:01:40.659287 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:40.659211    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2f165eaf-af96-4d29-8177-dfb1be534aa8-maas-api-tls\") pod \"maas-api-e2e-api-a-714794-85c9cc569c-tl2gm\" (UID: \"2f165eaf-af96-4d29-8177-dfb1be534aa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-714794-85c9cc569c-tl2gm"
Jul 13 16:01:40.659404 ip-10-0-137-93 kubenswrapper[2555]: E0713 16:01:40.659349    2555 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-714794-serving-cert: secret "maas-api-e2e-api-a-714794-serving-cert" not found
Jul 13 16:01:40.659459 ip-10-0-137-93 kubenswrapper[2555]: E0713 16:01:40.659426    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f165eaf-af96-4d29-8177-dfb1be534aa8-maas-api-tls podName:2f165eaf-af96-4d29-8177-dfb1be534aa8 nodeName:}" failed. No retries permitted until 2026-07-13 16:01:41.159403616 +0000 UTC m=+2287.484125505 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2f165eaf-af96-4d29-8177-dfb1be534aa8-maas-api-tls") pod "maas-api-e2e-api-a-714794-85c9cc569c-tl2gm" (UID: "2f165eaf-af96-4d29-8177-dfb1be534aa8") : secret "maas-api-e2e-api-a-714794-serving-cert" not found
Jul 13 16:01:40.659974 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:40.659953    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f165eaf-af96-4d29-8177-dfb1be534aa8-openshift-service-ca\") pod \"maas-api-e2e-api-a-714794-85c9cc569c-tl2gm\" (UID: \"2f165eaf-af96-4d29-8177-dfb1be534aa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-714794-85c9cc569c-tl2gm"
Jul 13 16:01:40.668049 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:40.668016    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5t69\" (UniqueName: \"kubernetes.io/projected/2f165eaf-af96-4d29-8177-dfb1be534aa8-kube-api-access-v5t69\") pod \"maas-api-e2e-api-a-714794-85c9cc569c-tl2gm\" (UID: \"2f165eaf-af96-4d29-8177-dfb1be534aa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-714794-85c9cc569c-tl2gm"
Jul 13 16:01:40.728007 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:40.727967    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:01:40.905554 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:40.905525    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:01:41.009117 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:41.009010    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:01:41.164945 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:41.164900    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2f165eaf-af96-4d29-8177-dfb1be534aa8-maas-api-tls\") pod \"maas-api-e2e-api-a-714794-85c9cc569c-tl2gm\" (UID: \"2f165eaf-af96-4d29-8177-dfb1be534aa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-714794-85c9cc569c-tl2gm"
Jul 13 16:01:41.167339 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:41.167305    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2f165eaf-af96-4d29-8177-dfb1be534aa8-maas-api-tls\") pod \"maas-api-e2e-api-a-714794-85c9cc569c-tl2gm\" (UID: \"2f165eaf-af96-4d29-8177-dfb1be534aa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-714794-85c9cc569c-tl2gm"
Jul 13 16:01:41.349795 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:41.349701    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-714794-85c9cc569c-tl2gm"
Jul 13 16:01:41.485552 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:41.485527    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-714794-85c9cc569c-tl2gm"]
Jul 13 16:01:41.488237 ip-10-0-137-93 kubenswrapper[2555]: W0713 16:01:41.488188    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f165eaf_af96_4d29_8177_dfb1be534aa8.slice/crio-2be5c656626a5948d26f5b64cd84c52614f0a00d060e2256ea67c3aa4027b985 WatchSource:0}: Error finding container 2be5c656626a5948d26f5b64cd84c52614f0a00d060e2256ea67c3aa4027b985: Status 404 returned error can't find the container with id 2be5c656626a5948d26f5b64cd84c52614f0a00d060e2256ea67c3aa4027b985
Jul 13 16:01:41.489689 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:41.489668    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 16:01:42.298927 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:42.298888    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-714794-85c9cc569c-tl2gm" event={"ID":"2f165eaf-af96-4d29-8177-dfb1be534aa8","Type":"ContainerStarted","Data":"76a2a1b02557aef127494acd40b81189232132fca65acaaf74175c1e5d47541b"}
Jul 13 16:01:42.299125 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:42.298938    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-714794-85c9cc569c-tl2gm" event={"ID":"2f165eaf-af96-4d29-8177-dfb1be534aa8","Type":"ContainerStarted","Data":"2be5c656626a5948d26f5b64cd84c52614f0a00d060e2256ea67c3aa4027b985"}
Jul 13 16:01:42.299125 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:42.299082    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-714794-85c9cc569c-tl2gm"
Jul 13 16:01:42.322931 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:42.322879    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-714794-85c9cc569c-tl2gm" podStartSLOduration=1.732455951 podStartE2EDuration="2.32286231s" totalImagesPullingTime="590.406359ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:01:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:01:42.321875569 +0000 UTC m=+2288.646597469" watchObservedRunningTime="2026-07-13 16:01:42.32286231 +0000 UTC m=+2288.647584256"
Jul 13 16:01:42.545668 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:42.545635    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:01:44.734531 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:44.734497    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:01:45.175059 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:45.174961    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:01:45.502020 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:45.501983    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:01:45.594012 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:45.593931    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:01:47.981124 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:47.981060    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:01:48.083664 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:48.083625    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-68976d-69f68dd454-p567m"]
Jul 13 16:01:48.084988 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:48.084956    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:01:48.088705 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:48.088679    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-68976d-69f68dd454-p567m"
Jul 13 16:01:48.092418 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:48.092390    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-68976d-serving-cert\""
Jul 13 16:01:48.116276 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:48.116240    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-68976d-69f68dd454-p567m"]
Jul 13 16:01:48.189087 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:48.189048    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:01:48.229688 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:48.229652    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gwzd\" (UniqueName: \"kubernetes.io/projected/4997c91d-3f1a-4b0a-a5d7-93d68d96acbe-kube-api-access-6gwzd\") pod \"maas-api-e2e-api-b-68976d-69f68dd454-p567m\" (UID: \"4997c91d-3f1a-4b0a-a5d7-93d68d96acbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-68976d-69f68dd454-p567m"
Jul 13 16:01:48.229902 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:48.229789    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4997c91d-3f1a-4b0a-a5d7-93d68d96acbe-openshift-service-ca\") pod \"maas-api-e2e-api-b-68976d-69f68dd454-p567m\" (UID: \"4997c91d-3f1a-4b0a-a5d7-93d68d96acbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-68976d-69f68dd454-p567m"
Jul 13 16:01:48.229902 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:48.229848    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4997c91d-3f1a-4b0a-a5d7-93d68d96acbe-maas-api-tls\") pod \"maas-api-e2e-api-b-68976d-69f68dd454-p567m\" (UID: \"4997c91d-3f1a-4b0a-a5d7-93d68d96acbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-68976d-69f68dd454-p567m"
Jul 13 16:01:48.311227 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:48.311153    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-714794-85c9cc569c-tl2gm"
Jul 13 16:01:48.330521 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:48.330482    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4997c91d-3f1a-4b0a-a5d7-93d68d96acbe-openshift-service-ca\") pod \"maas-api-e2e-api-b-68976d-69f68dd454-p567m\" (UID: \"4997c91d-3f1a-4b0a-a5d7-93d68d96acbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-68976d-69f68dd454-p567m"
Jul 13 16:01:48.330722 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:48.330530    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4997c91d-3f1a-4b0a-a5d7-93d68d96acbe-maas-api-tls\") pod \"maas-api-e2e-api-b-68976d-69f68dd454-p567m\" (UID: \"4997c91d-3f1a-4b0a-a5d7-93d68d96acbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-68976d-69f68dd454-p567m"
Jul 13 16:01:48.330722 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:48.330673    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gwzd\" (UniqueName: \"kubernetes.io/projected/4997c91d-3f1a-4b0a-a5d7-93d68d96acbe-kube-api-access-6gwzd\") pod \"maas-api-e2e-api-b-68976d-69f68dd454-p567m\" (UID: \"4997c91d-3f1a-4b0a-a5d7-93d68d96acbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-68976d-69f68dd454-p567m"
Jul 13 16:01:48.330722 ip-10-0-137-93 kubenswrapper[2555]: E0713 16:01:48.330710    2555 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-68976d-serving-cert: secret "maas-api-e2e-api-b-68976d-serving-cert" not found
Jul 13 16:01:48.330901 ip-10-0-137-93 kubenswrapper[2555]: E0713 16:01:48.330807    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4997c91d-3f1a-4b0a-a5d7-93d68d96acbe-maas-api-tls podName:4997c91d-3f1a-4b0a-a5d7-93d68d96acbe nodeName:}" failed. No retries permitted until 2026-07-13 16:01:48.830785646 +0000 UTC m=+2295.155507523 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4997c91d-3f1a-4b0a-a5d7-93d68d96acbe-maas-api-tls") pod "maas-api-e2e-api-b-68976d-69f68dd454-p567m" (UID: "4997c91d-3f1a-4b0a-a5d7-93d68d96acbe") : secret "maas-api-e2e-api-b-68976d-serving-cert" not found
Jul 13 16:01:48.331331 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:48.331312    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4997c91d-3f1a-4b0a-a5d7-93d68d96acbe-openshift-service-ca\") pod \"maas-api-e2e-api-b-68976d-69f68dd454-p567m\" (UID: \"4997c91d-3f1a-4b0a-a5d7-93d68d96acbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-68976d-69f68dd454-p567m"
Jul 13 16:01:48.341915 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:48.341883    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gwzd\" (UniqueName: \"kubernetes.io/projected/4997c91d-3f1a-4b0a-a5d7-93d68d96acbe-kube-api-access-6gwzd\") pod \"maas-api-e2e-api-b-68976d-69f68dd454-p567m\" (UID: \"4997c91d-3f1a-4b0a-a5d7-93d68d96acbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-68976d-69f68dd454-p567m"
Jul 13 16:01:48.591959 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:48.591867    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:01:48.707260 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:48.707224    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:01:48.806491 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:48.806458    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:01:48.835373 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:48.835351    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4997c91d-3f1a-4b0a-a5d7-93d68d96acbe-maas-api-tls\") pod \"maas-api-e2e-api-b-68976d-69f68dd454-p567m\" (UID: \"4997c91d-3f1a-4b0a-a5d7-93d68d96acbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-68976d-69f68dd454-p567m"
Jul 13 16:01:48.837780 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:48.837759    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4997c91d-3f1a-4b0a-a5d7-93d68d96acbe-maas-api-tls\") pod \"maas-api-e2e-api-b-68976d-69f68dd454-p567m\" (UID: \"4997c91d-3f1a-4b0a-a5d7-93d68d96acbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-68976d-69f68dd454-p567m"
Jul 13 16:01:49.001658 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:49.001623    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-68976d-69f68dd454-p567m"
Jul 13 16:01:49.158884 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:49.158851    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-68976d-69f68dd454-p567m"]
Jul 13 16:01:49.162338 ip-10-0-137-93 kubenswrapper[2555]: W0713 16:01:49.162306    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4997c91d_3f1a_4b0a_a5d7_93d68d96acbe.slice/crio-82b2181bdc7f81393b1721d110a799f285f80cf41bcc934a0fb7b1e3a49a5c84 WatchSource:0}: Error finding container 82b2181bdc7f81393b1721d110a799f285f80cf41bcc934a0fb7b1e3a49a5c84: Status 404 returned error can't find the container with id 82b2181bdc7f81393b1721d110a799f285f80cf41bcc934a0fb7b1e3a49a5c84
Jul 13 16:01:49.333534 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:49.333448    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-68976d-69f68dd454-p567m" event={"ID":"4997c91d-3f1a-4b0a-a5d7-93d68d96acbe","Type":"ContainerStarted","Data":"82b2181bdc7f81393b1721d110a799f285f80cf41bcc934a0fb7b1e3a49a5c84"}
Jul 13 16:01:50.340140 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:50.340103    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-68976d-69f68dd454-p567m" event={"ID":"4997c91d-3f1a-4b0a-a5d7-93d68d96acbe","Type":"ContainerStarted","Data":"e5695d8da506d25752c7e0d21560c0991f2e77150d4bc74ce68e6e00bbefdc58"}
Jul 13 16:01:50.340536 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:50.340162    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-68976d-69f68dd454-p567m"
Jul 13 16:01:50.358866 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:50.358823    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-68976d-69f68dd454-p567m" podStartSLOduration=1.946943733 podStartE2EDuration="2.358809656s" totalImagesPullingTime="411.865923ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:01:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:01:50.356603152 +0000 UTC m=+2296.681325039" watchObservedRunningTime="2026-07-13 16:01:50.358809656 +0000 UTC m=+2296.683531578"
Jul 13 16:01:52.474296 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:52.474254    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:01:54.282270 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:54.282236    2555 patch_prober.go:28] interesting pod/e2e-api-a-714794-openshift-default-5c66995599-9m75s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 13 16:01:54.282699 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:54.282298    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s" podUID="c0bd73ad-736e-464e-b367-c790e79233e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 13 16:01:54.360327 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:54.360289    2555 generic.go:356] "Generic (PLEG): container finished" podID="c0bd73ad-736e-464e-b367-c790e79233e1" containerID="d0564659199c1923b1224fcf6da89c8ca8230049b2f5b5b0d40952fca25530e4" exitCode=0
Jul 13 16:01:54.360489 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:54.360362    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s" event={"ID":"c0bd73ad-736e-464e-b367-c790e79233e1","Type":"ContainerDied","Data":"d0564659199c1923b1224fcf6da89c8ca8230049b2f5b5b0d40952fca25530e4"}
Jul 13 16:01:54.360794 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:54.360778    2555 scope.go:117] "RemoveContainer" containerID="d0564659199c1923b1224fcf6da89c8ca8230049b2f5b5b0d40952fca25530e4"
Jul 13 16:01:54.361793 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:54.361765    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 16:01:54.361861 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:54.361849    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 16:01:54.361899 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:54.361883    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 16:01:55.369806 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:55.369771    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s" event={"ID":"c0bd73ad-736e-464e-b367-c790e79233e1","Type":"ContainerStarted","Data":"5d0f45ef7e01c3a39482e6aa2ef0178e30c79b7acbfc00d9585bd3c25d73ee63"}
Jul 13 16:01:55.664101 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:55.664013    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s"
Jul 13 16:01:55.664440 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:55.664356    2555 patch_prober.go:28] interesting pod/e2e-api-a-714794-openshift-default-5c66995599-9m75s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 13 16:01:55.664633 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:55.664611    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s" podUID="c0bd73ad-736e-464e-b367-c790e79233e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 13 16:01:56.351055 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:56.351030    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-68976d-69f68dd454-p567m"
Jul 13 16:01:56.664278 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:56.663780    2555 patch_prober.go:28] interesting pod/e2e-api-a-714794-openshift-default-5c66995599-9m75s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 13 16:01:56.664278 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:56.663852    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s" podUID="c0bd73ad-736e-464e-b367-c790e79233e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 13 16:01:57.663746 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:57.663705    2555 patch_prober.go:28] interesting pod/e2e-api-a-714794-openshift-default-5c66995599-9m75s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 13 16:01:57.663978 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:57.663787    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s" podUID="c0bd73ad-736e-464e-b367-c790e79233e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 13 16:01:58.663618 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:58.663542    2555 patch_prober.go:28] interesting pod/e2e-api-a-714794-openshift-default-5c66995599-9m75s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 13 16:01:58.664221 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:58.664187    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s" podUID="c0bd73ad-736e-464e-b367-c790e79233e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 13 16:01:59.667350 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:59.667322    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s"
Jul 13 16:01:59.667841 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:59.667699    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s"
Jul 13 16:01:59.668466 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:01:59.668444    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s"
Jul 13 16:02:01.212100 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:01.212060    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:02:01.302269 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:01.302231    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:02:09.474681 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:09.474644    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:02:09.574626 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:09.574564    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:02:11.065884 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:11.065847    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:02:11.203921 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:11.203886    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:02:11.310146 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:11.310103    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-714794-85c9cc569c-tl2gm"]
Jul 13 16:02:11.310423 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:11.310396    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-714794-85c9cc569c-tl2gm" podUID="2f165eaf-af96-4d29-8177-dfb1be534aa8" containerName="maas-api" containerID="cri-o://76a2a1b02557aef127494acd40b81189232132fca65acaaf74175c1e5d47541b" gracePeriod=30
Jul 13 16:02:11.340453 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:11.340422    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:02:11.468283 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:11.468253    2555 generic.go:356] "Generic (PLEG): container finished" podID="2f165eaf-af96-4d29-8177-dfb1be534aa8" containerID="76a2a1b02557aef127494acd40b81189232132fca65acaaf74175c1e5d47541b" exitCode=0
Jul 13 16:02:11.468441 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:11.468337    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-714794-85c9cc569c-tl2gm" event={"ID":"2f165eaf-af96-4d29-8177-dfb1be534aa8","Type":"ContainerDied","Data":"76a2a1b02557aef127494acd40b81189232132fca65acaaf74175c1e5d47541b"}
Jul 13 16:02:11.560061 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:11.560031    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-714794-85c9cc569c-tl2gm"
Jul 13 16:02:11.642964 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:11.642880    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5t69\" (UniqueName: \"kubernetes.io/projected/2f165eaf-af96-4d29-8177-dfb1be534aa8-kube-api-access-v5t69\") pod \"2f165eaf-af96-4d29-8177-dfb1be534aa8\" (UID: \"2f165eaf-af96-4d29-8177-dfb1be534aa8\") "
Jul 13 16:02:11.642964 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:11.642942    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2f165eaf-af96-4d29-8177-dfb1be534aa8-maas-api-tls\") pod \"2f165eaf-af96-4d29-8177-dfb1be534aa8\" (UID: \"2f165eaf-af96-4d29-8177-dfb1be534aa8\") "
Jul 13 16:02:11.643165 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:11.642999    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f165eaf-af96-4d29-8177-dfb1be534aa8-openshift-service-ca\") pod \"2f165eaf-af96-4d29-8177-dfb1be534aa8\" (UID: \"2f165eaf-af96-4d29-8177-dfb1be534aa8\") "
Jul 13 16:02:11.643365 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:11.643339    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f165eaf-af96-4d29-8177-dfb1be534aa8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2f165eaf-af96-4d29-8177-dfb1be534aa8" (UID: "2f165eaf-af96-4d29-8177-dfb1be534aa8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 16:02:11.645180 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:11.645152    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f165eaf-af96-4d29-8177-dfb1be534aa8-kube-api-access-v5t69" (OuterVolumeSpecName: "kube-api-access-v5t69") pod "2f165eaf-af96-4d29-8177-dfb1be534aa8" (UID: "2f165eaf-af96-4d29-8177-dfb1be534aa8"). InnerVolumeSpecName "kube-api-access-v5t69". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:02:11.645273 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:11.645155    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f165eaf-af96-4d29-8177-dfb1be534aa8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2f165eaf-af96-4d29-8177-dfb1be534aa8" (UID: "2f165eaf-af96-4d29-8177-dfb1be534aa8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 16:02:11.743924 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:11.743888    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5t69\" (UniqueName: \"kubernetes.io/projected/2f165eaf-af96-4d29-8177-dfb1be534aa8-kube-api-access-v5t69\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:02:11.743924 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:11.743920    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2f165eaf-af96-4d29-8177-dfb1be534aa8-maas-api-tls\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:02:11.744092 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:11.743934    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f165eaf-af96-4d29-8177-dfb1be534aa8-openshift-service-ca\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:02:12.476278 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:12.476254    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-714794-85c9cc569c-tl2gm"
Jul 13 16:02:12.476278 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:12.476260    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-714794-85c9cc569c-tl2gm" event={"ID":"2f165eaf-af96-4d29-8177-dfb1be534aa8","Type":"ContainerDied","Data":"2be5c656626a5948d26f5b64cd84c52614f0a00d060e2256ea67c3aa4027b985"}
Jul 13 16:02:12.476808 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:12.476334    2555 scope.go:117] "RemoveContainer" containerID="76a2a1b02557aef127494acd40b81189232132fca65acaaf74175c1e5d47541b"
Jul 13 16:02:12.493784 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:12.493759    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-714794-85c9cc569c-tl2gm"]
Jul 13 16:02:12.497095 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:12.497074    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-714794-85c9cc569c-tl2gm"]
Jul 13 16:02:14.204102 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:14.204063    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f165eaf-af96-4d29-8177-dfb1be534aa8" path="/var/lib/kubelet/pods/2f165eaf-af96-4d29-8177-dfb1be534aa8/volumes"
Jul 13 16:02:15.609052 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:15.609011    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:02:21.611470 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:21.611430    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:02:21.666425 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:21.666397    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:02:26.265682 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:26.265635    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s"]
Jul 13 16:02:26.266169 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:26.265887    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s" podUID="c0bd73ad-736e-464e-b367-c790e79233e1" containerName="istio-proxy" containerID="cri-o://5d0f45ef7e01c3a39482e6aa2ef0178e30c79b7acbfc00d9585bd3c25d73ee63" gracePeriod=30
Jul 13 16:02:26.296019 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:26.295987    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:02:26.513037 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:26.512949    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:02:27.250046 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:27.250013    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:02:27.350986 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:27.350954    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:02:29.670714 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:29.670681    2555 patch_prober.go:28] interesting pod/e2e-api-a-714794-openshift-default-5c66995599-9m75s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 13 16:02:29.671077 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:29.670737    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s" podUID="c0bd73ad-736e-464e-b367-c790e79233e1" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 16:02:31.522558 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:31.522532    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s"
Jul 13 16:02:31.576804 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:31.576715    2555 generic.go:356] "Generic (PLEG): container finished" podID="c0bd73ad-736e-464e-b367-c790e79233e1" containerID="5d0f45ef7e01c3a39482e6aa2ef0178e30c79b7acbfc00d9585bd3c25d73ee63" exitCode=0
Jul 13 16:02:31.576804 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:31.576769    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s"
Jul 13 16:02:31.576985 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:31.576798    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s" event={"ID":"c0bd73ad-736e-464e-b367-c790e79233e1","Type":"ContainerDied","Data":"5d0f45ef7e01c3a39482e6aa2ef0178e30c79b7acbfc00d9585bd3c25d73ee63"}
Jul 13 16:02:31.576985 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:31.576856    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s" event={"ID":"c0bd73ad-736e-464e-b367-c790e79233e1","Type":"ContainerDied","Data":"829bc0ddacd5061632dabac0f793ce81eb646018232fdffb1d3d4f613756c698"}
Jul 13 16:02:31.576985 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:31.576878    2555 scope.go:117] "RemoveContainer" containerID="5d0f45ef7e01c3a39482e6aa2ef0178e30c79b7acbfc00d9585bd3c25d73ee63"
Jul 13 16:02:31.585857 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:31.585839    2555 scope.go:117] "RemoveContainer" containerID="d0564659199c1923b1224fcf6da89c8ca8230049b2f5b5b0d40952fca25530e4"
Jul 13 16:02:31.594180 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:31.594159    2555 scope.go:117] "RemoveContainer" containerID="5d0f45ef7e01c3a39482e6aa2ef0178e30c79b7acbfc00d9585bd3c25d73ee63"
Jul 13 16:02:31.594433 ip-10-0-137-93 kubenswrapper[2555]: E0713 16:02:31.594414    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d0f45ef7e01c3a39482e6aa2ef0178e30c79b7acbfc00d9585bd3c25d73ee63\": container with ID starting with 5d0f45ef7e01c3a39482e6aa2ef0178e30c79b7acbfc00d9585bd3c25d73ee63 not found: ID does not exist" containerID="5d0f45ef7e01c3a39482e6aa2ef0178e30c79b7acbfc00d9585bd3c25d73ee63"
Jul 13 16:02:31.594493 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:31.594444    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d0f45ef7e01c3a39482e6aa2ef0178e30c79b7acbfc00d9585bd3c25d73ee63"} err="failed to get container status \"5d0f45ef7e01c3a39482e6aa2ef0178e30c79b7acbfc00d9585bd3c25d73ee63\": rpc error: code = NotFound desc = could not find container \"5d0f45ef7e01c3a39482e6aa2ef0178e30c79b7acbfc00d9585bd3c25d73ee63\": container with ID starting with 5d0f45ef7e01c3a39482e6aa2ef0178e30c79b7acbfc00d9585bd3c25d73ee63 not found: ID does not exist"
Jul 13 16:02:31.594493 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:31.594463    2555 scope.go:117] "RemoveContainer" containerID="d0564659199c1923b1224fcf6da89c8ca8230049b2f5b5b0d40952fca25530e4"
Jul 13 16:02:31.594774 ip-10-0-137-93 kubenswrapper[2555]: E0713 16:02:31.594755    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0564659199c1923b1224fcf6da89c8ca8230049b2f5b5b0d40952fca25530e4\": container with ID starting with d0564659199c1923b1224fcf6da89c8ca8230049b2f5b5b0d40952fca25530e4 not found: ID does not exist" containerID="d0564659199c1923b1224fcf6da89c8ca8230049b2f5b5b0d40952fca25530e4"
Jul 13 16:02:31.594832 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:31.594783    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0564659199c1923b1224fcf6da89c8ca8230049b2f5b5b0d40952fca25530e4"} err="failed to get container status \"d0564659199c1923b1224fcf6da89c8ca8230049b2f5b5b0d40952fca25530e4\": rpc error: code = NotFound desc = could not find container \"d0564659199c1923b1224fcf6da89c8ca8230049b2f5b5b0d40952fca25530e4\": container with ID starting with d0564659199c1923b1224fcf6da89c8ca8230049b2f5b5b0d40952fca25530e4 not found: ID does not exist"
Jul 13 16:02:31.623119 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:31.623088    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0bd73ad-736e-464e-b367-c790e79233e1-istio-data\") pod \"c0bd73ad-736e-464e-b367-c790e79233e1\" (UID: \"c0bd73ad-736e-464e-b367-c790e79233e1\") "
Jul 13 16:02:31.623246 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:31.623129    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0bd73ad-736e-464e-b367-c790e79233e1-istio-token\") pod \"c0bd73ad-736e-464e-b367-c790e79233e1\" (UID: \"c0bd73ad-736e-464e-b367-c790e79233e1\") "
Jul 13 16:02:31.623246 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:31.623175    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0bd73ad-736e-464e-b367-c790e79233e1-istio-envoy\") pod \"c0bd73ad-736e-464e-b367-c790e79233e1\" (UID: \"c0bd73ad-736e-464e-b367-c790e79233e1\") "
Jul 13 16:02:31.623246 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:31.623201    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0bd73ad-736e-464e-b367-c790e79233e1-workload-certs\") pod \"c0bd73ad-736e-464e-b367-c790e79233e1\" (UID: \"c0bd73ad-736e-464e-b367-c790e79233e1\") "
Jul 13 16:02:31.623246 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:31.623221    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0bd73ad-736e-464e-b367-c790e79233e1-workload-socket\") pod \"c0bd73ad-736e-464e-b367-c790e79233e1\" (UID: \"c0bd73ad-736e-464e-b367-c790e79233e1\") "
Jul 13 16:02:31.623446 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:31.623275    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0bd73ad-736e-464e-b367-c790e79233e1-istiod-ca-cert\") pod \"c0bd73ad-736e-464e-b367-c790e79233e1\" (UID: \"c0bd73ad-736e-464e-b367-c790e79233e1\") "
Jul 13 16:02:31.623446 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:31.623307    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0bd73ad-736e-464e-b367-c790e79233e1-credential-socket\") pod \"c0bd73ad-736e-464e-b367-c790e79233e1\" (UID: \"c0bd73ad-736e-464e-b367-c790e79233e1\") "
Jul 13 16:02:31.623446 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:31.623373    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4nb7r\" (UniqueName: \"kubernetes.io/projected/c0bd73ad-736e-464e-b367-c790e79233e1-kube-api-access-4nb7r\") pod \"c0bd73ad-736e-464e-b367-c790e79233e1\" (UID: \"c0bd73ad-736e-464e-b367-c790e79233e1\") "
Jul 13 16:02:31.623446 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:31.623394    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0bd73ad-736e-464e-b367-c790e79233e1-istio-podinfo\") pod \"c0bd73ad-736e-464e-b367-c790e79233e1\" (UID: \"c0bd73ad-736e-464e-b367-c790e79233e1\") "
Jul 13 16:02:31.623691 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:31.623516    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0bd73ad-736e-464e-b367-c790e79233e1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c0bd73ad-736e-464e-b367-c790e79233e1" (UID: "c0bd73ad-736e-464e-b367-c790e79233e1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:02:31.623771 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:31.623751    2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0bd73ad-736e-464e-b367-c790e79233e1-workload-certs\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:02:31.623831 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:31.623757    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0bd73ad-736e-464e-b367-c790e79233e1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c0bd73ad-736e-464e-b367-c790e79233e1" (UID: "c0bd73ad-736e-464e-b367-c790e79233e1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 16:02:31.623831 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:31.623523    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0bd73ad-736e-464e-b367-c790e79233e1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c0bd73ad-736e-464e-b367-c790e79233e1" (UID: "c0bd73ad-736e-464e-b367-c790e79233e1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:02:31.623831 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:31.623811    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0bd73ad-736e-464e-b367-c790e79233e1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c0bd73ad-736e-464e-b367-c790e79233e1" (UID: "c0bd73ad-736e-464e-b367-c790e79233e1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:02:31.624102 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:31.624077    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0bd73ad-736e-464e-b367-c790e79233e1-istio-data" (OuterVolumeSpecName: "istio-data") pod "c0bd73ad-736e-464e-b367-c790e79233e1" (UID: "c0bd73ad-736e-464e-b367-c790e79233e1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:02:31.625695 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:31.625658    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0bd73ad-736e-464e-b367-c790e79233e1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c0bd73ad-736e-464e-b367-c790e79233e1" (UID: "c0bd73ad-736e-464e-b367-c790e79233e1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:02:31.625843 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:31.625810    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0bd73ad-736e-464e-b367-c790e79233e1-kube-api-access-4nb7r" (OuterVolumeSpecName: "kube-api-access-4nb7r") pod "c0bd73ad-736e-464e-b367-c790e79233e1" (UID: "c0bd73ad-736e-464e-b367-c790e79233e1"). InnerVolumeSpecName "kube-api-access-4nb7r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:02:31.625920 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:31.625868    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0bd73ad-736e-464e-b367-c790e79233e1-istio-token" (OuterVolumeSpecName: "istio-token") pod "c0bd73ad-736e-464e-b367-c790e79233e1" (UID: "c0bd73ad-736e-464e-b367-c790e79233e1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:02:31.625920 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:31.625897    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c0bd73ad-736e-464e-b367-c790e79233e1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c0bd73ad-736e-464e-b367-c790e79233e1" (UID: "c0bd73ad-736e-464e-b367-c790e79233e1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 16:02:31.724575 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:31.724534    2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0bd73ad-736e-464e-b367-c790e79233e1-istio-data\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:02:31.724575 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:31.724570    2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0bd73ad-736e-464e-b367-c790e79233e1-istio-token\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:02:31.724575 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:31.724580    2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0bd73ad-736e-464e-b367-c790e79233e1-istio-envoy\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:02:31.724575 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:31.724618    2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0bd73ad-736e-464e-b367-c790e79233e1-workload-socket\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:02:31.724875 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:31.724627    2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0bd73ad-736e-464e-b367-c790e79233e1-istiod-ca-cert\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:02:31.724875 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:31.724637    2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0bd73ad-736e-464e-b367-c790e79233e1-credential-socket\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:02:31.724875 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:31.724652    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4nb7r\" (UniqueName: \"kubernetes.io/projected/c0bd73ad-736e-464e-b367-c790e79233e1-kube-api-access-4nb7r\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:02:31.724875 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:31.724660    2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0bd73ad-736e-464e-b367-c790e79233e1-istio-podinfo\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:02:31.900856 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:31.900819    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s"]
Jul 13 16:02:31.904528 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:31.904496    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-714794-openshift-default-5c66995599-9m75s"]
Jul 13 16:02:32.203246 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:32.203169    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0bd73ad-736e-464e-b367-c790e79233e1" path="/var/lib/kubelet/pods/c0bd73ad-736e-464e-b367-c790e79233e1/volumes"
Jul 13 16:02:37.026027 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:37.025991    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-68976d-69f68dd454-p567m"]
Jul 13 16:02:37.026780 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:37.026743    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-68976d-69f68dd454-p567m" podUID="4997c91d-3f1a-4b0a-a5d7-93d68d96acbe" containerName="maas-api" containerID="cri-o://e5695d8da506d25752c7e0d21560c0991f2e77150d4bc74ce68e6e00bbefdc58" gracePeriod=30
Jul 13 16:02:37.049464 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:37.049443    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:02:37.272492 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:37.272465    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-68976d-69f68dd454-p567m"
Jul 13 16:02:37.374376 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:37.374286    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6gwzd\" (UniqueName: \"kubernetes.io/projected/4997c91d-3f1a-4b0a-a5d7-93d68d96acbe-kube-api-access-6gwzd\") pod \"4997c91d-3f1a-4b0a-a5d7-93d68d96acbe\" (UID: \"4997c91d-3f1a-4b0a-a5d7-93d68d96acbe\") "
Jul 13 16:02:37.374376 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:37.374340    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4997c91d-3f1a-4b0a-a5d7-93d68d96acbe-openshift-service-ca\") pod \"4997c91d-3f1a-4b0a-a5d7-93d68d96acbe\" (UID: \"4997c91d-3f1a-4b0a-a5d7-93d68d96acbe\") "
Jul 13 16:02:37.374649 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:37.374446    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4997c91d-3f1a-4b0a-a5d7-93d68d96acbe-maas-api-tls\") pod \"4997c91d-3f1a-4b0a-a5d7-93d68d96acbe\" (UID: \"4997c91d-3f1a-4b0a-a5d7-93d68d96acbe\") "
Jul 13 16:02:37.374838 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:37.374806    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4997c91d-3f1a-4b0a-a5d7-93d68d96acbe-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4997c91d-3f1a-4b0a-a5d7-93d68d96acbe" (UID: "4997c91d-3f1a-4b0a-a5d7-93d68d96acbe"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 16:02:37.376467 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:37.376439    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4997c91d-3f1a-4b0a-a5d7-93d68d96acbe-kube-api-access-6gwzd" (OuterVolumeSpecName: "kube-api-access-6gwzd") pod "4997c91d-3f1a-4b0a-a5d7-93d68d96acbe" (UID: "4997c91d-3f1a-4b0a-a5d7-93d68d96acbe"). InnerVolumeSpecName "kube-api-access-6gwzd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:02:37.376548 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:37.376523    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4997c91d-3f1a-4b0a-a5d7-93d68d96acbe-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4997c91d-3f1a-4b0a-a5d7-93d68d96acbe" (UID: "4997c91d-3f1a-4b0a-a5d7-93d68d96acbe"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 16:02:37.476174 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:37.476131    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6gwzd\" (UniqueName: \"kubernetes.io/projected/4997c91d-3f1a-4b0a-a5d7-93d68d96acbe-kube-api-access-6gwzd\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:02:37.476174 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:37.476169    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4997c91d-3f1a-4b0a-a5d7-93d68d96acbe-openshift-service-ca\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:02:37.476174 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:37.476183    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4997c91d-3f1a-4b0a-a5d7-93d68d96acbe-maas-api-tls\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:02:37.608833 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:37.608796    2555 generic.go:356] "Generic (PLEG): container finished" podID="4997c91d-3f1a-4b0a-a5d7-93d68d96acbe" containerID="e5695d8da506d25752c7e0d21560c0991f2e77150d4bc74ce68e6e00bbefdc58" exitCode=0
Jul 13 16:02:37.609039 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:37.608844    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-68976d-69f68dd454-p567m"
Jul 13 16:02:37.609039 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:37.608883    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-68976d-69f68dd454-p567m" event={"ID":"4997c91d-3f1a-4b0a-a5d7-93d68d96acbe","Type":"ContainerDied","Data":"e5695d8da506d25752c7e0d21560c0991f2e77150d4bc74ce68e6e00bbefdc58"}
Jul 13 16:02:37.609039 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:37.608939    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-68976d-69f68dd454-p567m" event={"ID":"4997c91d-3f1a-4b0a-a5d7-93d68d96acbe","Type":"ContainerDied","Data":"82b2181bdc7f81393b1721d110a799f285f80cf41bcc934a0fb7b1e3a49a5c84"}
Jul 13 16:02:37.609039 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:37.608971    2555 scope.go:117] "RemoveContainer" containerID="e5695d8da506d25752c7e0d21560c0991f2e77150d4bc74ce68e6e00bbefdc58"
Jul 13 16:02:37.618706 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:37.618688    2555 scope.go:117] "RemoveContainer" containerID="e5695d8da506d25752c7e0d21560c0991f2e77150d4bc74ce68e6e00bbefdc58"
Jul 13 16:02:37.618988 ip-10-0-137-93 kubenswrapper[2555]: E0713 16:02:37.618970    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5695d8da506d25752c7e0d21560c0991f2e77150d4bc74ce68e6e00bbefdc58\": container with ID starting with e5695d8da506d25752c7e0d21560c0991f2e77150d4bc74ce68e6e00bbefdc58 not found: ID does not exist" containerID="e5695d8da506d25752c7e0d21560c0991f2e77150d4bc74ce68e6e00bbefdc58"
Jul 13 16:02:37.619050 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:37.619001    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5695d8da506d25752c7e0d21560c0991f2e77150d4bc74ce68e6e00bbefdc58"} err="failed to get container status \"e5695d8da506d25752c7e0d21560c0991f2e77150d4bc74ce68e6e00bbefdc58\": rpc error: code = NotFound desc = could not find container \"e5695d8da506d25752c7e0d21560c0991f2e77150d4bc74ce68e6e00bbefdc58\": container with ID starting with e5695d8da506d25752c7e0d21560c0991f2e77150d4bc74ce68e6e00bbefdc58 not found: ID does not exist"
Jul 13 16:02:37.631851 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:37.631785    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-68976d-69f68dd454-p567m"]
Jul 13 16:02:37.638079 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:37.638051    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-68976d-69f68dd454-p567m"]
Jul 13 16:02:38.202993 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:38.202963    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4997c91d-3f1a-4b0a-a5d7-93d68d96acbe" path="/var/lib/kubelet/pods/4997c91d-3f1a-4b0a-a5d7-93d68d96acbe/volumes"
Jul 13 16:02:41.932083 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:41.932047    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:02:46.461361 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:46.461330    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:02:46.561936 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:46.561905    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:02:47.710749 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:47.710709    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:02:48.005261 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:48.005224    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:02:52.413407 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:52.413370    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:02:52.661019 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:52.660984    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:02:52.999437 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:52.999401    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:02:53.294249 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.294165    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm"]
Jul 13 16:02:53.294773 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.294754    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f165eaf-af96-4d29-8177-dfb1be534aa8" containerName="maas-api"
Jul 13 16:02:53.294839 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.294778    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f165eaf-af96-4d29-8177-dfb1be534aa8" containerName="maas-api"
Jul 13 16:02:53.294839 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.294790    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4997c91d-3f1a-4b0a-a5d7-93d68d96acbe" containerName="maas-api"
Jul 13 16:02:53.294839 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.294799    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="4997c91d-3f1a-4b0a-a5d7-93d68d96acbe" containerName="maas-api"
Jul 13 16:02:53.294839 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.294818    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0bd73ad-736e-464e-b367-c790e79233e1" containerName="istio-proxy"
Jul 13 16:02:53.294839 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.294827    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0bd73ad-736e-464e-b367-c790e79233e1" containerName="istio-proxy"
Jul 13 16:02:53.295082 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.294939    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f165eaf-af96-4d29-8177-dfb1be534aa8" containerName="maas-api"
Jul 13 16:02:53.295082 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.294957    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0bd73ad-736e-464e-b367-c790e79233e1" containerName="istio-proxy"
Jul 13 16:02:53.295082 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.294969    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="4997c91d-3f1a-4b0a-a5d7-93d68d96acbe" containerName="maas-api"
Jul 13 16:02:53.298365 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.298347    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm"
Jul 13 16:02:53.300645 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.300624    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-a1c3e5-openshift-default-dockercfg-2tqgs\""
Jul 13 16:02:53.307278 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.307252    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm"]
Jul 13 16:02:53.312494 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.312470    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e59e70b7-445e-486e-9ee4-53c68d07e32c-istio-envoy\") pod \"e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm\" (UID: \"e59e70b7-445e-486e-9ee4-53c68d07e32c\") " pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm"
Jul 13 16:02:53.312657 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.312503    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e59e70b7-445e-486e-9ee4-53c68d07e32c-istio-podinfo\") pod \"e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm\" (UID: \"e59e70b7-445e-486e-9ee4-53c68d07e32c\") " pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm"
Jul 13 16:02:53.312657 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.312579    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e59e70b7-445e-486e-9ee4-53c68d07e32c-istiod-ca-cert\") pod \"e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm\" (UID: \"e59e70b7-445e-486e-9ee4-53c68d07e32c\") " pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm"
Jul 13 16:02:53.312657 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.312633    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fll8c\" (UniqueName: \"kubernetes.io/projected/e59e70b7-445e-486e-9ee4-53c68d07e32c-kube-api-access-fll8c\") pod \"e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm\" (UID: \"e59e70b7-445e-486e-9ee4-53c68d07e32c\") " pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm"
Jul 13 16:02:53.312657 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.312653    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e59e70b7-445e-486e-9ee4-53c68d07e32c-credential-socket\") pod \"e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm\" (UID: \"e59e70b7-445e-486e-9ee4-53c68d07e32c\") " pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm"
Jul 13 16:02:53.312840 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.312680    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e59e70b7-445e-486e-9ee4-53c68d07e32c-istio-token\") pod \"e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm\" (UID: \"e59e70b7-445e-486e-9ee4-53c68d07e32c\") " pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm"
Jul 13 16:02:53.312840 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.312723    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e59e70b7-445e-486e-9ee4-53c68d07e32c-istio-data\") pod \"e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm\" (UID: \"e59e70b7-445e-486e-9ee4-53c68d07e32c\") " pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm"
Jul 13 16:02:53.312840 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.312758    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e59e70b7-445e-486e-9ee4-53c68d07e32c-workload-certs\") pod \"e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm\" (UID: \"e59e70b7-445e-486e-9ee4-53c68d07e32c\") " pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm"
Jul 13 16:02:53.312840 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.312790    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e59e70b7-445e-486e-9ee4-53c68d07e32c-workload-socket\") pod \"e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm\" (UID: \"e59e70b7-445e-486e-9ee4-53c68d07e32c\") " pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm"
Jul 13 16:02:53.314813 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.314792    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:02:53.413245 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.413199    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e59e70b7-445e-486e-9ee4-53c68d07e32c-workload-socket\") pod \"e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm\" (UID: \"e59e70b7-445e-486e-9ee4-53c68d07e32c\") " pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm"
Jul 13 16:02:53.413446 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.413256    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e59e70b7-445e-486e-9ee4-53c68d07e32c-istio-envoy\") pod \"e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm\" (UID: \"e59e70b7-445e-486e-9ee4-53c68d07e32c\") " pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm"
Jul 13 16:02:53.413446 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.413275    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e59e70b7-445e-486e-9ee4-53c68d07e32c-istio-podinfo\") pod \"e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm\" (UID: \"e59e70b7-445e-486e-9ee4-53c68d07e32c\") " pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm"
Jul 13 16:02:53.413446 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.413306    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e59e70b7-445e-486e-9ee4-53c68d07e32c-istiod-ca-cert\") pod \"e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm\" (UID: \"e59e70b7-445e-486e-9ee4-53c68d07e32c\") " pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm"
Jul 13 16:02:53.413446 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.413333    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fll8c\" (UniqueName: \"kubernetes.io/projected/e59e70b7-445e-486e-9ee4-53c68d07e32c-kube-api-access-fll8c\") pod \"e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm\" (UID: \"e59e70b7-445e-486e-9ee4-53c68d07e32c\") " pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm"
Jul 13 16:02:53.413446 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.413362    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e59e70b7-445e-486e-9ee4-53c68d07e32c-credential-socket\") pod \"e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm\" (UID: \"e59e70b7-445e-486e-9ee4-53c68d07e32c\") " pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm"
Jul 13 16:02:53.413446 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.413437    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e59e70b7-445e-486e-9ee4-53c68d07e32c-istio-token\") pod \"e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm\" (UID: \"e59e70b7-445e-486e-9ee4-53c68d07e32c\") " pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm"
Jul 13 16:02:53.414140 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.413580    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e59e70b7-445e-486e-9ee4-53c68d07e32c-istio-data\") pod \"e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm\" (UID: \"e59e70b7-445e-486e-9ee4-53c68d07e32c\") " pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm"
Jul 13 16:02:53.414140 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.413743    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e59e70b7-445e-486e-9ee4-53c68d07e32c-workload-socket\") pod \"e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm\" (UID: \"e59e70b7-445e-486e-9ee4-53c68d07e32c\") " pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm"
Jul 13 16:02:53.414140 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.413815    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e59e70b7-445e-486e-9ee4-53c68d07e32c-workload-certs\") pod \"e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm\" (UID: \"e59e70b7-445e-486e-9ee4-53c68d07e32c\") " pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm"
Jul 13 16:02:53.414312 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.414281    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e59e70b7-445e-486e-9ee4-53c68d07e32c-istiod-ca-cert\") pod \"e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm\" (UID: \"e59e70b7-445e-486e-9ee4-53c68d07e32c\") " pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm"
Jul 13 16:02:53.414573 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.414543    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e59e70b7-445e-486e-9ee4-53c68d07e32c-credential-socket\") pod \"e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm\" (UID: \"e59e70b7-445e-486e-9ee4-53c68d07e32c\") " pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm"
Jul 13 16:02:53.414832 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.414808    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e59e70b7-445e-486e-9ee4-53c68d07e32c-istio-data\") pod \"e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm\" (UID: \"e59e70b7-445e-486e-9ee4-53c68d07e32c\") " pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm"
Jul 13 16:02:53.415001 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.414907    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e59e70b7-445e-486e-9ee4-53c68d07e32c-workload-certs\") pod \"e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm\" (UID: \"e59e70b7-445e-486e-9ee4-53c68d07e32c\") " pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm"
Jul 13 16:02:53.415966 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.415946    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e59e70b7-445e-486e-9ee4-53c68d07e32c-istio-envoy\") pod \"e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm\" (UID: \"e59e70b7-445e-486e-9ee4-53c68d07e32c\") " pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm"
Jul 13 16:02:53.416190 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.416172    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e59e70b7-445e-486e-9ee4-53c68d07e32c-istio-podinfo\") pod \"e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm\" (UID: \"e59e70b7-445e-486e-9ee4-53c68d07e32c\") " pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm"
Jul 13 16:02:53.421224 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.421199    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e59e70b7-445e-486e-9ee4-53c68d07e32c-istio-token\") pod \"e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm\" (UID: \"e59e70b7-445e-486e-9ee4-53c68d07e32c\") " pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm"
Jul 13 16:02:53.421482 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.421461    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fll8c\" (UniqueName: \"kubernetes.io/projected/e59e70b7-445e-486e-9ee4-53c68d07e32c-kube-api-access-fll8c\") pod \"e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm\" (UID: \"e59e70b7-445e-486e-9ee4-53c68d07e32c\") " pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm"
Jul 13 16:02:53.439049 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.439022    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:02:53.609159 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.609060    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm"
Jul 13 16:02:53.747511 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.747479    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm"]
Jul 13 16:02:53.750627 ip-10-0-137-93 kubenswrapper[2555]: W0713 16:02:53.750604    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode59e70b7_445e_486e_9ee4_53c68d07e32c.slice/crio-4f8219926145aafc9d8567034e1ee0720a939b7e266d2db4dac49b3eba96a795 WatchSource:0}: Error finding container 4f8219926145aafc9d8567034e1ee0720a939b7e266d2db4dac49b3eba96a795: Status 404 returned error can't find the container with id 4f8219926145aafc9d8567034e1ee0720a939b7e266d2db4dac49b3eba96a795
Jul 13 16:02:53.752784 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.752752    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 16:02:53.752874 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.752815    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 16:02:53.752874 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:53.752842    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 16:02:54.691355 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:54.691313    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm" event={"ID":"e59e70b7-445e-486e-9ee4-53c68d07e32c","Type":"ContainerStarted","Data":"cbdb1d2406ec07e149ab7bb9848e4ba0aed8bf6c8b3f2d3062975846bb219684"}
Jul 13 16:02:54.691760 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:54.691393    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm" event={"ID":"e59e70b7-445e-486e-9ee4-53c68d07e32c","Type":"ContainerStarted","Data":"4f8219926145aafc9d8567034e1ee0720a939b7e266d2db4dac49b3eba96a795"}
Jul 13 16:02:54.713391 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:54.713332    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm" podStartSLOduration=1.7133162290000001 podStartE2EDuration="1.713316229s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:02:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:02:54.713259641 +0000 UTC m=+2361.037981538" watchObservedRunningTime="2026-07-13 16:02:54.713316229 +0000 UTC m=+2361.038038127"
Jul 13 16:02:55.609875 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:55.609842    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm"
Jul 13 16:02:55.614731 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:55.614706    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm"
Jul 13 16:02:55.695636 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:55.695615    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm"
Jul 13 16:02:55.696522 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:55.696504    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm"
Jul 13 16:02:56.679835 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:56.679801    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:02:56.756365 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:56.756332    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:02:56.761636 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:56.761606    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a1c3e5-9d79c54d4-d85rj"]
Jul 13 16:02:56.762219 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:56.762200    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0bd73ad-736e-464e-b367-c790e79233e1" containerName="istio-proxy"
Jul 13 16:02:56.762263 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:56.762225    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0bd73ad-736e-464e-b367-c790e79233e1" containerName="istio-proxy"
Jul 13 16:02:56.762342 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:56.762330    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0bd73ad-736e-464e-b367-c790e79233e1" containerName="istio-proxy"
Jul 13 16:02:56.765920 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:56.765898    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a1c3e5-9d79c54d4-d85rj"
Jul 13 16:02:56.768277 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:56.768249    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-a1c3e5-serving-cert\""
Jul 13 16:02:56.768413 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:56.768386    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kjwpb\""
Jul 13 16:02:56.773636 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:56.773615    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a1c3e5-9d79c54d4-d85rj"]
Jul 13 16:02:56.820428 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:56.820396    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:02:56.844430 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:56.844397    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1809bbda-5875-4778-a051-2d7b30ff7013-openshift-service-ca\") pod \"maas-api-e2e-shared-a-a1c3e5-9d79c54d4-d85rj\" (UID: \"1809bbda-5875-4778-a051-2d7b30ff7013\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a1c3e5-9d79c54d4-d85rj"
Jul 13 16:02:56.844621 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:56.844436    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rprzl\" (UniqueName: \"kubernetes.io/projected/1809bbda-5875-4778-a051-2d7b30ff7013-kube-api-access-rprzl\") pod \"maas-api-e2e-shared-a-a1c3e5-9d79c54d4-d85rj\" (UID: \"1809bbda-5875-4778-a051-2d7b30ff7013\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a1c3e5-9d79c54d4-d85rj"
Jul 13 16:02:56.844621 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:56.844569    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1809bbda-5875-4778-a051-2d7b30ff7013-maas-api-tls\") pod \"maas-api-e2e-shared-a-a1c3e5-9d79c54d4-d85rj\" (UID: \"1809bbda-5875-4778-a051-2d7b30ff7013\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a1c3e5-9d79c54d4-d85rj"
Jul 13 16:02:56.945201 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:56.945105    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1809bbda-5875-4778-a051-2d7b30ff7013-maas-api-tls\") pod \"maas-api-e2e-shared-a-a1c3e5-9d79c54d4-d85rj\" (UID: \"1809bbda-5875-4778-a051-2d7b30ff7013\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a1c3e5-9d79c54d4-d85rj"
Jul 13 16:02:56.945369 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:56.945272    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1809bbda-5875-4778-a051-2d7b30ff7013-openshift-service-ca\") pod \"maas-api-e2e-shared-a-a1c3e5-9d79c54d4-d85rj\" (UID: \"1809bbda-5875-4778-a051-2d7b30ff7013\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a1c3e5-9d79c54d4-d85rj"
Jul 13 16:02:56.945369 ip-10-0-137-93 kubenswrapper[2555]: E0713 16:02:56.945289    2555 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-a1c3e5-serving-cert: secret "maas-api-e2e-shared-a-a1c3e5-serving-cert" not found
Jul 13 16:02:56.945369 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:56.945306    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rprzl\" (UniqueName: \"kubernetes.io/projected/1809bbda-5875-4778-a051-2d7b30ff7013-kube-api-access-rprzl\") pod \"maas-api-e2e-shared-a-a1c3e5-9d79c54d4-d85rj\" (UID: \"1809bbda-5875-4778-a051-2d7b30ff7013\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a1c3e5-9d79c54d4-d85rj"
Jul 13 16:02:56.945369 ip-10-0-137-93 kubenswrapper[2555]: E0713 16:02:56.945351    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1809bbda-5875-4778-a051-2d7b30ff7013-maas-api-tls podName:1809bbda-5875-4778-a051-2d7b30ff7013 nodeName:}" failed. No retries permitted until 2026-07-13 16:02:57.445333282 +0000 UTC m=+2363.770055157 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1809bbda-5875-4778-a051-2d7b30ff7013-maas-api-tls") pod "maas-api-e2e-shared-a-a1c3e5-9d79c54d4-d85rj" (UID: "1809bbda-5875-4778-a051-2d7b30ff7013") : secret "maas-api-e2e-shared-a-a1c3e5-serving-cert" not found
Jul 13 16:02:56.945935 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:56.945916    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1809bbda-5875-4778-a051-2d7b30ff7013-openshift-service-ca\") pod \"maas-api-e2e-shared-a-a1c3e5-9d79c54d4-d85rj\" (UID: \"1809bbda-5875-4778-a051-2d7b30ff7013\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a1c3e5-9d79c54d4-d85rj"
Jul 13 16:02:56.968137 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:56.968104    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rprzl\" (UniqueName: \"kubernetes.io/projected/1809bbda-5875-4778-a051-2d7b30ff7013-kube-api-access-rprzl\") pod \"maas-api-e2e-shared-a-a1c3e5-9d79c54d4-d85rj\" (UID: \"1809bbda-5875-4778-a051-2d7b30ff7013\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a1c3e5-9d79c54d4-d85rj"
Jul 13 16:02:57.037793 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:57.037757    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:02:57.383172 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:57.383141    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:02:57.449934 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:57.449901    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1809bbda-5875-4778-a051-2d7b30ff7013-maas-api-tls\") pod \"maas-api-e2e-shared-a-a1c3e5-9d79c54d4-d85rj\" (UID: \"1809bbda-5875-4778-a051-2d7b30ff7013\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a1c3e5-9d79c54d4-d85rj"
Jul 13 16:02:57.452474 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:57.452448    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1809bbda-5875-4778-a051-2d7b30ff7013-maas-api-tls\") pod \"maas-api-e2e-shared-a-a1c3e5-9d79c54d4-d85rj\" (UID: \"1809bbda-5875-4778-a051-2d7b30ff7013\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a1c3e5-9d79c54d4-d85rj"
Jul 13 16:02:57.487116 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:57.487082    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:02:57.679732 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:57.679640    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a1c3e5-9d79c54d4-d85rj"
Jul 13 16:02:57.826271 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:57.826093    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a1c3e5-9d79c54d4-d85rj"]
Jul 13 16:02:57.828753 ip-10-0-137-93 kubenswrapper[2555]: W0713 16:02:57.828726    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1809bbda_5875_4778_a051_2d7b30ff7013.slice/crio-6ada1556e9dcbc0f2e03b21bec99ee6b915221fb4c04d664ee85a8b909ef0afe WatchSource:0}: Error finding container 6ada1556e9dcbc0f2e03b21bec99ee6b915221fb4c04d664ee85a8b909ef0afe: Status 404 returned error can't find the container with id 6ada1556e9dcbc0f2e03b21bec99ee6b915221fb4c04d664ee85a8b909ef0afe
Jul 13 16:02:58.713423 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:58.713340    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a1c3e5-9d79c54d4-d85rj" event={"ID":"1809bbda-5875-4778-a051-2d7b30ff7013","Type":"ContainerStarted","Data":"8b002e48ed618755e6fd871782c55b1362bc0efd083fa21e6bf94357de4afd17"}
Jul 13 16:02:58.713423 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:58.713391    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a1c3e5-9d79c54d4-d85rj" event={"ID":"1809bbda-5875-4778-a051-2d7b30ff7013","Type":"ContainerStarted","Data":"6ada1556e9dcbc0f2e03b21bec99ee6b915221fb4c04d664ee85a8b909ef0afe"}
Jul 13 16:02:58.713423 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:58.713422    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a1c3e5-9d79c54d4-d85rj"
Jul 13 16:02:58.734634 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:02:58.734561    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a1c3e5-9d79c54d4-d85rj" podStartSLOduration=2.313605899 podStartE2EDuration="2.734543725s" totalImagesPullingTime="420.937826ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:02:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:02:58.733433383 +0000 UTC m=+2365.058155283" watchObservedRunningTime="2026-07-13 16:02:58.734543725 +0000 UTC m=+2365.059265621"
Jul 13 16:03:01.201996 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:01.201961    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:03:01.541760 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:01.541683    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:03:01.837099 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:01.837009    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:03:02.937454 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:02.937415    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:03:04.488443 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:04.488406    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:03:04.576152 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:04.576114    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:03:04.580646 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:04.580615    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-4293a7-696fbc484c-ts5fn"]
Jul 13 16:03:04.586428 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:04.586407    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4293a7-696fbc484c-ts5fn"
Jul 13 16:03:04.589753 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:04.589731    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-4293a7-serving-cert\""
Jul 13 16:03:04.600325 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:04.600045    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-4293a7-696fbc484c-ts5fn"]
Jul 13 16:03:04.618055 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:04.618027    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d465036-a797-4d5c-a9e8-4ad99b6f6db4-maas-api-tls\") pod \"maas-api-e2e-shared-b-4293a7-696fbc484c-ts5fn\" (UID: \"7d465036-a797-4d5c-a9e8-4ad99b6f6db4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4293a7-696fbc484c-ts5fn"
Jul 13 16:03:04.618190 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:04.618145    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d465036-a797-4d5c-a9e8-4ad99b6f6db4-openshift-service-ca\") pod \"maas-api-e2e-shared-b-4293a7-696fbc484c-ts5fn\" (UID: \"7d465036-a797-4d5c-a9e8-4ad99b6f6db4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4293a7-696fbc484c-ts5fn"
Jul 13 16:03:04.618190 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:04.618179    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkhp9\" (UniqueName: \"kubernetes.io/projected/7d465036-a797-4d5c-a9e8-4ad99b6f6db4-kube-api-access-jkhp9\") pod \"maas-api-e2e-shared-b-4293a7-696fbc484c-ts5fn\" (UID: \"7d465036-a797-4d5c-a9e8-4ad99b6f6db4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4293a7-696fbc484c-ts5fn"
Jul 13 16:03:04.717377 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:04.717337    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:03:04.719558 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:04.719531    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d465036-a797-4d5c-a9e8-4ad99b6f6db4-openshift-service-ca\") pod \"maas-api-e2e-shared-b-4293a7-696fbc484c-ts5fn\" (UID: \"7d465036-a797-4d5c-a9e8-4ad99b6f6db4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4293a7-696fbc484c-ts5fn"
Jul 13 16:03:04.719713 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:04.719560    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkhp9\" (UniqueName: \"kubernetes.io/projected/7d465036-a797-4d5c-a9e8-4ad99b6f6db4-kube-api-access-jkhp9\") pod \"maas-api-e2e-shared-b-4293a7-696fbc484c-ts5fn\" (UID: \"7d465036-a797-4d5c-a9e8-4ad99b6f6db4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4293a7-696fbc484c-ts5fn"
Jul 13 16:03:04.719713 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:04.719705    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d465036-a797-4d5c-a9e8-4ad99b6f6db4-maas-api-tls\") pod \"maas-api-e2e-shared-b-4293a7-696fbc484c-ts5fn\" (UID: \"7d465036-a797-4d5c-a9e8-4ad99b6f6db4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4293a7-696fbc484c-ts5fn"
Jul 13 16:03:04.719833 ip-10-0-137-93 kubenswrapper[2555]: E0713 16:03:04.719789    2555 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-4293a7-serving-cert: secret "maas-api-e2e-shared-b-4293a7-serving-cert" not found
Jul 13 16:03:04.719888 ip-10-0-137-93 kubenswrapper[2555]: E0713 16:03:04.719861    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d465036-a797-4d5c-a9e8-4ad99b6f6db4-maas-api-tls podName:7d465036-a797-4d5c-a9e8-4ad99b6f6db4 nodeName:}" failed. No retries permitted until 2026-07-13 16:03:05.219839846 +0000 UTC m=+2371.544561728 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7d465036-a797-4d5c-a9e8-4ad99b6f6db4-maas-api-tls") pod "maas-api-e2e-shared-b-4293a7-696fbc484c-ts5fn" (UID: "7d465036-a797-4d5c-a9e8-4ad99b6f6db4") : secret "maas-api-e2e-shared-b-4293a7-serving-cert" not found
Jul 13 16:03:04.720320 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:04.720300    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d465036-a797-4d5c-a9e8-4ad99b6f6db4-openshift-service-ca\") pod \"maas-api-e2e-shared-b-4293a7-696fbc484c-ts5fn\" (UID: \"7d465036-a797-4d5c-a9e8-4ad99b6f6db4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4293a7-696fbc484c-ts5fn"
Jul 13 16:03:04.724386 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:04.724365    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a1c3e5-9d79c54d4-d85rj"
Jul 13 16:03:04.745247 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:04.745180    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkhp9\" (UniqueName: \"kubernetes.io/projected/7d465036-a797-4d5c-a9e8-4ad99b6f6db4-kube-api-access-jkhp9\") pod \"maas-api-e2e-shared-b-4293a7-696fbc484c-ts5fn\" (UID: \"7d465036-a797-4d5c-a9e8-4ad99b6f6db4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4293a7-696fbc484c-ts5fn"
Jul 13 16:03:05.016041 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:05.015957    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:03:05.225564 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:05.225529    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d465036-a797-4d5c-a9e8-4ad99b6f6db4-maas-api-tls\") pod \"maas-api-e2e-shared-b-4293a7-696fbc484c-ts5fn\" (UID: \"7d465036-a797-4d5c-a9e8-4ad99b6f6db4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4293a7-696fbc484c-ts5fn"
Jul 13 16:03:05.228091 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:05.228068    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d465036-a797-4d5c-a9e8-4ad99b6f6db4-maas-api-tls\") pod \"maas-api-e2e-shared-b-4293a7-696fbc484c-ts5fn\" (UID: \"7d465036-a797-4d5c-a9e8-4ad99b6f6db4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4293a7-696fbc484c-ts5fn"
Jul 13 16:03:05.287986 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:05.287887    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:03:05.386839 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:05.386790    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:03:05.510622 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:05.510594    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4293a7-696fbc484c-ts5fn"
Jul 13 16:03:05.696847 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:05.696323    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-4293a7-696fbc484c-ts5fn"]
Jul 13 16:03:05.748114 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:05.748081    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4293a7-696fbc484c-ts5fn" event={"ID":"7d465036-a797-4d5c-a9e8-4ad99b6f6db4","Type":"ContainerStarted","Data":"44f86917a686d139753630a941286e61545734449ead2254f5abd53f235ecc9c"}
Jul 13 16:03:06.754913 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:06.754882    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4293a7-696fbc484c-ts5fn" event={"ID":"7d465036-a797-4d5c-a9e8-4ad99b6f6db4","Type":"ContainerStarted","Data":"b879a8a2c056e384b4d54461e45ee7eb051c06ae815c7927b70749bb33740b0a"}
Jul 13 16:03:06.755286 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:06.755006    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4293a7-696fbc484c-ts5fn"
Jul 13 16:03:06.774638 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:06.774568    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4293a7-696fbc484c-ts5fn" podStartSLOduration=2.245238452 podStartE2EDuration="2.774548538s" totalImagesPullingTime="529.310086ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:03:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:03:06.77237407 +0000 UTC m=+2373.097095967" watchObservedRunningTime="2026-07-13 16:03:06.774548538 +0000 UTC m=+2373.099270434"
Jul 13 16:03:09.106451 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:09.106421    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:03:09.771955 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:09.771918    2555 generic.go:356] "Generic (PLEG): container finished" podID="e59e70b7-445e-486e-9ee4-53c68d07e32c" containerID="cbdb1d2406ec07e149ab7bb9848e4ba0aed8bf6c8b3f2d3062975846bb219684" exitCode=0
Jul 13 16:03:09.772153 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:09.771993    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm" event={"ID":"e59e70b7-445e-486e-9ee4-53c68d07e32c","Type":"ContainerDied","Data":"cbdb1d2406ec07e149ab7bb9848e4ba0aed8bf6c8b3f2d3062975846bb219684"}
Jul 13 16:03:09.772420 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:09.772403    2555 scope.go:117] "RemoveContainer" containerID="cbdb1d2406ec07e149ab7bb9848e4ba0aed8bf6c8b3f2d3062975846bb219684"
Jul 13 16:03:09.773370 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:09.773344    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 16:03:09.773459 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:09.773405    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 16:03:09.773459 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:09.773436    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 16:03:10.696641 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:10.696599    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm"
Jul 13 16:03:10.781606 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:10.781545    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm" event={"ID":"e59e70b7-445e-486e-9ee4-53c68d07e32c","Type":"ContainerStarted","Data":"fe44e9901d473fb701d85f0ee42a665ed070e5bf2ae640df80b77d5418e87875"}
Jul 13 16:03:11.609692 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:11.609655    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm"
Jul 13 16:03:11.610931 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:11.610907    2555 patch_prober.go:28] interesting pod/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 13 16:03:11.611032 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:11.610966    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm" podUID="e59e70b7-445e-486e-9ee4-53c68d07e32c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 13 16:03:12.609497 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:12.609458    2555 patch_prober.go:28] interesting pod/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 13 16:03:12.609936 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:12.609513    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm" podUID="e59e70b7-445e-486e-9ee4-53c68d07e32c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 13 16:03:12.773919 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:12.773882    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4293a7-696fbc484c-ts5fn"
Jul 13 16:03:13.609814 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:13.609774    2555 patch_prober.go:28] interesting pod/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 13 16:03:13.610234 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:13.609836    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm" podUID="e59e70b7-445e-486e-9ee4-53c68d07e32c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 13 16:03:14.610022 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:14.609977    2555 patch_prober.go:28] interesting pod/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 13 16:03:14.610490 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:14.610041    2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm" podUID="e59e70b7-445e-486e-9ee4-53c68d07e32c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 13 16:03:15.613453 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:15.613419    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm"
Jul 13 16:03:15.613955 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:15.613832    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm"
Jul 13 16:03:15.614493 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:15.614477    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm"
Jul 13 16:03:18.128610 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:18.128568    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:03:18.231540 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:18.231490    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:03:26.060310 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:26.060253    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:03:26.160310 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:26.160278    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:03:34.333966 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:34.333935    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cptrx_90f53326-a36e-4682-a268-bdfec7cf722b/console-operator/1.log"
Jul 13 16:03:34.341850 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:34.341826    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x8g52_f4724159-d88b-4ed1-a5fc-956a4d1e3fe8/ovn-acl-logging/0.log"
Jul 13 16:03:34.342951 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:34.342928    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cptrx_90f53326-a36e-4682-a268-bdfec7cf722b/console-operator/1.log"
Jul 13 16:03:34.349748 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:34.349732    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x8g52_f4724159-d88b-4ed1-a5fc-956a4d1e3fe8/ovn-acl-logging/0.log"
Jul 13 16:03:34.486657 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:34.486627    2555 scope.go:117] "RemoveContainer" containerID="0606b0899d1cbdf8521850b90f051a01c609bbb42c4e5658adb9b8328c4190fd"
Jul 13 16:03:36.234858 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:36.234810    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:03:40.624569 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:40.624510    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:03:40.677720 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:03:40.677678    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:04:10.462026 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:04:10.461991    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:04:15.054404 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:04:15.054373    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:05:55.378086 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:05:55.377997    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:06:09.281141 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:06:09.281103    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:06:11.604683 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:06:11.604647    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:06:12.546713 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:06:12.546679    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:06:27.858611 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:06:27.858553    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:06:50.576802 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:06:50.576772    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:07:28.170899 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:07:28.170862    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:07:29.252276 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:07:29.252241    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:07:40.690459 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:07:40.690425    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:07:47.235570 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:07:47.235526    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:07:47.332571 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:07:47.332538    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:07:59.593567 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:07:59.593535    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:08:18.977748 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:08:18.977709    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:08:19.079574 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:08:19.079540    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:08:26.904053 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:08:26.903968    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:08:27.004282 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:08:27.004245    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:08:34.364735 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:08:34.364708    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cptrx_90f53326-a36e-4682-a268-bdfec7cf722b/console-operator/1.log"
Jul 13 16:08:34.372641 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:08:34.372612    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x8g52_f4724159-d88b-4ed1-a5fc-956a4d1e3fe8/ovn-acl-logging/0.log"
Jul 13 16:08:34.373040 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:08:34.373022    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cptrx_90f53326-a36e-4682-a268-bdfec7cf722b/console-operator/1.log"
Jul 13 16:08:34.381534 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:08:34.381512    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x8g52_f4724159-d88b-4ed1-a5fc-956a4d1e3fe8/ovn-acl-logging/0.log"
Jul 13 16:08:58.797935 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:08:58.797893    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:08:59.810106 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:08:59.810072    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:09:00.677507 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:00.677472    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7712-139938562132784"]
Jul 13 16:09:00.680989 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:00.680973    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7712-139938562132784"
Jul 13 16:09:00.683647 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:00.683627    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-9j5ph\""
Jul 13 16:09:00.687901 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:00.687876    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7712-139938562132784"]
Jul 13 16:09:00.773274 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:00.773239    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhmdr\" (UniqueName: \"kubernetes.io/projected/1f65b6c0-e15e-49e9-b06e-90de340c90ad-kube-api-access-rhmdr\") pod \"test-curl-7712-139938562132784\" (UID: \"1f65b6c0-e15e-49e9-b06e-90de340c90ad\") " pod="openshift-ingress/test-curl-7712-139938562132784"
Jul 13 16:09:00.874518 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:00.874482    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhmdr\" (UniqueName: \"kubernetes.io/projected/1f65b6c0-e15e-49e9-b06e-90de340c90ad-kube-api-access-rhmdr\") pod \"test-curl-7712-139938562132784\" (UID: \"1f65b6c0-e15e-49e9-b06e-90de340c90ad\") " pod="openshift-ingress/test-curl-7712-139938562132784"
Jul 13 16:09:00.884261 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:00.884233    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhmdr\" (UniqueName: \"kubernetes.io/projected/1f65b6c0-e15e-49e9-b06e-90de340c90ad-kube-api-access-rhmdr\") pod \"test-curl-7712-139938562132784\" (UID: \"1f65b6c0-e15e-49e9-b06e-90de340c90ad\") " pod="openshift-ingress/test-curl-7712-139938562132784"
Jul 13 16:09:00.990972 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:00.990942    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7712-139938562132784"
Jul 13 16:09:01.127101 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:01.127075    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7712-139938562132784"]
Jul 13 16:09:01.128808 ip-10-0-137-93 kubenswrapper[2555]: W0713 16:09:01.128774    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1f65b6c0_e15e_49e9_b06e_90de340c90ad.slice/crio-23853f5d09316ec2454c7db528e54be32d0deacc601eb72081edb81c93e00c62 WatchSource:0}: Error finding container 23853f5d09316ec2454c7db528e54be32d0deacc601eb72081edb81c93e00c62: Status 404 returned error can't find the container with id 23853f5d09316ec2454c7db528e54be32d0deacc601eb72081edb81c93e00c62
Jul 13 16:09:01.129984 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:01.129966    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 16:09:01.486897 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:01.486849    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7712-139938562132784" event={"ID":"1f65b6c0-e15e-49e9-b06e-90de340c90ad","Type":"ContainerStarted","Data":"23853f5d09316ec2454c7db528e54be32d0deacc601eb72081edb81c93e00c62"}
Jul 13 16:09:02.493416 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:02.493383    2555 generic.go:356] "Generic (PLEG): container finished" podID="1f65b6c0-e15e-49e9-b06e-90de340c90ad" containerID="6549073c1353a0916f7c03355635dd2ec5303274a0589d4b81f15eda0e1b6819" exitCode=0
Jul 13 16:09:02.493861 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:02.493457    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7712-139938562132784" event={"ID":"1f65b6c0-e15e-49e9-b06e-90de340c90ad","Type":"ContainerDied","Data":"6549073c1353a0916f7c03355635dd2ec5303274a0589d4b81f15eda0e1b6819"}
Jul 13 16:09:03.647376 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:03.647350    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7712-139938562132784"
Jul 13 16:09:03.668384 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:03.668355    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7712-139938562132784_1f65b6c0-e15e-49e9-b06e-90de340c90ad/test-curl-7712-139938562132784/0.log"
Jul 13 16:09:03.692934 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:03.692898    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7712-139938562132784"]
Jul 13 16:09:03.694944 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:03.694924    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7712-139938562132784"]
Jul 13 16:09:03.800499 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:03.800408    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhmdr\" (UniqueName: \"kubernetes.io/projected/1f65b6c0-e15e-49e9-b06e-90de340c90ad-kube-api-access-rhmdr\") pod \"1f65b6c0-e15e-49e9-b06e-90de340c90ad\" (UID: \"1f65b6c0-e15e-49e9-b06e-90de340c90ad\") "
Jul 13 16:09:03.802480 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:03.802450    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f65b6c0-e15e-49e9-b06e-90de340c90ad-kube-api-access-rhmdr" (OuterVolumeSpecName: "kube-api-access-rhmdr") pod "1f65b6c0-e15e-49e9-b06e-90de340c90ad" (UID: "1f65b6c0-e15e-49e9-b06e-90de340c90ad"). InnerVolumeSpecName "kube-api-access-rhmdr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:09:03.820011 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:03.819983    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7712-139938564999600"]
Jul 13 16:09:03.820380 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:03.820367    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f65b6c0-e15e-49e9-b06e-90de340c90ad" containerName="test-curl-7712-139938562132784"
Jul 13 16:09:03.820425 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:03.820382    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f65b6c0-e15e-49e9-b06e-90de340c90ad" containerName="test-curl-7712-139938562132784"
Jul 13 16:09:03.820463 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:03.820456    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f65b6c0-e15e-49e9-b06e-90de340c90ad" containerName="test-curl-7712-139938562132784"
Jul 13 16:09:03.823418 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:03.823402    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7712-139938564999600"
Jul 13 16:09:03.829082 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:03.829054    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7712-139938564999600"]
Jul 13 16:09:03.901197 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:03.901164    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sls2j\" (UniqueName: \"kubernetes.io/projected/6a7f2274-6dc9-45d4-ae65-117368f573a9-kube-api-access-sls2j\") pod \"test-curl-7712-139938564999600\" (UID: \"6a7f2274-6dc9-45d4-ae65-117368f573a9\") " pod="openshift-ingress/test-curl-7712-139938564999600"
Jul 13 16:09:03.901359 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:03.901244    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhmdr\" (UniqueName: \"kubernetes.io/projected/1f65b6c0-e15e-49e9-b06e-90de340c90ad-kube-api-access-rhmdr\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:09:04.002558 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:04.002502    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sls2j\" (UniqueName: \"kubernetes.io/projected/6a7f2274-6dc9-45d4-ae65-117368f573a9-kube-api-access-sls2j\") pod \"test-curl-7712-139938564999600\" (UID: \"6a7f2274-6dc9-45d4-ae65-117368f573a9\") " pod="openshift-ingress/test-curl-7712-139938564999600"
Jul 13 16:09:04.010396 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:04.010371    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sls2j\" (UniqueName: \"kubernetes.io/projected/6a7f2274-6dc9-45d4-ae65-117368f573a9-kube-api-access-sls2j\") pod \"test-curl-7712-139938564999600\" (UID: \"6a7f2274-6dc9-45d4-ae65-117368f573a9\") " pod="openshift-ingress/test-curl-7712-139938564999600"
Jul 13 16:09:04.138983 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:04.138891    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7712-139938564999600"
Jul 13 16:09:04.208338 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:04.208307    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f65b6c0-e15e-49e9-b06e-90de340c90ad" path="/var/lib/kubelet/pods/1f65b6c0-e15e-49e9-b06e-90de340c90ad/volumes"
Jul 13 16:09:04.282363 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:04.282338    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7712-139938564999600"]
Jul 13 16:09:04.284365 ip-10-0-137-93 kubenswrapper[2555]: W0713 16:09:04.284337    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a7f2274_6dc9_45d4_ae65_117368f573a9.slice/crio-3dcb2abb8468e28af4f4498ed6a2f716e66cc307ca01ea60ab0941db7a807197 WatchSource:0}: Error finding container 3dcb2abb8468e28af4f4498ed6a2f716e66cc307ca01ea60ab0941db7a807197: Status 404 returned error can't find the container with id 3dcb2abb8468e28af4f4498ed6a2f716e66cc307ca01ea60ab0941db7a807197
Jul 13 16:09:04.506134 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:04.506100    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7712-139938562132784"
Jul 13 16:09:04.507010 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:04.506123    2555 scope.go:117] "RemoveContainer" containerID="6549073c1353a0916f7c03355635dd2ec5303274a0589d4b81f15eda0e1b6819"
Jul 13 16:09:04.507362 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:04.507334    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7712-139938564999600" event={"ID":"6a7f2274-6dc9-45d4-ae65-117368f573a9","Type":"ContainerStarted","Data":"3dcb2abb8468e28af4f4498ed6a2f716e66cc307ca01ea60ab0941db7a807197"}
Jul 13 16:09:05.514674 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:05.514638    2555 generic.go:356] "Generic (PLEG): container finished" podID="6a7f2274-6dc9-45d4-ae65-117368f573a9" containerID="738bbb314fa3aada96087e0f82433f8c3dd155a3cd22959f58b2bbe99211aa32" exitCode=0
Jul 13 16:09:05.515138 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:05.514717    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7712-139938564999600" event={"ID":"6a7f2274-6dc9-45d4-ae65-117368f573a9","Type":"ContainerDied","Data":"738bbb314fa3aada96087e0f82433f8c3dd155a3cd22959f58b2bbe99211aa32"}
Jul 13 16:09:06.676139 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:06.676109    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7712-139938564999600"
Jul 13 16:09:06.697117 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:06.697091    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7712-139938564999600_6a7f2274-6dc9-45d4-ae65-117368f573a9/test-curl-7712-139938564999600/0.log"
Jul 13 16:09:06.723701 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:06.723664    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7712-139938564999600"]
Jul 13 16:09:06.726744 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:06.726714    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7712-139938564999600"]
Jul 13 16:09:06.830310 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:06.830203    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sls2j\" (UniqueName: \"kubernetes.io/projected/6a7f2274-6dc9-45d4-ae65-117368f573a9-kube-api-access-sls2j\") pod \"6a7f2274-6dc9-45d4-ae65-117368f573a9\" (UID: \"6a7f2274-6dc9-45d4-ae65-117368f573a9\") "
Jul 13 16:09:06.832395 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:06.832373    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a7f2274-6dc9-45d4-ae65-117368f573a9-kube-api-access-sls2j" (OuterVolumeSpecName: "kube-api-access-sls2j") pod "6a7f2274-6dc9-45d4-ae65-117368f573a9" (UID: "6a7f2274-6dc9-45d4-ae65-117368f573a9"). InnerVolumeSpecName "kube-api-access-sls2j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:09:06.931190 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:06.931143    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sls2j\" (UniqueName: \"kubernetes.io/projected/6a7f2274-6dc9-45d4-ae65-117368f573a9-kube-api-access-sls2j\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:09:07.526691 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:07.526664    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3dcb2abb8468e28af4f4498ed6a2f716e66cc307ca01ea60ab0941db7a807197"
Jul 13 16:09:07.526691 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:07.526674    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7712-139938564999600"
Jul 13 16:09:07.536280 ip-10-0-137-93 kubenswrapper[2555]: E0713 16:09:07.536253    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7712-139938564999600\" is forbidden: User \"system:node:ip-10-0-137-93.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-137-93.ec2.internal' and this object" podUID="6a7f2274-6dc9-45d4-ae65-117368f573a9" pod="openshift-ingress/test-curl-7712-139938564999600"
Jul 13 16:09:08.203429 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:08.203389    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a7f2274-6dc9-45d4-ae65-117368f573a9" path="/var/lib/kubelet/pods/6a7f2274-6dc9-45d4-ae65-117368f573a9/volumes"
Jul 13 16:09:12.780382 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:12.780344    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:09:12.838768 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:12.838737    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:09:13.268062 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:13.268010    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7712-139938564457504"]
Jul 13 16:09:13.268439 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:13.268426    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a7f2274-6dc9-45d4-ae65-117368f573a9" containerName="test-curl-7712-139938564999600"
Jul 13 16:09:13.268504 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:13.268440    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a7f2274-6dc9-45d4-ae65-117368f573a9" containerName="test-curl-7712-139938564999600"
Jul 13 16:09:13.268544 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:13.268513    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a7f2274-6dc9-45d4-ae65-117368f573a9" containerName="test-curl-7712-139938564999600"
Jul 13 16:09:13.271894 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:13.271872    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7712-139938564457504"
Jul 13 16:09:13.274117 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:13.274094    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-9j5ph\""
Jul 13 16:09:13.277313 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:13.277285    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7712-139938564457504"]
Jul 13 16:09:13.392532 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:13.392499    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jc48d\" (UniqueName: \"kubernetes.io/projected/542d5daa-36a0-42af-a6c0-99916dcec9d2-kube-api-access-jc48d\") pod \"test-curl-7712-139938564457504\" (UID: \"542d5daa-36a0-42af-a6c0-99916dcec9d2\") " pod="openshift-ingress/test-curl-7712-139938564457504"
Jul 13 16:09:13.493261 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:13.493220    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jc48d\" (UniqueName: \"kubernetes.io/projected/542d5daa-36a0-42af-a6c0-99916dcec9d2-kube-api-access-jc48d\") pod \"test-curl-7712-139938564457504\" (UID: \"542d5daa-36a0-42af-a6c0-99916dcec9d2\") " pod="openshift-ingress/test-curl-7712-139938564457504"
Jul 13 16:09:13.501578 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:13.501549    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jc48d\" (UniqueName: \"kubernetes.io/projected/542d5daa-36a0-42af-a6c0-99916dcec9d2-kube-api-access-jc48d\") pod \"test-curl-7712-139938564457504\" (UID: \"542d5daa-36a0-42af-a6c0-99916dcec9d2\") " pod="openshift-ingress/test-curl-7712-139938564457504"
Jul 13 16:09:13.582048 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:13.581958    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7712-139938564457504"
Jul 13 16:09:13.723291 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:13.723266    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7712-139938564457504"]
Jul 13 16:09:13.725558 ip-10-0-137-93 kubenswrapper[2555]: W0713 16:09:13.725531    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod542d5daa_36a0_42af_a6c0_99916dcec9d2.slice/crio-6eef20f45a022cabb139e292058ef85737d03cdaed2919877c2918e0df6e6fa7 WatchSource:0}: Error finding container 6eef20f45a022cabb139e292058ef85737d03cdaed2919877c2918e0df6e6fa7: Status 404 returned error can't find the container with id 6eef20f45a022cabb139e292058ef85737d03cdaed2919877c2918e0df6e6fa7
Jul 13 16:09:14.561962 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:14.561928    2555 generic.go:356] "Generic (PLEG): container finished" podID="542d5daa-36a0-42af-a6c0-99916dcec9d2" containerID="0b1160b5c17c96608f3b2e3d9501b86ca1a16b1c63ba2a21415403cc92fa6fae" exitCode=0
Jul 13 16:09:14.562359 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:14.561979    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7712-139938564457504" event={"ID":"542d5daa-36a0-42af-a6c0-99916dcec9d2","Type":"ContainerDied","Data":"0b1160b5c17c96608f3b2e3d9501b86ca1a16b1c63ba2a21415403cc92fa6fae"}
Jul 13 16:09:14.562359 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:14.562007    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7712-139938564457504" event={"ID":"542d5daa-36a0-42af-a6c0-99916dcec9d2","Type":"ContainerStarted","Data":"6eef20f45a022cabb139e292058ef85737d03cdaed2919877c2918e0df6e6fa7"}
Jul 13 16:09:15.713721 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:15.713698    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7712-139938564457504"
Jul 13 16:09:15.737186 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:15.737158    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7712-139938564457504_542d5daa-36a0-42af-a6c0-99916dcec9d2/test-curl-7712-139938564457504/0.log"
Jul 13 16:09:15.764749 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:15.764719    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7712-139938564457504"]
Jul 13 16:09:15.768863 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:15.768820    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7712-139938564457504"]
Jul 13 16:09:15.813655 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:15.813629    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jc48d\" (UniqueName: \"kubernetes.io/projected/542d5daa-36a0-42af-a6c0-99916dcec9d2-kube-api-access-jc48d\") pod \"542d5daa-36a0-42af-a6c0-99916dcec9d2\" (UID: \"542d5daa-36a0-42af-a6c0-99916dcec9d2\") "
Jul 13 16:09:15.815672 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:15.815648    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/542d5daa-36a0-42af-a6c0-99916dcec9d2-kube-api-access-jc48d" (OuterVolumeSpecName: "kube-api-access-jc48d") pod "542d5daa-36a0-42af-a6c0-99916dcec9d2" (UID: "542d5daa-36a0-42af-a6c0-99916dcec9d2"). InnerVolumeSpecName "kube-api-access-jc48d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:09:15.914339 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:15.914305    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jc48d\" (UniqueName: \"kubernetes.io/projected/542d5daa-36a0-42af-a6c0-99916dcec9d2-kube-api-access-jc48d\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:09:16.203225 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:16.203134    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="542d5daa-36a0-42af-a6c0-99916dcec9d2" path="/var/lib/kubelet/pods/542d5daa-36a0-42af-a6c0-99916dcec9d2/volumes"
Jul 13 16:09:16.573563 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:16.573537    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7712-139938564457504"
Jul 13 16:09:16.573563 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:16.573555    2555 scope.go:117] "RemoveContainer" containerID="0b1160b5c17c96608f3b2e3d9501b86ca1a16b1c63ba2a21415403cc92fa6fae"
Jul 13 16:09:18.861646 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:18.861578    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:09:18.961812 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:18.961779    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:09:28.794556 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:28.794493    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a1c3e5-9d79c54d4-d85rj"]
Jul 13 16:09:28.795040 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:28.794777    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a1c3e5-9d79c54d4-d85rj" podUID="1809bbda-5875-4778-a051-2d7b30ff7013" containerName="maas-api" containerID="cri-o://8b002e48ed618755e6fd871782c55b1362bc0efd083fa21e6bf94357de4afd17" gracePeriod=30
Jul 13 16:09:28.817598 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:28.817551    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:09:29.057249 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:29.057193    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a1c3e5-9d79c54d4-d85rj"
Jul 13 16:09:29.122391 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:29.122356    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1809bbda-5875-4778-a051-2d7b30ff7013-openshift-service-ca\") pod \"1809bbda-5875-4778-a051-2d7b30ff7013\" (UID: \"1809bbda-5875-4778-a051-2d7b30ff7013\") "
Jul 13 16:09:29.122559 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:29.122411    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1809bbda-5875-4778-a051-2d7b30ff7013-maas-api-tls\") pod \"1809bbda-5875-4778-a051-2d7b30ff7013\" (UID: \"1809bbda-5875-4778-a051-2d7b30ff7013\") "
Jul 13 16:09:29.122559 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:29.122469    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rprzl\" (UniqueName: \"kubernetes.io/projected/1809bbda-5875-4778-a051-2d7b30ff7013-kube-api-access-rprzl\") pod \"1809bbda-5875-4778-a051-2d7b30ff7013\" (UID: \"1809bbda-5875-4778-a051-2d7b30ff7013\") "
Jul 13 16:09:29.122839 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:29.122813    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1809bbda-5875-4778-a051-2d7b30ff7013-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1809bbda-5875-4778-a051-2d7b30ff7013" (UID: "1809bbda-5875-4778-a051-2d7b30ff7013"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 16:09:29.124682 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:29.124653    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1809bbda-5875-4778-a051-2d7b30ff7013-kube-api-access-rprzl" (OuterVolumeSpecName: "kube-api-access-rprzl") pod "1809bbda-5875-4778-a051-2d7b30ff7013" (UID: "1809bbda-5875-4778-a051-2d7b30ff7013"). InnerVolumeSpecName "kube-api-access-rprzl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:09:29.124767 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:29.124698    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1809bbda-5875-4778-a051-2d7b30ff7013-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1809bbda-5875-4778-a051-2d7b30ff7013" (UID: "1809bbda-5875-4778-a051-2d7b30ff7013"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 16:09:29.223728 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:29.223685    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rprzl\" (UniqueName: \"kubernetes.io/projected/1809bbda-5875-4778-a051-2d7b30ff7013-kube-api-access-rprzl\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:09:29.223728 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:29.223720    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1809bbda-5875-4778-a051-2d7b30ff7013-openshift-service-ca\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:09:29.223728 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:29.223732    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1809bbda-5875-4778-a051-2d7b30ff7013-maas-api-tls\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:09:29.643958 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:29.643916    2555 generic.go:356] "Generic (PLEG): container finished" podID="1809bbda-5875-4778-a051-2d7b30ff7013" containerID="8b002e48ed618755e6fd871782c55b1362bc0efd083fa21e6bf94357de4afd17" exitCode=0
Jul 13 16:09:29.643958 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:29.643965    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a1c3e5-9d79c54d4-d85rj"
Jul 13 16:09:29.644263 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:29.644010    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a1c3e5-9d79c54d4-d85rj" event={"ID":"1809bbda-5875-4778-a051-2d7b30ff7013","Type":"ContainerDied","Data":"8b002e48ed618755e6fd871782c55b1362bc0efd083fa21e6bf94357de4afd17"}
Jul 13 16:09:29.644263 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:29.644116    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a1c3e5-9d79c54d4-d85rj" event={"ID":"1809bbda-5875-4778-a051-2d7b30ff7013","Type":"ContainerDied","Data":"6ada1556e9dcbc0f2e03b21bec99ee6b915221fb4c04d664ee85a8b909ef0afe"}
Jul 13 16:09:29.644263 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:29.644151    2555 scope.go:117] "RemoveContainer" containerID="8b002e48ed618755e6fd871782c55b1362bc0efd083fa21e6bf94357de4afd17"
Jul 13 16:09:29.656135 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:29.656115    2555 scope.go:117] "RemoveContainer" containerID="8b002e48ed618755e6fd871782c55b1362bc0efd083fa21e6bf94357de4afd17"
Jul 13 16:09:29.656440 ip-10-0-137-93 kubenswrapper[2555]: E0713 16:09:29.656421    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b002e48ed618755e6fd871782c55b1362bc0efd083fa21e6bf94357de4afd17\": container with ID starting with 8b002e48ed618755e6fd871782c55b1362bc0efd083fa21e6bf94357de4afd17 not found: ID does not exist" containerID="8b002e48ed618755e6fd871782c55b1362bc0efd083fa21e6bf94357de4afd17"
Jul 13 16:09:29.656528 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:29.656451    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b002e48ed618755e6fd871782c55b1362bc0efd083fa21e6bf94357de4afd17"} err="failed to get container status \"8b002e48ed618755e6fd871782c55b1362bc0efd083fa21e6bf94357de4afd17\": rpc error: code = NotFound desc = could not find container \"8b002e48ed618755e6fd871782c55b1362bc0efd083fa21e6bf94357de4afd17\": container with ID starting with 8b002e48ed618755e6fd871782c55b1362bc0efd083fa21e6bf94357de4afd17 not found: ID does not exist"
Jul 13 16:09:29.669175 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:29.669140    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a1c3e5-9d79c54d4-d85rj"]
Jul 13 16:09:29.675209 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:29.675180    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a1c3e5-9d79c54d4-d85rj"]
Jul 13 16:09:30.203476 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:30.203446    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1809bbda-5875-4778-a051-2d7b30ff7013" path="/var/lib/kubelet/pods/1809bbda-5875-4778-a051-2d7b30ff7013/volumes"
Jul 13 16:09:33.458945 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:33.458910    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:09:40.142869 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:40.142833    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:09:40.243202 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:40.243149    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:09:44.151892 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:44.151847    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm"]
Jul 13 16:09:44.152308 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:44.152134    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm" podUID="e59e70b7-445e-486e-9ee4-53c68d07e32c" containerName="istio-proxy" containerID="cri-o://fe44e9901d473fb701d85f0ee42a665ed070e5bf2ae640df80b77d5418e87875" gracePeriod=30
Jul 13 16:09:44.166483 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:44.166454    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:09:44.386216 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:44.386178    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:09:45.001270 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:45.001236    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:09:45.103054 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:45.103011    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:09:45.616131 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:45.616094    2555 patch_prober.go:28] interesting pod/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 13 16:09:45.616554 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:45.616201    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm" podUID="e59e70b7-445e-486e-9ee4-53c68d07e32c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 16:09:49.418722 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:49.418656    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm"
Jul 13 16:09:49.510346 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:49.510311    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e59e70b7-445e-486e-9ee4-53c68d07e32c-credential-socket\") pod \"e59e70b7-445e-486e-9ee4-53c68d07e32c\" (UID: \"e59e70b7-445e-486e-9ee4-53c68d07e32c\") "
Jul 13 16:09:49.510547 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:49.510377    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e59e70b7-445e-486e-9ee4-53c68d07e32c-istio-podinfo\") pod \"e59e70b7-445e-486e-9ee4-53c68d07e32c\" (UID: \"e59e70b7-445e-486e-9ee4-53c68d07e32c\") "
Jul 13 16:09:49.510547 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:49.510420    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e59e70b7-445e-486e-9ee4-53c68d07e32c-workload-socket\") pod \"e59e70b7-445e-486e-9ee4-53c68d07e32c\" (UID: \"e59e70b7-445e-486e-9ee4-53c68d07e32c\") "
Jul 13 16:09:49.510547 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:49.510458    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fll8c\" (UniqueName: \"kubernetes.io/projected/e59e70b7-445e-486e-9ee4-53c68d07e32c-kube-api-access-fll8c\") pod \"e59e70b7-445e-486e-9ee4-53c68d07e32c\" (UID: \"e59e70b7-445e-486e-9ee4-53c68d07e32c\") "
Jul 13 16:09:49.510547 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:49.510480    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e59e70b7-445e-486e-9ee4-53c68d07e32c-workload-certs\") pod \"e59e70b7-445e-486e-9ee4-53c68d07e32c\" (UID: \"e59e70b7-445e-486e-9ee4-53c68d07e32c\") "
Jul 13 16:09:49.510547 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:49.510502    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e59e70b7-445e-486e-9ee4-53c68d07e32c-istio-token\") pod \"e59e70b7-445e-486e-9ee4-53c68d07e32c\" (UID: \"e59e70b7-445e-486e-9ee4-53c68d07e32c\") "
Jul 13 16:09:49.510547 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:49.510523    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e59e70b7-445e-486e-9ee4-53c68d07e32c-istio-data\") pod \"e59e70b7-445e-486e-9ee4-53c68d07e32c\" (UID: \"e59e70b7-445e-486e-9ee4-53c68d07e32c\") "
Jul 13 16:09:49.510881 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:49.510575    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e59e70b7-445e-486e-9ee4-53c68d07e32c-istiod-ca-cert\") pod \"e59e70b7-445e-486e-9ee4-53c68d07e32c\" (UID: \"e59e70b7-445e-486e-9ee4-53c68d07e32c\") "
Jul 13 16:09:49.510881 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:49.510634    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e59e70b7-445e-486e-9ee4-53c68d07e32c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e59e70b7-445e-486e-9ee4-53c68d07e32c" (UID: "e59e70b7-445e-486e-9ee4-53c68d07e32c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:09:49.510881 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:49.510721    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e59e70b7-445e-486e-9ee4-53c68d07e32c-istio-envoy\") pod \"e59e70b7-445e-486e-9ee4-53c68d07e32c\" (UID: \"e59e70b7-445e-486e-9ee4-53c68d07e32c\") "
Jul 13 16:09:49.510881 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:49.510825    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e59e70b7-445e-486e-9ee4-53c68d07e32c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e59e70b7-445e-486e-9ee4-53c68d07e32c" (UID: "e59e70b7-445e-486e-9ee4-53c68d07e32c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:09:49.511102 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:49.510890    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e59e70b7-445e-486e-9ee4-53c68d07e32c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e59e70b7-445e-486e-9ee4-53c68d07e32c" (UID: "e59e70b7-445e-486e-9ee4-53c68d07e32c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:09:49.511102 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:49.511049    2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e59e70b7-445e-486e-9ee4-53c68d07e32c-credential-socket\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:09:49.511102 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:49.511068    2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e59e70b7-445e-486e-9ee4-53c68d07e32c-workload-socket\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:09:49.511102 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:49.511081    2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e59e70b7-445e-486e-9ee4-53c68d07e32c-workload-certs\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:09:49.511273 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:49.511167    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e59e70b7-445e-486e-9ee4-53c68d07e32c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e59e70b7-445e-486e-9ee4-53c68d07e32c" (UID: "e59e70b7-445e-486e-9ee4-53c68d07e32c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 16:09:49.511947 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:49.511922    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e59e70b7-445e-486e-9ee4-53c68d07e32c-istio-data" (OuterVolumeSpecName: "istio-data") pod "e59e70b7-445e-486e-9ee4-53c68d07e32c" (UID: "e59e70b7-445e-486e-9ee4-53c68d07e32c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:09:49.512998 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:49.512972    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e59e70b7-445e-486e-9ee4-53c68d07e32c-kube-api-access-fll8c" (OuterVolumeSpecName: "kube-api-access-fll8c") pod "e59e70b7-445e-486e-9ee4-53c68d07e32c" (UID: "e59e70b7-445e-486e-9ee4-53c68d07e32c"). InnerVolumeSpecName "kube-api-access-fll8c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:09:49.513106 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:49.512972    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e59e70b7-445e-486e-9ee4-53c68d07e32c-istio-token" (OuterVolumeSpecName: "istio-token") pod "e59e70b7-445e-486e-9ee4-53c68d07e32c" (UID: "e59e70b7-445e-486e-9ee4-53c68d07e32c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:09:49.513155 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:49.513112    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e59e70b7-445e-486e-9ee4-53c68d07e32c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e59e70b7-445e-486e-9ee4-53c68d07e32c" (UID: "e59e70b7-445e-486e-9ee4-53c68d07e32c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 16:09:49.513155 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:49.513140    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e59e70b7-445e-486e-9ee4-53c68d07e32c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e59e70b7-445e-486e-9ee4-53c68d07e32c" (UID: "e59e70b7-445e-486e-9ee4-53c68d07e32c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 16:09:49.611778 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:49.611735    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fll8c\" (UniqueName: \"kubernetes.io/projected/e59e70b7-445e-486e-9ee4-53c68d07e32c-kube-api-access-fll8c\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:09:49.611778 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:49.611772    2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e59e70b7-445e-486e-9ee4-53c68d07e32c-istio-token\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:09:49.611778 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:49.611781    2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e59e70b7-445e-486e-9ee4-53c68d07e32c-istio-data\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:09:49.611778 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:49.611789    2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e59e70b7-445e-486e-9ee4-53c68d07e32c-istiod-ca-cert\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:09:49.612056 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:49.611797    2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e59e70b7-445e-486e-9ee4-53c68d07e32c-istio-envoy\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:09:49.612056 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:49.611806    2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e59e70b7-445e-486e-9ee4-53c68d07e32c-istio-podinfo\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:09:49.744681 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:49.744647    2555 generic.go:356] "Generic (PLEG): container finished" podID="e59e70b7-445e-486e-9ee4-53c68d07e32c" containerID="fe44e9901d473fb701d85f0ee42a665ed070e5bf2ae640df80b77d5418e87875" exitCode=0
Jul 13 16:09:49.744877 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:49.744698    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm"
Jul 13 16:09:49.744877 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:49.744705    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm" event={"ID":"e59e70b7-445e-486e-9ee4-53c68d07e32c","Type":"ContainerDied","Data":"fe44e9901d473fb701d85f0ee42a665ed070e5bf2ae640df80b77d5418e87875"}
Jul 13 16:09:49.744877 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:49.744748    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm" event={"ID":"e59e70b7-445e-486e-9ee4-53c68d07e32c","Type":"ContainerDied","Data":"4f8219926145aafc9d8567034e1ee0720a939b7e266d2db4dac49b3eba96a795"}
Jul 13 16:09:49.744877 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:49.744768    2555 scope.go:117] "RemoveContainer" containerID="fe44e9901d473fb701d85f0ee42a665ed070e5bf2ae640df80b77d5418e87875"
Jul 13 16:09:49.753648 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:49.753630    2555 scope.go:117] "RemoveContainer" containerID="cbdb1d2406ec07e149ab7bb9848e4ba0aed8bf6c8b3f2d3062975846bb219684"
Jul 13 16:09:49.761578 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:49.761561    2555 scope.go:117] "RemoveContainer" containerID="fe44e9901d473fb701d85f0ee42a665ed070e5bf2ae640df80b77d5418e87875"
Jul 13 16:09:49.761844 ip-10-0-137-93 kubenswrapper[2555]: E0713 16:09:49.761825    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe44e9901d473fb701d85f0ee42a665ed070e5bf2ae640df80b77d5418e87875\": container with ID starting with fe44e9901d473fb701d85f0ee42a665ed070e5bf2ae640df80b77d5418e87875 not found: ID does not exist" containerID="fe44e9901d473fb701d85f0ee42a665ed070e5bf2ae640df80b77d5418e87875"
Jul 13 16:09:49.761901 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:49.761854    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe44e9901d473fb701d85f0ee42a665ed070e5bf2ae640df80b77d5418e87875"} err="failed to get container status \"fe44e9901d473fb701d85f0ee42a665ed070e5bf2ae640df80b77d5418e87875\": rpc error: code = NotFound desc = could not find container \"fe44e9901d473fb701d85f0ee42a665ed070e5bf2ae640df80b77d5418e87875\": container with ID starting with fe44e9901d473fb701d85f0ee42a665ed070e5bf2ae640df80b77d5418e87875 not found: ID does not exist"
Jul 13 16:09:49.761901 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:49.761874    2555 scope.go:117] "RemoveContainer" containerID="cbdb1d2406ec07e149ab7bb9848e4ba0aed8bf6c8b3f2d3062975846bb219684"
Jul 13 16:09:49.762105 ip-10-0-137-93 kubenswrapper[2555]: E0713 16:09:49.762089    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbdb1d2406ec07e149ab7bb9848e4ba0aed8bf6c8b3f2d3062975846bb219684\": container with ID starting with cbdb1d2406ec07e149ab7bb9848e4ba0aed8bf6c8b3f2d3062975846bb219684 not found: ID does not exist" containerID="cbdb1d2406ec07e149ab7bb9848e4ba0aed8bf6c8b3f2d3062975846bb219684"
Jul 13 16:09:49.762150 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:49.762110    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbdb1d2406ec07e149ab7bb9848e4ba0aed8bf6c8b3f2d3062975846bb219684"} err="failed to get container status \"cbdb1d2406ec07e149ab7bb9848e4ba0aed8bf6c8b3f2d3062975846bb219684\": rpc error: code = NotFound desc = could not find container \"cbdb1d2406ec07e149ab7bb9848e4ba0aed8bf6c8b3f2d3062975846bb219684\": container with ID starting with cbdb1d2406ec07e149ab7bb9848e4ba0aed8bf6c8b3f2d3062975846bb219684 not found: ID does not exist"
Jul 13 16:09:49.767414 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:49.767391    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm"]
Jul 13 16:09:49.771286 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:49.771267    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-a1c3e5-openshift-default-55d449ddc5-xwdcm"]
Jul 13 16:09:50.202764 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:50.202686    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e59e70b7-445e-486e-9ee4-53c68d07e32c" path="/var/lib/kubelet/pods/e59e70b7-445e-486e-9ee4-53c68d07e32c/volumes"
Jul 13 16:09:54.922160 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:54.922123    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-4293a7-696fbc484c-ts5fn"]
Jul 13 16:09:54.922670 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:54.922403    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4293a7-696fbc484c-ts5fn" podUID="7d465036-a797-4d5c-a9e8-4ad99b6f6db4" containerName="maas-api" containerID="cri-o://b879a8a2c056e384b4d54461e45ee7eb051c06ae815c7927b70749bb33740b0a" gracePeriod=30
Jul 13 16:09:54.949784 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:54.949758    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:09:55.176363 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:55.176286    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4293a7-696fbc484c-ts5fn"
Jul 13 16:09:55.263505 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:55.263466    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d465036-a797-4d5c-a9e8-4ad99b6f6db4-maas-api-tls\") pod \"7d465036-a797-4d5c-a9e8-4ad99b6f6db4\" (UID: \"7d465036-a797-4d5c-a9e8-4ad99b6f6db4\") "
Jul 13 16:09:55.263809 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:55.263518    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jkhp9\" (UniqueName: \"kubernetes.io/projected/7d465036-a797-4d5c-a9e8-4ad99b6f6db4-kube-api-access-jkhp9\") pod \"7d465036-a797-4d5c-a9e8-4ad99b6f6db4\" (UID: \"7d465036-a797-4d5c-a9e8-4ad99b6f6db4\") "
Jul 13 16:09:55.263809 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:55.263546    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d465036-a797-4d5c-a9e8-4ad99b6f6db4-openshift-service-ca\") pod \"7d465036-a797-4d5c-a9e8-4ad99b6f6db4\" (UID: \"7d465036-a797-4d5c-a9e8-4ad99b6f6db4\") "
Jul 13 16:09:55.263985 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:55.263959    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d465036-a797-4d5c-a9e8-4ad99b6f6db4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7d465036-a797-4d5c-a9e8-4ad99b6f6db4" (UID: "7d465036-a797-4d5c-a9e8-4ad99b6f6db4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 16:09:55.265816 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:55.265789    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d465036-a797-4d5c-a9e8-4ad99b6f6db4-kube-api-access-jkhp9" (OuterVolumeSpecName: "kube-api-access-jkhp9") pod "7d465036-a797-4d5c-a9e8-4ad99b6f6db4" (UID: "7d465036-a797-4d5c-a9e8-4ad99b6f6db4"). InnerVolumeSpecName "kube-api-access-jkhp9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 16:09:55.265816 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:55.265812    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d465036-a797-4d5c-a9e8-4ad99b6f6db4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7d465036-a797-4d5c-a9e8-4ad99b6f6db4" (UID: "7d465036-a797-4d5c-a9e8-4ad99b6f6db4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 16:09:55.365198 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:55.365151    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jkhp9\" (UniqueName: \"kubernetes.io/projected/7d465036-a797-4d5c-a9e8-4ad99b6f6db4-kube-api-access-jkhp9\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:09:55.365198 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:55.365188    2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d465036-a797-4d5c-a9e8-4ad99b6f6db4-openshift-service-ca\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:09:55.365198 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:55.365198    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d465036-a797-4d5c-a9e8-4ad99b6f6db4-maas-api-tls\") on node \"ip-10-0-137-93.ec2.internal\" DevicePath \"\""
Jul 13 16:09:55.777100 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:55.777065    2555 generic.go:356] "Generic (PLEG): container finished" podID="7d465036-a797-4d5c-a9e8-4ad99b6f6db4" containerID="b879a8a2c056e384b4d54461e45ee7eb051c06ae815c7927b70749bb33740b0a" exitCode=0
Jul 13 16:09:55.777277 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:55.777105    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4293a7-696fbc484c-ts5fn"
Jul 13 16:09:55.777277 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:55.777120    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4293a7-696fbc484c-ts5fn" event={"ID":"7d465036-a797-4d5c-a9e8-4ad99b6f6db4","Type":"ContainerDied","Data":"b879a8a2c056e384b4d54461e45ee7eb051c06ae815c7927b70749bb33740b0a"}
Jul 13 16:09:55.777277 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:55.777171    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4293a7-696fbc484c-ts5fn" event={"ID":"7d465036-a797-4d5c-a9e8-4ad99b6f6db4","Type":"ContainerDied","Data":"44f86917a686d139753630a941286e61545734449ead2254f5abd53f235ecc9c"}
Jul 13 16:09:55.777277 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:55.777195    2555 scope.go:117] "RemoveContainer" containerID="b879a8a2c056e384b4d54461e45ee7eb051c06ae815c7927b70749bb33740b0a"
Jul 13 16:09:55.786319 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:55.786302    2555 scope.go:117] "RemoveContainer" containerID="b879a8a2c056e384b4d54461e45ee7eb051c06ae815c7927b70749bb33740b0a"
Jul 13 16:09:55.786617 ip-10-0-137-93 kubenswrapper[2555]: E0713 16:09:55.786597    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b879a8a2c056e384b4d54461e45ee7eb051c06ae815c7927b70749bb33740b0a\": container with ID starting with b879a8a2c056e384b4d54461e45ee7eb051c06ae815c7927b70749bb33740b0a not found: ID does not exist" containerID="b879a8a2c056e384b4d54461e45ee7eb051c06ae815c7927b70749bb33740b0a"
Jul 13 16:09:55.786685 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:55.786626    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b879a8a2c056e384b4d54461e45ee7eb051c06ae815c7927b70749bb33740b0a"} err="failed to get container status \"b879a8a2c056e384b4d54461e45ee7eb051c06ae815c7927b70749bb33740b0a\": rpc error: code = NotFound desc = could not find container \"b879a8a2c056e384b4d54461e45ee7eb051c06ae815c7927b70749bb33740b0a\": container with ID starting with b879a8a2c056e384b4d54461e45ee7eb051c06ae815c7927b70749bb33740b0a not found: ID does not exist"
Jul 13 16:09:55.799623 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:55.799563    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-4293a7-696fbc484c-ts5fn"]
Jul 13 16:09:55.801564 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:55.801536    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-4293a7-696fbc484c-ts5fn"]
Jul 13 16:09:56.204875 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:56.204794    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d465036-a797-4d5c-a9e8-4ad99b6f6db4" path="/var/lib/kubelet/pods/7d465036-a797-4d5c-a9e8-4ad99b6f6db4/volumes"
Jul 13 16:09:59.584844 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:09:59.584808    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:10:05.919187 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:05.919148    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:10:05.974680 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:05.974642    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:10:10.281740 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:10.281695    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:10:10.521365 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:10.521329    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:10:15.907793 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:15.907756    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-b67r8_5e8500e3-6979-44e6-ae9b-522f31726ab6/manager/0.log"
Jul 13 16:10:16.162869 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:16.162790    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5496d869d5-4z6lw_5941779e-a585-4393-8107-4abf90259a6b/manager/0.log"
Jul 13 16:10:16.764267 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:16.764235    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7695c54b44-srkvs_97eb5169-eb65-430e-a099-bb4de7e8b38f/copy-manifests/0.log"
Jul 13 16:10:16.771519 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:16.771493    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7695c54b44-srkvs_97eb5169-eb65-430e-a099-bb4de7e8b38f/manager/0.log"
Jul 13 16:10:17.121012 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:17.120939    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-56464bcd74-jqhlb_740c0bcf-fad9-4e4d-bf80-ef2d84c32043/maas-api/0.log"
Jul 13 16:10:17.239412 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:17.239382    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29732625-2gpqk_7415b735-8b99-42b4-a97c-4c57f2d51967/cleanup/0.log"
Jul 13 16:10:18.273113 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:18.273080    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-migrate-e90cca64-8lbhf_25b34e7f-ab03-403f-b9c7-e67433c787c0/revoke-keys/0.log"
Jul 13 16:10:18.821236 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:18.821210    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-qdg5k_fc8bc0de-ffcd-4571-b6bc-0078c050e04a/postgres/0.log"
Jul 13 16:10:21.859758 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:21.859673    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-b5pfm_f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48/istio-proxy/1.log"
Jul 13 16:10:21.985212 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:21.985180    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-v44pf_a07c4115-54c4-430b-9242-2262c8fa63f5/payload-pre-processing/0.log"
Jul 13 16:10:22.100569 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:22.100531    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-vgnll_e2534dc7-b5b4-41c0-b6ad-51f586e19a2e/payload-processing/0.log"
Jul 13 16:10:22.220514 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:22.220485    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f55fdf65b-nwzqz_b144994d-e58a-4d9c-a003-891172fabc9a/router/0.log"
Jul 13 16:10:22.675324 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:22.675243    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-r6jfq_be3ab37b-024d-4948-9786-9b64fe90cbd0/main/0.log"
Jul 13 16:10:23.019465 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:23.019433    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-wxzls_2ba9aeef-321d-4d06-9c95-8532ac1c2934/main/0.log"
Jul 13 16:10:27.731804 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:27.731761    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-s8tpw/must-gather-xck56"]
Jul 13 16:10:27.732206 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:27.732145    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d465036-a797-4d5c-a9e8-4ad99b6f6db4" containerName="maas-api"
Jul 13 16:10:27.732206 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:27.732160    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d465036-a797-4d5c-a9e8-4ad99b6f6db4" containerName="maas-api"
Jul 13 16:10:27.732206 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:27.732179    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e59e70b7-445e-486e-9ee4-53c68d07e32c" containerName="istio-proxy"
Jul 13 16:10:27.732206 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:27.732185    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="e59e70b7-445e-486e-9ee4-53c68d07e32c" containerName="istio-proxy"
Jul 13 16:10:27.732206 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:27.732195    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1809bbda-5875-4778-a051-2d7b30ff7013" containerName="maas-api"
Jul 13 16:10:27.732206 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:27.732200    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="1809bbda-5875-4778-a051-2d7b30ff7013" containerName="maas-api"
Jul 13 16:10:27.732206 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:27.732209    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="542d5daa-36a0-42af-a6c0-99916dcec9d2" containerName="test-curl-7712-139938564457504"
Jul 13 16:10:27.732442 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:27.732216    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="542d5daa-36a0-42af-a6c0-99916dcec9d2" containerName="test-curl-7712-139938564457504"
Jul 13 16:10:27.732442 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:27.732283    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="542d5daa-36a0-42af-a6c0-99916dcec9d2" containerName="test-curl-7712-139938564457504"
Jul 13 16:10:27.732442 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:27.732305    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="e59e70b7-445e-486e-9ee4-53c68d07e32c" containerName="istio-proxy"
Jul 13 16:10:27.732442 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:27.732311    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="1809bbda-5875-4778-a051-2d7b30ff7013" containerName="maas-api"
Jul 13 16:10:27.732442 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:27.732318    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d465036-a797-4d5c-a9e8-4ad99b6f6db4" containerName="maas-api"
Jul 13 16:10:27.732442 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:27.732328    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="e59e70b7-445e-486e-9ee4-53c68d07e32c" containerName="istio-proxy"
Jul 13 16:10:27.732442 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:27.732391    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e59e70b7-445e-486e-9ee4-53c68d07e32c" containerName="istio-proxy"
Jul 13 16:10:27.732442 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:27.732396    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="e59e70b7-445e-486e-9ee4-53c68d07e32c" containerName="istio-proxy"
Jul 13 16:10:27.735620 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:27.735603    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s8tpw/must-gather-xck56"
Jul 13 16:10:27.737896 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:27.737875    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s8tpw\"/\"openshift-service-ca.crt\""
Jul 13 16:10:27.738752 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:27.738733    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s8tpw\"/\"kube-root-ca.crt\""
Jul 13 16:10:27.738864 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:27.738753    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-s8tpw\"/\"default-dockercfg-qxzff\""
Jul 13 16:10:27.745158 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:27.745135    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s8tpw/must-gather-xck56"]
Jul 13 16:10:27.746728 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:27.746706    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:10:27.832344 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:27.832306    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7djdb\" (UniqueName: \"kubernetes.io/projected/cce28b42-82e5-4ea8-bb51-69b562d7202d-kube-api-access-7djdb\") pod \"must-gather-xck56\" (UID: \"cce28b42-82e5-4ea8-bb51-69b562d7202d\") " pod="openshift-must-gather-s8tpw/must-gather-xck56"
Jul 13 16:10:27.832527 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:27.832355    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cce28b42-82e5-4ea8-bb51-69b562d7202d-must-gather-output\") pod \"must-gather-xck56\" (UID: \"cce28b42-82e5-4ea8-bb51-69b562d7202d\") " pod="openshift-must-gather-s8tpw/must-gather-xck56"
Jul 13 16:10:27.840479 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:27.840452    2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log" limit=1024
Jul 13 16:10:27.933480 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:27.933443    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7djdb\" (UniqueName: \"kubernetes.io/projected/cce28b42-82e5-4ea8-bb51-69b562d7202d-kube-api-access-7djdb\") pod \"must-gather-xck56\" (UID: \"cce28b42-82e5-4ea8-bb51-69b562d7202d\") " pod="openshift-must-gather-s8tpw/must-gather-xck56"
Jul 13 16:10:27.933677 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:27.933497    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cce28b42-82e5-4ea8-bb51-69b562d7202d-must-gather-output\") pod \"must-gather-xck56\" (UID: \"cce28b42-82e5-4ea8-bb51-69b562d7202d\") " pod="openshift-must-gather-s8tpw/must-gather-xck56"
Jul 13 16:10:27.933919 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:27.933900    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cce28b42-82e5-4ea8-bb51-69b562d7202d-must-gather-output\") pod \"must-gather-xck56\" (UID: \"cce28b42-82e5-4ea8-bb51-69b562d7202d\") " pod="openshift-must-gather-s8tpw/must-gather-xck56"
Jul 13 16:10:27.942233 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:27.942210    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7djdb\" (UniqueName: \"kubernetes.io/projected/cce28b42-82e5-4ea8-bb51-69b562d7202d-kube-api-access-7djdb\") pod \"must-gather-xck56\" (UID: \"cce28b42-82e5-4ea8-bb51-69b562d7202d\") " pod="openshift-must-gather-s8tpw/must-gather-xck56"
Jul 13 16:10:28.045709 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:28.045626    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s8tpw/must-gather-xck56"
Jul 13 16:10:28.179962 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:28.179942    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s8tpw/must-gather-xck56"]
Jul 13 16:10:28.181882 ip-10-0-137-93 kubenswrapper[2555]: W0713 16:10:28.181854    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcce28b42_82e5_4ea8_bb51_69b562d7202d.slice/crio-4148280aca9658254066e3ea2ea4290b97b59efc8814debcd086744a3d157076 WatchSource:0}: Error finding container 4148280aca9658254066e3ea2ea4290b97b59efc8814debcd086744a3d157076: Status 404 returned error can't find the container with id 4148280aca9658254066e3ea2ea4290b97b59efc8814debcd086744a3d157076
Jul 13 16:10:28.936924 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:28.936882    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s8tpw/must-gather-xck56" event={"ID":"cce28b42-82e5-4ea8-bb51-69b562d7202d","Type":"ContainerStarted","Data":"4148280aca9658254066e3ea2ea4290b97b59efc8814debcd086744a3d157076"}
Jul 13 16:10:29.946340 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:29.946288    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s8tpw/must-gather-xck56" event={"ID":"cce28b42-82e5-4ea8-bb51-69b562d7202d","Type":"ContainerStarted","Data":"1de245a9df0dbb60d74bc4de82f51ddff6ab32d05fb3e0dc7e18aa7382049dc8"}
Jul 13 16:10:29.946923 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:29.946889    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s8tpw/must-gather-xck56" event={"ID":"cce28b42-82e5-4ea8-bb51-69b562d7202d","Type":"ContainerStarted","Data":"30987863d1df92671bf90de4da128068b61b7a4a622f49a9757c9c4caa9ead05"}
Jul 13 16:10:29.964614 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:29.964542    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-s8tpw/must-gather-xck56" podStartSLOduration=2.174414546 podStartE2EDuration="2.96452683s" totalImagesPullingTime="790.112284ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 16:10:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:10:29.962433471 +0000 UTC m=+2816.287155367" watchObservedRunningTime="2026-07-13 16:10:29.96452683 +0000 UTC m=+2816.289248726"
Jul 13 16:10:30.671951 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:30.671920    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hdgtx_1f78133a-9d4f-47fb-8253-2220a6139ab9/global-pull-secret-syncer/0.log"
Jul 13 16:10:30.775031 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:30.775004    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-474qm_18dbbb96-8987-4ae8-bdf7-1ecee7120b97/konnectivity-agent/0.log"
Jul 13 16:10:30.876283 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:30.876248    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-93.ec2.internal_eda63208df358e0e9bf9d712ad8f74a0/haproxy/0.log"
Jul 13 16:10:37.692386 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:37.692308    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-hmvfz_b605a361-0f6b-4318-b532-efcfbd569501/cluster-monitoring-operator/0.log"
Jul 13 16:10:37.908239 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:37.908202    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6qdcn_f3f7655b-679e-4b6f-a692-5c4dd8cc623c/node-exporter/0.log"
Jul 13 16:10:37.936190 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:37.936165    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6qdcn_f3f7655b-679e-4b6f-a692-5c4dd8cc623c/kube-rbac-proxy/0.log"
Jul 13 16:10:37.962003 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:37.961924    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6qdcn_f3f7655b-679e-4b6f-a692-5c4dd8cc623c/init-textfile/0.log"
Jul 13 16:10:39.909984 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:39.909947    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-tc2dm_345f2b29-8ee5-4aef-97b7-422594da4954/networking-console-plugin/0.log"
Jul 13 16:10:40.528135 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:40.528090    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cptrx_90f53326-a36e-4682-a268-bdfec7cf722b/console-operator/1.log"
Jul 13 16:10:40.533561 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:40.533532    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cptrx_90f53326-a36e-4682-a268-bdfec7cf722b/console-operator/2.log"
Jul 13 16:10:40.736042 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:40.735998    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-s8tpw/perf-node-gather-daemonset-k4nd6"]
Jul 13 16:10:40.744177 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:40.744141    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-k4nd6"
Jul 13 16:10:40.750001 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:40.749966    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s8tpw/perf-node-gather-daemonset-k4nd6"]
Jul 13 16:10:40.773552 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:40.773514    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1e827d32-23e0-4a5e-b219-0cbae3dbaa2e-proc\") pod \"perf-node-gather-daemonset-k4nd6\" (UID: \"1e827d32-23e0-4a5e-b219-0cbae3dbaa2e\") " pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-k4nd6"
Jul 13 16:10:40.773741 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:40.773605    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1e827d32-23e0-4a5e-b219-0cbae3dbaa2e-lib-modules\") pod \"perf-node-gather-daemonset-k4nd6\" (UID: \"1e827d32-23e0-4a5e-b219-0cbae3dbaa2e\") " pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-k4nd6"
Jul 13 16:10:40.773741 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:40.773697    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1e827d32-23e0-4a5e-b219-0cbae3dbaa2e-sys\") pod \"perf-node-gather-daemonset-k4nd6\" (UID: \"1e827d32-23e0-4a5e-b219-0cbae3dbaa2e\") " pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-k4nd6"
Jul 13 16:10:40.773821 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:40.773783    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1e827d32-23e0-4a5e-b219-0cbae3dbaa2e-podres\") pod \"perf-node-gather-daemonset-k4nd6\" (UID: \"1e827d32-23e0-4a5e-b219-0cbae3dbaa2e\") " pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-k4nd6"
Jul 13 16:10:40.773860 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:40.773822    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnntr\" (UniqueName: \"kubernetes.io/projected/1e827d32-23e0-4a5e-b219-0cbae3dbaa2e-kube-api-access-gnntr\") pod \"perf-node-gather-daemonset-k4nd6\" (UID: \"1e827d32-23e0-4a5e-b219-0cbae3dbaa2e\") " pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-k4nd6"
Jul 13 16:10:40.875135 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:40.875045    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnntr\" (UniqueName: \"kubernetes.io/projected/1e827d32-23e0-4a5e-b219-0cbae3dbaa2e-kube-api-access-gnntr\") pod \"perf-node-gather-daemonset-k4nd6\" (UID: \"1e827d32-23e0-4a5e-b219-0cbae3dbaa2e\") " pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-k4nd6"
Jul 13 16:10:40.875424 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:40.875403    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1e827d32-23e0-4a5e-b219-0cbae3dbaa2e-proc\") pod \"perf-node-gather-daemonset-k4nd6\" (UID: \"1e827d32-23e0-4a5e-b219-0cbae3dbaa2e\") " pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-k4nd6"
Jul 13 16:10:40.875621 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:40.875577    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1e827d32-23e0-4a5e-b219-0cbae3dbaa2e-lib-modules\") pod \"perf-node-gather-daemonset-k4nd6\" (UID: \"1e827d32-23e0-4a5e-b219-0cbae3dbaa2e\") " pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-k4nd6"
Jul 13 16:10:40.875742 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:40.875718    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1e827d32-23e0-4a5e-b219-0cbae3dbaa2e-proc\") pod \"perf-node-gather-daemonset-k4nd6\" (UID: \"1e827d32-23e0-4a5e-b219-0cbae3dbaa2e\") " pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-k4nd6"
Jul 13 16:10:40.875910 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:40.875755    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1e827d32-23e0-4a5e-b219-0cbae3dbaa2e-sys\") pod \"perf-node-gather-daemonset-k4nd6\" (UID: \"1e827d32-23e0-4a5e-b219-0cbae3dbaa2e\") " pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-k4nd6"
Jul 13 16:10:40.876099 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:40.876084    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1e827d32-23e0-4a5e-b219-0cbae3dbaa2e-podres\") pod \"perf-node-gather-daemonset-k4nd6\" (UID: \"1e827d32-23e0-4a5e-b219-0cbae3dbaa2e\") " pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-k4nd6"
Jul 13 16:10:40.876243 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:40.875933    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1e827d32-23e0-4a5e-b219-0cbae3dbaa2e-lib-modules\") pod \"perf-node-gather-daemonset-k4nd6\" (UID: \"1e827d32-23e0-4a5e-b219-0cbae3dbaa2e\") " pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-k4nd6"
Jul 13 16:10:40.876355 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:40.875817    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1e827d32-23e0-4a5e-b219-0cbae3dbaa2e-sys\") pod \"perf-node-gather-daemonset-k4nd6\" (UID: \"1e827d32-23e0-4a5e-b219-0cbae3dbaa2e\") " pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-k4nd6"
Jul 13 16:10:40.876576 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:40.876561    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1e827d32-23e0-4a5e-b219-0cbae3dbaa2e-podres\") pod \"perf-node-gather-daemonset-k4nd6\" (UID: \"1e827d32-23e0-4a5e-b219-0cbae3dbaa2e\") " pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-k4nd6"
Jul 13 16:10:40.884475 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:40.884443    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnntr\" (UniqueName: \"kubernetes.io/projected/1e827d32-23e0-4a5e-b219-0cbae3dbaa2e-kube-api-access-gnntr\") pod \"perf-node-gather-daemonset-k4nd6\" (UID: \"1e827d32-23e0-4a5e-b219-0cbae3dbaa2e\") " pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-k4nd6"
Jul 13 16:10:41.057779 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:41.057743    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-k4nd6"
Jul 13 16:10:41.241650 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:41.241275    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s8tpw/perf-node-gather-daemonset-k4nd6"]
Jul 13 16:10:41.254418 ip-10-0-137-93 kubenswrapper[2555]: W0713 16:10:41.254371    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1e827d32_23e0_4a5e_b219_0cbae3dbaa2e.slice/crio-6963a9872efe3a36d05f0ce8182490521dcc92201e7262e6417a63bbbdd1a0cb WatchSource:0}: Error finding container 6963a9872efe3a36d05f0ce8182490521dcc92201e7262e6417a63bbbdd1a0cb: Status 404 returned error can't find the container with id 6963a9872efe3a36d05f0ce8182490521dcc92201e7262e6417a63bbbdd1a0cb
Jul 13 16:10:41.763191 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:41.763154    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-z7kxm_30748184-f09b-494c-bb8d-04fa13aff3b9/volume-data-source-validator/0.log"
Jul 13 16:10:42.048992 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:42.048893    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-k4nd6" event={"ID":"1e827d32-23e0-4a5e-b219-0cbae3dbaa2e","Type":"ContainerStarted","Data":"117096bafe1500890cb42438414da38b63451ce2c27d793061fd37db1e1ce17a"}
Jul 13 16:10:42.048992 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:42.048962    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-k4nd6" event={"ID":"1e827d32-23e0-4a5e-b219-0cbae3dbaa2e","Type":"ContainerStarted","Data":"6963a9872efe3a36d05f0ce8182490521dcc92201e7262e6417a63bbbdd1a0cb"}
Jul 13 16:10:42.049629 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:42.049601    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-k4nd6"
Jul 13 16:10:42.067069 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:42.067021    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-k4nd6" podStartSLOduration=2.066993132 podStartE2EDuration="2.066993132s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 16:10:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 16:10:42.065557144 +0000 UTC m=+2828.390279040" watchObservedRunningTime="2026-07-13 16:10:42.066993132 +0000 UTC m=+2828.391715055"
Jul 13 16:10:42.805889 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:42.805857    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tdnrr_72ca268f-c70d-4218-a657-7f1f9f4b1d7c/dns/0.log"
Jul 13 16:10:42.824158 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:42.824114    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tdnrr_72ca268f-c70d-4218-a657-7f1f9f4b1d7c/kube-rbac-proxy/0.log"
Jul 13 16:10:42.907842 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:42.907815    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-msf42_9ede2cce-055c-4a8d-a4f2-aaed0d7c818d/dns-node-resolver/0.log"
Jul 13 16:10:43.521751 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:43.521707    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gndtt_0d9e5461-c76c-4666-92dd-6c8eadd6b6d7/node-ca/0.log"
Jul 13 16:10:44.738603 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:44.738559    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-b5pfm_f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48/istio-proxy/0.log"
Jul 13 16:10:44.781686 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:44.781656    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-b5pfm_f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48/istio-proxy/1.log"
Jul 13 16:10:44.814515 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:44.814481    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-v44pf_a07c4115-54c4-430b-9242-2262c8fa63f5/payload-pre-processing/0.log"
Jul 13 16:10:44.845927 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:44.845897    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-vgnll_e2534dc7-b5b4-41c0-b6ad-51f586e19a2e/payload-processing/0.log"
Jul 13 16:10:44.866477 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:44.866440    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f55fdf65b-nwzqz_b144994d-e58a-4d9c-a003-891172fabc9a/router/0.log"
Jul 13 16:10:45.608469 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:45.608437    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wqtv7_5ee75ad9-88fc-477e-af2f-d31a4c51801f/serve-healthcheck-canary/0.log"
Jul 13 16:10:46.075227 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:46.075190    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-nn7v5_42b230fa-7a3d-43ef-909f-24805511fd6d/insights-operator/0.log"
Jul 13 16:10:46.076140 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:46.076123    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-nn7v5_42b230fa-7a3d-43ef-909f-24805511fd6d/insights-operator/1.log"
Jul 13 16:10:46.229743 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:46.229708    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vwk27_20415ed9-d86c-492d-bb29-21922b2a8677/kube-rbac-proxy/0.log"
Jul 13 16:10:46.249108 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:46.249074    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vwk27_20415ed9-d86c-492d-bb29-21922b2a8677/exporter/0.log"
Jul 13 16:10:46.269760 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:46.269731    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vwk27_20415ed9-d86c-492d-bb29-21922b2a8677/extractor/0.log"
Jul 13 16:10:48.399447 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:48.399414    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-b67r8_5e8500e3-6979-44e6-ae9b-522f31726ab6/manager/0.log"
Jul 13 16:10:48.768387 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:48.768356    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5496d869d5-4z6lw_5941779e-a585-4393-8107-4abf90259a6b/manager/0.log"
Jul 13 16:10:49.074389 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:49.074317    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-s8tpw/perf-node-gather-daemonset-k4nd6"
Jul 13 16:10:49.078216 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:49.078193    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7695c54b44-srkvs_97eb5169-eb65-430e-a099-bb4de7e8b38f/manager/0.log"
Jul 13 16:10:49.099944 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:49.099918    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7695c54b44-srkvs_97eb5169-eb65-430e-a099-bb4de7e8b38f/copy-manifests/0.log"
Jul 13 16:10:50.240405 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:50.240378    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7b567978d6-xj8bl_f6adab2a-02ff-4c13-8a56-d4ad4a8804ae/manager/0.log"
Jul 13 16:10:51.220189 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:51.220159    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-b5pfm_f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48/istio-proxy/0.log"
Jul 13 16:10:51.267282 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:51.267245    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-b5pfm_f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48/istio-proxy/1.log"
Jul 13 16:10:51.295728 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:51.295700    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-v44pf_a07c4115-54c4-430b-9242-2262c8fa63f5/payload-pre-processing/0.log"
Jul 13 16:10:51.330175 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:51.330140    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-vgnll_e2534dc7-b5b4-41c0-b6ad-51f586e19a2e/payload-processing/0.log"
Jul 13 16:10:51.372450 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:51.372416    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f55fdf65b-nwzqz_b144994d-e58a-4d9c-a003-891172fabc9a/router/0.log"
Jul 13 16:10:52.827725 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:52.827693    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-b5pfm_f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48/istio-proxy/0.log"
Jul 13 16:10:52.871219 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:52.871186    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-b5pfm_f9d12fc4-f2cc-4afa-9b03-5c0a3a5b2f48/istio-proxy/1.log"
Jul 13 16:10:52.897165 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:52.897129    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-v44pf_a07c4115-54c4-430b-9242-2262c8fa63f5/payload-pre-processing/0.log"
Jul 13 16:10:52.921897 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:52.921868    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-vgnll_e2534dc7-b5b4-41c0-b6ad-51f586e19a2e/payload-processing/0.log"
Jul 13 16:10:52.942765 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:52.942732    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f55fdf65b-nwzqz_b144994d-e58a-4d9c-a003-891172fabc9a/router/0.log"
Jul 13 16:10:55.636031 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:55.636002    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-wzqbw_c0e309cc-8060-4f5d-8f0b-898b69b0b5f9/migrator/0.log"
Jul 13 16:10:55.674741 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:55.674706    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-wzqbw_c0e309cc-8060-4f5d-8f0b-898b69b0b5f9/graceful-termination/0.log"
Jul 13 16:10:56.050343 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:56.050301    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-qtg8w_118282ab-3ef5-49f2-ad43-9d5eefdacf9b/kube-storage-version-migrator-operator/1.log"
Jul 13 16:10:56.051214 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:56.051198    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-qtg8w_118282ab-3ef5-49f2-ad43-9d5eefdacf9b/kube-storage-version-migrator-operator/0.log"
Jul 13 16:10:57.174277 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:57.174249    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-82fdm_77127f7b-f478-42a2-9972-255956e53070/kube-multus/0.log"
Jul 13 16:10:57.484972 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:57.484947    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vjmns_25a82f60-2fa2-49cb-b7fc-84496432841f/kube-multus-additional-cni-plugins/0.log"
Jul 13 16:10:57.505322 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:57.505287    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vjmns_25a82f60-2fa2-49cb-b7fc-84496432841f/egress-router-binary-copy/0.log"
Jul 13 16:10:57.525674 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:57.525653    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vjmns_25a82f60-2fa2-49cb-b7fc-84496432841f/cni-plugins/0.log"
Jul 13 16:10:57.546234 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:57.546207    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vjmns_25a82f60-2fa2-49cb-b7fc-84496432841f/bond-cni-plugin/0.log"
Jul 13 16:10:57.564955 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:57.564925    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vjmns_25a82f60-2fa2-49cb-b7fc-84496432841f/routeoverride-cni/0.log"
Jul 13 16:10:57.584326 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:57.584301    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vjmns_25a82f60-2fa2-49cb-b7fc-84496432841f/whereabouts-cni-bincopy/0.log"
Jul 13 16:10:57.603140 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:57.603111    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vjmns_25a82f60-2fa2-49cb-b7fc-84496432841f/whereabouts-cni/0.log"
Jul 13 16:10:57.662245 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:57.662219    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5bv64_d500cafe-37f3-4c98-8bef-63ba985b79fa/network-metrics-daemon/0.log"
Jul 13 16:10:57.678163 ip-10-0-137-93 kubenswrapper[2555]: I0713 16:10:57.678138    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5bv64_d500cafe-37f3-4c98-8bef-63ba985b79fa/kube-rbac-proxy/0.log"